Listening for new files Python -

-

i trying find solution problem have... have big share contains hundreds of thousands(if not millions) of files , new files arriving every second. trying write application make faster find files in share idea insert file names in redis db in format of : {'file_name','file_path'} , when file needed pull path db... problem starts when trying index old files(i assume take @ least few hours) while simeltaniously listen new files arrive during process. example of i'am trying do:

import redis import os r = redis.strictredis(host='localhost',port=6379,db=0) root, dirs, files in os.walk(r'd:\\'):     file in files:         r.set(os.path.basename(file),os.path.join(root, file))         print 'the file %s succefuly added' %os.path.basename(file)

how supposed modify code keep listening new files?

thanks help!=)

you should take @ watchdog library. you're looking for. here's example of using it: 

import sys import time import logging watchdog.observers import observer watchdog.events import loggingeventhandler  if __name__ == "__main__":     logging.basicconfig(level=logging.info,                         format='%(asctime)s - %(message)s',                         datefmt='%y-%m-%d %h:%m:%s')     path = sys.argv[1] if len(sys.argv) > 1 else '.'     event_handler = loggingeventhandler()     observer = observer()     observer.schedule(event_handler, path, recursive=true)     observer.start()     try:         while true:             time.sleep(1)     except keyboardinterrupt:         observer.stop()     observer.join()

Comments

Post a Comment

Popular posts from this blog

yii2 - Yii 2 Running a Cron in the basic template -

-
i have seen instructions on running cron in advanced template, cant figure out how on basic template. have following controller in basic controllers folder. <?php namespace app\controllers; use yii\console\controller; /** * cron controller */ class croncontroller extends controller { public function actionindex() { echo "cron service runnning"; } public function actionmail($to) { echo "sending mail " . $to; } } i have navigated root of application , tried these comands yii cron php yii cron im getting unknown comand "cron" i know old question failed find actual answer this. if @ code yii exec file you'll notice requires /common/config/aliases.php file console/config/main.php. can naturally change these or copy on these advanced template. hope solves problem wanting same thing.
Read more

asp.net - 'System.Web.HttpContext' does not contain a definition for 'GetOwinContext' Mystery -

-
i realize question might seem trivial some, it's these types of things find myself fighting quite bit , want make sense of despite seeming losing battle in .net (for me anyway). so, if following: using system.web; ... applicationuser user = system.web.httpcontext.getowincontext().getusermanager<applicationusermanager>().findbyid(system.web.httpcontext.user.identity.getuserid()); that produces error in title , red getowincontext() , error cannot resolve symbol 'getowincontext()' however, if following (remove system.web in front of httpcontext ), works expected (or @ least no errors): using system.web; ... applicationuser user = httpcontext.getowincontext().getusermanager<applicationusermanager>().findbyid(system.web.httpcontext.user.identity.getuserid()); however, if (same line that's working using system.web commented out): //using system.web; ... applicationuser user = httpcontext.getowincontext().getusermana...
Read more

mercurial graft feature, can it copy? -

-
there new feature in mercurial 3, called 'graft' (graft local). job of moving change-set different branch. is there way "copy" change-set branch? i interested in in moving stuff qa branch production branch, still need code reside in qa. want copy. found , have tried few things, maybe it'll become clear more tinkering , reading... does have better way of 'cherry picking' change-sets move cross branch (or trunk)??? graft copies changesets, doesn't move them. hg graft (emphasis mine): this command uses mercurial's merge logic copy individual changes other branches without merging branches in history graph. known 'backporting' or 'cherry-picking' . default, graft copy user, date, , description source changesets.
Read more