Listening for new files Python -

-

i trying find solution problem have... have big share contains hundreds of thousands(if not millions) of files , new files arriving every second. trying write application make faster find files in share idea insert file names in redis db in format of : {'file_name','file_path'} , when file needed pull path db... problem starts when trying index old files(i assume take @ least few hours) while simeltaniously listen new files arrive during process. example of i'am trying do:

import redis import os r = redis.strictredis(host='localhost',port=6379,db=0) root, dirs, files in os.walk(r'd:\\'):     file in files:         r.set(os.path.basename(file),os.path.join(root, file))         print 'the file %s succefuly added' %os.path.basename(file)

how supposed modify code keep listening new files?

thanks help!=)

you should take @ watchdog library. you're looking for. here's example of using it: 

import sys import time import logging watchdog.observers import observer watchdog.events import loggingeventhandler  if __name__ == "__main__":     logging.basicconfig(level=logging.info,                         format='%(asctime)s - %(message)s',                         datefmt='%y-%m-%d %h:%m:%s')     path = sys.argv[1] if len(sys.argv) > 1 else '.'     event_handler = loggingeventhandler()     observer = observer()     observer.schedule(event_handler, path, recursive=true)     observer.start()     try:         while true:             time.sleep(1)     except keyboardinterrupt:         observer.stop()     observer.join()

Comments

Post a Comment

Popular posts from this blog

yii2 - Yii 2 Running a Cron in the basic template -

-
i have seen instructions on running cron in advanced template, cant figure out how on basic template. have following controller in basic controllers folder. <?php namespace app\controllers; use yii\console\controller; /** * cron controller */ class croncontroller extends controller { public function actionindex() { echo "cron service runnning"; } public function actionmail($to) { echo "sending mail " . $to; } } i have navigated root of application , tried these comands yii cron php yii cron im getting unknown comand "cron" i know old question failed find actual answer this. if @ code yii exec file you'll notice requires /common/config/aliases.php file console/config/main.php. can naturally change these or copy on these advanced template. hope solves problem wanting same thing.
Read more

asp.net - 'System.Web.HttpContext' does not contain a definition for 'GetOwinContext' Mystery -

-
i realize question might seem trivial some, it's these types of things find myself fighting quite bit , want make sense of despite seeming losing battle in .net (for me anyway). so, if following: using system.web; ... applicationuser user = system.web.httpcontext.getowincontext().getusermanager<applicationusermanager>().findbyid(system.web.httpcontext.user.identity.getuserid()); that produces error in title , red getowincontext() , error cannot resolve symbol 'getowincontext()' however, if following (remove system.web in front of httpcontext ), works expected (or @ least no errors): using system.web; ... applicationuser user = httpcontext.getowincontext().getusermanager<applicationusermanager>().findbyid(system.web.httpcontext.user.identity.getuserid()); however, if (same line that's working using system.web commented out): //using system.web; ... applicationuser user = httpcontext.getowincontext().getusermana
Read more

c# - MSDN OneNote Api: Navigate to never before opened page without opening a OneNote Application Window -

-
my goal able use c# programmatically open .one section file , of section's page ids. in simple case (one have created , used section), can done following code: using microsoft.office.interop.onenote; class program { public static void processonenotefile() { application onenoteapp = new application(); string filepath = @"c:\users\admin\documents\onenote notebooks\my notebook\testsection.one"; string sectionid; onenoteapp.openhierarchy(filepath, null, out sectionid); string hierarchy; onenoteapp.gethierarchy(sectionid, hierarchyscope.hspages, out hierarchy); file.writealltext(@"c:\hierarchy.txt", hierarchy); } } from here can parse xml find pageids , go. the problem, however, want files getting else , have never opened before. when run same code on files, cannot find pageids in hierarchy, , therefore, cannot process pages. fix seems work use navigateto method open section file in onenot
Read more