python - Writer.add_document() function error Whoosh - mysql loop -

-

i'm trying index large amount of articles db encoded in latin1. i've solved encoding issue charset, not able add index each row.

i've tried : 1)

writer.add_document(id = unicode(row["id"]),body = unicode(row["body"]), name = unicode(row["name"]), brand = unicode(row["brand"]), familia = unicode(row["familia"]))

this indexes docs not respects index labels.

2)

writer.add_document(doc)

this reports add_document() takes 1 argument (2 given) error

here full code:

# open writer index ix.writer() writer:  con= mdb.connect(host="myhost",                       user="myuser",                       passwd="pass",                       db="db",                       charset="utf8",                       use_unicode=true) con:      cur = con.cursor(mdb.cursors.dictcursor)     #cur.execute("select  id, body, name, brand, familia articles")     rows = cur.fetchall()     row in rows:         print row         doc6 = row["brand"]         doc2 = row["name"]         print doc2         print 'body'         doc3 = row["body"].replace("á", "a")         doc3 = doc3.replace("é", "e")         doc3 = doc3.replace("í", "i")         doc3 = doc3.replace("ó", "o")         doc3 = doc3.replace("ú", "u")         doc3 = doc3.replace("ñ", "n")         doc3 = doc3.replace(""", "")         print doc3         print 'familia'         doc4 = row["familia"]         print doc4         print 'id'         doc5 = row["id"]         print doc5          writer.add_document(id = unicode(row["id"]),body = unicode(row["body"]), name = unicode(row["name"]), brand = unicode(row["brand"]), familia = unicode(row["familia"]))        #        # doc = unicode(doc5),unicode(doc3), unicode(doc2), unicode(doc6), unicode(doc4)        # writer.add_document(doc) #reports add_document() takes 1 argument (2 given) error        #writer.add_document(id = unicode(doc5),body = unicode(doc3), name = unicode(doc2), brand = unicode(doc6), familia = unicode(doc4))   numdocs = ix.doc_count_all() print "docs indexed =", numdocs

thank in advance!

solved way:

with con:     cur = con.cursor(mdb.cursors.dictcursor)    #cur.execute("select  id, body, name, brand, familia articles")    rows = cur.fetchall()    row in rows:          #print row          row["body"]= row["body"].replace("á", "a")          row["body"]= row["body"].replace("é", "e")          row["body"]= row["body"].replace("í", "i")          row["body"]= row["body"].replace("ó", "o")          row["body"]= row["body"].replace("ú", "u")          row["body"]= row["body"].replace("ñ", "n")          row["body"]= row["body"].replace(""", "")           writer.add_document(id=unicode(row["id"]),                         body=unicode(row["body"]),                         name=unicode(row["name"]),                         brand=unicode(row["brand"]),                         familia=unicode(row["familia"]),                         relevancia=row["relevancia"])  numdocs = ix.doc_count_all() print "docs indexed =", numdocs

special thank whoosh team patient , kindly solve doubts.


Comments

Post a Comment

Popular posts from this blog

yii2 - Yii 2 Running a Cron in the basic template -

-
i have seen instructions on running cron in advanced template, cant figure out how on basic template. have following controller in basic controllers folder. <?php namespace app\controllers; use yii\console\controller; /** * cron controller */ class croncontroller extends controller { public function actionindex() { echo "cron service runnning"; } public function actionmail($to) { echo "sending mail " . $to; } } i have navigated root of application , tried these comands yii cron php yii cron im getting unknown comand "cron" i know old question failed find actual answer this. if @ code yii exec file you'll notice requires /common/config/aliases.php file console/config/main.php. can naturally change these or copy on these advanced template. hope solves problem wanting same thing.
Read more

asp.net - 'System.Web.HttpContext' does not contain a definition for 'GetOwinContext' Mystery -

-
i realize question might seem trivial some, it's these types of things find myself fighting quite bit , want make sense of despite seeming losing battle in .net (for me anyway). so, if following: using system.web; ... applicationuser user = system.web.httpcontext.getowincontext().getusermanager<applicationusermanager>().findbyid(system.web.httpcontext.user.identity.getuserid()); that produces error in title , red getowincontext() , error cannot resolve symbol 'getowincontext()' however, if following (remove system.web in front of httpcontext ), works expected (or @ least no errors): using system.web; ... applicationuser user = httpcontext.getowincontext().getusermanager<applicationusermanager>().findbyid(system.web.httpcontext.user.identity.getuserid()); however, if (same line that's working using system.web commented out): //using system.web; ... applicationuser user = httpcontext.getowincontext().getusermana...
Read more

mercurial graft feature, can it copy? -

-
there new feature in mercurial 3, called 'graft' (graft local). job of moving change-set different branch. is there way "copy" change-set branch? i interested in in moving stuff qa branch production branch, still need code reside in qa. want copy. found , have tried few things, maybe it'll become clear more tinkering , reading... does have better way of 'cherry picking' change-sets move cross branch (or trunk)??? graft copies changesets, doesn't move them. hg graft (emphasis mine): this command uses mercurial's merge logic copy individual changes other branches without merging branches in history graph. known 'backporting' or 'cherry-picking' . default, graft copy user, date, , description source changesets.
Read more