python - XPath with Scrapy node begins with \n -

-

i'm using scrapy on html like:

<td nowrap="" valign="top" align="right">     <br>     text here.     <br>     other text here     <br> </td>

td[1]/text()[1] gives me:

(empty line) text here.

i've tried normalize-space, i.e. normalize-space(td[1]/text()[1]), works when test in firefox extension, not in scrapy. think scrapy getting tripped \n , skips on (or takes first line of node, nothing). i've tried "preceding" , "following" code, think might considered 1 element, dom says nodevalue = "\ntext here" thoughts?,

extract every text, desired 1 index. instance:

response.xpath("//table[@id='myid']/tr[1]/td[1]//text()")[1]

demo scrapy shell:

$ scrapy shell http://www.trobar.org/troubadours/coms_de_peiteu/guilhen_de_peiteu_01.php in [1]: table = response.xpath("//table")[2] in [2]: td = "".join(table.xpath(".//td[1]//text()").extract()) in [3]: print(td)  companho, farai un vers qu'er covinen, et aura-i mais de foudatz no-y de sen, et er totz mesclatz d'amor e de joy e de joven.  e tenguatz lo per vilan qui no-l enten, o dins son cor voluntiers non l'apren: greu partir si fai d'amor qui la troba talen.  dos cavalhs ai ma sselha, ben e gen, bon son et adreg per armas e valen, e no-ls puesc amdos tener, que l'us l'autre non cossen.  si-ls pogues adomesjar mon talen, ja no volgr'alhors mudar mon garnimen, que meils for'encavalguatz de nuill ome viven.  launs fon dels montaniers lo plus corren, mas aitan fer' estranhez'a longuamen et es tan fers e salvatges, que del bailar si defen.  l'autre fon noyritz sa jus part cofolen ez anc no-n vis bellazor, mon escien: aquest non er ja camjatz ni per aur ni per argen.  qu'ie-l donei son senhor polin payssen, pero si-m retinc ieu tan de covenen que, s'ilh lo tenia un an, qu'ieu lo tengues mais de cen.  cavalier, datz mi cosselh d'un pessamen: -anc mays no fuy issaratz de cauzimen- : res non sai ab qual me tengua, de n'agnes o de n'arsen.  de gimel ai lo castel e-l mandamen, e per niol fauc ergueill tota gen: c'ambedui me son jurat e plevit per sagramen.

Comments

Post a Comment

Popular posts from this blog

yii2 - Yii 2 Running a Cron in the basic template -

-
i have seen instructions on running cron in advanced template, cant figure out how on basic template. have following controller in basic controllers folder. <?php namespace app\controllers; use yii\console\controller; /** * cron controller */ class croncontroller extends controller { public function actionindex() { echo "cron service runnning"; } public function actionmail($to) { echo "sending mail " . $to; } } i have navigated root of application , tried these comands yii cron php yii cron im getting unknown comand "cron" i know old question failed find actual answer this. if @ code yii exec file you'll notice requires /common/config/aliases.php file console/config/main.php. can naturally change these or copy on these advanced template. hope solves problem wanting same thing.
Read more

asp.net - 'System.Web.HttpContext' does not contain a definition for 'GetOwinContext' Mystery -

-
i realize question might seem trivial some, it's these types of things find myself fighting quite bit , want make sense of despite seeming losing battle in .net (for me anyway). so, if following: using system.web; ... applicationuser user = system.web.httpcontext.getowincontext().getusermanager<applicationusermanager>().findbyid(system.web.httpcontext.user.identity.getuserid()); that produces error in title , red getowincontext() , error cannot resolve symbol 'getowincontext()' however, if following (remove system.web in front of httpcontext ), works expected (or @ least no errors): using system.web; ... applicationuser user = httpcontext.getowincontext().getusermanager<applicationusermanager>().findbyid(system.web.httpcontext.user.identity.getuserid()); however, if (same line that's working using system.web commented out): //using system.web; ... applicationuser user = httpcontext.getowincontext().getusermana
Read more

php - How do you embed a video into a custom theme on WordPress? -

-
i'm using wordpress 4.2.3 , created custom theme use. when try embed youtube video (pasting http:// link content area), video shows in edit content area, when view site, shows text url instead. i tried sorts of things clear formatting, removing link, unchecking settings in writing area, etc. temporarily switched default wp theme , video shows up, i'm missing in template code, , can't figure out what. here code used outputting content in template. index.php <div class="video"> <?php $post_id = 26; $queried_post = get_post($post_id); echo $queried_post->post_content; ?> </div> thanks - appreciate it!
Read more