mysql - Update in SQOOP Export not working -

-

i using hadoop 2.5.0 , sqoop 1.4.5.

i trying update in mysql following sqoop export command:

sqoop export --connect "connect_string" --username "user" --password "pass" --table "table_name" --columns "a,b,created_dtm,d,e" --export-dir "export_dir" --input-null-string "" --input-null-non-string "" --input-escaped-by \\ --input-fields-terminated-by "," --input-lines-terminated-by "\\n" --update-key --update-mode "allowinsert" -m 1;

a defined unique key in table structure.

but getting below exception , job hangs:

org.apache.sqoop.mapreduce.asyncsqloutputformat: got exception in update thread: java.sql.batchupdateexception: unknown column 'created_dtm' in 'field list'     @ com.mysql.jdbc.preparedstatement.executebatchserially(preparedstatement.java:1819)     @ com.mysql.jdbc.preparedstatement.executebatch(preparedstatement.java:1281)     @ org.apache.sqoop.mapreduce.asyncsqloutputformat$asyncsqlexecthread.run(asyncsqloutputformat.java:231) caused by: com.mysql.jdbc.exceptions.jdbc4.mysqlsyntaxerrorexception: unknown column 'created_dtm' in 'field list'

i tried following multiple ways of specifying columns:

--columns a,b,created_dtm,d,e --columns 'a','b','created_dtm','d','e' --columns "a,b,created_dtm,d,e"

but none of above worked. when above sqoop command executed first time when table empty inserts records since have specified --update-mode="allow-insert", after when try update same data. job fails every time.

could please suggest wrong here?

the table structure follows:

create table if not exists schema.`table` (   `id` bigint(20) not null auto_increment,   `a` varchar(254) not null,   `b` bigint(20) default null,   `created_dtm` timestamp not null default '0000-00-00 00:00:00',   `c` timestamp not null default '0000-00-00 00:00:00',   `e` bigint(20) not null,   `d` timestamp not null default '0000-00-00 00:00:00',   primary key (`id`),   unique key `u_table` (`a`),   key `i_table_c` (`c`) )


Comments

Post a Comment

Popular posts from this blog

yii2 - Yii 2 Running a Cron in the basic template -

-
i have seen instructions on running cron in advanced template, cant figure out how on basic template. have following controller in basic controllers folder. <?php namespace app\controllers; use yii\console\controller; /** * cron controller */ class croncontroller extends controller { public function actionindex() { echo "cron service runnning"; } public function actionmail($to) { echo "sending mail " . $to; } } i have navigated root of application , tried these comands yii cron php yii cron im getting unknown comand "cron" i know old question failed find actual answer this. if @ code yii exec file you'll notice requires /common/config/aliases.php file console/config/main.php. can naturally change these or copy on these advanced template. hope solves problem wanting same thing.
Read more

asp.net - 'System.Web.HttpContext' does not contain a definition for 'GetOwinContext' Mystery -

-
i realize question might seem trivial some, it's these types of things find myself fighting quite bit , want make sense of despite seeming losing battle in .net (for me anyway). so, if following: using system.web; ... applicationuser user = system.web.httpcontext.getowincontext().getusermanager<applicationusermanager>().findbyid(system.web.httpcontext.user.identity.getuserid()); that produces error in title , red getowincontext() , error cannot resolve symbol 'getowincontext()' however, if following (remove system.web in front of httpcontext ), works expected (or @ least no errors): using system.web; ... applicationuser user = httpcontext.getowincontext().getusermanager<applicationusermanager>().findbyid(system.web.httpcontext.user.identity.getuserid()); however, if (same line that's working using system.web commented out): //using system.web; ... applicationuser user = httpcontext.getowincontext().getusermana...
Read more

mercurial graft feature, can it copy? -

-
there new feature in mercurial 3, called 'graft' (graft local). job of moving change-set different branch. is there way "copy" change-set branch? i interested in in moving stuff qa branch production branch, still need code reside in qa. want copy. found , have tried few things, maybe it'll become clear more tinkering , reading... does have better way of 'cherry picking' change-sets move cross branch (or trunk)??? graft copies changesets, doesn't move them. hg graft (emphasis mine): this command uses mercurial's merge logic copy individual changes other branches without merging branches in history graph. known 'backporting' or 'cherry-picking' . default, graft copy user, date, , description source changesets.
Read more