twitter - Best Features for Term Level Clustering -

-

at moment, working on project related mining twitter data. aim of project find themes can used represent set of tweets. finding themes, came idea term level clustering. terms important concepts extracted using textmining tools. well, main question is, best features define term similarity? in project, due insufficient amount of data, doing unsupervised learning, clustering using k-means algorithm. have extracted features. understand, 1 way know semantic (not actually) meaning of term seeing context of term mentioned. therefore, have @ moment preceding , following word , pos of term. instance:

i drink cup of xyz had spoon of abc yesterday.

by seeing preceding word , pos - cup/nn , of/in xyz , spoon/nn , of/in abc - knew xyz , abc might liquid material or component. well, sounds naive, in fact, don't clusters. in addition previous features, have named entity types considered features. instance, entity type person, location, problem (in medical), medterm etc.

so, common features term level clustering? comments , suggestions appreciated. open guidance, such paper, link etc.

edit: in addition features, i've extracted head nouns of each term , considered 1 of features. thinking of using head noun in case multi-word terms.

well, let me see if understood correctly need. extracted/found terms want centres of clusters, , want find terms similar them grouped in proper cluster?.

in general need define similarity measure (distance) , here main point, want similarity distance measure or determine. if looking term term similarity, letters can try things levenshtein distance example, if want find contextual similar terms, written in different way mean same thing, thats different levenshtein pretty harder do.

what important keep in mind need measure of similarity find similar terms. see call features named entity types, k-means bad when dealing non continuos data.


Comments

Post a Comment

Popular posts from this blog

yii2 - Yii 2 Running a Cron in the basic template -

-
i have seen instructions on running cron in advanced template, cant figure out how on basic template. have following controller in basic controllers folder. <?php namespace app\controllers; use yii\console\controller; /** * cron controller */ class croncontroller extends controller { public function actionindex() { echo "cron service runnning"; } public function actionmail($to) { echo "sending mail " . $to; } } i have navigated root of application , tried these comands yii cron php yii cron im getting unknown comand "cron" i know old question failed find actual answer this. if @ code yii exec file you'll notice requires /common/config/aliases.php file console/config/main.php. can naturally change these or copy on these advanced template. hope solves problem wanting same thing.
Read more

asp.net - 'System.Web.HttpContext' does not contain a definition for 'GetOwinContext' Mystery -

-
i realize question might seem trivial some, it's these types of things find myself fighting quite bit , want make sense of despite seeming losing battle in .net (for me anyway). so, if following: using system.web; ... applicationuser user = system.web.httpcontext.getowincontext().getusermanager<applicationusermanager>().findbyid(system.web.httpcontext.user.identity.getuserid()); that produces error in title , red getowincontext() , error cannot resolve symbol 'getowincontext()' however, if following (remove system.web in front of httpcontext ), works expected (or @ least no errors): using system.web; ... applicationuser user = httpcontext.getowincontext().getusermanager<applicationusermanager>().findbyid(system.web.httpcontext.user.identity.getuserid()); however, if (same line that's working using system.web commented out): //using system.web; ... applicationuser user = httpcontext.getowincontext().getusermana...
Read more

mercurial graft feature, can it copy? -

-
there new feature in mercurial 3, called 'graft' (graft local). job of moving change-set different branch. is there way "copy" change-set branch? i interested in in moving stuff qa branch production branch, still need code reside in qa. want copy. found , have tried few things, maybe it'll become clear more tinkering , reading... does have better way of 'cherry picking' change-sets move cross branch (or trunk)??? graft copies changesets, doesn't move them. hg graft (emphasis mine): this command uses mercurial's merge logic copy individual changes other branches without merging branches in history graph. known 'backporting' or 'cherry-picking' . default, graft copy user, date, , description source changesets.
Read more