logstash - Drop duplicate lines with NXLog -


i'm using nxlog read log file , send logstash. works fine, of log items duplicates. they're in separate lines, content same. can't change way logs written log file, way fix either nxlog before gets send, or in logstash when arrives, prefer not do.

nxlog have function this, it's not working me.

<processor norepeat> module  pm_norepeat </processor>  <route 1> path in => norepeat => out </route> 

after i'm still receiving duplicates in logstash. ideas?

im_file populates raw_event should use this:

checkfields raw_event 

see answer here.


Comments

Popular posts from this blog

yii2 - Yii 2 Running a Cron in the basic template -

asp.net - 'System.Web.HttpContext' does not contain a definition for 'GetOwinContext' Mystery -

c# - MSDN OneNote Api: Navigate to never before opened page without opening a OneNote Application Window -