<html><head></head><body><div class="ydp88a9663eyahoo-style-wrap" style="font-family:Helvetica Neue, Helvetica, Arial, sans-serif;font-size:13px;"><div></div>
<div dir="ltr" data-setdir="false">Sebastian,</div><div dir="ltr" data-setdir="false">Only python fix.</div><div dir="ltr" data-setdir="false">Find below error at different time .</div><div dir="ltr" data-setdir="false"><br></div><div dir="ltr" data-setdir="false">Current I receive <span><b style="color: rgb(0, 0, 0); font-family: Helvetica Neue, Helvetica, Arial, sans-serif;">csv.Error: new-line character seen in unquoted field - do you need to open the file in universal-newline mode?</b></span></div><div dir="ltr" data-setdir="false"><div><div><b><br></b></div><div><b>@13:14 GMT</b></div><div> 2020-03-19 16:14:27,444 - ShadowServer-Parser - ERROR - Bot has found a problem.</div><div>Traceback (most recent call last):</div><div> File "/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py", line 267, in start</div><div> self.process()</div><div> File "/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py", line 941, in process</div><div> for line in self.parse(report):</div><div> File "/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py", line 884, in parse_csv_dict</div><div> self.csv_fieldnames = csv_reader.fieldnames</div><div> File "/usr/lib/python3.5/csv.py", line 96, in fieldnames</div><div> self._fieldnames = next(self.reader)</div><div><b>_csv.Error: new-line character seen in unquoted field - do you need to open the file in universal-newline mode?</b></div><div>2020-03-19 16:14:27,445 - ShadowServer-Parser - INFO - Dumping message to dump file.</div><div><br></div><div><br></div><div> "traceback": [</div><div> "Traceback (most recent call last):\n",</div><div> " File \"/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py\", line 267, in start\n self.process()\n",</div><div> " File \"/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py\", line 941, in process\n for line in self.parse(report):\n",</div><div> " File \"/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py\", line 884, in parse_csv_dict\n self.csv_fieldnames = csv_reader.fieldnames\n",</div><div> " File \"/usr/lib/python3.5/csv.py\", line 96, in fieldnames\n self._fieldnames = next(self.reader)\n",</div><div> "_<b>csv.Error: new-line character seen in unquoted field - do you need to open the file in universal-newline mode?\n"</b></div><div> ]</div><div> }</div><div><br></div><div><br></div><div><b>@11:02 GMT</b></div><div>2020-03-19 14:02:16,409 - ShadowServer-Parser - ERROR - Failed to parse line.</div><div>Traceback (most recent call last):</div><div> File "/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py", line 951, in process</div><div> events = list(filter(bool, value))</div><div> File "/usr/local/lib/python3.5/dist-packages/intelmq/bots/parsers/shadowserver/parser.py", line 111, in parse_line</div><div> ' format or misconfiguration.'.format(shadowkey, self.feedname))</div><div><b>ValueError: Required column 'timestamp' not found in feed 'Blacklisted-IP'. Possible change in data format or misconfiguration.</b></div><div>2020-03-19 14:02:16,410 - ShadowServer-Parser - INFO - Dumping message to dump file.</div><div>2020-03-19 14:02:16,514 - ShadowServer-Parser - INFO - Dumping message to dump file.</div><div>2020-03-19 14:02:16,612 - ShadowServer-Parser - INFO - Sent 0 events and found 2 problem(s).</div><div><br></div><div><br></div><div>From Dump;</div><div> "source_queue": "ShadowServer-Parser-queue",</div><div> "traceback": "Traceback (most recent call last):\n File \"/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py\", line 951, in process\n events = list(filter(bool, value))\n File \"/usr/local/lib/python3.5/dist-packages/intelmq/bots/parsers/shadowserver/parser.py\", line 111, in parse_line\n ' format or misconfiguration.'.format(shadowkey, self.feedname))\nValueError: Required column 'timestamp' not found in feed '<b>Blacklisted-IP'. Possible change in data format or misconfiguration.\n"</b></div><div> }</div></div>Your assistance is highly requested.</div><div dir="ltr" data-setdir="false"><br></div><div dir="ltr" data-setdir="false">Thank you,</div><div dir="ltr" data-setdir="false">Patrick</div><div><br></div>
</div><div id="yahoo_quoted_5271934405" class="yahoo_quoted">
<div style="font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;font-size:13px;color:#26282a;">
<div>
On Thursday, March 19, 2020, 04:33:45 PM GMT+3, Sebastian Wagner <wagner@cert.at> wrote:
</div>
<div><br></div>
<div><br></div>
<div><div id="yiv1488429112"><div>
<div class="yiv1488429112moz-cite-prefix">Hi,</div>
<div class="yiv1488429112moz-cite-prefix"><br clear="none">
</div>
<div class="yiv1488429112moz-cite-prefix">On 3/19/20 12:27 PM, patric sungura
wrote:<br clear="none">
</div>
<blockquote type="cite">Find
output below ;
<div dir="ltr">
<div>
<div>sha256sum /usr/lib/python3.5/csv.py</div>
<div>6d96e56ec22d1603ffed0f8d20f5b5090fb6ae4c7417126d09afc45447b34a64
/usr/lib/python3.5/csv.py</div>
</div>
</div>
</blockquote>
<p>Great, so we now fixed the Python problem :)<br clear="none">
</p>
<div class="yiv1488429112moz-cite-prefix">On 3/19/20 2:29 PM, patric sungura
wrote:<br clear="none">
</div>
<blockquote type="cite">
</blockquote></div><div><div class="yiv1488429112ydp53e397c9yahoo-style-wrap" style="font-family:Helvetica Neue, Helvetica, Arial, sans-serif;font-size:13px;"> 2020-03-19 16:14:27,444 -
ShadowServer-Parser - ERROR - Bot has found a problem.
<div dir="ltr">
<div>
<div>Traceback (most recent call last):</div>
<div> File
"/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py",
line 267, in start</div>
<div> self.process()</div>
<div> File
"/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py",
line 941, in process</div>
<div> for line in self.parse(report):</div>
<div> File
"/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py",
line 884, in parse_csv_dict</div>
<div> self.csv_fieldnames = csv_reader.fieldnames</div>
<div> File "/usr/lib/python3.5/csv.py", line 96, in
fieldnames</div>
<div> self._fieldnames = next(self.reader)</div>
<div><b>_csv.Error: new-line character seen in unquoted
field - do you need to open the file in
universal-newline mode?</b></div>
</div>
</div>
</div>
In the previous mail the error was different - so what changed?
<blockquote type="cite">
<div class="yiv1488429112yqt5021047728" id="yiv1488429112yqtfd43050"><div class="yiv1488429112yahoo_quoted" id="yiv1488429112yahoo_quoted_4806795210">
<div style="font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;font-size:13px;color:#26282a;">
<div>
<div id="yiv1488429112">
<div>
<div class="yiv1488429112ydp42f012eeyahoo-style-wrap" style="font-family:Helvetica Neue, Helvetica, Arial, sans-serif;font-size:13px;">
<div dir="ltr">
<div>
<div>2020-03-19 14:02:16,409 - ShadowServer-Parser
- ERROR - Failed to parse line.</div>
<div>Traceback (most recent call last):</div>
<div> File
"/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py",
line 951, in process</div>
<div> events = list(filter(bool, value))</div>
<div> File
"/usr/local/lib/python3.5/dist-packages/intelmq/bots/parsers/shadowserver/parser.py",
line 111, in parse_line</div>
<div> ' format or
misconfiguration.'.format(shadowkey,
self.feedname))</div>
<div><b>ValueError: Required column 'timestamp'
not found in feed 'Blacklisted-IP'. Possible
change in data format or misconfiguration.</b></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div></blockquote><div class="yiv1488429112yqt5021047728" id="yiv1488429112yqtfd31175">
Sebastian<br clear="none">
<pre class="yiv1488429112moz-signature">--
// Sebastian Wagner <a rel="nofollow" shape="rect" class="yiv1488429112moz-txt-link-rfc2396E" ymailto="mailto:wagner@cert.at" target="_blank" href="mailto:wagner@cert.at"><wagner@cert.at></a> - T: +43 1 5056416 7201
// CERT Austria - <a rel="nofollow" shape="rect" class="yiv1488429112moz-txt-link-freetext" target="_blank" href="https://www.cert.at/">https://www.cert.at/</a>
// Eine Initiative der nic.at GmbH - <a rel="nofollow" shape="rect" class="yiv1488429112moz-txt-link-freetext" target="_blank" href="https://www.nic.at/">https://www.nic.at/</a>
// Firmenbuchnummer 172568b, LG Salzburg</pre>
</div></div></div><div class="yqt5021047728" id="yqtfd40058">-- <br clear="none">Listen-Einstellungen:<br clear="none"> <a shape="rect" href="https://lists.cert.at/cgi-bin/mailman/listinfo/intelmq-users" target="_blank">https://lists.cert.at/cgi-bin/mailman/listinfo/intelmq-users</a><br clear="none"></div></div>
</div>
</div></body></html>