[Intelmq-users] MAIL ATTACHMENT FETCHER FAILS TO READ/PARSE CSV FILE.

Sebastian Wagner wagner at cert.at
Thu Mar 19 14:33:33 CET 2020


Hi,

On 3/19/20 12:27 PM, patric sungura wrote:
> Find output below ;
> sha256sum /usr/lib/python3.5/csv.py
> 6d96e56ec22d1603ffed0f8d20f5b5090fb6ae4c7417126d09afc45447b34a64 
> /usr/lib/python3.5/csv.py

Great, so we now fixed the Python problem :)

On 3/19/20 2:29 PM, patric sungura wrote:
>     2020-03-19 16:14:27,444 - ShadowServer-Parser - ERROR - Bot has
> found a problem.
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py",
> line 267, in start
>     self.process()
>   File "/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py",
> line 941, in process
>     for line in self.parse(report):
>   File "/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py",
> line 884, in parse_csv_dict
>     self.csv_fieldnames = csv_reader.fieldnames
>   File "/usr/lib/python3.5/csv.py", line 96, in fieldnames
>     self._fieldnames = next(self.reader)
> *_csv.Error: new-line character seen in unquoted field - do you need
> to open the file in universal-newline mode?*
In the previous mail the error was different - so what changed?
> 2020-03-19 14:02:16,409 - ShadowServer-Parser - ERROR - Failed to
> parse line.
> Traceback (most recent call last):
>   File "/usr/local/lib/python3.5/dist-packages/intelmq/lib/bot.py",
> line 951, in process
>     events = list(filter(bool, value))
>   File
> "/usr/local/lib/python3.5/dist-packages/intelmq/bots/parsers/shadowserver/parser.py",
> line 111, in parse_line
>     ' format or misconfiguration.'.format(shadowkey, self.feedname))
> *ValueError: Required column 'timestamp' not found in feed
> 'Blacklisted-IP'. Possible change in data format or misconfiguration.*
Sebastian

-- 
// Sebastian Wagner <wagner at cert.at> - T: +43 1 5056416 7201
// CERT Austria - https://www.cert.at/
// Eine Initiative der nic.at GmbH - https://www.nic.at/
// Firmenbuchnummer 172568b, LG Salzburg

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.cert.at/pipermail/intelmq-users/attachments/20200319/b16fbd4d/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: OpenPGP digital signature
URL: <http://lists.cert.at/pipermail/intelmq-users/attachments/20200319/b16fbd4d/attachment.sig>


More information about the Intelmq-users mailing list