- IntelMQ-users

IntelMQ 2.3.3 release
by Sebastian Wagner 31 May '21

31 May '21

Dear community, While the development of the next major version 3.0.0 of IntelMQ is in the final spurt, the current version 2.3.3 marks the end of the 2.x development cycle. Beside small error corrections it comes with support for a few new Shadowserver feeds (https://www.shadowserver.org/news/changes-in-sinkhole-and-honeypot-report-t…). Please find below the list of changes. Thanks to all contributors for the issues reported and pull requests! The new version is already available on GitHub, PyPI, the deb+rpm repositories and DockerHub. Installation documentation: https://intelmq.readthedocs.io/en/maintenance/user/installation.html Upgrade documentation: https://intelmq.readthedocs.io/en/maintenance/user/upgrade.html ### Core - `intelmq.lib.upgrade`: - Added `v233_feodotracker_browse` for Abuse.ch Feodotracker Browse parser configuration adaption (PR#1941 by Sebastian Wagner). ### Bots #### Parsers - `intelmq.bots.parsers.microsoft.parser_ctip`: - Add support for new field `SourceIpInfo.SourceIpv4Int` (PR#1940 by Sebastian Wagner). - Fix mapping of "ConnectionType" fields, this is not `protocol.application`. Now mapped to `extra.*.connection_type` (PR#1940 by Sebastian Wagner). - `intelmq.bots.parsers.shadowserver._config`: - Add support for the new feeds *Honeypot-Amplification-DDoS-Events*, *Honeypot-Brute-Force-Events*, *Honeypot-Darknet*, *IP-Spoofer-Events*, *Sinkhole-Events*, *Sinkhole-HTTP-Events*, *Vulnerable-Exchange-Server*, *Sinkhole-Events-HTTP-Referer* (PR#1950, PR#1952, PR#1953, PR#1954, PR#1970 by Birger Schacht and Sebastian Wagner, PR#1971 by Mikk Margus Möll). #### Experts - `intelmq.bots.experts.splunk_saved_search.expert`: - fixed erroneous string formatting (PR#1960 by Karl-Johan Karlsson). #### Outputs - `intelmq.bots.outputs.smtp.output`: - Handle empty "fieldnames" parameter by sending no attachment (PR#1932 by Sebastian Wagner). ### Documentation - Feeds: - Fixed Abuse.ch Feodotracker Browse parser configuration (PR#1941 by Sebastian Wagner fixes #1938). ### Tests - `intelmq.bots.parsers.html_table`: - Added testcase for Abuse.ch Feodotracker Browse (PR#1941 by Sebastian Wagner). ### Tools - intelmqsetup: - Set ownershop of state file path and its parent directory (PR#1911 by Sebastian Wagner). ### Known issues - ParserBot: erroneous raw line recovery in error handling (#1850). -- // Sebastian Wagner <wagner(a)cert.at> - T: +43 676 898 298 7201 // CERT Austria - https://www.cert.at/ // Eine Initiative der nic.at GmbH - https://www.nic.at/ // Firmenbuchnummer 172568b, LG Salzburg

1 0

REDIS SERVER STOP
by hatibu chande 20 May '21

20 May '21

Hi, My redis server stopped working after successfully installing intelmq. The following logs are from the redis server. pam_unix(sudo:session): session opened for user intelmq by (uid=0) pam_unix(sudo:session): session closed for user intelmq Can anyone help me. Regards, Hatibu.

2 1

MISP Expert bot
by Soni, Drupad 11 May '21

11 May '21

Hi Sebastian, How misp expert bot works? I want to know more on this. I have used mispfeed output bot as output to misp but I am not able to see feeds in MISP. Later I have found a expert bot of MISP. Please guide me how that can be used. Also as you prefer not to share screenshots thus not sharing them. Please let me know if needed for reference. Regards, Drupad Soni KPMG - Cyber Security Embassy Golf Links Business Park, Pebble Beach, 'B' Block, 1st & 2nd Floor, Off Intermediate Ring Road Mobile : +91 8140283894 Know more about our Cyber Security Services https://home.kpmg.com/in/en/home/services/advisory/risk-consulting/it-advis… ********************************************************************** KPMG (in India) allows reasonable personal use of the e-mail system. Views and opinions expressed in these communications do not necessarily represent those of KPMG (in India). ******************************************************************************************************* DISCLAIMER The information in this e-mail is confidential and may be legally privileged. It is intended solely for the addressee. Access to this e-mail by anyone else is unauthorized. If you have received this communication in error, please address with the subject heading "Received in error," send to postmaster1(a)kpmg.com, then delete the e-mail and destroy any copies of it. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. Any opinions or advice contained in this e-mail are subject to the terms and conditions expressed in the governing KPMG client engagement letter. Opinions, conclusions and other information in this e-mail and any attachments that do not relate to the official business of the firm are neither given nor endorsed by it. KPMG cannot guarantee that e-mail communications are secure or error-free, as information could be intercepted, corrupted, amended, lost, destroyed, arrive late or incomplete, or contain viruses. KPMG, an Indian partnership and a member firm of KPMG International Cooperative ("KPMG International"), a Swiss entity that serves as a coordinating entity for a network of independent firms operating under the KPMG name. KPMG International Cooperative (“KPMG International”) provides no services to clients. Each member firm of KPMG International Cooperative (“KPMG International”) is a legally distinct and separate entity and each describes itself as such. “Notwithstanding anything inconsistent contained in the meeting invite to which this acceptance pertains, this acceptance is restricted solely to confirming my availability for the proposed call and should not be construed in any manner as acceptance of any other terms or conditions. Specifically, nothing contained herein may be construed as an acceptance (or deemed acceptance) of any request or notification for recording of the call, which can be done only if it is based on my explicit and written consent and subject to the terms and conditions on which such consent has been granted” *******************************************************************************************************

4 9

Can't get IntelMq-Manager working
by Evan Littmann 10 May '21

10 May '21

Hello, I just installed this on Fedora 34 and the bots start, but the web interface won't work. I am running Nginx and have added the file vars.js with this "var ROOT = /usr/local/lib/python3.9/site-packages/intelmq_api/intelmq-api.wsgi" line without the quotes. The web interface loads, but it won't do anything. When I go to the About tab, the Debugging line has a turning dot that looks like it's stuck in a loop and there is no Version information. I know I'm missing something simple, but I can't figure out what. Any help? Regards, Evan Littmann

2 1

How to use MISP-API-OUTPUT bot
by Soni, Drupad 04 May '21

04 May '21

Hi Sebastian/Bernhard, How to use misp-api-output bot? I have tried multiple things with misp-output-bot but it doesn't work properly. In MISP it doesn't reflect feeds properly. Please guide me how to reflect events using api bot in misp. Regards, Drupad Soni KPMG - Cyber Security Embassy Golf Links Business Park, Pebble Beach, 'B' Block, 1st & 2nd Floor, Off Intermediate Ring Road Mobile : +91 8140283894 Know more about our Cyber Security Services https://home.kpmg.com/in/en/home/services/advisory/risk-consulting/it-advis… ********************************************************************** KPMG (in India) allows reasonable personal use of the e-mail system. Views and opinions expressed in these communications do not necessarily represent those of KPMG (in India). ******************************************************************************************************* DISCLAIMER The information in this e-mail is confidential and may be legally privileged. It is intended solely for the addressee. Access to this e-mail by anyone else is unauthorized. If you have received this communication in error, please address with the subject heading "Received in error," send to postmaster1(a)kpmg.com, then delete the e-mail and destroy any copies of it. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. Any opinions or advice contained in this e-mail are subject to the terms and conditions expressed in the governing KPMG client engagement letter. Opinions, conclusions and other information in this e-mail and any attachments that do not relate to the official business of the firm are neither given nor endorsed by it. KPMG cannot guarantee that e-mail communications are secure or error-free, as information could be intercepted, corrupted, amended, lost, destroyed, arrive late or incomplete, or contain viruses. KPMG, an Indian partnership and a member firm of KPMG International Cooperative ("KPMG International"), a Swiss entity that serves as a coordinating entity for a network of independent firms operating under the KPMG name. KPMG International Cooperative (“KPMG International”) provides no services to clients. Each member firm of KPMG International Cooperative (“KPMG International”) is a legally distinct and separate entity and each describes itself as such. “Notwithstanding anything inconsistent contained in the meeting invite to which this acceptance pertains, this acceptance is restricted solely to confirming my availability for the proposed call and should not be construed in any manner as acceptance of any other terms or conditions. Specifically, nothing contained herein may be construed as an acceptance (or deemed acceptance) of any request or notification for recording of the call, which can be done only if it is based on my explicit and written consent and subject to the terms and conditions on which such consent has been granted” *******************************************************************************************************

1 0

IntelMQ also impacted by Python 3.8 IP address parsing bug (CVE-2021-29921)
by Sebastian Wagner 03 May '21

03 May '21

Dear all, you may have heard about a parsing bug/vulnerability in Python's ipaddress module. Only Python version >= 3.8 are affected. The bug affects the handling of addresses in octal notation The sources below have more details on the error, but in principle it means that the leading zeros of IP address in octal notation are stripped and the rest is parsed decimal. The correct behavior would have been that the numbers starting with zeros are parsed as octal. You can also see the (erroneous) changes in the documentation: https://docs.python.org/3/library/ipaddress.html#ipaddress.IPv4Address ("Changed in version 3.8" and "Changed in version 3.10"). There no fix yet for this bug, but you should receive it soon from your distribution. As an IntelMQ user, you need to trust your input sources anyway, or check the validity of the collected data. If any feed gives you IP addresses with leading zeros, the outcome may be unexpected. Further sources: https://www.bleepingcomputer.com/news/security/python-also-impacted-by-crit… https://sick.codes/sick-2021-014/ best regards Sebastian -- // Sebastian Wagner <wagner(a)cert.at> - T: +43 676 898 298 7201 // CERT Austria - https://www.cert.at/ // Eine Initiative der nic.at GmbH - https://www.nic.at/ // Firmenbuchnummer 172568b, LG Salzburg

1 0

shadowserver-parser and new sinkhole/honeypot reports?
by Patrick Forsberg 03 May '21

03 May '21

Hi, Is anyone working on adding the new sinkhole and honeypot reports to the parser? _https_://www.shadowserver.org/news/changes-in-sinkhole-and-honeypot-report… Regards, /Patrick

2 1

mispfeedoutput bot feed
by Soni, Drupad 30 Apr '21

30 Apr '21

Hi Sebastian/Bernhard, Mispfeed-output bot failed. Error is as below, Bot initialization failed. Traceback (most recent call last): File "/usr/lib/python3/dist-packages/intelmq/lib/bot.py", line 164, in __init__ self.init() File "/usr/lib/python3/dist-packages/intelmq/bots/outputs/misp/output_feed.py", line 65, in init self.current_event.load_file(self.current_file) File "/usr/local/lib/python3.6/dist-packages/pymisp/mispevent.py", line 1598, in load_file self.load(f, validate, metadata_only) File "/usr/local/lib/python3.6/dist-packages/pymisp/mispevent.py", line 1606, in load json_event = json.loads(json_event) File "/usr/lib/python3.6/json/__init__.py", line 354, in loads return _default_decoder.decode(s) File "/usr/lib/python3.6/json/decoder.py", line 339, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib/python3.6/json/decoder.py", line 357, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) Regards, Drupad Soni KPMG - Cyber Security Embassy Golf Links Business Park, Pebble Beach, 'B' Block, 1st & 2nd Floor, Off Intermediate Ring Road Mobile : +91 8140283894 Know more about our Cyber Security Services https://home.kpmg.com/in/en/home/services/advisory/risk-consulting/it-advis… ********************************************************************** KPMG (in India) allows reasonable personal use of the e-mail system. Views and opinions expressed in these communications do not necessarily represent those of KPMG (in India). ******************************************************************************************************* DISCLAIMER The information in this e-mail is confidential and may be legally privileged. It is intended solely for the addressee. Access to this e-mail by anyone else is unauthorized. If you have received this communication in error, please address with the subject heading "Received in error," send to postmaster1(a)kpmg.com, then delete the e-mail and destroy any copies of it. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. Any opinions or advice contained in this e-mail are subject to the terms and conditions expressed in the governing KPMG client engagement letter. Opinions, conclusions and other information in this e-mail and any attachments that do not relate to the official business of the firm are neither given nor endorsed by it. KPMG cannot guarantee that e-mail communications are secure or error-free, as information could be intercepted, corrupted, amended, lost, destroyed, arrive late or incomplete, or contain viruses. KPMG, an Indian partnership and a member firm of KPMG International Cooperative ("KPMG International"), a Swiss entity that serves as a coordinating entity for a network of independent firms operating under the KPMG name. KPMG International Cooperative (“KPMG International”) provides no services to clients. Each member firm of KPMG International Cooperative (“KPMG International”) is a legally distinct and separate entity and each describes itself as such. “Notwithstanding anything inconsistent contained in the meeting invite to which this acceptance pertains, this acceptance is restricted solely to confirming my availability for the proposed call and should not be construed in any manner as acceptance of any other terms or conditions. Specifically, nothing contained herein may be construed as an acceptance (or deemed acceptance) of any request or notification for recording of the call, which can be done only if it is based on my explicit and written consent and subject to the terms and conditions on which such consent has been granted” *******************************************************************************************************

2 5

Bot Unknown
by hatibu chande 29 Apr '21

29 Apr '21

Hello Team, I recently installed inetlmq and configured shadowsever API bot collector with shadowserverAPI parser, Cymru-Whois-Expert and File-Output but i got this error when running. Starting Botnet... Starting Cymru-Whois-Expert... Starting File-Output... Starting Shadowserver-JSON-Parser... Starting Shadowserver-Reports-API-Collector... Status of Bot Cymru-Whois-Expert is unknown: 'Unhandled error checking the process 18850 with commandline [].'. Cymru-Whois-Expert unknown Status of Bot File-Output is unknown: 'Unhandled error checking the process 18851 with commandline [].'. File-Output unknown Status of Bot Shadowserver-JSON-Parser is unknown: 'Unhandled error checking the process 18852 with commandline [].'. Shadowserver-JSON-Parser unknown Status of Bot Shadowserver-Reports-API-Collector is unknown: 'Unhandled error checking the process 18853 with commandline [].'. Shadowserver-Reports-API-Collector unknown Bot Botnet is running. Can anyone help me please. Regards, Hatibu.

2 1

Re: [IntelMQ-users] [IntelMQ -users] AttributeError: 'Parameters' object has no attribute 'logging_level'
by Sebastian Wagner 28 Apr '21

28 Apr '21

Hi, That's interesting, I wonder how it emptied itself. You can use this one here to fill it with the standard values: https://raw.githubusercontent.com/certtools/intelmq/2.3.2/intelmq/etc/defau… In IntelMQ 3.0, that file does not exist anymore and it's not necessary to specify all the "default default" values in a file at all :) Sebastian On 4/28/21 3:01 PM, hatibu chande wrote: > Hi, > > No logging_level field.., It looks like this {} only. > > Hatibu. > > On Wed, Apr 28, 2021 at 3:55 PM Sebastian Wagner <wagner(a)cert.at > <mailto:wagner@cert.at>> wrote: > > Ok, how does you defaults.conf look like? in particular, is there > a logging_level field? > > On 4/28/21 2:53 PM, hatibu chande wrote: >> Hello Sebastian, >> >> I upgraded to version 2.3.2 but still got the same error. >> >> File "/usr/bin/intelmqctl", line 11, in <module> >> load_entry_point('intelmq==2.3.2', 'console_scripts', >> 'intelmqctl')() >> File >> "/usr/lib/python3/dist-packages/intelmq/bin/intelmqctl.py", line >> 1899, in main >> x = IntelMQController(interactive=True) >> File >> "/usr/lib/python3/dist-packages/intelmq/bin/intelmqctl.py", line >> 706, in __init__ >> self.logging_level = self.parameters.logging_level.upper() >> AttributeError: 'Parameters' object has no attribute 'logging_level' >> >> Regards, >> Hatibu. >> >> On Wed, Apr 28, 2021 at 3:19 PM Sebastian Wagner <wagner(a)cert.at >> <mailto:wagner@cert.at>> wrote: >> >> Dear hatibu, >> >> It looks like you are using an outdated version of IntelMQ >> (2.3.1). Please upgrade to the latest version 2.3.2 first, >> otherwise we might be chasing bugs which are already fixed. >> >> Sebastian >> >> P.S: you also posted to intelmq-dev, to which you are not >> subscribed and the message was thus held back. I rejected >> that one as posting to one list is enough. >> >> On 4/28/21 2:11 PM, hatibu chande wrote: >>> Hello Team, >>> >>> I recently installed IntelMQ and got this error when running >>> intelmqctl status command. Please can any one help me. >>> >>> File "/usr/bin/intelmqctl", line 11, in <module> >>> load_entry_point('intelmq==2.3.1', 'console_scripts', >>> 'intelmqctl')() >>> File >>> "/usr/lib/python3/dist-packages/intelmq/bin/intelmqctl.py", >>> line 1899, in main >>> x = IntelMQController(interactive=True) >>> File >>> "/usr/lib/python3/dist-packages/intelmq/bin/intelmqctl.py", >>> line 706, in __init__ >>> self.logging_level = self.parameters.logging_level.upper() >>> AttributeError: 'Parameters' object has no attribute >>> 'logging_level' >>> >>> >>> Regards, >>> >>> Hatibu. >>> >> -- >> // Sebastian Wagner <wagner(a)cert.at> <mailto:wagner@cert.at> - T: +43 676 898 298 7201 >> // CERT Austria - https://www.cert.at/ >> // Eine Initiative der nic.at <http://nic.at> GmbH - https://www.nic.at/ >> // Firmenbuchnummer 172568b, LG Salzburg >> >> > -- > // Sebastian Wagner <wagner(a)cert.at> <mailto:wagner@cert.at> - T: +43 676 898 298 7201 > // CERT Austria - https://www.cert.at/ > // Eine Initiative der nic.at <http://nic.at> GmbH - https://www.nic.at/ > // Firmenbuchnummer 172568b, LG Salzburg > -- // Sebastian Wagner <wagner(a)cert.at> - T: +43 676 898 298 7201 // CERT Austria - https://www.cert.at/ // Eine Initiative der nic.at GmbH - https://www.nic.at/ // Firmenbuchnummer 172568b, LG Salzburg

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

IntelMQ-users