[IntelMQ-users] [IntelMQ] Question about harmonization.conf

[Mika Silander]

Hi Jonathan. 

A report is a JSON document that is emitted by a collector bot. This document contains fields listed in the "report" section of harmonization.conf. Packed inside the report there is information about 1-N security events. Once the collector has the report ready, it sends it to a parser bot. The parser bot then splits the report document into events. An event is a JSON document describing a single security event. The fields in an event are listed in the "event" section of harmonization.conf. After the split, the parser bot sends the events one by one to the next configured expert bot in the bot chain. Eventually, the last expert bot in the chain passes the event to an output bot. The output bots could be considered as the components that provide the "reporting capability" you mention as they typically forward/store the processed event into a system outside of intelmq. 

Harmonized fields are in other words, "standardised" over all reports and events intelmq processes because there are rules as to what values they are allowed to contain. Beyond these we have many non-harmonised fields that may contain (almost) arbitrary values. 
These non-harmonised fields are typically named "extra.*" describing the event of the corresponding security feed in more detail. Basically, these contain data that is specific to feeds, not data common to all feeds and thus not "harmonizable". 

I'll stop here in the hope the above helps. More seasoned developers may continue from hereon (and correct me along the way if necessary). 

Br, Mika 



From: "intelmq-users" <intelmq-users at lists.cert.at> 
To: "intelmq-users" <intelmq-users at lists.cert.at> 
Sent: Friday, 17 December, 2021 14:12:50 
Subject: [IntelMQ-users] [IntelMQ] Question about harmonization.conf 



Greetings IntelMQ community, 



I’m looking for information about the harmonization.conf file located in /etc. In this file I see two sections: «event», and «report». 

Could you please tell me the difference? Unfortunately, I was not able to find hints in the current documentation. 



Also, as I see «report», does that mean IntelMQ has a reporting capability ? As far as I know IntelMQ doesn’t provide a reporting capability, hence my doubt. 😊 



Thanks, 

Jonathan 



-- 

Jonathan SCOUPREMAN | [ mailto:jscoupreman at excellium-services.lu | jscoupreman at excellium-services.lu ] | PGP Key ID: [ http://pgp.circl.lu/pks/lookup?op=vindex&fingerprint=on&search=0x6802c48ead971c07 | 
0xAD971C07 ] 

CERT-XLM | [ mailto:cert at excellium-services.com | cert at excellium-services.com ] | PGP Key ID: [ http://pgp.circl.lu/pks/lookup?op=vindex&fingerprint=on&search=0x67B311E5D74E5AC0 | 
0xD74E5AC0 ] 

CERT-XLM Incident Handler @ [ https://excellium-services.com/ | excellium-services.com ] 

Excellium Services S.A. | 5 rue Goell L-5326 Contern 

Mobile: +352 691 982 790 

Emergency: +352 262 039 64 708 | [ mailto:emergency at excellium-services.com | emergency at excellium-services.com ] | PGP Key ID: [ https://excellium-services.com/assets/EMERGENCY_PKEY.asc | 0x42662EFE ] 


This email is confidential and may contain legally privileged information. If you are not the intended recipient, you should not copy, distribute, disclose or use the information it contains, please e-mail the sender immediately and delete this message from your system. Note: e-mails are susceptible to corruption, interception and unauthorised amendment; we do not accept liability for any such changes, or for their consequences. You should be aware that we may monitor your e-mails and their content. Excellium Services SA. 
-- 
List settings: 
https://lists.cert.at/cgi-bin/mailman/listinfo/intelmq-users 
IntelMQ Documentation: https://intelmq.readthedocs.io/ 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.cert.at/pipermail/intelmq-users/attachments/20211217/63fd1755/attachment.htm>