[qualys_gav]: Generate unique identifiers for each interval ingestion #16215
Description
Integration Name
Qualys Global AssetView [qualys_gav]
Dataset Name
qualys_gav.asset
Integration Version
0.6.0
Agent Version
latest
OS Version and Architecture
Docker
User Goal
When using the Qualys Global Asset View integration, the full data ingestion process can take several hours to complete. Tracking when ingestion begins and ends can be challenging. Additionally, if the process spans on 2 days, grouping data by day results in an inaccurate representation of daily breakdowns, as it spreads records across two days.
To address this, adding a unique field for each ingestion interval will allow for precise comparisons of document counts per interval. Ideally, two fields would suffice (names may vary):
- interval_start: Example format:
2025-03-19T08:13:31.953Z - interval_id: Example value:
582fc58b-f983-4c35-abb1-65c507c1dc0c
Tip
It has been already implemented in the Qualys VMDR integration: #13840
Existing Features
There are no existing feature for this use case.
What did you see?
cf User Goal
Anything else?
No response