-
Notifications
You must be signed in to change notification settings - Fork 455
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add pipeline tests for AWS CloudTrail #408
Add pipeline tests for AWS CloudTrail #408
Conversation
457d804
to
bedca2b
Compare
Pinging @elastic/security-external-integrations (Team:Security-External Integrations) |
bedca2b
to
304f5c1
Compare
4f32459
to
be9f816
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
As there were incompatible changes pushed to the master branch (PR: #410), please rebase this PR against the master branch.
You can fix go.sum
with mage ModTidy
.
7221f0c
to
eec40b6
Compare
The tests revealed a few issues. There was an error in the pipeline for update-user-json.log because serviceEventDetails was not present. This was the error "error": { "message": "Cannot invoke \\\"Object.getClass()\\\" because \\\"receiver\\\" is null" } The aws.cloudtrail.read_only field was mapped as keyword but was actual a JSON boolean. I changed the type to boolean, but do not plan to backport this change to Filebeat. And lastly some ECS user_agent fields were missing. This depends on elastic/elastic-package#177 to make the flattened fields pass test validation.
eec40b6
to
e13a28f
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great.
* Sync changes to AWS CloudTrail elastic/integrations#408 * Sync changes to CheckPoint Firewall Change type of event.severity. elastic/integrations#409 * Sync changes from Cisco ASA / FTD elastic/integrations#414 * Sync changes from Cisco IOS Make icmp and igmp fields strings because they are keywords. elastic/integrations#416 * Sync changes to CrowdStrike Falcon Fix some field types. elastic/integrations#377 * Sync changes to Fortinet Firewall Drop assignip if the value is "N/A". elastic/integrations#437 * Sync changes to Juniper SRX Convert event.risk values to float Protect against missing event.timezone Convert event.severity to long. elastic/integrations#443 * Sync changes to Suricata EVE Convert suricata.eve.flow_id to string because the field is a keyword in the mapping. elastic/integrations#457 * Sync changes to Zeek DNS Fix usages of ignore_failure with convert processor. Make DNS transaction ID a string. elastic/integrations#448 * Add changelog
* Sync changes to AWS CloudTrail elastic/integrations#408 * Sync changes to CheckPoint Firewall Change type of event.severity. elastic/integrations#409 * Sync changes from Cisco ASA / FTD elastic/integrations#414 * Sync changes from Cisco IOS Make icmp and igmp fields strings because they are keywords. elastic/integrations#416 * Sync changes to CrowdStrike Falcon Fix some field types. elastic/integrations#377 * Sync changes to Fortinet Firewall Drop assignip if the value is "N/A". elastic/integrations#437 * Sync changes to Juniper SRX Convert event.risk values to float Protect against missing event.timezone Convert event.severity to long. elastic/integrations#443 * Sync changes to Suricata EVE Convert suricata.eve.flow_id to string because the field is a keyword in the mapping. elastic/integrations#457 * Sync changes to Zeek DNS Fix usages of ignore_failure with convert processor. Make DNS transaction ID a string. elastic/integrations#448 * Add changelog (cherry picked from commit bf46572)
#24077) * Sync fixes from Integration Package Testing (#23424) * Sync changes to AWS CloudTrail elastic/integrations#408 * Sync changes to CheckPoint Firewall Change type of event.severity. elastic/integrations#409 * Sync changes from Cisco ASA / FTD elastic/integrations#414 * Sync changes from Cisco IOS Make icmp and igmp fields strings because they are keywords. elastic/integrations#416 * Sync changes to CrowdStrike Falcon Fix some field types. elastic/integrations#377 * Sync changes to Fortinet Firewall Drop assignip if the value is "N/A". elastic/integrations#437 * Sync changes to Juniper SRX Convert event.risk values to float Protect against missing event.timezone Convert event.severity to long. elastic/integrations#443 * Sync changes to Suricata EVE Convert suricata.eve.flow_id to string because the field is a keyword in the mapping. elastic/integrations#457 * Sync changes to Zeek DNS Fix usages of ignore_failure with convert processor. Make DNS transaction ID a string. elastic/integrations#448 * Add changelog (cherry picked from commit bf46572)
The tests revealed a few issues. There was an error in the pipeline for update-user-json.log because serviceEventDetails was not present. This was the error "error": { "message": "Cannot invoke \\\"Object.getClass()\\\" because \\\"receiver\\\" is null" } The aws.cloudtrail.read_only field was mapped as keyword but was actual a JSON boolean. I changed the type to boolean, but do not plan to backport this change to Filebeat. And lastly some ECS user_agent fields were missing. This depends on elastic/elastic-package#177 to make the flattened fields pass test validation.
What does this PR do?
The tests revealed a few issues. There was an error in the pipeline for update-user-json.log because
serviceEventDetails was not present. This was the error
The aws.cloudtrail.read_only field was mapped as keyword but was actual a JSON boolean.
I changed the type to boolean, but do not plan to backport this change to Filebeat.
And lastly some ECS user_agent fields were missing.
This depends on elastic/elastic-package#177 to make the flattened fields pass
test validation.
Checklist
Related issues