From eb5bda6f821fe9b070c0ee34f9a44046f5393918 Mon Sep 17 00:00:00 2001 From: elasticmachine Date: Mon, 31 Jan 2022 14:47:07 +0000 Subject: [PATCH 1/6] docs: Close changelog for 7.17.0 --- CHANGELOG.asciidoc | 147 ++++++++++++++++++++++++++++++++++ CHANGELOG.next.asciidoc | 36 +-------- libbeat/docs/release.asciidoc | 1 + 3 files changed, 151 insertions(+), 33 deletions(-) diff --git a/CHANGELOG.asciidoc b/CHANGELOG.asciidoc index b72e5f00a25a..b263d40d5a6b 100644 --- a/CHANGELOG.asciidoc +++ b/CHANGELOG.asciidoc @@ -3,6 +3,153 @@ :issue: https://github.com/elastic/beats/issues/ :pull: https://github.com/elastic/beats/pull/ +[[release-notes-7.17.0]] +=== Beats version 7.17.0 +https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] + +==== Breaking changes + +*Affecting all Beats* + +- Add job.name in pods controlled by Jobs {pull}28954[28954] +- Enrich kubernetes metadata with node annotations. {pull}29605[29605] + +*Auditbeat* + +*Filebeat* + +*Heartbeat* + +- Fix broken macOS ICMP python e2e test. {pull}29900[29900] +- Only add monitor.status to browser events when summary. {pull}29460[29460] +- Also add summary to journeys for which the synthetics runner crashes. {pull}29606[29606] +- Update size of ICMP packets to adhere to standard min size. {pull}29948[29948] +- Add fonts to support more different types of characters for multiple languages. {pull}29606[29861] + +*Metricbeat* + +- Remove overriding of index pattern on the Kubernetes overview dashboard. {pull}29676[29676] + +*Packetbeat* + +*Winlogbeat* + + +*Functionbeat* + +==== Bugfixes + +*Affecting all Beats* + + +*Auditbeat* + +- system/socket: Fix startup errors on newer 5.x kernels due to missing _do_fork function. {issue}29607[29607] {pull}29744[29744] +- system/package: Fix parsing of Installed-Size field of DEB packages. {issue}16661[16661] {pull}17188[17188] +- system module: Fix panic during initialisation when /proc/stat can't be read. {pull}17569[17569] +- system/package: Fix an error that can occur while trying to persist package metadata. {issue}18536[18536] {pull}18887[18887] +- system/socket: Fix bugs leading to wrong process being attributed to flows. {pull}29166[29166] {issue}17165[17165] +- system/socket: Fix process name and arg truncation for long names, paths and args lists. {issue}24667[24667] {pull}29410[29410] + +*Filebeat* + +- aws-s3: Stop trying to increase SQS message visibility after ReceiptHandleIsInvalid errors. {pull}29480[29480] +- Fix handling of IPv6 addresses in netflow flow events. {issue}19210[19210] {pull}29383[29383] +- Fix `sophos` KV splitting and syslog header handling {issue}24237[24237] {pull}29331[29331] +- Undo deletion of endpoint config from cloudtrail fileset in {pull}29415[29415]. {pull}29450[29450] +- Make Cisco ASA and FTD modules conform to the ECS definition for event.outcome and event.type. {issue}29581[29581] {pull}29698[29698] +- ibmmq: Fixed `@timestamp` not being populated with correct values. {pull}29773[29773] +- aws-s3: Improve gzip detection to avoid false negatives. {issue}29968[29968] +- decode_cef: Fix panic when recovering from invalid CEF extensions that contain escape characters. {issue}30010[30010] + +*Heartbeat* + +- Fix race condition in http monitors using `mode:all` that can cause crashes. {pull}29697[pull] +- Fix broken ICMP availability check that prevented heartbeat from starting in rare cases. {pull}29413[pull] + +*Metricbeat* + +- Use xpack.enabled on SM modules to write into .monitoring indices when using Metricbeat standalone {pull}28365[28365] +- Fix in rename processor to ingest metrics for `write.iops` to proper field instead of `write_iops` in rds metricset. {pull}28960[28960] +- Enhance filter check in kubernetes event metricset. {pull}29470[29470] +- Fix gcp metrics metricset apply aligner to all metric_types {pull}29514[29513] +- Fixed GCP GKE Overview dashboard {pull}29913[29913] + +*Packetbeat* + + +*Winlogbeat* + + +*Functionbeat* + + +*Elastic Logging Plugin* + + +==== Added + +*Affecting all Beats* + +- SASL/SCRAM in the Kafka output is no longer beta. {pull}29126[29126] +- add_process_metadata processor: add `process.parent.pid` to reflect `process.ppid`. {issue}30070[30070] {pull}30077[30077] + +*Auditbeat* + +*Filebeat* + +*Heartbeat* + +- More errors are now visible in ES with new logic failing monitors later to ease debugging. {pull}29413[pull] + + +*Metricbeat* + +*Packetbeat* + + +*Functionbeat* + + +*Winlogbeat* + +- Add support for custom XML queries {issue}1054[1054] {pull}29330[29330] + + +*Elastic Log Driver* + + +==== Deprecated + +*Affecting all Beats* + + +*Filebeat* + + +*Heartbeat* + +*Metricbeat* + + +*Packetbeat* + +*Winlogbeat* + +*Functionbeat* + +==== Known Issue + +*Journalbeat* + + + + + + + + + [[release-notes-7.16.3]] === Beats version 7.16.3 https://github.com/elastic/beats/compare/v7.16.2...v7.16.3[View commits] diff --git a/CHANGELOG.next.asciidoc b/CHANGELOG.next.asciidoc index 5f0e38e08f3a..b1c63f87d592 100644 --- a/CHANGELOG.next.asciidoc +++ b/CHANGELOG.next.asciidoc @@ -10,8 +10,6 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d *Affecting all Beats* -- Add job.name in pods controlled by Jobs {pull}28954[28954] -- Enrich kubernetes metadata with node annotations. {pull}29605[29605] *Auditbeat* @@ -19,15 +17,9 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d *Heartbeat* -- Fix broken macOS ICMP python e2e test. {pull}29900[29900] -- Only add monitor.status to browser events when summary. {pull}29460[29460] -- Also add summary to journeys for which the synthetics runner crashes. {pull}29606[29606] -- Update size of ICMP packets to adhere to standard min size. {pull}29948[29948] -- Add fonts to support more different types of characters for multiple languages. {pull}29606[29861] *Metricbeat* -- Remove overriding of index pattern on the Kubernetes overview dashboard. {pull}29676[29676] *Packetbeat* @@ -43,36 +35,15 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d *Auditbeat* -- system/socket: Fix startup errors on newer 5.x kernels due to missing _do_fork function. {issue}29607[29607] {pull}29744[29744] -- system/package: Fix parsing of Installed-Size field of DEB packages. {issue}16661[16661] {pull}17188[17188] -- system module: Fix panic during initialisation when /proc/stat can't be read. {pull}17569[17569] -- system/package: Fix an error that can occur while trying to persist package metadata. {issue}18536[18536] {pull}18887[18887] -- system/socket: Fix bugs leading to wrong process being attributed to flows. {pull}29166[29166] {issue}17165[17165] -- system/socket: Fix process name and arg truncation for long names, paths and args lists. {issue}24667[24667] {pull}29410[29410] *Filebeat* -- aws-s3: Stop trying to increase SQS message visibility after ReceiptHandleIsInvalid errors. {pull}29480[29480] -- Fix handling of IPv6 addresses in netflow flow events. {issue}19210[19210] {pull}29383[29383] -- Fix `sophos` KV splitting and syslog header handling {issue}24237[24237] {pull}29331[29331] -- Undo deletion of endpoint config from cloudtrail fileset in {pull}29415[29415]. {pull}29450[29450] -- Make Cisco ASA and FTD modules conform to the ECS definition for event.outcome and event.type. {issue}29581[29581] {pull}29698[29698] -- ibmmq: Fixed `@timestamp` not being populated with correct values. {pull}29773[29773] -- aws-s3: Improve gzip detection to avoid false negatives. {issue}29968[29968] -- decode_cef: Fix panic when recovering from invalid CEF extensions that contain escape characters. {issue}30010[30010] *Heartbeat* -- Fix race condition in http monitors using `mode:all` that can cause crashes. {pull}29697[pull] -- Fix broken ICMP availability check that prevented heartbeat from starting in rare cases. {pull}29413[pull] *Metricbeat* -- Use xpack.enabled on SM modules to write into .monitoring indices when using Metricbeat standalone {pull}28365[28365] -- Fix in rename processor to ingest metrics for `write.iops` to proper field instead of `write_iops` in rds metricset. {pull}28960[28960] -- Enhance filter check in kubernetes event metricset. {pull}29470[29470] -- Fix gcp metrics metricset apply aligner to all metric_types {pull}29514[29513] -- Fixed GCP GKE Overview dashboard {pull}29913[29913] *Packetbeat* @@ -90,8 +61,6 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d *Affecting all Beats* -- SASL/SCRAM in the Kafka output is no longer beta. {pull}29126[29126] -- add_process_metadata processor: add `process.parent.pid` to reflect `process.ppid`. {issue}30070[30070] {pull}30077[30077] *Auditbeat* @@ -99,7 +68,6 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d *Heartbeat* -- More errors are now visible in ES with new logic failing monitors later to ease debugging. {pull}29413[pull] *Metricbeat* @@ -112,7 +80,6 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d *Winlogbeat* -- Add support for custom XML queries {issue}1054[1054] {pull}29330[29330] *Elastic Log Driver* @@ -146,3 +113,6 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d + + + diff --git a/libbeat/docs/release.asciidoc b/libbeat/docs/release.asciidoc index 8b26e0356de9..0873a8f88168 100644 --- a/libbeat/docs/release.asciidoc +++ b/libbeat/docs/release.asciidoc @@ -8,6 +8,7 @@ This section summarizes the changes in each release. Also read <> for more detail about changes that affect upgrade. +* <> * <> * <> * <> From d705790a923e99388197faef72f6ed5f8dd1f8ae Mon Sep 17 00:00:00 2001 From: Andres Rodriguez Date: Mon, 31 Jan 2022 16:23:52 +0100 Subject: [PATCH 2/6] Fix entries that did not make the BC --- CHANGELOG.asciidoc | 2 -- CHANGELOG.next.asciidoc | 2 ++ 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/CHANGELOG.asciidoc b/CHANGELOG.asciidoc index b263d40d5a6b..80847c0bfdf8 100644 --- a/CHANGELOG.asciidoc +++ b/CHANGELOG.asciidoc @@ -24,7 +24,6 @@ https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] - Only add monitor.status to browser events when summary. {pull}29460[29460] - Also add summary to journeys for which the synthetics runner crashes. {pull}29606[29606] - Update size of ICMP packets to adhere to standard min size. {pull}29948[29948] -- Add fonts to support more different types of characters for multiple languages. {pull}29606[29861] *Metricbeat* @@ -92,7 +91,6 @@ https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] *Affecting all Beats* - SASL/SCRAM in the Kafka output is no longer beta. {pull}29126[29126] -- add_process_metadata processor: add `process.parent.pid` to reflect `process.ppid`. {issue}30070[30070] {pull}30077[30077] *Auditbeat* diff --git a/CHANGELOG.next.asciidoc b/CHANGELOG.next.asciidoc index b1c63f87d592..0d64f1e24b22 100644 --- a/CHANGELOG.next.asciidoc +++ b/CHANGELOG.next.asciidoc @@ -41,6 +41,7 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d *Heartbeat* +- Add fonts to support more different types of characters for multiple languages. {pull}29861[29861] *Metricbeat* @@ -61,6 +62,7 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d *Affecting all Beats* +- add_process_metadata processor: add `process.parent.pid` to reflect `process.ppid`. {issue}30070[30070] {pull}30077[30077] *Auditbeat* From 7cd3c9d48c5949c956c88308b13f0cde1d18e6c9 Mon Sep 17 00:00:00 2001 From: Andres Rodriguez Date: Mon, 31 Jan 2022 16:31:14 +0100 Subject: [PATCH 3/6] Missing base docker image change --- CHANGELOG.asciidoc | 1 + 1 file changed, 1 insertion(+) diff --git a/CHANGELOG.asciidoc b/CHANGELOG.asciidoc index 80847c0bfdf8..6df4f80533bb 100644 --- a/CHANGELOG.asciidoc +++ b/CHANGELOG.asciidoc @@ -11,6 +11,7 @@ https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] *Affecting all Beats* +- Change Docker base image from CentOS 7 to Ubuntu 20.04 {pull}29681[29681] - Add job.name in pods controlled by Jobs {pull}28954[28954] - Enrich kubernetes metadata with node annotations. {pull}29605[29605] From 6b7b500a86c3df7c31a3a5505c735b00f1b314cf Mon Sep 17 00:00:00 2001 From: Andres Rodriguez Date: Mon, 31 Jan 2022 17:27:30 +0100 Subject: [PATCH 4/6] Clean up breaking changes --- CHANGELOG.asciidoc | 11 +++++------ 1 file changed, 5 insertions(+), 6 deletions(-) diff --git a/CHANGELOG.asciidoc b/CHANGELOG.asciidoc index 6df4f80533bb..a5f371c45b0a 100644 --- a/CHANGELOG.asciidoc +++ b/CHANGELOG.asciidoc @@ -13,7 +13,6 @@ https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] - Change Docker base image from CentOS 7 to Ubuntu 20.04 {pull}29681[29681] - Add job.name in pods controlled by Jobs {pull}28954[28954] -- Enrich kubernetes metadata with node annotations. {pull}29605[29605] *Auditbeat* @@ -21,11 +20,6 @@ https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] *Heartbeat* -- Fix broken macOS ICMP python e2e test. {pull}29900[29900] -- Only add monitor.status to browser events when summary. {pull}29460[29460] -- Also add summary to journeys for which the synthetics runner crashes. {pull}29606[29606] -- Update size of ICMP packets to adhere to standard min size. {pull}29948[29948] - *Metricbeat* - Remove overriding of index pattern on the Kubernetes overview dashboard. {pull}29676[29676] @@ -41,6 +35,7 @@ https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] *Affecting all Beats* +- Enrich kubernetes metadata with node annotations. {pull}29605[29605] *Auditbeat* @@ -66,6 +61,10 @@ https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] - Fix race condition in http monitors using `mode:all` that can cause crashes. {pull}29697[pull] - Fix broken ICMP availability check that prevented heartbeat from starting in rare cases. {pull}29413[pull] +- Fix broken macOS ICMP python e2e test. {pull}29900[29900] +- Only add monitor.status to browser events when summary. {pull}29460[29460] +- Also add summary to journeys for which the synthetics runner crashes. {pull}29606[29606] +- Update size of ICMP packets to adhere to standard min size. {pull}29948[29948] *Metricbeat* From d5afe2a5000da1868aed2cd3b372305587574398 Mon Sep 17 00:00:00 2001 From: Andres Rodriguez Date: Mon, 31 Jan 2022 17:35:53 +0100 Subject: [PATCH 5/6] More clean up breaking changes --- CHANGELOG.asciidoc | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-) diff --git a/CHANGELOG.asciidoc b/CHANGELOG.asciidoc index a5f371c45b0a..189d18a50f78 100644 --- a/CHANGELOG.asciidoc +++ b/CHANGELOG.asciidoc @@ -12,7 +12,6 @@ https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] *Affecting all Beats* - Change Docker base image from CentOS 7 to Ubuntu 20.04 {pull}29681[29681] -- Add job.name in pods controlled by Jobs {pull}28954[28954] *Auditbeat* @@ -22,8 +21,6 @@ https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] *Metricbeat* -- Remove overriding of index pattern on the Kubernetes overview dashboard. {pull}29676[29676] - *Packetbeat* *Winlogbeat* @@ -73,6 +70,7 @@ https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] - Enhance filter check in kubernetes event metricset. {pull}29470[29470] - Fix gcp metrics metricset apply aligner to all metric_types {pull}29514[29513] - Fixed GCP GKE Overview dashboard {pull}29913[29913] +- Remove overriding of index pattern on the Kubernetes overview dashboard. {pull}29676[29676] *Packetbeat* @@ -91,6 +89,7 @@ https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] *Affecting all Beats* - SASL/SCRAM in the Kafka output is no longer beta. {pull}29126[29126] +- Add job.name in pods controlled by Jobs {pull}28954[28954] *Auditbeat* From f552a240dc0bf8ac9b9c2230a12602e2a3f1cbd7 Mon Sep 17 00:00:00 2001 From: Andres Rodriguez Date: Mon, 31 Jan 2022 17:38:04 +0100 Subject: [PATCH 6/6] Remove empty sections --- CHANGELOG.asciidoc | 70 ----------------------------------------- CHANGELOG.next.asciidoc | 3 -- 2 files changed, 73 deletions(-) diff --git a/CHANGELOG.asciidoc b/CHANGELOG.asciidoc index 189d18a50f78..01806eedd488 100644 --- a/CHANGELOG.asciidoc +++ b/CHANGELOG.asciidoc @@ -13,21 +13,6 @@ https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] - Change Docker base image from CentOS 7 to Ubuntu 20.04 {pull}29681[29681] -*Auditbeat* - -*Filebeat* - -*Heartbeat* - -*Metricbeat* - -*Packetbeat* - -*Winlogbeat* - - -*Functionbeat* - ==== Bugfixes *Affecting all Beats* @@ -72,18 +57,6 @@ https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] - Fixed GCP GKE Overview dashboard {pull}29913[29913] - Remove overriding of index pattern on the Kubernetes overview dashboard. {pull}29676[29676] -*Packetbeat* - - -*Winlogbeat* - - -*Functionbeat* - - -*Elastic Logging Plugin* - - ==== Added *Affecting all Beats* @@ -91,61 +64,18 @@ https://github.com/elastic/beats/compare/v7.16.3...v7.17.0[View commits] - SASL/SCRAM in the Kafka output is no longer beta. {pull}29126[29126] - Add job.name in pods controlled by Jobs {pull}28954[28954] -*Auditbeat* - -*Filebeat* - *Heartbeat* - More errors are now visible in ES with new logic failing monitors later to ease debugging. {pull}29413[pull] - -*Metricbeat* - -*Packetbeat* - - -*Functionbeat* - - *Winlogbeat* - Add support for custom XML queries {issue}1054[1054] {pull}29330[29330] - -*Elastic Log Driver* - - ==== Deprecated -*Affecting all Beats* - - -*Filebeat* - - -*Heartbeat* - -*Metricbeat* - - -*Packetbeat* - -*Winlogbeat* - -*Functionbeat* - ==== Known Issue -*Journalbeat* - - - - - - - - [[release-notes-7.16.3]] === Beats version 7.16.3 diff --git a/CHANGELOG.next.asciidoc b/CHANGELOG.next.asciidoc index 0d64f1e24b22..8ef4bee6d2fb 100644 --- a/CHANGELOG.next.asciidoc +++ b/CHANGELOG.next.asciidoc @@ -115,6 +115,3 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d - - -