Skip to content

Conversation

@narph
Copy link
Contributor

@narph narph commented Oct 2, 2020

What does this PR do?

Maps cloud.account.id to azure subscription ID

Why is it important?

Inventory fields

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Related issues

narph added 30 commits July 23, 2020 11:01
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Oct 2, 2020
@narph narph self-assigned this Oct 2, 2020
@narph narph added [zube]: In Review needs_backport PR is waiting to be backported to other branches. Team:Platforms Label for the Integrations - Platforms team labels Oct 2, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-platforms (Team:Platforms)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Oct 2, 2020
Copy link
Contributor

@kaiyan-sheng kaiyan-sheng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks for adding this!

@elasticmachine
Copy link
Collaborator

elasticmachine commented Oct 2, 2020

💔 Tests Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #21483 updated]

  • Start Time: 2020-10-02T15:39:13.531+0000

  • Duration: 70 min 10 sec

Test stats 🧪

Test Results
Failed 2
Passed 10711
Skipped 601
Total 11314

Test errors

Expand to view the tests failures

  • Name: Build&Test / filebeat-build / TestFileScanner – filestream

    • Age: 1
    • Duration: 0
    • Error Details: Failed
  • Name: Build&Test / filebeat-build / TestFileScanner/select_all_files – filestream

    • Age: 1
    • Duration: 0
    • Error Details: Failed

Steps errors

Expand to view the steps failures

  • Name: Extract

    • Description: tar -xpf source.tgz

    • Duration: 1 min 32 sec

    • Start Time: 2020-10-02T16:09:13.143+0000

    • log

  • Name: Error signal

    • Description: untar: step failed with error script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-10-02T16:09:45.579+0000

    • log

  • Name: mage build test

    • Description: mage build test

    • Duration: 2 min 5 sec

    • Start Time: 2020-10-02T16:09:06.799+0000

    • log

  • Name: Extract

    • Description: tar -xpf source.tgz

    • Duration: 1 min 33 sec

    • Start Time: 2020-10-02T16:09:16.446+0000

    • log

  • Name: Error signal

    • Description: untar: step failed with error script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-10-02T16:09:49.001+0000

    • log

  • Name: Extract

    • Description: tar -xpf source.tgz

    • Duration: 1 min 32 sec

    • Start Time: 2020-10-02T16:09:19.832+0000

    • log

  • Name: Error signal

    • Description: untar: step failed with error script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-10-02T16:09:52.259+0000

    • log

  • Name: Extract

    • Description: tar -xpf source.tgz

    • Duration: 1 min 32 sec

    • Start Time: 2020-10-02T16:09:18.020+0000

    • log

  • Name: Error signal

    • Description: untar: step failed with error script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-10-02T16:09:50.426+0000

    • log

  • Name: Extract

    • Description: tar -xpf source.tgz

    • Duration: 1 min 33 sec

    • Start Time: 2020-10-02T16:09:24.209+0000

    • log

  • Name: Error signal

    • Description: untar: step failed with error script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-10-02T16:09:57.222+0000

    • log

  • Name: Extract

    • Description: tar -xpf source.tgz

    • Duration: 1 min 34 sec

    • Start Time: 2020-10-02T16:09:23.323+0000

    • log

  • Name: Error signal

    • Description: untar: step failed with error script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-10-02T16:09:57.699+0000

    • log

  • Name: Extract

    • Description: tar -xpf source.tgz

    • Duration: 1 min 33 sec

    • Start Time: 2020-10-02T16:09:23.885+0000

    • log

  • Name: Error signal

    • Description: untar: step failed with error script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-10-02T16:09:56.799+0000

    • log

  • Name: Extract

    • Description: tar -xpf source.tgz

    • Duration: 1 min 39 sec

    • Start Time: 2020-10-02T16:09:23.365+0000

    • log

  • Name: Error signal

    • Description: untar: step failed with error script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-10-02T16:10:02.450+0000

    • log

  • Name: Extract

    • Description: tar -xpf source.tgz

    • Duration: 1 min 32 sec

    • Start Time: 2020-10-02T16:09:19.966+0000

    • log

  • Name: Error signal

    • Description: untar: step failed with error script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-10-02T16:09:52.378+0000

    • log

  • Name: Extract

    • Description: tar -xpf source.tgz

    • Duration: 1 min 34 sec

    • Start Time: 2020-10-02T16:09:26.073+0000

    • log

  • Name: Error signal

    • Description: untar: step failed with error script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-10-02T16:09:59.926+0000

    • log

  • Name: Extract

    • Description: tar -xpf source.tgz

    • Duration: 1 min 34 sec

    • Start Time: 2020-10-02T16:09:24.905+0000

    • log

  • Name: Error signal

    • Description: untar: step failed with error script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-10-02T16:09:58.711+0000

    • log

  • Name: Extract

    • Description: tar -xpf source.tgz

    • Duration: 1 min 57 sec

    • Start Time: 2020-10-02T16:09:26.128+0000

    • log

  • Name: Error signal

    • Description: untar: step failed with error script returned exit code 1

    • Duration: 0 min 0 sec

    • Start Time: 2020-10-02T16:10:23.021+0000

    • log

Log output

Expand to view the last 100 lines of log output

[2020-10-02T16:48:23.119Z]  Go version:        go1.13.15
[2020-10-02T16:48:23.119Z]  Git commit:        4484c46d9d
[2020-10-02T16:48:23.119Z]  Built:             Wed Sep 16 17:02:36 2020
[2020-10-02T16:48:23.119Z]  OS/Arch:           linux/amd64
[2020-10-02T16:48:23.119Z]  Experimental:      false
[2020-10-02T16:48:23.119Z] 
[2020-10-02T16:48:23.119Z] Server: Docker Engine - Community
[2020-10-02T16:48:23.119Z]  Engine:
[2020-10-02T16:48:23.119Z]   Version:          19.03.13
[2020-10-02T16:48:23.119Z]   API version:      1.40 (minimum version 1.12)
[2020-10-02T16:48:23.119Z]   Go version:       go1.13.15
[2020-10-02T16:48:23.119Z]   Git commit:       4484c46d9d
[2020-10-02T16:48:23.119Z]   Built:            Wed Sep 16 17:01:06 2020
[2020-10-02T16:48:23.119Z]   OS/Arch:          linux/amd64
[2020-10-02T16:48:23.119Z]   Experimental:     false
[2020-10-02T16:48:23.119Z]  containerd:
[2020-10-02T16:48:23.119Z]   Version:          1.3.7
[2020-10-02T16:48:23.119Z]   GitCommit:        8fba4e9a7d01810a393d5d25a3621dc101981175
[2020-10-02T16:48:23.119Z]  runc:
[2020-10-02T16:48:23.119Z]   Version:          1.0.0-rc10
[2020-10-02T16:48:23.119Z]   GitCommit:        dc9208a3303feef5b3839f4323d9beb36df0a9dd
[2020-10-02T16:48:23.119Z]  docker-init:
[2020-10-02T16:48:23.119Z]   Version:          0.18.0
[2020-10-02T16:48:23.119Z]   GitCommit:        fec3683
[2020-10-02T16:48:34.162Z] [INFO] unstashV2: JOB_GCS_BUCKET is set. bucket param got precedency instead.
[2020-10-02T16:48:34.172Z] [INFO] unstashV2: JOB_GCS_CREDENTIALS is set. credentialsId param got precedency instead.
[2020-10-02T16:48:34.237Z] [Google Cloud Storage Plugin] Found 1 files to download from pattern: gs://beats-ci-temp/Beats/beats/PR-21483-2/source/source.tgz
[2020-10-02T16:48:34.256Z] [Google Cloud Storage Plugin] Downloading: Beats/beats/PR-21483-2/source/source.tgz to local path: /var/lib/jenkins/workspace/Beats_beats_PR-21483/source.tgz
[2020-10-02T16:48:47.708Z] + tar --version
[2020-10-02T16:48:48.011Z] + tar -xpf source.tgz
[2020-10-02T16:49:00.585Z] + rm source.tgz
[2020-10-02T16:49:00.641Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats
[2020-10-02T16:49:00.651Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/uncategorized-1601654727090
[2020-10-02T16:49:00.684Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/libbeat-stress-tests-1601654953922
[2020-10-02T16:49:00.715Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/x-pack-elastic-agent-build-1601655038813
[2020-10-02T16:49:00.751Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/winlogbeat-crosscompile-1601655042017
[2020-10-02T16:49:00.792Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/journalbeat-unitTest-1601655065572
[2020-10-02T16:49:00.831Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/filebeat-build-1601655076124
[2020-10-02T16:49:00.865Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/auditbeat-crosscompile-1601655087058
[2020-10-02T16:49:00.895Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/x-pack-dockerlogbeat-build-1601655099506
[2020-10-02T16:49:00.932Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/x-pack-functionbeat-build-1601655167314
[2020-10-02T16:49:00.965Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/libbeat-crosscompile-1601655231736
[2020-10-02T16:49:00.996Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/packetbeat-build-1601655257663
[2020-10-02T16:49:01.030Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/metricbeat-unitTest-1601655300127
[2020-10-02T16:49:01.078Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/heartbeat-build-1601655407750
[2020-10-02T16:49:01.114Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/x-pack-auditbeat-build-1601655464552
[2020-10-02T16:49:01.147Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/auditbeat-build-1601655492050
[2020-10-02T16:49:01.186Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/metricbeat-crosscompile-1601655600459
[2020-10-02T16:49:01.222Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/x-pack-libbeat-build-1601655608245
[2020-10-02T16:49:01.254Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/generator-beat-test-1601655671231
[2020-10-02T16:49:01.285Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/generator-metricbeat-test-1601655675303
[2020-10-02T16:49:01.323Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/x-pack-metricbeat-build-1601656661559
[2020-10-02T16:49:01.358Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/libbeat-build-1601656752207
[2020-10-02T16:49:01.397Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/metricbeat-goIntegTest-1601656962459
[2020-10-02T16:49:01.439Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/metricbeat-pythonIntegTest-1601657090265
[2020-10-02T16:49:01.472Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/x-pack-filebeat-build-1601657263264
[2020-10-02T16:49:01.809Z] + cat
[2020-10-02T16:49:01.809Z] + /usr/local/bin/runbld ./runbld-test-reports --job-name elastic+beats+pull-request
[2020-10-02T16:49:01.809Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-10-02T16:49:08.417Z] runbld>>> runbld started
[2020-10-02T16:49:08.417Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-10-02T16:49:10.338Z] runbld>>> The following profiles matched the job 'elastic+beats+pull-request' in order of occurrence in the config (last value wins).
[2020-10-02T16:49:10.338Z] runbld>>> Matches in the system config:
[2020-10-02T16:49:10.338Z] runbld>>> - Matched ^elastic\+beats
[2020-10-02T16:49:10.338Z] runbld>>> - Matched ^elastic\+beats\+pull-request
[2020-10-02T16:49:11.728Z] runbld>>> Debug logging enabled.
[2020-10-02T16:49:11.728Z] runbld>>> Storing result
[2020-10-02T16:49:11.728Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-10-02T16:49:11.728Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20201002164911-B11D2AD7
[2020-10-02T16:49:11.728Z] runbld>>> Adding system facts.
[2020-10-02T16:49:13.123Z] runbld>>> Adding vcs info for the latest commit:  eff3c2e29f7eb8150b4ac80660a184fe52d6e13b
[2020-10-02T16:49:13.123Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-10-02T16:49:13.123Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-10-02T16:49:13.123Z] Processing JUnit reports with runbld...
[2020-10-02T16:49:13.123Z] + echo 'Processing JUnit reports with runbld...'
[2020-10-02T16:49:13.385Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-10-02T16:49:13.385Z] runbld>>> DURATION: 36ms
[2020-10-02T16:49:13.385Z] runbld>>> STDOUT: 40 bytes
[2020-10-02T16:49:13.385Z] runbld>>> STDERR: 49 bytes
[2020-10-02T16:49:13.385Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-10-02T16:49:13.385Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-21483
[2020-10-02T16:49:14.330Z] runbld>>> Storing build metadata: 
[2020-10-02T16:49:14.330Z] runbld>>> Adding test report.
[2020-10-02T16:49:14.330Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats
[2020-10-02T16:49:15.276Z] runbld>>> Found 79 test output files
[2020-10-02T16:49:15.853Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/metricbeat-goIntegTest-1601656962459/metricbeat/build/TEST-go-integration-graphite.xml
[2020-10-02T16:49:15.853Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21483/src/github.com/elastic/beats/metricbeat-goIntegTest-1601656962459/metricbeat/build/TEST-go-integration-windows.xml
[2020-10-02T16:49:17.246Z] runbld>>> Test output logs contained: Errors: 0 Failures: 2 Tests: 11314 Skipped: 420
[2020-10-02T16:49:17.246Z] runbld>>> Storing result
[2020-10-02T16:49:17.246Z] runbld>>> FAILURES: 2
[2020-10-02T16:49:17.821Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-10-02T16:49:17.821Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20201002164911-B11D2AD7
[2020-10-02T16:49:17.821Z] runbld>>> Email notification disabled by environment variable.
[2020-10-02T16:49:17.821Z] runbld>>> Slack notification disabled by environment variable.
[2020-10-02T16:49:23.292Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-21483
[2020-10-02T16:49:23.320Z] [INFO] getVaultSecret: Getting secrets
[2020-10-02T16:49:23.398Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-10-02T16:49:23.991Z] + chmod 755 generate-build-data.sh
[2020-10-02T16:49:23.991Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21483/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21483/runs/2 FAILURE 4210200
[2020-10-02T16:49:23.991Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21483/runs/2/steps/?limit=10000 -o steps-info.json

@narph narph merged commit 9aab0c0 into elastic:master Oct 5, 2020
@narph narph deleted the az-inv branch October 5, 2020 08:53
narph added a commit to narph/beats that referenced this pull request Oct 5, 2020
* mofidy doc

* tet

* add cloud

* changelog

(cherry picked from commit 9aab0c0)
v1v added a commit to v1v/beats that referenced this pull request Oct 5, 2020
…-matches-found

* upstream/master: (21 commits)
  Skip filestream flaky tests (elastic#21490)
  Ignore unsupported metrics in the azure module (elastic#21486)
  Do not run symlink tests on Windows (elastic#21472)
  Map `cloud.account.id` to azure sub id (elastic#21483)
  Add support for app_state metricset (elastic#20639)
  Include original error when metricbeat fails to connect with Kafka (elastic#21484)
  Prompt only when agent is already enrolled (elastic#21473)
  Fix leftover delpoyment example (elastic#21474)
  Bump version to ECS 1.6 in modules without ECS updates (elastic#21455)
  Clarify input type configuration options (elastic#19284)
  Increase index pattern size check to 10MiB (elastic#21487)
  Migrate S3 Input to Filebeat Input V2 (elastic#20005)
  [libbeat] Add configurable exponential backoff for disk queue write errors (elastic#21493)
  Revert "Revert "[JJBB] Set shallow cloning to 10 (elastic#21409)" (elastic#21447)" (elastic#21467)
  Fix format of debug messages in tlscommon (elastic#21482)
  [CI] Change x-pack/auditbeat build events (comments, labels) (elastic#21463)
  [CI] changeset from elastic#20603 was not added to CI2.0 (elastic#21464)
  Add new log file reader for filestream input (elastic#21450)
  [CI] Send slack message with build status (elastic#21428)
  Remove duplicated sources url in dependencies report (elastic#21462)
  ...
@narph narph added the v7.10.0 label Oct 5, 2020
narph added a commit that referenced this pull request Oct 5, 2020
* mofidy doc

* tet

* add cloud

* changelog

(cherry picked from commit 9aab0c0)
v1v added a commit to v1v/beats that referenced this pull request Oct 5, 2020
* upstream/master: (26 commits)
  [Ingest Manager] Send updating state (elastic#21461)
  [Filebeat][New Fileset] Cisco Umbrella support (elastic#21504)
  [Ingest Manager] Download asc from artifact store specified in spec (elastic#21488)
  Implementation of fileProspector (elastic#21479)
  [Metricbeat] Add latency config option into aws module (elastic#20875)
  Skip filestream flaky tests (elastic#21490)
  Ignore unsupported metrics in the azure module (elastic#21486)
  Do not run symlink tests on Windows (elastic#21472)
  Map `cloud.account.id` to azure sub id (elastic#21483)
  Add support for app_state metricset (elastic#20639)
  Include original error when metricbeat fails to connect with Kafka (elastic#21484)
  Prompt only when agent is already enrolled (elastic#21473)
  Fix leftover delpoyment example (elastic#21474)
  Bump version to ECS 1.6 in modules without ECS updates (elastic#21455)
  Clarify input type configuration options (elastic#19284)
  Increase index pattern size check to 10MiB (elastic#21487)
  Migrate S3 Input to Filebeat Input V2 (elastic#20005)
  [libbeat] Add configurable exponential backoff for disk queue write errors (elastic#21493)
  Revert "Revert "[JJBB] Set shallow cloning to 10 (elastic#21409)" (elastic#21447)" (elastic#21467)
  Fix format of debug messages in tlscommon (elastic#21482)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

needs_backport PR is waiting to be backported to other branches. Team:Platforms Label for the Integrations - Platforms team v7.10.0 [zube]: In Review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add cloud.account.id into azure module

3 participants