Skip to content

Conversation

@kvch
Copy link
Contributor

@kvch kvch commented Oct 2, 2020

#21450 has broken the Windows builds. This PR should fix it.

@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Oct 2, 2020
@kvch kvch added the Team:Services (Deprecated) Label for the former Integrations-Services team label Oct 2, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-services (Team:Services)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Oct 2, 2020
@elasticmachine
Copy link
Collaborator

elasticmachine commented Oct 2, 2020

💔 Build Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #21472 updated]

  • Start Time: 2020-10-05T07:39:46.895+0000

  • Duration: 58 min 26 sec

Test stats 🧪

Test Results
Failed 0
Passed 3567
Skipped 552
Total 4119

Steps errors

Expand to view the steps failures

  • Name: mage build test
    • Description: mage build test

    • Duration: 8 min 45 sec

    • Start Time: 2020-10-05T08:04:48.930+0000

    • log

Log output

Expand to view the last 100 lines of log output

[2020-10-05T08:36:32.924Z] c1e54eec4b57: Download complete
[2020-10-05T08:36:32.924Z] c1e54eec4b57: Pull complete
[2020-10-05T08:36:32.924Z] Digest: sha256:b733d4a32c4da6a00a84df2ca32791bb03df95400243648d8c539e7b4cce329c
[2020-10-05T08:36:32.924Z] Status: Downloaded newer image for alpine:3.4
[2020-10-05T08:36:35.173Z] + python .ci/scripts/pre_archive_test.py
[2020-10-05T08:36:37.095Z] Copy ./x-pack/filebeat/build into build/x-pack/filebeat/build
[2020-10-05T08:36:37.108Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21472/src/github.com/elastic/beats/build
[2020-10-05T08:36:37.138Z] WARNING: Unknown parameter(s) found for class type 'hudson.tasks.junit.pipeline.JUnitResultsStep': id,stashedTestReports
[2020-10-05T08:36:37.166Z] Recording test results
[2020-10-05T08:36:39.626Z] Stashed 4 file(s)
[2020-10-05T08:36:39.640Z] Archiving artifacts
[2020-10-05T08:36:40.332Z] + python .ci/scripts/search_system_tests.py
[2020-10-05T08:36:40.350Z] [INFO] system-tests='build/x-pack/filebeat/build/system-tests'. If no empty then let's create a tarball
[2020-10-05T08:36:40.660Z] + tar --version
[2020-10-05T08:36:40.978Z] + tar --exclude=x-pack-filebeat--system-tests-linux.tgz -czf x-pack-filebeat--system-tests-linux.tgz build/x-pack/filebeat/build/system-tests
[2020-10-05T08:37:02.989Z] Archiving artifacts
[2020-10-05T08:37:15.728Z] Client: Docker Engine - Community
[2020-10-05T08:37:15.728Z]  Version:           19.03.13
[2020-10-05T08:37:15.729Z]  API version:       1.40
[2020-10-05T08:37:15.729Z]  Go version:        go1.13.15
[2020-10-05T08:37:15.729Z]  Git commit:        4484c46d9d
[2020-10-05T08:37:15.729Z]  Built:             Wed Sep 16 17:02:36 2020
[2020-10-05T08:37:15.729Z]  OS/Arch:           linux/amd64
[2020-10-05T08:37:15.729Z]  Experimental:      false
[2020-10-05T08:37:15.729Z] 
[2020-10-05T08:37:15.729Z] Server: Docker Engine - Community
[2020-10-05T08:37:15.729Z]  Engine:
[2020-10-05T08:37:15.729Z]   Version:          19.03.13
[2020-10-05T08:37:15.729Z]   API version:      1.40 (minimum version 1.12)
[2020-10-05T08:37:15.729Z]   Go version:       go1.13.15
[2020-10-05T08:37:15.729Z]   Git commit:       4484c46d9d
[2020-10-05T08:37:15.729Z]   Built:            Wed Sep 16 17:01:06 2020
[2020-10-05T08:37:15.729Z]   OS/Arch:          linux/amd64
[2020-10-05T08:37:15.729Z]   Experimental:     false
[2020-10-05T08:37:15.729Z]  containerd:
[2020-10-05T08:37:15.729Z]   Version:          1.3.7
[2020-10-05T08:37:15.729Z]   GitCommit:        8fba4e9a7d01810a393d5d25a3621dc101981175
[2020-10-05T08:37:15.729Z]  runc:
[2020-10-05T08:37:15.729Z]   Version:          1.0.0-rc10
[2020-10-05T08:37:15.729Z]   GitCommit:        dc9208a3303feef5b3839f4323d9beb36df0a9dd
[2020-10-05T08:37:15.729Z]  docker-init:
[2020-10-05T08:37:15.729Z]   Version:          0.18.0
[2020-10-05T08:37:15.729Z]   GitCommit:        fec3683
[2020-10-05T08:37:26.968Z] [INFO] unstashV2: JOB_GCS_BUCKET is set. bucket param got precedency instead.
[2020-10-05T08:37:26.978Z] [INFO] unstashV2: JOB_GCS_CREDENTIALS is set. credentialsId param got precedency instead.
[2020-10-05T08:37:27.053Z] [Google Cloud Storage Plugin] Found 1 files to download from pattern: gs://beats-ci-temp/Beats/beats/PR-21472-12/source/source.tgz
[2020-10-05T08:37:27.083Z] [Google Cloud Storage Plugin] Downloading: Beats/beats/PR-21472-12/source/source.tgz to local path: /var/lib/jenkins/workspace/Beats_beats_PR-21472/source.tgz
[2020-10-05T08:37:41.133Z] + tar --version
[2020-10-05T08:37:41.430Z] + tar -xpf source.tgz
[2020-10-05T08:37:51.741Z] + rm source.tgz
[2020-10-05T08:37:51.891Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21472/src/github.com/elastic/beats
[2020-10-05T08:37:51.900Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21472/src/github.com/elastic/beats/uncategorized-1601884873134
[2020-10-05T08:37:51.952Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21472/src/github.com/elastic/beats/filebeat-build-1601885558409
[2020-10-05T08:37:51.989Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21472/src/github.com/elastic/beats/filebeat-windows-windows-2019-1601885800818
[2020-10-05T08:37:52.030Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21472/src/github.com/elastic/beats/x-pack-filebeat-windows-windows-2019-1601885829938
[2020-10-05T08:37:52.071Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21472/src/github.com/elastic/beats/x-pack-filebeat-build-1601886999190
[2020-10-05T08:37:52.412Z] + cat
[2020-10-05T08:37:52.412Z] + /usr/local/bin/runbld ./runbld-test-reports --job-name elastic+beats+pull-request
[2020-10-05T08:37:52.412Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-10-05T08:37:59.002Z] runbld>>> runbld started
[2020-10-05T08:37:59.003Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-10-05T08:37:59.949Z] runbld>>> The following profiles matched the job 'elastic+beats+pull-request' in order of occurrence in the config (last value wins).
[2020-10-05T08:37:59.949Z] runbld>>> Matches in the system config:
[2020-10-05T08:37:59.949Z] runbld>>> - Matched ^elastic\+beats
[2020-10-05T08:37:59.949Z] runbld>>> - Matched ^elastic\+beats\+pull-request
[2020-10-05T08:38:01.335Z] runbld>>> Debug logging enabled.
[2020-10-05T08:38:01.335Z] runbld>>> Storing result
[2020-10-05T08:38:01.597Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-10-05T08:38:01.597Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20201005083801-568CFFFF
[2020-10-05T08:38:01.597Z] runbld>>> Adding system facts.
[2020-10-05T08:38:02.545Z] runbld>>> Adding vcs info for the latest commit:  2f6a9bd2e4a38a39cb54fc83ccdccbcc06c248bc
[2020-10-05T08:38:02.545Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-10-05T08:38:02.545Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-10-05T08:38:02.806Z] Processing JUnit reports with runbld...
[2020-10-05T08:38:02.806Z] + echo 'Processing JUnit reports with runbld...'
[2020-10-05T08:38:03.067Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-10-05T08:38:03.067Z] runbld>>> DURATION: 46ms
[2020-10-05T08:38:03.067Z] runbld>>> STDOUT: 40 bytes
[2020-10-05T08:38:03.067Z] runbld>>> STDERR: 49 bytes
[2020-10-05T08:38:03.067Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-10-05T08:38:03.067Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-21472
[2020-10-05T08:38:04.011Z] runbld>>> Storing build metadata: 
[2020-10-05T08:38:04.012Z] runbld>>> Adding test report.
[2020-10-05T08:38:04.012Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-21472/src/github.com/elastic/beats
[2020-10-05T08:38:04.955Z] runbld>>> Found 10 test output files
[2020-10-05T08:38:05.904Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 4119 Skipped: 534
[2020-10-05T08:38:05.904Z] runbld>>> Storing result
[2020-10-05T08:38:05.904Z] runbld>>> FAILURES: 0
[2020-10-05T08:38:06.166Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-10-05T08:38:06.166Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20201005083801-568CFFFF
[2020-10-05T08:38:06.427Z] runbld>>> Email notification disabled by environment variable.
[2020-10-05T08:38:06.427Z] runbld>>> Slack notification disabled by environment variable.
[2020-10-05T08:38:12.449Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-21472
[2020-10-05T08:38:12.678Z] [INFO] getVaultSecret: Getting secrets
[2020-10-05T08:38:12.753Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-10-05T08:38:13.373Z] + chmod 755 generate-build-data.sh
[2020-10-05T08:38:13.373Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21472/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21472/runs/12 FAILURE 3506218
[2020-10-05T08:38:13.374Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21472/runs/12/steps/?limit=10000 -o steps-info.json
[2020-10-05T08:38:14.284Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21472/runs/12/tests/?status=FAILED -o tests-errors.json
[2020-10-05T08:38:14.835Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21472/runs/12/log/ -o pipeline-log.txt

@kvch kvch merged commit c912167 into elastic:master Oct 5, 2020
kvch added a commit to kvch/beats that referenced this pull request Oct 5, 2020
kvch added a commit that referenced this pull request Oct 5, 2020
…ner for filestream (#21468)

* Add implementation of FSWatcher and FSScanner for filestream (#21444)

## What does this PR do?

This PR adds the implementation for `FSWatcher` and `FSScanner` for the `filestream` input.

The implementation of `FSScanner` is called `fileScanner`. It is responsible for
* resolves recursive globs on creation
* normalizes glob patterns on creation
* finds files which match the configured paths and returns `FileInfo` for those

This is the refactored version of the `log` input's scanner, globber functions.

The implementation of `FSWatcher` is called `fileWatcher`. It checks the file list returned by `fileScanner` and creates events based on the result.

## Why is it important?

It is required for the `filestream` input.

## Related issues

Related #20243

(cherry picked from commit a119083)

* Do not run symlink tests on Windows (#21472)
v1v added a commit to v1v/beats that referenced this pull request Oct 5, 2020
…-matches-found

* upstream/master: (21 commits)
  Skip filestream flaky tests (elastic#21490)
  Ignore unsupported metrics in the azure module (elastic#21486)
  Do not run symlink tests on Windows (elastic#21472)
  Map `cloud.account.id` to azure sub id (elastic#21483)
  Add support for app_state metricset (elastic#20639)
  Include original error when metricbeat fails to connect with Kafka (elastic#21484)
  Prompt only when agent is already enrolled (elastic#21473)
  Fix leftover delpoyment example (elastic#21474)
  Bump version to ECS 1.6 in modules without ECS updates (elastic#21455)
  Clarify input type configuration options (elastic#19284)
  Increase index pattern size check to 10MiB (elastic#21487)
  Migrate S3 Input to Filebeat Input V2 (elastic#20005)
  [libbeat] Add configurable exponential backoff for disk queue write errors (elastic#21493)
  Revert "Revert "[JJBB] Set shallow cloning to 10 (elastic#21409)" (elastic#21447)" (elastic#21467)
  Fix format of debug messages in tlscommon (elastic#21482)
  [CI] Change x-pack/auditbeat build events (comments, labels) (elastic#21463)
  [CI] changeset from elastic#20603 was not added to CI2.0 (elastic#21464)
  Add new log file reader for filestream input (elastic#21450)
  [CI] Send slack message with build status (elastic#21428)
  Remove duplicated sources url in dependencies report (elastic#21462)
  ...
v1v added a commit to v1v/beats that referenced this pull request Oct 5, 2020
* upstream/master: (26 commits)
  [Ingest Manager] Send updating state (elastic#21461)
  [Filebeat][New Fileset] Cisco Umbrella support (elastic#21504)
  [Ingest Manager] Download asc from artifact store specified in spec (elastic#21488)
  Implementation of fileProspector (elastic#21479)
  [Metricbeat] Add latency config option into aws module (elastic#20875)
  Skip filestream flaky tests (elastic#21490)
  Ignore unsupported metrics in the azure module (elastic#21486)
  Do not run symlink tests on Windows (elastic#21472)
  Map `cloud.account.id` to azure sub id (elastic#21483)
  Add support for app_state metricset (elastic#20639)
  Include original error when metricbeat fails to connect with Kafka (elastic#21484)
  Prompt only when agent is already enrolled (elastic#21473)
  Fix leftover delpoyment example (elastic#21474)
  Bump version to ECS 1.6 in modules without ECS updates (elastic#21455)
  Clarify input type configuration options (elastic#19284)
  Increase index pattern size check to 10MiB (elastic#21487)
  Migrate S3 Input to Filebeat Input V2 (elastic#20005)
  [libbeat] Add configurable exponential backoff for disk queue write errors (elastic#21493)
  Revert "Revert "[JJBB] Set shallow cloning to 10 (elastic#21409)" (elastic#21447)" (elastic#21467)
  Fix format of debug messages in tlscommon (elastic#21482)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Team:Services (Deprecated) Label for the former Integrations-Services team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants