Skip to content

Conversation

@jonatan-ivanov
Copy link
Contributor

@jonatan-ivanov jonatan-ivanov commented Jun 2, 2020

Type of change: Bug

What does this PR do?

See issue: #17192
It changes the type of the ingress_hostname field since it is not an IP address

Why is it important?

It is causing mapping issues (ingress_hostname is not an IP address): #17192 (comment)

Checklist

  • [x ] My code follows the style guidelines of this project
  • [ ] I have commented my code, particularly in hard-to-understand areas
  • [ ] I have made corresponding changes to the documentation
  • [ ] I have made corresponding change to the default configuration files
  • [ ] I have added tests that prove my fix is effective or that my feature works
  • [ ] I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Please let me know if I'm missing something here and I should have done anything else.

Related issues

Other types seem fishy too (should be IPs?), please let me know if you want these to be fixed too in this PR:

    - name: external_ip
      type: keyword
      description: Service external IP
    - name: load_balancer_ip
      type: keyword
      description: Load Balancer service IP
    - name: ingress_ip
      type: keyword
      description: Ingress IP

Logs

See: #17192 (comment)

{
  "type":"mapper_parsing_exception",
  "reason":"failed to parse field [kubernetes.service.ingress_hostname] of type [ip] in document with id 'abc123'. Preview of field's value: 'xyz123.elb.us-west-2.amazonaws.com'",
  "caused_by":{
    "type":"illegal_argument_exception",
    "reason":"'xyz123.elb.us-west-2.amazonaws.com' is not an IP string literal."
  }
}

@elasticmachine
Copy link
Contributor

Since this is a community submitted pull request, a Jenkins build has not been kicked off automatically. Can an Elastic organization member please verify the contents of this patch and then kick off a build manually?

1 similar comment
@elasticmachine
Copy link
Contributor

Since this is a community submitted pull request, a Jenkins build has not been kicked off automatically. Can an Elastic organization member please verify the contents of this patch and then kick off a build manually?

@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Jun 2, 2020
@cla-checker-service
Copy link

cla-checker-service bot commented Jun 2, 2020

💚 CLA has been signed

@elasticmachine
Copy link
Contributor

elasticmachine commented Jun 2, 2020

💔 Build Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Started by user kaiyan-sheng, Replayed #7]

  • Start Time: 2020-06-04T21:51:03.366+0000

  • Duration: 59 min 26 sec

Test stats 🧪

Test Results
Failed 0
Passed 3505
Skipped 811
Total 4316

Steps errors

Expand to view the steps failures

  • Name: Mage build test
    • Description: mage build test

    • Duration: 10 min 26 sec

    • Start Time: 2020-06-04T22:16:38.757+0000

    • log

Log output

Expand to view the last 100 lines of log output

[2020-06-04T22:50:04.170Z] 		at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:67)
[2020-06-04T22:50:04.170Z] 		at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
[2020-06-04T22:50:04.170Z] 		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[2020-06-04T22:50:04.170Z] 		at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2020-06-04T22:50:04.170Z] 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-06-04T22:50:04.170Z] 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-06-04T22:50:04.170Z] Caused: hudson.FilePath$TunneledInterruptedException
[2020-06-04T22:50:04.170Z] 	at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3075)
[2020-06-04T22:50:04.170Z] 	at hudson.remoting.UserRequest.perform(UserRequest.java:212)
[2020-06-04T22:50:04.170Z] 	at hudson.remoting.UserRequest.perform(UserRequest.java:54)
[2020-06-04T22:50:04.170Z] 	at hudson.remoting.Request$2.run(Request.java:369)
[2020-06-04T22:50:04.170Z] 	at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
[2020-06-04T22:50:04.170Z] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2020-06-04T22:50:04.170Z] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-06-04T22:50:04.170Z] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-06-04T22:50:04.170Z] 	at hudson.remoting.Engine$1.lambda$newThread$0(Engine.java:93)
[2020-06-04T22:50:04.170Z] Caused: java.lang.InterruptedException: java.lang.InterruptedException: no matches found within 10000
[2020-06-04T22:50:04.170Z] 	at hudson.FilePath.act(FilePath.java:1071)
[2020-06-04T22:50:04.170Z] 	at hudson.FilePath.act(FilePath.java:1058)
[2020-06-04T22:50:04.170Z] 	at hudson.FilePath.validateAntFileMask(FilePath.java:2684)
[2020-06-04T22:50:04.170Z] 	at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:265)
[2020-06-04T22:50:04.170Z] 	at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:80)
[2020-06-04T22:50:04.170Z] 	at org.jenkinsci.plugins.workflow.steps.CoreStep$Execution.run(CoreStep.java:67)
[2020-06-04T22:50:04.170Z] 	at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47)
[2020-06-04T22:50:04.170Z] 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[2020-06-04T22:50:04.170Z] 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[2020-06-04T22:50:04.170Z] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[2020-06-04T22:50:04.170Z] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-06-04T22:50:04.170Z] 	at java.lang.Thread.run(Thread.java:748)
[2020-06-04T22:50:04.170Z] No artifacts found that match the file pattern "**/build/TEST*.out". Configuration error?
[2020-06-04T22:50:04.558Z] + curl -sSLo codecov https://codecov.io/bash
[2020-06-04T22:50:04.828Z] + FILE=auditbeat/build/coverage/full.cov
[2020-06-04T22:50:04.828Z] + [ -f auditbeat/build/coverage/full.cov ]
[2020-06-04T22:50:04.828Z] + FILE=filebeat/build/coverage/full.cov
[2020-06-04T22:50:04.828Z] + [ -f filebeat/build/coverage/full.cov ]
[2020-06-04T22:50:04.828Z] + FILE=heartbeat/build/coverage/full.cov
[2020-06-04T22:50:04.828Z] + [ -f heartbeat/build/coverage/full.cov ]
[2020-06-04T22:50:04.828Z] + FILE=libbeat/build/coverage/full.cov
[2020-06-04T22:50:04.828Z] + [ -f libbeat/build/coverage/full.cov ]
[2020-06-04T22:50:04.828Z] + FILE=metricbeat/build/coverage/full.cov
[2020-06-04T22:50:04.828Z] + [ -f metricbeat/build/coverage/full.cov ]
[2020-06-04T22:50:04.828Z] + FILE=packetbeat/build/coverage/full.cov
[2020-06-04T22:50:04.828Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-06-04T22:50:04.828Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-06-04T22:50:04.828Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-06-04T22:50:04.828Z] + FILE=journalbeat/build/coverage/full.cov
[2020-06-04T22:50:04.828Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-06-04T22:50:06.234Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912/src/github.com/elastic/beats
[2020-06-04T22:50:06.548Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-06-04T22:50:06.560Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912/src/github.com/elastic/beats/Lint
[2020-06-04T22:50:06.642Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests
[2020-06-04T22:50:06.713Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912/src/github.com/elastic/beats/Metricbeat-x-pack-Mac-OS-X
[2020-06-04T22:50:06.791Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912/src/github.com/elastic/beats/Metricbeat-Mac-OS-X
[2020-06-04T22:50:06.864Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-06-04T22:50:06.949Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-06-04T22:50:07.024Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-06-04T22:50:07.097Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912/src/github.com/elastic/beats/Metricbeat-x-pack-Windows
[2020-06-04T22:50:07.170Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912/src/github.com/elastic/beats/Metricbeat-Windows
[2020-06-04T22:50:07.255Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912/src/github.com/elastic/beats/Filebeat-x-pack-Mac-OS-X
[2020-06-04T22:50:07.329Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912/src/github.com/elastic/beats/Metricbeat-Python-integration-tests
[2020-06-04T22:50:07.691Z] + cat
[2020-06-04T22:50:07.691Z] + /usr/local/bin/runbld ./runbld-script
[2020-06-04T22:50:07.691Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-06-04T22:50:14.287Z] runbld>>> runbld started
[2020-06-04T22:50:14.287Z] runbld>>> 1.6.11/a66728ff8f4356963772e6e6d2069392fa06acbe
[2020-06-04T22:50:16.210Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-18912' in order of occurrence in the config (last value wins).
[2020-06-04T22:50:17.602Z] runbld>>> Debug logging enabled.
[2020-06-04T22:50:17.602Z] runbld>>> Storing result
[2020-06-04T22:50:17.866Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-06-04T22:50:17.866Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200604225017-C68019D9
[2020-06-04T22:50:17.866Z] runbld>>> Adding system facts.
[2020-06-04T22:50:18.816Z] runbld>>> Adding vcs info for the latest commit:  35f3045a4d3ecfcc6079740f47cfa06bddadf2ea
[2020-06-04T22:50:18.817Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-06-04T22:50:18.817Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-06-04T22:50:19.079Z] Processing JUnit reports with runbld...
[2020-06-04T22:50:19.079Z] + echo 'Processing JUnit reports with runbld...'
[2020-06-04T22:50:19.341Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-06-04T22:50:19.341Z] runbld>>> DURATION: 10ms
[2020-06-04T22:50:19.341Z] runbld>>> STDOUT: 40 bytes
[2020-06-04T22:50:19.341Z] runbld>>> STDERR: 49 bytes
[2020-06-04T22:50:19.341Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-06-04T22:50:19.341Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912/src/github.com/elastic/beats
[2020-06-04T22:50:20.733Z] runbld>>> Storing build metadata: 
[2020-06-04T22:50:20.733Z] runbld>>> Adding test report.
[2020-06-04T22:50:20.733Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912/src/github.com/elastic/beats
[2020-06-04T22:50:21.678Z] runbld>>> Found 15 test output files
[2020-06-04T22:50:23.077Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 4316 Skipped: 729
[2020-06-04T22:50:23.077Z] runbld>>> Storing result
[2020-06-04T22:50:23.077Z] runbld>>> FAILURES: 0
[2020-06-04T22:50:23.338Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-06-04T22:50:23.338Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200604225017-C68019D9
[2020-06-04T22:50:23.338Z] runbld>>> Email notification disabled by environment variable.
[2020-06-04T22:50:23.338Z] runbld>>> Slack notification disabled by environment variable.
[2020-06-04T22:50:28.851Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18912
[2020-06-04T22:50:28.963Z] [INFO] getVaultSecret: Getting secrets
[2020-06-04T22:50:29.021Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-06-04T22:50:29.729Z] + chmod 755 generate-build-data.sh
[2020-06-04T22:50:29.729Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18912/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18912/runs/8 FAILURE 3566103
[2020-06-04T22:50:29.729Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18912/runs/8/steps/?limit=10000 -o steps-info.json
[2020-06-04T22:50:30.280Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18912/runs/8/tests/?status=FAILED -o tests-errors.json

@kaiyan-sheng
Copy link
Contributor

kaiyan-sheng commented Jun 2, 2020

Thank you for fixing this! Could you sign the CLA and also run mage update under beats/metricbeat to update the fields please?

@kaiyan-sheng kaiyan-sheng added the Team:Platforms Label for the Integrations - Platforms team label Jun 2, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/integrations-platforms (Team:Platforms)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Jun 2, 2020
@kaiyan-sheng kaiyan-sheng added needs_backport PR is waiting to be backported to other branches. needs_team Indicates that the issue/PR needs a Team:* label review labels Jun 2, 2020
@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Jun 2, 2020
@botelastic
Copy link

botelastic bot commented Jun 2, 2020

This pull request doesn't have a Team:<team> label.

@jonatan-ivanov
Copy link
Contributor Author

@kaiyan-sheng I've already done that right after the bot notified me. Is it possible to rerun the check or did I messed something up?

@jonatan-ivanov
Copy link
Contributor Author

Oh wait: #18912 (comment) and the check is passed. :)

@jsoriano
Copy link
Member

jsoriano commented Jun 3, 2020

jenkins run the tests please

@jsoriano
Copy link
Member

jsoriano commented Jun 3, 2020

@jonatan-ivanov could you please update this branch with master? Metricbeat tests are failing because of an issue that has been already solved.

@kaiyan-sheng kaiyan-sheng self-assigned this Jun 3, 2020
@jonatan-ivanov
Copy link
Contributor Author

@jsoriano @kaiyan-sheng done

@jsoriano
Copy link
Member

jsoriano commented Jun 4, 2020

ok to test

@jsoriano
Copy link
Member

jsoriano commented Jun 4, 2020

jenkins run the tests please

@jonatan-ivanov
Copy link
Contributor Author

@kaiyan-sheng @jsoriano Could you please re-run the failing jobs?
I'm not sure if they will persist, to me they sem flaky:

  • Travis has two failures both are apt-get install errors
  • x-pack Linux has an InterruptedException (timeout/something shut down?)

@jsoriano
Copy link
Member

jsoriano commented Jun 5, 2020

Failure in metricbeat x-pack job should be fixed by #18777, I think this PR would be good to go.

@kaiyan-sheng
Copy link
Contributor

@jsoriano Great! I will get this merged and cherrypicked. Thank you @jonatan-ivanov!

@kaiyan-sheng kaiyan-sheng merged commit 824f845 into elastic:master Jun 5, 2020
@zube zube bot added [zube]: Done and removed [zube]: Inbox labels Jun 5, 2020
@kaiyan-sheng kaiyan-sheng added v7.9.0 and removed needs_backport PR is waiting to be backported to other branches. labels Jun 5, 2020
kaiyan-sheng added a commit that referenced this pull request Jun 5, 2020
* Fixing type of ingress_hostname (#18912)

(cherry picked from commit 824f845)

Co-authored-by: Jonatan Ivanov <[email protected]>
kaiyan-sheng added a commit that referenced this pull request Jun 5, 2020
* Fixing type of ingress_hostname (#18912)

(cherry picked from commit 824f845)

Co-authored-by: Jonatan Ivanov <[email protected]>
kaiyan-sheng added a commit that referenced this pull request Jun 5, 2020
* Fixing type of ingress_hostname (#18912)

(cherry picked from commit 824f845)

Co-authored-by: Jonatan Ivanov <[email protected]>
@jonatan-ivanov jonatan-ivanov deleted the patch-1 branch June 6, 2020 19:38
melchiormoulin pushed a commit to melchiormoulin/beats that referenced this pull request Oct 14, 2020
leweafan pushed a commit to leweafan/beats that referenced this pull request Apr 28, 2023
…astic#19011)

* Fixing type of ingress_hostname (elastic#18912)

(cherry picked from commit 51bc252)

Co-authored-by: Jonatan Ivanov <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

review Team:Platforms Label for the Integrations - Platforms team v7.7.2 v7.8.0 v7.9.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Metricbeat mappings

5 participants