Skip to content

Run base tests when applying module selective testing#26976

Closed
jsoriano wants to merge 1 commit intoelastic:masterfrom
jsoriano:exclude-dashboards-selective-testing
Closed

Run base tests when applying module selective testing#26976
jsoriano wants to merge 1 commit intoelastic:masterfrom
jsoriano:exclude-dashboards-selective-testing

Conversation

@jsoriano
Copy link
Copy Markdown
Member

@jsoriano jsoriano commented Jul 20, 2021 •
edited
Loading

What does this PR do?

Run base tests when applying module selective testing in python integration tests.

Why is it important?

Dashboards are not tested at the module level, they are only tested by the base tests. When a single module is modified, selective testing is applied, so dashboard tests were not executed, allowing to introduce issues when single dashboards are modified.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

How to test this PR locally

  • Introduce a failure in a dashboard of the kubernetes module (or any other module).
  • Run integration tests for this module MODULE="kubernetes" mage -v pythonIntegTest, failure should be detected.

Related issues

@jsoriano jsoriano added review Team:Integrations Label for the Integrations team labels Jul 20, 2021
@jsoriano jsoriano self-assigned this Jul 20, 2021
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Jul 20, 2021

Pinging @elastic/integrations (Team:Integrations)

@botelastic botelastic Bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Jul 20, 2021
@jsoriano jsoriano added backport-v7.14.0 Automated backport with mergify backport-v7.15.0 Automated backport with mergify needs_team Indicates that the issue/PR needs a Team:* label labels Jul 20, 2021
@botelastic botelastic Bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Jul 20, 2021
@botelastic
Copy link
Copy Markdown

botelastic Bot commented Jul 20, 2021

This pull request doesn't have a Team:<team> label.

@jsoriano jsoriano mentioned this pull request Jul 20, 2021
Merged
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Jul 20, 2021

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2021-07-20T10:36:28.294+0000

  • Duration: 106 min 24 sec

  • Commit: a145284

Test stats 🧪

Test Results
Failed 1
Passed 19362
Skipped 1536
Total 20899

Trends 🧪

Image of Build Times

Image of Tests

Test errors 1

Expand to view the tests failures

Build&Test / metricbeat-pythonIntegTest / test_dashboards – metricbeat.tests.system.test_base.Test
    Expand to view the error details

     AssertionError: Error output: 2021-07-20T12:00:36.302Z	INFO	instance/beat.go:654	Home path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards] Config path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards] Data path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/data] Logs path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/logs]
  2021-07-20T12:00:36.302Z	DEBUG	[beat]	instance/beat.go:712	Beat metadata path: /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/data/meta.json
  2021-07-20T12:00:36.307Z	INFO	instance/beat.go:662	Beat ID: 1698b9a6-8132-4b59-8475-69feacfed989
  2021-07-20T12:00:36.307Z	INFO	[beat]	instance/beat.go:996	Beat info	{"system_info": {"beat": {"path": {"config": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards", "data": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/data", "home": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards", "logs": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/logs"}, "type": "metricbeat", "uuid": "1698b9a6-8132-4b59-8475-69feacfed989"}}}
  2021-07-20T12:00:36.307Z	INFO	[beat]	instance/beat.go:1005	Build info	{"system_info": {"build": {"commit": "unknown", "libbeat": "8.0.0", "time": "1754-08-30T22:43:41.128Z", "version": "8.0.0"}}}
  2021-07-20T12:00:36.307Z	INFO	[beat]	instance/beat.go:1008	Go runtime info	{"system_info": {"go": {"os":"linux","arch":"amd64","max_procs":8,"version":"go1.16.6"}}}
  2021-07-20T12:00:36.309Z	INFO	[beat]	instance/beat.go:1012	Host info	{"system_info": {"host": {"architecture":"x86_64","boot_time":"2021-07-20T10:58:18Z","containerized":true,"name":"beats-ci-immutable-ubuntu-1804-1626778671975416100","ip":["127.0.0.1/8","::1/128","10.224.3.47/32","fe80::4001:aff:fee0:32f/64","172.17.0.1/16","fe80::42:dfff:fe7b:6c/64","172.18.0.1/16","172.19.0.1/16","fe80::42:bbff:fef7:d0a/64","fe80::dc3a:7cff:fe5e:b5ac/64","fe80::cb6:2ff:feec:c814/64"],"kernel_version":"5.4.0-1046-gcp","mac":["42:01:0a:e0:03:2f","02:42:df:7b:00:6c","02:42:b8:15:f9:a3","02:42:bb:f7:0d:0a","de:3a:7c:5e:b5:ac","0e:b6:02:ec:c8:14"],"os":{"type":"linux","family":"debian","platform":"debian","name":"Debian GNU/Linux","version":"10 (buster)","major":10,"minor":0,"patch":0,"codename":"buster"},"timezone":"UTC","timezone_offset_sec":0,"id":"88ca5e7b2819c56ffc2ab2fc4af49881"}}}
  2021-07-20T12:00:36.310Z	INFO	[beat]	instance/beat.go:1041	Process info	{"system_info": {"process": {"capabilities": {"inheritable":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"permitted":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"effective":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"bounding":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"ambient":null}, "cwd": "/go/src/github.com/elastic/beats/metricbeat", "exe": "/go/src/github.com/elastic/beats/metricbeat/metricbeat.test", "name": "metricbeat.test", "pid": 244, "ppid": 176, "seccomp": {"mode":"filter","no_new_privs":false}, "start_time": "2021-07-20T12:00:35.680Z"}}}
  2021-07-20T12:00:36.310Z	INFO	instance/beat.go:309	Setup Beat: metricbeat; Version: 8.0.0
  2021-07-20T12:00:36.310Z	DEBUG	[beat]	instance/beat.go:335	Initializing output plugins
  2021-07-20T12:00:36.310Z	INFO	[index-management]	idxmgmt/std.go:184	Set output.elasticsearch.index to 'metricbeat-8.0.0' as ILM is enabled.
  2021-07-20T12:00:36.311Z	INFO	[esclientleg]	eslegclient/connection.go:100	elasticsearch url: http://172.19.0.2:9200
  2021-07-20T12:00:36.311Z	DEBUG	[publisher]	pipeline/consumer.go:148	start pipeline event consumer
  2021-07-20T12:00:36.311Z	INFO	[publisher]	pipeline/module.go:113	Beat name: beats-ci-immutable-ubuntu-1804-1626778671975416100
  2021-07-20T12:00:36.311Z	DEBUG	[registry.lightmodules]	mb/lightmodules.go:262	Light modules directory '%!d(string=/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/module)' doesn't exist
  2021-07-20T12:00:36.311Z	DEBUG	[modules]	beater/metricbeat.go:151	Available modules and metricsets: Register [ModuleFactory:[beat, docker, elasticsearch, kibana, kubernetes, linux, logstash, mongodb, mysql, postgresql, system, uwsgi], MetricSetFactory:[aerospike/namespace, apache/status, beat/state, beat/stats, ceph/cluster_disk, ceph/cluster_health, ceph/cluster_status, ceph/mgr_cluster_disk, ceph/mgr_cluster_health, ceph/mgr_osd_perf, ceph/mgr_osd_pool_stats, ceph/mgr_osd_tree, ceph/mgr_pool_disk, ceph/monitor_health, ceph/osd_df, ceph/osd_tree, ceph/pool_disk, consul/agent, couchbase/bucket, couchbase/cluster, couchbase/node, couchdb/server, docker/container, docker/cpu, docker/diskio, docker/event, docker/healthcheck, docker/image, docker/info, docker/memory, docker/network, docker/network_summary, dropwizard/collector, elasticsearch/ccr, elasticsearch/cluster_stats, elasticsearch/enrich, elasticsearch/index, elasticsearch/index_recovery, elasticsearch/index_summary, elasticsearch/ml_job, elasticsearch/node, elasticsearch/node_stats, elasticsearch/pending_tasks, elasticsearch/shard, envoyproxy/server, etcd/leader, etcd/metrics, etcd/self, etcd/store, golang/expvar, golang/heap, graphite/server, haproxy/info, haproxy/stat, http/json, http/server, jolokia/jmx, kafka/consumergroup, kafka/partition, kibana/settings, kibana/stats, kibana/status, kubernetes/apiserver, kubernetes/container, kubernetes/controllermanager, kubernetes/event, kubernetes/node, kubernetes/pod, kubernetes/proxy, kubernetes/scheduler, kubernetes/state_container, kubernetes/state_cronjob, kubernetes/state_daemonset, kubernetes/state_deployment, kubernetes/state_job, kubernetes/state_node, kubernetes/state_persistentvolume, kubernetes/state_persistentvolumeclaim, kubernetes/state_pod, kubernetes/state_replicaset, kubernetes/state_resourcequota, kubernetes/state_service, kubernetes/state_statefulset, kubernetes/state_storageclass, kubernetes/system, kubernetes/volume, kvm/dommemstat, kvm/status, linux/conntrack, linux/iostat, linux/ksm, linux/memory, linux/pageinfo, logstash/node, logstash/node_stats, memcached/stats, mongodb/collstats, mongodb/dbstats, mongodb/metrics, mongodb/replstatus, mongodb/status, munin/node, mysql/galera_status, mysql/query, mysql/status, nats/connection, nats/connections, nats/route, nats/routes, nats/stats, nats/subscriptions, nginx/stubstatus, openmetrics/collector, php_fpm/pool, php_fpm/process, postgresql/activity, postgresql/bgwriter, postgresql/database, postgresql/statement, prometheus/collector, prometheus/query, prometheus/remote_write, rabbitmq/connection, rabbitmq/exchange, rabbitmq/node, rabbitmq/queue, redis/info, redis/key, redis/keyspace, system/core, system/cpu, system/diskio, system/entropy, system/filesystem, system/fsstat, system/load, system/memory, system/network, system/network_summary, system/process, system/process_summary, system/raid, system/service, system/socket, system/socket_summary, system/uptime, system/users, traefik/health, uwsgi/status, vsphere/datastore, vsphere/host, vsphere/virtualmachine, zookeeper/connection, zookeeper/mntr, zookeeper/server], LightModules:[LightModules:[]]]
  Loading dashboards (Kibana must be running and reachable)
  2021-07-20T12:00:36.311Z	INFO	[kibana]	kibana/client.go:124	Kibana url: http://172.19.0.3:5601
  2021-07-20T12:00:36.861Z	INFO	[kibana]	kibana/client.go:124	Kibana url: http://172.19.0.3:5601
  2021-07-20T12:00:36.881Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Initialize the Kibana 7.12.0 loader
  2021-07-20T12:00:36.881Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Kibana URL http://172.19.0.3:5601
  2021-07-20T12:00:38.176Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Importing directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7
  2021-07-20T12:00:38.176Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7
  2021-07-20T12:00:38.176Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-Host-Services-overview.json
  2021-07-20T12:00:39.170Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-aerospike-overview.json
  2021-07-20T12:00:40.203Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-apache-overview.json
  2021-07-20T12:00:41.218Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-ceph-overview.json
  2021-07-20T12:00:42.248Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-consul-overview.json
  2021-07-20T12:00:43.263Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-containers-overview.json
  2021-07-20T12:00:44.290Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-couchbase-overview.json
  2021-07-20T12:00:45.305Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-couchdb-overview.json
  2021-07-20T12:00:46.333Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-docker-overview.json
  2021-07-20T12:00:47.338Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-golang-overview.json
  2021-07-20T12:00:48.357Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-backend.json
  2021-07-20T12:00:49.409Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-frontend.json
  2021-07-20T12:00:50.387Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-http-backend.json
  2021-07-20T12:00:51.396Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-http-frontend.json
  2021-07-20T12:00:52.457Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-http-server.json
  2021-07-20T12:00:53.427Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-overview.json
  2021-07-20T12:00:54.458Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-visualizations.json
  2021-07-20T12:00:55.464Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-host-overview.json
  2021-07-20T12:00:56.500Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kafka-overview.json
  2021-07-20T12:00:57.498Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-apiserver.json
  2021-07-20T12:00:58.516Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-controller-manager.json
  2021-07-20T12:00:59.569Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-overview.json
  2021-07-20T12:00:59.633Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-proxy.json
  2021-07-20T12:01:00.549Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-scheduler.json
  2021-07-20T12:01:01.562Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-mongodb-overview.json
  2021-07-20T12:01:02.588Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-mysql-overview.json
  2021-07-20T12:01:03.599Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-nats-overview.json
  2021-07-20T12:01:04.620Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-postgresql-overview.json
  2021-07-20T12:01:05.678Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-prometheus-overview.json
  2021-07-20T12:01:06.648Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-rabbitmq-overview.json
  2021-07-20T12:01:07.658Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-redis-keys.json
  2021-07-20T12:01:08.678Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-redis-overview.json
  2021-07-20T12:01:09.683Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-system-overview.json
  2021-07-20T12:01:10.706Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-uwsgi-overview.json
  2021-07-20T12:01:11.753Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-zookeeper-overview.json
  2021-07-20T12:01:12.736Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-nginx-overview.json
  2021-07-20T12:01:13.742Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-vsphere-host.json
  2021-07-20T12:01:14.760Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-vsphere-vm.json
  2021-07-20T12:01:15.821Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-windows-service.json
  2021-07-20T12:01:16.796Z	ERROR	instance/beat.go:971	Exiting: Failed to import dashboard: Failed to load directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard:
    error loading /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-overview.json: returned 500 to import file: <nil>. Response: {"statusCode":500,"error":"Internal Server Error","message":"An internal server error occurred."}
  Exiting: Failed to import dashboard: Failed to load directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard:
    error loading /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-overview.json: returned 500 to import file: <nil>. Response: {"statusCode":500,"error":"Internal Server Error","message":"An internal server error occurred."}
  
assert 1 == 0

    Expand to view the stacktrace

     self = <test_base.Test testMethod=test_dashboards>

    @unittest.skipUnless(INTEGRATION_TESTS, "integration test")
    @pytest.mark.timeout(180, func_only=True)
    def test_dashboards(self):
        """
        Test that the dashboards can be loaded with `setup --dashboards`
        """
        shutil.copytree(self.kibana_dir(), os.path.join(self.working_dir, "kibana"))
    
        es = Elasticsearch([self.get_elasticsearch_url()])
        self.render_config_template(
            modules=[{
                "name": "apache",
                "metricsets": ["status"],
                "hosts": ["localhost"],
            }],
            elasticsearch={"host": self.get_elasticsearch_url()},
            kibana={"host": self.get_kibana_url()},
        )
        exit_code = self.run_beat(extra_args=["setup", "--dashboards"])
    
>       assert exit_code == 0, 'Error output: ' + self.get_log()
E       AssertionError: Error output: 2021-07-20T12:00:36.302Z	INFO	instance/beat.go:654	Home path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards] Config path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards] Data path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/data] Logs path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/logs]
E         2021-07-20T12:00:36.302Z	DEBUG	[beat]	instance/beat.go:712	Beat metadata path: /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/data/meta.json
E         2021-07-20T12:00:36.307Z	INFO	instance/beat.go:662	Beat ID: 1698b9a6-8132-4b59-8475-69feacfed989
E         2021-07-20T12:00:36.307Z	INFO	[beat]	instance/beat.go:996	Beat info	{"system_info": {"beat": {"path": {"config": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards", "data": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/data", "home": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards", "logs": "/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/logs"}, "type": "metricbeat", "uuid": "1698b9a6-8132-4b59-8475-69feacfed989"}}}
E         2021-07-20T12:00:36.307Z	INFO	[beat]	instance/beat.go:1005	Build info	{"system_info": {"build": {"commit": "unknown", "libbeat": "8.0.0", "time": "1754-08-30T22:43:41.128Z", "version": "8.0.0"}}}
E         2021-07-20T12:00:36.307Z	INFO	[beat]	instance/beat.go:1008	Go runtime info	{"system_info": {"go": {"os":"linux","arch":"amd64","max_procs":8,"version":"go1.16.6"}}}
E         2021-07-20T12:00:36.309Z	INFO	[beat]	instance/beat.go:1012	Host info	{"system_info": {"host": {"architecture":"x86_64","boot_time":"2021-07-20T10:58:18Z","containerized":true,"name":"beats-ci-immutable-ubuntu-1804-1626778671975416100","ip":["127.0.0.1/8","::1/128","10.224.3.47/32","fe80::4001:aff:fee0:32f/64","172.17.0.1/16","fe80::42:dfff:fe7b:6c/64","172.18.0.1/16","172.19.0.1/16","fe80::42:bbff:fef7:d0a/64","fe80::dc3a:7cff:fe5e:b5ac/64","fe80::cb6:2ff:feec:c814/64"],"kernel_version":"5.4.0-1046-gcp","mac":["42:01:0a:e0:03:2f","02:42:df:7b:00:6c","02:42:b8:15:f9:a3","02:42:bb:f7:0d:0a","de:3a:7c:5e:b5:ac","0e:b6:02:ec:c8:14"],"os":{"type":"linux","family":"debian","platform":"debian","name":"Debian GNU/Linux","version":"10 (buster)","major":10,"minor":0,"patch":0,"codename":"buster"},"timezone":"UTC","timezone_offset_sec":0,"id":"88ca5e7b2819c56ffc2ab2fc4af49881"}}}
E         2021-07-20T12:00:36.310Z	INFO	[beat]	instance/beat.go:1041	Process info	{"system_info": {"process": {"capabilities": {"inheritable":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"permitted":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"effective":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"bounding":["chown","dac_override","fowner","fsetid","kill","setgid","setuid","setpcap","net_bind_service","net_raw","sys_chroot","mknod","audit_write","setfcap"],"ambient":null}, "cwd": "/go/src/github.com/elastic/beats/metricbeat", "exe": "/go/src/github.com/elastic/beats/metricbeat/metricbeat.test", "name": "metricbeat.test", "pid": 244, "ppid": 176, "seccomp": {"mode":"filter","no_new_privs":false}, "start_time": "2021-07-20T12:00:35.680Z"}}}
E         2021-07-20T12:00:36.310Z	INFO	instance/beat.go:309	Setup Beat: metricbeat; Version: 8.0.0
E         2021-07-20T12:00:36.310Z	DEBUG	[beat]	instance/beat.go:335	Initializing output plugins
E         2021-07-20T12:00:36.310Z	INFO	[index-management]	idxmgmt/std.go:184	Set output.elasticsearch.index to 'metricbeat-8.0.0' as ILM is enabled.
E         2021-07-20T12:00:36.311Z	INFO	[esclientleg]	eslegclient/connection.go:100	elasticsearch url: http://172.19.0.2:9200
E         2021-07-20T12:00:36.311Z	DEBUG	[publisher]	pipeline/consumer.go:148	start pipeline event consumer
E         2021-07-20T12:00:36.311Z	INFO	[publisher]	pipeline/module.go:113	Beat name: beats-ci-immutable-ubuntu-1804-1626778671975416100
E         2021-07-20T12:00:36.311Z	DEBUG	[registry.lightmodules]	mb/lightmodules.go:262	Light modules directory '%!d(string=/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/module)' doesn't exist
E         2021-07-20T12:00:36.311Z	DEBUG	[modules]	beater/metricbeat.go:151	Available modules and metricsets: Register [ModuleFactory:[beat, docker, elasticsearch, kibana, kubernetes, linux, logstash, mongodb, mysql, postgresql, system, uwsgi], MetricSetFactory:[aerospike/namespace, apache/status, beat/state, beat/stats, ceph/cluster_disk, ceph/cluster_health, ceph/cluster_status, ceph/mgr_cluster_disk, ceph/mgr_cluster_health, ceph/mgr_osd_perf, ceph/mgr_osd_pool_stats, ceph/mgr_osd_tree, ceph/mgr_pool_disk, ceph/monitor_health, ceph/osd_df, ceph/osd_tree, ceph/pool_disk, consul/agent, couchbase/bucket, couchbase/cluster, couchbase/node, couchdb/server, docker/container, docker/cpu, docker/diskio, docker/event, docker/healthcheck, docker/image, docker/info, docker/memory, docker/network, docker/network_summary, dropwizard/collector, elasticsearch/ccr, elasticsearch/cluster_stats, elasticsearch/enrich, elasticsearch/index, elasticsearch/index_recovery, elasticsearch/index_summary, elasticsearch/ml_job, elasticsearch/node, elasticsearch/node_stats, elasticsearch/pending_tasks, elasticsearch/shard, envoyproxy/server, etcd/leader, etcd/metrics, etcd/self, etcd/store, golang/expvar, golang/heap, graphite/server, haproxy/info, haproxy/stat, http/json, http/server, jolokia/jmx, kafka/consumergroup, kafka/partition, kibana/settings, kibana/stats, kibana/status, kubernetes/apiserver, kubernetes/container, kubernetes/controllermanager, kubernetes/event, kubernetes/node, kubernetes/pod, kubernetes/proxy, kubernetes/scheduler, kubernetes/state_container, kubernetes/state_cronjob, kubernetes/state_daemonset, kubernetes/state_deployment, kubernetes/state_job, kubernetes/state_node, kubernetes/state_persistentvolume, kubernetes/state_persistentvolumeclaim, kubernetes/state_pod, kubernetes/state_replicaset, kubernetes/state_resourcequota, kubernetes/state_service, kubernetes/state_statefulset, kubernetes/state_storageclass, kubernetes/system, kubernetes/volume, kvm/dommemstat, kvm/status, linux/conntrack, linux/iostat, linux/ksm, linux/memory, linux/pageinfo, logstash/node, logstash/node_stats, memcached/stats, mongodb/collstats, mongodb/dbstats, mongodb/metrics, mongodb/replstatus, mongodb/status, munin/node, mysql/galera_status, mysql/query, mysql/status, nats/connection, nats/connections, nats/route, nats/routes, nats/stats, nats/subscriptions, nginx/stubstatus, openmetrics/collector, php_fpm/pool, php_fpm/process, postgresql/activity, postgresql/bgwriter, postgresql/database, postgresql/statement, prometheus/collector, prometheus/query, prometheus/remote_write, rabbitmq/connection, rabbitmq/exchange, rabbitmq/node, rabbitmq/queue, redis/info, redis/key, redis/keyspace, system/core, system/cpu, system/diskio, system/entropy, system/filesystem, system/fsstat, system/load, system/memory, system/network, system/network_summary, system/process, system/process_summary, system/raid, system/service, system/socket, system/socket_summary, system/uptime, system/users, traefik/health, uwsgi/status, vsphere/datastore, vsphere/host, vsphere/virtualmachine, zookeeper/connection, zookeeper/mntr, zookeeper/server], LightModules:[LightModules:[]]]
E         Loading dashboards (Kibana must be running and reachable)
E         2021-07-20T12:00:36.311Z	INFO	[kibana]	kibana/client.go:124	Kibana url: http://172.19.0.3:5601
E         2021-07-20T12:00:36.861Z	INFO	[kibana]	kibana/client.go:124	Kibana url: http://172.19.0.3:5601
E         2021-07-20T12:00:36.881Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Initialize the Kibana 7.12.0 loader
E         2021-07-20T12:00:36.881Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Kibana URL http://172.19.0.3:5601
E         2021-07-20T12:00:38.176Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Importing directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7
E         2021-07-20T12:00:38.176Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7
E         2021-07-20T12:00:38.176Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-Host-Services-overview.json
E         2021-07-20T12:00:39.170Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-aerospike-overview.json
E         2021-07-20T12:00:40.203Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-apache-overview.json
E         2021-07-20T12:00:41.218Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-ceph-overview.json
E         2021-07-20T12:00:42.248Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-consul-overview.json
E         2021-07-20T12:00:43.263Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-containers-overview.json
E         2021-07-20T12:00:44.290Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-couchbase-overview.json
E         2021-07-20T12:00:45.305Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-couchdb-overview.json
E         2021-07-20T12:00:46.333Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-docker-overview.json
E         2021-07-20T12:00:47.338Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-golang-overview.json
E         2021-07-20T12:00:48.357Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-backend.json
E         2021-07-20T12:00:49.409Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-frontend.json
E         2021-07-20T12:00:50.387Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-http-backend.json
E         2021-07-20T12:00:51.396Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-http-frontend.json
E         2021-07-20T12:00:52.457Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-http-server.json
E         2021-07-20T12:00:53.427Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-overview.json
E         2021-07-20T12:00:54.458Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-haproxy-visualizations.json
E         2021-07-20T12:00:55.464Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-host-overview.json
E         2021-07-20T12:00:56.500Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kafka-overview.json
E         2021-07-20T12:00:57.498Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-apiserver.json
E         2021-07-20T12:00:58.516Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-controller-manager.json
E         2021-07-20T12:00:59.569Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-overview.json
E         2021-07-20T12:00:59.633Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-proxy.json
E         2021-07-20T12:01:00.549Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-scheduler.json
E         2021-07-20T12:01:01.562Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-mongodb-overview.json
E         2021-07-20T12:01:02.588Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-mysql-overview.json
E         2021-07-20T12:01:03.599Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-nats-overview.json
E         2021-07-20T12:01:04.620Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-postgresql-overview.json
E         2021-07-20T12:01:05.678Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-prometheus-overview.json
E         2021-07-20T12:01:06.648Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-rabbitmq-overview.json
E         2021-07-20T12:01:07.658Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-redis-keys.json
E         2021-07-20T12:01:08.678Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-redis-overview.json
E         2021-07-20T12:01:09.683Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-system-overview.json
E         2021-07-20T12:01:10.706Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-uwsgi-overview.json
E         2021-07-20T12:01:11.753Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-zookeeper-overview.json
E         2021-07-20T12:01:12.736Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-nginx-overview.json
E         2021-07-20T12:01:13.742Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-vsphere-host.json
E         2021-07-20T12:01:14.760Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-vsphere-vm.json
E         2021-07-20T12:01:15.821Z	DEBUG	[dashboards]	dashboards/kibana_loader.go:160	Import dashboard from /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/metricbeat-windows-service.json
E         2021-07-20T12:01:16.796Z	ERROR	instance/beat.go:971	Exiting: Failed to import dashboard: Failed to load directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard:
E           error loading /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-overview.json: returned 500 to import file: <nil>. Response: {"statusCode":500,"error":"Internal Server Error","message":"An internal server error occurred."}
E         Exiting: Failed to import dashboard: Failed to load directory /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard:
E           error loading /go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/kibana/7/dashboard/Metricbeat-kubernetes-overview.json: returned 500 to import file: <nil>. Response: {"statusCode":500,"error":"Internal Server Error","message":"An internal server error occurred."}
E         
E       assert 1 == 0

tests/system/test_base.py:79: AssertionError

Steps errors 4

Expand to view the steps failures

metricbeat-pythonIntegTest - mage pythonIntegTest
  • Took 31 min 52 sec . View more details on here
  • Description: mage pythonIntegTest
metricbeat-pythonIntegTest - mage pythonIntegTest
  • Took 22 min 11 sec . View more details on here
  • Description: mage pythonIntegTest
metricbeat-pythonIntegTest - mage pythonIntegTest
  • Took 22 min 11 sec . View more details on here
  • Description: mage pythonIntegTest
Error signal
  • Took 0 min 0 sec . View more details on here
  • Description: Error 'hudson.AbortException: script returned exit code 1'

Log output

Expand to view the last 100 lines of log output 

[2021-07-20T12:21:33.279Z] 
[2021-07-20T12:21:33.279Z] metricbeat/module/elasticsearch/test_elasticsearch.py::Test::test_metricsets_0_ccr
[2021-07-20T12:21:33.279Z] metricbeat/module/elasticsearch/test_elasticsearch.py::Test::test_xpack
[2021-07-20T12:21:33.279Z]   /go/src/github.com/elastic/beats/build/ve/docker/lib/python3.7/site-packages/elasticsearch/connection/base.py:177: ElasticsearchDeprecationWarning: the default value for the ?wait_for_active_shards parameter will change from '0' to 'index-setting' in version 8; specify '?wait_for_active_shards=index-setting' to adopt the future default behaviour, or '?wait_for_active_shards=0' to preserve today's behaviour
[2021-07-20T12:21:33.279Z]     warnings.warn(message, category=ElasticsearchDeprecationWarning)
[2021-07-20T12:21:33.279Z] 
[2021-07-20T12:21:33.279Z] -- Docs: https://docs.pytest.org/en/stable/warnings.html
[2021-07-20T12:21:33.279Z] - generated xml file: /go/src/github.com/elastic/beats/metricbeat/build/TEST-python-integration.xml -
[2021-07-20T12:21:33.279Z] ============================= slowest 20 durations =============================
[2021-07-20T12:21:33.279Z] 61.62s setup    metricbeat/module/ceph/test_ceph.py::Test_0::test_ceph_0_cluster_disk
[2021-07-20T12:21:33.279Z] 51.41s setup    metricbeat/module/kafka/test_kafka.py::KafkaTest_0::test_kafka_jmx_0_consumer
[2021-07-20T12:21:33.279Z] 50.44s setup    metricbeat/module/kafka/test_kafka.py::KafkaTest_1::test_kafka_jmx_0_consumer
[2021-07-20T12:21:33.279Z] 50.19s setup    metricbeat/module/kafka/test_kafka.py::KafkaTest_2::test_kafka_jmx_0_consumer
[2021-07-20T12:21:33.279Z] 48.38s setup    metricbeat/module/couchbase/test_couchbase.py::Test::test_couchbase_0_bucket
[2021-07-20T12:21:33.279Z] 48.21s setup    metricbeat/module/kafka/test_kafka.py::KafkaTest_3::test_kafka_jmx_0_consumer
[2021-07-20T12:21:33.279Z] 48.21s setup    metricbeat/module/kafka/test_kafka.py::KafkaTest_4::test_kafka_jmx_0_consumer
[2021-07-20T12:21:33.279Z] 40.71s call     metricbeat/tests/system/test_base.py::Test::test_dashboards
[2021-07-20T12:21:33.279Z] 27.32s setup    metricbeat/module/ceph/test_ceph.py::Test_1::test_ceph_0_cluster_disk
[2021-07-20T12:21:33.279Z] 26.29s setup    metricbeat/module/logstash/test_logstash.py::Test::test_node
[2021-07-20T12:21:33.279Z] 26.11s setup    metricbeat/module/kibana/test_kibana.py::Test::test_status
[2021-07-20T12:21:33.279Z] 25.09s setup    metricbeat/tests/system/test_base.py::Test::test_dashboards
[2021-07-20T12:21:33.279Z] 20.41s teardown metricbeat/module/logstash/test_logstash.py::Test::test_xpack
[2021-07-20T12:21:33.279Z] 19.65s setup    metricbeat/tests/system/test_beat.py::Test::test_metricsets_0_stats
[2021-07-20T12:21:33.279Z] 19.37s setup    metricbeat/module/elasticsearch/test_elasticsearch.py::Test::test_metricsets_0_ccr
[2021-07-20T12:21:33.279Z] 17.10s setup    metricbeat/module/mysql/test_mysql.py::Test_6::test_status
[2021-07-20T12:21:33.279Z] 14.11s setup    metricbeat/module/mysql/test_mysql.py::Test_3::test_status
[2021-07-20T12:21:33.279Z] 13.07s setup    metricbeat/module/mysql/test_mysql.py::Test_1::test_status
[2021-07-20T12:21:33.279Z] 11.99s setup    metricbeat/module/postgresql/test_postgresql.py::Test_3::test_activity
[2021-07-20T12:21:33.279Z] 11.97s setup    metricbeat/module/postgresql/test_postgresql.py::Test_4::test_activity
[2021-07-20T12:21:33.279Z] =========================== short test summary info ============================
[2021-07-20T12:21:33.279Z] FAILED tests/system/test_base.py::Test::test_dashboards - AssertionError: Error output: 2021-07-20T12:00:36.302Z	INFO	instance/beat.go:654	Home path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards] Config path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards] Data path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/data] Logs path: [/go/src/github.com/elastic/beats/metricbeat/build/system-tests/run/test_base.Test.test_dashboards/logs]
[2021-07-20T12:21:33.280Z] ====== 1 failed, 233 passed, 13 skipped, 3 warnings in 1298.92s (0:21:38) ======
[2021-07-20T12:21:33.539Z] >> python test: Integration Testing Complete
[2021-07-20T12:21:33.539Z] Error: running "/go/src/github.com/elastic/beats/build/ve/docker/bin/pytest --timeout=90 --durations=20 --junit-xml=build/TEST-python-integration.xml tests/system/test_autodiscover.py tests/system/test_autodiscover_jolokia.py tests/system/test_base.py tests/system/test_beat.py tests/system/test_cmd.py tests/system/test_config.py tests/system/test_lightmodules.py tests/system/test_processors.py tests/system/test_reload.py tests/system/test_template.py tests/system/test_timeseries.py module/aerospike/test_aerospike.py module/apache/test_apache.py module/ceph/test_ceph.py module/consul/test_consul.py module/couchbase/test_couchbase.py module/couchdb/test_couchdb.py module/docker/test_docker.py module/dropwizard/test_dropwizard.py module/elasticsearch/test_elasticsearch.py module/envoyproxy/test_envoyproxy.py module/etcd/test_etcd.py module/golang/test_golang.py module/haproxy/test_haproxy.py module/http/test_http.py module/jolokia/test_jolokia.py module/kafka/test_kafka.py module/kibana/test_kibana.py module/logstash/test_logstash.py module/memcached/test_memcached.py module/mongodb/test_mongodb.py module/munin/test_munin.py module/mysql/test_mysql.py module/nats/test_nats.py module/openmetrics/test_openmetrics.py module/php_fpm/test_phpfpm.py module/postgresql/test_postgresql.py module/prometheus/test_prometheus.py module/redis/test_redis.py module/system/test_system.py module/traefik/test_traefik.py module/uwsgi/test_uwsgi.py module/vsphere/test_vsphere.py module/zookeeper/test_zookeeper.py" failed with exit code 1
[2021-07-20T12:21:34.921Z] Error: running "docker-compose -p metricbeat_8_0_0_a145284e2e-snapshot run -e DOCKER_COMPOSE_PROJECT_NAME=metricbeat_8_0_0_a145284e2e-snapshot -e BEAT_STRICT_PERMS=false -e STACK_ENVIRONMENT=snapshot -e TESTING_ENVIRONMENT=snapshot -e GOCACHE=/go/src/github.com/elastic/beats/build/docker-gocache -v /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6/pkg/mod/cache/download:/gocache:ro -e GOPROXY=file:///gocache,direct -e EXEC_UID=1166 -e EXEC_GID=1167 -e BEATS_INSIDE_INTEGRATION_TEST_ENV=true -e GOFLAGS=-mod=readonly -e TEST_COVERAGE=true -e RACE_DETECTOR=true -e TEST_TAGS=null,oracle beat /go/src/github.com/elastic/beats/metricbeat/build/mage-linux-amd64 pythonIntegTest" failed with exit code 1
[2021-07-20T12:21:35.283Z] Timeout set to expire in 5 min 0 sec
[2021-07-20T12:21:35.620Z] Cleaning up /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6
[2021-07-20T12:21:35.620Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-07-20T12:21:35.620Z] ++ id -u
[2021-07-20T12:21:35.620Z] ++ id -g
[2021-07-20T12:21:35.620Z] + docker run -v /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6:/beat alpine:3.4 sh -c 'find /beat -user 0 -exec chown -h 1166:1167 {} \;'
[2021-07-20T12:21:35.620Z] Unable to find image 'alpine:3.4' locally
[2021-07-20T12:21:36.189Z] 3.4: Pulling from library/alpine
[2021-07-20T12:21:36.448Z] c1e54eec4b57: Pulling fs layer
[2021-07-20T12:21:36.708Z] c1e54eec4b57: Download complete
[2021-07-20T12:21:36.967Z] c1e54eec4b57: Pull complete
[2021-07-20T12:21:36.967Z] Digest: sha256:b733d4a32c4da6a00a84df2ca32791bb03df95400243648d8c539e7b4cce329c
[2021-07-20T12:21:36.967Z] Status: Downloaded newer image for alpine:3.4
[2021-07-20T12:21:38.877Z] + set -e
[2021-07-20T12:21:38.877Z] + echo 'Change permissions with write access of all files inside the specific folder'
[2021-07-20T12:21:38.877Z] Change permissions with write access of all files inside the specific folder
[2021-07-20T12:21:38.877Z] + chmod -R +w /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6
[2021-07-20T12:21:40.007Z] Running in /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6/src/github.com/elastic/beats/build
[2021-07-20T12:21:40.337Z] + rm -rf ve
[2021-07-20T12:21:40.337Z] + find . -type d -name vendor -exec rm -r {} ;
[2021-07-20T12:21:40.768Z] + python .ci/scripts/pre_archive_test.py
[2021-07-20T12:21:41.707Z] Copy ./metricbeat/build into build/metricbeat/build
[2021-07-20T12:21:41.744Z] Running in /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6/src/github.com/elastic/beats/build
[2021-07-20T12:21:41.795Z] Recording test results
[2021-07-20T12:21:43.769Z] [Checks API] No suitable checks publisher found.
[2021-07-20T12:21:44.125Z] + tar --version
[2021-07-20T12:21:44.498Z] + tar --exclude=test-build-artifacts-metricbeat-pythonIntegTest-tgz -czf test-build-artifacts-metricbeat-pythonIntegTest-tgz .
[2021-07-20T12:22:17.049Z] + gsutil --version
[2021-07-20T12:22:20.387Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-07-20T12:22:20.798Z] + gcloud auth activate-service-account --key-file ****
[2021-07-20T12:22:21.737Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-07-20T12:22:22.138Z] + gsutil -m -q cp -a public-read test-build-artifacts-metricbeat-pythonIntegTest-tgz gs://beats-ci-temp/Beats/beats/PR-26976-1
[2021-07-20T12:22:25.927Z] + python .ci/scripts/search_system_tests.py
[2021-07-20T12:22:25.971Z] [INFO] system-tests='build/metricbeat/build/system-tests'. If no empty then let's create a tarball
[2021-07-20T12:22:26.329Z] + tar --version
[2021-07-20T12:22:26.703Z] + tar --exclude=metricbeat--system-tests-linux-tgz -czf metricbeat--system-tests-linux-tgz build/metricbeat/build/system-tests
[2021-07-20T12:22:35.246Z] + gsutil --version
[2021-07-20T12:22:36.676Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-07-20T12:22:37.038Z] + gcloud auth activate-service-account --key-file ****
[2021-07-20T12:22:37.605Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-07-20T12:22:38.000Z] + gsutil -m -q cp -a public-read metricbeat--system-tests-linux-tgz gs://beats-ci-temp/Beats/beats/PR-26976-1
[2021-07-20T12:22:41.110Z] + go clean -modcache
[2021-07-20T12:22:44.505Z] Timeout set to expire in 5 min 0 sec
[2021-07-20T12:22:44.839Z] Cleaning up /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6
[2021-07-20T12:22:44.839Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-07-20T12:22:44.839Z] ++ id -u
[2021-07-20T12:22:44.839Z] ++ id -g
[2021-07-20T12:22:44.839Z] + docker run -v /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6:/beat alpine:3.4 sh -c 'find /beat -user 0 -exec chown -h 1166:1167 {} \;'
[2021-07-20T12:22:45.780Z] + set -e
[2021-07-20T12:22:45.780Z] + echo 'Change permissions with write access of all files inside the specific folder'
[2021-07-20T12:22:45.780Z] Change permissions with write access of all files inside the specific folder
[2021-07-20T12:22:45.780Z] + chmod -R +w /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6
[2021-07-20T12:22:46.224Z] Running in /var/lib/jenkins/workspace/PR-26976-1-a6b82cf1-243f-43ef-b1d1-0ba4ec0cdfc6
[2021-07-20T12:22:49.732Z] Failed in branch metricbeat-pythonIntegTest
[2021-07-20T12:22:50.882Z] Stage "Extended" skipped due to earlier failure(s)
[2021-07-20T12:22:50.987Z] Stage "Packaging" skipped due to earlier failure(s)
[2021-07-20T12:22:51.083Z] Stage "Packaging-Pipeline" skipped due to earlier failure(s)
[2021-07-20T12:22:51.229Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-26976/src/github.com/elastic/beats
[2021-07-20T12:22:51.752Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-26976
[2021-07-20T12:22:51.867Z] [INFO] getVaultSecret: Getting secrets
[2021-07-20T12:22:51.921Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-07-20T12:22:52.900Z] + chmod 755 generate-build-data.sh
[2021-07-20T12:22:52.901Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26976/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26976/runs/1 FAILURE 6384331
[2021-07-20T12:22:52.901Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26976/runs/1/steps/?limit=10000 -o steps-info.json
[2021-07-20T12:22:58.095Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26976/runs/1/tests/?status=FAILED -o tests-errors.json

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Test stats 🧪

Test Results
Failed 1
Passed 19362
Skipped 1536
Total 20899

Genuine test errors 1

💔 There are test failures but not known flaky tests, most likely a genuine test failure.

  • Name: Build&Test / metricbeat-pythonIntegTest / test_dashboards – metricbeat.tests.system.test_base.Test

@jsoriano
Copy link
Copy Markdown
Member Author

jsoriano commented Jul 28, 2021

Merged as part of #26972

@jsoriano jsoriano closed this Jul 28, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@jsoriano jsoriano

Labels

backport-v7.14.0 Automated backport with mergify backport-v7.15.0 Automated backport with mergify review Team:Integrations Label for the Integrations team

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@jsoriano @elasticmachine