Skip to content

Skip flaky test TestFilestreamTruncate (backport #25218)#25267

Closed
mergify[bot] wants to merge 1 commit into7.13from
mergify/bp/7.13/pr-25218
Closed

Skip flaky test TestFilestreamTruncate (backport #25218)#25267
mergify[bot] wants to merge 1 commit into7.13from
mergify/bp/7.13/pr-25218

Conversation

@mergify
Copy link
Copy Markdown
Contributor

@mergify mergify Bot commented Apr 23, 2021 •
edited by zube Bot
Loading

This is an automatic backport of pull request #25218 done by Mergify.

Mergify commands and options

More conditions and actions can be found in the documentation.

You can also trigger Mergify actions by commenting on this pull request:

  • @Mergifyio refresh will re-evaluate the rules
  • @Mergifyio rebase will rebase this PR on its base branch
  • @Mergifyio update will merge the base branch into this PR
  • @Mergifyio backport <destination> will backport this PR on <destination> branch

Additionally, on Mergify dashboard you can:

  • look at your merge queues
  • generate the Mergify configuration with the config editor.

Finally, you can contact us on https://mergify.io/

@mergify mergify Bot added the backport label Apr 23, 2021
@botelastic botelastic Bot added the needs_team Indicates that the issue/PR needs a Team:* label label Apr 23, 2021
@botelastic
Copy link
Copy Markdown

botelastic Bot commented Apr 23, 2021

This pull request doesn't have a Team:<team> label.

@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Apr 23, 2021

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: Pull request #25267 opened

  • Start Time: 2021-04-23T11:42:42.832+0000

  • Duration: 58 min 20 sec

  • Commit: c00311d

Test stats 🧪

Test Results
Failed 154
Passed 13119
Skipped 2293
Total 15566

Trends 🧪

Image of Build Times

Image of Tests

Test errors 154

Expand to view the tests failures

> Show only the first 10 test failures

Build&Test / filebeat-build / TestDefaultHarvesterGroup/assert_a_harvester_for_same_source_cannot_be_started – github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile
    Expand to view the error details

     Failed

    Expand to view the stacktrace

     === RUN   TestDefaultHarvesterGroup/assert_a_harvester_for_same_source_cannot_be_started
coverage: 42.5% of statements
panic: test timed out after 10m0s

goroutine 66 [running]:
testing.(*M).startAlarm.func1()
	/usr/local/go/src/testing/testing.go:1618 +0xe5
created by time.goFunc
	/usr/local/go/src/time/sleep.go:167 +0x45

goroutine 1 [chan receive, 9 minutes]:
testing.(*T).Run(0xc000571080, 0xd43f0c, 0x19, 0xd66328, 0x494501)
	/usr/local/go/src/testing/testing.go:1169 +0x2da
testing.runTests.func1(0xc0001de900)
	/usr/local/go/src/testing/testing.go:1439 +0x78
testing.tRunner(0xc0001de900, 0xc0005bfda8)
	/usr/local/go/src/testing/testing.go:1123 +0xef
testing.runTests(0xc0004feae0, 0x12f8180, 0x11, 0x11, 0xc018ccbe289497d0, 0x8bb45bf315, 0x1306000, 0x40f608)
	/usr/local/go/src/testing/testing.go:1437 +0x2fe
testing.(*M).Run(0xc0000ef400, 0x0)
	/usr/local/go/src/testing/testing.go:1345 +0x1eb
main.main()
	_testmain.go:141 +0x1c5

goroutine 55 [chan receive, 9 minutes]:
testing.(*T).Run(0xc000571500, 0xd578e3, 0x34, 0xc000525810, 0xe02501)
	/usr/local/go/src/testing/testing.go:1169 +0x2da
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.TestDefaultHarvesterGroup(0xc000571080)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester_test.go:154 +0x18a
testing.tRunner(0xc000571080, 0xd66328)
	/usr/local/go/src/testing/testing.go:1123 +0xef
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:1168 +0x2b3

goroutine 59 [chan receive, 9 minutes]:
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.blockUntilCancelOnRun(0xc000525790, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester_test.go:353 +0x4e
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*mockHarvester).Run(0xc0004ff9e0, 0xc000525790, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester_test.go:332 +0x19b
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.startHarvester.func1(0x7fb1282246d0, 0xc0004fddc0, 0x0, 0x0)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester.go:204 +0x9a7
github.com/elastic/go-concert/unison.(*TaskGroup).Go.func1(0xc00057fe50, 0xc0004fdd80)
	/go/pkg/mod/github.com/elastic/go-concert@v0.1.0/unison/taskgroup.go:124 +0x99
created by github.com/elastic/go-concert/unison.(*TaskGroup).Go
	/go/pkg/mod/github.com/elastic/go-concert@v0.1.0/unison/taskgroup.go:122 +0xd7

goroutine 60 [sleep]:
time.Sleep(0x989680)
	/usr/local/go/src/runtime/time.go:188 +0xbf
github.com/elastic/beats/v7/libbeat/tests/resources.(*GoroutinesChecker).WaitUntilIncreased(0xc000069e28, 0x2)
	/go/src/github.com/elastic/beats/libbeat/tests/resources/goroutines.go:95 +0x2c
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.TestDefaultHarvesterGroup.func5(0xc000571500)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester_test.go:165 +0x251
testing.tRunner(0xc000571500, 0xc000525810)
	/usr/local/go/src/testing/testing.go:1123 +0xef
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:1168 +0x2b3

goroutine 62 [chan receive, 9 minutes]:
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.blockUntilCancelOnRun(0xc0005258d0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester_test.go:353 +0x4e
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*mockHarvester).Run(0xc0004ffac0, 0xc0005258d0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester_test.go:332 +0x19b
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.startHarvester.func1(0x7fb1282246d0, 0xc0004fdf40, 0x0, 0x0)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester.go:204 +0x9a7
github.com/elastic/go-concert/unison.(*TaskGroup).Go.func1(0xc000600450, 0xc0004fdf80)
	/go/pkg/mod/github.com/elastic/go-concert@v0.1.0/unison/taskgroup.go:124 +0x99
created by github.com/elastic/go-concert/unison.(*TaskGroup).Go
	/go/pkg/mod/github.com/elastic/go-concert@v0.1.0/unison/taskgroup.go:122 +0xd7

Build&Test / filebeat-build / TestDefaultHarvesterGroup – github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile
    Expand to view the error details

     Failed

    Expand to view the stacktrace

     === RUN   TestDefaultHarvesterGroup
=== RUN   TestDefaultHarvesterGroup/assert_a_harvester_is_started_in_a_goroutine
=== RUN   TestDefaultHarvesterGroup/assert_a_harvester_can_be_stopped_and_removed_from_bookkeeper
=== RUN   TestDefaultHarvesterGroup/assert_a_harvester_for_same_source_cannot_be_started
coverage: 42.5% of statements
panic: test timed out after 10m0s

goroutine 66 [running]:
testing.(*M).startAlarm.func1()
	/usr/local/go/src/testing/testing.go:1618 +0xe5
created by time.goFunc
	/usr/local/go/src/time/sleep.go:167 +0x45

goroutine 1 [chan receive, 9 minutes]:
testing.(*T).Run(0xc000571080, 0xd43f0c, 0x19, 0xd66328, 0x494501)
	/usr/local/go/src/testing/testing.go:1169 +0x2da
testing.runTests.func1(0xc0001de900)
	/usr/local/go/src/testing/testing.go:1439 +0x78
testing.tRunner(0xc0001de900, 0xc0005bfda8)
	/usr/local/go/src/testing/testing.go:1123 +0xef
testing.runTests(0xc0004feae0, 0x12f8180, 0x11, 0x11, 0xc018ccbe289497d0, 0x8bb45bf315, 0x1306000, 0x40f608)
	/usr/local/go/src/testing/testing.go:1437 +0x2fe
testing.(*M).Run(0xc0000ef400, 0x0)
	/usr/local/go/src/testing/testing.go:1345 +0x1eb
main.main()
	_testmain.go:141 +0x1c5

goroutine 55 [chan receive, 9 minutes]:
testing.(*T).Run(0xc000571500, 0xd578e3, 0x34, 0xc000525810, 0xe02501)
	/usr/local/go/src/testing/testing.go:1169 +0x2da
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.TestDefaultHarvesterGroup(0xc000571080)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester_test.go:154 +0x18a
testing.tRunner(0xc000571080, 0xd66328)
	/usr/local/go/src/testing/testing.go:1123 +0xef
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:1168 +0x2b3

goroutine 59 [chan receive, 9 minutes]:
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.blockUntilCancelOnRun(0xc000525790, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester_test.go:353 +0x4e
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*mockHarvester).Run(0xc0004ff9e0, 0xc000525790, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester_test.go:332 +0x19b
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.startHarvester.func1(0x7fb1282246d0, 0xc0004fddc0, 0x0, 0x0)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester.go:204 +0x9a7
github.com/elastic/go-concert/unison.(*TaskGroup).Go.func1(0xc00057fe50, 0xc0004fdd80)
	/go/pkg/mod/github.com/elastic/go-concert@v0.1.0/unison/taskgroup.go:124 +0x99
created by github.com/elastic/go-concert/unison.(*TaskGroup).Go
	/go/pkg/mod/github.com/elastic/go-concert@v0.1.0/unison/taskgroup.go:122 +0xd7

goroutine 60 [sleep]:
time.Sleep(0x989680)
	/usr/local/go/src/runtime/time.go:188 +0xbf
github.com/elastic/beats/v7/libbeat/tests/resources.(*GoroutinesChecker).WaitUntilIncreased(0xc000069e28, 0x2)
	/go/src/github.com/elastic/beats/libbeat/tests/resources/goroutines.go:95 +0x2c
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.TestDefaultHarvesterGroup.func5(0xc000571500)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester_test.go:165 +0x251
testing.tRunner(0xc000571500, 0xc000525810)
	/usr/local/go/src/testing/testing.go:1123 +0xef
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:1168 +0x2b3

goroutine 62 [chan receive, 9 minutes]:
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.blockUntilCancelOnRun(0xc0005258d0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester_test.go:353 +0x4e
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.(*mockHarvester).Run(0xc0004ffac0, 0xc0005258d0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester_test.go:332 +0x19b
github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile.startHarvester.func1(0x7fb1282246d0, 0xc0004fdf40, 0x0, 0x0)
	/go/src/github.com/elastic/beats/filebeat/input/filestream/internal/input-logfile/harvester.go:204 +0x9a7
github.com/elastic/go-concert/unison.(*TaskGroup).Go.func1(0xc000600450, 0xc0004fdf80)
	/go/pkg/mod/github.com/elastic/go-concert@v0.1.0/unison/taskgroup.go:124 +0x99
created by github.com/elastic/go-concert/unison.(*TaskGroup).Go
	/go/pkg/mod/github.com/elastic/go-concert@v0.1.0/unison/taskgroup.go:122 +0xd7

Build&Test / filebeat-build / TestDefaultHarvesterGroup/assert_a_harvester_is_started_in_a_goroutine – github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile
    Expand to view the error details

     Failed

    Expand to view the stacktrace

     === RUN   TestDefaultHarvesterGroup/assert_a_harvester_is_started_in_a_goroutine

Build&Test / filebeat-build / TestDefaultHarvesterGroup/assert_a_harvester_can_be_stopped_and_removed_from_bookkeeper – github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile
    Expand to view the error details

     Failed

    Expand to view the stacktrace

     === RUN   TestDefaultHarvesterGroup/assert_a_harvester_can_be_stopped_and_removed_from_bookkeeper

Build&Test / x-pack/filebeat-build / test_fileset_file_001_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     AssertionError: The following expected object doesn't match:    Diff:   {'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}}, full object:    {'log.offset': 0, 'source.geo.continent_name': 'North America', 'source.geo.region_iso_code': 'US-PA', 'source.geo.city_name': 'State College', 'source.geo.country_iso_code': 'US', 'source.geo.country_name': 'United States', 'source.geo.region_name': 'Pennsylvania', 'source.geo.location.lon': -77.8618, 'source.geo.location.lat': 40.7957, 'source.as.number': 7922, 'source.as.organization.name': 'COMCAST-7922', 'source.ip': '98.235.162.24', 'source.user.domain': 'bar.com', 'source.user.name': 'foo', 'source.user.id': '1', 'source.user.email': 'foo@bar.com', 'fileset.name': 'saml', 'tags': ['forwarded'], 'input.type': 'log', 'related.ip': ['98.235.162.24'], 'related.user': ['foo'], 'google_workspace.saml.initiated_by': 'idp', 'google_workspace.saml.status_code': 'SUCCESS_URI', 'google_workspace.saml.application_name': 'app', 'google_workspace.saml.second_level_status_code': 'SUCCESS_URI', 'google_workspace.saml.failure_type': 'failure_app_not_configured_for_user', 'google_workspace.saml.orgunit_path': 'ounit', 'service.type': 'gsuite', 'organization.id': '1', 'event.original': '{"kind":"admin#reports#activity","id":{"time":"2020-10-02T15:00:00Z","uniqueQualifier":1,"applicationName":"saml","customerId":"1"},"actor":{"callerType":"USER","email":"foo@bar.com","profileId":1},"ownerDomain":"elastic.com","ipAddress":"98.235.162.24","events":{"type":"login","name":"login_failure","parameters":[{"name":"application_name","value":"app"},{"name":"failure_type","value":"failure_app_not_configured_for_user"},{"name":"initiated_by","value":"idp"},{"name":"orgunit_path","value":"ounit"},{"name":"saml_second_level_status_code","value":"SUCCESS_URI"},{"name":"saml_status_code","value":"SUCCESS_URI"}]}}', 'event.provider': 'saml', 'event.module': 'gsuite', 'event.action': 'login_failure', 'event.id': '1', 'event.type': ['start'], 'event.category': ['authentication', 'session'], 'event.dataset': 'gsuite.saml', 'event.outcome': 'failure', 'user.domain': 'bar.com', 'user.name': 'foo', 'user.id': '1', 'gsuite.actor.type': 'USER', 'gsuite.kind': 'admin#reports#activity', 'gsuite.organization.domain': 'elastic.com', 'gsuite.event.type': 'login'} assert 1 == 0  +  where 1 = len({'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}})

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_001_gsuite>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
    cfgfile=cfgfile)
../../filebeat/tests/system/test_modules.py:193: in run_on_file
    self._test_expected_events(test_file, objects)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_001_gsuite>
test_file = '/go/src/github.com/elastic/beats/x-pack/filebeat/module/gsuite/saml/test/gsuite-saml-test.json.log'
objects = [{'@timestamp': '2020-10-02T15:00:00.000Z', 'agent': {'ephemeral_id': '83badf13-d90e-4182-9685-ed8e011b2955', 'hostnam...{'action': 'login_success', 'category': ['authentication', 'session'], 'dataset': 'gsuite.saml', 'id': '1', ...}, ...}]

    def _test_expected_events(self, test_file, objects):
    
        # Generate expected files if GENERATE env variable is set
        if os.getenv("GENERATE"):
            with open(test_file + "-expected.json", 'w') as f:
                # Flatten an cleanup objects
                # This makes sure when generated on different machines / version the expected.json stays the same.
                for k, obj in enumerate(objects):
                    objects[k] = self.flatten_object(obj, {}, "")
                    clean_keys(objects[k])
    
                json.dump(objects, f, indent=4, separators=(',', ': '), sort_keys=True)
    
        with open(test_file + "-expected.json", "r") as f:
            expected = json.load(f)
    
        assert len(expected) == len(objects), "expected {} events to compare but got {}".format(
            len(expected), len(objects))
    
        for idx in range(len(expected)):
            ev = expected[idx]
            obj = objects[idx]
    
            # Flatten objects for easier comparing
            obj = self.flatten_object(obj, {}, "")
            clean_keys(obj)
            clean_keys(ev)
    
            d = DeepDiff(ev, obj, ignore_order=True)
    
>           assert len(d) == 0, "The following expected object doesn't match:\n Diff:\n{}, full object: \n{}".format(d, obj)
E           AssertionError: The following expected object doesn't match:
E              Diff:
E             {'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}}, full object: 
E             {'log.offset': 0, 'source.geo.continent_name': 'North America', 'source.geo.region_iso_code': 'US-PA', 'source.geo.city_name': 'State College', 'source.geo.country_iso_code': 'US', 'source.geo.country_name': 'United States', 'source.geo.region_name': 'Pennsylvania', 'source.geo.location.lon': -77.8618, 'source.geo.location.lat': 40.7957, 'source.as.number': 7922, 'source.as.organization.name': 'COMCAST-7922', 'source.ip': '98.235.162.24', 'source.user.domain': 'bar.com', 'source.user.name': 'foo', 'source.user.id': '1', 'source.user.email': 'foo@bar.com', 'fileset.name': 'saml', 'tags': ['forwarded'], 'input.type': 'log', 'related.ip': ['98.235.162.24'], 'related.user': ['foo'], 'google_workspace.saml.initiated_by': 'idp', 'google_workspace.saml.status_code': 'SUCCESS_URI', 'google_workspace.saml.application_name': 'app', 'google_workspace.saml.second_level_status_code': 'SUCCESS_URI', 'google_workspace.saml.failure_type': 'failure_app_not_configured_for_user', 'google_workspace.saml.orgunit_path': 'ounit', 'service.type': 'gsuite', 'organization.id': '1', 'event.original': '{"kind":"admin#reports#activity","id":{"time":"2020-10-02T15:00:00Z","uniqueQualifier":1,"applicationName":"saml","customerId":"1"},"actor":{"callerType":"USER","email":"foo@bar.com","profileId":1},"ownerDomain":"elastic.com","ipAddress":"98.235.162.24","events":{"type":"login","name":"login_failure","parameters":[{"name":"application_name","value":"app"},{"name":"failure_type","value":"failure_app_not_configured_for_user"},{"name":"initiated_by","value":"idp"},{"name":"orgunit_path","value":"ounit"},{"name":"saml_second_level_status_code","value":"SUCCESS_URI"},{"name":"saml_status_code","value":"SUCCESS_URI"}]}}', 'event.provider': 'saml', 'event.module': 'gsuite', 'event.action': 'login_failure', 'event.id': '1', 'event.type': ['start'], 'event.category': ['authentication', 'session'], 'event.dataset': 'gsuite.saml', 'event.outcome': 'failure', 'user.domain': 'bar.com', 'user.name': 'foo', 'user.id': '1', 'gsuite.actor.type': 'USER', 'gsuite.kind': 'admin#reports#activity', 'gsuite.organization.domain': 'elastic.com', 'gsuite.event.type': 'login'}
E           assert 1 == 0
E            +  where 1 = len({'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}})

../../filebeat/tests/system/test_modules.py:225: AssertionError

Build&Test / x-pack/filebeat-build / test_fileset_file_002_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     AssertionError: The following expected object doesn't match:    Diff:   {'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}}, full object:    {'log.offset': 0, 'source.geo.continent_name': 'North America', 'source.geo.region_iso_code': 'US-PA', 'source.geo.city_name': 'State College', 'source.geo.country_iso_code': 'US', 'source.geo.country_name': 'United States', 'source.geo.region_name': 'Pennsylvania', 'source.geo.location.lon': -77.8618, 'source.geo.location.lat': 40.7957, 'source.as.number': 7922, 'source.as.organization.name': 'COMCAST-7922', 'source.ip': '98.235.162.24', 'source.user.domain': 'bar.com', 'source.user.name': 'foo', 'source.user.id': '1', 'source.user.email': 'foo@bar.com', 'fileset.name': 'groups', 'tags': ['forwarded'], 'input.type': 'log', 'related.ip': ['98.235.162.24'], 'related.user': ['foo'], 'service.type': 'gsuite', 'organization.id': '1', 'event.original': '{"kind":"admin#reports#activity","id":{"time":"2020-10-02T15:00:00Z","uniqueQualifier":1,"applicationName":"groups","customerId":"1"},"actor":{"callerType":"USER","email":"foo@bar.com","profileId":1},"ownerDomain":"elastic.com","ipAddress":"98.235.162.24","events":{"type":"acl_change","name":"change_acl_permission","parameters":[{"name":"acl_permission","value":"can_add_members"},{"name":"group_email","value":"group@example.com"},{"name":"new_value_repeated","multiValue":["managers","members"]},{"name":"old_value_repeated","multiValue":["managers"]}]}}', 'event.provider': 'groups', 'event.module': 'gsuite', 'event.action': 'change_acl_permission', 'event.id': '1', 'event.category': ['iam'], 'event.type': ['group', 'change'], 'event.dataset': 'gsuite.groups', 'user.domain': 'bar.com', 'user.name': 'foo', 'user.id': '1', 'gsuite.actor.type': 'USER', 'gsuite.kind': 'admin#reports#activity', 'gsuite.organization.domain': 'elastic.com', 'gsuite.groups.old_value': ['managers'], 'gsuite.groups.email': 'group@example.com', 'gsuite.groups.acl_permission': 'can_add_members', 'gsuite.groups.new_value': ['managers', 'members'], 'gsuite.event.type': 'acl_change', 'group.domain': 'example.com', 'group.name': 'group'} assert 1 == 0  +  where 1 = len({'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}})

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_002_gsuite>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
    cfgfile=cfgfile)
../../filebeat/tests/system/test_modules.py:193: in run_on_file
    self._test_expected_events(test_file, objects)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_002_gsuite>
test_file = '/go/src/github.com/elastic/beats/x-pack/filebeat/module/gsuite/groups/test/gsuite-groups-test.json.log'
objects = [{'@timestamp': '2020-10-02T15:00:00.000Z', 'agent': {'ephemeral_id': '8c095a81-0c6b-4146-a1e4-ca4fc6cb11dd', 'hostnam...: 'change_basic_setting', 'category': ['iam', 'configuration'], 'dataset': 'gsuite.groups', 'id': '1', ...}, ...}, ...]

    def _test_expected_events(self, test_file, objects):
    
        # Generate expected files if GENERATE env variable is set
        if os.getenv("GENERATE"):
            with open(test_file + "-expected.json", 'w') as f:
                # Flatten an cleanup objects
                # This makes sure when generated on different machines / version the expected.json stays the same.
                for k, obj in enumerate(objects):
                    objects[k] = self.flatten_object(obj, {}, "")
                    clean_keys(objects[k])
    
                json.dump(objects, f, indent=4, separators=(',', ': '), sort_keys=True)
    
        with open(test_file + "-expected.json", "r") as f:
            expected = json.load(f)
    
        assert len(expected) == len(objects), "expected {} events to compare but got {}".format(
            len(expected), len(objects))
    
        for idx in range(len(expected)):
            ev = expected[idx]
            obj = objects[idx]
    
            # Flatten objects for easier comparing
            obj = self.flatten_object(obj, {}, "")
            clean_keys(obj)
            clean_keys(ev)
    
            d = DeepDiff(ev, obj, ignore_order=True)
    
>           assert len(d) == 0, "The following expected object doesn't match:\n Diff:\n{}, full object: \n{}".format(d, obj)
E           AssertionError: The following expected object doesn't match:
E              Diff:
E             {'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}}, full object: 
E             {'log.offset': 0, 'source.geo.continent_name': 'North America', 'source.geo.region_iso_code': 'US-PA', 'source.geo.city_name': 'State College', 'source.geo.country_iso_code': 'US', 'source.geo.country_name': 'United States', 'source.geo.region_name': 'Pennsylvania', 'source.geo.location.lon': -77.8618, 'source.geo.location.lat': 40.7957, 'source.as.number': 7922, 'source.as.organization.name': 'COMCAST-7922', 'source.ip': '98.235.162.24', 'source.user.domain': 'bar.com', 'source.user.name': 'foo', 'source.user.id': '1', 'source.user.email': 'foo@bar.com', 'fileset.name': 'groups', 'tags': ['forwarded'], 'input.type': 'log', 'related.ip': ['98.235.162.24'], 'related.user': ['foo'], 'service.type': 'gsuite', 'organization.id': '1', 'event.original': '{"kind":"admin#reports#activity","id":{"time":"2020-10-02T15:00:00Z","uniqueQualifier":1,"applicationName":"groups","customerId":"1"},"actor":{"callerType":"USER","email":"foo@bar.com","profileId":1},"ownerDomain":"elastic.com","ipAddress":"98.235.162.24","events":{"type":"acl_change","name":"change_acl_permission","parameters":[{"name":"acl_permission","value":"can_add_members"},{"name":"group_email","value":"group@example.com"},{"name":"new_value_repeated","multiValue":["managers","members"]},{"name":"old_value_repeated","multiValue":["managers"]}]}}', 'event.provider': 'groups', 'event.module': 'gsuite', 'event.action': 'change_acl_permission', 'event.id': '1', 'event.category': ['iam'], 'event.type': ['group', 'change'], 'event.dataset': 'gsuite.groups', 'user.domain': 'bar.com', 'user.name': 'foo', 'user.id': '1', 'gsuite.actor.type': 'USER', 'gsuite.kind': 'admin#reports#activity', 'gsuite.organization.domain': 'elastic.com', 'gsuite.groups.old_value': ['managers'], 'gsuite.groups.email': 'group@example.com', 'gsuite.groups.acl_permission': 'can_add_members', 'gsuite.groups.new_value': ['managers', 'members'], 'gsuite.event.type': 'acl_change', 'group.domain': 'example.com', 'group.name': 'group'}
E           assert 1 == 0
E            +  where 1 = len({'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}})

../../filebeat/tests/system/test_modules.py:225: AssertionError

Build&Test / x-pack/filebeat-build / test_fileset_file_003_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     AssertionError: The following expected object doesn't match:    Diff:   {'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}}, full object:    {'log.offset': 0, 'source.geo.continent_name': 'North America', 'source.geo.region_iso_code': 'US-PA', 'source.geo.city_name': 'State College', 'source.geo.country_iso_code': 'US', 'source.geo.country_name': 'United States', 'source.geo.region_name': 'Pennsylvania', 'source.geo.location.lon': -77.8618, 'source.geo.location.lat': 40.7957, 'source.as.number': 7922, 'source.as.organization.name': 'COMCAST-7922', 'source.ip': '98.235.162.24', 'source.user.domain': 'bar.com', 'source.user.name': 'foo', 'source.user.id': '1', 'source.user.email': 'foo@bar.com', 'fileset.name': 'admin', 'tags': ['forwarded'], 'input.type': 'log', 'related.ip': ['98.235.162.24'], 'related.user': ['foo', 'user'], 'service.type': 'gsuite', 'organization.id': '1', 'event.original': '{"kind":"admin#reports#activity","id":{"time":"2020-10-02T15:00:00Z","uniqueQualifier":1,"applicationName":"admin","customerId":"1"},"actor":{"callerType":"USER","email":"foo@bar.com","profileId":1},"ownerDomain":"elastic.com","ipAddress":"98.235.162.24","events":{"type":"MOBILE_SETTINGS","name":"ACTION_CANCELLED","parameters":[{"name":"ACTION_ID","value":"id"},{"name":"ACTION_TYPE","value":"ACCOUNT_WIPE"},{"name":"DEVICE_ID","value":"id"},{"name":"DEVICE_TYPE","value":"type"},{"name":"USER_EMAIL","value":"user@example.com"}]}}', 'event.provider': 'admin', 'event.module': 'gsuite', 'event.action': 'ACTION_CANCELLED', 'event.id': '1', 'event.category': ['iam'], 'event.type': ['user', 'info'], 'event.dataset': 'gsuite.admin', 'user.domain': 'bar.com', 'user.name': 'foo', 'user.id': '1', 'user.target.domain': 'example.com', 'user.target.name': 'user', 'user.target.email': 'user@example.com', 'gsuite.actor.type': 'USER', 'gsuite.kind': 'admin#reports#activity', 'gsuite.organization.domain': 'elastic.com', 'gsuite.admin.mobile.action.id': 'id', 'gsuite.admin.mobile.action.type': 'ACCOUNT_WIPE', 'gsuite.admin.device.id': 'id', 'gsuite.admin.device.type': 'type', 'gsuite.admin.user.email': 'user@example.com', 'gsuite.event.type': 'MOBILE_SETTINGS'} assert 1 == 0  +  where 1 = len({'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}})

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_003_gsuite>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
    cfgfile=cfgfile)
../../filebeat/tests/system/test_modules.py:193: in run_on_file
    self._test_expected_events(test_file, objects)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_003_gsuite>
test_file = '/go/src/github.com/elastic/beats/x-pack/filebeat/module/gsuite/admin/test/gsuite-admin-mobile-test.json.log'
objects = [{'@timestamp': '2020-10-02T15:00:00.000Z', 'agent': {'ephemeral_id': '4eed0360-528a-4122-b1ed-ae11b9a0a1db', 'hostnam...ent': {'action': 'COMPANY_DEVICE_DELETION', 'category': ['iam'], 'dataset': 'gsuite.admin', 'id': '1', ...}, ...}, ...]

    def _test_expected_events(self, test_file, objects):
    
        # Generate expected files if GENERATE env variable is set
        if os.getenv("GENERATE"):
            with open(test_file + "-expected.json", 'w') as f:
                # Flatten an cleanup objects
                # This makes sure when generated on different machines / version the expected.json stays the same.
                for k, obj in enumerate(objects):
                    objects[k] = self.flatten_object(obj, {}, "")
                    clean_keys(objects[k])
    
                json.dump(objects, f, indent=4, separators=(',', ': '), sort_keys=True)
    
        with open(test_file + "-expected.json", "r") as f:
            expected = json.load(f)
    
        assert len(expected) == len(objects), "expected {} events to compare but got {}".format(
            len(expected), len(objects))
    
        for idx in range(len(expected)):
            ev = expected[idx]
            obj = objects[idx]
    
            # Flatten objects for easier comparing
            obj = self.flatten_object(obj, {}, "")
            clean_keys(obj)
            clean_keys(ev)
    
            d = DeepDiff(ev, obj, ignore_order=True)
    
>           assert len(d) == 0, "The following expected object doesn't match:\n Diff:\n{}, full object: \n{}".format(d, obj)
E           AssertionError: The following expected object doesn't match:
E              Diff:
E             {'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}}, full object: 
E             {'log.offset': 0, 'source.geo.continent_name': 'North America', 'source.geo.region_iso_code': 'US-PA', 'source.geo.city_name': 'State College', 'source.geo.country_iso_code': 'US', 'source.geo.country_name': 'United States', 'source.geo.region_name': 'Pennsylvania', 'source.geo.location.lon': -77.8618, 'source.geo.location.lat': 40.7957, 'source.as.number': 7922, 'source.as.organization.name': 'COMCAST-7922', 'source.ip': '98.235.162.24', 'source.user.domain': 'bar.com', 'source.user.name': 'foo', 'source.user.id': '1', 'source.user.email': 'foo@bar.com', 'fileset.name': 'admin', 'tags': ['forwarded'], 'input.type': 'log', 'related.ip': ['98.235.162.24'], 'related.user': ['foo', 'user'], 'service.type': 'gsuite', 'organization.id': '1', 'event.original': '{"kind":"admin#reports#activity","id":{"time":"2020-10-02T15:00:00Z","uniqueQualifier":1,"applicationName":"admin","customerId":"1"},"actor":{"callerType":"USER","email":"foo@bar.com","profileId":1},"ownerDomain":"elastic.com","ipAddress":"98.235.162.24","events":{"type":"MOBILE_SETTINGS","name":"ACTION_CANCELLED","parameters":[{"name":"ACTION_ID","value":"id"},{"name":"ACTION_TYPE","value":"ACCOUNT_WIPE"},{"name":"DEVICE_ID","value":"id"},{"name":"DEVICE_TYPE","value":"type"},{"name":"USER_EMAIL","value":"user@example.com"}]}}', 'event.provider': 'admin', 'event.module': 'gsuite', 'event.action': 'ACTION_CANCELLED', 'event.id': '1', 'event.category': ['iam'], 'event.type': ['user', 'info'], 'event.dataset': 'gsuite.admin', 'user.domain': 'bar.com', 'user.name': 'foo', 'user.id': '1', 'user.target.domain': 'example.com', 'user.target.name': 'user', 'user.target.email': 'user@example.com', 'gsuite.actor.type': 'USER', 'gsuite.kind': 'admin#reports#activity', 'gsuite.organization.domain': 'elastic.com', 'gsuite.admin.mobile.action.id': 'id', 'gsuite.admin.mobile.action.type': 'ACCOUNT_WIPE', 'gsuite.admin.device.id': 'id', 'gsuite.admin.device.type': 'type', 'gsuite.admin.user.email': 'user@example.com', 'gsuite.event.type': 'MOBILE_SETTINGS'}
E           assert 1 == 0
E            +  where 1 = len({'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}})

../../filebeat/tests/system/test_modules.py:225: AssertionError

Build&Test / x-pack/filebeat-build / test_fileset_file_004_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     AssertionError: The following expected object doesn't match:    Diff:   {'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}}, full object:    {'log.offset': 0, 'source.geo.continent_name': 'North America', 'source.geo.region_iso_code': 'US-PA', 'source.geo.city_name': 'State College', 'source.geo.country_iso_code': 'US', 'source.geo.country_name': 'United States', 'source.geo.region_name': 'Pennsylvania', 'source.geo.location.lon': -77.8618, 'source.geo.location.lat': 40.7957, 'source.as.number': 7922, 'source.as.organization.name': 'COMCAST-7922', 'source.ip': '98.235.162.24', 'source.user.domain': 'bar.com', 'source.user.name': 'foo', 'source.user.id': '1', 'source.user.email': 'foo@bar.com', 'fileset.name': 'admin', 'url.path': '/path/in/url', 'url.full': 'http://example.com/path/in/url', 'tags': ['forwarded'], 'input.type': 'log', 'related.ip': ['98.235.162.24'], 'related.user': ['foo'], 'service.type': 'gsuite', 'organization.id': '1', 'event.original': '{"kind":"admin#reports#activity","id":{"time":"2020-10-02T15:00:00Z","uniqueQualifier":1,"applicationName":"admin","customerId":"1"},"actor":{"callerType":"USER","email":"foo@bar.com","profileId":1},"ownerDomain":"elastic.com","ipAddress":"98.235.162.24","events":{"type":"SITES_SETTINGS","name":"ADD_WEB_ADDRESS","parameters":[{"name":"SITE_LOCATION","value":"/path/in/url"},{"name":"WEB_ADDRESS","value":"http://example.com/path/in/url"},{"name":"NEW_VALUE","value":"new"},{"name":"OLD_VALUE","value":"old"},{"name":"ORG_UNIT_NAME","value":"org"},{"name":"SETTING_NAME","value":"setting"}]}}', 'event.provider': 'admin', 'event.module': 'gsuite', 'event.action': 'ADD_WEB_ADDRESS', 'event.id': '1', 'event.category': ['iam'], 'event.type': ['creation'], 'event.dataset': 'gsuite.admin', 'user.domain': 'bar.com', 'user.name': 'foo', 'user.id': '1', 'gsuite.actor.type': 'USER', 'gsuite.kind': 'admin#reports#activity', 'gsuite.organization.domain': 'elastic.com', 'gsuite.admin.org_unit.name': 'org', 'gsuite.admin.old_value': 'old', 'gsuite.admin.new_value': 'new', 'gsuite.admin.setting.name': 'setting', 'gsuite.event.type': 'SITES_SETTINGS'} assert 1 == 0  +  where 1 = len({'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}})

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_004_gsuite>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
    cfgfile=cfgfile)
../../filebeat/tests/system/test_modules.py:193: in run_on_file
    self._test_expected_events(test_file, objects)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_004_gsuite>
test_file = '/go/src/github.com/elastic/beats/x-pack/filebeat/module/gsuite/admin/test/gsuite-admin-sites-test.json.log'
objects = [{'@timestamp': '2020-10-02T15:00:00.000Z', 'agent': {'ephemeral_id': 'f331593d-8f29-4ad0-bd22-b37965112793', 'hostnam....9.0'}, 'event': {'action': 'VIEW_SITE_DETAILS', 'category': ['iam'], 'dataset': 'gsuite.admin', 'id': '1', ...}, ...}]

    def _test_expected_events(self, test_file, objects):
    
        # Generate expected files if GENERATE env variable is set
        if os.getenv("GENERATE"):
            with open(test_file + "-expected.json", 'w') as f:
                # Flatten an cleanup objects
                # This makes sure when generated on different machines / version the expected.json stays the same.
                for k, obj in enumerate(objects):
                    objects[k] = self.flatten_object(obj, {}, "")
                    clean_keys(objects[k])
    
                json.dump(objects, f, indent=4, separators=(',', ': '), sort_keys=True)
    
        with open(test_file + "-expected.json", "r") as f:
            expected = json.load(f)
    
        assert len(expected) == len(objects), "expected {} events to compare but got {}".format(
            len(expected), len(objects))
    
        for idx in range(len(expected)):
            ev = expected[idx]
            obj = objects[idx]
    
            # Flatten objects for easier comparing
            obj = self.flatten_object(obj, {}, "")
            clean_keys(obj)
            clean_keys(ev)
    
            d = DeepDiff(ev, obj, ignore_order=True)
    
>           assert len(d) == 0, "The following expected object doesn't match:\n Diff:\n{}, full object: \n{}".format(d, obj)
E           AssertionError: The following expected object doesn't match:
E              Diff:
E             {'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}}, full object: 
E             {'log.offset': 0, 'source.geo.continent_name': 'North America', 'source.geo.region_iso_code': 'US-PA', 'source.geo.city_name': 'State College', 'source.geo.country_iso_code': 'US', 'source.geo.country_name': 'United States', 'source.geo.region_name': 'Pennsylvania', 'source.geo.location.lon': -77.8618, 'source.geo.location.lat': 40.7957, 'source.as.number': 7922, 'source.as.organization.name': 'COMCAST-7922', 'source.ip': '98.235.162.24', 'source.user.domain': 'bar.com', 'source.user.name': 'foo', 'source.user.id': '1', 'source.user.email': 'foo@bar.com', 'fileset.name': 'admin', 'url.path': '/path/in/url', 'url.full': 'http://example.com/path/in/url', 'tags': ['forwarded'], 'input.type': 'log', 'related.ip': ['98.235.162.24'], 'related.user': ['foo'], 'service.type': 'gsuite', 'organization.id': '1', 'event.original': '{"kind":"admin#reports#activity","id":{"time":"2020-10-02T15:00:00Z","uniqueQualifier":1,"applicationName":"admin","customerId":"1"},"actor":{"callerType":"USER","email":"foo@bar.com","profileId":1},"ownerDomain":"elastic.com","ipAddress":"98.235.162.24","events":{"type":"SITES_SETTINGS","name":"ADD_WEB_ADDRESS","parameters":[{"name":"SITE_LOCATION","value":"/path/in/url"},{"name":"WEB_ADDRESS","value":"http://example.com/path/in/url"},{"name":"NEW_VALUE","value":"new"},{"name":"OLD_VALUE","value":"old"},{"name":"ORG_UNIT_NAME","value":"org"},{"name":"SETTING_NAME","value":"setting"}]}}', 'event.provider': 'admin', 'event.module': 'gsuite', 'event.action': 'ADD_WEB_ADDRESS', 'event.id': '1', 'event.category': ['iam'], 'event.type': ['creation'], 'event.dataset': 'gsuite.admin', 'user.domain': 'bar.com', 'user.name': 'foo', 'user.id': '1', 'gsuite.actor.type': 'USER', 'gsuite.kind': 'admin#reports#activity', 'gsuite.organization.domain': 'elastic.com', 'gsuite.admin.org_unit.name': 'org', 'gsuite.admin.old_value': 'old', 'gsuite.admin.new_value': 'new', 'gsuite.admin.setting.name': 'setting', 'gsuite.event.type': 'SITES_SETTINGS'}
E           assert 1 == 0
E            +  where 1 = len({'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}})

../../filebeat/tests/system/test_modules.py:225: AssertionError

Build&Test / x-pack/filebeat-build / test_fileset_file_005_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     AssertionError: The following expected object doesn't match:    Diff:   {'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}}, full object:    {'log.offset': 0, 'source.geo.continent_name': 'North America', 'source.geo.region_iso_code': 'US-PA', 'source.geo.city_name': 'State College', 'source.geo.country_iso_code': 'US', 'source.geo.country_name': 'United States', 'source.geo.region_name': 'Pennsylvania', 'source.geo.location.lon': -77.8618, 'source.geo.location.lat': 40.7957, 'source.as.number': 7922, 'source.as.organization.name': 'COMCAST-7922', 'source.ip': '98.235.162.24', 'source.user.domain': 'bar.com', 'source.user.name': 'foo', 'source.user.id': '1', 'source.user.email': 'foo@bar.com', 'fileset.name': 'admin', 'tags': ['forwarded'], 'input.type': 'log', 'related.ip': ['98.235.162.24'], 'related.user': ['foo', 'user'], 'service.type': 'gsuite', 'organization.id': '1', 'event.original': '{"kind":"admin#reports#activity","id":{"time":"2020-10-02T15:00:00Z","uniqueQualifier":1,"applicationName":"admin","customerId":"1"},"actor":{"callerType":"USER","email":"foo@bar.com","profileId":1},"ownerDomain":"elastic.com","ipAddress":"98.235.162.24","events":{"type":"DELEGATED_ADMIN_SETTINGS","name":"ASSIGN_ROLE","parameters":[{"name":"ORG_UNIT_NAME","value":"org"},{"name":"ROLE_NAME","value":"_DIRECTORY_SYNC_ADMIN_ROLE"},{"name":"USER_EMAIL","value":"user@example.com"}]}}', 'event.provider': 'admin', 'event.module': 'gsuite', 'event.action': 'ASSIGN_ROLE', 'event.id': '1', 'event.category': ['iam'], 'event.type': ['change'], 'event.dataset': 'gsuite.admin', 'user.domain': 'bar.com', 'user.name': 'foo', 'user.id': '1', 'user.target.domain': 'example.com', 'user.target.name': 'user', 'user.target.email': 'user@example.com', 'gsuite.actor.type': 'USER', 'gsuite.kind': 'admin#reports#activity', 'gsuite.organization.domain': 'elastic.com', 'gsuite.admin.org_unit.name': 'org', 'gsuite.admin.role.name': '_DIRECTORY_SYNC_ADMIN_ROLE', 'gsuite.admin.user.email': 'user@example.com', 'gsuite.event.type': 'DELEGATED_ADMIN_SETTINGS'} assert 1 == 0  +  where 1 = len({'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}})

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_005_gsuite>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
    cfgfile=cfgfile)
../../filebeat/tests/system/test_modules.py:193: in run_on_file
    self._test_expected_events(test_file, objects)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_005_gsuite>
test_file = '/go/src/github.com/elastic/beats/x-pack/filebeat/module/gsuite/admin/test/gsuite-admin-delegatedadmin-test.json.log'
objects = [{'@timestamp': '2020-10-02T15:00:00.000Z', 'agent': {'ephemeral_id': 'e0f5666e-d2f6-4600-bd3c-a2a0ff0b25ae', 'hostnam...1.9.0'}, 'event': {'action': 'RENAME_ROLE', 'category': ['iam'], 'dataset': 'gsuite.admin', 'id': '1', ...}, ...}, ...]

    def _test_expected_events(self, test_file, objects):
    
        # Generate expected files if GENERATE env variable is set
        if os.getenv("GENERATE"):
            with open(test_file + "-expected.json", 'w') as f:
                # Flatten an cleanup objects
                # This makes sure when generated on different machines / version the expected.json stays the same.
                for k, obj in enumerate(objects):
                    objects[k] = self.flatten_object(obj, {}, "")
                    clean_keys(objects[k])
    
                json.dump(objects, f, indent=4, separators=(',', ': '), sort_keys=True)
    
        with open(test_file + "-expected.json", "r") as f:
            expected = json.load(f)
    
        assert len(expected) == len(objects), "expected {} events to compare but got {}".format(
            len(expected), len(objects))
    
        for idx in range(len(expected)):
            ev = expected[idx]
            obj = objects[idx]
    
            # Flatten objects for easier comparing
            obj = self.flatten_object(obj, {}, "")
            clean_keys(obj)
            clean_keys(ev)
    
            d = DeepDiff(ev, obj, ignore_order=True)
    
>           assert len(d) == 0, "The following expected object doesn't match:\n Diff:\n{}, full object: \n{}".format(d, obj)
E           AssertionError: The following expected object doesn't match:
E              Diff:
E             {'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}}, full object: 
E             {'log.offset': 0, 'source.geo.continent_name': 'North America', 'source.geo.region_iso_code': 'US-PA', 'source.geo.city_name': 'State College', 'source.geo.country_iso_code': 'US', 'source.geo.country_name': 'United States', 'source.geo.region_name': 'Pennsylvania', 'source.geo.location.lon': -77.8618, 'source.geo.location.lat': 40.7957, 'source.as.number': 7922, 'source.as.organization.name': 'COMCAST-7922', 'source.ip': '98.235.162.24', 'source.user.domain': 'bar.com', 'source.user.name': 'foo', 'source.user.id': '1', 'source.user.email': 'foo@bar.com', 'fileset.name': 'admin', 'tags': ['forwarded'], 'input.type': 'log', 'related.ip': ['98.235.162.24'], 'related.user': ['foo', 'user'], 'service.type': 'gsuite', 'organization.id': '1', 'event.original': '{"kind":"admin#reports#activity","id":{"time":"2020-10-02T15:00:00Z","uniqueQualifier":1,"applicationName":"admin","customerId":"1"},"actor":{"callerType":"USER","email":"foo@bar.com","profileId":1},"ownerDomain":"elastic.com","ipAddress":"98.235.162.24","events":{"type":"DELEGATED_ADMIN_SETTINGS","name":"ASSIGN_ROLE","parameters":[{"name":"ORG_UNIT_NAME","value":"org"},{"name":"ROLE_NAME","value":"_DIRECTORY_SYNC_ADMIN_ROLE"},{"name":"USER_EMAIL","value":"user@example.com"}]}}', 'event.provider': 'admin', 'event.module': 'gsuite', 'event.action': 'ASSIGN_ROLE', 'event.id': '1', 'event.category': ['iam'], 'event.type': ['change'], 'event.dataset': 'gsuite.admin', 'user.domain': 'bar.com', 'user.name': 'foo', 'user.id': '1', 'user.target.domain': 'example.com', 'user.target.name': 'user', 'user.target.email': 'user@example.com', 'gsuite.actor.type': 'USER', 'gsuite.kind': 'admin#reports#activity', 'gsuite.organization.domain': 'elastic.com', 'gsuite.admin.org_unit.name': 'org', 'gsuite.admin.role.name': '_DIRECTORY_SYNC_ADMIN_ROLE', 'gsuite.admin.user.email': 'user@example.com', 'gsuite.event.type': 'DELEGATED_ADMIN_SETTINGS'}
E           assert 1 == 0
E            +  where 1 = len({'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}})

../../filebeat/tests/system/test_modules.py:225: AssertionError

Build&Test / x-pack/filebeat-build / test_fileset_file_006_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     AssertionError: The following expected object doesn't match:    Diff:   {'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}}, full object:    {'log.offset': 0, 'source.geo.continent_name': 'North America', 'source.geo.region_iso_code': 'US-PA', 'source.geo.city_name': 'State College', 'source.geo.country_iso_code': 'US', 'source.geo.country_name': 'United States', 'source.geo.region_name': 'Pennsylvania', 'source.geo.location.lon': -77.8618, 'source.geo.location.lat': 40.7957, 'source.as.number': 7922, 'source.as.organization.name': 'COMCAST-7922', 'source.ip': '98.235.162.24', 'source.user.domain': 'bar.com', 'source.user.name': 'foo', 'source.user.id': '1', 'source.user.email': 'foo@bar.com', 'fileset.name': 'admin', 'tags': ['forwarded'], 'input.type': 'log', 'related.ip': ['98.235.162.24'], 'related.user': ['foo'], 'service.type': 'gsuite', 'organization.id': '1', 'event.original': '{"kind":"admin#reports#activity","id":{"time":"2020-10-02T15:00:00Z","uniqueQualifier":1,"applicationName":"admin","customerId":"1"},"actor":{"callerType":"USER","email":"foo@bar.com","profileId":1},"ownerDomain":"elastic.com","ipAddress":"98.235.162.24","events":{"type":"ORG_SETTINGS","name":"CHROME_LICENSES_ENABLED","parameters":[{"name":"APPLICATION_NAME","value":"app"},{"name":"CHROME_LICENSES_ENABLED","value":"DISABLED"},{"name":"ORG_UNIT_NAME","value":"org"}]}}', 'event.provider': 'admin', 'event.module': 'gsuite', 'event.action': 'CHROME_LICENSES_ENABLED', 'event.id': '1', 'event.category': ['iam'], 'event.type': ['change'], 'event.dataset': 'gsuite.admin', 'user.domain': 'bar.com', 'user.name': 'foo', 'user.id': '1', 'gsuite.actor.type': 'USER', 'gsuite.kind': 'admin#reports#activity', 'gsuite.organization.domain': 'elastic.com', 'gsuite.admin.org_unit.name': 'org', 'gsuite.admin.application.name': 'app', 'gsuite.admin.chrome_licenses.enabled': 'DISABLED', 'gsuite.event.type': 'ORG_SETTINGS'} assert 1 == 0  +  where 1 = len({'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}})

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_006_gsuite>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
    cfgfile=cfgfile)
../../filebeat/tests/system/test_modules.py:193: in run_on_file
    self._test_expected_events(test_file, objects)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_006_gsuite>
test_file = '/go/src/github.com/elastic/beats/x-pack/filebeat/module/gsuite/admin/test/gsuite-admin-org-test.json.log'
objects = [{'@timestamp': '2020-10-02T15:00:00.000Z', 'agent': {'ephemeral_id': 'b6250314-0f00-4524-bced-211408650187', 'hostnam..., 'event': {'action': 'ASSIGN_CUSTOM_LOGO', 'category': ['iam'], 'dataset': 'gsuite.admin', 'id': '1', ...}, ...}, ...]

    def _test_expected_events(self, test_file, objects):
    
        # Generate expected files if GENERATE env variable is set
        if os.getenv("GENERATE"):
            with open(test_file + "-expected.json", 'w') as f:
                # Flatten an cleanup objects
                # This makes sure when generated on different machines / version the expected.json stays the same.
                for k, obj in enumerate(objects):
                    objects[k] = self.flatten_object(obj, {}, "")
                    clean_keys(objects[k])
    
                json.dump(objects, f, indent=4, separators=(',', ': '), sort_keys=True)
    
        with open(test_file + "-expected.json", "r") as f:
            expected = json.load(f)
    
        assert len(expected) == len(objects), "expected {} events to compare but got {}".format(
            len(expected), len(objects))
    
        for idx in range(len(expected)):
            ev = expected[idx]
            obj = objects[idx]
    
            # Flatten objects for easier comparing
            obj = self.flatten_object(obj, {}, "")
            clean_keys(obj)
            clean_keys(ev)
    
            d = DeepDiff(ev, obj, ignore_order=True)
    
>           assert len(d) == 0, "The following expected object doesn't match:\n Diff:\n{}, full object: \n{}".format(d, obj)
E           AssertionError: The following expected object doesn't match:
E              Diff:
E             {'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}}, full object: 
E             {'log.offset': 0, 'source.geo.continent_name': 'North America', 'source.geo.region_iso_code': 'US-PA', 'source.geo.city_name': 'State College', 'source.geo.country_iso_code': 'US', 'source.geo.country_name': 'United States', 'source.geo.region_name': 'Pennsylvania', 'source.geo.location.lon': -77.8618, 'source.geo.location.lat': 40.7957, 'source.as.number': 7922, 'source.as.organization.name': 'COMCAST-7922', 'source.ip': '98.235.162.24', 'source.user.domain': 'bar.com', 'source.user.name': 'foo', 'source.user.id': '1', 'source.user.email': 'foo@bar.com', 'fileset.name': 'admin', 'tags': ['forwarded'], 'input.type': 'log', 'related.ip': ['98.235.162.24'], 'related.user': ['foo'], 'service.type': 'gsuite', 'organization.id': '1', 'event.original': '{"kind":"admin#reports#activity","id":{"time":"2020-10-02T15:00:00Z","uniqueQualifier":1,"applicationName":"admin","customerId":"1"},"actor":{"callerType":"USER","email":"foo@bar.com","profileId":1},"ownerDomain":"elastic.com","ipAddress":"98.235.162.24","events":{"type":"ORG_SETTINGS","name":"CHROME_LICENSES_ENABLED","parameters":[{"name":"APPLICATION_NAME","value":"app"},{"name":"CHROME_LICENSES_ENABLED","value":"DISABLED"},{"name":"ORG_UNIT_NAME","value":"org"}]}}', 'event.provider': 'admin', 'event.module': 'gsuite', 'event.action': 'CHROME_LICENSES_ENABLED', 'event.id': '1', 'event.category': ['iam'], 'event.type': ['change'], 'event.dataset': 'gsuite.admin', 'user.domain': 'bar.com', 'user.name': 'foo', 'user.id': '1', 'gsuite.actor.type': 'USER', 'gsuite.kind': 'admin#reports#activity', 'gsuite.organization.domain': 'elastic.com', 'gsuite.admin.org_unit.name': 'org', 'gsuite.admin.application.name': 'app', 'gsuite.admin.chrome_licenses.enabled': 'DISABLED', 'gsuite.event.type': 'ORG_SETTINGS'}
E           assert 1 == 0
E            +  where 1 = len({'values_changed': {"root['source.as.organization.name']": {'new_value': 'COMCAST-7922', 'old_value': 'Comcast Cable Communications, LLC'}}})

../../filebeat/tests/system/test_modules.py:225: AssertionError

Steps errors 3

Expand to view the steps failures

filebeat-build - mage build test
  • Took 19 min 7 sec . View more details on here
  • Description: mage build test
x-pack/filebeat-build - mage build test
  • Took 38 min 33 sec . View more details on here
  • Description: mage build test
Error signal
  • Took 0 min 0 sec . View more details on here
  • Description: Error 'hudson.AbortException: script returned exit code 1'

Log output

Expand to view the last 100 lines of log output 

[2021-04-23T12:38:22.023Z]   Git commit:       46229ca
[2021-04-23T12:38:22.023Z]   Built:            Fri Jan 29 14:31:25 2021
[2021-04-23T12:38:22.023Z]   OS/Arch:          linux/amd64
[2021-04-23T12:38:22.023Z]   Experimental:     false
[2021-04-23T12:38:22.023Z]  containerd:
[2021-04-23T12:38:22.023Z]   Version:          1.4.4
[2021-04-23T12:38:22.023Z]   GitCommit:        05f951a3781f4f2c1911b05e61c160e9c30eaa8e
[2021-04-23T12:38:22.023Z]  runc:
[2021-04-23T12:38:22.023Z]   Version:          1.0.0-rc93
[2021-04-23T12:38:22.023Z]   GitCommit:        12644e614e25b05da6fd08a38ffa0cfe1903fdec
[2021-04-23T12:38:22.023Z]  docker-init:
[2021-04-23T12:38:22.023Z]   Version:          0.19.0
[2021-04-23T12:38:22.023Z]   GitCommit:        de40ad0
[2021-04-23T12:38:22.023Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-04-23T12:38:22.023Z] Unable to find image 'alpine:3.4' locally
[2021-04-23T12:38:22.595Z] 3.4: Pulling from library/alpine
[2021-04-23T12:38:22.855Z] c1e54eec4b57: Pulling fs layer
[2021-04-23T12:38:23.115Z] c1e54eec4b57: Verifying Checksum
[2021-04-23T12:38:23.115Z] c1e54eec4b57: Download complete
[2021-04-23T12:38:23.377Z] c1e54eec4b57: Pull complete
[2021-04-23T12:38:23.377Z] Digest: sha256:b733d4a32c4da6a00a84df2ca32791bb03df95400243648d8c539e7b4cce329c
[2021-04-23T12:38:23.377Z] Status: Downloaded newer image for alpine:3.4
[2021-04-23T12:38:25.920Z] Change permissions with write access of all files inside the specific folder
[2021-04-23T12:38:26.895Z] Running in /var/lib/jenkins/workspace/PR-25267-1-cd91ca02-da3f-4498-9797-780d26e35819/src/github.com/elastic/beats/build
[2021-04-23T12:38:27.223Z] + rm -rf ve
[2021-04-23T12:38:27.223Z] + find . -type d -name vendor -exec rm -r {} ;
[2021-04-23T12:38:27.619Z] + python .ci/scripts/pre_archive_test.py
[2021-04-23T12:38:30.164Z] Copy ./x-pack/filebeat/build into build/x-pack/filebeat/build
[2021-04-23T12:38:30.193Z] Running in /var/lib/jenkins/workspace/PR-25267-1-cd91ca02-da3f-4498-9797-780d26e35819/src/github.com/elastic/beats/build
[2021-04-23T12:38:30.239Z] Recording test results
[2021-04-23T12:38:32.252Z] [Checks API] No suitable checks publisher found.
[2021-04-23T12:38:32.600Z] + tar --version
[2021-04-23T12:38:32.977Z] + tar --exclude=test-build-artifacts-x-pack-filebeat-build-tgz -czf test-build-artifacts-x-pack-filebeat-build-tgz .
[2021-04-23T12:39:41.317Z] + gsutil --version
[2021-04-23T12:39:41.317Z] /var/lib/jenkins/workspace/PR-25267-1-cd91ca02-da3f-4498-9797-780d26e35819/src/github.com/elastic/beats/build@tmp/durable-cf6f235f/script.sh: 1: /var/lib/jenkins/workspace/PR-25267-1-cd91ca02-da3f-4498-9797-780d26e35819/src/github.com/elastic/beats/build@tmp/durable-cf6f235f/script.sh: gsutil: not found
[2021-04-23T12:39:41.387Z] Running in /var/lib/jenkins/workspace/PR-25267-1-cd91ca02-da3f-4498-9797-780d26e35819/src/github.com/elastic/beats/build@tmp
[2021-04-23T12:39:41.762Z] + wget --version
[2021-04-23T12:39:42.140Z] + wget -q -O gsutil.tar.gz https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-sdk-319.0.0-linux-x86_64.tar.gz
[2021-04-23T12:39:43.083Z] + tar -xpf gsutil.tar.gz --strip-components=1
[2021-04-23T12:39:45.730Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-04-23T12:39:46.141Z] + gcloud auth activate-service-account --key-file ****
[2021-04-23T12:39:48.051Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-04-23T12:39:48.432Z] + gsutil -m -q cp -a public-read test-build-artifacts-x-pack-filebeat-build-tgz gs://beats-ci-temp/Beats/beats/PR-25267-1
[2021-04-23T12:39:54.194Z] + python .ci/scripts/search_system_tests.py
[2021-04-23T12:39:54.222Z] [INFO] system-tests='build/x-pack/filebeat/build/system-tests'. If no empty then let's create a tarball
[2021-04-23T12:39:54.582Z] + tar --version
[2021-04-23T12:39:54.955Z] + tar --exclude=x-pack-filebeat--system-tests-linux-tgz -czf x-pack-filebeat--system-tests-linux-tgz build/x-pack/filebeat/build/system-tests
[2021-04-23T12:40:34.130Z] + gsutil --version
[2021-04-23T12:40:34.130Z] /var/lib/jenkins/workspace/PR-25267-1-cd91ca02-da3f-4498-9797-780d26e35819/src/github.com/elastic/beats@tmp/durable-605760b4/script.sh: 1: /var/lib/jenkins/workspace/PR-25267-1-cd91ca02-da3f-4498-9797-780d26e35819/src/github.com/elastic/beats@tmp/durable-605760b4/script.sh: gsutil: not found
[2021-04-23T12:40:34.192Z] Running in /var/lib/jenkins/workspace/PR-25267-1-cd91ca02-da3f-4498-9797-780d26e35819/src/github.com/elastic/beats@tmp
[2021-04-23T12:40:34.548Z] + wget --version
[2021-04-23T12:40:34.935Z] + wget -q -O gsutil.tar.gz https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-sdk-319.0.0-linux-x86_64.tar.gz
[2021-04-23T12:40:35.578Z] + tar -xpf gsutil.tar.gz --strip-components=1
[2021-04-23T12:40:38.977Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-04-23T12:40:39.348Z] + gcloud auth activate-service-account --key-file ****
[2021-04-23T12:40:40.733Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-04-23T12:40:41.384Z] + gsutil -m -q cp -a public-read x-pack-filebeat--system-tests-linux-tgz gs://beats-ci-temp/Beats/beats/PR-25267-1
[2021-04-23T12:40:46.161Z] + go clean -modcache
[2021-04-23T12:40:49.794Z] Cleaning up /var/lib/jenkins/workspace/PR-25267-1-cd91ca02-da3f-4498-9797-780d26e35819
[2021-04-23T12:40:49.794Z] Client: Docker Engine - Community
[2021-04-23T12:40:49.794Z]  Version:           20.10.3
[2021-04-23T12:40:49.794Z]  API version:       1.41
[2021-04-23T12:40:49.794Z]  Go version:        go1.13.15
[2021-04-23T12:40:49.794Z]  Git commit:        48d30b5
[2021-04-23T12:40:49.794Z]  Built:             Fri Jan 29 14:33:13 2021
[2021-04-23T12:40:49.794Z]  OS/Arch:           linux/amd64
[2021-04-23T12:40:49.794Z]  Context:           default
[2021-04-23T12:40:49.794Z]  Experimental:      true
[2021-04-23T12:40:49.794Z] 
[2021-04-23T12:40:49.794Z] Server: Docker Engine - Community
[2021-04-23T12:40:49.794Z]  Engine:
[2021-04-23T12:40:49.794Z]   Version:          20.10.3
[2021-04-23T12:40:49.794Z]   API version:      1.41 (minimum version 1.12)
[2021-04-23T12:40:49.794Z]   Go version:       go1.13.15
[2021-04-23T12:40:49.794Z]   Git commit:       46229ca
[2021-04-23T12:40:49.794Z]   Built:            Fri Jan 29 14:31:25 2021
[2021-04-23T12:40:49.794Z]   OS/Arch:          linux/amd64
[2021-04-23T12:40:49.794Z]   Experimental:     false
[2021-04-23T12:40:49.794Z]  containerd:
[2021-04-23T12:40:49.794Z]   Version:          1.4.4
[2021-04-23T12:40:49.794Z]   GitCommit:        05f951a3781f4f2c1911b05e61c160e9c30eaa8e
[2021-04-23T12:40:49.794Z]  runc:
[2021-04-23T12:40:49.794Z]   Version:          1.0.0-rc93
[2021-04-23T12:40:49.794Z]   GitCommit:        12644e614e25b05da6fd08a38ffa0cfe1903fdec
[2021-04-23T12:40:49.794Z]  docker-init:
[2021-04-23T12:40:49.794Z]   Version:          0.19.0
[2021-04-23T12:40:49.794Z]   GitCommit:        de40ad0
[2021-04-23T12:40:49.794Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-04-23T12:40:53.994Z] Change permissions with write access of all files inside the specific folder
[2021-04-23T12:40:54.300Z] Running in /var/lib/jenkins/workspace/PR-25267-1-cd91ca02-da3f-4498-9797-780d26e35819
[2021-04-23T12:41:01.212Z] Failed in branch x-pack/filebeat-build
[2021-04-23T12:41:01.891Z] Stage "Packaging" skipped due to earlier failure(s)
[2021-04-23T12:41:02.031Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-25267/src/github.com/elastic/beats
[2021-04-23T12:41:02.374Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-25267
[2021-04-23T12:41:02.499Z] [INFO] getVaultSecret: Getting secrets
[2021-04-23T12:41:02.553Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-04-23T12:41:03.560Z] + chmod 755 generate-build-data.sh
[2021-04-23T12:41:03.560Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-25267/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-25267/runs/1 FAILURE 3500449
[2021-04-23T12:41:03.560Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-25267/runs/1/steps/?limit=10000 -o steps-info.json
[2021-04-23T12:41:05.421Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-25267/runs/1/tests/?status=FAILED -o tests-errors.json

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Test stats 🧪

Test Results
Failed 154
Passed 13119
Skipped 2293
Total 15566

Genuine test errors 100

💔 There are test failures but not known flaky tests, most likely a genuine test failure.

  • Name: Build&Test / filebeat-build / TestDefaultHarvesterGroup/assert_a_harvester_for_same_source_cannot_be_started – github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile
  • Name: Build&Test / filebeat-build / TestDefaultHarvesterGroup – github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile
  • Name: Build&Test / filebeat-build / TestDefaultHarvesterGroup/assert_a_harvester_is_started_in_a_goroutine – github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile
  • Name: Build&Test / filebeat-build / TestDefaultHarvesterGroup/assert_a_harvester_can_be_stopped_and_removed_from_bookkeeper – github.com/elastic/beats/v7/filebeat/input/filestream/internal/input-logfile
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_001_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_002_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_003_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_004_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_005_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_006_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_007_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_008_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_009_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_010_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_011_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_012_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_013_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_014_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_015_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_016_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_017_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_018_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_019_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_020_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_021_gsuite – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_024_azure – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_027_azure – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_032_fortinet – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_036_juniper – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_037_juniper – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_038_juniper – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_039_juniper – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_040_juniper – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_046_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_053_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_059_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_060_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_061_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_064_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_065_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_068_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_069_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_077_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_079_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_082_checkpoint – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_083_sonicwall – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_093_gcp – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_095_gcp – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_113_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_114_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_115_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_116_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_117_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_119_squid – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_123_o365 – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_124_o365 – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_128_o365 – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_131_o365 – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_132_o365 – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_135_o365 – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_136_o365 – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_138_o365 – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_141_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_142_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_143_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_144_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_145_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_146_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_147_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_148_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_149_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_150_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_151_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_152_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_153_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_154_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_155_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_156_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_157_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_158_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_159_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_160_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_161_google_workspace – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_167_iptables – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_169_okta – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_172_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_173_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_176_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_177_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_178_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_180_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_182_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_186_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_190_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_192_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_193_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_195_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_198_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_203_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_205_cyberarkpas – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest

@kvch
Copy link
Copy Markdown
Contributor

kvch commented Apr 29, 2021

I have already backported the stabilizing enhancements.

@kvch kvch closed this Apr 29, 2021
@mergify mergify Bot deleted the mergify/bp/7.13/pr-25218 branch April 29, 2021 10:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@andrewkroh andrewkroh

Labels

backport needs_team Indicates that the issue/PR needs a Team:* label

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@elasticmachine @kvch @andrewkroh