Add test to check if Prospector sets metadata of files on updates in filestream#24868

Merged

kvch merged 3 commits intoelastic:masterfrom

kvch:test-filebeat-filestream-metadata-update

Apr 1, 2021

Contributor

kvch commented Mar 31, 2021

What does this PR do?

This PR adds a test to see if the Prospector is able to update file metadata in the registry.

Requires #24864

Why is it important?

It has not been tested automatically before.

Checklist

My code follows the style guidelines of this project
~~- [ ] I have commented my code, particularly in hard-to-understand areas~~
~~- [ ] I have made corresponding changes to the documentation~~
~~- [ ] I have made corresponding change to the default configuration files~~
~~- [ ] I have added tests that prove my fix is effective or that my feature works~~
~~- [ ] I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.~~

botelastic Bot added the needs_team label

kvch added the Team:Elastic-Agent label

Contributor

elasticmachine commented Mar 31, 2021

Pinging @elastic/agent (Team:Agent)

botelastic Bot removed the needs_team label

Contributor

elasticmachine commented Mar 31, 2021 •

edited by jenkins-beats-ci Bot

Loading

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Build Cause: Pull request #24868 updated
Start Time: 2021-03-31T13:44:39.915+0000
Duration: 53 min 45 sec
Commit: 7c2c795

Test stats 🧪

Test	Results
Failed	66
Passed	13128
Skipped	2271
Total	15465

Trends 🧪

Test errors

Expand to view the tests failures

> Show only the first 10 test failures

`Build&Test / filebeat-build / test_fileset_file_060_traefik – filebeat.tests.system.test_modules.Test`

Expand to view the error details

 Exception: Key 'user_agent.device.type' found in event is not documented!

Expand to view the stacktrace

 a = (<test_modules.Test testMethod=test_fileset_file_060_traefik>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/system/test_modules.py:99: in test_fileset_file
    cfgfile=cfgfile)
tests/system/test_modules.py:183: in run_on_file
    self.assert_fields_are_documented(obj)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_modules.Test testMethod=test_fileset_file_060_traefik>
evt = {'@timestamp': '2017-10-02T20:22:07.000Z', 'agent': {'ephemeral_id': 'fcd076f1-046f-421f-8d26-584f59d50a71', 'id': 'ae...category': ['web'], 'created': '2021-03-31T14:15:59.813Z', 'dataset': 'traefik.access', 'duration': 2000000, ...}, ...}

    def assert_fields_are_documented(self, evt):
        """
        Assert that all keys present in evt are documented in fields.yml.
        This reads from the global fields.yml, means `make collect` has to be run before the check.
        """
        expected_fields, dict_fields, aliases = self.load_fields()
        flat = self.flatten_object(evt, dict_fields)
    
        def field_pattern_match(pattern, key):
            pattern_fields = pattern.split(".")
            key_fields = key.split(".")
            if len(pattern_fields) != len(key_fields):
                return False
            for i in range(len(pattern_fields)):
                if pattern_fields[i] == "*":
                    continue
                if pattern_fields[i] != key_fields[i]:
                    return False
            return True
    
        def is_documented(key, docs):
            if key in docs:
                return True
            for pattern in (f for f in docs if "*" in f):
                if field_pattern_match(pattern, key):
                    return True
            return False
    
        for key in flat.keys():
            metaKey = key.startswith('@metadata.')
            # Range keys as used in 'date_range' etc will not have docs of course
            isRangeKey = key.split('.')[-1] in ['gte', 'gt', 'lte', 'lt']
            if not(is_documented(key, expected_fields) or metaKey or isRangeKey):
>               raise Exception("Key '{}' found in event is not documented!".format(key))
E               Exception: Key 'user_agent.device.type' found in event is not documented!

../libbeat/tests/system/beat/beat.py:729: Exception

`Build&Test / filebeat-build / test_fileset_file_061_nginx – filebeat.tests.system.test_modules.Test`

Expand to view the error details

 Exception: Key 'user_agent.device.type' found in event is not documented!

Expand to view the stacktrace

 a = (<test_modules.Test testMethod=test_fileset_file_061_nginx>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/system/test_modules.py:99: in test_fileset_file
    cfgfile=cfgfile)
tests/system/test_modules.py:183: in run_on_file
    self.assert_fields_are_documented(obj)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_modules.Test testMethod=test_fileset_file_061_nginx>
evt = {'@timestamp': '2020-02-07T11:48:51.000Z', 'agent': {'ephemeral_id': 'f5665c0c-ef65-42bd-abae-c86015b02fac', 'id': 'ae...1-03-31T14:16:01.780Z', 'dataset': 'nginx.ingress_controller', 'ingested': '2021-03-31T14:16:03.001523441Z', ...}, ...}

    def assert_fields_are_documented(self, evt):
        """
        Assert that all keys present in evt are documented in fields.yml.
        This reads from the global fields.yml, means `make collect` has to be run before the check.
        """
        expected_fields, dict_fields, aliases = self.load_fields()
        flat = self.flatten_object(evt, dict_fields)
    
        def field_pattern_match(pattern, key):
            pattern_fields = pattern.split(".")
            key_fields = key.split(".")
            if len(pattern_fields) != len(key_fields):
                return False
            for i in range(len(pattern_fields)):
                if pattern_fields[i] == "*":
                    continue
                if pattern_fields[i] != key_fields[i]:
                    return False
            return True
    
        def is_documented(key, docs):
            if key in docs:
                return True
            for pattern in (f for f in docs if "*" in f):
                if field_pattern_match(pattern, key):
                    return True
            return False
    
        for key in flat.keys():
            metaKey = key.startswith('@metadata.')
            # Range keys as used in 'date_range' etc will not have docs of course
            isRangeKey = key.split('.')[-1] in ['gte', 'gt', 'lte', 'lt']
            if not(is_documented(key, expected_fields) or metaKey or isRangeKey):
>               raise Exception("Key '{}' found in event is not documented!".format(key))
E               Exception: Key 'user_agent.device.type' found in event is not documented!

../libbeat/tests/system/beat/beat.py:729: Exception

`Build&Test / filebeat-build / test_fileset_file_062_nginx – filebeat.tests.system.test_modules.Test`

Expand to view the error details

 Exception: Key 'user_agent.device.type' found in event is not documented!

Expand to view the stacktrace

 a = (<test_modules.Test testMethod=test_fileset_file_062_nginx>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/system/test_modules.py:99: in test_fileset_file
    cfgfile=cfgfile)
tests/system/test_modules.py:183: in run_on_file
    self.assert_fields_are_documented(obj)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_modules.Test testMethod=test_fileset_file_062_nginx>
evt = {'@timestamp': '2016-12-07T10:05:07.000Z', 'agent': {'ephemeral_id': '5d6f3938-ca46-4ba4-8b3c-23dac92b2323', 'id': 'ae...eated': '2021-03-31T14:16:03.940Z', 'dataset': 'nginx.access', 'ingested': '2021-03-31T14:16:05.088785771Z', ...}, ...}

    def assert_fields_are_documented(self, evt):
        """
        Assert that all keys present in evt are documented in fields.yml.
        This reads from the global fields.yml, means `make collect` has to be run before the check.
        """
        expected_fields, dict_fields, aliases = self.load_fields()
        flat = self.flatten_object(evt, dict_fields)
    
        def field_pattern_match(pattern, key):
            pattern_fields = pattern.split(".")
            key_fields = key.split(".")
            if len(pattern_fields) != len(key_fields):
                return False
            for i in range(len(pattern_fields)):
                if pattern_fields[i] == "*":
                    continue
                if pattern_fields[i] != key_fields[i]:
                    return False
            return True
    
        def is_documented(key, docs):
            if key in docs:
                return True
            for pattern in (f for f in docs if "*" in f):
                if field_pattern_match(pattern, key):
                    return True
            return False
    
        for key in flat.keys():
            metaKey = key.startswith('@metadata.')
            # Range keys as used in 'date_range' etc will not have docs of course
            isRangeKey = key.split('.')[-1] in ['gte', 'gt', 'lte', 'lt']
            if not(is_documented(key, expected_fields) or metaKey or isRangeKey):
>               raise Exception("Key '{}' found in event is not documented!".format(key))
E               Exception: Key 'user_agent.device.type' found in event is not documented!

../libbeat/tests/system/beat/beat.py:729: Exception

`Build&Test / filebeat-build / test_fileset_file_063_nginx – filebeat.tests.system.test_modules.Test`

Expand to view the error details

 Exception: Key 'user_agent.device.type' found in event is not documented!

Expand to view the stacktrace

 a = (<test_modules.Test testMethod=test_fileset_file_063_nginx>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/system/test_modules.py:99: in test_fileset_file
    cfgfile=cfgfile)
tests/system/test_modules.py:183: in run_on_file
    self.assert_fields_are_documented(obj)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_modules.Test testMethod=test_fileset_file_063_nginx>
evt = {'@timestamp': '2016-10-25T12:49:33.000Z', 'agent': {'ephemeral_id': 'c9689b72-dffd-496b-9395-c03a9476b06e', 'id': 'ae...eated': '2021-03-31T14:16:05.821Z', 'dataset': 'nginx.access', 'ingested': '2021-03-31T14:16:06.894577219Z', ...}, ...}

    def assert_fields_are_documented(self, evt):
        """
        Assert that all keys present in evt are documented in fields.yml.
        This reads from the global fields.yml, means `make collect` has to be run before the check.
        """
        expected_fields, dict_fields, aliases = self.load_fields()
        flat = self.flatten_object(evt, dict_fields)
    
        def field_pattern_match(pattern, key):
            pattern_fields = pattern.split(".")
            key_fields = key.split(".")
            if len(pattern_fields) != len(key_fields):
                return False
            for i in range(len(pattern_fields)):
                if pattern_fields[i] == "*":
                    continue
                if pattern_fields[i] != key_fields[i]:
                    return False
            return True
    
        def is_documented(key, docs):
            if key in docs:
                return True
            for pattern in (f for f in docs if "*" in f):
                if field_pattern_match(pattern, key):
                    return True
            return False
    
        for key in flat.keys():
            metaKey = key.startswith('@metadata.')
            # Range keys as used in 'date_range' etc will not have docs of course
            isRangeKey = key.split('.')[-1] in ['gte', 'gt', 'lte', 'lt']
            if not(is_documented(key, expected_fields) or metaKey or isRangeKey):
>               raise Exception("Key '{}' found in event is not documented!".format(key))
E               Exception: Key 'user_agent.device.type' found in event is not documented!

../libbeat/tests/system/beat/beat.py:729: Exception

`Build&Test / filebeat-build / test_fileset_file_064_nginx – filebeat.tests.system.test_modules.Test`

Expand to view the error details

 Exception: Key 'user_agent.device.type' found in event is not documented!

Expand to view the stacktrace

 a = (<test_modules.Test testMethod=test_fileset_file_064_nginx>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/system/test_modules.py:99: in test_fileset_file
    cfgfile=cfgfile)
tests/system/test_modules.py:183: in run_on_file
    self.assert_fields_are_documented(obj)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_modules.Test testMethod=test_fileset_file_064_nginx>
evt = {'@timestamp': '2016-12-07T10:05:07.000Z', 'agent': {'ephemeral_id': 'c6a449de-73f3-41e7-a165-1d2f60756d48', 'id': 'ae...: '6fb7aada414b', 'type': 'filebeat', ...}, 'destination': {'domain': 'example.com'}, 'ecs': {'version': '1.8.0'}, ...}

    def assert_fields_are_documented(self, evt):
        """
        Assert that all keys present in evt are documented in fields.yml.
        This reads from the global fields.yml, means `make collect` has to be run before the check.
        """
        expected_fields, dict_fields, aliases = self.load_fields()
        flat = self.flatten_object(evt, dict_fields)
    
        def field_pattern_match(pattern, key):
            pattern_fields = pattern.split(".")
            key_fields = key.split(".")
            if len(pattern_fields) != len(key_fields):
                return False
            for i in range(len(pattern_fields)):
                if pattern_fields[i] == "*":
                    continue
                if pattern_fields[i] != key_fields[i]:
                    return False
            return True
    
        def is_documented(key, docs):
            if key in docs:
                return True
            for pattern in (f for f in docs if "*" in f):
                if field_pattern_match(pattern, key):
                    return True
            return False
    
        for key in flat.keys():
            metaKey = key.startswith('@metadata.')
            # Range keys as used in 'date_range' etc will not have docs of course
            isRangeKey = key.split('.')[-1] in ['gte', 'gt', 'lte', 'lt']
            if not(is_documented(key, expected_fields) or metaKey or isRangeKey):
>               raise Exception("Key '{}' found in event is not documented!".format(key))
E               Exception: Key 'user_agent.device.type' found in event is not documented!

../libbeat/tests/system/beat/beat.py:729: Exception

`Build&Test / filebeat-build / test_fileset_file_067_iis – filebeat.tests.system.test_modules.Test`

Expand to view the error details

 Exception: Key 'user_agent.device.type' found in event is not documented!

Expand to view the stacktrace

 a = (<test_modules.Test testMethod=test_fileset_file_067_iis>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/system/test_modules.py:99: in test_fileset_file
    cfgfile=cfgfile)
tests/system/test_modules.py:183: in run_on_file
    self.assert_fields_are_documented(obj)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_modules.Test testMethod=test_fileset_file_067_iis>
evt = {'@timestamp': '2018-01-01T08:09:10.000Z', 'agent': {'ephemeral_id': '8e68ca4d-2f47-4500-a673-4e33e9f59957', 'id': 'ae...ebeat', ...}, 'destination': {'address': '127.0.0.1', 'ip': '127.0.0.1', 'port': 80}, 'ecs': {'version': '1.8.0'}, ...}

    def assert_fields_are_documented(self, evt):
        """
        Assert that all keys present in evt are documented in fields.yml.
        This reads from the global fields.yml, means `make collect` has to be run before the check.
        """
        expected_fields, dict_fields, aliases = self.load_fields()
        flat = self.flatten_object(evt, dict_fields)
    
        def field_pattern_match(pattern, key):
            pattern_fields = pattern.split(".")
            key_fields = key.split(".")
            if len(pattern_fields) != len(key_fields):
                return False
            for i in range(len(pattern_fields)):
                if pattern_fields[i] == "*":
                    continue
                if pattern_fields[i] != key_fields[i]:
                    return False
            return True
    
        def is_documented(key, docs):
            if key in docs:
                return True
            for pattern in (f for f in docs if "*" in f):
                if field_pattern_match(pattern, key):
                    return True
            return False
    
        for key in flat.keys():
            metaKey = key.startswith('@metadata.')
            # Range keys as used in 'date_range' etc will not have docs of course
            isRangeKey = key.split('.')[-1] in ['gte', 'gt', 'lte', 'lt']
            if not(is_documented(key, expected_fields) or metaKey or isRangeKey):
>               raise Exception("Key '{}' found in event is not documented!".format(key))
E               Exception: Key 'user_agent.device.type' found in event is not documented!

../libbeat/tests/system/beat/beat.py:729: Exception

`Build&Test / filebeat-build / test_fileset_file_068_iis – filebeat.tests.system.test_modules.Test`

Expand to view the error details

 Exception: Key 'user_agent.device.type' found in event is not documented!

Expand to view the stacktrace

 a = (<test_modules.Test testMethod=test_fileset_file_068_iis>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/system/test_modules.py:99: in test_fileset_file
    cfgfile=cfgfile)
tests/system/test_modules.py:183: in run_on_file
    self.assert_fields_are_documented(obj)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_modules.Test testMethod=test_fileset_file_068_iis>
evt = {'@timestamp': '2018-08-28T18:24:25.000Z', 'agent': {'ephemeral_id': '3195eddb-a4c9-4a40-99ec-8edafa02ade1', 'id': 'ae......}, 'destination': {'address': '10.100.220.70', 'ip': '10.100.220.70', 'port': 80}, 'ecs': {'version': '1.8.0'}, ...}

    def assert_fields_are_documented(self, evt):
        """
        Assert that all keys present in evt are documented in fields.yml.
        This reads from the global fields.yml, means `make collect` has to be run before the check.
        """
        expected_fields, dict_fields, aliases = self.load_fields()
        flat = self.flatten_object(evt, dict_fields)
    
        def field_pattern_match(pattern, key):
            pattern_fields = pattern.split(".")
            key_fields = key.split(".")
            if len(pattern_fields) != len(key_fields):
                return False
            for i in range(len(pattern_fields)):
                if pattern_fields[i] == "*":
                    continue
                if pattern_fields[i] != key_fields[i]:
                    return False
            return True
    
        def is_documented(key, docs):
            if key in docs:
                return True
            for pattern in (f for f in docs if "*" in f):
                if field_pattern_match(pattern, key):
                    return True
            return False
    
        for key in flat.keys():
            metaKey = key.startswith('@metadata.')
            # Range keys as used in 'date_range' etc will not have docs of course
            isRangeKey = key.split('.')[-1] in ['gte', 'gt', 'lte', 'lt']
            if not(is_documented(key, expected_fields) or metaKey or isRangeKey):
>               raise Exception("Key '{}' found in event is not documented!".format(key))
E               Exception: Key 'user_agent.device.type' found in event is not documented!

../libbeat/tests/system/beat/beat.py:729: Exception

`Build&Test / filebeat-build / test_fileset_file_069_iis – filebeat.tests.system.test_modules.Test`

Expand to view the error details

 Exception: Key 'user_agent.device.type' found in event is not documented!

Expand to view the stacktrace

 a = (<test_modules.Test testMethod=test_fileset_file_069_iis>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/system/test_modules.py:99: in test_fileset_file
    cfgfile=cfgfile)
tests/system/test_modules.py:183: in run_on_file
    self.assert_fields_are_documented(obj)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_modules.Test testMethod=test_fileset_file_069_iis>
evt = {'@timestamp': '2020-10-04T22:00:34.000Z', 'agent': {'ephemeral_id': '89d2b246-e5b2-42fb-b900-f2d85902491c', 'id': 'ae....162', 'domain': 'images.hogeschoolrotterdam.nl', 'ip': '10.24.129.162', 'port': 80}, 'ecs': {'version': '1.8.0'}, ...}

    def assert_fields_are_documented(self, evt):
        """
        Assert that all keys present in evt are documented in fields.yml.
        This reads from the global fields.yml, means `make collect` has to be run before the check.
        """
        expected_fields, dict_fields, aliases = self.load_fields()
        flat = self.flatten_object(evt, dict_fields)
    
        def field_pattern_match(pattern, key):
            pattern_fields = pattern.split(".")
            key_fields = key.split(".")
            if len(pattern_fields) != len(key_fields):
                return False
            for i in range(len(pattern_fields)):
                if pattern_fields[i] == "*":
                    continue
                if pattern_fields[i] != key_fields[i]:
                    return False
            return True
    
        def is_documented(key, docs):
            if key in docs:
                return True
            for pattern in (f for f in docs if "*" in f):
                if field_pattern_match(pattern, key):
                    return True
            return False
    
        for key in flat.keys():
            metaKey = key.startswith('@metadata.')
            # Range keys as used in 'date_range' etc will not have docs of course
            isRangeKey = key.split('.')[-1] in ['gte', 'gt', 'lte', 'lt']
            if not(is_documented(key, expected_fields) or metaKey or isRangeKey):
>               raise Exception("Key '{}' found in event is not documented!".format(key))
E               Exception: Key 'user_agent.device.type' found in event is not documented!

../libbeat/tests/system/beat/beat.py:729: Exception

`Build&Test / filebeat-build / test_fileset_file_070_iis – filebeat.tests.system.test_modules.Test`

Expand to view the error details

 Exception: Key 'user_agent.device.type' found in event is not documented!

Expand to view the stacktrace

 a = (<test_modules.Test testMethod=test_fileset_file_070_iis>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/system/test_modules.py:99: in test_fileset_file
    cfgfile=cfgfile)
tests/system/test_modules.py:183: in run_on_file
    self.assert_fields_are_documented(obj)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_modules.Test testMethod=test_fileset_file_070_iis>
evt = {'@timestamp': '2018-12-31T12:02:53.000Z', 'agent': {'ephemeral_id': '535a4836-710b-4bc2-b098-54709418e493', 'id': 'ae..., ...}, 'destination': {'address': '10.44.0.136', 'ip': '10.44.0.136', 'port': 8080}, 'ecs': {'version': '1.8.0'}, ...}

    def assert_fields_are_documented(self, evt):
        """
        Assert that all keys present in evt are documented in fields.yml.
        This reads from the global fields.yml, means `make collect` has to be run before the check.
        """
        expected_fields, dict_fields, aliases = self.load_fields()
        flat = self.flatten_object(evt, dict_fields)
    
        def field_pattern_match(pattern, key):
            pattern_fields = pattern.split(".")
            key_fields = key.split(".")
            if len(pattern_fields) != len(key_fields):
                return False
            for i in range(len(pattern_fields)):
                if pattern_fields[i] == "*":
                    continue
                if pattern_fields[i] != key_fields[i]:
                    return False
            return True
    
        def is_documented(key, docs):
            if key in docs:
                return True
            for pattern in (f for f in docs if "*" in f):
                if field_pattern_match(pattern, key):
                    return True
            return False
    
        for key in flat.keys():
            metaKey = key.startswith('@metadata.')
            # Range keys as used in 'date_range' etc will not have docs of course
            isRangeKey = key.split('.')[-1] in ['gte', 'gt', 'lte', 'lt']
            if not(is_documented(key, expected_fields) or metaKey or isRangeKey):
>               raise Exception("Key '{}' found in event is not documented!".format(key))
E               Exception: Key 'user_agent.device.type' found in event is not documented!

../libbeat/tests/system/beat/beat.py:729: Exception

`Build&Test / filebeat-build / test_fileset_file_071_iis – filebeat.tests.system.test_modules.Test`

Expand to view the error details

 Exception: Key 'user_agent.device.type' found in event is not documented!

Expand to view the stacktrace

 a = (<test_modules.Test testMethod=test_fileset_file_071_iis>,)

    @wraps(func)
    def standalone_func(*a):
>       return func(*(a + p.args), **p.kwargs)

../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
tests/system/test_modules.py:99: in test_fileset_file
    cfgfile=cfgfile)
tests/system/test_modules.py:183: in run_on_file
    self.assert_fields_are_documented(obj)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <test_modules.Test testMethod=test_fileset_file_071_iis>
evt = {'@timestamp': '2020-10-07T23:00:17.000Z', 'agent': {'ephemeral_id': 'ecde799a-0357-47c3-b847-7e58a0f501f5', 'id': 'ae.....}, 'destination': {'address': '192.168.16.11', 'ip': '192.168.16.11', 'port': 443}, 'ecs': {'version': '1.8.0'}, ...}

    def assert_fields_are_documented(self, evt):
        """
        Assert that all keys present in evt are documented in fields.yml.
        This reads from the global fields.yml, means `make collect` has to be run before the check.
        """
        expected_fields, dict_fields, aliases = self.load_fields()
        flat = self.flatten_object(evt, dict_fields)
    
        def field_pattern_match(pattern, key):
            pattern_fields = pattern.split(".")
            key_fields = key.split(".")
            if len(pattern_fields) != len(key_fields):
                return False
            for i in range(len(pattern_fields)):
                if pattern_fields[i] == "*":
                    continue
                if pattern_fields[i] != key_fields[i]:
                    return False
            return True
    
        def is_documented(key, docs):
            if key in docs:
                return True
            for pattern in (f for f in docs if "*" in f):
                if field_pattern_match(pattern, key):
                    return True
            return False
    
        for key in flat.keys():
            metaKey = key.startswith('@metadata.')
            # Range keys as used in 'date_range' etc will not have docs of course
            isRangeKey = key.split('.')[-1] in ['gte', 'gt', 'lte', 'lt']
            if not(is_documented(key, expected_fields) or metaKey or isRangeKey):
>               raise Exception("Key '{}' found in event is not documented!".format(key))
E               Exception: Key 'user_agent.device.type' found in event is not documented!

../libbeat/tests/system/beat/beat.py:729: Exception

Steps errors

Expand to view the steps failures

`filebeat-build - mage build test`

Took 20 min 20 sec . View more details on here
Description: mage build test

`x-pack/filebeat-build - mage build test`

Took 36 min 41 sec . View more details on here
Description: mage build test

`Error signal`

Took 0 min 0 sec . View more details on here
Description: Error 'hudson.AbortException: script returned exit code 1'

Log output

Expand to view the last 100 lines of log output

[2021-03-31T14:35:01.273Z]   Git commit:       46229ca
[2021-03-31T14:35:01.273Z]   Built:            Fri Jan 29 14:31:25 2021
[2021-03-31T14:35:01.273Z]   OS/Arch:          linux/amd64
[2021-03-31T14:35:01.273Z]   Experimental:     false
[2021-03-31T14:35:01.273Z]  containerd:
[2021-03-31T14:35:01.273Z]   Version:          1.4.4
[2021-03-31T14:35:01.273Z]   GitCommit:        05f951a3781f4f2c1911b05e61c160e9c30eaa8e
[2021-03-31T14:35:01.273Z]  runc:
[2021-03-31T14:35:01.273Z]   Version:          1.0.0-rc93
[2021-03-31T14:35:01.273Z]   GitCommit:        12644e614e25b05da6fd08a38ffa0cfe1903fdec
[2021-03-31T14:35:01.273Z]  docker-init:
[2021-03-31T14:35:01.273Z]   Version:          0.19.0
[2021-03-31T14:35:01.273Z]   GitCommit:        de40ad0
[2021-03-31T14:35:01.273Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-03-31T14:35:01.273Z] Unable to find image 'alpine:3.4' locally
[2021-03-31T14:35:02.213Z] 3.4: Pulling from library/alpine
[2021-03-31T14:35:02.213Z] c1e54eec4b57: Pulling fs layer
[2021-03-31T14:35:02.782Z] c1e54eec4b57: Verifying Checksum
[2021-03-31T14:35:02.782Z] c1e54eec4b57: Download complete
[2021-03-31T14:35:03.043Z] c1e54eec4b57: Pull complete
[2021-03-31T14:35:03.043Z] Digest: sha256:b733d4a32c4da6a00a84df2ca32791bb03df95400243648d8c539e7b4cce329c
[2021-03-31T14:35:03.043Z] Status: Downloaded newer image for alpine:3.4
[2021-03-31T14:35:04.954Z] Change permissions with write access of all files inside the specific folder
[2021-03-31T14:35:06.353Z] Running in /var/lib/jenkins/workspace/PR-24868-5-96444f0a-7d0d-4fab-b6ae-d680d359667d/src/github.com/elastic/beats/build
[2021-03-31T14:35:06.647Z] + rm -rf ve
[2021-03-31T14:35:06.647Z] + find . -type d -name vendor -exec rm -r {} ;
[2021-03-31T14:35:06.962Z] + python .ci/scripts/pre_archive_test.py
[2021-03-31T14:35:09.502Z] Copy ./x-pack/filebeat/build into build/x-pack/filebeat/build
[2021-03-31T14:35:09.515Z] Running in /var/lib/jenkins/workspace/PR-24868-5-96444f0a-7d0d-4fab-b6ae-d680d359667d/src/github.com/elastic/beats/build
[2021-03-31T14:35:09.530Z] Recording test results
[2021-03-31T14:35:11.300Z] [Checks API] No suitable checks publisher found.
[2021-03-31T14:35:11.609Z] + tar --version
[2021-03-31T14:35:11.921Z] + tar --exclude=test-build-artifacts-x-pack-filebeat-build-tgz -czf test-build-artifacts-x-pack-filebeat-build-tgz .
[2021-03-31T14:36:08.546Z] + gsutil --version
[2021-03-31T14:36:08.547Z] /var/lib/jenkins/workspace/PR-24868-5-96444f0a-7d0d-4fab-b6ae-d680d359667d/src/github.com/elastic/beats/build@tmp/durable-71337585/script.sh: 1: /var/lib/jenkins/workspace/PR-24868-5-96444f0a-7d0d-4fab-b6ae-d680d359667d/src/github.com/elastic/beats/build@tmp/durable-71337585/script.sh: gsutil: not found
[2021-03-31T14:36:08.589Z] Running in /var/lib/jenkins/workspace/PR-24868-5-96444f0a-7d0d-4fab-b6ae-d680d359667d/src/github.com/elastic/beats/build@tmp
[2021-03-31T14:36:08.941Z] + wget --version
[2021-03-31T14:36:09.257Z] + wget -q -O gsutil.tar.gz https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-sdk-319.0.0-linux-x86_64.tar.gz
[2021-03-31T14:36:09.831Z] + tar -xpf gsutil.tar.gz --strip-components=1
[2021-03-31T14:36:13.219Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-03-31T14:36:13.584Z] + gcloud auth activate-service-account --key-file ****
[2021-03-31T14:36:15.520Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-03-31T14:36:15.836Z] + gsutil -m -q cp -a public-read test-build-artifacts-x-pack-filebeat-build-tgz gs://beats-ci-temp/Beats/beats/PR-24868-5
[2021-03-31T14:36:21.551Z] + python .ci/scripts/search_system_tests.py
[2021-03-31T14:36:21.576Z] [INFO] system-tests='build/x-pack/filebeat/build/system-tests'. If no empty then let's create a tarball
[2021-03-31T14:36:21.965Z] + tar --version
[2021-03-31T14:36:22.307Z] + tar --exclude=x-pack-filebeat--system-tests-linux-tgz -czf x-pack-filebeat--system-tests-linux-tgz build/x-pack/filebeat/build/system-tests
[2021-03-31T14:36:54.780Z] + gsutil --version
[2021-03-31T14:36:54.780Z] /var/lib/jenkins/workspace/PR-24868-5-96444f0a-7d0d-4fab-b6ae-d680d359667d/src/github.com/elastic/beats@tmp/durable-e3652e80/script.sh: 1: /var/lib/jenkins/workspace/PR-24868-5-96444f0a-7d0d-4fab-b6ae-d680d359667d/src/github.com/elastic/beats@tmp/durable-e3652e80/script.sh: gsutil: not found
[2021-03-31T14:36:54.825Z] Running in /var/lib/jenkins/workspace/PR-24868-5-96444f0a-7d0d-4fab-b6ae-d680d359667d/src/github.com/elastic/beats@tmp
[2021-03-31T14:36:55.174Z] + wget --version
[2021-03-31T14:36:55.532Z] + wget -q -O gsutil.tar.gz https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-sdk-319.0.0-linux-x86_64.tar.gz
[2021-03-31T14:36:56.418Z] + tar -xpf gsutil.tar.gz --strip-components=1
[2021-03-31T14:36:59.778Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-03-31T14:37:00.089Z] + gcloud auth activate-service-account --key-file ****
[2021-03-31T14:37:01.495Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-03-31T14:37:02.072Z] + gsutil -m -q cp -a public-read x-pack-filebeat--system-tests-linux-tgz gs://beats-ci-temp/Beats/beats/PR-24868-5
[2021-03-31T14:37:06.645Z] + go clean -modcache
[2021-03-31T14:37:10.258Z] Cleaning up /var/lib/jenkins/workspace/PR-24868-5-96444f0a-7d0d-4fab-b6ae-d680d359667d
[2021-03-31T14:37:10.258Z] Client: Docker Engine - Community
[2021-03-31T14:37:10.258Z]  Version:           20.10.3
[2021-03-31T14:37:10.258Z]  API version:       1.41
[2021-03-31T14:37:10.258Z]  Go version:        go1.13.15
[2021-03-31T14:37:10.258Z]  Git commit:        48d30b5
[2021-03-31T14:37:10.258Z]  Built:             Fri Jan 29 14:33:13 2021
[2021-03-31T14:37:10.258Z]  OS/Arch:           linux/amd64
[2021-03-31T14:37:10.258Z]  Context:           default
[2021-03-31T14:37:10.258Z]  Experimental:      true
[2021-03-31T14:37:10.258Z] 
[2021-03-31T14:37:10.258Z] Server: Docker Engine - Community
[2021-03-31T14:37:10.258Z]  Engine:
[2021-03-31T14:37:10.258Z]   Version:          20.10.3
[2021-03-31T14:37:10.258Z]   API version:      1.41 (minimum version 1.12)
[2021-03-31T14:37:10.258Z]   Go version:       go1.13.15
[2021-03-31T14:37:10.258Z]   Git commit:       46229ca
[2021-03-31T14:37:10.258Z]   Built:            Fri Jan 29 14:31:25 2021
[2021-03-31T14:37:10.258Z]   OS/Arch:          linux/amd64
[2021-03-31T14:37:10.258Z]   Experimental:     false
[2021-03-31T14:37:10.258Z]  containerd:
[2021-03-31T14:37:10.258Z]   Version:          1.4.4
[2021-03-31T14:37:10.258Z]   GitCommit:        05f951a3781f4f2c1911b05e61c160e9c30eaa8e
[2021-03-31T14:37:10.258Z]  runc:
[2021-03-31T14:37:10.258Z]   Version:          1.0.0-rc93
[2021-03-31T14:37:10.258Z]   GitCommit:        12644e614e25b05da6fd08a38ffa0cfe1903fdec
[2021-03-31T14:37:10.258Z]  docker-init:
[2021-03-31T14:37:10.258Z]   Version:          0.19.0
[2021-03-31T14:37:10.258Z]   GitCommit:        de40ad0
[2021-03-31T14:37:10.258Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-03-31T14:37:14.490Z] Change permissions with write access of all files inside the specific folder
[2021-03-31T14:37:14.778Z] Running in /var/lib/jenkins/workspace/PR-24868-5-96444f0a-7d0d-4fab-b6ae-d680d359667d
[2021-03-31T14:37:23.525Z] Failed in branch x-pack/filebeat-build
[2021-03-31T14:37:23.611Z] Stage "Packaging" skipped due to earlier failure(s)
[2021-03-31T14:37:23.665Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-24868@2/src/github.com/elastic/beats
[2021-03-31T14:37:24.137Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-24868
[2021-03-31T14:37:24.182Z] [INFO] getVaultSecret: Getting secrets
[2021-03-31T14:37:24.269Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-03-31T14:37:24.970Z] + chmod 755 generate-build-data.sh
[2021-03-31T14:37:24.970Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24868/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24868/runs/5 FAILURE 3164794
[2021-03-31T14:37:25.531Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24868/runs/5/steps/?limit=10000 -o steps-info.json
[2021-03-31T14:37:26.442Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24868/runs/5/tests/?status=FAILED -o tests-errors.json

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Test stats 🧪

Test	Results
Failed	66
Passed	13128
Skipped	2271
Total	15465

Genuine test errors

💔 There are test failures but not known flaky tests, most likely a genuine test failure.

Name: Build&Test / filebeat-build / test_fileset_file_060_traefik – filebeat.tests.system.test_modules.Test
Name: Build&Test / filebeat-build / test_fileset_file_061_nginx – filebeat.tests.system.test_modules.Test
Name: Build&Test / filebeat-build / test_fileset_file_062_nginx – filebeat.tests.system.test_modules.Test
Name: Build&Test / filebeat-build / test_fileset_file_063_nginx – filebeat.tests.system.test_modules.Test
Name: Build&Test / filebeat-build / test_fileset_file_064_nginx – filebeat.tests.system.test_modules.Test
Name: Build&Test / filebeat-build / test_fileset_file_067_iis – filebeat.tests.system.test_modules.Test
Name: Build&Test / filebeat-build / test_fileset_file_068_iis – filebeat.tests.system.test_modules.Test
Name: Build&Test / filebeat-build / test_fileset_file_069_iis – filebeat.tests.system.test_modules.Test
Name: Build&Test / filebeat-build / test_fileset_file_070_iis – filebeat.tests.system.test_modules.Test
Name: Build&Test / filebeat-build / test_fileset_file_071_iis – filebeat.tests.system.test_modules.Test
Name: Build&Test / filebeat-build / test_fileset_file_072_iis – filebeat.tests.system.test_modules.Test
Name: Build&Test / filebeat-build / test_fileset_file_106_apache – filebeat.tests.system.test_modules.Test
Name: Build&Test / filebeat-build / test_fileset_file_107_apache – filebeat.tests.system.test_modules.Test
Name: Build&Test / filebeat-build / test_fileset_file_108_apache – filebeat.tests.system.test_modules.Test
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_048_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_049_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_051_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_052_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_053_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_054_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_055_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_056_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_057_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_058_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_059_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_060_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_061_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_062_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_063_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_064_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_065_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_066_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_067_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_068_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_069_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_070_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_071_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_072_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_073_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_074_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_075_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_076_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_077_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_078_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_079_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_081_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_082_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_131_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_139_f5 – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_141_zscaler – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_142_zscaler – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_145_tomcat – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_173_o365 – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_178_o365 – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_179_o365 – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_180_o365 – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_181_o365 – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_221_gcp – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_252_envoyproxy – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_253_envoyproxy – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_255_suricata – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_256_suricata – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_257_suricata – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_264_squid – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_271_okta – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_301_azure – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest

kvch force-pushed the test-filebeat-filestream-metadata-update branch from 8d67308 to a4e89cd Compare

March 31, 2021 12:48


          Add check to see if metadata changes are detected and saved by the pr…

526f618

…ospector in filestream

kvch force-pushed the test-filebeat-filestream-metadata-update branch from a4e89cd to 526f618 Compare

March 31, 2021 12:58

urso reviewed

View reviewed changes

filebeat/input/filestream/input_integration_test.go

kvch added 2 commits

March 31, 2021 15:27


          check immediately after rename if source is modified and cursor stays…

514c37a

… the same


          add metadata to registry when first encountered

7c2c795

kvch requested a review from urso

March 31, 2021 15:50

urso approved these changes

View reviewed changes

kvch merged commit 51a3317 into elastic:master

kvch mentioned this pull request

Cherry-pick #24868 to 7.x: Add test to check if Prospector sets metadata of files on updates in filestream #24881

Closed

1 task

kvch added the v7.13.0 label

kvch added a commit to kvch/beats that referenced this pull request


          Add test to check if Prospector sets metadata of files on updates in …

8d8d97b

…filestream (elastic#24868)

This PR adds a test to see if the Prospector is able to update file metadata in the registry.

(cherry picked from commit 51a3317)

kvch added a commit to kvch/beats that referenced this pull request


          Add test to check if Prospector sets metadata of files on updates in …

61cbb33

…filestream (elastic#24868)

This PR adds a test to see if the Prospector is able to update file metadata in the registry.

(cherry picked from commit 51a3317)

kvch mentioned this pull request

Cherry-pick #24868 to 7.x: Add test to check if Prospector sets metadata of files on updates in filestream #24883

Merged

1 task

kvch added a commit that referenced this pull request


          Add test to check if Prospector sets metadata of files on updates in …

bed2ad7

…filestream (#24868) (#24883)

This PR adds a test to see if the Prospector is able to update file metadata in the registry.

(cherry picked from commit 51a3317)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Team:Elastic-Agent v7.13.0