[Ingest] Add additional attributes to the Datasources Stored Object

[paul-tavares]

In support of Endpoint Security, add the following additional attributes to datasources:

• updated_on : Date (ISO). Should be set every time the SO is updated
• updated_by : User. Should be set every time the SO is updated
• created_on : Date (ISO). Should be set once only during create
• created_by : User. Should be set once only during create

REST Impact

1. New attributes should be returned with every response that includes the Datasource
2. None of these new attributes should be accepted via the REST API (POST, PUT, etc.)
3. ❓ These should NOT be included in the JSON/YAML that is sent to the Agent (cc/ @nchaulet)

UI Impact

4. ❓ Should these be shown in the UI? (either on the Agent Config > Datasources list/table? or the Edit Datasource View?) (/cc @hbharding)

[kevinlog]

Thanks for creating this @paul-tavares , gonna add our team label as well.

[elasticmachine]

Pinging @elastic/endpoint-management (Team:Endpoint Management)

[nchaulet]

❓ These should NOT be included in the JSON/YAML that is sent to the Agent (cc/ @nchaulet)

Yes we should not send this to the agent, the way we build the config allow to add new property to the saved object without impacting the agent final config

[jen-huang]

Just an FYI as these will be changes to saved object mappings, we should check that the changes do not need migrations, or add correct migrations, so that previously saved data sources just work with the new mappings. (As these are completely new properties, I don't think we will need to add migrations 🤞)

[paul-tavares]

Thanks @jen-huang for the heads up and for the link - now I know where to get dev info. about saved object 😄 👍

[hbharding]

Should these be shown in the UI?

Yes! I think this is a good idea. I'll work on some designs and create a UI implementation issue.

[paul-tavares]

So I do think we need migration to ensure these fields are returned for existing data being that I think we would like to define the (TS) types for these are required.

I will look closer into the Migration to figure out how to do it. I'm thinking all fields should be set SO's last update date (updated_at) and set the user to system.