Skip to content

[RollupV2] Move rollup metadata to field mappings #69921

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 14 commits into from
Mar 11, 2021
Merged

[RollupV2] Move rollup metadata to field mappings #69921

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
a7e04ab
Moved field specific metadata to field mappings
csoulios Mar 3, 2021
c0cb760
Added test for rolling up data stream indices
csoulios Mar 3, 2021
2bdb9f9
Addressed reviewer comments
csoulios Mar 4, 2021
2a2cb11
Moved rollup source idx name/uuid to IndexMetadata
csoulios Mar 4, 2021
78b3ade
Merge branch 'master' into rollupv2-meta-refactor
csoulios Mar 5, 2021
66a4ccb
Merge branch 'master' into rollupv2-meta-refactor
csoulios Mar 8, 2021
170c12e
Moved rollup source idx name/uuid to IndexMetadata
csoulios Mar 8, 2021
b265f07
Added detailed tests for metrics
csoulios Mar 9, 2021
ed5fa3c
Merge branch 'master' into rollupv2-meta-refactor
csoulios Mar 9, 2021
541de2b
use private settings
talevy Mar 9, 2021
d92496e
Code cleanup
csoulios Mar 10, 2021
ed1698c
Merge branch 'master' into rollupv2-meta-refactor
csoulios Mar 10, 2021
9191148
Addressed reviewer comments
csoulios Mar 10, 2021
c1a26ce
Merge branch 'master' into rollupv2-meta-refactor
csoulios Mar 10, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 0 additions & 9 deletions server/src/main/java/org/elasticsearch/cluster/ClusterModule.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,6 @@
import org.elasticsearch.cluster.metadata.MetadataMappingService;
import org.elasticsearch.cluster.metadata.MetadataUpdateSettingsService;
import org.elasticsearch.cluster.metadata.RepositoriesMetadata;
import org.elasticsearch.cluster.metadata.RollupMetadata;
import org.elasticsearch.cluster.routing.DelayedAllocationService;
import org.elasticsearch.cluster.routing.allocation.AllocationService;
import org.elasticsearch.cluster.routing.allocation.ExistingShardsAllocator;
Expand Down Expand Up @@ -65,7 +64,6 @@
import org.elasticsearch.persistent.PersistentTasksCustomMetadata;
import org.elasticsearch.persistent.PersistentTasksNodeService;
import org.elasticsearch.plugins.ClusterPlugin;
import org.elasticsearch.rollup.RollupV2;
import org.elasticsearch.script.ScriptMetadata;
import org.elasticsearch.snapshots.SnapshotsInfoService;
import org.elasticsearch.tasks.Task;
Expand Down Expand Up @@ -135,9 +133,6 @@ public static List<Entry> getNamedWriteables() {
ComposableIndexTemplateMetadata::readDiffFrom);
registerMetadataCustom(entries, DataStreamMetadata.TYPE, DataStreamMetadata::new, DataStreamMetadata::readDiffFrom);

if (RollupV2.isEnabled()) {
registerMetadataCustom(entries, RollupMetadata.TYPE, RollupMetadata::new, RollupMetadata::readDiffFrom);
}
// Task Status (not Diffable)
entries.add(new Entry(Task.Status.class, PersistentTasksNodeService.Status.NAME, PersistentTasksNodeService.Status::new));
return entries;
Expand All @@ -162,10 +157,6 @@ public static List<NamedXContentRegistry.Entry> getNamedXWriteables() {
ComposableIndexTemplateMetadata::fromXContent));
entries.add(new NamedXContentRegistry.Entry(Metadata.Custom.class, new ParseField(DataStreamMetadata.TYPE),
DataStreamMetadata::fromXContent));
if (RollupV2.isEnabled()) {
entries.add(new NamedXContentRegistry.Entry(Metadata.Custom.class, new ParseField(RollupMetadata.TYPE),
RollupMetadata::fromXContent));
}
return entries;
}

Expand Down
7 changes: 7 additions & 0 deletions server/src/main/java/org/elasticsearch/cluster/metadata/IndexMetadata.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -570,6 +570,13 @@ public Index getResizeSourceIndex() {
INDEX_RESIZE_SOURCE_UUID.get(settings)) : null;
}

public static final String INDEX_ROLLUP_SOURCE_UUID_KEY = "index.rollup.source.uuid";
public static final String INDEX_ROLLUP_SOURCE_NAME_KEY = "index.rollup.source.name";
public static final Setting<String> INDEX_ROLLUP_SOURCE_UUID = Setting.simpleString(INDEX_ROLLUP_SOURCE_UUID_KEY,
Property.IndexScope, Property.PrivateIndex);
public static final Setting<String> INDEX_ROLLUP_SOURCE_NAME = Setting.simpleString(INDEX_ROLLUP_SOURCE_NAME_KEY,
Property.IndexScope, Property.PrivateIndex);

ImmutableOpenMap<String, DiffableStringMap> getCustomData() {
return this.customData;
}
Expand Down
178 changes: 0 additions & 178 deletions server/src/main/java/org/elasticsearch/cluster/metadata/RollupGroup.java
View file
Open in desktop

This file was deleted.

Loading