Skip to content

Conversation

@mark-vieira
Copy link
Contributor

Another try at #93062

mark-vieira and others added 30 commits January 18, 2023 12:01
# Conflicts:
#	test/test-clusters/src/main/java/org/elasticsearch/test/cluster/local/AbstractLocalSpecBuilder.java
#	test/test-clusters/src/main/java/org/elasticsearch/test/cluster/local/DefaultLocalClusterSpecBuilder.java
#	test/test-clusters/src/main/java/org/elasticsearch/test/cluster/local/LocalClusterFactory.java
#	test/test-clusters/src/main/java/org/elasticsearch/test/cluster/local/LocalClusterSpec.java
#	test/test-clusters/src/main/java/org/elasticsearch/test/cluster/local/LocalSpecBuilder.java
`JvmErgonomics` requires various JVM options to be present, but if they
are omitted then we throw a `NullPointerException` which looks to the
user like an ES bug. They would have to be doing something a little odd
to get into this state, but nonetheless it is possible to hit these
NPEs. We don't need to handle such a config gracefully, but we should
clarify why Elasticsearch won't start to help the user fix their config.
This commit changes the geoip downloader so that we only download the geoip databases if you
have at least one geoip processor in your cluster, or when you add a new geoip processor (or if
`ingest.geoip.downloader.eager.download` is explicitly set to true).
The issue with this test failure is actually that we were silently
failing to install the plugin under test into the cluster. The root
cause here was the FIPS security policy file was not copied into cluster
config directory before we attempting to run the plugin installer. Since
we pass the FIPS JVM arguments to all CLI tools as well this caused
plugin installation to fail. We now ensure that these files are copied
before we attempt to run _any_ ES tools.

Closes elastic#93303
It's pretty common to run a block of code in a `try ... catch` block
that just passes exceptions off to a listener's `onFailure` method. This
commit adds a small utility to encapsulate this, enabling some
one-liners.
original-brownbear and others added 10 commits February 2, 2023 09:07
Some random finds while working with this code. We shouldn't use a Consumer<Long> instead of a LongConsumer
as we never pass `null` to the consumer.
Also, way simplified the locking around the Lucene `Bytebuffer b` to simplify the code and technically make it
a little faster/less-contenting as well.
Plus, made use of modern Java's buffer slicing to simplify the slicing of the Lucene buffer.
In FIPS mode, passwords require a minimal length. This PR adjusts a
test to adhere to this.

Fixes: elastic#93449
Delete-snapshot tasks can sometimes be very long-running, but they're
hard to monitor because the tasks API does not include a description of
the snapshot(s) which are being deleted. This commit adds such a
description.
We sometimes see a `ShardLockObtainFailedException` when a shard failed
to shut down as fast as we expected, often because a node left and
rejoined the cluster. Sometimes this is because it was held open by
ongoing scrolls or PITs, but other times it may be because the shutdown
process itself is too slow. With this commit we add the ability to
capture and log a thread dump at the time of the failure to give us more
information about where the shutdown process might be running slowly.

Relates elastic#93226
@mark-vieira mark-vieira added >test Issues or PRs that are addressing/adding tests :Delivery/Build Build or test infrastructure test-windows Trigger CI checks on Windows test-full-bwc Trigger full BWC version matrix tests labels Feb 2, 2023
@github-actions
Copy link
Contributor

github-actions bot commented Feb 2, 2023

Documentation preview:

@elasticsearchmachine elasticsearchmachine added v8.7.0 Team:Delivery Meta label for Delivery team labels Feb 2, 2023
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-delivery (Team:Delivery)

# Conflicts:
#	server/src/main/java/org/elasticsearch/Version.java
@mark-vieira
Copy link
Contributor Author

@elasticmachine update branch

@mark-vieira
Copy link
Contributor Author

@elasticmachine update branch

@mark-vieira
Copy link
Contributor Author

@elasticmachine run elasticsearch-ci/part-2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Delivery/Build Build or test infrastructure Team:Delivery Meta label for Delivery team >test Issues or PRs that are addressing/adding tests test-full-bwc Trigger full BWC version matrix tests test-windows Trigger CI checks on Windows v8.7.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.