Skip to content

Conversation

@mark-vieira
Copy link
Contributor

#93062 with some additional fixes.

mark-vieira and others added 30 commits January 18, 2023 12:01
# Conflicts:
#	test/test-clusters/src/main/java/org/elasticsearch/test/cluster/local/AbstractLocalSpecBuilder.java
#	test/test-clusters/src/main/java/org/elasticsearch/test/cluster/local/DefaultLocalClusterSpecBuilder.java
#	test/test-clusters/src/main/java/org/elasticsearch/test/cluster/local/LocalClusterFactory.java
#	test/test-clusters/src/main/java/org/elasticsearch/test/cluster/local/LocalClusterSpec.java
#	test/test-clusters/src/main/java/org/elasticsearch/test/cluster/local/LocalSpecBuilder.java
`JvmErgonomics` requires various JVM options to be present, but if they
are omitted then we throw a `NullPointerException` which looks to the
user like an ES bug. They would have to be doing something a little odd
to get into this state, but nonetheless it is possible to hit these
NPEs. We don't need to handle such a config gracefully, but we should
clarify why Elasticsearch won't start to help the user fix their config.
This commit changes the geoip downloader so that we only download the geoip databases if you
have at least one geoip processor in your cluster, or when you add a new geoip processor (or if
`ingest.geoip.downloader.eager.download` is explicitly set to true).
The issue with this test failure is actually that we were silently
failing to install the plugin under test into the cluster. The root
cause here was the FIPS security policy file was not copied into cluster
config directory before we attempting to run the plugin installer. Since
we pass the FIPS JVM arguments to all CLI tools as well this caused
plugin installation to fail. We now ensure that these files are copied
before we attempt to run _any_ ES tools.

Closes elastic#93303
It's pretty common to run a block of code in a `try ... catch` block
that just passes exceptions off to a listener's `onFailure` method. This
commit adds a small utility to encapsulate this, enabling some
one-liners.
@elasticsearchmachine elasticsearchmachine added Team:Delivery Meta label for Delivery team v8.7.0 labels Feb 1, 2023
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-delivery (Team:Delivery)

@mark-vieira mark-vieira added test-windows Trigger CI checks on Windows >test Issues or PRs that are addressing/adding tests and removed >test Issues or PRs that are addressing/adding tests labels Feb 1, 2023
@mark-vieira
Copy link
Contributor Author

@elasticmachine update branch

@mark-vieira
Copy link
Contributor Author

@elasticmachine run elasticsearch-ci/part-1

@mark-vieira mark-vieira merged commit 820ba5a into elastic:main Feb 1, 2023
@elasticsearchmachine
Copy link
Collaborator

💔 Backport failed

Status Branch Result
8.6 Commit could not be cherrypicked due to conflicts
7.17 Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 93422

mark-vieira added a commit to mark-vieira/elasticsearch that referenced this pull request Feb 1, 2023
…stic#93422)

# Conflicts:
#	x-pack/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/MLModelDeploymentFullClusterRestartIT.java
#	x-pack/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/MlConfigIndexMappingsFullClusterRestartIT.java
mark-vieira added a commit to mark-vieira/elasticsearch that referenced this pull request Feb 1, 2023
…stic#93422)

# Conflicts:
#	qa/full-cluster-restart/build.gradle
#	qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/upgrades/FullClusterRestartIT.java
#	qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/upgrades/FullClusterRestartSettingsUpgradeIT.java
#	qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/upgrades/QueryBuilderBWCIT.java
#	x-pack/plugin/shutdown/qa/full-cluster-restart/build.gradle
#	x-pack/plugin/shutdown/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/FullClusterRestartIT.java
#	x-pack/qa/full-cluster-restart/build.gradle
#	x-pack/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/FullClusterRestartIT.java
#	x-pack/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/FullClusterRestartSettingsUpgradeIT.java
#	x-pack/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/MLModelDeploymentFullClusterRestartIT.java
#	x-pack/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/MlConfigIndexMappingsFullClusterRestartIT.java
#	x-pack/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/MlHiddenIndicesFullClusterRestartIT.java
#	x-pack/qa/full-cluster-restart/src/javaRestTest/resources/system_key
elasticsearchmachine pushed a commit that referenced this pull request Feb 2, 2023
#93422) (#93430)

* Convert full cluster restart tests to new rest testing framework (#93422)

# Conflicts:
#	x-pack/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/MLModelDeploymentFullClusterRestartIT.java
#	x-pack/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/MlConfigIndexMappingsFullClusterRestartIT.java

* Fix test artifact

* Fix build script

---------

Co-authored-by: Elastic Machine <[email protected]>
n1v0lg added a commit that referenced this pull request Feb 2, 2023
n1v0lg added a commit that referenced this pull request Feb 2, 2023
mark-vieira pushed a commit to mark-vieira/elasticsearch that referenced this pull request Feb 2, 2023
mark-vieira added a commit to mark-vieira/elasticsearch that referenced this pull request Feb 2, 2023
elasticsearchmachine pushed a commit that referenced this pull request Feb 2, 2023
…rk (#93422) (#93432)

* Convert full cluster restart tests to new rest testing framework (#93422)

# Conflicts:
#	qa/full-cluster-restart/build.gradle
#	qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/upgrades/FullClusterRestartIT.java
#	qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/upgrades/FullClusterRestartSettingsUpgradeIT.java
#	qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/upgrades/QueryBuilderBWCIT.java
#	x-pack/plugin/shutdown/qa/full-cluster-restart/build.gradle
#	x-pack/plugin/shutdown/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/FullClusterRestartIT.java
#	x-pack/qa/full-cluster-restart/build.gradle
#	x-pack/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/FullClusterRestartIT.java
#	x-pack/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/FullClusterRestartSettingsUpgradeIT.java
#	x-pack/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/MLModelDeploymentFullClusterRestartIT.java
#	x-pack/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/MlConfigIndexMappingsFullClusterRestartIT.java
#	x-pack/qa/full-cluster-restart/src/javaRestTest/java/org/elasticsearch/xpack/restart/MlHiddenIndicesFullClusterRestartIT.java
#	x-pack/qa/full-cluster-restart/src/javaRestTest/resources/system_key

* Fixes

* Fix warning failures

* Fix heap dump path

* More fixes

* Fix test cluster security setup on Windows

* Use relative path for script execution

* More, more fixes

* Fix warning error

* More fixes

* Fix security warning
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Delivery/Build Build or test infrastructure Team:Delivery Meta label for Delivery team >test Issues or PRs that are addressing/adding tests test-full-bwc Trigger full BWC version matrix tests test-windows Trigger CI checks on Windows v7.17.10 v8.6.2 v8.7.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.