Skip to content

Conversation

@mark-vieira
Copy link
Contributor

Several of the :plugins:repository-hdfs integration test tasks are not being pulled from the cache due to changes in test fixture data directories. These directories really shouldn't be on the classpath as the only thing we need is the ports file. Due to some particularities in classpath input filtering, we can't just add the ports file itself and subsequently ignore it for the purposes if input snapshotting. So instead we copy the file to its own directory, and add the directory to the classpath. This allows us to ignore the ports file so changes won't affect the cache key.

@mark-vieira mark-vieira added the :Delivery/Build Build or test infrastructure label Feb 27, 2020
@mark-vieira mark-vieira requested a review from rjernst February 27, 2020 00:32
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-infra (:Core/Infra/Build)

Copy link
Member

@rjernst rjernst left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. One optional suggestion

nonInputProperties.systemProperty "test.hdfs-fixture.ports", path
}
classpath += files("$buildDir/fixtures")
nonInputProperties.systemProperty "test.hdfs-fixture.ports", file("$portsFileDir/ports")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not hugely important, but the path here will be "${workingDir}/ports/ports" right? Maybe name the file "hdfsPorts" or something like that

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've renamed this directory hdfsFixture to be most accurate.

@mark-vieira mark-vieira merged commit 8bb5a11 into elastic:master Feb 27, 2020
@mark-vieira mark-vieira deleted the hdfs-integtest-cache-fix branch February 28, 2020 21:57
@ywelsch ywelsch added v7.6.1 and removed v7.6.2 labels Mar 2, 2020
@mark-vieira mark-vieira added the Team:Delivery Meta label for Delivery team label Nov 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Delivery/Build Build or test infrastructure Team:Delivery Meta label for Delivery team v7.6.1 v7.7.0 v8.0.0-alpha1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants