Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make firecracker CoW tests run on CI #7429

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Make firecracker CoW tests run on CI #7429

wants to merge 1 commit into from

Conversation

bduffany
Copy link
Member

Related issues: N/A

@bduffany bduffany changed the title Make CoW tests run on CI Make firecracker CoW tests run on CI Sep 11, 2024
@bduffany bduffany force-pushed the cow-test-ci branch 4 times, most recently from dcd4377 to 33ad403 Compare September 11, 2024 21:36
@bduffany bduffany marked this pull request as ready for review September 11, 2024 21:36
workDirForkOriginalSnapshot := testfs.MakeDirAll(t, rootDir, "work-fork-og-snapshot")
originalSnapshotKey := baseVM.SnapshotKeySet().GetBranchKey()
originalSnapshotKey.SnapshotId = baseSnapshotId
originalSnapshotKey := &fcpb.SnapshotKey{
Copy link
Member Author

@bduffany bduffany Sep 11, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There were 2 issues here:

  • We weren't doing anything with originalSnapshotKey - from the comment I think the intent was to set it on ContainerOpts so that we resume from this specific snapshot
  • I forgot to update this logic here when we simplified snapshot-specific keys so that they only include the instance_name + snapshot_id.

@bduffany
Copy link
Member Author

yikes, the tests are running extremely slowly. going to start on a separate PR to do the file-locking thing with the IP addresses, so that we can shard this test.

bduffany added a commit that referenced this pull request Sep 23, 2024
…e machine (#7439)

Follow-up from #7429

* Add optional `flock`-based IP range locking to prevent concurrent test
shards from trying to use the same IP range concurrently.
* This is useful for firecracker tests, as well as running multiple
firecracker executors locally.
* Don't try to clean up network namespaces in tests, because they might
be in use.
* I don't expect that too many of these will accumulate, but if it does
happen, we can find a way to clean up "orphaned" namespaces, maybe by
associating them with lockfiles.
* Don't try to clean up the shared executor root directory in tests
either, to prevent converted ext4 image files from disappearing
mid-test.
* Added a TODO to provision these images as data deps of the test
instead of converting during the test.
* Set `shard_count` on `firecracker_test`. (This won't actually buy us a
ton of concurrency until we disable exclusive task scheduling on the
bare pool.)

**Related issues**:
buildbuddy-io/buildbuddy-internal#3758
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants