Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrating Iris GPU benchmarking with meerkat #41

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

Barfy007JB1
Copy link

This PR integrates IRIS GPU benchmarking functionality into Meerkat.

@Barfy007JB1 Barfy007JB1 added the enhancement New feature or request label Nov 19, 2024
@Barfy007JB1 Barfy007JB1 self-assigned this Nov 19, 2024
Copy link
Contributor

@Chris-green-stfc Chris-green-stfc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good overall. The ansible stuff is good, just needs some tidying up of the bash script(s).

@@ -25,6 +25,14 @@
- role: attach_manila
- role: run_manila_storage_benchmark

- hosts: all
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should be - hosts: gpu that way it will only be run when people want to run the GPU benchmarks

- ./vars/gpu.yaml
roles:
- role: setup_iris
- role: update_machine
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you update the machine before running other roles? That way we can make sure we have the latest versions of this installed.

mkdir iris_bench
cd iris_bench

git clone https://github.com/bryceshirley/iris-bench.git
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@@ -0,0 +1,2 @@
- name: Run gpu benchmark
shell: "./gpu_benchmark.sh -p /home/{{ user }} -s local"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the bash script doesn't seem to take in any user inputs, so you don't need -p /home/{{ user }} -s local


# Run Benchmark

iris-gpubench --benchmark_image "synthetic_regression" --export_to_meerkat
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is --export_to_meerkat something you've added to the IRIS benchmarking?

Comment on lines +1 to +7
#! /bin/bash

server_UUID=$(curl http://169.254.169.254/openstack/latest/meta_data.json -s | grep -ioP .{8}-.{4}-.{4}-.{4}-.{12})
vm_info=$(openstack server show $server_UUID)
echo $vm_info | grep -ioP "\w*.nubes.rl.ac.uk" | head -1
echo $vm_info | grep -ioP "flavor\s\|\s\S*" | cut -c 10-
echo $vm_info | grep -ioP "image\s\|\s\S*" | cut -c 9-
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file doesn't seem to be run. So does it need to be here?

Comment on lines +11 to +13
benchmark_and_send_data () {
run_benchmark
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This doesn't send the data to meerkat, unless the --export_to_meerkat does that in the IRIS benchmark itself


DB="https://{{ db_ip }}:{{ db_port }}/write"

cp get-iris.sh $storage_path
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

$storage doesn't seem to be a declared variable.
Does the file need to be copied anywhere? It should have already have been copied to ~/

mode: '0755'
loop:
- get-iris.sh
- get-vm-info.sh
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this file need to be copied? I don't think it is called at all

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants