Skip to content

Correct spelling of cananry and update aws release jar and wheel s3 paths #502

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Mar 13, 2025
Merged

Correct spelling of cananry and update aws release jar and wheel s3 paths #502

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
7b70114
Correct spelling of cananry and update aws release jar and wheel s3 p…
david-zlai Mar 13, 2025
4908688
fix
david-zlai Mar 13, 2025
3087951
Merge branch 'main' into davidhan/not_cananry
david-zlai Mar 13, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions scripts/distribution/build_and_upload_artifacts.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -211,11 +211,11 @@ function upload_to_aws() {
set -euxo pipefail
for element in "${customer_ids_to_upload[@]}"
do
ELEMENT_JAR_PATH=s3://zipline-artifacts-$element/jars/
ELEMENT_JAR_PATH=s3://zipline-artifacts-$element/release/latest/jars/
ELEMENT_WHEEL_PATH=s3://zipline-artifacts-$element/release/latest/wheels/
aws s3 cp "$CLOUD_AWS_JAR" "$ELEMENT_JAR_PATH" --metadata="zipline_user=$USER,updated_date=$(date),commit=$(git rev-parse HEAD),branch=$(git rev-parse --abbrev-ref HEAD)"
aws s3 cp "$SERVICE_JAR" "$ELEMENT_JAR_PATH" --metadata="zipline_user=$USER,updated_date=$(date),commit=$(git rev-parse HEAD),branch=$(git rev-parse --abbrev-ref HEAD)"
aws s3 cp "$EXPECTED_ZIPLINE_WHEEL" "$ELEMENT_JAR_PATH" --metadata="zipline_user=$USER,updated_date=$(date),commit=$(git rev-parse HEAD),branch=$(git rev-parse --abbrev-ref HEAD)"
aws s3 cp "$OLD_ZIPLINE_WHEEL_NAME" "$ELEMENT_JAR_PATH" --metadata="zipline_user=$USER,updated_date=$(date),commit=$(git rev-parse HEAD),branch=$(git rev-parse --abbrev-ref HEAD)"
aws s3 cp "$EXPECTED_ZIPLINE_WHEEL" "$ELEMENT_WHEEL_PATH" --metadata="zipline_user=$USER,updated_date=$(date),commit=$(git rev-parse HEAD),branch=$(git rev-parse --abbrev-ref HEAD)"
aws s3 cp "$FLINK_JAR" "$ELEMENT_JAR_PATH" --metadata="zipline_user=$USER,updated_date=$(date),commit=$(git rev-parse HEAD),branch=$(git rev-parse --abbrev-ref HEAD)"
done
echo "Succeeded"
Expand Down
10 changes: 5 additions & 5 deletions scripts/distribution/run_aws_quickstart.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ done

mkdir -p /tmp/zipline_test/aws
cd /tmp/zipline_test/aws
rm -rf cananry-confs
rm -rf canary-confs

# Delete glue tables
# hardcoding the s3 path here because that's where the underlying location of the data is for this glue database `data`
Expand All @@ -33,9 +33,9 @@ RED='\033[0;31m'

WHEEL_FILE="zipline_ai-0.1.0-py3-none-any.whl "

# Clone the cananry configs
git clone [email protected]:zipline-ai/cananry-confs.git
cd cananry-confs
# Clone the canary configs
git clone [email protected]:zipline-ai/canary-confs.git
cd canary-confs

# Use the branch with Zipline specific team.json
git fetch origin davidhan/run_aws
Expand All @@ -46,7 +46,7 @@ python3 -m venv tmp_chronon
source tmp_chronon/bin/activate

# Download the wheel
aws s3 cp s3://zipline-artifacts-canary/jars/$WHEEL_FILE .
aws s3 cp s3://zipline-artifacts-canary/release/latest/wheels/$WHEEL_FILE .

# Install the wheel (force)
pip uninstall zipline-ai
Expand Down
8 changes: 4 additions & 4 deletions scripts/distribution/run_gcp_quickstart.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ mkdir -p /tmp/zipline_test/gcp

cd /tmp/zipline_test/gcp

rm -rf cananry-confs
rm -rf canary-confs


GREEN='\033[0;32m'
Expand All @@ -18,9 +18,9 @@ bq rm -f -t canary-443022:data.quickstart_purchases_v1_dev
bq rm -f -t canary-443022:data.quickstart_purchases_v1_dev_upload
#TODO: delete bigtable rows

# Clone the cananry configs
git clone [email protected]-zipline:zipline-ai/cananry-confs.git
cd cananry-confs
# Clone the canary configs
git clone [email protected]:zipline-ai/canary-confs.git
cd canary-confs

# Use the branch with Zipline specific team.json
git fetch origin davidhan/dev
Expand Down