Skip to content

Commit

Permalink
feautre: add subtrace to jsonl worker
Browse files Browse the repository at this point in the history
  • Loading branch information
cdxker committed Dec 7, 2024
1 parent cd65155 commit 3b5719a
Show file tree
Hide file tree
Showing 3 changed files with 7 additions and 3 deletions.
2 changes: 1 addition & 1 deletion server/Dockerfile.crawl-worker
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ COPY . .
RUN cargo build --release --features "runtime-env" --bin "crawl-worker"

FROM debian:bookworm-slim as runtime

Check warning on line 20 in server/Dockerfile.crawl-worker

View workflow job for this annotation

GitHub Actions / Push Crawl Worker (blacksmith-8vcpu-ubuntu-2204, linux/amd64)

The 'as' keyword should match the case of the 'from' keyword

FromAsCasing: 'as' and 'FROM' keywords' casing do not match More info: https://docs.docker.com/go/dockerfile/rule/from-as-casing/
RUN apt-get update -y && apt-get -y install pkg-config libssl-dev libpq-dev ca-certificates
RUN apt-get update -y && apt-get -y install pkg-config libssl-dev libpq-dev ca-certificates curl
WORKDIR /app
COPY ./migrations/ /app/migrations
COPY --from=builder /app/target/release/crawl-worker /app/crawl-worker
Expand Down
6 changes: 5 additions & 1 deletion server/Dockerfile.csv-jsonl-worker
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,11 @@ COPY . .
RUN cargo build --release --features "runtime-env" --bin "csv-jsonl-worker"

FROM debian:bookworm-slim as runtime

Check warning on line 20 in server/Dockerfile.csv-jsonl-worker

View workflow job for this annotation

GitHub Actions / Push CSV JSONL worker Image (blacksmith-8vcpu-ubuntu-2204, linux/amd64)

The 'as' keyword should match the case of the 'from' keyword

FromAsCasing: 'as' and 'FROM' keywords' casing do not match More info: https://docs.docker.com/go/dockerfile/rule/from-as-casing/
RUN apt-get update -y && apt-get -y install pkg-config libssl-dev libpq-dev ca-certificates
RUN apt-get update -y && apt-get -y install pkg-config libssl-dev libpq-dev ca-certificates curl

RUN curl -fsSLO https://github.com/subtrace/subtrace/releases/download/b143/subtrace-linux-amd64 \
&& chmod +x ./subtrace-linux-amd64

WORKDIR /app
COPY ./migrations/ /app/migrations
COPY --from=builder /app/target/release/csv-jsonl-worker /app/csv-jsonl-worker
Expand Down
2 changes: 1 addition & 1 deletion server/src/bin/csv-jsonl-worker.rs
Original file line number Diff line number Diff line change
Expand Up @@ -196,7 +196,7 @@ async fn file_worker(
log::error!(
"File {} has not yet been uploaded to the signed put url: {:?}",
csv_jsonl_worker_message.file_id.to_string(),
err
err.to_string(),
);

let _ = redis::cmd("LREM")
Expand Down

0 comments on commit 3b5719a

Please sign in to comment.