Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add /v1/{check_email,bulk} endpoints with throttle&concurrency #1536

Closed
wants to merge 63 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
63 commits
Select commit Hold shift + click to select a range
87b97a2
Make it run
amaury1093 Nov 10, 2024
0d54624
It works
amaury1093 Nov 10, 2024
e1dfafa
Add simple queues, no wildcards
amaury1093 Nov 21, 2024
489a403
Fix logging
amaury1093 Nov 21, 2024
7be151f
spawn
amaury1093 Nov 21, 2024
b600b32
works
amaury1093 Nov 21, 2024
4959961
Fix concurrency
amaury1093 Nov 21, 2024
ee3a720
Fix webhook
amaury1093 Nov 21, 2024
4b5f89c
add job_id
amaury1093 Nov 21, 2024
6dc5ea1
Require PgPool
amaury1093 Nov 21, 2024
c91a9df
better error management
amaury1093 Nov 21, 2024
56ae7c9
Error mgmt
amaury1093 Nov 21, 2024
7a3b057
fix errror
amaury1093 Nov 21, 2024
5bb1d02
refactor csv_helper
amaury1093 Nov 21, 2024
af3c9bd
remove error logs
amaury1093 Nov 21, 2024
d8bb3eb
make /v1/check_email work
amaury1093 Nov 21, 2024
28106c2
Better error management
amaury1093 Nov 22, 2024
ac3a6c2
Better logging
amaury1093 Nov 22, 2024
c8bffd2
betterlogs
amaury1093 Nov 22, 2024
2c28d7f
Add comments
amaury1093 Nov 22, 2024
791132e
use throttle mutex
amaury1093 Nov 22, 2024
7bb7c75
Better logs
amaury1093 Nov 22, 2024
a4f683c
make reply work
amaury1093 Nov 22, 2024
8b9a2f0
Make it cleaner
amaury1093 Nov 22, 2024
ea52840
add two channels
amaury1093 Nov 22, 2024
c348b0d
Fix it
amaury1093 Nov 22, 2024
08d7546
simplify
amaury1093 Nov 22, 2024
50d3355
fix some
amaury1093 Nov 22, 2024
2e4bfc6
use anyhow
amaury1093 Nov 22, 2024
2361050
Make docker work
amaury1093 Nov 23, 2024
9c14ac2
Disable if false
amaury1093 Nov 23, 2024
02a64d0
fix
amaury1093 Nov 23, 2024
0b9c39a
Reorg files
amaury1093 Nov 23, 2024
c3be24a
compiles
amaury1093 Nov 23, 2024
ed4476c
indent
amaury1093 Nov 23, 2024
ab49ac2
fix tests
amaury1093 Nov 23, 2024
2acbb2f
Fix some clippy
amaury1093 Nov 23, 2024
986dac7
improvement
amaury1093 Nov 23, 2024
594c885
Better defaults
amaury1093 Nov 23, 2024
95b608d
fix test
amaury1093 Nov 23, 2024
ebd36ad
Make docker-compose work
amaury1093 Nov 23, 2024
cc8c4d7
get results
amaury1093 Nov 23, 2024
f9e268a
Update to 0.10.0
amaury1093 Nov 24, 2024
f109f54
update docker compsoe
amaury1093 Nov 24, 2024
3cc2205
Fix docker deploy
amaury1093 Nov 24, 2024
3ff1df2
rename summary to progress
amaury1093 Nov 24, 2024
d74da37
Update openapi with /v1/
amaury1093 Nov 24, 2024
e678099
add openapi
amaury1093 Nov 24, 2024
4c02a33
separate into two tasks
amaury1093 Nov 24, 2024
ce955bc
Make config better
amaury1093 Nov 24, 2024
5838659
Better verif_methods
amaury1093 Nov 24, 2024
dcf3411
add openapi
amaury1093 Nov 24, 2024
90fbfef
Fix serialization
amaury1093 Nov 24, 2024
33b3d75
better wording
amaury1093 Nov 24, 2024
f0fb5ae
fix tests
amaury1093 Nov 24, 2024
e42f8ad
revert
amaury1093 Nov 24, 2024
9e4f696
Fix println!
amaury1093 Nov 24, 2024
f6f58f1
fix some
amaury1093 Nov 24, 2024
30aaf25
Move pg_pool to config
amaury1093 Nov 24, 2024
7538e5b
more idiomatic
amaury1093 Nov 24, 2024
a674211
clean up
amaury1093 Nov 24, 2024
60d5186
switch to queues
amaury1093 Nov 24, 2024
d6436de
fix tests
amaury1093 Nov 24, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/deploy_backend.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ name: deploy_backend
on:
push:
tags:
- "backend/v*.*.*"
- "v*.*.*"

jobs:
docker-publish:
Expand All @@ -12,7 +12,7 @@ jobs:
- uses: actions/checkout@master
- name: Set GITHUB_TAG arg
id: vars
run: echo ::set-output name=GITHUB_TAG::${GITHUB_REF:18} # Remove /refs/head/backend/
run: echo ::set-output name=GITHUB_TAG::${GITHUB_REF}
- name: Print version
run: echo "Publishing reacherhq/backend:${{ steps.vars.outputs.GITHUB_TAG }}"
- name: Publish to Registry
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/deploy_cli.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ name: deploy_cli
on:
push:
tags:
- "cli/v*"
- "v*.*.*"

env:
# TODO: Rename to your binary
Expand Down
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,9 @@ target
.DS_Store
private

# docker-compose
backend/postgres_data

# Output when debugging Hotmail password recovery using a headless browser.
hotmail.jpeg

Expand Down

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

3 changes: 3 additions & 0 deletions .vscode/settings.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
{
"rust-analyzer.cargo.features": "all"
}
42 changes: 14 additions & 28 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion Cargo.toml
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
[workspace]
members = ["backend", "cli", "core", "worker"]
members = ["backend", "cli", "core"]
Loading
Loading