Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add local_search_enabled flag to classifier #291

Merged
merged 3 commits into from
Jul 4, 2024

Conversation

mgdigital
Copy link
Collaborator

@mgdigital mgdigital commented Jul 4, 2024

  • Add a local_search_enabled flag to the classifier, that can disable the local search query on the content table for matching torrents to known content. This search should be tried before any external API call is attempted, but it's an expensive query and so it's useful to be able to disable it using this flag.
  • Retroactively set the local_search_enabled flag to false for the 0.9.0 upgrade job, which should improve the queue throughput and reduce the load put on the database by the queue jobs.

@mgdigital mgdigital merged commit abdb714 into main Jul 4, 2024
6 checks passed
@mgdigital mgdigital deleted the classifier-local-search-flag branch July 4, 2024 11:33
truecharts-admin referenced this pull request in truecharts/public Jul 24, 2024
… v0.9.5@7bf4688 by renovate (#24084)

This PR contains the following updates:

| Package | Update | Change |
|---|---|---|
|
[ghcr.io/bitmagnet-io/bitmagnet](https://github.com/bitmagnet-io/bitmagnet)
| patch | `v0.9.3` -> `v0.9.5` |

---

> [!WARNING]
> Some dependencies could not be looked up. Check the Dependency
Dashboard for more information.

---

### Release Notes

<details>
<summary>bitmagnet-io/bitmagnet
(ghcr.io/bitmagnet-io/bitmagnet)</summary>

###
[`v0.9.5`](https://github.com/bitmagnet-io/bitmagnet/releases/tag/v0.9.5)

[Compare
Source](https://github.com/bitmagnet-io/bitmagnet/compare/v0.9.4...v0.9.5)

Allow rate limit "burst" for TMDB API when using the default API key,
allowing the limit to average to 1 second with a lot less blocking,
which became more important as the default queue concurrency was reduced
to 1.

#### What's Changed

- Increase rate limit burst when using default TMDB API key by
[@&#8203;mgdigital](https://github.com/mgdigital) in
[https://github.com/bitmagnet-io/bitmagnet/pull/296](https://github.com/bitmagnet-io/bitmagnet/pull/296)

**Full Changelog**:
bitmagnet-io/bitmagnet@v0.9.4...v0.9.5

###
[`v0.9.4`](https://github.com/bitmagnet-io/bitmagnet/releases/tag/v0.9.4)

[Compare
Source](https://github.com/bitmagnet-io/bitmagnet/compare/v0.9.3...v0.9.4)

This release includes 2 optimizations that should reduce the load that
queue jobs place on the database, including for the 0.9.0 upgrade job.

It should also reduce instances of `ERROR: canceling statement due to
user request` in the Postgres logs, but note that Bitmagnet does cancel
some database queries because it sometimes tries 2 query strategies in a
race and cancels the slowest one, so this message doesn't indicate a
problem.

#### What's Changed

- Add local_search_enabled flag to classifier by
[@&#8203;mgdigital](https://github.com/mgdigital) in
[https://github.com/bitmagnet-io/bitmagnet/pull/291](https://github.com/bitmagnet-io/bitmagnet/pull/291)
- Reduce CTE strategy usage when not needed by
[@&#8203;mgdigital](https://github.com/mgdigital) in
[https://github.com/bitmagnet-io/bitmagnet/pull/292](https://github.com/bitmagnet-io/bitmagnet/pull/292)

**Full Changelog**:
bitmagnet-io/bitmagnet@v0.9.3...v0.9.4

</details>

---

### Configuration

📅 **Schedule**: Branch creation - At any time (no schedule defined),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Enabled.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.

---

- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box

---

This PR has been generated by [Renovate
Bot](https://github.com/renovatebot/renovate).

<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy40NDAuNiIsInVwZGF0ZWRJblZlciI6IjM3LjQ0MC42IiwidGFyZ2V0QnJhbmNoIjoibWFzdGVyIiwibGFiZWxzIjpbImF1dG9tZXJnZSIsInVwZGF0ZS9kb2NrZXIvZ2VuZXJhbC9ub24tbWFqb3IiXX0=-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant