Skip to content

feat: add iii-experiment worker - #15

Merged
rohitg00 merged 6 commits into
mainfrom
feat/experiment
Apr 22, 2026
Merged

feat: add iii-experiment worker#15
rohitg00 merged 6 commits into
mainfrom
feat/experiment

Conversation

@rohitg00

@rohitg00 rohitg00 commented Apr 7, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Generic optimization loop with 7 functions
  • Any target_function + any metric_function, minimize or maximize
  • Not ML-specific: works on latency, code quality, prompts, configs, costs
  • All through iii primitives: State, Streams, HTTP triggers
  • 18 tests, 0 warnings

Functions

Function Description
experiment::create Define experiment with target, metric, direction, budget
experiment::propose Generate parameter variations
experiment::run Single iteration: propose, trigger, measure
experiment::decide Compare score against best
experiment::loop Run full budget of iterations
experiment::status Current experiment state and history
experiment::stop Halt running experiment

Test plan

  • cargo test — 18 tests passing
  • cargo check — 0 warnings

@coderabbitai

coderabbitai Bot commented Apr 7, 2026

Copy link
Copy Markdown

Warning

Rate limit exceeded

@rohitg00 has exceeded the limit for the number of commits that can be reviewed per hour. Please wait 31 minutes and 49 seconds before requesting another review.

Your organization is not enrolled in usage-based pricing. Contact your admin to enable usage-based pricing to continue reviews beyond the rate limit, or try again in 31 minutes and 49 seconds.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 035432a5-7163-4b98-9c69-15b33dc20579

📥 Commits

Reviewing files that changed from the base of the PR and between e664259 and 28c5103.

📒 Files selected for processing (16)
  • experiment/Cargo.toml
  • experiment/README.md
  • experiment/build.rs
  • experiment/config.yaml
  • experiment/src/config.rs
  • experiment/src/functions/create.rs
  • experiment/src/functions/decide.rs
  • experiment/src/functions/loop_run.rs
  • experiment/src/functions/mod.rs
  • experiment/src/functions/propose.rs
  • experiment/src/functions/run.rs
  • experiment/src/functions/status.rs
  • experiment/src/functions/stop.rs
  • experiment/src/main.rs
  • experiment/src/manifest.rs
  • experiment/src/state.rs
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch feat/experiment

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Generic optimization loop — any target function + any metric function. 7 functions:
- experiment::create — define experiment with target, metric, direction, budget
- experiment::propose — generate parameter variations
- experiment::run — single iteration: propose, trigger target, measure metric
- experiment::decide — compare score against best (minimize/maximize)
- experiment::loop — run full budget of iterations
- experiment::status/stop — monitor and control

Not ML-specific. Works on latency, code quality, prompts, configs, costs.
Uses iii primitives: State (definitions, results, runs, best), Streams (progress), HTTP triggers.
18 tests, 0 warnings.
@rohitg00

Copy link
Copy Markdown
Contributor Author

Heads up — main is being bumped to iii-sdk =0.11.3 in #33. When that lands, please rebase and bump this worker's pin (currently 0.11.0) to =0.11.3. Two 0.11.x deltas that may bite:

  • iii-sdk no longer exposes an otel cargo feature — OTel is always-on. Drop features = ["otel"] if you use it.
  • WorkerMetadata gained an isolation field. If you construct it as a struct literal, add ..Default::default() (or fill the field). iii-lsp hit this; see the fix in chore: bump iii-sdk to 0.11.3 across all workers #33.
  • register_function(msg, handler) (two-arg) is now register_function_with(msg, handler); register_function is single-arg via IntoFunctionRegistration. image-resize hit this; see chore: bump iii-sdk to 0.11.3 across all workers #33.

Release notes: https://github.com/iii-hq/iii/releases/tag/iii/v0.11.3

@rohitg00
rohitg00 merged commit f87a176 into main Apr 22, 2026
5 checks passed
@rohitg00
rohitg00 deleted the feat/experiment branch April 22, 2026 23:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant