docs(tutorials): add Inspect AI evaluation tutorial and notebook - #628

Merged

burtenshaw merged 16 commits into

huggingface:mainfrom

sergiopaniego:feature/eval-inspect-tutorial

May 5, 2026

Commits on Apr 30, 2026

docs(tutorials): add Inspect AI evaluation tutorial and notebook

sergiopaniego
and
claude
committed
c3331ae
docs(tutorials): remove HF Inference Providers option from eval notebook

sergiopaniego
and
claude
committed
587e1fd
fix(eval): add max_connections support to serialize samples against capacity-limited envs

sergiopaniego
and
claude
committed
34c191f
fix(eval): use asyncio.Semaphore to serialize env connections in solver

sergiopaniego
and
claude
committed
5753ec4
fix(eval): handle non-serializable Task object in result.model_dump()

sergiopaniego
and
claude
committed
5431cb7
docs(tutorials): add Option C for local transformers model (Qwen2.5-0.5B)

sergiopaniego
and
claude
committed
8642e8b
docs(tutorials): use Qwen/Qwen3.5-0.8B as the local model example

sergiopaniego
and
claude
committed
ba2b11f
docs(tutorials): note temperature incompatibility and transformers upgrade for hf/ backend

sergiopaniego
and
claude
committed
b327ca9
docs(tutorials): simplify Option C with direct pip install -U transformers line

sergiopaniego
and
claude
committed
9cf5aec
docs(tutorials): fix misleading semaphore comment — limit matches MAX_CONCURRENT_ENVS

sergiopaniego
and
claude
committed
3abb1da
docs(tutorials): sync notebook with .md and fix Next Steps links to website

sergiopaniego
and
claude
committed
20a6187
docs(tutorials): use getpass for API key input instead of hardcoded placeholder

sergiopaniego
and
claude
committed
f165c8c

Commits on May 4, 2026

chore: ruff format inspect_harness.py

sergiopaniego
and
claude
committed
e297715

Commits on May 5, 2026