Repository navigation

feat(e2e): Add BFCL v3 function calling test infrastructure - #523

Closed

vschandramourya wants to merge 24 commits into

mainfrom

feat/bfcl-test-infrastructure

Commits on Mar 23, 2026
- feat(bfcl): add BFCL v3 test infrastructure
  vschandramourya
  committed
  51f559d
- feat(bfcl): add BFCL pytest test classes
  vschandramourya
  committed
  0900457
- refactor(bfcl): address review feedback
  vschandramourya
  committed
  6c5bc3a
- remove bfcl logs from being tracked
  vschandramourya
  committed
  c091618
- Remove the baseline comparision code
  vschandramourya
  committed
  6adf41f
- add pytest marker for GPU-dependent workers
  vschandramourya
  committed
  5d9d32d
- Replace module-level _all_cases with pytest_generate_tests for lazy loading; added lazy loading with caching
  vschandramourya
  committed
  de0bfdc
- fix(bfcl): thread-safe result collection and proper session lifecycle, recorded errors.
  vschandramourya
  committed
  7c52ebd
- fix(bfcl): replace set_run_dir with get_or_create_run_dir avoiding empty dir creations
  vschandramourya
  committed
  4cb86fc
- lint fix
  vschandramourya
  committed
  4561812
- test(bfcl): improve data downloading and loader fail-fast behavior
  vschandramourya
  committed
  764fd7e
- test(bfcl): tighten evaluator validation
  vschandramourya
  committed
  ea384a9
- fix(bfcl): fix session teardown issue
  vschandramourya
  committed
  88b1a98
- fix(bfcl): resolve mypy issues in evaluator
  vschandramourya
  committed
  b1a4318
- test(e2e)mark standalone BFCL suite as e2e
  vschandramourya
  committed
  44f12b5
Commits on Mar 24, 2026
- fix(e2e) keep all ignored files at one place
  vschandramourya
  committed
  056ad64
- fix(e2e) correct the file imports and fail gracefully
  vschandramourya
  committed
  e52b7ab
Commits on Mar 27, 2026
Commits on Mar 30, 2026
- refactor(bfcl): convert case dict to BFCLCase dataclass
  vschandramourya
  committed
  29bc201
Commits on Apr 1, 2026
- Merge branch 'main' into feat/bfcl-test-infrastructure
  vschandramourya
  authored
  f4a1df0
Commits on Apr 7, 2026
- Update e2e_test/bfcl/converter.py
  
  vschandramourya
  and
  claude[bot]
  authored
  5981cf3
- Merge branch 'main' into feat/bfcl-test-infrastructure
  vschandramourya
  authored
  ecb0361

Navigation Menu

Repository navigation

feat(e2e): Add BFCL v3 function calling test infrastructure - #523

feat(e2e): Add BFCL v3 function calling test infrastructure#523
vschandramourya wants to merge 24 commits into
mainfrom
feat/bfcl-test-infrastructure

Commits on Mar 23, 2026

feat(bfcl): add BFCL v3 test infrastructure

feat(bfcl): add BFCL pytest test classes

refactor(bfcl): address review feedback

remove bfcl logs from being tracked

Remove the baseline comparision code

add pytest marker for GPU-dependent workers

Replace module-level _all_cases with pytest_generate_tests for lazy loading; added lazy loading with caching

fix(bfcl): thread-safe result collection and proper session lifecycle, recorded errors.

fix(bfcl): replace set_run_dir with get_or_create_run_dir avoiding empty dir creations

lint fix

test(bfcl): improve data downloading and loader fail-fast behavior

test(bfcl): tighten evaluator validation

fix(bfcl): fix session teardown issue

fix(bfcl): resolve mypy issues in evaluator

test(e2e)mark standalone BFCL suite as e2e

Commits on Mar 24, 2026

fix(e2e) keep all ignored files at one place

fix(e2e) correct the file imports and fail gracefully

Commits on Mar 27, 2026

refactor(bfcl): move response helpers from test file into bfcl package

Merge branch 'main' into feat/bfcl-test-infrastructure

Merge branch 'main' into feat/bfcl-test-infrastructure

Commits on Mar 30, 2026

refactor(bfcl): convert case dict to BFCLCase dataclass

Commits on Apr 1, 2026

Merge branch 'main' into feat/bfcl-test-infrastructure

Commits on Apr 7, 2026

Update e2e_test/bfcl/converter.py

Merge branch 'main' into feat/bfcl-test-infrastructure