Skip to content

Add general difflib reward function + format extraction task - #363

Closed
kalomaze wants to merge 10 commits into
mainfrom
general-difflib
Closed

Add general difflib reward function + format extraction task#363
kalomaze wants to merge 10 commits into
mainfrom
general-difflib

Conversation

@kalomaze

@kalomaze kalomaze commented Jun 4, 2025

Copy link
Copy Markdown
Contributor

image

Most of the time for this was spent on synthetic data creation + cleaning so far, reward func may need tweaking ideally.

Examples include:

  • extraction w/ precise formatting requirements
  • conditional instructions

Comment thread configs/inference/formatask.toml
Comment thread configs/training/formatask.toml Outdated
@rasdani

rasdani commented Jun 4, 2025

Copy link
Copy Markdown
Contributor

there's cydifflib a drop-in replacement for difflib with multiples of speed up.
in case you want/need to speed up verification.
https://github.com/rapidfuzz/CyDifflib

kalomaze and others added 5 commits June 6, 2025 05:57
Co-authored-by: samsja <55492238+samsja@users.noreply.github.com>
Co-authored-by: samsja <55492238+samsja@users.noreply.github.com>
@samsja

samsja commented Jun 13, 2025

Copy link
Copy Markdown
Member

#396

closing as I merge the pr here

@samsja samsja closed this Jun 13, 2025
@mikasenghaas
mikasenghaas deleted the general-difflib branch August 5, 2026 04:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants