Add Indic PNC prompt-tuning review toolkit - #3
Closed
mohammadaaftabv wants to merge 1 commit into
Closed
mohammadaaftabv wants to merge 1 commit into
mohammadaaftabv wants to merge 1 commit into
Conversation
|
This PR is stale because it has been open for 14 days with no activity. Remove stale label or comment or update or this will be closed in 7 days. |
|
This PR was closed because it has been inactive for 7 days since being marked as stale. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changed
Adds a self-contained review toolkit under
examples/audio/pnc_prompt_tuning/for optimizing and judging punctuation-and-capitalization prompts across the 12 spreadsheet-ground-truth Indic languages.tutorials/audio/granary_v2_postprocessing/common.yamlas the sole authoritative downstream PNC normalization contract.. , ? !and permitted capitalization; raw Unicode preservation is validated before normalization.common.yamlrules exactly and retains both raw and common-normalized candidates for audit./lustre/fsw/portfolios/edgeai/users/aaftabv/pnc_prompt_finetuning, including Draco's symlinked path alias without permitting physical symlink escapes.Why
The experiment needs one reproducible target matching the existing Granary v2 postprocessing pipeline. This avoids evaluating a second native-punctuation profile or allowing generator cleanup that the authoritative normalizer already defines.
Known blocker
The pinned
common.yamlcurrently omits the Odia Unicode block (U+0B00–U+0B7F). The contract preflight therefore deliberately reportsoras incompatible and exits before any model call. This PR does not add a local workaround or a second normalization policy;common.yamlitself must be updated and repinned before a 12-language run can proceed.Validation
45 passedin the offline pytest suite.bash -npassed forscripts/run_draco_review.sh.c7c7a0b0033831551e986b2135324af409516a792c52d251d0d486d364201f81, incompatible languageor, intentional exit code 2.Review scope
All changes are new files under
examples/audio/pnc_prompt_tuning/. Existing Curator source files,common.yaml, and the productionpnc_prompt.mdare unchanged.