Skip to content

Prompting fix to improve LCB score for GPTOSS #1169

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Kipok merged 8 commits into from
Jan 25, 2026
Merged

Prompting fix to improve LCB score for GPTOSS #1169

Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
99296c0
adding lcb prompt for gpt-oss
wasiahmad Jan 15, 2026
026ada0
Merge branch 'main' into gptoss_dsv32_lcb_fix
wasiahmad Jan 15, 2026
98132ce
lcb prompting updates
wasiahmad Jan 21, 2026
2d46b1d
lcb prompting updates
wasiahmad Jan 21, 2026
7467684
updating default prompt-config
wasiahmad Jan 23, 2026
7a3c0a8
Merge branch 'main' into gptoss_dsv32_lcb_fix
wasiahmad Jan 24, 2026
01f14d9
changing back dataset prep
wasiahmad Jan 24, 2026
24fcb4c
rolling back to previous prompt config and defaults
wasiahmad Jan 25, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions nemo_skills/prompt/config/gpt-oss/livecodebench.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
user: |-
{question}

Please avoid using `sys.stdin.buffer` to process input, and avoid using `threading`.
Copy link
Copy Markdown
Contributor

@greptile-apps greptile-apps bot Jan 21, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

style: The simplified prompt lacks explicit guidance on allowed input methods (like input(), sys.stdin.read()) that were in the previous version. Consider whether models might benefit from positive examples of what TO use, not just what to avoid.

Suggested change
Please avoid using `sys.stdin.buffer` to process input, and avoid using `threading`.
Please avoid using `sys.stdin.buffer` to process input, and avoid using `threading`. Instead use `input()` or `sys.stdin.read()`.

Note: If this suggestion doesn't match your team's coding style, reply to this and let me know. I'll remember it for next time!