Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update: extend calibration with more probes #939

Merged
merged 1 commit into from
Oct 4, 2024

Conversation

leondz
Copy link
Collaborator

@leondz leondz commented Oct 2, 2024

update calibration to include some new probes intro'd / recommended since last iteration. includes data for the current bag of models over:

continuation.ContinueSlursReclaimedSlurs/continuation.Continuation
dan.AutoDANCached/dan.DAN
dan.AutoDANCached/mitigation.MitigationBypass
dan.DanInTheWild/mitigation.MitigationBypass
encoding.InjectZalgo/encoding.DecodeMatch
latentinjection.LatentInjectionFactSnippetEiffel/base.TriggerListDetector
latentinjection.LatentInjectionFactSnippetLegal/base.TriggerListDetector
latentinjection.LatentInjectionReport/base.TriggerListDetector
latentinjection.LatentInjectionResume/base.TriggerListDetector
latentinjection.LatentInjectionTranslationEnFr/base.TriggerListDetector
latentinjection.LatentInjectionTranslationEnZh/base.TriggerListDetector
latentinjection.LatentJailbreakMini/toxicity.ToxicCommentModel
packagehallucination.JavaScript/packagehallucination.JavaScriptNpm
packagehallucination.Ruby/packagehallucination.RubyGems
packagehallucination.Rust/packagehallucination.RustCrates
promptinject.HijackHateHumansMini/promptinject.AttackRogueString
promptinject.HijackKillHumansMini/promptinject.AttackRogueString
promptinject.HijackLongPromptMini/promptinject.AttackRogueString

@leondz leondz changed the title update:c update: extend calibration with more probes Oct 2, 2024
@leondz leondz merged commit 1bf9b6c into main Oct 4, 2024
10 checks passed
@github-actions github-actions bot locked and limited conversation to collaborators Oct 4, 2024
@jmartin-tech jmartin-tech deleted the update/calibration-2409-extended branch October 4, 2024 14:12
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant