Skip to content

Issues: NVIDIA/garak

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

299 Open 289 Closed
299 Open 289 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

feature: HuggingFace Gated Model Support enhancement Architectural upgrades
#1015 opened Nov 19, 2024 by EricXQiu
2
feature: Generic LLM HTTP API Support enhancement Architectural upgrades
#1013 opened Nov 19, 2024 by EricXQiu
1
probe: ANSI/Stök new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#997 opened Nov 11, 2024 by leondz 24.12
probe: more xss exfil probes probes Content & activity of LLM probes
#996 opened Nov 11, 2024 by leondz 24.12
feature: Refactor attempt to not override getters & setters enhancement Architectural upgrades
#995 opened Nov 11, 2024 by leondz 24.12
atkgen: disinfo probe probes Content & activity of LLM probes
#994 opened Nov 11, 2024 by leondz 24.12
atkgen: illegal content probe probes Content & activity of LLM probes
#993 opened Nov 11, 2024 by leondz 24.12
detector: Use LLMaaJ to see if models are following payload instructions detectors work on code that inherits from or manages Detector enhancement Architectural upgrades
#992 opened Nov 11, 2024 by leondz 24.12
feature: Enable use_safetensors/True for HF models and expose as config var enhancement Architectural upgrades
#990 opened Nov 11, 2024 by leondz 24.12
feature: Block pickle loading unless garak’s configured to do unsafe things enhancement Architectural upgrades
#989 opened Nov 11, 2024 by leondz
5 tasks
24.12
feature: add plugin file date/hash to plugin load messages & logs for auditing enhancement Architectural upgrades
#988 opened Nov 11, 2024 by leondz 24.12
test: run tests automatically at fixed time intervals, to catch shifts in dependencies housekeeping Repository and project maintenance tests Testing-related
#987 opened Nov 11, 2024 by leondz 24.12
feature: support audit trails, where asset IDs can be plugged in enhancement Architectural upgrades
#985 opened Nov 11, 2024 by leondz 24.12
feature: auto-eval enhancement Architectural upgrades
#984 opened Nov 11, 2024 by leondz 24.12
feature: Enable skipping of tests for policy points target is permissive over enhancement Architectural upgrades policy Related to policy scanning
#983 opened Nov 11, 2024 by leondz 24.12
feature: report target’s apparent policy & match to a predefined policies enhancement Architectural upgrades policy Related to policy scanning
#982 opened Nov 11, 2024 by leondz
11 tasks
24.12
atkgen: flexible probe probes Content & activity of LLM probes
#981 opened Nov 11, 2024 by leondz
7 tasks
24.12
atkgen: Establish pipeline toolkit from target (represented as a detector) to trained model enhancement Architectural upgrades probes Content & activity of LLM probes
#980 opened Nov 11, 2024 by leondz 24.12
detector: non-engagement detectors work on code that inherits from or manages Detector new plugin Describes an entirely new probe, detector, generator or harness
#975 opened Nov 7, 2024 by leondz
detector & payload: AgentHarm
#974 opened Nov 4, 2024 by leondz
detector: StrongREJECT -- evaluation for jailbreaks
#973 opened Nov 4, 2024 by leondz
REST URI client error: 422 question Further information is requested
#952 opened Oct 17, 2024 by samfhritp
2
probe: autodan-turbo new plugin Describes an entirely new probe, detector, generator or harness probes Content & activity of LLM probes
#944 opened Oct 11, 2024 by leondz
Reorganise _config - move run-specific items out of plugins and into run enhancement Architectural upgrades
#931 opened Sep 24, 2024 by leondz
security: warn if api_key given in config and config is world-readable cli Command-line interface functions enhancement Architectural upgrades
#927 opened Sep 23, 2024 by leondz 24.12
ProTip! Find all open issues with in progress development work with linked:pr.