Skip to content

Commit

Permalink
add template for taskname=taskname for gpt p tuning (NVIDIA#6283) (NV…
Browse files Browse the repository at this point in the history
…IDIA#6285)

Signed-off-by: hsiehjackson <[email protected]>
  • Loading branch information
github-actions[bot] authored and hsiehjackson committed Jun 2, 2023
1 parent 8767fb6 commit 570f9b4
Showing 1 changed file with 8 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -111,6 +111,14 @@ model:
answer_only_loss: True
answer_field: "answer"

- taskname: "taskname"
prompt_template: "<|VIRTUAL_PROMPT_0|> {prompt} {completion}"
total_virtual_tokens: 100
virtual_token_splits: [100]
truncate_field: null
answer_only_loss: True
answer_field: "completion"

prompt_tuning: # Prompt tunin specific params
new_prompt_init_methods: ['text'] # List of 'text' or 'random', should correspond to tasks listed in new tasks
new_prompt_init_text: ['some init text goes here'] # some init text if init method is text, or None if init method is random
Expand Down

0 comments on commit 570f9b4

Please sign in to comment.