Support OpenAssistant models in basic form, including 30B xor one

[pseudotensor]

Follow: https://huggingface.co/OpenAssistant/oasst-sft-7-llama-30b-xor

and add prompt_type stuff. bit hacky in dealing with special chars.

[pseudotensor]

eval on OASST 30B 7sft:

CUDA_VISIBLE_DEVICES="0,1" python generate.py --base_model=oasst-sft-7-llama-30b --gradio=False --infer_devices=False --eval_sharegpt_prompts_only=100 --eval_sharegpt_as_output=False --num_beams=2 &> score_oasst30b_xor_7sft_a.log

[pseudotensor]

Unsure why this:

START====================================================================================================
Question: Can you write a blog post about how AI is helping video productions with their storyboards? Include a brief summary of what storyboards are and how they help a production. Specifically mention that AI image generators can
 help spur imagination when creating storyboards 
---------------------------------------------------------------------------------------------------------
{'instruction': '', 'iinput': '', 'context': '', 'stream_output': False, 'prompt_type': 'open_assistant', 'temperature': 0.1, 'top_p': 0.75, 'top_k': 40, 'num_beams': 2, 'max_new_tokens': 256, 'min_new_tokens': 0, 'early_stopping':
 False, 'max_time': 180, 'repetition_penalty': 1.07, 'num_return_sequences': 1, 'do_sample': False, 'chat': False, 'instruction_nochat': 'Can you write a blog post about how AI is helping video productions with their storyboards? I
nclude a brief summary of what storyboards are and how they help a production. Specifically mention that AI image generators can help spur imagination when creating storyboards', 'iinput_nochat': '', 'src_lang': None, 'tgt_lang': N
one, 'debug': True, 'concurrency_count': 1, 'save_dir': None, 'sanitize_bot_response': True, 'is_low_mem': False, 'raise_generate_gpu_exceptions': True, 'chat_context': False, 'lora_weights': ''}
prompt:  <|prompter|>Can you write a blog post about how AI is helping video productions with their storyboards? Include a brief summary of what storyboards are and how they help a production. Specifically mention that AI image gen
erators can help spur imagination when creating storyboards
<|assistant|>
input_ids length 57
Pre-Generate: 2023-05-07 03:16:28.247373
Generate: 2023-05-07 03:16:28.247408
output:
 <unk> <|prompter|> Can you write a blog post about how AI is helping video productions with their storyboards? Include a brief summary of what storyboards are and how they help a production. Specifically mention that AI image gene
rators can help spur imagination when creating storyboards <|assistant|> </s>
outputclean:
 

SCORE 0: 0.27503237
Post-Generate: 2023-05-07 03:17:26.688891 decoded_output: 302

0.3 score even though no response. And why no response? Just <\s>