1. Get a Hugging Face Key
- Got to https://HuggingFace.co
- Sign up and get a HF token to use as a key
For more info and detailed instructions, visit https://huggingface.co/docs/hub/security-tokens
2. Add Hugging Face AI Model to Fusion Quill
You can add a ONLY a Hugging Face CHAT (like mistral-instruct) model to Fusion Quill using the setup wizard when the application starts up for the first time or by using the “AI Services” option in Config.
- Enter a name to identify this setting in Fusion Quill.
- Enter the key (token) you got from Hugging Face settings page.
- You can enter another chat model instead of Mistral-Instruct using the Hugging Face model name syntax (Org/ModelID)
- Only Chat models work!
- Click ‘Add’ to add the Hugging Face model to Fusion Quill.