Fusion Quill AI

Setup Groq AI Model in Fusion Quill

Get a Groq API Key

  1. Create a Groq account and log in.
  2. Navigate to the API key page and “Create new secret key”.

For more information and detailed instructions, visit Groq AI Account Setup.

Add Groq Model to Fusion Quill

You can add an Groq AI model to Fusion Quill using the setup wizard when the application starts up for the first time or by using the “AI Services” option in Config.

  1. Click ‘Add Open AI / Azure Open AI / Ollama/ vLLM Model’
  2. Enter a name to identify this setting in Fusion Quill.
  3. Select ‘Custom API like vLLM’ as the Service Provider.
  4. Enter a valid Groq model name like mixtral-8x7b-32768.
  5. Enter the API key you got from Groq.
  6. Enter the Endpoint Url as https://api.groq.com/openai/v1
  7. Click ‘Add’ to add the Groq model to Fusion Quill.