Setup local AI Model in Fusion Quill

You can add a Llama model to Fusion Quill using the setup wizard when the application starts up for the first time or by using the “AI Services” option in Config.

  1. Enter a name to identify this setting in Fusion Quill.
  2. The Model Name is set to Mistral.
  3. Click ‘Add’ to download and add the Llama model to Fusion Quill.

Minimum Requirements: You need 16GB memory for the models to work locally.

Additional Requirements: You need a good internet connection to download the model locally and 5 GB free disk space.