Add an AI Model Provider

This document is a step-by-step tutorial designed for beginners. It will guide you through the process of integrating a model provider with Hanzo Cloud, our powerful knowledge base system.

Adding a model provider to Hanzo Cloud enables you to enhance its functionality by incorporating machine learning models and AI capabilities. Model providers allow you to analyze and process data within your knowledge base system, making it more intelligent and efficient.

If you're new to integrating model providers, don't worry. We've broken down the process into simple steps that anyone can follow.

Before you can add an AI model provider, make sure you have Hanzo IAM and Hanzo Cloud deployed. If you haven't done, please refer to the Deploy Hanzo IAM and Hanzo Cloud tutorial.

Model providers are used to integrate LLM into Hanzo Cloud. You can add them by following these steps:

Click the Providers button on the home page.

Click the Add button to add a model provider.

Fill in the model provider details and click the Save & Exit button.

Hanzo Cloud supports many model providers, including:

Example

Some models don't support streaming-output. Known models that support streaming-output include:

After adding a model provider, you can use it to analyze and process data in Hanzo Cloud using chatbots, question answering, and other AI capabilities.

Return to the model provider list page:

Now that you've added a model provider, you can use it to analyze and process data in Hanzo Cloud using chatbots, question answering, and other AI capabilities.

In the next chapter, we'll learn how to add an embedding provider to Hanzo Cloud.