Set a provider for a generative AI capability
Determine which AI provider to use for each of the generative AI capabilities of Generative AI Controller.
Before you begin
Configure your credentials for your preferred provider. See Configuring API credentials for generative AI capabilities for more details.
Role required: admin
About this task
Generative AI Controller comes with four capabilities by default. You can only configure a provider for the capabilities listed in the table in step 2. If you have installed other Now Assist applications, you may see other capabilities on the OneExtend Capability table. Those other capabilities use the Now LLM Service as their provider and can't be reconfigured.
Procedure
In the navigation filter, search for the OneExtend Capability table by entering
sys_one_extend_capability.list.Open the record for the capability that you would like to configure, such as Sentiment Analysis.
| Capability | Definition |
|---|---|
| Generate Content | Generate texts about a given topic with Workflow Studio and Virtual Agent Designer. |
| Generic Prompt | Create your own use case and prompt. |
| Sentiment Analysis | Analyze user sentiment with Workflow Studio and Virtual Agent Designer. |
| Summarize | Create summaries of topics with Workflow Studio and Virtual Agent Designer. |
In the OneExtend Definition Configs related list, set Default to
truefor your preferred capability provider.Note: By default, you can choose only one provider for a capability. For example, if Default is
truefor Sentiment (OpenAI Completion), you must set Default tofalsebefore changing Default totruefor Sentiment (Azure OpenAI).
Default builder config open with builder capability related list. The capability records and default column are highlighted.
| Capability Definition | Model |
|---|---|
| - OpenAI Completion - Azure OpenAI Completion | GPT-3 |
| - OpenAI Chat Completion - Azure OpenAI Chat Completion | GPT-3.5 |
| - GPT4 \(OpenAI Chat Compl\) - GPT4 \(Azure OpenAI Chat Compl\) | GPT-4 |
| - AI Studio \(Google Cloud Completion\) - AI Studio \(Google Cloud Chat Completion\) - Vertex AI \(Google Cloud Completion\) - Vertex AI \(Google Cloud Chat Completion\) | Google Gemini |
| IBM watsonx | Granite |
Result
Flows, topics, and scripts that use the generative AI capability use the provider you've specified.
Related topics