Configure AI model providers for Now Assist for Code skills
Select a large language model (LLM) as the AI service provider for Now Assist for Code skills.
You can use Now LLM Service, Azure OpenAI, Google Gemini or Anthropic Claude on AWS as the AI model provider for all generative AI skills and AI agents. Use the Configuration Controls in AI Control Tower to define which options are available, then set the skill-level preferences in the Now Assist Admin console. For more information, see Large language models on the ServiceNow AI Platform®.
AI stewards can enable or disable AI model providers in the AI Control Tower. Administrators set the default AI model providers for Now Assist skills in your instance through the Now Assist Admin console. As a user, you can override the instance default AI model provider and select a different model provider for Now Assist for Code skills in the script editor.
Parent Topic:Configuring Now Assist for Code
Set default AI model providers for your instance
Select a large language model (LLM) as the AI service provider for Now Assist for Code skills.
Before you begin
Role required: admin
About this task
Set the default AI model providers for Now Assist skills in your instance through the Now Assist Admin console.
Procedure
Navigate to All > Now Assist Admin > Settings.
Go to the Manage model providers tab and select Model Providers.
Manage model providers
Change the model provider by selecting Edit LLM Provider.
Select a model provider for either all skill groups or just a specific skill group.
| Choice | Description |
|---|---|
| Select a model provider for all the skill groups and skills in the instance. |
|
| Select a model provider for a specific skill group. |
Image omitted: now-assist-code-llm-customize-skill-group.png Select model provider for a skill group.</p></td></tr><tr><td id="d728963e305"><strong>Select a model provider for a specific skill.</strong></td><td><ol> To change the model provider for specific skills, do the following:
Image omitted: now-assist-code-llm-customize-skill.png Select model provider for specific skills.</p></td></tr></tbody> ResultThe skills and the skill groups are updated with the selected model providers. Select an AI model provider for Now Assist for Code skills in script editorSelect an AI model provider for specific skills within the script editor. Before you beginRole required: authenticated user About this taskAI stewards can enable or disable AI model providers in the AI Control Tower. Administrators set the default AI model providers for Now Assist skills in your instance through the Now Assist Admin console. As a user, you can override the instance default AI model provider and select a different model provider for Now Assist for Code skills in the script editor. You can only choose from the models that are enabled in the AI Control Tower. Procedure
Image omitted: now-assist-code-settings.png From the list of AI Providers, select a model provider. ResultAll requests to Now Assist for Code, including Code auto-complete, Code explain, Code generation, and Code edit, use the model provider that you selected. Note: You can switch between models at any time and as many times as you like. |