Large language models on the ServiceNow AI Platform

ServiceNow AI Platform® utilises large language models (LLM) for generative AI and agentic AI functionality. You can choose the ServiceNow® LLM or supported third-party models. LLMs bring about the Generative AI application capabilities by understanding and generating human language, and processing vast amount of data.

Third-party model strategy

ServiceNow® supports third-party AI model providers, which signifies that the admin persona can select a third-party large language or an AI model provider for Now Assist skills that are available out of box. Find the supported model providers, the LLM services and the version.

Note: Some out of box skills, Agents, and Agentic Workflows do not support Now LLM Service or third party model providers. To learn more about the exceptions to LLM service and third party model providers support, see https://support.servicenow.com/kb?id=kb_article_view&sysparm_article=KB2222333

Large language model selection

This selection is supported at various levels such as, skill, skill group and instance levels. However, the controls that define LLMs mapping to different skills, allowed at various global locations, are configured and approved in AI Control Tower by the AI steward. The model provider options for custom skills created in Now Assist skill kit and AI Agent Studio are also configured in AI Control Tower. See Configure third-party LLMs using AI Control Tower to learn more.

The Manage large language models feature enables the admin persona to perform additional actions like:

• Edit the model provider at the instance, skill group and skill levels
• Deactivate active skills which are non-compliant with fallback as No. See Explore AI model providers to learn more.
• View audit history on policy updates by AI steward in AI Control Tower
• Select allowed model providers across domain separated instances.

See Manage AI models to learn about managing.

For more information on selecting and updating model providers, see Manage model providers.

• Now LLM Service updates
  The Now LLM Service provides access to specialized large language models (LLMs) that are developed by ServiceNow. It also provides access to open-source LLMs that are selected, configured, or enhanced by ServiceNow, from the ServiceNow community and partners. Review these reference materials and model cards for additional information about the Now LLM Service and about the models used.
• General guidelines for writing instructions for generative AI large language models (LLMs)
  When using Now Assist products and skills, you may have the option to give specific instructions or other guidance to the LLM. Writing generative AI instructions is different from conducting a keyword search. Use the following general guidelines when crafting your instructions.
• Long term stable models
  Long term stable (LTS) models support regulated industries, such as financial institutions, with stronger AI lifecycle management, governance, transparency, and compliance tools.
• Discrepancies when using different AI search tools
  Different AI search tools may return different answers for the same or similar searches. This difference in results is expected. It occurs because each large language model (LLM) uses a different approach to find results and generate answers that match your search.
• Providers and Models
  You can bring your own large language model (LLM) provider and API to use with Now Assist.

Parent Topic:Enable AI experiences