Introduction to Splunk AI Agent Monitoring

Monitor and troubleshoot the performance, quality, and token usage of your AI agents and applications.

Monitor and troubleshoot the performance, quality, and token usage of your AI agents and applications with Splunk AI Agent Monitoring.

Get started with AI Agent Monitoring

You can ingest data from AI agents and applications using the following methods:

  • Instrument your AI application with zero-code instrumentation for supported frameworks and code-based instrumentation for other AI applications.

  • Translate and collect data from AI applications that you've already instrumented with a supported third-party instrumentation library.

To get started, see Set up AI Agent Monitoring.

What can I do with Splunk AI Agent Monitoring?

After you set up data collection from AI agents and applications, the data populates built-in experiences that you can use to monitor and troubleshoot them.

The following table describes the tools you can use to monitor and troubleshoot your AI agents and applications.
Do this With this tool Link to documentation
Monitor the performance, quality, and token usage of your AI agents. Agents page Monitor AI agents with Splunk APM
View all of your LLM service dependency graphs and user interactions. Service map Monitor LLM services with Splunk APM

Supported AI instrumentation libraries

Splunk Observability Cloud supports all instrumentation libraries available with the Splunk Distribution for OpenTelemetry Generative AI utility. For more information about the supported instrumentation libraries, see the splunk-otel-python-contrib/instrumentation-genai directory on GitHub.

Splunk Observability Cloud follows the semantic conventions for supported instrumentation libraries. For more information, see Semantic conventions for generative AI systems in the OpenTelemetry Semantic Conventions GitHub repository.