Set up Observability for AI

Learn about the high-level steps to set up Splunk Observability for AI

Monitor and troubleshoot your AI components by sending data from AI components to Splunk Observability Cloud.

Complete the following high-level steps to set up and use Observability for AI.

  1. Collect metrics and metadata from AI components.
  2. Collect traces and logs from AI components.
  3. Monitor and troubleshoot your AI components.

Collect traces and logs from AI components

Learn how to collect traces and logs from AI components for Splunk AI Observability.

Splunk Observability Cloud uses the Splunk HTTP Event Collector (HEC) exporter to enable the Splunk Distribution of the OpenTelemetry Collector to collect traces and logs. Splunk Log Observer Connect correlates the logs with metrics and traces for advanced troubleshooting.

To collect traces and logs for your AI components, complete the following high-level steps:

  1. Set up Log Observer Connect for Splunk Cloud Platform.

  2. Configure the Splunk HEC exporter to send logs to Splunk Cloud Platform.

Monitor and troubleshoot your AI components

Learn about the tools you can use to monitor and troubleshoot your AI components in Splunk AI Observability.

After you set up data collection from supported AI components to Splunk Observability Cloud, the data populates built-in experiences that you can use to monitor and troubleshoot your AI components.

The following table describes the tools you can use to monitor and troubleshoot your AI components.
Monitoring tool Use this tool to Link to documentation
Built-in navigators Orient and explore different layers of your AI tech stack.
Built-in dashboards Assess service, endpoint, and system health at a glance.
Splunk Application Performance Monitoring (APM) service map and trace view View all of your LLM service dependency graphs and user interactions in the service map or trace view.

Monitor LLM services with Splunk APM