Splunk Observability Cloud

Splunk Observability Cloud is a real-time observability platform purpose-built for monitoring metrics, traces, and logs at scale. It ingests OpenTelemetry data and provides advanced dashboards and analytics to help teams detect and resolve performance issues quickly. This guide explains how to integrate ThousandEyes data with Splunk Observability Cloud using OpenTelemetry.

For more information about sending metrics to Splunk Observability Cloud using OpenTelemetry, see Splunk Observability Cloud: Manage Data.

Step 1: Create a Splunk Observability Cloud Access Token

To send data to Splunk Observability Cloud, you need an access token. Follow these steps to create a Splunk Observability Cloud access token:

1. In the Splunk Observability Cloud platform, go to Settings > Access Token.

2. Click Create Token.

3. Enter a Name.

4. Select Ingest Token (required for telemetry data).

5. Accept to continue with your selection.

6. Click Next > Next. and then Create to create your access token.

   Copy the token to use it to send telemetry data to Splunk Observability Cloud.

Step 2: Create an Integration

Create an Integration Using the ThousandEyes UI

To integrate Splunk Observability Cloud with ThousandEyes, follow these steps.

1. Log in to your account on the ThousandEyes platform and go to Manage > Integration > Integration 1.0.

2. Click New Integration and select OpenTelemetry Integration.

3. Enter a Name for the integration.

4. Set the Target to HTTP.

5. Enter the Endpoint URL to send data in OTLP (OpenTelemetry Protocol) format https://ingest.{REALM}.signalfx.com/v2/datapoint/otlp. Replace {REALM} with your Splunk environment such as us1, eu0.

6. For Preset Configuration, select Splunk Observability Cloud.

7. For Auth Type, select Custom.

8. Add the following Custom Headers:

   • X-SF-Token: {TOKEN}. Enter your Splunk Observability Cloud access token created in step 1.

   • Content-Type: application/x-protobuf.

9. For the OpenTelemetry Signal, select Metric.

10. For the Data Model Version, select v2.

11. Select a test. For more information on creating a test, see General Setup Instructions.

12. Click Save to complete the integration setup.

You have now successfully integrated your ThousandEyes data with Splunk Observability Cloud.

Manage Integrations in the UI

For more information on managing OpenTelemetry integrations, including listing, editing, and deleting integrations, see Manage Integrations Using the UI - Integrations 1.0.

Create an Integration Using the ThousandEyes API

For a programmatic integration, use the following API command:

Using HTTP Protocol

curl -v -XPOST https://api.thousandeyes.com/v7/stream -H "Content-Type: application/json" -H "Authorization: Bearer $BEARER_TOKEN" -d '{
  "type": "opentelemetry",
  "testMatch": [{
    "id": "281474976717575",
    "domain": "cea"
  }],
  "endpointType": "http",
  "streamEndpointUrl": "https://ingest.{REALM}.signalfx.com:443/v2/datapoint/otlp",
  "customHeaders" : {
    "X-SF-Token": "{TOKEN}",
    "Content-Type": "application/x-protobuf"
  }
}'

Using gRPC Protocol

curl -v -XPOST https://api.thousandeyes.com/v7/stream -H "Content-Type: application/json" -H "Authorization: Bearer $BEARER_TOKEN" -d '{
  "type": "opentelemetry",
  "testMatch": [{
    "id": "281474976717575",
    "domain": "cea"
  }],
  "endpointType": "grpc",
  "streamEndpointUrl": "https://ingest.{REALM}.signalfx.com:443",
  "customHeaders" : {
    "X-SF-Token": "{TOKEN}",
    "Content-Type": "application/x-protobuf"
  }
}'

Replace streamEndpointUrl and X-SF-Token values with the correct values for your Splunk Observability Cloud instance.

ThousandEyes Dashboard in Splunk Observability Cloud

Once the integration is set up, you can view real-time monitoring data in the ThousandEyes Network Monitoring Dashboard within Splunk Observability Cloud. The dashboard includes:

• HTTP Server Availability (%): Displays the availability of monitored HTTP servers.

• HTTP Throughput (bytes/s): Shows the data transfer rate over time.

• Client Request Duration (seconds): Measures the latency of client requests.

• Web Page Load Completion (%): Indicates the percentage of successful page loads.

• Page Load Duration (seconds): Displays the time taken to load pages.

ThousandEyes Dashboard in Splunk Observability Cloud

You can download the dashboard template from the following link: Download ThousandEyes Splunk Observability Cloud dashboard template (Google Drive).