Anthropic

Python auto-instrumentation for Anthropic SDK

Python autoinstrumentation library for the Anthropic package.

This package implements the following Anthropic clients:

• Messages
• Completions
• AsyncMessages
• AsyncCompletions

These traces are fully OpenTelemetry compatible and can be sent to an OpenTelemetry collector for viewing, such as Arize Phoenix.

Installation

pip install openinference-instrumentation-anthropic

Quickstart

Install required packages:

pip install openinference-instrumentation-anthropic anthropic arize-phoenix opentelemetry-sdk opentelemetry-exporter-otlp

Start Phoenix server

python -m phoenix.server.main serve

By default, Phoenix listens on http://localhost:6006. You can visit the app via a browser at the same address. (Phoenix does not send data over the internet. It only operates locally on your machine.)

Setup instrumentation

Set up AnthropicInstrumentor to trace your application and send traces to Phoenix:

import os
from anthropic import Anthropic
from openinference.instrumentation.anthropic import AnthropicInstrumentor
from opentelemetry.exporter.otlp.proto.http.trace_exporter import OTLPSpanExporter
from opentelemetry.sdk import trace as trace_sdk
from opentelemetry.sdk.trace.export import SimpleSpanProcessor

# Configure AnthropicInstrumentor with Phoenix endpoint
endpoint = "http://127.0.0.1:6006/v1/traces"
tracer_provider = trace_sdk.TracerProvider()
tracer_provider.add_span_processor(SimpleSpanProcessor(OTLPSpanExporter(endpoint)))

AnthropicInstrumentor().instrument(tracer_provider=tracer_provider)

os.environ["ANTHROPIC_API_KEY"] = "YOUR_KEY_HERE"

client = Anthropic()

response = client.messages.create(
    max_tokens=1024,
    messages=[
        {
            "role": "user",
            "content": "Tell me about the history of Iceland!",
        }
    ],
    model="claude-3-opus-20240229",
)
print(response)

Now, on the Phoenix UI in your browser, you should see the traces from your Anthropic application. Click on a trace, then the “Attributes” tab will provide you with in-depth information regarding execution.

More Info

• OpenInference and Phoenix documentation
• How to customize spans to track sessions, metadata, etc.
• How to account for private information and span payload customization
• PyPI package