The Hivetrace SDK integrates your application with Hivetrace to inspect and monitor both user prompts (input) and LLM responses (output).
Typical use cases:
- Observability: trace prompts/responses with consistent metadata (session, user, agent, etc.)
- Policy enforcement: detect unsafe or disallowed content and decide what to do next
- Sanitization: optionally use cleaned text when data cleaning is enabled
- Attachments (optional): attach files for analysis when needed (you can omit files entirely)
The SDK works with any LLM provider (OpenAI, Perplexity, local models, etc.) because you instrument your app at the boundary where you send a user prompt to an LLM and receive the model output. You can monitor:
- user prompts via
client.input(...) - model responses via
client.output(...)
If you use a multi-agent framework, install the corresponding extra and use the adapter/integration. These are third-party frameworks — we provide integrations to monitor their agent runs.
| Framework | Install | Docs |
|---|---|---|
| LangChain | pip install "hivetrace[langchain]" |
LangChain Integration |
| CrewAI | pip install "hivetrace[crewai]" |
CrewAI Integration |
| OpenAI Agents | pip install "hivetrace[openai_agents]" |
OpenAI Agents Integration |
Exact dependency set used by extras
- LangChain (
hivetrace[langchain]):langchain-openai==0.2.5langchain-community==0.3.18langchain==0.3.19langchain_experimental==0.3.4
- CrewAI (
hivetrace[crewai]):crewai>=0.95.0
- OpenAI Agents (
hivetrace[openai_agents]):openai-agents>=0.1.0
Install from PyPI:
pip install hivetrace[base]By default, the SDK reads its connection settings from environment variables:
HIVETRACE_URL— Base URL of your Hivetrace instance (must start withhttp://orhttps://)HIVETRACE_ACCESS_TOKEN— API token used for authentication (created in the UI)
HIVETRACE_APP_ID is optional and is used by some integrations/examples as a convenient place to store your application ID. You can always pass application_id explicitly per call.
HIVETRACE_URL=https://your-hivetrace-instance.com
HIVETRACE_ACCESS_TOKEN=your-access-token
HIVETRACE_APP_ID=your-application-idfrom hivetrace import SyncHivetraceSDK
client = SyncHivetraceSDK(
config={
"HIVETRACE_URL": "https://your-hivetrace-instance.com",
"HIVETRACE_ACCESS_TOKEN": "your-access-token",
}
)from hivetrace import SyncHivetraceSDKCreate an application in the Hivetrace UI and copy its application_id.
In synchronous mode you can use Hivetrace results to decide:
- Whether to call your LLM at all (when the user input is not allowed)
- What to return to the end user (when the LLM output is not allowed)
This lets you return a safe, prepared response instead of sending a violating prompt to the LLM or returning a potentially unsafe LLM answer.
Recommended flow (best practice):
- Step 1 — inspect input: call
client.input(...)for the user message.- If the result indicates a violation (guardrails/custom policy), stop and return a prepared safe reply (e.g. “Sorry, I can’t help with that.”). Do not call your LLM.
- If the result includes sanitized text (e.g.
dataclean.cleaned_text), you may choose to send the sanitized version to your LLM instead of the raw user text.
- Step 2 — call your LLM: only if the input is acceptable.
- Step 3 — inspect output: call
client.output(...)for the LLM answer.- If the output violates your policies, return a prepared safe reply instead of the LLM answer.
from hivetrace import SyncHivetraceSDK
APP_ID = "your-application-id" # created in the Hivetrace UI
client = SyncHivetraceSDK()
user_message = "My name is John"
# 1) Inspect the user prompt (input)
input_result = client.input(application_id=APP_ID, message=user_message)
# If available, you can prefer sanitized text (data cleaning) for your LLM call.
prompt_for_llm = input_result.get("dataclean", {}).get("cleaned_text", user_message)
# 2) Call your LLM (your code)
assistant_message = call_your_llm(prompt_for_llm)
# 3) Inspect the LLM response (output)
output_result = client.output(application_id=APP_ID, message=assistant_message)You can use either the synchronous client (SyncHivetraceSDK) or the asynchronous client (AsyncHivetraceSDK). Choose the one that fits your runtime.
# The sync client reads configuration from environment variables or accepts an explicit config
client = SyncHivetraceSDK()from hivetrace import SyncHivetraceSDK
APP_ID = "your-application-id" # created in the Hivetrace UI
def main():
# option 1: context manager
with SyncHivetraceSDK() as client:
client.input(application_id=APP_ID, message="User prompt here")
# option 2: manual close
client = SyncHivetraceSDK()
try:
client.input(application_id=APP_ID, message="User prompt here")
finally:
client.close()
main()from hivetrace import AsyncHivetraceSDK
# The async client reads configuration from environment variables or accepts an explicit config
client = AsyncHivetraceSDK()import asyncio
from hivetrace import AsyncHivetraceSDK
APP_ID = "your-application-id" # created in the Hivetrace UI
async def main():
# option 1: context manager
async with AsyncHivetraceSDK() as client:
await client.input(application_id=APP_ID, message="User prompt here")
# option 2: manual close
client = AsyncHivetraceSDK()
try:
await client.input(application_id=APP_ID, message="User prompt here")
finally:
await client.close()
asyncio.run(main())Both input() and output() accept:
additional_parameters(optional): any JSON-serializable metadata you want to attach (session id, user id, agent info, etc.)
File attachments (files) are optional and are currently supported for user prompts only (input()).
from pathlib import Path
from hivetrace import SyncHivetraceSDK
APP_ID = "your-application-id" # created in the Hivetrace UI
client = SyncHivetraceSDK()
files = [
("doc1.txt", Path("doc1.txt").read_bytes(), "text/plain"),
]
result = client.input(
application_id=APP_ID,
message="My name is John",
additional_parameters={ # optional
"session_id": "your-session-id",
"user_id": "your-user-id",
"agents": {
"agent-1-id": {"name": "Agent 1", "description": "Agent description"},
"agent-2-id": {"name": "Agent 2"},
},
},
files=files, # optional (input only)
)# Sync
def input(
application_id: str,
message: str,
additional_parameters: dict | None = None,
files: list[tuple[str, bytes, str]] | None = None,
) -> dict: ...
# Async
async def input(
application_id: str,
message: str,
additional_parameters: dict | None = None,
files: list[tuple[str, bytes, str]] | None = None,
) -> dict: ...Sends a user prompt to Hivetrace.
application_id— Application identifier (must be a valid UUID, created in the UI)message— The user promptadditional_parameters— Optional dictionary with extra context (session, user, agents, etc.)files— Optional list of tuples(filename: str, content: bytes, mime_type: str)
Response example:
{
"request_id": "62c51dcf-f7bb-44d3-8c3a-6007b2a44d7d",
"schema_version": "2.0.0",
"status": "success",
"errors": [],
"tokens": {
"count": 8,
"usage_severity": null
},
"guardrails": {
"flagged": false
},
"custom_policy": {
"flagged": false
},
"dataclean": {
"flagged": true,
"cleaned_text": "My name is XXXX",
"types": [
{
"type": "NAME",
"count": 1
}
]
}
}# Sync
def output(
application_id: str,
message: str,
additional_parameters: dict | None = None,
) -> dict: ...
# Async
async def output(
application_id: str,
message: str,
additional_parameters: dict | None = None,
) -> dict: ...Sends an LLM response to Hivetrace.
application_id— Application identifier (must be a valid UUID, created in the UI)message— The LLM responseadditional_parameters— Optional dictionary with extra context (session, user, agents, etc.)
Response example:
{
"request_id": "f1e45e80-8f95-449b-9ac4-977b8616ed99",
"schema_version": "2.0.0",
"status": "success",
"errors": [],
"tokens": {
"count": 5,
"usage_severity": null
},
"guardrails": {
"flagged": false
},
"dataclean": {
"flagged": true,
"cleaned_text": "My name is XXXX",
"types": [
{
"type": "NAME",
"count": 1
}
]
}
}Demo repository
https://github.com/anntish/multiagents-crew-forge
What to do: Add the HiveTrace SDK to your project
Where: In requirements.txt or via pip
# Via pip (for quick testing)
pip install hivetrace[crewai]>=1.3.5
# Or add to requirements.txt (recommended)
echo "hivetrace[crewai]>=1.3.3" >> requirements.txt
pip install -r requirements.txtWhy: The HiveTrace SDK provides decorators and clients for sending agent activity data to the monitoring platform.
Example: In src/config.py
PLANNER_ID = "333e4567-e89b-12d3-a456-426614174001"
WRITER_ID = "444e4567-e89b-12d3-a456-426614174002"
EDITOR_ID = "555e4567-e89b-12d3-a456-426614174003"Why agents need IDs: HiveTrace tracks each agent individually. A UUID ensures the agent can be uniquely identified in the monitoring system.
What to do: Map agent roles to their HiveTrace IDs
Example: In src/agents.py (where your agents are defined)
from crewai import Agent
# ADD: import agent IDs
from src.config import EDITOR_ID, PLANNER_ID, WRITER_ID
# ADD: mapping for HiveTrace (REQUIRED!)
agent_id_mapping = {
"Content Planner": { # ← Exactly the same as Agent(role="Content Planner")
"id": PLANNER_ID,
"description": "Creates content plans"
},
"Content Writer": { # ← Exactly the same as Agent(role="Content Writer")
"id": WRITER_ID,
"description": "Writes high-quality articles"
},
"Editor": { # ← Exactly the same as Agent(role="Editor")
"id": EDITOR_ID,
"description": "Edits and improves articles"
},
}
# Your existing agents (NO CHANGES)
planner = Agent(
role="Content Planner", # ← Must match key in agent_id_mapping
goal="Create a structured content plan for the given topic",
backstory="You are an experienced analyst...",
verbose=True,
)
writer = Agent(
role="Content Writer", # ← Must match key in agent_id_mapping
goal="Write an informative and engaging article",
backstory="You are a talented writer...",
verbose=True,
)
editor = Agent(
role="Editor", # ← Must match key in agent_id_mapping
goal="Improve the article",
backstory="You are an experienced editor...",
verbose=True,
)Important: The keys in agent_id_mapping must exactly match the role of your agents. Otherwise, HiveTrace will not be able to associate activity with the correct agent.
What to do: Add HiveTrace support to tools
Example: In src/tools.py
from crewai.tools import BaseTool
from typing import Optional
class WordCountTool(BaseTool):
name: str = "WordCountTool"
description: str = "Count words, characters and sentences in text"
# ADD: HiveTrace field (REQUIRED!)
agent_id: Optional[str] = None
def _run(self, text: str) -> str:
word_count = len(text.split())
return f"Word count: {word_count}"Example: In src/agents.py
from src.tools import WordCountTool
from src.config import PLANNER_ID, WRITER_ID, EDITOR_ID
# ADD: create tools for each agent
planner_tools = [WordCountTool()]
writer_tools = [WordCountTool()]
editor_tools = [WordCountTool()]
# ADD: assign tools to agents
for tool in planner_tools:
tool.agent_id = PLANNER_ID
for tool in writer_tools:
tool.agent_id = WRITER_ID
for tool in editor_tools:
tool.agent_id = EDITOR_ID
# Use tools in agents
planner = Agent(
role="Content Planner",
tools=planner_tools, # ← Agent-specific tools
# ... other parameters
)Why: HiveTrace tracks tool usage. The agent_id field in the tool class and its assignment let HiveTrace know which agent used which tool.
What to do: Add the HiveTrace client to the application lifecycle
Example: In main.py
from contextlib import asynccontextmanager
from fastapi import FastAPI
# ADD: import HiveTrace SDK
from hivetrace import SyncHivetraceSDK
from src.config import HIVETRACE_ACCESS_TOKEN, HIVETRACE_URL
@asynccontextmanager
async def lifespan(app: FastAPI):
# ADD: initialize HiveTrace client
hivetrace = SyncHivetraceSDK(
config={
"HIVETRACE_URL": HIVETRACE_URL,
"HIVETRACE_ACCESS_TOKEN": HIVETRACE_ACCESS_TOKEN,
}
)
# Store client in app state
app.state.hivetrace = hivetrace
try:
yield
finally:
# IMPORTANT: close connection on shutdown
hivetrace.close()
app = FastAPI(lifespan=lifespan)What to do: Wrap Crew creation with the HiveTrace decorator
Example: In src/services/topic_service.py
import uuid
from typing import Optional
from crewai import Crew
# ADD: HiveTrace imports
from hivetrace import SyncHivetraceSDK
from hivetrace import crewai_trace as trace
from src.agents import agent_id_mapping, planner, writer, editor
from src.tasks import plan_task, write_task, edit_task
from src.config import HIVETRACE_APP_ID
def process_topic(
topic: str,
hivetrace: SyncHivetraceSDK, # ← ADD parameter
user_id: Optional[str] = None,
session_id: Optional[str] = None,
):
# ADD: generate unique conversation ID
agent_conversation_id = str(uuid.uuid4())
# ADD: common trace parameters
common_params = {
"agent_conversation_id": agent_conversation_id,
"user_id": user_id,
"session_id": session_id,
}
# ADD: log user request
hivetrace.input(
application_id=HIVETRACE_APP_ID,
message=f"Requesting information from agents on topic: {topic}",
additional_parameters={
**common_params,
"agents": agent_id_mapping, # ← pass agent mapping
},
)
# ADD: @trace decorator for monitoring Crew
@trace(
hivetrace=hivetrace,
application_id=HIVETRACE_APP_ID,
agent_id_mapping=agent_id_mapping, # ← REQUIRED!
)
def create_crew():
return Crew(
agents=[planner, writer, editor],
tasks=[plan_task, write_task, edit_task],
verbose=True,
)
# Execute with monitoring
crew = create_crew()
result = crew.kickoff(
inputs={"topic": topic},
**common_params # ← pass common parameters
)
return {
"result": result.raw,
"execution_details": {**common_params, "status": "completed"},
}How it works:
-
agent_conversation_id— unique ID for grouping all actions under a single request -
hivetrace.input()— sends the user’s request to HiveTrace for inspection -
@trace:- Intercepts all agent actions inside the Crew
- Sends data about each step to HiveTrace
- Associates actions with specific agents via
agent_id_mapping
-
**common_params— passes metadata intocrew.kickoff()so all events are linked
Critical: The @trace decorator must be applied to the function that creates and returns the Crew, not the function that calls kickoff().
What to do: Pass the HiveTrace client to the business logic
Example: In src/routers/topic_router.py
from fastapi import APIRouter, Body, Request
# ADD: import HiveTrace type
from hivetrace import SyncHivetraceSDK
from src.services.topic_service import process_topic
from src.config import SESSION_ID, USER_ID
router = APIRouter(prefix="/api")
@router.post("/process-topic")
async def api_process_topic(request: Request, request_body: dict = Body(...)):
# ADD: get HiveTrace client from app state
hivetrace: SyncHivetraceSDK = request.app.state.hivetrace
return process_topic(
topic=request_body["topic"],
hivetrace=hivetrace, # ← pass client
user_id=USER_ID,
session_id=SESSION_ID,
)Why: The API endpoint must pass the HiveTrace client to the business logic so monitoring data can be sent.
- Role mismatch — make sure keys in
agent_id_mappingexactly matchrolein agents - Missing
agent_id_mapping— the@tracedecorator must receive the mapping - Decorator on wrong function —
@tracemust be applied to the Crew creation function, notkickoff - Client not closed — remember to call
hivetrace.close()in the lifespan - Invalid credentials — check your HiveTrace environment variables
Demo repository
https://github.com/anntish/multiagents-langchain-forge
This project implements monitoring of a multi-agent system in LangChain via the HiveTrace SDK.
pip install hivetrace[langchain]>=1.3.5
# optional: add to requirements.txt and install
echo "hivetrace[langchain]>=1.3.3" >> requirements.txt
pip install -r requirements.txtWhat the package provides: SDK clients (sync/async), a universal callback for LangChain agents, and ready-to-use calls for sending inputs/logs/outputs to HiveTrace.
HIVETRACE_URL: HiveTrace addressHIVETRACE_ACCESS_TOKEN: HiveTrace access tokenHIVETRACE_APP_ID: your application ID in HiveTraceOPENAI_API_KEY: key for the LLM provider (example with OpenAI)- Additionally:
OPENAI_MODEL,USER_ID,SESSION_ID
Create a dictionary of fixed UUIDs for all "agent nodes" (e.g., orchestrator, specialized agents). This ensures unambiguous identification in tracing.
Example: file src/core/constants.py:
PREDEFINED_AGENT_IDS = {
"MainHub": "111e1111-e89b-12d3-a456-426614174099",
"text_agent": "222e2222-e89b-12d3-a456-426614174099",
"math_agent": "333e3333-e89b-12d3-a456-426614174099",
"pre_text_agent": "444e4444-e89b-12d3-a456-426614174099",
"pre_math_agent": "555e5555-e89b-12d3-a456-426614174099",
}Tip: dictionary keys must match the actual node names appearing in logs (tool/agent name in LangChain calls).
Create and use AgentLoggingCallback — it should be passed:
- as a callback in
AgentExecutor(orchestrator), and - as
callback_handlerin your tools/agent wrappers (BaseTool).
Example: file src/core/orchestrator.py (fragment):
from hivetrace.adapters.langchain import AgentLoggingCallback
from langchain.agents import AgentExecutor, create_openai_tools_agent
from langchain_core.prompts import ChatPromptTemplate, MessagesPlaceholder
class OrchestratorAgent:
def __init__(self, llm, predefined_agent_ids=None):
self.llm = llm
self.logging_callback = AgentLoggingCallback(
default_root_name="MainHub",
predefined_agent_ids=predefined_agent_ids,
)
# Example: wrapper agents as tools
# MathAgentTool/TextAgentTool internally pass self.logging_callback further
agent = create_openai_tools_agent(self.llm, self.tools, ChatPromptTemplate.from_messages([
("system", "You are the orchestrator agent of a multi-agent system."),
MessagesPlaceholder(variable_name="chat_history", optional=True),
("human", "{input}"),
MessagesPlaceholder(variable_name="agent_scratchpad"),
]))
self.executor = AgentExecutor(
agent=agent,
tools=self.tools,
verbose=True,
callbacks=[self.logging_callback],
)Important: all nested agents/tools that create their own AgentExecutor or inherit from BaseTool must also receive this callback_handler so their steps are included in tracing.
Use the run_with_tracing helper from hivetrace/adapters/langchain/api.py. It:
- logs the input with agent mapping and metadata;
- calls your orchestrator;
- collects and sends accumulated logs/final answer.
Minimal example (script):
import os, uuid
from langchain_openai import ChatOpenAI
from src.core.orchestrator import OrchestratorAgent
from src.core.constants import PREDEFINED_AGENT_IDS
from hivetrace.adapters.langchain import run_with_tracing
llm = ChatOpenAI(model=os.getenv("OPENAI_MODEL", "gpt-4o-mini"), temperature=0.2, streaming=False)
orchestrator = OrchestratorAgent(llm, predefined_agent_ids=PREDEFINED_AGENT_IDS)
result = run_with_tracing(
orchestrator=orchestrator,
query="Format this text and count the number of words",
application_id=os.getenv("HIVETRACE_APP_ID"),
user_id=os.getenv("USER_ID"),
session_id=os.getenv("SESSION_ID"),
conversation_id=str(uuid.uuid4()),
)
print(result)FastAPI variant (handler fragment):
from fastapi import APIRouter, Request
from hivetrace.adapters.langchain import run_with_tracing
import uuid
router = APIRouter()
@router.post("/query")
async def process_query(payload: dict, request: Request):
orchestrator = request.app.state.orchestrator
conv_id = str(uuid.uuid4()) # always create a new agent_conversation_id for each request to group agent work for the same question
result = run_with_tracing(
orchestrator=orchestrator,
query=payload["query"],
application_id=request.app.state.HIVETRACE_APP_ID,
user_id=request.app.state.USER_ID,
session_id=request.app.state.SESSION_ID,
conversation_id=conv_id,
)
return {"status": "success", "result": result}Helpers automatically create a short-lived client if none is provided. If you want to reuse a client — create it once during the application's lifecycle and pass it to helpers.
FastAPI (lifespan):
from contextlib import asynccontextmanager
from fastapi import FastAPI
from hivetrace import SyncHivetraceSDK
@asynccontextmanager
async def lifespan(app: FastAPI):
hivetrace = SyncHivetraceSDK()
app.state.hivetrace = hivetrace
try:
yield
finally:
hivetrace.close()
app = FastAPI(lifespan=lifespan)Then:
result = run_with_tracing(
orchestrator=orchestrator,
query=payload.query,
hivetrace=request.app.state.hivetrace, # pass your own client
application_id=request.app.state.HIVETRACE_APP_ID,
)- Agent nodes: orchestrator nodes and specialized "agent wrappers" (
text_agent,math_agent, etc.). - Actual tools: low-level tools (e.g.,
text_analyzer,text_formatter) are logged on start/end events. - Service records: automatically added
return_result(returning result to parent) andfinal_answer(final answer of the root node) steps.
This gives a clear call graph with data flow direction and the final answer.
- Name mismatch: key in
PREDEFINED_AGENT_IDSmust match the node/tool name in logs. - No agent mapping: either pass
agents_mappingtorun_with_tracingor definepredefined_agent_idsinAgentLoggingCallback— the SDK will build the mapping automatically. - Callback not attached: add
AgentLoggingCallbackto allAgentExecutorandBaseToolwrappers via thecallback_handlerparameter. - Client not closed: use lifespan/context manager for
SyncHivetraceSDK.
Demo repository
https://github.com/anntish/openai-agents-forge
pip install hivetrace[openai_agents]==1.3.5Set the environment variables (via .env or export):
HIVETRACE_URL=http://localhost:8000 # Your HiveTrace URL
HIVETRACE_ACCESS_TOKEN=ht_... # Your HiveTrace access token
HIVETRACE_APPLICATION_ID=00000000-...-0000 # Your HiveTrace application ID
SESSION_ID=
USERID=
OPENAI_API_KEY=
OPENAI_BASE_URL=https://api.openai.com/v1
OPENAI_MODEL=gpt-4o-miniAdd 3 lines before creating/using your agents:
from agents import set_trace_processors
from hivetrace.adapters.openai_agents.tracing import HivetraceOpenAIAgentProcessor
set_trace_processors([
HivetraceOpenAIAgentProcessor() # will take config from env
])Alternative (explicit configuration if you don’t want to rely on env):
from agents import set_trace_processors
from hivetrace import SyncHivetraceSDK
from hivetrace.adapters.openai_agents.tracing import HivetraceOpenAIAgentProcessor
hivetrace = SyncHivetraceSDK(config={
"HIVETRACE_URL": "http://localhost:8000",
"HIVETRACE_ACCESS_TOKEN": "ht_...",
})
set_trace_processors([
HivetraceOpenAIAgentProcessor(
application_id="00000000-0000-0000-0000-000000000000",
hivetrace_instance=hivetrace,
)
])Important:
- Register the processor only once at app startup.
- Attach it before the first agent run (
Runner.run(...)/Runner.run_sync(...)).
Before:
from agents import Agent, Runner
assistant = Agent(name="Assistant", instructions="Be helpful.")
print(Runner.run_sync(assistant, "Hi!"))After (with HiveTrace monitoring):
from agents import Agent, Runner, set_trace_processors
from hivetrace.adapters.openai_agents.tracing import HivetraceOpenAIAgentProcessor
set_trace_processors([HivetraceOpenAIAgentProcessor()])
assistant = Agent(name="Assistant", instructions="Be helpful.")
print(Runner.run_sync(assistant, "Hi!"))From this moment, all agent calls, handoffs, and tool invocations will be logged in HiveTrace.
If you use tools, decorate them with @function_tool so their calls are automatically traced:
from agents import function_tool
@function_tool(description_override="Adds two numbers")
def calculate_sum(a: int, b: int) -> int:
return a + bAdd this tool to your agent’s tools=[...] — and its calls will appear in HiveTrace with inputs/outputs.
This project is licensed under Apache License 2.0.