Standardizing Agent Telemetry: How Arize AI and Google Cloud Are Taming the Wild West of Enterprise AI
By ⚡ min read
<p>Modern enterprise software stacks are increasingly composable, giving developers the freedom to assemble and reassemble components across multi-cloud environments. This architectural flexibility powers everything from microservices to containerized deployments. But as agentic functions—autonomous AI agents that can call tools, invoke models, and even improve user requests—gain traction in production, a critical gap has emerged: unstandardized telemetry.</p><p>Without a consistent way to track and monitor these agents, enterprises risk losing visibility into their behavior, connections, and actions. This is the 'Wild West' of agent orchestration, where adaptability comes at the cost of observability. However, a new push from Arize AI and Google Cloud aims to change that by mandating standardized telemetry protocols.</p><h2 id="challenge">The Challenge of Agent Telemetry in Composable Environments</h2><p>Agentic functions enjoy the same freedom of movement as other software components. Developers empower agents in production to call multiple system tools, invoke AI models (language, visual, large or small), modify user requests, and hand off tasks to domain-specific agents. While this enhances system adaptability, it creates a nightmare for telemetry.</p><figure style="margin:20px 0"><img src="https://cdn.thenewstack.io/media/2026/05/a242b6f7-owl-illustration-agency-orgvebc4fvq-unsplash-1024x887.jpg" alt="Standardizing Agent Telemetry: How Arize AI and Google Cloud Are Taming the Wild West of Enterprise AI" style="width:100%;height:auto;border-radius:8px" loading="lazy"><figcaption style="font-size:12px;color:#666;margin-top:5px">Source: thenewstack.io</figcaption></figure><p>When agents operate across different frameworks, models, and cloud backends, their traces—chronological records of execution events—become fragmented. Without standardization, teams must rebuild instrumentation every time the stack changes, leading to inefficiencies and blind spots.</p><h3 id="portability">Portability Over Point-to-Point Integration</h3><p>According to Richard Young, Technical Director of Partner Solutions Architecture at Arize AI, the core issue isn't where integration points exist but the portability of telemetry standards. “When you use standards like OpenTelemetry and OpenInference, you keep optionality without losing visibility. Standardized agent telemetry lets you change frameworks, models, tools, or observability backends without rebuilding your instrumentation every time. The trace format stays consistent even as the stack changes,” Young explains in a company blog post.</p><p>This emphasis on portability means that agent telemetry should be framework-agnostic, ensuring that as enterprises adopt new technologies, their observability data remains coherent and actionable.</p><h2 id="why-matters">Why Standardized Telemetry Matters for Enterprise Agents</h2><p>Inside the broader universe of observability, telemetry at the agent level provides crucial insights: where agents exist, what connections they are authorized to use, and what actions they have taken. This information is vital for debugging, compliance, and performance optimization.</p><p>Ryan Mangan, CEO of cloud resource optimization company EfficientEther, underscores this point: “In any live production software deployment, you can’t operate what you can’t see, and that goes double for agents.” Without standardized telemetry, agent behavior becomes a black box, increasing operational risk.</p><figure style="margin:20px 0"><img src="https://cdn.thenewstack.io/media/2026/05/a242b6f7-owl-illustration-agency-orgvebc4fvq-unsplash-scaled.jpg" alt="Standardizing Agent Telemetry: How Arize AI and Google Cloud Are Taming the Wild West of Enterprise AI" style="width:100%;height:auto;border-radius:8px" loading="lazy"><figcaption style="font-size:12px;color:#666;margin-top:5px">Source: thenewstack.io</figcaption></figure><p>Standardized formats like OpenTelemetry and OpenInference enable consistent tracing across diverse environments. They allow teams to analyze behavior uniformly and avoid locking critical observability data into a single platform—a key requirement for multi-cloud strategies.</p><h2 id="partnership">Arize AI and Google Cloud: A Partnership for Standardization</h2><p>Arize AI has partnered with Google Cloud following the launch of Google’s Gemini Enterprise Agent Platform last month. The Arize AX enterprise agent development platform now receives traces directly from the Gemini Agent service. Crucially, it aligns agent telemetry around OpenTelemetry and OpenInference standards. This approach ensures that software engineering teams can instrument agents once, analyze behavior consistently, and maintain flexibility regardless of underlying infrastructure.</p><p>The partnership addresses a fundamental pain point: as enterprises deploy more agents, they need a unified view of agent activity without being locked into proprietary observability tools. By adopting open standards, Arize and Google Cloud enable businesses to swap out components—whether models, frameworks, or backends—without losing visibility.</p><h2 id="path-forward">The Path Forward: Consistency Without Lock-In</h2><p>Standardized agent telemetry is not just a technical convenience; it’s a business imperative. As agentic systems become more autonomous and widespread, enterprises must ensure they can monitor, audit, and optimize these systems effectively. The collaboration between Arize AI and Google Cloud signals a shift toward shared telemetry models, where open standards become the norm.</p><p>For software engineering teams, the message is clear: adopt standards like OpenTelemetry and OpenInference now to future-proof your agent observability. This approach preserves optionality, reduces rework, and provides the consistency needed to keep agents in check—even as the stack evolves.</p><p>In the end, the goal is not just to track agents but to enable their responsible and effective operation. With standardized telemetry, enterprises can embrace the composability of modern architectures without sacrificing the visibility that makes production systems reliable.</p>