Back to work

AI is running.Is it working?

Telemetry, evaluation, and integration work to help teams understand what their AI was costing and how well it was performing.

Intern · Tech Strategy & ExecutionJUN — AUG 2026 · COMPLETED
20+Teams / business units in scope
5Highest-spending orgs in discovery
01 / THE SITUATION

Start with the
actual problem.

AI activity was spread across teams with different pipelines, workloads, and definitions of success. Cost alone could not tell the full story. Teams needed useful signals about usage and output quality, and leadership needed a shared view that made those signals comparable.

02 / THE DECISIONS

The work behind
the outcome.

01

Start with a shared data contract.

I worked across teams to define common AI delivery metrics. Consistent contracts helped turn different implementations into useful reporting without pretending every team worked the same way.

02

Connect usage to quality.

I built Python telemetry ingestion and LLM payload parsing for token usage, latency, and throughput. Quality and drift flagging, together with human-review tooling, added context to the cost picture.

03

Meet each team where it already worked.

Discovery and governance involved the five highest-spending organizations. Integration wrappers and middleware addressed differences in schemas, rate limits, and regional compute boundaries.

03 / THE SYSTEM

How the pieces connect.

Explanatory system view · reconstructed from the project

04 / MY CONTRIBUTION

Hands on.
People with me.

I contributed the ingestion, parsing, flagging, and review tooling, including a React reporting interface. I also worked with infrastructure and partner teams to resolve integration issues and make the metrics useful across organizational boundaries.

PythonLLM telemetryScikit-learnReactData contractsHuman review
05 / WHAT CHANGED

What came out of it.

The work spanned 20+ teams and business units, with focused discovery and governance involving the five highest-spending internal organizations. It brought resource tracking and quality signals into reporting that could inform decisions about AI deployments.

CONTEXT & LIMITS

The organizational scope describes the breadth of the work. It is not a count of independently verified services or deployments, and no specific dollar savings are claimed here. The internship ended in August 2026.

KEEP GOING / 04

Lori Comunica

A better way to be understood.