Telemetry: add an in-process span sink

Python SDK の TelemetryConfig と CopilotClient のテレメトリ設定から始め、既存の otlp-http および file の span パスを追跡します。ホストから提供される exporter または callback が、プロセス内でどのように span とリソースを受け取るかを定義します。完了の条件は、CLI のモデル span とツール span が、ループバックサーバーや 2 つ目の exporter なしで、ホストの既存の OpenTelemetry パイプラインを使用できることです。

TelemetryConfig supports otlp-http and file. Both send spans out of the process. If the app embedding the SDK already has an OpenTelemetry pipeline set up, there's no way to plug the CLI's spans straight into it.

Our stack is Microsoft Agent Framework on top of the Python SDK, running as an Azure AI Foundry hosted agent. The service sets up an OpenTelemetry tracer provider that exports to Azure Monitor, so host-side spans like agent invocations and tool execution land in Application Insights. The CLI's model and tool calls don't, since its spans have nowhere to go except back out over OTLP.

To get them in, we start a loopback HTTP server on an ephemeral port, point otlp_endpoint at it, decode the OTLP/JSON, and pass each span to the tracer provider the service already has. It works, but it's an HTTP server and a decoder just to move spans between two objects in the same process.

A sidecar collector was the other option we tried. It means a second exporter and resource to configure, and it doesn't help when running locally.

What would help

Some way to receive the spans in-process. A callback, or an exporter instance supplied by the host:

CopilotClient(telemetry={"exporter": my_span_exporter})

The exact API doesn't matter much to us. What we want is for the CLI's spans to go through the exporter and resource the host already has, instead of a second pipeline alongside it.