OpenTelemetry support for MQTT pub/sub with Application Insights Java agent

Open
#3,625 1 comment 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
25/100
Issue type
Feature
Clarity
Needs clarification
Activity status
Stale
Tech stack
azure, java

Research direction

The issue names no files, tests, or entry points. Begin by identifying where the Java agent handles instrumentation and context propagation for messaging, then define how HiveMQ MQTT publish and subscribe operations should carry correlation data. Done means telemetry can be correlated across Azure and on-premises components without custom application code.

Written by the indexing model from the issue text.

Description

Is your feature request related to a problem? Please describe.
We need to track and correlate telemetry data across a distributed system that spans both Azure-hosted micro-services and on-premises components which some of those use an MQTT broker for pub/sub operations.

Actually we need to be able to correlate telemetry between Azure hosted micro-services (in AKS) which publish data to a on-premises MQTT broker; There are a subscriber on-premises which handles the published messages and implement different actions, which finally end up using other Azure Services (Event Hubs, Cosmos Db...). Our need is to be able to track request started in Azure, with the on-premises actions, and back with the Azure requests.

Describe the solution you would like
Be able to automatically correlate the request originated from the AKS hosted micro-services and on-premises components which already use the Application Insights Java agent among all the stack.

Describe alternatives you have considered
Use new MQTT 5.0 user properties to propagate the operation_id in pub/sub operations, but it requires to introduce custom code where we are already using the Application Insights Java agent.

Additional context
We use Java across all micro-services & components. We currently use Applications insights in both Azure hosted micro-services and on-premises micro-services.

For MQTT pub/sub operations we currently use HiveMQ client and EMQX broker:

EMQX broker can even propagate the operation_id automatically if it is populated to be used within their metrics: https://www.emqx.io/docs/en/latest/observability/open-telemetry/traces.html

Dominant language
Java
Stars
327
Forks
222
Avg merge
22h 34m
Merged PRs (30d)
14

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from microsoft/ApplicationInsights-Java

All issues in microsoft/ApplicationInsights-Java

Similar issues

More Java issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.