Filter based on package logs send by the agent (3.7.2) to Application Insight
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 25/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Stale
- Domain
- cloud, observability
Research direction
Start by reviewing the instrumentation.logging section and the metric-filter processor, the two configuration paths named in the issue. Define package-level filtering for logs sent by the agent, then verify that unwanted third-party package logs can be excluded without suppressing the application's own logs.
Written by the indexing model from the issue text.
Description
I have a lot of logs generated by 3rd party libraries in my application, which I do not need to have ingested into Application Insights, and those logs generate significant costs on Application Insights. Currently it is only possible to set global log level threshold, which is not sufficient, because the unwanted logs are either INFO or WARN, so to exclude them I would need to exclude also the logs from my application, which makes this solution useless.
In my current scenario I am running a Scala 2.12 Spark application on Azure Databricks runtime 16.3 as a jar task instrumented with -javaagent (agent version 3.7.2) parameter through spark config and APPLICATIONINSIGHTS_CONNECTION_STRING environment variable, and getting a lot of com.databricks.* and org.apache.spark.* logs. But this feature would be applicable to any other scenario.
I would like to be able to filter/configure logs that are send to Application Insight by the agent on package level.
This could be configured either in the instrumentation.logging section or as a log procesor in similar fashion to the metric-filter processor.
- Dominant language
- Java
- Stars
- 327
- Forks
- 222
- Avg merge
- 22h 34m
- Merged PRs (30d)
- 14
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from microsoft/ApplicationInsights-Java
-
microsoft/ApplicationInsights-Java#4851 · 1 assignee ·
-
Difficulty 4/5 3-5 days Newbie friendliness 45/100
microsoft/ApplicationInsights-Java#4817 · 1 comment ·
-
Difficulty 4/5 3-5 days Newbie friendliness 42/100
microsoft/ApplicationInsights-Java#4770 · 2 comments ·
-
Difficulty 5/5 Over a week Newbie friendliness 30/100
microsoft/ApplicationInsights-Java#4769 · 2 comments ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
microsoft/ApplicationInsights-Java#4729 · 121 comments ·
All issues in microsoft/ApplicationInsights-Java
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
elastic/gradle-plugins#157 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
cryptomator/hub#497 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
johanhaleby/occurrent#1120 ·