DBR 12.2 LTS l4jv2 - LA_SPARKMETRIC_REGEX does not filter logs

[cf-szywko]

Dear Sir or Madam
I have problem with filter logs using spark monitoring library. I have added export LA_SPARKMETRIC_REGEX="app." to init script. But it looks like it does not work. Spark logs a lot of internal logs which I do not want to publish to loganalytics.
I want to filter out logs based on:
logger name

  "log.level": {
    "$resolver": "level",
    "field": "name"
  },

or
application id
"applicationId": "${spark:spark.app.id:-}",
or based on anything else if it is possible. I am open to modify source code if needed.
Filter logs on loganatlytics level is not possible for me.
Databricks runtime 12.2 LTS,
Used branch: l4jv2

[cf-szywko]

Hi please any help.

[cf-szywko]

Do we have anybody here?

[hallihan]

Please reach out to the contact listed in the README if you still need assistance. https://github.com/mspnp/spark-monitoring/tree/l4jv2#monitoring-azure-databricks-in-an-azure-log-analytics-workspace