Missing transaction traces and mislabeling of POST and other requests

[SebastianSidortschuck]

Description

When using this extension we consistently get errors in the newrelic_agent.log and all of our POST (and some GET/OPTIONS) requests are mislabeled as Non-Web and are missing the instrumentation, showing Application code in (ROOT) or no transactions at all

Steps to Reproduce

Our setup:

• ktor 2.3.11
• Kotlin 2.0.0
• newrelic-kotlin-coroutines v1.0.2
• newrelic-kotlin-ktor 1.0
• java-agent current

Expected Behavior

POST and other mislabeled requests being handled as web requests and containing the full trace information

Relevant Logs / Console output

Missing transaction trace:

Mislabeled

Logs

2024-07-11T15:10:52,430+0000 [1918 1] com.newrelic INFO: JRE vendor Amazon.com Inc. version 17.0.7
2024-07-11T15:10:52,430+0000 [1918 1] com.newrelic INFO: JVM vendor Amazon.com Inc. OpenJDK 64-Bit Server VM version 17.0.7+7-LTS
2024-07-11T15:10:52,431+0000 [1918 1] com.newrelic INFO: OS Linux version 4.14.314-237.533.amzn2.aarch64 arch aarch64
2024-07-11T15:10:52,431+0000 [1918 1] com.newrelic INFO: New Relic Agent v8.12.0 is initializing...

2024-07-11T15:35:03,357+0000 [1918 74] com.newrelic ERROR: Tracer Debug: Inconsistent state! tracer (actual tracer popped off stack) != lastTracer (pointer to top of stack) for com.newrelic.agent.TransactionActivity@1 (com.newrelic.agent.tracers.DefaultTracer@1eb16436 != com.newrelic.agent.tracers.DefaultTracer@61c6bc18)
2024-07-11T15:35:03,357+0000 [1918 74] com.newrelic ERROR: Tracer Debug: Inconsistent state! tracer (actual tracer popped off stack) != lastTracer (pointer to top of stack) for com.newrelic.agent.TransactionActivity@1 (com.newrelic.agent.tracers.OtherRootTracer@64058656 != com.newrelic.agent.tracers.DefaultTracer@61c6bc18)

2024-07-02T11:48:08,622+0200 [482499 1] com.newrelic INFO: JRE vendor Amazon.com Inc. version 17.0.8.1
2024-07-02T11:48:08,622+0200 [482499 1] com.newrelic INFO: JVM vendor Amazon.com Inc. OpenJDK 64-Bit Server VM version 17.0.8.1+8-LTS
2024-07-02T11:48:08,622+0200 [482499 1] com.newrelic INFO: OS Linux version 6.6.32-1-MANJARO arch amd64
2024-07-02T11:48:08,622+0200 [482499 1] com.newrelic INFO: New Relic Agent v8.12.0 is initializing...

2024-07-02T11:50:01,146+0200 [482499 89] com.newrelic ERROR: Tracer Debug: Inconsistent state! tracer (actual tracer popped off stack) != lastTracer (pointer to top of stack) for com.newrelic.agent.TransactionActivity@7fffffff (com.newrelic.agent.tracers.OtherRootTracer@d75d02a != com.newrelic.agent.tracers.DefaultTracer@6888c6bb)
2024-07-02T11:50:01,154+0200 [482499 89] com.newrelic ERROR: Tracer Debug: An error occurred calling Transaction.tracerFinished() for class com.newrelic.instrumentation.kotlin.coroutines_17.NRContinuationWrapper : java.lang.NullPointerException: Cannot invoke "com.newrelic.agent.Transaction.activityFailedOrIgnored(com.newrelic.agent.TransactionActivity, int)" because "this.transaction" is null : this Tracer = com.newrelic.agent.tracers.OtherRootTracer@d75d02a
2024-07-02T11:51:01,293+0200 [482499 88] com.newrelic ERROR: Tracer Debug: Inconsistent state! tracer (actual tracer popped off stack) != lastTracer (pointer to top of stack) for com.newrelic.agent.TransactionActivity@7fffffff (com.newrelic.agent.tracers.OtherRootTracer@5481ebf0 != com.newrelic.agent.tracers.DefaultTracer@20fb9e6a)
2024-07-02T11:51:01,293+0200 [482499 60] com.newrelic ERROR: Tracer Debug: Inconsistent state! tracer (actual tracer popped off stack) != lastTracer (pointer to top of stack) for com.newrelic.agent.TransactionActivity@7fffffff (com.newrelic.agent.tracers.OtherRootTracer@3e6295a9 != com.newrelic.agent.tracers.DefaultTracer@c997983)
2024-07-02T11:51:01,294+0200 [482499 60] com.newrelic ERROR: Tracer Debug: An error occurred calling Transaction.tracerFinished() for class com.newrelic.instrumentation.kotlin.coroutines_17.NRContinuationWrapper : java.lang.NullPointerException: Cannot invoke "com.newrelic.agent.Transaction.activityFailedOrIgnored(com.newrelic.agent.TransactionActivity, int)" because "this.transaction" is null : this Tracer = com.newrelic.agent.tracers.OtherRootTracer@3e6295a9
2024-07-02T11:51:01,294+0200 [482499 88] com.newrelic ERROR: Tracer Debug: An error occurred calling Transaction.tracerFinished() for class kotlinx.coroutines.internal.LimitedDispatcher$Worker : java.lang.NullPointerException: Cannot invoke "com.newrelic.agent.Transaction.activityFailedOrIgnored(com.newrelic.agent.TransactionActivity, int)" because "this.transaction" is null : this Tracer = com.newrelic.agent.tracers.OtherRootTracer@5481ebf0
2024-07-02T11:51:01,294+0200 [482499 60] com.newrelic ERROR: Tracer Debug: Inconsistent state! tracer (actual tracer popped off stack) != lastTracer (pointer to top of stack) for com.newrelic.agent.TransactionActivity@7fffffff (com.newrelic.agent.tracers.OtherRootTracer@63214695 != com.newrelic.agent.tracers.DefaultTracer@394134b2)

Your Environment

Errors happening locally (Manjaro Linux) and on EC2 (running Amazon Linux 2, Graviton).

Additional context

Discussed this already with the Solutions Consultant and they're aware of the problem and have a link to one of the applications that has this issue

[dhilpipre]

Thanks for opening this issue. We are working on getting it resolved and will let you know once we have it fixed.

[dhilpipre]

Sorry for the delay but we have finally been able to sort this issue out. Please install Release V2.0.0