Lower the interval that traces are sent for integration testing purpose

[wimdeblauwe-volvo]

I am using the Spring Boot starter. I am also using Testcontainers and the grafana/otel-lgtm:latest Docker image for integration tests. I wrote 3 tests to ensure metrics, logs and traces are working by querying Grafana. My traces related test is slow because it always seem to take 10 seconds before Grafana reports that there are traces. Is there any way to speed this up? I tried setting otel.exporter.otlp.timeout to 1000 for example in my Spring Boot application yaml file, but that did not seem to help. I also tried with otel.exporter.otlp.traces.timeout, but that also did not help. Is there anything else I can try?

[jaydeluca]

sounds like a pretty cool setup. I believe the timeout configs you reference are more related to the length of time the exporter will wait for the requests involved in the exporting to complete before giving up, as opposed to controlling the interval in which it exports.

You could try lowering the batch span processor delay: otel.bsp.schedule.delay, which defaults to 5s.

[wimdeblauwe-volvo]

Thank you for your quick reply, but unfortunately, it does not seem to change anything.

[jaydeluca]

are you sure that the latency is occurring within the control of the tracer? Perhaps there is a delay in the grafana tempo pipeline? I am not as familiar with that tooling but looking at the docs it appears that tempo has a wait period of 10s before it flushes spans. It might be worth seeing if you can adjust that configuration and see if it makes a difference.

[wimdeblauwe-volvo]

Thanks for the tip. I have asked a question if it is possible to change that setting when using the docker image here.

[laurit]

cc @zeitlinger

[zeitlinger]

Closing in favor of grafana/docker-otel-lgtm#427