Random notes, reasoning, scenarios

Jump to bottom

Peter Wilcsinszky edited this page Apr 4, 2024 · 3 revisions

Aggregator model

Loki learnings

Kubernetes labels are flattened into resource attributes. How to extract them back to the original key/value properly and add them automatically as loki index/label?
How to add tenant header to messages dynamically? https://github.com/springernature/o11y-otel-contextprocessor/blob/main/otelcol-dev/contextprocessor/README.md#usage

Reasons for why the aggregator model is still needed

Lots of outputs with large disk space requirements
Lots of CPU heavy computation
Large, hard to manage config

Aggregator problem space

Immutable configuration
Flexible configuration - let everything to be configured, do not stand in the way
Secure credentials
Automatic secure connections