Skip to content

Conversation

@ueli-g
Copy link

@ueli-g ueli-g commented Oct 1, 2024

Documentation to go with fluent/fluent-bit#9427

This removes a defined prefix from measurement names which might otherwise be shared between many measurements in the same data bucket. Compatibility is not affected, default behavior (with documented default strip_prefix "") is to strip zero character from the front which identical to the existing mechanism.

When writing to a range of different buckets, routing to the corresponding out_influxdb instances happens on tag matches. This change allows to match on tag prefixes, but strip them from the measurement name. This avoids having identical prefixes for all measurement names in the same data bucket.

To achieve this, read from char tag[] with an offset when writing the measurement name, provided the prefix matches the tag completely and the overlap is at most tag_length - 1 characters.

@patrick-stephens
Copy link
Contributor

@fluent/chronosphere-tech-writers should we be ensuring we add YAML config as well now always?

@eschabell eschabell self-assigned this Oct 22, 2025
@eschabell eschabell requested a review from esmerel October 22, 2025 00:17
@eschabell eschabell added waiting-for-user Waiting for user/contributors feedback or requested changes conflict Waiting on conflict to be resolved by contributor waiting-on-review Waiting on a review from mainteners labels Oct 22, 2025
@eschabell
Copy link
Collaborator

@esmerel can you review please, but leave open as code PR fluent/fluent-bit#9427 must merge first and is still open.

@eschabell
Copy link
Collaborator

eschabell commented Oct 22, 2025

@ueli-g can you resolve the conflicts and provide YAML config example (if you need help with that, happy to provide)? I also nudged you on the code PR fluent/fluent-bit#9427

@esmerel
Copy link
Contributor

esmerel commented Oct 22, 2025

I fixed the merge conflicts and made review updates while I was fixing it since I was already in there.

@esmerel esmerel added waiting-on-code-merge and removed conflict Waiting on conflict to be resolved by contributor waiting-on-code-merge waiting-for-user Waiting for user/contributors feedback or requested changes waiting-on-review Waiting on a review from mainteners labels Oct 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants