Skip to content

primary-site-0.0.32

Compare
Choose a tag to compare
@github-actions github-actions released this 12 Oct 21:36
2c2ea54

This introduces a configuration parameter to the stream service called BUFFER_CONNECTIONS_THRESHOLD. When set to a non-negative number, this will cause the query executor to buffer storage connections ahead of time when more than $THRESHOLD logical streams must be merged in the plan. This will have the effect of smoothing throughput from the service, at the cost of double the memory consumption for the affected requests. The impact of the change will be most noticeable for requests that merge a large number of topics. Users who wish to experiment with this feature can experiment with values to find a balance that is helpful for painful queries but doesn't increase memory for non-painful ones.

The default value for this setting is currently -1, meaning no behavior change by default. It is likely a release in the near future will pick a nonzero default based on learnings from this one. Users not experience problems can simply wait until then to receive the change.