-
Notifications
You must be signed in to change notification settings - Fork 834
Parquet Store gateway #7046
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Parquet Store gateway #7046
Conversation
27d4ca3 to
7ab5bc7
Compare
docs/blocks-storage/store-gateway.md
Outdated
| # Minimum time to wait for ring stability at startup. 0 to disable. | ||
| # CLI flag: -store-gateway.sharding-ring.wait-stability-min-duration | ||
| [wait_stability_min_duration: <duration> | default = 1m] | ||
| [wait_stability_min_duration: <duration> | default = 0s] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This change should be removed
docs/blocks-storage/store-gateway.md
Outdated
| # start anyway. | ||
| # CLI flag: -store-gateway.sharding-ring.wait-stability-max-duration | ||
| [wait_stability_max_duration: <duration> | default = 5m] | ||
| [wait_stability_max_duration: <duration> | default = 5s] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This change should be removed
| assert.Empty(t, warnings) | ||
| } | ||
|
|
||
| //func TestParquetBucketStores_Series_ShouldNotCheckMaxInflightRequestsIfTheLimitIsDisabled(t *testing.T) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we want to keep this
| assert.Equal(t, codes.InvalidArgument, s.Code()) | ||
| } | ||
|
|
||
| func TestChunkToStoreEncoding(t *testing.T) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This test seems irrelevant?
integration/parquet_gateway_test.go
Outdated
| cortex_testutil "github.com/cortexproject/cortex/pkg/util/test" | ||
| ) | ||
|
|
||
| func TestParquetGatewayWithBlocksStorageRunningInMicroservicesMode(t *testing.T) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I would prefer reusing the existing store gateway integration test instead of creating a new parquet gateway test. This adds a lot of duplicated code
|
@yeya24 |
|
Can u please update the PR title and description? |
d1c6d11 to
773cfb4
Compare
Signed-off-by: yeya24 <[email protected]>
Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: SungJin1212 <[email protected]>
Signed-off-by: SungJin1212 <[email protected]>
d0d3dae to
336be55
Compare
Signed-off-by: SungJin1212 <[email protected]>
336be55 to
553e4ea
Compare
This PR introduces a new parquet mode for the Store Gateway. In this initial version, the mode operates statelessly and does not perform operations such as block syncing. The primary improvement is to enhance cache utilization by leveraging the Store Gateway's block affinity.
Which issue(s) this PR fixes:
Fixes #6940
Checklist
CHANGELOG.mdupdated - the order of entries should be[CHANGE],[FEATURE],[ENHANCEMENT],[BUGFIX]