Enable file caching in GCSFuse to fix WTV timeouts #938
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Please prefix your pull request with one of the following: [FEATURE] [FIX] [IMPROVEMENT].
In raising this pull request, I confirm the following (please check boxes):
My familiarity with the project is as follows (check one):
Few WTV files were randomly timing out in tests. Apparently WTV files do a lot of file seeks and as a consequence, each seek attempt triggers an API request to fetch the data at the specified location. I'm guessing the large number of seeks was hitting some kind of internal API rate-limit causing the test to timeout.
This PR migrates GCSFuse to the latest version (to support parallel downloads) and enables local file caching which means that seeks need not trigger new API requests.