Increase logging verbosity and fix grpc issues #13

chenj-hub · 2024-10-21T15:12:30Z

Allow increased logging verbosity
Downgrade grpc to fix previous regression in buildfarm 2.6.0

Worker loss can signal cascading failure and shutdown for execute-only peers. Ensure that a ReportResultStage seeing an SRE does not close the stage, and that there are basic retries for remote uploads.

Works with current redis-py-cluster 2.1.3

Fixes buildfarm#1403

Prevents a hang on shutdown when redis is disconnected

Use the proper name for a status code as presented when the read will not be retried.

Remediating https://nvd.nist.gov/vuln/detail/CVE-2023-2976

Fixes buildfarm#1421

Update platforms

* Add download metrics for buildfarm:worker * Run formatter * remove static * change IO_METRIC prometheus counter to static

* Separate channel for write api * shutdown channel on termination

* Fix deadlock by setting a timeout and removing the lock. * remove timeout as its not necessary * lint: delete unused import

Interactions with RemoteCasWriter which declare IOExceptions should throw them exclusively for failures.

JCenter is retired. Pick some mirrors from https://repo.maven.apache.org/maven2/.meta/repository-metadata.xml

Fixes buildfarm#1447

Specifying --prometheus_port for either server or worker will: Override the config value if delivered as int > 0, otherwise leave the config value alone. Since prometheusPort as configured <= 0 disables the server, this permits users to specify '0' to override the config with a disable switch. Updated quick_start docs to reflect this extra parameter.

…es (buildfarm#1444) Co-authored-by: Trevor Hickey <[email protected]>

Support "rediss://" (extra 's', like https) to indicate Redis-SSL connections. For Redis client identifier, we use the `identifier` passed to RedisShardBackplane.

Specify and patch more recent rules_go and bazel_gazelle per upstream patch. Docker images work with recent HEAD releases of bazel as a result. Depends on buildfarm#1453 resolution to actually build //... Fixes buildfarm#1440

Any '.' appearance as a segment should be considered to be the current directory in the search sequence of a working_directory path.

Method setExecuteResponseBuilder is not called in OperationContext

The cost in size for a single table bidirectional index is vast compared to the use of 3nf integer keys. Experimental estimates offer a decrease in file size of 90%.

…ations (buildfarm#1462)

This reverts commit f651cdb.

…s-fork

…to-v2.6.1

This reverts commit 95719e5.

amishra-u and others added 30 commits July 3, 2023 12:27

Fix: custom latency buckets buildfarm#1376 (buildfarm#1396)

a9936f0

Supply a basic retrier to remote cas writes

f74f270

Worker loss can signal cascading failure and shutdown for execute-only peers. Ensure that a ReportResultStage seeing an SRE does not close the stage, and that there are basic retries for remote uploads.

Update buildfarm-indexer for upstream updates

f7eb74a

Works with current redis-py-cluster 2.1.3

Commonize grpc createChannel with TLS selection

f893b5a

Refactor findMissingBlobs method

70903df

incorporate feedback

68318c5

Upgrade grpc repo/maven deps for java_common

95719e5

Fixes buildfarm#1403

Shut down prometheus collector thread on CFC stop

abcd8fc

Prevents a hang on shutdown when redis is disconnected

Output status code name on shard read error

9b4bd6f

Use the proper name for a status code as presented when the read will not be retried.

Reduce log levels to make log files more meaningful (buildfarm#1414)

8710642

Fix io_bytes_read metrics for buildfarm:server

8315723

chore(deps): bump Guava from 31.1-jre to 32.1.1-jre

77fee77

Remediating https://nvd.nist.gov/vuln/detail/CVE-2023-2976

Upgrade opentelemetry javaagent to 1.28

b5754e4

Update platforms

9e7e633

Fixes buildfarm#1421

Merge pull request buildfarm#1422 from keith/ks/update-platforms

ae907b5

Update platforms

Add download rate metrics for buildfarm:worker (buildfarm#1418)

18ae72e

* Add download metrics for buildfarm:worker * Run formatter * remove static * change IO_METRIC prometheus counter to static

Add request metadata interceptor to Worker (buildfarm#1425)

1180a85

Separate channel for write api (buildfarm#1424)

8795c6e

* Separate channel for write api * shutdown channel on termination

fix docu CAS config (buildfarm#1432)

0abb176

Fix deadlock when handling Write request (buildfarm#1442)

882e86f

* Fix deadlock by setting a timeout and removing the lock. * remove timeout as its not necessary * lint: delete unused import

Deliver RemoteCasWriter IOExceptions (buildfarm#1438)

773341c

Interactions with RemoteCasWriter which declare IOExceptions should throw them exclusively for failures.

build: update maven mirrors

20d4ae5

JCenter is retired. Pick some mirrors from https://repo.maven.apache.org/maven2/.meta/repository-metadata.xml

Add production-ready helm chart for deploying buildfarm on k8s

a7f1ac2

Update quick_start.md

dfe9d3d

Fixes buildfarm#1447

[metrics] Emit operation_exit_code metric to track execution exit cod…

fb7cbd8

…es (buildfarm#1444) Co-authored-by: Trevor Hickey <[email protected]>

feat(redis): support rediss:// URIs for Redis-SSL

a6fe207

Support "rediss://" (extra 's', like https) to indicate Redis-SSL connections. For Redis client identifier, we use the `identifier` passed to RedisShardBackplane.

chore: make code more readable

79eee49

Update rules_docker dependencies via injection

3305669

Specify and patch more recent rules_go and bazel_gazelle per upstream patch. Docker images work with recent HEAD releases of bazel as a result. Depends on buildfarm#1453 resolution to actually build //... Fixes buildfarm#1440

Treat '.' working_directory segment as current

7f86c47

Any '.' appearance as a segment should be considered to be the current directory in the search sequence of a working_directory path.

werkt and others added 10 commits September 25, 2023 13:34

Remove unused setExecuteResponseBuilder

90439ca

Method setExecuteResponseBuilder is not called in OperationContext

Log on write errors

8cc247f

Use integer ids for Sqlite bidirectional index

f651cdb

The cost in size for a single table bidirectional index is vast compared to the use of 3nf integer keys. Experimental estimates offer a decrease in file size of 90%.

Update graceful shutdown functionality to better handle worker termin…

9f93972

…ations (buildfarm#1462)

Revert "Use integer ids for Sqlite bidirectional index"

fe5fc19

This reverts commit f651cdb.

Merge commit 'fe5fc198c4b29f363f00d57149f63f5bbb962fd8' into bazel-io…

b585478

…s-fork

Add back Autowired for Spring

ee77a49

Merge pull request #9 from bazel-ios/jackies/upgrade-bazel-buildfarm-…

032f18e

…to-v2.6.1

Point at different logging config

337053c

Revert "Upgrade grpc repo/maven deps for java_common"

e286f1c

This reverts commit 95719e5.

chenj-hub changed the title ~~Jackies/increase log verbosity~~ Increase logging verbosity and fix grpc issues Oct 21, 2024

congt force-pushed the bazel-ios-fork branch from 0ad72d3 to d80cf31 Compare August 24, 2025 23:25

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Increase logging verbosity and fix grpc issues #13

Increase logging verbosity and fix grpc issues #13

Uh oh!

chenj-hub commented Oct 21, 2024 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

11 participants

Increase logging verbosity and fix grpc issues #13

Are you sure you want to change the base?

Increase logging verbosity and fix grpc issues #13

Uh oh!

Conversation

chenj-hub commented Oct 21, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

11 participants

chenj-hub commented Oct 21, 2024 •

edited

Loading