Commit c83652b
committed
Simplify: deduplicate sendControlMessage, HashMap over ConcurrentHashMap,
rename test
Code review findings:
- VeniceWriter: make 5-param sendControlMessage delegate to 6-param overload,
eliminating duplicated getDebugInfo/isEndOfSegment/synchronized logic
- MapLongAccumulator: ConcurrentHashMap → HashMap — Spark tasks are
single-threaded (each gets a fresh copy()), no concurrent access occurs
- MRJobCounterHelperTest: rename misleading test to reflect what it actually
tests (counter retrieval round-trip, not Reporter-based increment)1 parent 0acc746 commit c83652b
3 files changed
Lines changed: 9 additions & 22 deletions
File tree
- clients/venice-push-job/src
- main/java/com/linkedin/venice/spark/datawriter/task
- test/java/com/linkedin/venice/hadoop/mapreduce/counter
- internal/venice-common/src/main/java/com/linkedin/venice/writer
Lines changed: 5 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | 3 | | |
| 4 | + | |
4 | 5 | | |
5 | | - | |
6 | 6 | | |
7 | 7 | | |
8 | 8 | | |
9 | 9 | | |
10 | 10 | | |
11 | 11 | | |
12 | 12 | | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
13 | 16 | | |
14 | 17 | | |
15 | 18 | | |
16 | 19 | | |
17 | | - | |
| 20 | + | |
18 | 21 | | |
19 | 22 | | |
20 | 23 | | |
| |||
Lines changed: 1 addition & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
33 | 33 | | |
34 | 34 | | |
35 | 35 | | |
36 | | - | |
37 | | - | |
38 | | - | |
| 36 | + | |
39 | 37 | | |
40 | 38 | | |
41 | 39 | | |
| |||
Lines changed: 3 additions & 17 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2277 | 2277 | | |
2278 | 2278 | | |
2279 | 2279 | | |
2280 | | - | |
2281 | | - | |
2282 | | - | |
2283 | | - | |
2284 | | - | |
2285 | | - | |
2286 | | - | |
2287 | | - | |
2288 | | - | |
2289 | | - | |
2290 | | - | |
2291 | | - | |
2292 | | - | |
2293 | | - | |
2294 | | - | |
2295 | | - | |
2296 | | - | |
| 2280 | + | |
2297 | 2281 | | |
2298 | 2282 | | |
2299 | 2283 | | |
| |||
2303 | 2287 | | |
2304 | 2288 | | |
2305 | 2289 | | |
| 2290 | + | |
| 2291 | + | |
2306 | 2292 | | |
2307 | 2293 | | |
2308 | 2294 | | |
| |||
0 commit comments