Commit 3751c19
authored
Ubuntu 26.04 base (ffmpeg 8, ImageMagick 7), Valkey 9, Postgres 18 (v2.7.0) (#68)
* Ubuntu 26.04 base (ffmpeg 8, ImageMagick 7), Valkey 9, Postgres 18 (v2.7.0)
Fixes #67.
Base image moves to ubuntu:26.04: FFmpeg 6.1.1 -> 8.0.1 and ImageMagick
6.9 -> 7.1.2. The app pins Python 3.12 via deadsnakes in a dedicated venv
(26.04 ships 3.14, which psycopg2-binary has no wheels for). The image
checker invokes magick with a convert fallback, the temporal-outlier probe
uses pts_time (pkt_pts_time was removed in newer FFmpeg and silently
disabled that signal), and kernel header packages are purged from the
final image, clearing the unfixable linux-libc-dev CVE tail.
Also fixed: the benign ImageMagick warning gates checked for
"@warning/png.c" but ImageMagick (6 and 7) emits "@ warning/png.c" with a
space, so the benign-classification paths were unreachable; same token
fixed in tools/fix_imagemagick_profile_warnings.py.
docker-compose defaults change to postgres:18-alpine (BREAKING for
existing volumes; the 18+ images also moved the volume mount from
/var/lib/postgresql/data to /var/lib/postgresql) and valkey/valkey:9-alpine
(drop-in; service name and URLs unchanged). A tested 15->18 dump/restore
migration guide is in docs/DOCKER_SETUP.md.
CI gains an image-integration job that builds the Docker image and runs
the real-media parser tests inside it, since the ffmpeg/ImageMagick stderr
parsers fail soft and only break observably against the shipped binaries.
Verified: real-media suite passes inside the new image (10/10, including
corruption detection on ffmpeg 8 / IM7); fresh compose stack on
postgres 18 + valkey 9 scanned 5 samples end-to-end and flagged exactly
the 2 planted corrupt files; 15->18 dump/restore dry-run row counts match;
host suite 475 passed.
* Link migration guide from README docs index; changelog date
* Docs accuracy audit + stop media playback when viewer closes
Media viewer fix: closing the player modal only hid it, so a playing
video or audio file kept playing (and buffering) in the background.
closeModal() now pauses any media in the modal and detaches its sources;
the viewer close button and outside-click both route through it.
Verified in-browser: play, close, playback stops and sources detach for
both video and audio.
Docs audit: every doc was checked against the codebase by parallel
auditors and corrected. Highlights:
- docs/api/README.md and docs/examples/* documented endpoints that never
existed (/api/scan-all, /api/stats/summary, /api/scan/parallel-v2*,
/api/export/csv, /api/cleanup) and omitted authentication; all examples
now call real endpoints with Bearer tokens.
- DOCKER_SETUP.md's example compose would not have booted (celery_app
module, /health healthcheck, missing SECRET_KEY, allkeys-lru eviction);
it now mirrors the real docker-compose.yml.
- CONFIGURATION.md/INSTALLATION.md described a Celery beat and a
four-queue layout that do not exist; replaced with the real APScheduler
jobs and the single pixelprobe queue. CELERY_WORKERS (read nowhere)
corrected to CELERY_CONCURRENCY everywhere.
- PERFORMANCE_TUNING.md rewritten: its entire env-var surface
(MAX_SCAN_WORKERS, BATCH_COMMIT_SIZE, ...) never existed in this code.
- Pool sizes (5+10, not 20+40), session lifetime (24h, not 30 days),
task lists, adaptive chunk tiers, stuck-scan thresholds, module/model
inventories all corrected against source.
- openapi.yaml: removed duplicate /configurations path key and the
nonexistent DELETE /configurations/{id}; schedule scan_type enum now
includes file_changes and orphan; export formats csv/json/pdf only.
- Removed a hardcoded deployment hostname from FIX_INCOMPLETE_SCANS.md.
* Humanizer pass across all documentation
Full-file pass over every doc (README, docs/, docs/api, docs/developer,
docs/examples, docs/maintenance) removing AI-writing patterns while
leaving audited technical facts untouched: significance inflation and
promotional adjectives cut, "What it does / Why needed" bullet walls
rewritten as prose, boilerplate best-practices lists reduced to their
concrete items, duplicate link indexes and say-nothing intros removed,
Unicode arrows in prose replaced with ASCII. Also removed two dead links
into the gitignored docs/development/ directory and fixed list numbering
in TOOLS_AND_SCRIPTS.md. Net 96 lines shorter.1 parent f9c55a7 commit 3751c19
30 files changed
Lines changed: 1054 additions & 883 deletions
File tree
- .github/workflows
- docs
- api
- developer
- examples
- maintenance
- pixelprobe
- static/js
- tests/fixtures/media_samples
- tools
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
57 | 57 | | |
58 | 58 | | |
59 | 59 | | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
5 | 5 | | |
6 | 6 | | |
7 | 7 | | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
8 | 30 | | |
9 | 31 | | |
10 | 32 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
5 | 5 | | |
6 | | - | |
7 | | - | |
8 | | - | |
9 | | - | |
10 | | - | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
11 | 11 | | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
12 | 15 | | |
13 | 16 | | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
19 | 21 | | |
20 | 22 | | |
21 | 23 | | |
| |||
24 | 26 | | |
25 | 27 | | |
26 | 28 | | |
27 | | - | |
| 29 | + | |
28 | 30 | | |
29 | | - | |
30 | | - | |
31 | | - | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
32 | 35 | | |
33 | 36 | | |
34 | 37 | | |
| |||
60 | 63 | | |
61 | 64 | | |
62 | 65 | | |
63 | | - | |
64 | | - | |
65 | | - | |
66 | | - | |
67 | | - | |
68 | | - | |
69 | | - | |
70 | | - | |
71 | | - | |
72 | | - | |
73 | | - | |
74 | | - | |
75 | | - | |
76 | | - | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
77 | 84 | | |
78 | 85 | | |
79 | 86 | | |
80 | 87 | | |
81 | 88 | | |
82 | 89 | | |
83 | | - | |
84 | | - | |
| 90 | + | |
85 | 91 | | |
86 | 92 | | |
87 | 93 | | |
| |||
106 | 112 | | |
107 | 113 | | |
108 | 114 | | |
109 | | - | |
| 115 | + | |
110 | 116 | | |
111 | | - | |
| 117 | + | |
112 | 118 | | |
113 | | - | |
| 119 | + | |
114 | 120 | | |
115 | 121 | | |
116 | | - | |
117 | | - | |
| 122 | + | |
| 123 | + | |
118 | 124 | | |
119 | | - | |
120 | | - | |
| 125 | + | |
| 126 | + | |
121 | 127 | | |
122 | | - | |
123 | | - | |
| 128 | + | |
| 129 | + | |
124 | 130 | | |
125 | 131 | | |
126 | 132 | | |
127 | 133 | | |
128 | 134 | | |
129 | | - | |
130 | 135 | | |
131 | 136 | | |
132 | | - | |
133 | | - | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
134 | 145 | | |
135 | 146 | | |
136 | 147 | | |
| |||
162 | 173 | | |
163 | 174 | | |
164 | 175 | | |
165 | | - | |
| 176 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
32 | 32 | | |
33 | 33 | | |
34 | 34 | | |
35 | | - | |
| 35 | + | |
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
39 | | - | |
| 39 | + | |
40 | 40 | | |
41 | | - | |
| 41 | + | |
42 | 42 | | |
43 | 43 | | |
44 | 44 | | |
45 | 45 | | |
46 | 46 | | |
47 | 47 | | |
48 | | - | |
49 | | - | |
| 48 | + | |
| 49 | + | |
50 | 50 | | |
51 | 51 | | |
52 | 52 | | |
| |||
60 | 60 | | |
61 | 61 | | |
62 | 62 | | |
63 | | - | |
| 63 | + | |
64 | 64 | | |
65 | 65 | | |
66 | 66 | | |
| |||
105 | 105 | | |
106 | 106 | | |
107 | 107 | | |
108 | | - | |
109 | | - | |
110 | | - | |
111 | | - | |
112 | | - | |
| 108 | + | |
113 | 109 | | |
114 | 110 | | |
115 | 111 | | |
| |||
141 | 137 | | |
142 | 138 | | |
143 | 139 | | |
144 | | - | |
| 140 | + | |
145 | 141 | | |
146 | 142 | | |
147 | 143 | | |
| |||
194 | 190 | | |
195 | 191 | | |
196 | 192 | | |
| 193 | + | |
197 | 194 | | |
198 | 195 | | |
199 | 196 | | |
| |||
235 | 232 | | |
236 | 233 | | |
237 | 234 | | |
| 235 | + | |
| 236 | + | |
| 237 | + | |
| 238 | + | |
| 239 | + | |
| 240 | + | |
| 241 | + | |
238 | 242 | | |
239 | 243 | | |
240 | 244 | | |
| |||
243 | 247 | | |
244 | 248 | | |
245 | 249 | | |
| 250 | + | |
246 | 251 | | |
247 | 252 | | |
248 | 253 | | |
| |||
312 | 317 | | |
313 | 318 | | |
314 | 319 | | |
315 | | - | |
316 | | - | |
317 | | - | |
318 | | - | |
319 | | - | |
320 | | - | |
| 320 | + | |
321 | 321 | | |
322 | 322 | | |
323 | 323 | | |
| |||
482 | 482 | | |
483 | 483 | | |
484 | 484 | | |
485 | | - | |
| 485 | + | |
486 | 486 | | |
487 | | - | |
| 487 | + | |
| 488 | + | |
| 489 | + | |
| 490 | + | |
| 491 | + | |
| 492 | + | |
488 | 493 | | |
489 | 494 | | |
490 | 495 | | |
| |||
520 | 525 | | |
521 | 526 | | |
522 | 527 | | |
523 | | - | |
| 528 | + | |
524 | 529 | | |
525 | 530 | | |
526 | 531 | | |
| |||
542 | 547 | | |
543 | 548 | | |
544 | 549 | | |
545 | | - | |
| 550 | + | |
546 | 551 | | |
547 | 552 | | |
548 | 553 | | |
| |||
0 commit comments