URLHAUS Custom DB Validation Loop Causes Excessive HTTP Requests

[The-Real-Admin-Guy]

Title: URLHAUS Custom DB Validation Loop Causes Excessive HTTP Requests

Summary: During freshclam updates, urlhaus.abuse.ch is queried 15-20 times
in rapid succession despite receiving HTTP 304 (Not Modified) after the first
successful update.

Deleting extra entries, simply re introduces them next time clamui is run.

Evidence:

• Log files from every updates (manual) and auto
• CPU spike correlation (80% on 16-core system during scans)
• Request pattern: 1× HTTP 200, then 15-20× HTTP 304 in same second

Expected Behavior: Single validation check after successful download
Actual Behavior: Tight loop re-validating unchanged file

[Pdzly]

Interesting, i never encountered this. Can you please let me know your system info ( like distro, type (flatpak, source or deb?...))

During scanning it is normal to encounter cpu spikes as it is scanning through many many files at quick succession. I am not sure if there is any "eco" mode with less cpu usage. But i only detect hard cpu spikes with clamscan, clamdaemon handles it a bit better.

[Pdzly]

@The-Real-Admin-Guy sry for deleting your comment but the logs show scan paths and i dont want that data to be public i need to refactor this to be redacting user data i will remedy this asap to fix this. But i think i know why the initial issue happened

[The-Real-Admin-Guy]

Ah... Inner workings shy?
Alright.
Keep me posted!

You are doing a great job by the way. I really like ClamUI,
I think it has great potential to be the best of it's kind in the penguin space!

Feel free to ask if you need anything else on my end...

Good work!

[Pdzly]

Thanks i think i already have a fix for it.