Api speed improvements

[dtdannen]

No description provided.

[Copilot]

Pull Request Overview

This PR introduces several enhancements aimed at improving API speed and overall application performance. Key changes include:

• New utility scripts for processing and analyzing DVM events.
• Updates to the frontend API polling intervals from 1 second to 60 seconds.
• Enhancements in API caching and logging configuration, including a memory-aware cache implementation.

Reviewed Changes

Copilot reviewed 14 out of 14 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
utility/publish_dvm_announcement_to_nostr.py	New utility script for publishing DVM announcements to Nostr.
utility/count_unique_dvm_authors.py	New script to count unique DVM authors using batch processing.
utility/count_raw_events.py	New script to count total rows in the raw_events table.
utility/count_events_by_kind.py	New script to generate AsciiDoc output of event counts by kind.
frontend/dvmdash-frontend/lib/api.ts	Updated API refresh intervals for improved performance.
api/src/main.py	Enhancements in caching, logging configuration, and API endpoints.
api/requirements.txt	Added cachetools dependency.
api/logging_config.json	New logging configuration for Uvicorn.
api/Dockerfile.local & api/Dockerfile	Updated CMD to use the new log configuration.

Comments suppressed due to low confidence (1)

api/src/main.py:74

• The eviction condition uses CACHE_GB_LIMIT which is set to 1.0, making the condition equivalent to checking if self.memory_usage + size_estimate exceeds self.memory_threshold. Consider clarifying the intended logic or updating the constant to better reflect the desired eviction threshold.

if (self.memory_usage + size_estimate > CACHE_GB_LIMIT * self.memory_threshold):

[dtdannen]

There's also some utility scripts for generating documentation in this PR as well.