Database schema changes 2024-2025

[michaelsproul]

Description

This is a meta-issue for scheduling database schema changes in Lighthouse.

The Lighthouse v5.2.0 schema was v19.

v20 was:

• Electra: Remaining Consensus Data Structures #5712

v21 was (released in Lighthouse v5.3.0):

• Store pubkey cache decompressed on disk #5897

v22 was:

• Hierarchical state diffs #5978

v23 is:

• Drop head tracker for summaries DAG #6744

v24 is:

• Hierarchical state diffs in hot DB #6750

v25 is:

• Remove all prod eth1 related code #7133

v26 is:

• Cleaning up on-disk Fusaka data accidentally stored pre-Fusaka (@jimmygchen)
• Custody persist fix #7661

v27 is

• Data column custody info #7648

v28 is:

• Slim down PersistedForkChoice #7760

Later:

• feat(beacon_node/beacon_chain): Removed DataColumnInfo #7624

Future versions:

• Linear blocks
• HotStateSummary cleanup + CompactBeaconState. TODO: do it without ValidatorTrait.
• Abolish BlobInfo

[michaelsproul]

Something else to consider is that we already used some of the versions in this range for preliminary tree-states releases. The latest being v24 which will not be compatible with the final v24 envisioned here. Maybe we could skip a few numbers to avoid confusion

[michaelsproul]

I've added V28 for the fork choice slimdown, which I am working on as part of:

• Slim down PersistedForkChoice #7760