Skip to content

Rework configuration for frequency of training artifacts #898

@grassesi

Description

@grassesi

Is your feature request related to a problem? Please describe.

It is useful to modify the checkpoint frequency and terminal output frequency when working on toy problems for testing and debugging purposes.

Describe the solution you'd like

Add configuration parameters for controlling the frequency checkpointing and console writing during training. It makes sense to group them together with the existing parameter for controlling calculation and logging of training metrics. The suggest parameters would be:
log_intervals

  • metrics
  • checkpoint
  • terminal

A temporary backward compatibility mechanism has to be implemented to allow finetuning/inference on runs that dont have the new/changed configuration parameters.

Describe alternatives you've considered

No response

Additional context

No response

Organisation

JSC

Metadata

Metadata

Assignees

Labels

infraIssues related to infrastructure

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions