4.0.1 merge

[bghira]

This pull request updates documentation across multiple languages to introduce new configuration options and clarify advanced features for data loading and model training. The most significant changes are the addition of the disable_multiline_split option for caption handling in dataloaders, new options for customizing text encoder layers in FLUX.2 models, enhancements for model metadata, expanded validation strategies using datasets, and detailed CREPA regularization scheduling controls.

Data Loader Options:

• Added disable_multiline_split option to dataloader documentation in English (DATALOADER.md), Spanish (DATALOADER.es.md), Portuguese (DATALOADER.pt-BR.md), Hindi (DATALOADER.hi.md), Japanese (DATALOADER.ja.md), and Chinese (DATALOADER.zh.md). This option prevents splitting captions by newlines, useful for preserving intentional line breaks. Updated example configs to include this option. [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12]

Model Training Options:

• Added --custom_text_encoder_intermediary_layers option to Spanish (OPTIONS.es.md) and Hindi (OPTIONS.hi.md) documentation, allowing users to override which hidden state layers are extracted from the text encoder for FLUX.2 models. Includes format, defaults, usage notes, and warnings about cache invalidation. [1] [2]

• Added --modelspec_comment option to Spanish (OPTIONS.es.md) documentation, enabling embedding custom comments into model metadata, visible in external viewers. Supports environment variable substitution and multiple lines. Updated CLI usage and options reference. [1] [2] [3]

Validation and Conditioning:

• Documented new validation strategies in Spanish (OPTIONS.es.md): --validation_using_datasets for img2img validation using training dataset images, and --eval_dataset_id for selecting a specific dataset for evaluation. Includes detailed explanations of conditioning modes, dataset types, and how these options interact.

CREPA Regularization Scheduling:

• Expanded documentation for CREPA regularization in Spanish (OPTIONS.es.md) with new options: --crepa_scheduler, --crepa_warmup_steps, --crepa_decay_steps, --crepa_lambda_end, --crepa_power, --crepa_cutoff_step, --crepa_similarity_threshold, --crepa_similarity_ema_decay, and --crepa_threshold_mode. Includes configuration examples and usage notes for advanced scheduling and stopping criteria. [1] [2]