Name		Name	Last commit message	Last commit date
Latest commit History 116 Commits
.gitignore		.gitignore
01_train.py		01_train.py
1model-twice-first-layer-shared-embeddings.csv		1model-twice-first-layer-shared-embeddings.csv
1model-twice-no-first-layer-shared-embeddings.csv		1model-twice-no-first-layer-shared-embeddings.csv
2_train_with_model_merging.py		2_train_with_model_merging.py
2_train_with_model_merging.sh		2_train_with_model_merging.sh
2models-first-layer-shared-embeddings.csv		2models-first-layer-shared-embeddings.csv
2models-first-layer.csv		2models-first-layer.csv
2models-no-first-layer-shared-embeddings.csv		2models-no-first-layer-shared-embeddings.csv
2models-no-first-layer.csv		2models-no-first-layer.csv
LICENSE		LICENSE
README.md		README.md
ablations.sh		ablations.sh
ablations1xtoks-coconut.sh		ablations1xtoks-coconut.sh
ablations1xtoks-norm.sh		ablations1xtoks-norm.sh
ablations5xtoks.sh		ablations5xtoks.sh
ablations_1xtoks.sh		ablations_1xtoks.sh
fineweb100B.sh		fineweb100B.sh
plot_results.py		plot_results.py
requirements.txt		requirements.txt
results.csv		results.csv
results1xtoks_norm.csv		results1xtoks_norm.csv
results_2-model-merging.md		results_2-model-merging.md
results_5xtoks.csv		results_5xtoks.csv
results_coconut.csv		results_coconut.csv

Repository files navigation

model-stack

Train async, then stack