Repository navigation

adding nemo2.0 eks test case - #688

Closed

KeitaW wants to merge 1201 commits into

mainfrom

nemo-eks

Closed

adding nemo2.0 eks test case#688
KeitaW wants to merge 1201 commits into
mainfrom
nemo-eks

This pull request is big! We're only showing the most recent 250 commits

Commits on May 8, 2024
- Merge pull request #316 from aws-samples/bugfix/nccl_tests
  verdimrc
  authored
  a2daee1
- remove AZ
  KeitaW
  committed
  d2c218a
- make script idempotent given --dry-run flag
  KeitaW
  committed
  d05136d
- make region and profile configurable
  KeitaW
  committed
  0496507
- update values for the env_vars + fix typo
  KeitaW
  committed
  468088f
- Merge pull request #320 from aws-samples/fix-easy-setup
  KeitaW
  authored
  fff9e4c
- Updated README to explain how to update config.py
  shimomut
  committed
  7f0bce4
Commits on May 9, 2024
- Merge pull request #321 from aws-samples/hyperpod-readme-update-20240508
  nghtm
  authored
  64ead51
Commits on May 10, 2024
- pytorch-screen.py: fix attribute error (backend einsum) on newer pytorch
  Verdi March
  committed
  3bd4c17
- Merge pull request #323 from aws-samples/fix-pt-env-validation
  verdimrc
  authored
  8fd4088
- FSDP with meta device requires sync_module_states=True
  pbelevich
  committed
  da6f289
- Merge pull request #327 from aws-samples/fsdp_sync_module_states_true
  perifaws
  authored
  1d3f752
Commits on May 14, 2024
- NCCL Test Script for AMI (#329)
  Sean Smith
  authored
  90a8cf9
- updates to HyperPod Observability Lifecycle scripts (#326)
  nghtm
  authored
  598314f
Commits on May 15, 2024
- Check if wget command installed in easy-setup.sh (#330)
  KeitaW
  authored
  6d773a6
- Update to Ubuntu 20.04 (#332)
  Sean Smith
  authored
  2b58c93
Commits on May 16, 2024
- Add LDAP Server (#311)
  mhuguesaws
  authored
  fba0e2d
- Update README.md (#333)
  nghtm
  authored
  97c055b
- Update Dockerfile efa exporter public ecr (#336)
  mhuguesaws
  authored
  7a5f440
- EKS CB fix for un-managed Node group (#334)
  Sean Smith
  authored
  000cb1b
- Deleting --cpus-per-task as it is not compatible with HyperPod auto-resume option. (#337)
  shimomut
  authored
  2826120
Commits on May 20, 2024
- Add in lt for p5 (#339)
  Sean Smith
  authored
  de4faaf
Commits on May 21, 2024
- --- (#344)
  dependabot[bot]
  authored
  861ae31
- --- (#345)
  dependabot[bot]
  authored
  1980d4a
- Change ldap sg name (#338)
  mhuguesaws
  authored
  9c19c6a
Commits on May 22, 2024
- Improve upon EFA versions script (#266)
  Sean Smith
  authored
  cc92717
Commits on May 23, 2024
- add metrics on the headnode (#347)
  Sean Smith
  authored
  68aef32
Commits on May 26, 2024
- Pcluster easy-ssh.sh (#346)
  
  Sean Smith
  and
  KeitaW
  authored
  196916a
Commits on May 30, 2024
- fix script name in 1.torch-screen.sbatch (#348)
  KeitaW
  authored
  23ef50b
- smhp: quality-of-live improvements (#300)
  
  verdimrc
  and
  Verdi March
  authored
  21e6460
- Fix nccl-test container image fails with cuda driver mismatch (#314)
  
  verdimrc
  and
  Verdi March
  authored
  d778493
Commits on Jun 3, 2024
- Nsight (#343)
  awsankur
  authored
  1209815
Commits on Jun 4, 2024
- Update README.md with typo in hyperlink (#349)
  awsankur
  authored
  2a39459
- Fixed typo
  awsankur
  authored
  b0b0c06
- Update config.yaml
  awsankur
  authored
  902e454
Commits on Jun 7, 2024
- Added EFA Node Exporter for EKS (#352)
  awsankur
  authored
  eb1d369
Commits on Jun 10, 2024
- Mamba (#342)
  syedazi
  authored
  28edd81
Commits on Jun 12, 2024
- Change readme to refer to recent test cases & assets (#355)
  perifaws
  authored
  efa07f7
- Fix/readme - fix borked logo (#356)
  perifaws
  authored
  bdfd5c9
- Remove borked ascii logo, once more (#357)
  perifaws
  authored
  2aa5ba7
- Fix readme file in NCCL tests (#358)
  perifaws
  authored
  26130c0
Commits on Jun 18, 2024
- Bump scikit-learn from 1.2.1 to 1.5.0 in /3.test_cases/4.DDP (#360)
  dependabot[bot]
  authored
  2d1ebee
Commits on Jun 21, 2024
- Upgrade packages in container to reduce the number of CVEs (#361)
  iankouls-aws
  authored
  e944da0
Commits on Jun 25, 2024
- Trainium llama3 (#363)
  
  syedazi
  and
  nghtm
  authored
  94bd6c9
- Add fsdp and smpv2 example for EKS (#364)
  
  iankouls-aws
  and
  awsankur
  authored
  7187e27
Commits on Jul 2, 2024
- Update nsight (#368)
  awsankur
  authored
  b3cae85
Commits on Jul 3, 2024
- Relocate docker/pyxis to /opt/sagemaker directory (#367)
  Sean Smith
  authored
  c6d054c
Commits on Jul 5, 2024
- Add secondary ebs volume setup in easy-setup.sh (#369)
  KeitaW
  authored
  33b6335
Commits on Jul 10, 2024
- Improvements/#371 change nccl version (#372)
  mhuguesaws
  authored
  2abc6bd
- Adding remote code trust flag for Dataloader (#373)
  amanshanbhag
  authored
  469efb5
Commits on Jul 15, 2024
- Prepare DLAMI for ParallelCluster using pcluster build-image (#92)
  
  authored
  080aff2
Commits on Jul 19, 2024
- chore: Update NCCL version, add aws-ofi-nccl tuner plugin (#379)
  
  bryantbiggs
  and
  KeitaW
  authored
  5e25da4
- Change create_streaming_dataloader method's timeout (#378)
  amanshanbhag
  authored
  99fd31a
Commits on Jul 20, 2024
- Revert "chore: Update NCCL version, add aws-ofi-nccl tuner plugin (#379)" (#380)
  KeitaW
  authored
  5082009
Commits on Jul 26, 2024
Commits on Jul 29, 2024
- Update README.md
  KeitaW
  authored
  db11a13
Commits on Jul 30, 2024
- Update Llama3 training test case with Trainium on SMHP (#383)
  KeitaW
  authored
  821e178
Commits on Aug 2, 2024
- reorganize (#389)
  KeitaW
  authored
  d73bea9
Commits on Aug 3, 2024
- Update README.md
  KeitaW
  authored
  80e4e5e
- Update 0.tensorflow.Dockerfile (#374)
  
  authored
  48d185e
- Update README.md
  KeitaW
  authored
  09e9405
Commits on Aug 4, 2024
- Update README.md
  KeitaW
  authored
  3e4ad8a
Commits on Aug 5, 2024
- Fix jax install (#394)
  mhuguesaws
  authored
  fbfc61a
Commits on Aug 6, 2024
- update Neuron SDK in LifeCycleScript (#390)
  
  KeitaW
  and
  nghtm
  authored
  7b5ce6a
Commits on Aug 7, 2024
- update test case (#398)
  KeitaW
  authored
  36d5922
- Fix device name for LDAP server. (#393)
  mhuguesaws
  authored
  9b37f2f
- Update README.md (#399)
  awsankur
  authored
  a2fdef9
- Update README.md
  KeitaW
  authored
  646be38
Commits on Aug 8, 2024
- add nccom-tests micro benchmark (#395)
  KeitaW
  authored
  d739d11
- Change NCCL bench versions (#400)
  mhuguesaws
  authored
  ba513f9
- Update 1.conda-train.sbatch (#401)
  KeitaW
  authored
  0cd8c5a
Commits on Aug 12, 2024
- megatron-lm test case: update README (#114)
  
  authored
  4d16b6d
Commits on Aug 13, 2024
- Update efa-cheatsheet.md (#406)
  
  KeitaW
  and
  benfriebe
  authored
  9f19c41
Commits on Aug 16, 2024
- Change slurm NCCL test to avoid mangled output. (#408)
  mhuguesaws
  authored
  4e10fcd
Commits on Aug 20, 2024
- Fix CI nccl test (#409)
  mhuguesaws
  authored
  68666f2
Commits on Aug 23, 2024
- update TORCHRUN_ARGS to be able to auto-resume (#407)
  KeitaW
  authored
  27469d9
Commits on Aug 24, 2024
- Adding FSxL MetadataConfiguration to allow customers to configure after creation (#411)
  shimomut
  authored
  dd9bd3c
- Update README.md
  KeitaW
  authored
  1d553a0
Commits on Aug 25, 2024
- Update README.md
  KeitaW
  authored
  e2d4906
Commits on Aug 26, 2024
- FSDP: Mistral(mathstral) sbatch file - MISTRAL MODEL SUPPORT (#385)
  nithiyn
  authored
  fe01050
- Add mistral model type support (#384)
  arm-diaz
  authored
  7791f5d
Commits on Aug 31, 2024
- Bump opencv-python from 4.5.5.64 to 4.8.1.78 in /3.test_cases/4.DDP (#415)
  dependabot[bot]
  authored
  8bc21ed
- Change aws-ofi-plugin version in nccl test (#412)
  mhuguesaws
  authored
  203e831
Commits on Sep 1, 2024
- Bump opencv-python-headless in /3.test_cases/9.nemo-multimodal (#414)
  dependabot[bot]
  authored
  fc50ab8
Commits on Sep 2, 2024
- Bump opencv-python-headless in /3.test_cases/14.bionemo (#416)
  dependabot[bot]
  authored
  1d4933a
Commits on Sep 3, 2024
- Update README.md (#417)
  KeitaW
  authored
  59645d9
Commits on Sep 5, 2024
- Improvements/nemo version update (#418)
  mhuguesaws
  authored
  c672e5a
Commits on Sep 7, 2024
- Update nccl version in CI (#419)
  mhuguesaws
  authored
  910a953
Commits on Sep 9, 2024
- Llama3.1 8b model training on Trn1 and EKS HyperPod (#413)
  
  aruncs2005
  and
  arunkumarl87
  authored
  79a798c
Commits on Sep 10, 2024
Commits on Sep 11, 2024
- Add GPU Health dashboards (#426)
  mhuguesaws
  authored
  cb28283
Commits on Sep 17, 2024
- Improvements/#430 nccl 2.23.4 (#431)
  mhuguesaws
  authored
  9b037bd
Commits on Sep 18, 2024
Commits on Sep 19, 2024
- Update 0.Dockerfile (#434)
  awsankur
  authored
  0e856a4
Commits on Sep 20, 2024
- Improvements/#370 bump megatron version (#437)
  mhuguesaws
  authored
  517cb39
Commits on Sep 23, 2024
- Improvements/#427 (#438)
  nghtm
  authored
  7124b10
- Update install_enroot_pyxis.sh (#439)
  nghtm
  authored
  18c6cd1
Commits on Sep 26, 2024
- Updates to Observability scripts include: add idempotency, improve logging, use pre-built ECR image for EFA-Node-Exporter, update dcgm container version to latest from nvidia. tested on g5.48xl and…
  nghtm
  authored
  ee14c53
Commits on Oct 4, 2024
- Update install_enroot_pyxis.sh (#449)
  KeitaW
  authored
  77c0e94
Commits on Oct 7, 2024
- Set HuggingFace metadata timeout (in seconds) for large clusters (#447)
  shimomut
  authored
  559e018
Commits on Oct 8, 2024
- added the option enable_pam_slurm_adopt in lifecycle scripts (#441)
  gmgtgh
  authored
  180e3fe
- Add an option to activate CPU Offloading (#404)
  KeitaW
  authored
  da275ec
Commits on Oct 9, 2024
- Update README.md (#456)
  nghtm
  authored
  8677a42
- Update arguments.py
  KeitaW
  authored
  135f103
Commits on Oct 11, 2024
- Remove AWS Pytorch channel in examples (#453)
  junpuf
  authored
  32fb5ae
Commits on Oct 14, 2024
- Add database deployment for Slurm accounting. (#452)
  
  mhuguesaws
  and
  Sean Smith
  authored
  86ce468
Commits on Oct 17, 2024
- Change EFA Installer and AWS OFI nccl plugin versions. (#454)
  mhuguesaws
  authored
  5d28e92
Commits on Oct 21, 2024
- Bump deepspeed in /3.test_cases/13.SM-dataparallel-deepspeed/code (#461)
  dependabot[bot]
  authored
  aab9818
Commits on Oct 22, 2024
- Install numpy v1 specifically to avoid version incompatible issues (#458)
  shimomut
  authored
  b162fcf
Commits on Oct 24, 2024
- Spelling nits in README.md (#465)
  jimburtoft
  authored
  e705fd5
Commits on Oct 25, 2024
- Change aws-ofi-plugin for EFA 1.35.0 due to regression (#466)
  mhuguesaws
  authored
  368f304
Commits on Oct 29, 2024
- Head node and login node ip in motd (#470)
  Sean Smith
  authored
  9021ae3
- Update requirements.txt (#469)
  nghtm
  authored
  b3aa317
Commits on Oct 30, 2024
- P5 on AWS Batch w/ Capacity Blocks (#448)
  Sean Smith
  authored
  69d87eb
Commits on Nov 4, 2024
- add configurable parameter to setup mountpoint for s3 in config.py (#471)
  nghtm
  authored
  8046e95
- Remove cuda compat (#476)
  
  jahaniam
  and
  mhuguesaws
  authored
  aaf0edd
Commits on Nov 5, 2024
- Add github stars to readme file (#477)
  perifaws
  authored
  05a8672
Commits on Nov 8, 2024
- Create fsdp-simple.yaml (#483)
  KeitaW
  authored
  cc3ef91
- Added onboarding automation script (#484)
  amanshanbhag
  authored
  7941874
- don't display login in motd if no login node (#473)
  Sean Smith
  authored
  331bb59
Commits on Nov 11, 2024
- Unifying CF template for FSxL for HyperPod Slurm and EKS (#482)
  shimomut
  authored
  8193c43
- Synchronizing the CF template with the one we have used in the workshop (#489)
  shimomut
  authored
  df40121
- Improvements/nccl efa update (#488)
  mhuguesaws
  authored
  3bb79b9
- add keypair to ~/.ssh/config file (#485)
  Sean Smith
  authored
  40d2338
- Automate onboarding smhp slurm (#487)
  amanshanbhag
  authored
  daca11f
Commits on Nov 12, 2024
- Generate keypair by default (#486)
  Sean Smith
  authored
  0967936
Commits on Nov 14, 2024
- easy-ssh improvements - switch to default (ubuntu) user (#490)
  Sean Smith
  authored
  d541cc3
Commits on Nov 15, 2024
- Update 0.nvcr-pytorch-aws.dockerfile (#495)
  nghtm
  authored
  1577997
- small improvement to login (#494)
  Sean Smith
  authored
  b29e349
Commits on Nov 18, 2024
- create ~/.ssh/config if it doesn't exist (#497)
  Sean Smith
  authored
  e4c729b
Commits on Nov 19, 2024
- Raising the default Kubernetes version to 1.30 (#499)
  shimomut
  authored
  730de53
- add link to the HP EKS workshop (#498)
  KeitaW
  authored
  8126215
- check for ssm document (#500)
  Sean Smith
  authored
  fc1be0f
Commits on Nov 21, 2024
- pin prometheus to version 2.55.1 (#504)
  nghtm
  authored
  d911db0
Commits on Nov 23, 2024
- fix: Updating Dockerfile to pin versions and fix the exampel (#505)
  mnuyens
  authored
  f81f48f
Commits on Dec 6, 2024
- Add HTTPS for LDAP web UI (#507)
  mhuguesaws
  authored
  c174e1c
Commits on Dec 9, 2024
- Add security groups creation to LDAP server (#509)
  mhuguesaws
  authored
  8b72077
- send public key to cluster (#508)
  Sean Smith
  authored
  dc38a7f
- better dryrun (#512)
  Sean Smith
  authored
  191723c
Commits on Dec 10, 2024
- Login improvements (#511)
  Sean Smith
  authored
  662e739
- name SSM doc (#502)
  Sean Smith
  authored
  b078ad7
Commits on Dec 11, 2024
- remove AWS Batch (#513)
  Sean Smith
  authored
  7e0e5db
- Change aws ofi plugin version 1.13.2 (#501)
  mhuguesaws
  authored
  ca41841
- Add p5e (#516)
  Sean Smith
  authored
  ff1c942
Commits on Dec 12, 2024
- Update NCCL tests for both slurm and k8s (#506)
  
  KeitaW
  and
  mhuguesaws
  authored
  f1eaede
Commits on Dec 17, 2024
- Added training plan logic into automate script (#510)
  amanshanbhag
  authored
  a306252
Commits on Jan 8, 2025
- Adding script to onboard EKS SMHP. (#522)
  amanshanbhag
  authored
  08faf98
Commits on Jan 13, 2025
- Update gen-keypair-ubuntu.sh to update authorized_keys (#518)
  
  KeitaW
  and
  mhuguesaws
  authored
  11934b9
Commits on Jan 14, 2025
- Update gen-keypair-ubuntu.sh
  KeitaW
  authored
  32a080d
Commits on Jan 15, 2025
- Update the Neuron SDK to 2.21.0 (#523)
  jianyinglangaws
  authored
  a7d6a5b
Commits on Jan 22, 2025
- Update automate-eks-cluster-creation.sh (#529)
  amanshanbhag
  authored
  4783ba7
Commits on Jan 24, 2025
- Fixing neuron bug in automate script (#532)
  amanshanbhag
  authored
  0f7f685
- Fixing CF stack output names in create_config.sh (#534)
  amanshanbhag
  authored
  3b243c9
Commits on Jan 30, 2025
- Cf stack slurm ssm (#538)
  amanshanbhag
  authored
  b0389a1
Commits on Jan 31, 2025
- feat: multi headnode support update (#535)
  guanweim
  authored
  3b6aab9
Commits on Feb 3, 2025
- Updatemhoutput (#541)
  guanweim
  authored
  ae7dd63
Commits on Feb 4, 2025
- Make FSDP example to use preinstalled aws-ofi-nccl (#539)
  
  KeitaW
  and
  mhuguesaws
  authored
  4303ca7
Commits on Feb 5, 2025
- Adding examples for SMHP EKS task governance (#543)
  jwoschitz
  authored
  2ca3e6e
- add os grafana stack (#526)
  
  KeitaW
  and
  nghtm
  authored
  1119ac8
- Fix a crash with empty InstanceGroup in resource_config.json (#545)
  olegtalalov
  authored
  7f4a505
Commits on Feb 6, 2025
- exponential backoff for node exporter and dcgm exporter containers
  nghtm
  committed
  f5ada55
Commits on Feb 12, 2025
- Fixing Dockerfile to install torchvision torchaudio consistent to torch (#549)
  shimomut
  authored
  861ea1e
- updating task governance
  nadknish
  committed
  0133d3d
- Revert "updating task governance"
  nadknish
  committed
  5dd9703
Commits on Feb 13, 2025
- Automating multihead cluster creation process + automating user creation process (POSIX + IAM) (#542)
  amanshanbhag
  authored
  d5b7dcd
Commits on Feb 18, 2025
- Minor change to OS cluster observability CF stack description (#560)
  amanshanbhag
  authored
  cf205ec
Commits on Feb 19, 2025
Commits on Feb 20, 2025
- Update Welcome message to clarify which HP cluster is going to be cre… (#562)
  KeitaW
  authored
  5aa0395
- Changed docker run command for os observability stack to use IMDSv2 (#561)
  
  authored
  e1b2ed5
Commits on Feb 24, 2025
- Added Nsight slurm workshop artifacts
  Ankur Srivastava
  committed
  8b04d80
- Updated
  Ankur Srivastava
  committed
  ea4075a
Commits on Feb 25, 2025
- HyperPod EKS Automation Script and CFN Updates (#565)
  bluecrayon52
  authored
  c32af83
- updated BUCKET_NAME to S3_BUCKET_NAME in helper script (#566)
  bluecrayon52
  authored
  3b289ba
Commits on Feb 26, 2025
- Fix exclusion of eth in NCCL tests (#569)
  mhuguesaws
  authored
  27531ab
Commits on Mar 1, 2025
- Fix Open MPI conduit in NCCL tests (#571)
  mhuguesaws
  authored
  3770b49
- Update nccl-tests-ami.sbatch
  KeitaW
  authored
  4039347
Commits on Mar 6, 2025
- remove .gitmodules (#576)
  KeitaW
  authored
  21ad8ed
- Improvements/megatron lm (#575)
  
  mhuguesaws
  and
  KeitaW
  authored
  0cd69fc
Commits on Mar 7, 2025
- Adding torchtitan sample (#574)
  
  allela-roy
  and
  KeitaW
  authored
  4740c3f
Commits on Mar 11, 2025
- Update nemo-launcher test case (#580)
  KeitaW
  authored
  6cad516
- exit when targetted instance unreachable (#563)
  KeitaW
  authored
  be00160
- remove own_account.md (#581)
  KeitaW
  authored
  f69aabc
Commits on Mar 12, 2025
- Nemo2.0 on sagemaker hyperpod (#570)
  
  authored
  e67fc35
Commits on Mar 17, 2025
- updated etcd version tag from latest to v3.5.19 (#588)
  bluecrayon52
  authored
  f7ee4ed
Commits on Mar 18, 2025
- update nemorun testcase (#590)
  
  KeitaW
  and
  DaisukeMiyamoto
  authored
  39b82e2
- Update nccom-tests.sbatch (#591)
  KeitaW
  authored
  6d86576
Commits on Mar 19, 2025
- Update 0.Dockerfile (#592)
  awsankur
  authored
  0fa4578
Commits on Mar 20, 2025
- Updated SMHP EKS IAM policy to include ecr:BatchCheckLayerAvailability (#594)
  bluecrayon52
  authored
  bd53eec
- Fix/smhp eks readme (#593)
  bluecrayon52
  authored
  bfe39ba
Commits on Mar 21, 2025
- add auto-resume flag automatically when job executed on HP (#595)
  KeitaW
  authored
  b2af25d
- Added scripts for BioNeMo 2.5 (#596)
  awsankur
  authored
  eb32c00
Commits on Mar 24, 2025
- Update run.py
  KeitaW
  authored
  665bf8b
Commits on Mar 25, 2025
- Change EFA Installer and NCCL benchmark versions (#598)
  mhuguesaws
  authored
  8144327
Commits on Mar 26, 2025
- Added resiliency plugins to nemo run test case (#610)
  aroraakshit
  authored
  7e4518e
Commits on Mar 27, 2025
- Change EFA exporter version. (#608)
  mhuguesaws
  authored
  ff1e485
- Add autobuild of efa node exporter (#612)
  mhuguesaws
  authored
  d72c630
Commits on Mar 28, 2025
- update default mhn db properties (#613)
  andrew-j-cai
  authored
  f61e1e3
Commits on Mar 31, 2025
- Slurm studio integration (#609)
  amanshanbhag
  authored
  22f421d
- Update `eksctl` cluster versions and ML CBR usage (#573)
  bryantbiggs
  authored
  bd2f524
- Deleting SMP/SMDDP test-cases based on PM's input (#617)
  shimomut
  authored
  305a69b
- adding picotron (#584)
  KeitaW
  authored
  67a9667
- update readme and deprecate test cases (#620)
  KeitaW
  authored
  3a559fa
- Add EKS node autorepair example cluster manifest example (#619)
  iankouls-aws
  authored
  32293bf
- added AmazonEKS_CNI_Policy to SM Exec Role (#624)
  bluecrayon52
  authored
  06c6489
Commits on Apr 1, 2025
- Change efa node exporter container to distroless (#611)
  mhuguesaws
  authored
  ee5b38a
- Change EFA, NCCL version in pipeline (#626)
  mhuguesaws
  authored
  000a608
Commits on Apr 2, 2025
- added DOCKER_NETWORK and env_var persistence for Workshop Studio use (#623)
  bluecrayon52
  authored
  f584e8e
Commits on Apr 3, 2025
- Update buildspec.yaml
  mhuguesaws
  authored
  d513e05
Commits on Apr 6, 2025
- updated fsx_ubuntu.sh script with wait loop (#633)
  bluecrayon52
  authored
  60cb59c
Commits on Apr 8, 2025
- Change PyTorch version for FSDP case and remove conda (#629)
  mhuguesaws
  authored
  5f037e9
- Change FSDP to install python venv.
  mhuguesaws
  authored
  4a30cc3
- Change FSDP python3
  mhuguesaws
  authored
  a9d0628
Commits on Apr 9, 2025
- Change prometheus version for SMHP (#628)
  mhuguesaws
  authored
  97afdd3
Commits on Apr 10, 2025
- Openzfs smhp (#622)
  amanshanbhag
  authored
  659faf1
- Fix cloudwatch access from Grafana (#627)
  mhuguesaws
  authored
  0f754e4
- Fixing recently raised Studio Issues (#640)
  amanshanbhag
  authored
  ac776b0
- Terraform Modules for HyperPod EKS (#586)
  
  bluecrayon52
  and
  KeitaW
  authored
  f11ddee
Commits on Apr 11, 2025
- Slurm cluster creation issues (#641)
  amanshanbhag
  authored
  521411e
Commits on Apr 18, 2025
- Update 0.distributed-training.Dockerfile (#645)
  KeitaW
  authored
  4cc0e2e
- Improvements/fsdp restructure (#630)
  
  mhuguesaws
  and
  KeitaW
  authored
  4d16e5f
Commits on Apr 20, 2025
- Add automated Grafana dashboard deployment (#607)
  mhuguesaws
  authored
  cc161b1
Commits on Apr 23, 2025
- Fix nccl-tests-ami.sbatch
  mhuguesaws
  authored
  34cf245
- Fix FSDP venv python version
  mhuguesaws
  authored
  052fbc7
Commits on Apr 24, 2025
- Fix FSDP to use venv first (#650)
  mhuguesaws
  authored
  82630f1
Commits on Apr 28, 2025
- Fix wheel FSDP create_venv.sh
  mhuguesaws
  authored
  04cc85d
- nvshmem (#599)
  
  pbelevich
  and
  KeitaW
  authored
  e97db8e
Commits on May 1, 2025
- Update install_enroot_pyxis.sh (#661)
  KeitaW
  authored
  6437167
Commits on May 5, 2025
- feat: Add Hyperpod Optimum-neuron LoRA example (#631)
  
  Captainia
  and
  KeitaW
  authored
  fbe5373
Commits on May 6, 2025
- Update Dockerfile
  mhuguesaws
  authored
  9416546
- Adding custom dcgm metrics for EKS (#666)
  nadknish
  authored
  acd9934
Commits on May 7, 2025
- re-adding deepspeed (#659)
  KeitaW
  authored
  6c62b92
Commits on May 8, 2025
- Lcc studio jl (#669)
  amanshanbhag
  authored
  58fddf8
Commits on May 9, 2025
- Update 0.distributed-training.Dockerfile (#671)
  nicolaven
  authored
  77fdf44
Commits on May 10, 2025
- utility to dump details of all nodes in a cluster, into a csv file (#652)
  
  authored
  5c563b0
Commits on May 13, 2025
- Update setup_mariadb_accounting.sh with apg installation (#672)
  amanshanbhag
  authored
  3e97ece
- U 2204 patch -- update from #672 (#673)
  amanshanbhag
  authored
  f325214
Commits on May 15, 2025
- Upgrade pinned version of Ansible (#681)
  amanshanbhag
  authored
  5c4f1ea
Commits on May 16, 2025
- Nghtm patch 2 (#683)
  nghtm
  authored
  7186278
Commits on May 19, 2025
- Add EKS CNI Policy to SageMaker HyperPod Terraform Role
  nghtm
  committed
  5e24209
Commits on May 20, 2025
- Fix minor spelling mistake in start_slurm.sh (#686)
  sammyhori
  authored
  530fd5d
Commits on May 21, 2025
- adding nemo2.0 eks test case
  KeitaW
  committed
  2ed8f61

Commits

Commits on May 8, 2024

Commits on May 9, 2024

Commits on May 10, 2024

Commits on May 14, 2024

Commits on May 15, 2024

Commits on May 16, 2024

Commits on May 20, 2024

Commits on May 21, 2024

Commits on May 22, 2024

Commits on May 23, 2024

Commits on May 26, 2024

Commits on May 30, 2024

Commits on Jun 3, 2024

Commits on Jun 4, 2024

Commits on Jun 7, 2024

Commits on Jun 10, 2024

Commits on Jun 12, 2024

Commits on Jun 18, 2024

Commits on Jun 21, 2024

Commits on Jun 25, 2024

Commits on Jul 2, 2024

Commits on Jul 3, 2024

Commits on Jul 5, 2024

Commits on Jul 10, 2024

Commits on Jul 15, 2024

Commits on Jul 19, 2024

Commits on Jul 20, 2024

Commits on Jul 26, 2024

Commits on Jul 29, 2024

Commits on Jul 30, 2024

Commits on Aug 2, 2024

Commits on Aug 3, 2024

Commits on Aug 4, 2024

Commits on Aug 5, 2024

Commits on Aug 6, 2024

Commits on Aug 7, 2024

Commits on Aug 8, 2024

Commits on Aug 12, 2024

Commits on Aug 13, 2024

Commits on Aug 16, 2024

Commits on Aug 20, 2024

Commits on Aug 23, 2024

Commits on Aug 24, 2024

Commits on Aug 25, 2024

Commits on Aug 26, 2024

Commits on Aug 31, 2024

Commits on Sep 1, 2024

Commits on Sep 2, 2024

Commits on Sep 3, 2024

Commits on Sep 5, 2024

Commits on Sep 7, 2024

Commits on Sep 9, 2024

Commits on Sep 10, 2024