Skip to content

Update llama3 70b and removes the neuron-top in update_neuron_sdk.sh script #530

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 11 commits into from
Feb 19, 2025
Merged

Update llama3 70b and removes the neuron-top in update_neuron_sdk.sh script #530

Show file tree
Hide file tree
Changes from 10 commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
dcc0148
Update the Neuron SDK to 2.21.0
jianyinglangaws Jan 15, 2025
2a635e4
Update the Llama3-70B pretraining with the Neuron SDK 2.21
jianyinglangaws Jan 20, 2025
e3b32d5
Fix a typo
jianyinglangaws Jan 20, 2025
f323463
Add --hw_backend trn1 in the convert_checkpoint command
jianyinglangaws Jan 20, 2025
4628ad1
More update
jianyinglangaws Jan 22, 2025
cc53ffc
Update the update_neuron_sdk.sh by removing the neuron-top check
jianyinglangaws Jan 22, 2025
3f61688
Keep enable_update_neuron_sdk as Flase by default
jianyinglangaws Jan 22, 2025
71550bb
Update automate-eks-cluster-creation.sh (#529)
amanshanbhag Jan 22, 2025
1111761
Merge branch 'main' into update_llama3_70b
KeitaW Jan 22, 2025
7604644
Update according to the review comments.
jianyinglangaws Jan 24, 2025
dd6c029
minor updates in doc
KeitaW Jan 26, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
47 changes: 21 additions & 26 deletions 1.architectures/5.sagemaker-hyperpod/LifecycleScripts/base-config/utils/update_neuron_sdk.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,33 +1,28 @@
#!/bin/bash
set -euxo pipefail
if neuron-top -v &> /dev/null
then
echo "Update to Neuron SDK Release 2.21.0"
# Configure Linux for Neuron repository updates
. /etc/os-release

sudo echo "deb https://apt.repos.neuron.amazonaws.com ${VERSION_CODENAME} main" | sudo tee /etc/apt/sources.list.d/neuron.list
wget -qO - https://apt.repos.neuron.amazonaws.com/GPG-PUB-KEY-AMAZON-AWS-NEURON.PUB | sudo apt-key add -
echo "Update to Neuron SDK Release 2.21.0"
# Configure Linux for Neuron repository updates
. /etc/os-release

# Update OS packages
sudo apt-get update -y
sudo echo "deb https://apt.repos.neuron.amazonaws.com ${VERSION_CODENAME} main" | sudo tee /etc/apt/sources.list.d/neuron.list
wget -qO - https://apt.repos.neuron.amazonaws.com/GPG-PUB-KEY-AMAZON-AWS-NEURON.PUB | sudo apt-key add -

# Install git
sudo apt-get install git -y
# Update OS packages
sudo apt-get update -y

# Remove preinstalled packages and Install Neuron Driver and Runtime
sudo apt-get remove aws-neuron-dkms -y
sudo apt-get remove aws-neuronx-dkms -y
sudo apt-get remove aws-neuronx-oci-hook -y
sudo apt-get remove aws-neuronx-runtime-lib -y
sudo apt-get remove aws-neuronx-collectives -y
sudo apt-get install aws-neuronx-dkms=2.19.64.0 -y
sudo apt-get install aws-neuronx-oci-hook=2.6.36.0 -y
sudo apt-get install aws-neuronx-runtime-lib=2.23.110.0* -y
sudo apt-get install aws-neuronx-collectives=2.23.133.0* -y
# Remove preinstalled packages and Install Neuron Driver and Runtime
sudo apt-get remove aws-neuron-dkms -y
sudo apt-get remove aws-neuronx-dkms -y
sudo apt-get remove aws-neuronx-oci-hook -y
sudo apt-get remove aws-neuronx-runtime-lib -y
sudo apt-get remove aws-neuronx-collectives -y
sudo apt-get install aws-neuronx-dkms=2.19.64.0 -y
sudo apt-get install aws-neuronx-oci-hook=2.6.36.0 -y
sudo apt-get install aws-neuronx-runtime-lib=2.23.110.0* -y
sudo apt-get install aws-neuronx-collectives=2.23.133.0* -y

# Remove pre-installed package and Install Neuron Tools
sudo apt-get remove aws-neuron-tools -y
sudo apt-get remove aws-neuronx-tools -y
sudo apt-get install aws-neuronx-tools=2.19.0.0 -y
fi
# Remove pre-installed package and Install Neuron Tools
sudo apt-get remove aws-neuron-tools -y
sudo apt-get remove aws-neuronx-tools -y
sudo apt-get install aws-neuronx-tools=2.20.204.0 -y
Loading