This repo is a example of how one can integrate pruna with aws ecosystem.
The notebook triton_nlp_llama_pruna.ipynb is based on SageMaker example notebooks, and demonstrate how to build, and deploy machine learning models using Amazon SageMaker.
The quickest setup to run example notebooks includes:
- An AWS account
- Proper IAM User and Role setup
- An S3 bucket