Skip to content

Commit 9804ed4

Browse files
committed
revert change
Signed-off-by: Kyle Sayers <[email protected]>
1 parent 24e1dc9 commit 9804ed4

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/transform/quip_example.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@
1414
# NOTE: because the datafree pipeline is being used in this
1515
# example, you can use additional GPUs to support larger models
1616
MODEL_ID = "meta-llama/Llama-3.1-8B-Instruct"
17-
model = AutoModelForCausalLM.from_pretrained(MODEL_ID, dtype="auto")
17+
model = AutoModelForCausalLM.from_pretrained(MODEL_ID, torch_dtype="auto")
1818
tokenizer = AutoTokenizer.from_pretrained(MODEL_ID)
1919

2020
# Configure the quantization algorithm to run.

0 commit comments

Comments
 (0)