Skip to content

Commit e9192be

Browse files
authored
quantize : fix using combined imatrix GGUFs (multiple datasets) (#14973)
1 parent 41e78c5 commit e9192be

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tools/quantize/quantize.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -311,7 +311,7 @@ static int load_imatrix(const std::string & imatrix_file, std::vector<std::strin
311311
int64_t n_datasets = gguf_get_arr_n(ctx_gguf, dataset_idx);
312312
imatrix_datasets.reserve(n_datasets);
313313
for (int64_t i = 0; i < n_datasets; ++i) {
314-
imatrix_datasets.push_back(gguf_get_val_str(ctx_gguf, dataset_idx));
314+
imatrix_datasets.push_back(gguf_get_arr_str(ctx_gguf, dataset_idx, i));
315315
}
316316
printf("%s: imatrix datasets=['%s'", __func__, imatrix_datasets[0].c_str());
317317
for (size_t i = 1; i < imatrix_datasets.size(); ++i) {

0 commit comments

Comments
 (0)