-
Notifications
You must be signed in to change notification settings - Fork 351
Description
Hi, there,
I've just got an error when I run Milvus performance test with VectorDBBench using deep1b dataset.
The error log shows that maybe somewhere occur index-out-of-range error.
My Milvus's version is 2.5.21, and VectorDBBench's version is 1.0.16
dataset files was downloaded from here: https://huggingface.co/datasets/open-vdb/deep-image-96-angular/tree/main
Has someone met the same problem ? what should I do to solve it ?
Here is my test configurations:
and here is my task configurations:
the error log shows below:
2025-12-26 19:24:03,174 | WARNING: search error: list index out of range, list index out of range (task_runner.py:269) (236456)
2025-12-26 19:24:03,174 | WARNING: Failed to run performance case, reason = list index out of range (task_runner.py:222) (236456)
Traceback (most recent call last):
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/backend/task_runner.py", line 218, in run_perf_case
search_results = self.serial_search()
^^^^^^^^^^^^^^^^^^^^^
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/backend/taskrunner.py", line 271, in serial_search
raise e from e
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/backend/taskrunner.py", line 267, in serial_search
results, _ = self.serial_search_runner.run()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/backend/utils.py", line 43, in inner
result = func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/backend/runner/serialrunner.py", line 309, in run
return self.run_in_subprocess()
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/backend/runner/serialrunner.py", line 300, in run_in_subprocess
return future.result()
^^^^^^^^^^^^^^^
File "/data/anaconda3/envs/milvus/lib/python3.12/concurrent/futures/base.py", line 456, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "/data/anaconda3/envs/milvus/lib/python3.12/concurrent/futures/base.py", line 401, in __get_result
raise self._exception
IndexError: list index out of range
2025-12-26 19:24:03,175 | WARNING: [1/1] case {'label': <CaseLabel.Performance: 2>, 'name': 'deep (Performace Case)', 'dataset': {'data': {'name': 'deep', 'size': 9990000, 'dim': 96, 'metric_type': <MetricType.COSINE: 'COSINE'>}}, 'db': 'Milvus'} failed to run, reason=list index out of range (interface.py:203) (236456)
Traceback (most recent call last):
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/interface.py", line 182, in async_task_v2
case_res.metrics = runner.run(drop_old)
^^^^^^^^^^^^^^^^^^^^
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/backend/taskrunner.py", line 150, in run
return self.run_perf_case(drop_old)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/backend/taskrunner.py", line 224, in run_perf_case
raise e from None
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/backend/taskrunner.py", line 218, in run_perf_case
search_results = self.serial_search()
^^^^^^^^^^^^^^^^^^^^^
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/backend/taskrunner.py", line 271, in serial_search
raise e from e
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/backend/taskrunner.py", line 267, in serial_search
results, _ = self.serial_search_runner.run()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/backend/utils.py", line 43, in inner
result = func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/backend/runner/serialrunner.py", line 309, in run
return self.run_in_subprocess()
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/anaconda3/envs/milvus/lib/python3.12/site-packages/vectordb_bench/backend/runner/serialrunner.py", line 300, in run_in_subprocess
return future.result()
^^^^^^^^^^^^^^^
File "/data/anaconda3/envs/milvus/lib/python3.12/concurrent/futures/base.py", line 456, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "/data/anaconda3/envs/milvus/lib/python3.12/concurrent/futures/base.py", line 401, in __get_result
raise self._exception
IndexError: list index out of range