Skip to content

Commit 0b7aa99

Browse files
jmatejczmaciejmajek
authored andcommitted
refactor: remove navigation tasks (#638)
1 parent 6fd5671 commit 0b7aa99

File tree

10 files changed

+2
-1103
lines changed

10 files changed

+2
-1103
lines changed

docs/simulation_and_benchmarking/rai_bench.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -130,7 +130,6 @@ The ToolCallingAgentBenchmark class manages the execution of tasks and collects
130130
There are predefined Tasks available which are grouped by categories:
131131

132132
- Basic - require retrieving info from certain topics
133-
- Navigation
134133
- Spatial reasoning - questions about surroundings with images attached
135134
- Manipulation
136135
- Custom Interfaces - requires using messages with custom interfaces

src/rai_bench/rai_bench/docs/tool_calling_agent_benchmark.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,4 +14,4 @@ Implementations can be found:
1414

1515
- Validators [Validators](../tool_calling_agent/validators.py)
1616
- Subtasks [Validators](../tool_calling_agent/tasks/subtasks.py)
17-
- Tasks, including navigation, spatial, custom interfaces and other [Tasks](../tool_calling_agent/tasks/)
17+
- Tasks, including basic, spatial, custom interfaces and manipulation [Tasks](../tool_calling_agent/tasks/)

src/rai_bench/rai_bench/examples/benchmarking_models.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,6 @@
3636
task_types=[ # what types of tasks to include
3737
"basic",
3838
"spatial_reasoning",
39-
# "navigation",
4039
"custom_interfaces",
4140
"manipulation",
4241
],

src/rai_bench/rai_bench/test_models.py

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -96,14 +96,12 @@ class ToolCallingAgentBenchmarkConfig(BenchmarkConfig):
9696
Literal[
9797
"basic",
9898
"manipulation",
99-
"navigation",
10099
"custom_interfaces",
101100
"spatial_reasoning",
102101
]
103102
] = [
104103
"basic",
105104
"manipulation",
106-
"navigation",
107105
"custom_interfaces",
108106
"spatial_reasoning",
109107
]

0 commit comments

Comments
 (0)