⚡️ Speed up function get_input_data_lineage_excluding_auto_batch_casting by 13% in PR #1504 (feature/try-to-beat-the-limitation-of-ee-in-terms-of-singular-elements-pushed-into-batch-inputs)

The optimization achieves a 12% speedup by applying two key changes:

**1. Function Call Inlining (Primary Optimization)**
The main performance gain comes from inlining the `get_lineage_for_input_property` function logic directly into the main loop of `get_input_data_lineage_excluding_auto_batch_casting`. This eliminates ~2,342 function calls (as shown in the profiler), reducing the overhead from 79.6% to 31.6% of total time spent in the `identify_lineage` call.

The inlined logic checks `input_definition.is_compound_input()` directly in the loop and handles both compound and simple inputs inline, avoiding the function call overhead entirely for the common case of simple batch-oriented inputs.

**2. Dictionary Implementation Change**
In `verify_lineages`, replaced `defaultdict(list)` with a plain dictionary using explicit key existence checks. This reduces the overhead of defaultdict's factory function calls and provides more predictable performance characteristics, especially beneficial when processing large numbers of lineages.

**Performance Impact by Test Type:**
- **Large-scale tests** (500+ properties): ~17-18% improvement due to reduced per-iteration overhead
- **Basic tests** (few properties): ~14-22% improvement from eliminating function call overhead  
- **Compound inputs**: ~7-20% improvement, with better gains for simpler compound structures
- **Edge cases** (empty/scalar): Minimal impact as expected, since less computation occurs

The optimization maintains identical behavior and error handling while significantly reducing the computational overhead in the hot path where most properties are processed.

Author: codeflash-ai[bot]

inference/core/workflows/execution_engine/v1/compiler/graph_constructor.py

@@ -1633,13 +1633,23 @@ def get_input_data_lineage_excluding_auto_batch_casting(
     for property_name, input_definition in input_data.items():
         if property_name in scalar_parameters_to_be_batched:
             continue
-        new_lineages_detected_within_property_data = get_lineage_for_input_property(
-            step_name=step_name,
-            property_name=property_name,
-            input_definition=input_definition,
-            lineage_deduplication_set=lineage_deduplication_set,
-        )
-        lineages.extend(new_lineages_detected_within_property_data)
+        if input_definition.is_compound_input():
+            new_lineages_detected_within_property_data = (
+                get_lineage_from_compound_input(
+                    step_name=step_name,
+                    property_name=property_name,
+                    input_definition=input_definition,
+                    lineage_deduplication_set=lineage_deduplication_set,
+                )
+            )
+            lineages.extend(new_lineages_detected_within_property_data)
+        else:
+            if input_definition.is_batch_oriented():
+                lineage = input_definition.data_lineage
+                lineage_id = identify_lineage(lineage=lineage)
+                if lineage_id not in lineage_deduplication_set:
+                    lineage_deduplication_set.add(lineage_id)
+                    lineages.append(lineage)
     if not lineages:
         return lineages
     verify_lineages(step_name=step_name, detected_lineages=lineages)
@@ -1729,9 +1739,13 @@ def get_lineage_from_compound_input(
 
 
 def verify_lineages(step_name: str, detected_lineages: List[List[str]]) -> None:
-    lineages_by_length = defaultdict(list)
+    lineages_by_length = {}
     for lineage in detected_lineages:
-        lineages_by_length[len(lineage)].append(lineage)
+        lineage_len = len(lineage)
+        if lineage_len not in lineages_by_length:
+            lineages_by_length[lineage_len] = [lineage]
+        else:
+            lineages_by_length[lineage_len].append(lineage)
     if len(lineages_by_length) > 2:
         raise StepInputLineageError(
             public_message=f"Input data provided for step: `{step_name}` comes with lineages at more than two "