Skip to content

Commit 2f51273

Browse files
authored
fix: huge speed boost (#3132)
# What does this PR do? make llama stack fast again ## Test Plan
1 parent 25e0553 commit 2f51273

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

llama_stack/core/server/server.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -181,7 +181,6 @@ async def sse_generator(event_gen_coroutine):
181181
event_gen = await event_gen_coroutine
182182
async for item in event_gen:
183183
yield create_sse_event(item)
184-
await asyncio.sleep(0.01)
185184
except asyncio.CancelledError:
186185
logger.info("Generator cancelled")
187186
if event_gen:

0 commit comments

Comments
 (0)