Weekly patch release
App
Added
- Added partial support for fastapi
Requestannotation inconfigure_apihandlers (#16047) - Added a nicer UI with URL and examples for the autoscaler component (#16063)
- Enabled users to have more control over scaling out/in intervals (#16093)
- Added more datatypes to the serving component (#16018)
- Added
work.deletemethod to delete the work (#16103) - Added
display_nameproperty to LightningWork for the cloud (#16095) - Added
ColdStartProxyto the AutoScaler (#16094) - Added status endpoint, enable
ready(#16075) - Implemented
readyfor components (#16129)
Changed
- The default
start_methodfor creating Work processes locally on macOS is now 'spawn' (previously 'fork') (#16089) - The utility
lightning.app.utilities.cloud.is_running_in_cloudnow returnsTrueduring the loading of the app locally when running with--cloud(#16045) - Updated Multinode Warning (#16091)
- Updated app testing (#16000)
- Changed overwrite to
True(#16009) - Simplified messaging in cloud dispatch (#16160)
- Added annotations endpoint (#16159)
Fixed
- Fixed
PythonServermessaging "Your app has started" (#15989) - Fixed auto-batching to enable batching for requests coming even after the batch interval but is in the queue (#16110)
- Fixed a bug where
AutoScalerwould fail with min_replica=0 (#16092 - Fixed a non-thread safe deepcopy in the scheduler (#16114)
- Fixed HTTP Queue sleeping for 1 sec by default if no delta was found (#16114)
- Fixed the endpoint info tab not showing up in the
AutoScalerUI (#16128) - Fixed an issue where an exception would be raised in the logs when using a recent version of
streamlit(#16139) - Fixed e2e tests (#16146)
Full Changelog: 1.8.5.post0...1.8.6