Even when the app is fully closed. The Live Activities and the Dynamic Island stays like Cider Remote is still opened.
Dynamic Island: 
Live Activities: 
Update :
The only way to remove it is to remove the Live Activities by yourself by swiping it in the notification box.