-
Notifications
You must be signed in to change notification settings - Fork 857
ignore restart file on the first run #8082
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
cblmemo
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good catch @cg505 ! Thanks for fixing this. LGTM!
|
/smoke-test --remote-server |
|
/smoke-test |
cblmemo
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for fixing this @cg505 ! Mostly LGTM. left a discussion
| logger.warning( | ||
| f'{colorama.Fore.RED}Consolidation mode for jobs is enabled, ' | ||
| f'but the controller cluster {controller_cn} is still running. ' | ||
| 'Please terminate the controller cluster first.' | ||
| f'{colorama.Style.RESET_ALL}') |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
feeling like we should print out how many running jobs are still on the job controller here - just to get a sense of how many resources are still on the old deployment. same applies for serve.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It will make this call much slower, so I think it could be a problem.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sounds good. Lets just keep this :)
|
smoke test failures are on nightly |
* ignore restart file on the first run * avoid crashing the server on inconsistent consolidation mode config * Revert "avoid crashing the server on inconsistent consolidation mode config" This reverts commit dfa985e. * only use a warning for inconsistent consolidation mode
Fixes #8083.
Tested (run the relevant ones):
bash format.sh/smoke-test(CI) orpytest tests/test_smoke.py(local)/smoke-test -k test_name(CI) orpytest tests/test_smoke.py::test_name(local)/quicktest-core(CI) orpytest tests/smoke_tests/test_backward_compat.py(local)