Skip to content

[One Workflow] Keep execution indices green on single-node clusters - #290445

Open
skynetigor wants to merge 1 commit into
elastic:mainfrom
skynetigor:19297-execution-indices-turn-single-node-es-yellow
Open

[One Workflow] Keep execution indices green on single-node clusters#290445
skynetigor wants to merge 1 commit into
elastic:mainfrom
skynetigor:19297-execution-indices-turn-single-node-es-yellow

Conversation

@skynetigor

@skynetigor skynetigor commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Issue

Beats single-node snapshot tests go yellow after Kibana start. Workflow execution indices were created with Elasticsearch’s default of 1 replica, which cannot allocate on one node. Health probes fail.

Approach

Same choice as .workflows-events: auto-expand replicas from 0 to 1. Apply it on create, and update existing indices on the next Kibana start so already-yellow clusters recover.

Behavior

On a single-node cluster, those indices run with 0 replicas and cluster health can stay green after boot. On two or more nodes they still get a replica. A failed settings update is logged and does not block startup.

Test plan

  • Start Kibana against single-node ES and confirm cluster health is green after boot
  • Confirm .workflows-executions and .workflows-step-executions have 0 replicas on one node
  • Confirm a multi-node cluster still allocates a replica
  • Restart Kibana against an existing yellow pair of those indices and confirm they go green

References

Closes elastic/security-team#19297

Set auto_expand_replicas 0-1 so default replicas do not yellow single-node clusters after eager index creation.

Closes elastic/security-team#19297
@skynetigor skynetigor added release_note:fix backport:skip This PR does not require backporting Team:One Workflow Team label for One Workflow (Workflow automation) v9.6.0 labels Sep 11, 2026
@infra-vault-gh-plugin-prod

Copy link
Copy Markdown
🤖 Jobs for this PR can be triggered through checkboxes. 🚧

ℹ️ To trigger the CI, please tick the checkbox below 👇

  • Click to trigger kibana-pull-request for this PR!
  • Click to trigger kibana-deploy-project-from-pr for this PR!
  • Click to trigger kibana-deploy-cloud-from-pr for this PR!
  • Click to trigger kibana-entity-store-performance-from-pr for this PR!
  • Click to trigger kibana-storybooks-from-pr for this PR!

@skynetigor
skynetigor marked this pull request as ready for review September 11, 2026 08:41
@skynetigor
skynetigor requested a review from a team as a code owner September 11, 2026 08:41
@kibanamachine

Copy link
Copy Markdown
Contributor

💛 Build succeeded, but was flaky

Failed CI Steps

Metrics [docs]

Unknown metric groups

warm start memory

id before after diff
post forced gc heap baseline - 836761828 +836761828
post forced gc heap delta - -2576630 -2576630
post forced gc heap delta standard deviation - 3276425 +3276425
post forced gc heap target - 834185198 +834185198
tail heap delta - -3461674 -3461674
total +1668185147

Test Failures

  • [job] [logs] Scout Lane #9 - stateful-classic / default / local-stateful-classic - Document flyout v2 — alerts page entry - assignees: assigning the current user shows the avatar in the flyout header
  • [job] [logs] Jest Tests #2 / suricata_row_renderer should render a suricata row even if it does not have a suricata signature
  • [job] [logs] Jest Tests #11 / Testing AddDataProviderPopover Test Popover is visible

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:skip This PR does not require backporting release_note:fix Team:One Workflow Team label for One Workflow (Workflow automation) v9.6.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants