Skip to content

Re-trigger the reindexing if indices fail to complete the workflow #8860

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 37 commits into
base: dave/async_reindex
Choose a base branch
from
Draft

Re-trigger the reindexing if indices fail to complete the workflow #8860

wants to merge 37 commits into from

Conversation

daveaugustus
Copy link
Contributor

🔩 Description: What code changed, and why?

⛓️ Related Resources

👍 Definition of Done

👟 How to Build and Test the Change

✅ Checklist

All PRs must tick these:

With occasional exceptions, all PRs from Progress employees must tick these:

  • Is the code clear? (complicated code or lots of comments--subdivide and use well-named methods, meaningful variable names, etc.)
  • Consistency checked? (user notifications, user prompts, visual patterns, code patterns, variable names)
  • Repeated code blocks eliminated? (adapt and reuse existing components, blocks, functions, etc.)
  • Spelling, grammar, typos checked? (at a minimum use make spell in any component directory)
  • Code well-formatted? (indents, line breaks, etc. improve rather than hinder readability)

All PRs from Progress employees should tick these if appropriate:

  • Tests added/updated? (all new code needs new tests)
  • Docs added/updated? (all customer-facing changes)

Please add a note next to any checkbox above if you are NOT ticking it.

📷 Screenshots, if applicable

daveaugustus added 7 commits April 10, 2025 00:12
Async reindexing
ae6cf2c 
Signed-off-by: daveaugustus <[email protected]>
completed async reindexing
80c910e 
Signed-off-by: daveaugustus <[email protected]>
code corrections
be0b1d8 
Signed-off-by: daveaugustus <[email protected]>
reverted monitorReindexing
9d879bf 
Signed-off-by: daveaugustus <[email protected]>
removed done channel
480dbef 
Signed-off-by: daveaugustus <[email protected]>
PR comment changes
b89100b 
Signed-off-by: daveaugustus <[email protected]>
code setup
56535d8 
Signed-off-by: daveaugustus <[email protected]>
@daveaugustus daveaugustus marked this pull request as draft April 15, 2025 09:03
@netlify Netlify
Copy link

netlify bot commented Apr 15, 2025 •
edited
Loading

✅ Deploy Preview for chef-automate ready!

Name Link
🔨 Latest commit 56535d8
🔍 Latest deploy log https://app.netlify.com/sites/chef-automate/deploys/67fe20ef46df9d00084c520b
😎 Deploy Preview https://deploy-preview-8860--chef-automate.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@daveaugustus daveaugustus changed the base branch from main to dave/async_reindex April 15, 2025 09:04
Aishwarya2001A and others added 18 commits April 17, 2025 12:05
@Aishwarya2001A @rensycthomas
@chef-ci @punitmundra @vivekshankar1
Aishi/reindex (#8863)
50fa1a7 
* comment

Signed-off-by: daveaugustus <[email protected]>

* Build automate_backend_ctl to use packages from LTS. Upgrade ruby version to ruby3_4 (#8851)

Signed-off-by: Rensy Thomas <[email protected]>

* Bump version to 4.13.145 by Chef Expeditor

Obvious fix; these changes are the result of automation not creative thinking.

* Bump version to 4.13.146 by Chef Expeditor

Obvious fix; these changes are the result of automation not creative thinking.

* Add note for max_connections parameter (#8852)

Signed-off-by: Rensy Thomas <[email protected]>

* Bump version to 4.13.147 by Chef Expeditor

Obvious fix; these changes are the result of automation not creative thinking.

* Bump version to 4.13.148 by Chef Expeditor

Obvious fix; these changes are the result of automation not creative thinking.

* Revert "Build automate_backend_ctl to use packages from LTS. Upgrade ruby ver…" (#8854)

This reverts commit 2e954e2.

* Bump version to 4.13.149 by Chef Expeditor

Obvious fix; these changes are the result of automation not creative thinking.

* Bump version to 4.13.150 by Chef Expeditor

Obvious fix; these changes are the result of automation not creative thinking.

* snow doc update compatibility (#8857)

Signed-off-by: Vivek Shankar <[email protected]>

* Bump version to 4.13.151 by Chef Expeditor

Obvious fix; these changes are the result of automation not creative thinking.

* Bump version to 4.13.152 by Chef Expeditor

Obvious fix; these changes are the result of automation not creative thinking.

* fix elasticsidecar connection leak issue (#8859)

* fix elasticsidecar connection leak issue

Signed-off-by: Vivek Shankar <[email protected]>

* add no semgrep

Signed-off-by: Vivek Shankar <[email protected]>

---------

Signed-off-by: Vivek Shankar <[email protected]>

* Bump version to 4.13.153 by Chef Expeditor

Obvious fix; these changes are the result of automation not creative thinking.

* Bump version to 4.13.154 by Chef Expeditor

Obvious fix; these changes are the result of automation not creative thinking.

* func runFromReindexFromSourceToTemp

Signed-off-by: Aishwarya2001A <[email protected]>

* rest of the funcs

Signed-off-by: Aishwarya2001A <[email protected]>

* comments

Signed-off-by: Aishwarya2001A <[email protected]>

* un-necessary changes

Signed-off-by: daveaugustus <[email protected]>

* wrong rebasing correction

Signed-off-by: daveaugustus <[email protected]>

---------

Signed-off-by: daveaugustus <[email protected]>
Signed-off-by: Rensy Thomas <[email protected]>
Signed-off-by: Vivek Shankar <[email protected]>
Signed-off-by: Aishwarya2001A <[email protected]>
Co-authored-by: daveaugustus <[email protected]>
Co-authored-by: rensycthomas <[email protected]>
Co-authored-by: Chef Expeditor <[email protected]>
Co-authored-by: punitmundra <[email protected]>
Co-authored-by: vivekshankar1 <[email protected]>
removed null check
e13ebd9 
Signed-off-by: daveaugustus <[email protected]>
@rensycthomas @Aishwarya2001A
Build automate_backend_ctl to use packages from LTS. Upgrade ruby ver…
a7eb32e 
…sion to ruby3_4 (#8851)

Signed-off-by: Rensy Thomas <[email protected]>
@chef-ci @Aishwarya2001A
Bump version to 4.13.145 by Chef Expeditor
752a42a 
Obvious fix; these changes are the result of automation not creative thinking.
@chef-ci @Aishwarya2001A
Bump version to 4.13.146 by Chef Expeditor
45bf369 
Obvious fix; these changes are the result of automation not creative thinking.
@rensycthomas @Aishwarya2001A
Add note for max_connections parameter (#8852)
2de2c9d 
Signed-off-by: Rensy Thomas <[email protected]>
@chef-ci @Aishwarya2001A
Bump version to 4.13.147 by Chef Expeditor
86858f0 
Obvious fix; these changes are the result of automation not creative thinking.
@chef-ci @Aishwarya2001A
Bump version to 4.13.148 by Chef Expeditor
e4eb19d 
Obvious fix; these changes are the result of automation not creative thinking.
@punitmundra @Aishwarya2001A
Revert "Build automate_backend_ctl to use packages from LTS. Upgrade …
b092e38 
…ruby ver…" (#8854)

This reverts commit 2e954e2.
@chef-ci @Aishwarya2001A
Bump version to 4.13.149 by Chef Expeditor
5a7eeab 
Obvious fix; these changes are the result of automation not creative thinking.
@chef-ci @Aishwarya2001A
Bump version to 4.13.150 by Chef Expeditor
d048360 
Obvious fix; these changes are the result of automation not creative thinking.
@vivekshankar1 @Aishwarya2001A
snow doc update compatibility (#8857)
4f60c21 
Signed-off-by: Vivek Shankar <[email protected]>
@chef-ci @Aishwarya2001A
Bump version to 4.13.151 by Chef Expeditor
ab1ff08 
Obvious fix; these changes are the result of automation not creative thinking.
@chef-ci @Aishwarya2001A
Bump version to 4.13.152 by Chef Expeditor
77ac32d 
Obvious fix; these changes are the result of automation not creative thinking.
@vivekshankar1 @Aishwarya2001A
fix elasticsidecar connection leak issue (#8859)
c6fc43f 
* fix elasticsidecar connection leak issue

Signed-off-by: Vivek Shankar <[email protected]>

* add no semgrep

Signed-off-by: Vivek Shankar <[email protected]>

---------

Signed-off-by: Vivek Shankar <[email protected]>
@chef-ci @Aishwarya2001A
Bump version to 4.13.153 by Chef Expeditor
0966899 
Obvious fix; these changes are the result of automation not creative thinking.
@chef-ci @Aishwarya2001A
Bump version to 4.13.154 by Chef Expeditor
ef90791 
Obvious fix; these changes are the result of automation not creative thinking.
@Aishwarya2001A
corrections
531e8bf 
Signed-off-by: Aishwarya2001A <[email protected]>
@github-actions github-actions bot added the documentation Anything related to the Automate docs. label Apr 18, 2025
@daveaugustus @Aishwarya2001A
added heartbeat and heartbeatThreshold (#8866)
010779b 
* added heartbeat and heartbeatThreshold

Signed-off-by: daveaugustus <[email protected]>

* todos

Signed-off-by: daveaugustus <[email protected]>

* async reindexing

Signed-off-by: daveaugustus <[email protected]>

* logic corrections

Signed-off-by: daveaugustus <[email protected]>

* corrections

Signed-off-by: Aishwarya2001A <[email protected]>

* TODO comments

Signed-off-by: Aishwarya2001A <[email protected]>

* code for TODO comment

Signed-off-by: Aishwarya2001A <[email protected]>

* cli changes

Signed-off-by: Aishwarya2001A <[email protected]>

* syntax corrections

Signed-off-by: daveaugustus <[email protected]>

---------

Signed-off-by: daveaugustus <[email protected]>
Signed-off-by: Aishwarya2001A <[email protected]>
Co-authored-by: daveaugustus <[email protected]>
Co-authored-by: Aishwarya2001A <[email protected]>
@daveaugustus daveaugustus requested a review from Dmaddu April 21, 2025 18:59
Aishwarya2001A and others added 10 commits April 22, 2025 12:13
@Aishwarya2001A
heartbeat code changes
bd556c3 
Signed-off-by: Aishwarya2001A <[email protected]>
@Aishwarya2001A
switch case corrections
546a37e 
Signed-off-by: Aishwarya2001A <[email protected]>
@daveaugustus @Aishwarya2001A
some edge case tracked (#8869)
b9a5d2e 
* some edge case tracked

Signed-off-by: daveaugustus <[email protected]>

* added check for failed cases in the failed indices running for reindexing

Signed-off-by: daveaugustus <[email protected]>

* removed failed-true in delete cases

Signed-off-by: daveaugustus <[email protected]>

* adding stages

Signed-off-by: Aishwarya2001A <[email protected]>

* create aliases status complete code

Signed-off-by: Aishwarya2001A <[email protected]>

* db check for completion of all the stages

Signed-off-by: daveaugustus <[email protected]>

---------

Signed-off-by: daveaugustus <[email protected]>
Signed-off-by: Aishwarya2001A <[email protected]>
Co-authored-by: daveaugustus <[email protected]>
Co-authored-by: Aishwarya2001A <[email protected]>
@Aishwarya2001A
version file
f2ccf70 
Signed-off-by: Aishwarya2001A <[email protected]>
@Aishwarya2001A
elastic sidecar
f29ba70 
Signed-off-by: Aishwarya2001A <[email protected]>
@Aishwarya2001A
elastic sidecar
3b48a23 
Signed-off-by: Aishwarya2001A <[email protected]>
@Aishwarya2001A
config postgres file
78a90ad 
Signed-off-by: Aishwarya2001A <[email protected]>
@Aishwarya2001A
service now file
97bbe2a 
Signed-off-by: Aishwarya2001A <[email protected]>
@Aishwarya2001A
service now file
fdbb2a7 
Signed-off-by: Aishwarya2001A <[email protected]>
@Aishwarya2001A
heartbeat
6d1008d 
Signed-off-by: Aishwarya2001A <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Dmaddu Dmaddu Awaiting requested review from Dmaddu

Assignees
No one assigned
Labels
documentation Anything related to the Automate docs.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@daveaugustus @Aishwarya2001A @rensycthomas @chef-ci @punitmundra @vivekshankar1