Skip to content

Conversation

petewall
Copy link
Contributor

@petewall petewall commented Jul 23, 2025

Use the Helm Chart Toolbox to run Helm chart integration tests in parallel. Starting with two tests that I found in the ci directory.

Where I'd take this next:

  1. Copy the abc_values.yaml files from the ci directory into the individual test directories. This will keep them in the text directory and "associated" with that test.
  2. Create new tests at least to cover the existing tests run in ci
  3. Stop using chart-testing (aka ct), which is what runs tests sequentially and takes a long time.

At this point, you should see the helm-ci GitHub Action take ~5 minutes, rather than 20+ minutes.

  1. Long-term phase: Split the tests to focus on individual features, rather than packing lots of things into a small amount of tests. Since Helm Chart Toolbox tests will run in parallel, a larger count of smaller tests is better than a handful of complicated tests.
  2. Create more tests!

@CLAassistant
Copy link

CLAassistant commented Jul 23, 2025

CLA assistant check
All committers have signed the CLA.

@petewall petewall force-pushed the petewall/helm-chart-testing branch 2 times, most recently from 160644d to 5ea1d9b Compare July 23, 2025 20:45
Copy link
Contributor

Helm Diff Output - Summary

Default Values Scenario-diff-output
Distributed Scenario-diff-output
Ingress Values Scenario-diff-output
Legacy Monitoring Values Scenario-diff-output
Simple Scalable AWS Kube IRSA Values Scenario-diff-output
Simple Thanos Values Scenario-diff-output
Single Binary Scenario-diff-output

@petewall petewall changed the title Introduce the Helm Chart Toolbox integration tests test: Introduce the Helm Chart Toolbox integration tests Jul 23, 2025
@petewall petewall force-pushed the petewall/helm-chart-testing branch from 33ae0d3 to d29ee37 Compare July 24, 2025 15:49
@petewall petewall marked this pull request as ready for review July 24, 2025 15:49
@petewall petewall requested a review from a team as a code owner July 24, 2025 15:49
@jkroepke
Copy link
Contributor

@petewall
Copy link
Contributor Author

This doesn't include helm unittest. That project rules and stays on its own. Helm Chart Toolbox is something I started to handle making actual cluster-based tests easier and can run in parallel.

@Jayclifford345 Jayclifford345 merged commit 8781d21 into main Aug 1, 2025
77 checks passed
@Jayclifford345 Jayclifford345 deleted the petewall/helm-chart-testing branch August 1, 2025 10:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants