Skip to content

Commit d0bef75

Browse files
pohlypohly
committed
sig-testing: add alpha/beta enabled and conformance periodic jobs
This mirrors the presubmit counterparts that were added in kubernetes#35534 and tested in kubernetes/kubernetes#134250. I can help monitor the existing alpha/beta features jobs. Those need to be renamed in testgrid to avoid confusion. Other than that they remain unchanged for now. Potential future work: - Changes related to serial and/or slow jobs. Serial tests are excluded implicitly by e2e-k8s.sh because the jobs enables PARALLEL (kubernetes#35594). Slow jobs are disabled in LABEL_FILTER because that is what the existing periodics did. We might be able to run them because as long as they overlap with other tests there shouldn't be much impact on overall job duration (same applies to presubmits!). Scheduling of slow tests may be relevant (onsi/ginkgo#1599). - Release informing/blocking. The existing jobs are release informing. alpha-beta-features shouldn't be because breaking alpha tests is not something that the release team should have to deal with. Instead, the new jobs should get promoted once they are known to be stable. beta-features can remain release informing, tests for beta features (even if off-by-default) need to be stable. - Decision about "enabled-conformance". The conformance jobs got included because it was suggested on Slack. They run a subset of the tests run by their "enabled" counterparts. It remains to be seen whether having two jobs instead of one really provides a better release signal.
1 parent 5403aee commit d0bef75

File tree

1 file changed

+203
-4
lines changed

1 file changed

+203
-4
lines changed

‎config/jobs/kubernetes/sig-testing/kubernetes-kind-ci.yaml‎

Lines changed: 203 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -105,9 +105,9 @@ periodics:
105105
name: ci-kubernetes-e2e-kind-beta-features
106106
annotations:
107107
testgrid-dashboards: sig-release-master-informing, sig-testing-kind
108-
testgrid-tab-name: kind-master-beta
108+
testgrid-tab-name: kind-master-beta-features
109109
description: Runs tests with no special requirements other than beta feature gates in a KinD cluster where beta feature gates and APIs are enabled.
110-
testgrid-alert-email: [email protected],[email protected],[email protected]
110+
testgrid-alert-email: [email protected],[email protected],[email protected],[email protected]
111111
testgrid-num-columns-recent: '6'
112112
labels:
113113
preset-dind-enabled: "true"
@@ -149,14 +149,112 @@ periodics:
149149
memory: 9Gi
150150
cpu: 7
151151

152+
- interval: 4h
153+
cluster: k8s-infra-prow-build
154+
name: ci-kubernetes-e2e-kind-beta-enabled
155+
annotations:
156+
testgrid-dashboards: sig-testing-kind
157+
testgrid-tab-name: kind-master-beta-enabled
158+
description: Runs tests with no special requirements in a KinD cluster where beta feature gates and APIs are enabled, i.e. this does not include tests for off-by-default beta features.
159+
testgrid-alert-email: [email protected],[email protected],[email protected]
160+
testgrid-num-columns-recent: '6'
161+
labels:
162+
preset-dind-enabled: "true"
163+
decorate: true
164+
decoration_config:
165+
timeout: 60m
166+
extra_refs:
167+
- org: kubernetes
168+
repo: kubernetes
169+
base_ref: master
170+
path_alias: k8s.io/kubernetes
171+
spec:
172+
containers:
173+
- image: gcr.io/k8s-staging-test-infra/krte:v20250925-95b5a2c7a5-master
174+
command:
175+
- wrapper.sh
176+
- bash
177+
- -c
178+
- curl -sSL https://kind.sigs.k8s.io/dl/latest/linux-amd64.tgz | tar xvfz - -C "${PATH%%:*}/" && e2e-k8s.sh
179+
env:
180+
- name: FEATURE_GATES
181+
value: '{"AllBeta":true}'
182+
- name: RUNTIME_CONFIG
183+
value: '{"api/beta":"true", "api/ga":"true"}'
184+
- name: LABEL_FILTER
185+
value: "Feature: isEmpty && !Alpha && !Deprecated && !Slow && !Disruptive && !Flaky"
186+
- name: PARALLEL
187+
value: "true"
188+
# we need privileged mode in order to do docker in docker
189+
securityContext:
190+
privileged: true
191+
resources:
192+
limits:
193+
memory: 9Gi
194+
cpu: 7
195+
requests:
196+
# these are both a bit below peak usage during build
197+
# this is mostly for building kubernetes
198+
memory: 9Gi
199+
cpu: 7
200+
201+
- interval: 4h
202+
cluster: k8s-infra-prow-build
203+
name: ci-kubernetes-e2e-kind-beta-enabled-conformance
204+
annotations:
205+
testgrid-dashboards: sig-testing-kind
206+
testgrid-tab-name: kind-master-beta-enabled-conformance
207+
description: Runs conformance tests in a KinD cluster where beta feature gates and APIs are enabled.
208+
testgrid-alert-email: [email protected],[email protected],[email protected]
209+
testgrid-num-columns-recent: '6'
210+
labels:
211+
preset-dind-enabled: "true"
212+
decorate: true
213+
decoration_config:
214+
timeout: 60m
215+
extra_refs:
216+
- org: kubernetes
217+
repo: kubernetes
218+
base_ref: master
219+
path_alias: k8s.io/kubernetes
220+
spec:
221+
containers:
222+
- image: gcr.io/k8s-staging-test-infra/krte:v20250925-95b5a2c7a5-master
223+
command:
224+
- wrapper.sh
225+
- bash
226+
- -c
227+
- curl -sSL https://kind.sigs.k8s.io/dl/latest/linux-amd64.tgz | tar xvfz - -C "${PATH%%:*}/" && e2e-k8s.sh
228+
env:
229+
- name: FEATURE_GATES
230+
value: '{"AllBeta":true}'
231+
- name: RUNTIME_CONFIG
232+
value: '{"api/beta":"true", "api/ga":"true"}'
233+
- name: LABEL_FILTER
234+
value: "Conformance && !Deprecated && !Slow && !Disruptive && !Flaky"
235+
- name: PARALLEL
236+
value: "true"
237+
# we need privileged mode in order to do docker in docker
238+
securityContext:
239+
privileged: true
240+
resources:
241+
limits:
242+
memory: 9Gi
243+
cpu: 7
244+
requests:
245+
# these are both a bit below peak usage during build
246+
# this is mostly for building kubernetes
247+
memory: 9Gi
248+
cpu: 7
249+
152250
- interval: 4h
153251
cluster: k8s-infra-prow-build
154252
name: ci-kubernetes-e2e-kind-alpha-beta-features
155253
annotations:
156254
testgrid-dashboards: sig-release-master-informing, sig-testing-kind
157-
testgrid-tab-name: kind-master-alpha-beta
255+
testgrid-tab-name: kind-master-alpha-beta-features
158256
description: Runs tests with no special requirements other than alpha or beta feature gates in a KinD cluster where alpha and beta feature gates and APIs are enabled.
159-
testgrid-alert-email: [email protected],[email protected],[email protected]
257+
testgrid-alert-email: [email protected],[email protected],[email protected],[email protected]
160258
testgrid-num-columns-recent: '6'
161259
labels:
162260
preset-dind-enabled: "true"
@@ -177,6 +275,7 @@ periodics:
177275
- -c
178276
- curl -sSL https://kind.sigs.k8s.io/dl/latest/linux-amd64.tgz | tar xvfz - -C "${PATH%%:*}/" && e2e-k8s.sh
179277
env:
278+
# EventedPLEG is disabled temporarily for https://github.com/kubernetes/kubernetes/issues/122721
180279
- name: FEATURE_GATES
181280
value: '{"AllAlpha":true,"AllBeta":true,"EventedPLEG": false}'
182281
- name: RUNTIME_CONFIG
@@ -198,6 +297,106 @@ periodics:
198297
memory: 9Gi
199298
cpu: 7
200299

300+
- interval: 4h
301+
cluster: k8s-infra-prow-build
302+
name: ci-kubernetes-e2e-kind-alpha-beta-enabled
303+
annotations:
304+
testgrid-dashboards: sig-testing-kind
305+
testgrid-tab-name: kind-master-alpha-beta-enabled
306+
description: Runs tests with no special requirements in a KinD cluster where alpha and beta feature gates and APIs are enabled, i.e. this does not include tests for alpha features and off-by-default beta features.
307+
testgrid-alert-email: [email protected],[email protected],[email protected]
308+
testgrid-num-columns-recent: '6'
309+
labels:
310+
preset-dind-enabled: "true"
311+
decorate: true
312+
decoration_config:
313+
timeout: 60m
314+
extra_refs:
315+
- org: kubernetes
316+
repo: kubernetes
317+
base_ref: master
318+
path_alias: k8s.io/kubernetes
319+
spec:
320+
containers:
321+
- image: gcr.io/k8s-staging-test-infra/krte:v20250925-95b5a2c7a5-master
322+
command:
323+
- wrapper.sh
324+
- bash
325+
- -c
326+
- curl -sSL https://kind.sigs.k8s.io/dl/latest/linux-amd64.tgz | tar xvfz - -C "${PATH%%:*}/" && e2e-k8s.sh
327+
env:
328+
# EventedPLEG is disabled temporarily for https://github.com/kubernetes/kubernetes/issues/122721
329+
- name: FEATURE_GATES
330+
value: '{"AllAlpha":true,"AllBeta":true,"EventedPLEG": false}'
331+
- name: RUNTIME_CONFIG
332+
value: '{"api/all":"true"}'
333+
- name: LABEL_FILTER
334+
value: "Feature: isEmpty && !Deprecated && !Slow && !Disruptive && !Flaky"
335+
- name: PARALLEL
336+
value: "true"
337+
# we need privileged mode in order to do docker in docker
338+
securityContext:
339+
privileged: true
340+
resources:
341+
limits:
342+
memory: 9Gi
343+
cpu: 7
344+
requests:
345+
# these are both a bit below peak usage during build
346+
# this is mostly for building kubernetes
347+
memory: 9Gi
348+
cpu: 7
349+
350+
- interval: 4h
351+
cluster: k8s-infra-prow-build
352+
name: ci-kubernetes-e2e-kind-alpha-beta-conformance
353+
annotations:
354+
testgrid-dashboards: sig-testing-kind
355+
testgrid-tab-name: kind-master-alpha-beta-enabled-conformance
356+
description: Runs conformance tests in a KinD cluster where alpha and beta feature gates and APIs are enabled.
357+
testgrid-alert-email: [email protected],[email protected],[email protected]
358+
testgrid-num-columns-recent: '6'
359+
labels:
360+
preset-dind-enabled: "true"
361+
decorate: true
362+
decoration_config:
363+
timeout: 60m
364+
extra_refs:
365+
- org: kubernetes
366+
repo: kubernetes
367+
base_ref: master
368+
path_alias: k8s.io/kubernetes
369+
spec:
370+
containers:
371+
- image: gcr.io/k8s-staging-test-infra/krte:v20250925-95b5a2c7a5-master
372+
command:
373+
- wrapper.sh
374+
- bash
375+
- -c
376+
- curl -sSL https://kind.sigs.k8s.io/dl/latest/linux-amd64.tgz | tar xvfz - -C "${PATH%%:*}/" && e2e-k8s.sh
377+
env:
378+
# EventedPLEG is disabled temporarily for https://github.com/kubernetes/kubernetes/issues/122721
379+
- name: FEATURE_GATES
380+
value: '{"AllAlpha":true,"AllBeta":true,"EventedPLEG": false}'
381+
- name: RUNTIME_CONFIG
382+
value: '{"api/all":"true"}'
383+
- name: LABEL_FILTER
384+
value: "Conformance && !Deprecated && !Slow && !Disruptive && !Flaky"
385+
- name: PARALLEL
386+
value: "true"
387+
# we need privileged mode in order to do docker in docker
388+
securityContext:
389+
privileged: true
390+
resources:
391+
limits:
392+
memory: 9Gi
393+
cpu: 7
394+
requests:
395+
# these are both a bit below peak usage during build
396+
# this is mostly for building kubernetes
397+
memory: 9Gi
398+
cpu: 7
399+
201400
- interval: 24h
202401
cluster: k8s-infra-prow-build
203402
name: ci-kubernetes-e2e-kind-rootless

0 commit comments

Comments
 (0)