CI: test buildkite branch to not run external stdlib test unless they are updated or on a release branch

[KristofferC]

JuliaCI/julia-buildkite#483

[KristofferC]

EXTERNAL_STDLIBS_SKIPPED: ArgTools DelimitedFiles Distributed Downloads JuliaSyntaxHighlighting LazyArtifacts LibCURL LinearAlgebra NetworkOptions Pkg SHA SparseArrays Statistics StyledStrings SuiteSparse Tar

TESTS is: all --ci --skip ArgTools DelimitedFiles Distributed Downloads JuliaSyntaxHighlighting LazyArtifacts LibCURL LinearAlgebra NetworkOptions Pkg SHA SparseArrays Statistics StyledStrings SuiteSparse Tar

That seems ok, now let's test updating a .version file to see that that stdlib runs.

[DilumAluthge]

┌ Warning: Not skipping tests: LinearAlgebra, SHA, StyledStrings, Pkg, SparseArrays, Distributed, JuliaSyntaxHighlighting, SuiteSparse, ArgTools, LazyArtifacts, NetworkOptions, Statistics, Tar, LibCURL, DelimitedFiles

Seems like we might have a bug somewhere?

For Linux, we have several places where we split up "net" and "non-net" tests into two separate Buildkite jobs. The reasoning for this is that we want to run "non-net" under rr. We don't want to run "net" under rr, because it becomes unbearably slow to e.g. run Pkg tests under rr.

I wonder if the mechanism that we use for splitting up "net" and "non-net" might be interacting badly with the new "skip external stdlibs" logic.

[KristofferC]

EXTERNAL_STDLIBS_SKIPPED: ArgTools DelimitedFiles Distributed Downloads JuliaSyntaxHighlighting LazyArtifacts LibCURL LinearAlgebra NetworkOptions Pkg SHA SparseArrays Statistics StyledStrings SuiteSparse Tar

Seems it didn't detect the .version file change.

[DilumAluthge]

If you run those same Git commands locally (the ones you're using to check for diff), do you get the result you expect?

[KristofferC]

I'll have to add some debug stuff to the pipeline because it is possible the paths are not set up like I thought.

[KristofferC]

Seems to work now. Perhaps ironically, the mistake was a main/master branch name confusion.

EXTERNAL_STDLIBS_SKIPPED: ArgTools DelimitedFiles Distributed Downloads JuliaSyntaxHighlighting LazyArtifacts LibCURL LinearAlgebra NetworkOptions SHA SparseArrays Statistics StyledStrings SuiteSparse Tar

(Note Pkg not in the list).

[KristofferC]

Seems like we might have a bug somewhere?

This happens when you do e.g. make test-Foo --skip Bar it will complain about Bar.