Nicholson/petsc+metis

[nkoukpaizan]

Merge request type

• New feature
• Resolves bug
• Documentation
• Other

Relates to

• OPFLOW
• SOPFLOW
• SCOPFLOW
• TCOPFLOW
• CMake build system
• Spack configuration
• Manual
• Web docs
• Other

This MR updates

• Header files
• Source code
• CMake build system
• Spack configuration
• Web docs
• Manual
• Other

Summary

This changes the PETSc build configuration on frontier to depend on metis (parmetis when +mpi).

• Changed the rocmcc version used to build PETSc to 6.3.1 to match what we are using to build other codes.
• Changed the default build type from Debug to RelWithDebInfo for clang-hip (e.g., Frontier). Users building with the scripts more likely want an optimized build, and developers should know how to set their desired build type.

Linked Issue(s)

This does not fix existing issues (e.g., segfault when running with larger systems), but it does not hurt to merge it.