Integrating the Kubeflow Spark Application with the Kubeflow Pipeline

[CrashCumber]

Hello! I hope you can help me with my question.
I'm trying to integrate a Kubeflow Spark Application into a Kubeflow Pipeline using the KFP SDK v2, but I'm having trouble figuring out how to do it.

What I want to do is run the Kubeflow Spark Application as part of a Kubeflow Pipeline, and have it trigger other tasks when it finishes.
Is there a way to directly integrate the Spark Application with the pipeline using the KFP SDK v2?

In version 1, we could use Kubernetes components to run Spark applications as a component, but those components have been removed from the repository in version 2 and the syntax no longer works.

Can you help me figure out how to make this work with the new version of the SDK?