Add Tuner class

[omkar-334]

What does this PR do?

This PR adds the Tuner class and the corresponding tests for it.

#260 cc @SkalskiP

Type of Change

• New feature (non-breaking change that adds functionality)

Testing

• I have tested this change locally
• I have added/updated tests for this change

Checklist

• My code follows the style guidelines of this project
• I have performed a self-review of my own code
• I have commented my code where necessary, particularly in hard-to-understand areas
• My changes generate no new warnings or errors
• I have updated the documentation accordingly (if applicable)

Additional Context

[omkar-334]

@SkalskiP here's the colab for testing this out - https://colab.research.google.com/drive/1Y9l8SIYUdRwDChzh73ScobSZ59n0kgZG?usp=sharing

Since we're saving the optuna study as a class variable, the user has the convenience of plotting it or saving it too. I think this is nice.

[omkar-334]

[SkalskiP]

Hi @omkar-334, this is so cool! 🔥 I'm so excited for this feature.

Is there a way we could summerize those experiments in a table? Or return information about all experiments at the end of tuning?

[omkar-334]

Is there a way we could summerize those experiments in a table? Or return information about all experiments at the end of tuning?

hey @SkalskiP , optuna has study.trials_dataframe() built-in which returns a proper DataFrame with all trial info.

This is really handy and since we already save the optuna study as a class variable, the user can access it anytime.

[omkar-334]

hey @SkalskiP , just a nudge, can you review this

[SkalskiP]

Hi @omkar-334, I’m very sorry. I was sick all week. I only started to feel a bit better yesterday, so today I’m getting back to GitHub.

[omkar-334]

Hi @omkar-334, I’m very sorry. I was sick all week. I only started to feel a bit better yesterday, so today I’m getting back to GitHub.

no worries, @SkalskiP ... take care. I was working on the 3rd part. will make a PR for this after you review this.
Thanks!