Skip to content

Update evaluation to use new splitters and include updates #769

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 31 commits into
base: develop
Choose a base branch
from

Conversation

bruAristimunha
Copy link
Collaborator

Refactor the evaluation process to utilize new cross-session and cross-subject splitters. Include updates in the "What's New" section to reflect these enhancements.

@bruAristimunha
Copy link
Collaborator Author

Within-Session is so complicated to refactor....

Copy link
Collaborator

@PierreGtch PierreGtch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perfect, thanks @bruAristimunha !

@bruAristimunha bruAristimunha requested a review from PierreGtch May 5, 2025 08:02
@bruAristimunha
Copy link
Collaborator Author

bruAristimunha commented May 5, 2025

I think with this, we solved the parallel issue for the main functions' evaluation functions. The main question is how we can handle grid_search that has some parallel behaviour.

I feel we should mix a parallel backend in this context (loky main and thread for gridsearch). Like, how I pushed....

@PierreGtch
Copy link
Collaborator

@bruAristimunha I think we discussed about deprecating grid search at some point, such that it would be included in the pipelines directly, not the evaluations

@bruAristimunha
Copy link
Collaborator Author

I push the comments about gridsearch to another issue... Too complicated for now, let's start to use the splitter that we spent a lot of time doing >.<

Copy link
Collaborator

@tomMoral tomMoral left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A first batch of comments

bruAristimunha and others added 2 commits May 6, 2025 23:24
Copy link
Collaborator

@PierreGtch PierreGtch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All good on my side :) Just one comment but for a future PR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants