- 
                Notifications
    
You must be signed in to change notification settings  - Fork 73
 
A blog post about Computo #1177
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change | 
|---|---|---|
| 
          
            
          
           | 
    @@ -28,3 +28,5 @@ resources/_gen | |
| /layouts/shortcodes/blogdown | ||
| /.quarto/ | ||
| translations.R | ||
| 
     | 
||
| **/*.quarto_ipynb | ||
| Original file line number | Diff line number | Diff line change | 
|---|---|---|
| @@ -0,0 +1,9 @@ | ||
| --- | ||
| name: Aymeric Stamm | ||
| bio: Research engineer in Statistics at CNRS. Specialized in developing novel statistical methods for analyzing complex data, such as manifold-valued data, network-valued data, topological data, connectome data and so on. Applications in neuroscience and gait analysis. Actively contributing to the open-source community to foster a collaborative science globewise. Technical support team member of Computo journal. | ||
| link: https://astamm.github.io | ||
| github: astamm | ||
| orcid: 0000-0002-8725-3654 | ||
| linkedin: https://www.linkedin.com/in/aymeric-stamm-65a420179/ | ||
| img: img/community/aymeric-stamm.jpg | ||
| --- | 
| Original file line number | Diff line number | Diff line change | 
|---|---|---|
| @@ -0,0 +1,9 @@ | ||
| --- | ||
| name: François-David Collin | ||
| bio: Research engineer in LLMs, statistics and machine learning at CNRS, Alexander Grotendieck Montpellier Institute (IMAG), Montpellier University, France. Technical support team member of Computo journal. Part-time lecturer at MIASHS, Paul Valery University. | ||
| link: https://fradav.perso.math.cnrs.fr | ||
| twitter: LuinGor | ||
| github: fradav | ||
| orcid: 0000-0002-8374-7163 | ||
| linkedin: fradav | ||
| --- | 
| Original file line number | Diff line number | Diff line change | 
|---|---|---|
| @@ -0,0 +1,9 @@ | ||
| --- | ||
| name: Julien Chiquet | ||
| bio: Senior Researcher in Statistics and Machine Learning. EiC of Computo. | ||
| link: https://jchiquet.github.io/ | ||
| github: jchiquet | ||
| orcid: 0000-0002-3629-3429 | ||
| linkedin: jchiquet | ||
| img: img/community/julien-chiquet.jpg | ||
| --- | 
| Original file line number | Diff line number | Diff line change | 
|---|---|---|
| @@ -0,0 +1,9 @@ | ||
| --- | ||
| name: Marie-Pierre Etienne | ||
| bio: Interested in Statistical ecology and statistics for stochastic processes. | ||
| link: https://marieetienne.github.io/ | ||
| github: MarieEtienne | ||
| orcid: 0000-0002-2097-2267 | ||
| linkedin: marie-pierre-etienne | ||
| img: img/community/marie-pierre-etienne.jpg | ||
| --- | 
| Original file line number | Diff line number | Diff line change | 
|---|---|---|
| @@ -0,0 +1,7 @@ | ||
| --- | ||
| name: Nelle Varoquaux | ||
| bio: Researcher in machine learning and causal inference methods to better understand structure, function, regulation, and evolution of genomes. | ||
| link: https://nellev.github.io/ | ||
| github: nellev | ||
| orcid: 0000-0002-8748-6546 | ||
| --- | 
| Original file line number | Diff line number | Diff line change | 
|---|---|---|
| @@ -0,0 +1,9 @@ | ||
| --- | ||
| name: Pierre Neuvial | ||
| bio: Statistician specialized in High-Dimensional Statistics and Multiple Testing. | ||
| link: https://www.math.univ-toulouse.fr/~pneuvial/ | ||
| github: pneuvial | ||
| orcid: 0000-0003-3584-9998 | ||
| linkedin: pierre-neuvial-50027316 | ||
| img: img/community/pierre-neuvial.jpg | ||
| --- | 
| Original file line number | Diff line number | Diff line change | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| @@ -0,0 +1,92 @@ | ||||||||||
| --- | ||||||||||
| title: Computo - A Journal for Transparent and Reproducible Research in Statistics and Machine Learning | ||||||||||
| author: | ||||||||||
| - Julien Chiquet | ||||||||||
| - François-David Collin | ||||||||||
| - Marie-Pierre Etienne | ||||||||||
| - Aymeric Stamm | ||||||||||
| - Nelle Varoquaux | ||||||||||
| slug: computo-journal-reproducible-research-statistics-machine-learning | ||||||||||
| date: '2025-11-06' | ||||||||||
| tags: | ||||||||||
| - software-peer-review | ||||||||||
| - reproducible research | ||||||||||
                
      
                  astamm marked this conversation as resolved.
               
          
            Show resolved
            Hide resolved
         | 
||||||||||
| - open science | ||||||||||
| - statistics | ||||||||||
| - machine learning | ||||||||||
| - R | ||||||||||
| - community | ||||||||||
| description: "[Computo](https://computo-journal.org) is a journal promoting methodological, computational, and algorithmic contributions in statistics and machine learning that provide a better understanding of which models or methods are most appropriate to answer specific scientific questions. Computo leverages modern tools in programming and scientific reporting to support more transparent, interactive, and reproducible research outputs." | ||||||||||
| socialImg: https://computo-journal.org/assets/img/logo_text_vertical.svg | ||||||||||
| socialAlt: Computo logo | ||||||||||
| editor: Steffi LaZerte | ||||||||||
| params: | ||||||||||
| doi: "10.59350/6pnct-5cj35" | ||||||||||
| --- | ||||||||||
| 
     | 
||||||||||
| {{< imgtxt src="https://computo-journal.org/assets/img/logo_text_vertical.svg" alt="Computo logo" link="https://computo-journal.org/site/about.html" >}} | ||||||||||
| 
         There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. This link isn't working at the moment, but I've opened an issue (#1181) as I think it's a website issue. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. In the browser, it works fine. I would not know how to help debug this further. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Oh glad to hear it works for you, perhaps it's a browser-related thing. At any rate Maëlle pushed a fix (it wasn't your problem 😁) so we're hopefully good to go!  | 
||||||||||
| [Computo](https://computo-journal.org) is a journal promoting methodological, computational, and algorithmic contributions in statistics and machine learning that provide a better understanding of which models or methods are most appropriate to answer specific scientific questions. Computo leverages modern tools in programming and scientific reporting to support more transparent, interactive, and reproducible research outputs. | ||||||||||
| 
         There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Perhaps add something explicitly explaining why an article about Computo is on the rOpenSci blog? e.g., add a sentence at the end like "We're excited to introduce Computo to the rOpenSci community as a complementary...."  | 
||||||||||
| {{</ imgtxt >}} | ||||||||||
| 
     | 
||||||||||
| ## Why we created Computo | ||||||||||
| 
     | 
||||||||||
| The idea of Computo was born out of a need to address several challenges in the current scientific publishing landscape, particularly within statistics and machine learning. While the reproducibility crisis is a significant concern, with an increasing volume of publications straining the review process and potentially impacting quality \[1\], Computo also aims to foster a deeper scientific understanding. | ||||||||||
| 
         There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I'm a bit unclear about which challenges Computo aims to address. The reproducivility crisis? The strain fo the increasing volume of publications on the review process? What do you think of the following suggestion? 
        Suggested change
       
    
 There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I will check with the editorial board today and get back to you on this later in the day. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. 
        Suggested change
       
    
  | 
||||||||||
| 
     | 
||||||||||
| The rapid proliferation of new methods in machine learning and statistics can make it difficult to establish a clear state of the art for specific scientific questions. There is often a lack of established, subject-specific benchmark datasets, and the pressure to demonstrate the superiority of novel methods can sometimes lead to less-than-objective performance evaluations. Furthermore, publishing negative results (e.g. failure to demonstrate a statistically significant improvement), which are crucial for scientific progress, remains challenging. | ||||||||||
| 
         There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I feel like there's something missing in "A clear state of the art [---] for specific scientific questions.".  | 
||||||||||
| 
     | 
||||||||||
| Computo was created to promote methodological and algorithmic contributions that not only are reproducible but also provide a better understanding of which models or methods are most appropriate to answer specific scientific questions. We believe that building up solid scientific knowledge requires both the reproducibility of published results and a clear articulation of their scientific implications. While many journals now require code and data, these are often insufficient on their own to ensure true reproducibility or to fully grasp the scientific contribution. | ||||||||||
| 
     | 
||||||||||
| [^1]: Hanson, M. A., Barreiro, P. G., Crosetto, P., & Brockington, D. (2024). The strain on scientific publishing. Quantitative Science Studies, 5(4), 823-843. | ||||||||||
| 
     | 
||||||||||
| ## What Computo offers | ||||||||||
| 
     | 
||||||||||
| Computo differs from other existing journals both in its scope and in the centrality given to reproducibility and open science. | ||||||||||
| 
     | 
||||||||||
| ### Scope | ||||||||||
| 
     | 
||||||||||
| Computo welcomes a range of contributions in statistics and machine learning: | ||||||||||
| 
     | 
||||||||||
| - New methods with original stats/ML developments, or numerical studies that illustrate theoretical results in stats/ML; | ||||||||||
| 
     | 
||||||||||
| - Case studies or surveys on stats/ML methods to address a specific (type of) question in data analysis, neutral comparison studies that provide insight into when, how, and why the compared methods perform well or less well; | ||||||||||
| 
     | 
||||||||||
| - Software/tutorial papers to present implementations of stats/ML algorithms or to feature the use of a package/toolbox. For such papers we expect not only the description of an existing implementation but also the study of a concrete use case. If applicable, a comparison to related works and appropriate benchmarking are also expected. | ||||||||||
| 
     | 
||||||||||
| ### Reproducibility and open science | ||||||||||
| 
     | 
||||||||||
| By combining open access, reproducibility, and methodological clarity, Computo aims to support the scientific community in making informed and transparent choices in data analysis: | ||||||||||
| 
     | 
||||||||||
| - Computo is an online-only journal, under the [diamond open access](https://en.wikipedia.org/wiki/Diamond_open_access "diamond open access") publication model, free for authors and readers; | ||||||||||
| 
     | 
||||||||||
| - Computo systematically makes all exchanges between authors and reviewers available: reviews are often very useful to readers, and making them available is also a recognition of the important work done by reviewers. To address the fear of some prospective authors that an overly negative review could undermine the chances of later publication, we have chosen to make the reviews available upon publication. Moreover, the reviewers may choose to remain anonymous, as some reviewers do not feel comfortable lifting their anonymity.  | ||||||||||
| 
     | 
||||||||||
| - Computo uses an original publication format that guarantees the reproducibility of results: articles are submitted as notebooks integrating text, code, equations and bibliographic references. Thanks to [Quarto](https://quarto.org/), we are able to support R, Python and Julia. A submission is associated with a git repository (hosted on [GitHub](https://github.com)) configured to demonstrate, dynamically and durably, the reproducibility of the contribution. HTML and PDF versions of the article are automatically built through GitHub Actions. Templates to prepare a new submission are available from the [Computo submission page](https://computo-journal.org/site/guidelines-authors.html "Computo submission page"). | ||||||||||
| 
     | 
||||||||||
| ### Where we are at | ||||||||||
| 
     | 
||||||||||
| Since its inception in late 2022, we have created a robust ecosystem for reproducible science. As of July 2025, we have published 17 articles, and 4 are under review. An example of published paper is given below: | ||||||||||
| 
     | 
||||||||||
| {{< quote footer="Giorgi et al." cite="[Efficient simulation of individual-based population models, **Computo**, 2024.](https://computo-journal.org/published-202412-giorgi-efficient/)" >}} | ||||||||||
| {{< figure src="https://codimd.math.cnrs.fr/uploads/upload_3627015bebde47d40c656be41d76c014.png" alt="Efficient simulation of individual-based population models" >}} | ||||||||||
| {{< /quote >}} | ||||||||||
| 
     | 
||||||||||
| ### Collaboration and challenges | ||||||||||
| 
     | 
||||||||||
| We use [GitHub to host our repositories](https://github.com/computorg) and Quarto for document creation, ensuring that all code and data are openly available (contributions for GitLab support are welcome!). This collaborative approach has allowed us to overcome numerous challenges, from technical hurdles to ensuring the quality and reproducibility of published work. | ||||||||||
| 
     | 
||||||||||
| One significant challenge has been refining our peer-review process to balance rigor with accessibility. We\'ve explored various platforms and are currently considering a future move towards a more community-driven and transparent system to enhance engagement. | ||||||||||
| 
     | 
||||||||||
| A more fundamental challenge lies in defining and evaluating the true reproducibility of scientific work. We distinguish between "editorial reproducibility" – the ability to re-run the provided code and obtain the same outputs – and "scientific reproducibility," which delves deeper into the robustness and generalizability of the findings. Establishing clear guidelines and policies for this, especially in complex fields like Deep Learning, has been a continuous effort. For instance, evaluating a Deep Learning paper where retraining a model might be infeasible or beyond the scope of the submitted work requires careful consideration of what constitutes a "reproducible" contribution from a scientific standpoint, beyond just code execution. | ||||||||||
| 
     | 
||||||||||
| ## The future of Computo | ||||||||||
| 
     | 
||||||||||
| With a shared focus on improving the quality of scientific contributions, rOpenSci and Computo offer complementary approaches to fostering reproducible research. rOpenSci (and by extension pyOpenSci for the Python side) focuses on the reliability and robustness of software tools through a transparent, community-driven peer review process. Computo, in turn, ensures that these tools are used in transparent and fully reproducible computational scientific articles, preserving code, data, and environment specifications. | ||||||||||
| 
     | 
||||||||||
| Looking ahead, we aim to further enhance the dissemination of scientific knowledge by moving towards greater interactivity, richer data visualizations, and exploring innovative communication models, drawing inspiration from initiatives like the former [distill.pub](https://distill.pub). Our approach is to progressively engage all stakeholders: editors, engineers, authors, and the wider scientific community in this evolution. | ||||||||||
| 
     | 
||||||||||
| Our concrete next steps focus on: | ||||||||||
| 
     | 
||||||||||
| * **Streamlining Workflows and Tools:** Consolidating our editorial process, potentially within a more community-focused environment, and expanding authoring tools with user-friendly computational environments for pre-submission. | ||||||||||
| * **Ensuring Long-Term Access and Innovation:** Deploying a robust platform for long-term reproducibility, including on-the-fly container creation and archiving, while continuing to explore and integrate novel ways to present and interact with scientific findings. | ||||||||||
| 
     | 
||||||||||
| We look forward to continuing our journey with the support of our community and partners like rOpenSci. | ||||||||||
| 
         There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Since we don't have a formal partnership, perhaps use slightly different wording (to avoid people thinking that our peer-review processes are linked, for example). 
        Suggested change
       
    
  | 
||||||||||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You'll need to use
françois-david-collinas the folder name to ensure this works correctly (i.e. keep special characters)