Skip to content

Commit ec61727

Browse files
authored
Merge pull request #229 from ACCLAB/vnbdev
Updating citations and minor fixes to blog posts
2 parents 1a35068 + 219eeca commit ec61727

5 files changed

Lines changed: 117 additions & 116 deletions

File tree

README.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -132,15 +132,15 @@ Please refer to the official [tutorial](https://acclab.github.io/DABEST-python/)
132132

133133
## How to cite
134134

135-
**Getting over ANOVA: Estimation graphics for multi-group comparisons**
135+
**Getting over ANOVA: estimation graphics for multi-group comparisons**
136136

137-
*Zinan Lu, Jonathan Anns, Yishan Mai, Rou Zhang, Kahseng Lian, Nicole MynYi Lee, Shan Hashir, Lucas Wang Zhuoyu, A. Rosa Castillo Gonzalez, Joses Ho, Hyungwon Choi, Sangyu Xu, Adam Claridge-Chang*
137+
*Zinan Lu, Jonathan Anns, Yishan Mai, Rou Zhang, Kahseng Lian, Nicole MynYi Lee, Shan Hashir, Lucas Zhuoyu Wang, Yixuan Li, A. Rosa Castillo Gonzalez, Joses Ho, Hyungwon Choi, Sangyu Xu, Adam Claridge-Chang*
138138

139-
bioRxiv preprint 2026. [10.64898/2026.01.26.701654](http://dx.doi.org/10.64898/2026.01.26.701654)
139+
Nature Methods 2026, 1548-7105. [10.1038/s41592-026-03187-7](https://doi.org/10.1038/s41592-026-03187-7)
140140

141-
[PDF](https://www.biorxiv.org/content/10.64898/2026.01.26.701654v1.full.pdf)
141+
[Paywalled publisher site](https://www.nature.com/articles/s41592-026-03187-7)
142142

143-
**Moving beyond P values: Everyday data analysis with estimation plots**
143+
**Moving beyond P values: data analysis with estimation graphics**
144144

145145
*Joses Ho, Tayfun Tumkaya, Sameer Aryal, Hyungwon Choi, Adam Claridge-Chang*
146146

@@ -164,7 +164,7 @@ If you have any specific comments and ideas for new features that you would like
164164

165165
## Acknowledgements
166166

167-
We would like to thank alpha testers from the [Claridge-Chang lab](https://www.claridgechang.net/): [Sangyu Xu](https://github.com/sangyu), [Xianyuan Zhang](https://github.com/XYZfar), [Farhan Mohammad](https://github.com/farhan8igib), Jurga Mituzaitė, and Stanislav Ott.
167+
We would like to thank alpha testers from the [Claridge-Chang lab](https://www.claridgechang.net/): [Sangyu Xu](https://github.com/sangyu), [Xianyuan Zhang](https://github.com/XYZfar), [Farhan Mohammad](https://github.com/farhan8igib), Jurga Mituzaitė, Stanislav Ott, [Tayfun Tumkaya](https://github.com/ttumkaya), [Jonathan Anns](https://github.com/JAnns98), [Nicole Lee](https://github.com/mnicolee) and [Yishan Mai](https://github.com/maiyishan).
168168

169169
## Testing
170170

nbs/03-citation.ipynb

Lines changed: 10 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,9 +15,17 @@
1515
"source": [
1616
"\n",
1717
"\n",
18-
"If your publication features a graphic generated with this software library, please cite the following publication.\n",
18+
"If your publication features a graphic generated with this software library, please cite the following publications.\n",
1919
"\n",
20-
"**Moving beyond P values: Everyday data analysis with estimation plots**\n",
20+
"**Getting over ANOVA: estimation graphics for multi-group comparisons**\n",
21+
"Zinan Lu, Jonathan Anns, Yishan Mai, Rou Zhang, Kahseng Lian, Nicole MynYi Lee, Shan Hashir, Lucas Zhuoyu Wang, Yixuan Li, A. Rosa Castillo Gonzalez, Joses Ho, Hyungwon Choi, Sangyu Xu, Adam Claridge-Chang\n",
22+
"\n",
23+
"`Nature Methods` 2026, 1548-7105. [doi:10.1038/s41592-026-03187-7](https://doi.org/10.1038/s41592-026-03187-7)\n",
24+
"\n",
25+
"[Paywalled publisher site](https://www.nature.com/articles/s41592-026-03187-7)\n",
26+
"\n",
27+
"\n",
28+
"**Moving beyond P values: data analysis with estimation graphics**\n",
2129
"Joses Ho, Tayfun Tumkaya, Sameer Aryal, Hyungwon Choi, Adam Claridge-Chang\n",
2230
"\n",
2331
"`Nature Methods` 2019, 1548-7105. [doi:10.1038/s41592-019-0470-3](https://doi.org/10.1038/s41592-019-0470-3)\n",

nbs/blog/posts/dabesties-over-the-years/dabesties-over-the-years.ipynb

Lines changed: 21 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -7,8 +7,9 @@
77
"source": [
88
"---\n",
99
"date: \"2026-08-03\"\n",
10-
"title: 'DABESTies over the years'\n",
11-
"subtitle: 'Who are our DABESTies? 7 years later, here’s what we found.'\n",
10+
"title: 'Tracking DABEST adoption'\n",
11+
"subtitle: 'Seven years after DABEST was introduced in 2019, we looked back at its adoption across the literature.'\n",
12+
"image: figure-2.svg\n",
1213
"---"
1314
]
1415
},
@@ -25,47 +26,47 @@
2526
"id": "c3d1e5a7",
2627
"metadata": {},
2728
"source": [
28-
"In 1978, Kenneth Rothman argued in the *New England Journal of Medicine* [\\[1\\]](#1) that confidence intervals should replace significance tests. He spent years trying to make that happen. As an editor at the *American Journal of Public Health*, he required authors to report confidence intervals instead of p-values, reducing sole reliance on p-values from 63% to 5% [\\[2\\]](#2). When he founded [*Epidemiology*](https://www.ovid.com/jnls/epidem) in 1990, he went further and banned p-values altogether. On paper, it looked like a success. But when Fidler and colleagues [\\[2\\]](#2) examined those papers, they found that while authors had dutifully reported confidence intervals, very few actually used them to interpret their results. The policy was eventually abandoned."
29+
"Knowing whether a result is statistically significant is not the same as understanding what the data shows. In 1978, Kenneth Rothman argued in the *New England Journal of Medicine* [\\[1\\]](#1) that confidence intervals should replace significance tests. He spent years trying to make that happen. As an editor at the *American Journal of Public Health*, he required authors to report confidence intervals instead of p-values, reducing sole reliance on p-values from 63% to 5% [\\[2\\]](#2). When he founded [*Epidemiology*](https://www.ovid.com/jnls/epidem) in 1990, he went further and banned p-values altogether. On paper, it looked like a success. But when Fidler and colleagues [\\[2\\]](#2) examined those papers, they found that while authors had dutifully reported confidence intervals, very few actually used them to interpret their results. The policy was eventually abandoned."
2930
]
3031
},
3132
{
3233
"cell_type": "markdown",
3334
"id": "e5f3a7c9",
3435
"metadata": {},
3536
"source": [
36-
"That history was very much on our minds. We wanted to make it easier for people to think about their data by giving them a practical way to visualize estimation statistics. That led us to publish *Moving beyond P values: data analysis with estimation graphics* [\\[3\\]](#3) in *Nature Methods*, alongside DABEST [\\[4\\]](#4), the software that generates those figures."
37+
"That history was very much on our minds when we first published *Moving beyond P values: data analysis with estimation graphics* [\\[3\\]](#3) in *Nature Methods*, alongside DABEST [\\[4\\]](#4), the software that generates those figures. We wanted to make it easier for people to think about their data by giving them a practical way to visualize estimation statistics."
3738
]
3839
},
3940
{
4041
"cell_type": "markdown",
4142
"id": "978aff1c",
4243
"metadata": {},
4344
"source": [
44-
"Our paper also became part of a broader conversation about how estimation statistics should be reported. Just six weeks after our paper was published, *eNeuro* launched an initiative encouraging authors to adopt estimation statistics, alongside a perspective by Calin-Jageman and Cumming [\\[5\\]](#5) explaining the rationale. In early 2020, Editor-in-Chief Christophe Bernard asked Reviewing Editors \\[[6](#6), [7](#7)\\] to identify papers that could benefit from converting to estimation statistics, and 100 were flagged. Across the journal, 52 papers published that year included estimation statistics. By any reasonable measure, the initiative worked, but what caught our attention was how *eNeuro* framed that success. The follow-up editorial [\\[7\\]](#7) presents estimation as something authors can layer on top of conventional significance testing rather than in place of it, and Bernard goes as far as saying that in some cases the p-value stops being necessary at all. "
45+
"Our paper also became part of a broader conversation about how estimation statistics should be reported. Just six weeks after our paper was published, *eNeuro* launched an initiative encouraging authors to adopt estimation statistics as something to layer on top of existing practice rather than replace it [\\[5\\]](#5), alongside a perspective by Calin-Jageman and Cumming [\\[6\\]](#6) explaining the rationale. In early 2020, Editor-in-Chief Christophe Bernard asked Reviewing Editors [\\[7\\]](#7) to identify papers that could benefit from converting to estimation statistics, and 100 were flagged. Across the journal, 52 papers published that year included estimation statistics. The initiative clearly succeeded in increasing the use of estimation statistics, although Bernard noted that in some cases p-values may no longer be necessary."
4546
]
4647
},
4748
{
4849
"cell_type": "markdown",
4950
"id": "f6a4b8d1",
5051
"metadata": {},
5152
"source": [
52-
"Seven years after we released DABEST, we wanted to know who our DABESTies are, and what they actually did with it. We pulled every work citing the 2019 paper from OpenAlex [\\[8\\]](#8). After removing papers from our own lab, preprints and duplicate records, we were left with 1,266 citations from 2018 through 2025, with another 89 so far in 2026 **(Figure 1)**. DABEST has now been cited across 660 journals, 25 research fields, and ~638 institutions."
53+
"Seven years after we released DABEST, we wanted to know if anything had changed. What did the people who picked it up actually do with it? We pulled every work citing the 2019 paper from OpenAlex [\\[8\\]](#8). After removing papers from our own lab, preprints and duplicate records, we were left with 1,266 citations from 2018 through 2025, with another 89 so far in 2026 **(Figure 1)**. DABEST has now been cited across 660 journals, 25 research fields, and ~638 institutions."
5354
]
5455
},
5556
{
5657
"cell_type": "markdown",
5758
"id": "b8c6d1f3",
5859
"metadata": {},
5960
"source": [
60-
"![](figure-1.svg)"
61+
"![](figure-1.svg){fig-align=\"center\" width=\"100%\"}"
6162
]
6263
},
6364
{
6465
"cell_type": "markdown",
6566
"id": "c9d7e2a4",
6667
"metadata": {},
6768
"source": [
68-
"<p style=\"color:#6c757d;\"><b>Figure 1.</b> Works citing DABEST per year excluding our lab’s work, preprints, and duplicate records.</p>"
69+
"<p style=\"color:#6c757d; font-size:calc(1em - 2px); line-height:1.2;\"><b>Figure 1.</b> Works citing DABEST per year excluding our lab’s work, preprints, and duplicate records.</p>"
6970
]
7071
},
7172
{
@@ -76,76 +77,68 @@
7677
"The two biggest fields are medicine and neuroscience, with 322 and 317 citing papers respectively, followed by biochemistry and molecular biology (217), environmental science (114) and agriculture (113) **(Figure 2)**. Psychology, engineering, computer science and the social sciences all appear further down the list."
7778
]
7879
},
79-
{
80-
"cell_type": "markdown",
81-
"id": "e2f9a4c6",
82-
"metadata": {},
83-
"source": [
84-
"That is a much wider user base than we could ever have surveyed directly, and it is the reason we went to the papers themselves instead. If we wanted to know what people were doing with DABEST, the only reliable place to look was at what they had published."
85-
]
86-
},
8780
{
8881
"cell_type": "markdown",
8982
"id": "f3a1b5d7",
9083
"metadata": {},
9184
"source": [
92-
"![](figure-2.svg)"
85+
"![](figure-2.svg){fig-align=\"center\" width=\"100%\"}"
9386
]
9487
},
9588
{
9689
"cell_type": "markdown",
9790
"id": "a4b2c6e8",
9891
"metadata": {},
9992
"source": [
100-
"<p style=\"color:#6c757d;\"><b>Figure 2.</b> The field breakdown of the 1,355 works citing DABEST, after removing our own lab's papers, preprints and duplicate records.</p>"
93+
"<p style=\"color:#6c757d; font-size:calc(1em - 2px); line-height:1.2;\"><b>Figure 2.</b> The field breakdown of the 1,355 works citing DABEST, after removing our own lab's papers, preprints and duplicate records.</p>"
10194
]
10295
},
10396
{
10497
"cell_type": "markdown",
105-
"id": "b5c3d7f9",
98+
"id": "e2f9a4c6",
10699
"metadata": {},
107100
"source": [
108-
"So we read the 100 most-cited research papers that cited our 2019 paper, excluding reviews, editorials, tutorials and software papers. For each paper, we recorded where the estimation plot appeared and where p-values were reported **(Figure 3)**. Estimation plots reached the main figures in 74 papers, appeared only in the supplement in 19, and were absent in 7. Nearly all 100 of them reported p-values as well."
101+
"That is a much wider user base than we could ever have surveyed directly. To understand how people were actually using DABEST, we turned to the literature."
109102
]
110103
},
111104
{
112105
"cell_type": "markdown",
113106
"id": "c6d4e8a1",
114107
"metadata": {},
115108
"source": [
116-
"![](figure-3.svg)"
109+
"![](figure-3.svg){fig-align=\"center\" width=\"100%\"}"
117110
]
118111
},
119112
{
120113
"cell_type": "markdown",
121114
"id": "d7e5f9b2",
122115
"metadata": {},
123116
"source": [
124-
"<p style=\"color:#6c757d;\"><b>Figure 3.</b> How the 100 scored papers were selected and sorted. The counts in the top two boxes come from the earlier OpenAlex pull, before preprints and duplicates were removed. The six categories at the bottom were built to capture how each paper used DABEST, by recording whether the estimation plot reached a main figure or stayed in the supplement, and how far the p-values travelled alongside it.</p>"
117+
"<p style=\"color:#6c757d; font-size:calc(1em - 2px); line-height:1.2;\"><b>Figure 3.</b> How the 100 scored papers were selected and sorted. The counts in the top two boxes come from the earlier OpenAlex pull, before preprints and duplicates were removed. The six categories at the bottom were built to capture how each paper used DABEST, by recording whether the estimation plot reached a main figure or stayed in the supplement, and how far the p-values travelled alongside it.</p>"
125118
]
126119
},
127120
{
128121
"cell_type": "markdown",
129-
"id": "e8f6a1c3",
122+
"id": "b5c3d7f9",
130123
"metadata": {},
131124
"source": [
132-
"The more revealing picture emerges when the two answers are placed side by side. The single most common arrangement, covering 68 of the 100 papers, was an estimation plot in a main figure with p-values reported in the main text right alongside it. Only two papers combined a main-figure estimation plot with no p-values anywhere at all **(Figure 4)**."
125+
"We read the 100 most-cited research papers that cited our 2019 paper, excluding reviews, editorials, tutorials and software papers. For each paper, we recorded two things: where the estimation plot appeared and where p-values were reported **(Figure 3)**. Estimation plots reached the main figures in 74 papers, appeared only in the supplement in 19, and were absent in 7. Nearly all 100 of them reported p-values as well. The single most common arrangement, covering 68 of the 100 papers, was an estimation plot in a main figure with p-values reported in the main text right alongside it. Only two papers combined a main-figure estimation plot with no p-values anywhere at all **(Figure 4)**."
133126
]
134127
},
135128
{
136129
"cell_type": "markdown",
137130
"id": "f9a7b2d4",
138131
"metadata": {},
139132
"source": [
140-
"![](figure-4.svg)"
133+
"![](figure-4.svg){fig-align=\"center\" width=\"100%\"}"
141134
]
142135
},
143136
{
144137
"cell_type": "markdown",
145138
"id": "a1b8c3e5",
146139
"metadata": {},
147140
"source": [
148-
"<p style=\"color:#6c757d;\"><b>Figure 4.</b> Where the estimation plot and the p-values landed across the 100 most-cited research articles. The three colored groups are the categories referred to in Figure 3.</p>"
141+
"<p style=\"color:#6c757d; font-size:calc(1em - 2px); line-height:1.2;\"><b>Figure 4.</b> Where the estimation plot and the p-values landed across the 100 most-cited research articles. The three colored groups are the categories referred to in Figure 3.</p>"
149142
]
150143
},
151144
{
@@ -182,10 +175,10 @@
182175
"`[4]`: ACCLAB. [*DABEST-Python: Data Analysis with Bootstrapped ESTimation*](https://github.com/ACCLAB/DABEST-python). *GitHub*. Accessed 3 Aug. 2026.\n",
183176
"\n",
184177
"<a id='5'></a>\n",
185-
"`[5]`: Calin-Jageman, Robert J., and Geoff Cumming. [“Estimation for Better Inference in Neuroscience.”](https://doi.org/10.1523/ENEURO.0205-19.2019) *eNeuro*, vol. 6, no. 4, 2019, article ENEURO.0205-19.2019.\n",
178+
"`[5]`: Bernard, Christophe. [“Changing the Way We Report, Interpret, and Discuss Our Results to Rebuild Trust in Our Research.”](https://doi.org/10.1523/ENEURO.0259-19.2019) *eNeuro*, vol. 6, no. 4, 2019, article ENEURO.0259-19.2019.\n",
186179
"\n",
187180
"<a id='6'></a>\n",
188-
"`[6]`: Bernard, Christophe. [“Changing the Way We Report, Interpret, and Discuss Our Results to Rebuild Trust in Our Research.”](https://doi.org/10.1523/ENEURO.0259-19.2019) *eNeuro*, vol. 6, no. 4, 2019, article ENEURO.0259-19.2019.\n",
181+
"`[6]`: Calin-Jageman, Robert J., and Geoff Cumming. [“Estimation for Better Inference in Neuroscience.”](https://doi.org/10.1523/ENEURO.0205-19.2019) *eNeuro*, vol. 6, no. 4, 2019, article ENEURO.0205-19.2019.\n",
189182
"\n",
190183
"<a id='7'></a>\n",
191184
"`[7]`: Bernard, Christophe. [“Estimation Statistics, One Year Later.”](https://doi.org/10.1523/ENEURO.0091-21.2021) *eNeuro*, vol. 8, no. 2, 2021, article ENEURO.0091-21.2021.\n",

0 commit comments

Comments
 (0)