Monday, May 27, 2013

xkcd on significance testing


xkcd: Significant

Jim Wood's May 15 post, "Let's Abandon Significance Tests", illustrated.  As he says, "the real importance of the cartoon has to do with the whole issue of publication bias: only the green jelly bean test gets written up, submitted, and published (and turned into a press release). Hence (since the other tests remain invisible) no multiple-test correction is ever done or even suggested by editors or reviewers, who don't know about the other 19 tests. This is a serious problem that arguably didn't get enough attention in my post."

No comments: