Posts

Showing posts from March, 2016

Should we always bring out our nulls?

tl;dr: Thinking about projects that aren't (and may never be) finished. Should they necessarily be published? One null result tells you about as much as one positive; not much. But a pattern of nulls demands attention. #BringOutYerNulls � Micah Allen (@neuroconscience) March 18, 2016 Suggestion: let's kick start this by tweeting some null results we had under the hashtag #BringOutYerNulls . Bonus points if published! � Micah Allen (@neuroconscience) March 18, 2016 So, the other day there was a very nice conversation on twitter, started by Micah Allen and focusing on people clearing out their file-drawers and describing null findings. The original inspiration was a very interesting paper about one lab's file drawer , in which we got insight into the messy state of the evidence the lab had collected prior to its being packaged into conventional publications. The broader idea, of course, is that � since they don't fit as easily into conventional narratives of discovery � ...

Limited support for an app-based intervention

Image
tl;dr: I reanalyzed a recent field-trial of a math-learning app. The results differ by analytic strategy, suggesting the importance of preregistration. Last year, Berkowitz et al. published a randomized controlled trial of a learning app. Children were randomly assigned to math and reading app groups; their learning outcomes on standardized math and reading tests were assessed after a period of app usage. A math anxiety measure was also collected for children�s parents. The authors wrote that: The intervention, short numerical story problems delivered through an iPad app, significantly increased children�s math achievement across the school year compared to a reading (control) group, especially for children whose parents are habitually anxious about math. I got excited about this finding because I have recently been trying to understand the potential of mobile and tablet apps for intervention at home, but when I dug into the data I found that not all views of the dataset supported...