A retrospective meta-analysis is a post hoc methodology with substantial probability of bias and is appropriately viewed as exploratory. Well-powered confirmatory studies, prospective meta-analysis and best-evidence synthesis are alternative approaches that emphasize confirmatory research and can provide more reliable evidence.
Preregistration is commonly seen as an effective way of reducing questionable research practices within psychology. This procedure happens prior to data collection/analysis and usually involves either sending in a research plan to a study registry or submitting a registered report. A prototype of registered reports operated within parapsychology long before mainstream psychology, and recent research showed that these reports contained fewer significant results than traditional journal articles. The current study builds on this work by examining the efficacy of another early preregistration procedure within parapsychology, namely the Koestler Parapsychology Unit’s Study Registry (KPU SR). This initiative began in 2012, has attracted almost a hundred submissions, and continues to operate. The outcomes of studies preregistered on the KPU SR were compared with those of non-preregistered parapsychology studies published in journals during the same time period. In line with previous work within mainstream psychology, the preregistered studies contained fewer significant results (16%) than non-preregistered experiments (46.6%). The implications of these findings for preregistration are discussed along with suggestions for future research.
Social media posts and websites claim that the way in which people perceive ambiguous images reveals insights into their personality and thinking style. To explore this notion, participants indicated the first image that they perceived in four ambiguous pictures (Duck-Rabbit, Younger-Older Woman, Rubin’s Vase and Horse-Seal), and completed a Five Factor personality measure along with scales relating to optimism, procrastination, holistic thinking, and decision-making style. Many of the claims received no empirical support and so constitute a new type of psychological myth. Future research could explore why these claims remain popular with the public and why people frequently share the material with others. In addition, several significant and interesting findings emerged, including associations between Duck-Rabbit, personality, and optimism, and Younger-Older Woman and age. Possible future research into these phenomena is discussed.
This commentary is on the systematic review by Lee et al. on pages 49–58 of this issue.
Watching a magic trick is a unique experience in which seemingly impossible events appear possible but without any suspension of disbelief. Unfortunately, relatively little work has examined the psychological impact of this fascinating experience. In the current study, participants first completed a measure of the degree to which they disliked magic (Loathing of Legerdemain Scale: LOLS) and then watched a video that either contained a series of magic tricks (magic video) or carefully matched non-magic tricks (control video). Participants then rated the degree to which they experienced positive epistemic emotions (Epistemically Related Emotion Scale: ERES), their belief about impossible events being possible in the future (Modal Judgment Task: MJT), general optimism (State Optimism Measure: SOM) and subjective wellbeing (Satisfaction With Life Scale: SWLS). Compared to participants who watched the control video, those who saw the magic video reported more positive epistemic emotions on the ERES. There were no significant differences on the MJT, SOM and SWLS. Participants’ LOLS scores were negatively correlated with the ERES, SOM and SWLS, suggesting that those who like magic are more likely to experience positive epistemic emotions, have higher levels of general optimism, and express greater satisfaction with their lives. These findings are discussed within the context of short-term and long-term exposure to magic, along with recommendations for future work.
Previous work suggests that unexpected and surprising experiences (e.g., living in another culture or looking at surreal images) promotes creative thinking. This targeted literature review examines whether the inherent cognitive disruption associated with experiencing the seemingly impossible has a similar effect. Correlational and experimental research across six domains (entertainment magic, fantasy play, virtual reality and computer gaming, dreaming, science fiction/fantasy, and anomalous experiences) provided consistent support for the hypothesis. In addition, anecdotal evidence illustrated the possible impact that the creative output associated with each of these areas may have had on technology, science, and the arts. It is argued that impossible experiences are an important driver of creative thinking, thus accounting for reports of such experiences across the lifespan and throughout history. The theoretical and practical implications of this work are discussed, along with recommendations for future research.
Research suggests that learning to perform magic tricks can promote both physical and psychological wellbeing. The current study extended this work by examining the impact of learning magic tricks on divergent thinking. A group of 10- to 11-year-old children completed Guilford’s Alternate Uses Test both before and after participating in either a magic-based, or art-based, activity. As predicted, compared to the art-based activity, the magic-based activity resulted in a significantly greater increase in both AUT Fluency and AUT Originality scores. Rosenberg’s Self-Esteem Scale and Dweck’s Implicit Theories of Intelligence Scale for Children was also completed after each activity, and participants’ self-esteem scores were higher after the art-based activity than the magic-based activity. In an exploratory aspect of the study, the AUT was re-administered to both groups three weeks later, and yielded no significant differences. The practical and theoretical implications of these findings are discussed, along with recommendations for future research.
This study investigated the potential for comics to promote skepticism about the paranormal. Participants rated their interest in comics, read a skeptical account of alleged paranormal phenomena in one of three mediums (text, comic, and comic containing an interactive magic trick), and then rated their engagement, skepticism and recall. The text was rated as more interesting and entertaining than the comics, and participants' prior interest in comics positively correlated with engagement and shift in skepticism. This suggests that for certain cohorts, comics may be an effective way to promote engagement and attitude change. The implications for future work are considered.
Background This study describes the construction and validation of a new scale for measuring belief in paranormal phenomena. The work aims to address psychometric and conceptual shortcomings associated with existing measures of paranormal belief. The study also compares the use of classic test theory and modern test theory as methods for scale development. Method We combined novel items and amended items taken from existing scales, to produce an initial corpus of 29 items. Two hundred and thirty-one adult participants rated their level of agreement with each item using a seven-point Likert scale. Results Classical test theory methods (including exploratory factor analysis and principal components analysis) reduced the scale to 14 items and one overarching factor: Supernatural Beliefs . The factor demonstrated high internal reliability, with an excellent test–retest reliability for the total scale. Modern test theory methods (Rasch analysis using a rating scale model) reduced the scale to 13 items with a four-point response format. The Rasch scale was found to be most effective at differentiating between individuals with moderate-high levels of paranormal beliefs, and differential item functioning analysis indicated that the Rasch scale represents a valid measure of belief in paranormal phenomena. Conclusions The scale developed using modern test theory is identified as the final scale as this model allowed for in-depth analyses and refinement of the scale that was not possible using classical test theory. Results support the psychometric reliability of this new scale for assessing belief in paranormal phenomena, particularly when differentiating between individuals with higher levels of belief.
For hundreds of years, magic tricks have been employed within a variety of pedagogic contexts, including promoting science and mathematics, delivering educational messaging, enhancing scepticism about the paranormal, and boosting creative thinking for product design. This review examines this diverse body of work, focusing on studies that have assessed the impact of such interventions. Although the studies tended to yield positive outcomes, much of the work suffered from methodological shortcomings, including measuring the impact of interventions over a relatively short period of time, focusing on self-report measures and failing to employ control groups. The paper makes several recommendations for future study in the area, including assessing the longer-term impact of magic-based interventions, comparing these interventions to other types of pedagogic techniques, focussing on knowledge retention and behavioural outcomes, and collaborating with magicians to develop more impactful interventions.