To draw causal conclusions about the efficacy of a psychological intervention, researchers must compare the treatment condition with a control group that accounts for improvements caused by factors other than the treatment. Using an active control helps to control for the possibility that improvement by the experimental group resulted from a placebo effect. Although active control groups are superior to “no-contact” controls, only when the active control group has the same expectation of improvement as the experimental group can we attribute differential improvements to the potency of the treatment. Despite the need to match expectations between treatment and control groups, almost no psychological interventions do so. This failure to control for expectations is not a minor omission—it is a fundamental design flaw that potentially undermines any causal inference. We illustrate these principles with a detailed example from the video-game-training literature showing how the use of an active control group does not eliminate expectation differences. The problem permeates other interventions as well, including those targeting mental health, cognition, and educational achievement. Fortunately, measuring expectations and adopting alternative experimental designs makes it possible to control for placebo effects, thereby increasing confidence in the causal efficacy of psychological interventions.
Frequent action video game players often outperform non-gamers on measures of perception and cognition, and some studies find that video game practice enhances those abilities. The possibility that video game training transfers broadly to other aspects of cognition is exciting because training on one task rarely improves performance on others. At first glance, the cumulative evidence suggests a strong relationship between gaming experience and other cognitive abilities, but methodological shortcomings call that conclusion into question. We discuss these pitfalls, identify how existing studies succeed or fail in overcoming them, and provide guidelines for more definitive tests of the effects of gaming on cognition.
Computers and the Internet have the potential to enrich the lives of seniors and aid in the performance of important tasks required for independent living. A prerequisite for reaping these benefits is having the skills needed to use these systems, which is highly dependent on proper training. One prerequisite for efficient and effective training is being able to gauge current levels of proficiency. We developed a new measure (the Computer Proficiency Questionnaire, or CPQ) to measure computer proficiency in the domains of computer basics, printing, communication, Internet, calendaring software, and multimedia use. Our aim was to develop a measure appropriate for individuals with a wide range of proficiencies from noncomputer users to extremely skilled users. To assess the reliability and validity of the CPQ, a diverse sample of older adults, including 276 older adults with no or minimal computer experience, was recruited and asked to complete the CPQ. The CPQ demonstrated excellent reliability (Cronbach’s α = .98), with subscale reliabilities ranging from .86 to .97. Age, computer use, and general technology use all predicted CPQ scores. Factor analysis revealed three main factors of proficiency related to Internet and e-mail use; communication and calendaring; and computer basics. Based on our findings, we also developed a short-form CPQ (CPQ-12) with similar properties but 21 fewer questions. The CPQ and CPQ-12 are useful tools to gauge computer proficiency for training and research purposes, even among low computer proficient older adults.
The goal of the current study was to investigate the relationship between sport expertise and perceptual and cognitive skills, as measured by the component skills approach. We hypothesized that athletes would outperform non-athlete controls in a number of perceptual and cognitive domains and that sport expertise would minimize gender differences. A total of 154 individuals (87 professional volleyball players and 67 non-athlete controls) participated in the study. Participants performed a cognitive battery, which included tests of executive control, memory, and visuo-spatial attention. Athletes showed superior performance speed on three tasks (two executive control tasks and one visuo-spatial attentional processing task). In a subset of tasks, gender effects were observed mainly in the control group, supporting the notion that athletic experience can reduce traditional gender effects. The expertise effects obtained substantiate the view that laboratory tests of cognition may indeed enlighten the sport-cognition relationship.
Recent research has demonstrated broad benefits of video game play to perceptual and cognitive abilities. These broad improvements suggest that video game-based cognitive interventions may be ideal to combat the many perceptual and cognitive declines associated with advancing age. Furthermore, game interventions have the potential to induce higher rates of intervention compliance compared to other cognitive interventions as they are assumed to be inherently enjoyable and motivating. We explored these issues in an intervention that tested the ability of an action game and a “brain fitness” game to improve a variety of abilities. Cognitive abilities did not significantly improve, suggesting caution when recommending video game interventions as a means to reduce the effects of cognitive aging. However, the game expected to produce the largest benefit based on previous literature (an action game) induced the lowest intervention compliance. We explain this low compliance by participants’ ratings of the action game as less enjoyable and by their prediction that training would have few meaningful benefits. Despite null cognitive results, data provide valuable insights into the types of video games older adults are willing to play and why.