Reporting effect sizes in scientific articles is increasingly widespread and encouraged by journals; however, choosing an effect size for analyses such as mixed-effects regression modeling and hierarchical linear modeling can be difficult. One relatively uncommon, but very informative, standardized measure of effect size is Cohen’s f2, which allows an evaluation of local effect size, i.e., one variable’s effect size within the context of a multivariate regression model. Unfortunately, this measure is often not readily accessible from commonly used software for repeated-measures or hierarchical data analysis. In this guide, we illustrate how to extract Cohen’s f2 for two variables within a mixed-effects regression model using PROC MIXED in SAS® software. Two examples of calculating Cohen’s f2 for different research questions are shown, using data from a longitudinal cohort study of smoking development in adolescents. This tutorial is designed to facilitate the calculation and reporting of effect sizes for single variables within mixed-effects multiple regression models, and is relevant for analyses of repeated-measures or hierarchical/multilevel data that are common in experimental psychology, observational research, and clinical or intervention studies.
The growing popularity of electronic cigarettes (e-cigarettes) among youth raises concerns about possible causal effects on conventional cigarette smoking. However, past research remains inconclusive due to heavy confounding between cigarette and e-cigarette use. This study uses propensity score methods to robustly adjust for shared risk in estimating the relationship between e-cigarette use and conventional smoking. Cross-sectional data from 8th and 10th graders were drawn from the 2015–2016 waves of Monitoring the Future (n = 12 421). The effects of (1) lifetime and (2) current e-cigarette use on (A) lifetime and (B) current conventional cigarette smoking were examined using logistic regression analyses with inverse propensity weighting based on 14 associated risk factors. After accounting for the propensity for using e-cigarettes based on 14 risk factors, both lifetime and current e-cigarette use significantly increased the risk of ever smoking a conventional cigarette (OR = 2.49, 95% CI = 1.77 to 3.51; OR = 2.32, 95% CI = 1.66 to 3.25, respectively). However, lifetime (OR = 2.17, 95% CI = 0.62 to 7.63) and current e-cigarette use (OR = 0.95, 95% CI = 0.55 to 1.63) did not significantly increase the risk of current conventional cigarette smoking. E-cigarette use does not appear to be associated with current, continued smoking. Instead, the apparent relationship between e-cigarette use and current conventional smoking is fully explained by shared risk factors, thus failing to support claims that e-cigarettes have a causal effect on concurrent conventional smoking among youth. E-cigarette use has a remaining association with lifetime cigarette smoking after propensity score adjustment; however, future research is needed to determine whether this is a causal relationship or merely reflects unmeasured confounding. This study examines the relationship between e-cigarette use and conventional smoking using inverse propensity score weighting, an innovative statistical method that produces less-biased results in the presence of heavy confounding. Our findings show that the apparent relationship between e-cigarette use and current cigarette smoking is entirely attributable to shared risk factors for tobacco use. However, e-cigarette use is associated with lifetime cigarette smoking, though further research is needed to determine whether this is a causal relationship or merely reflects unaccounted-for confounding. Propensity score weighting produced significantly weaker effect estimations compared to conventional regression control.
E-cigarettes (Electronic Nicotine Delivery Systems, or ENDS) are an increasingly popular tobacco product among youth. Some evidence suggests that e-cigarettes may be effective for harm reduction and smoking cessation, although these claims remain controversial. Little is known about how nicotine dependence may contribute to e-cigarettes’ effectiveness in reducing or quitting conventional smoking. A cohort of young adults were surveyed over 4 years (approximately ages 19–23). Varying-coefficient models (VCMs) were used to examine the relationship between e-cigarette use and conventional smoking frequency, and how this relationship varies across users with different nicotine dependence levels. Lifetime, but not recent, e-cigarette use was associated with less frequent concurrent smoking of conventional cigarettes among those with high levels of nicotine dependence. However, nondependent e-cigarette users smoked conventional cigarettes slightly more frequently than those who had never used e-cigarettes. Nearly half of ever e-cigarette users reported using them to quit smoking at the last measurement wave. For those who used e-cigarettes in a cessation attempt, the frequency of e-cigarette use was not associated with reductions in future conventional smoking frequency. These findings offer possible support that e-cigarettes may act as a smoking reduction method among highly nicotine-dependent young adult cigarette smokers. However, the opposite was found in non-dependent smokers, suggesting that e-cigarette use should be discouraged among novice tobacco users. Additionally, although a substantial proportion of young adults used e-cigarettes to help them quit smoking, these self-initiated quit attempts with e-cigarettes were not associated with future smoking reduction or cessation. This study offers potential support for e-cigarettes as a smoking reduction tool among highly nicotine-dependent young adult conventional smokers, although the extent and nature of this remains unclear. The use of e-cigarettes as a quit aid was not associated with reductions in conventional smoking, consistent with most other quit aids in this sample except for nicotine replacement therapy, which was only effective for the most dependent smokers. Notably, these findings highlight the necessity of accounting for smokers’ nicotine dependence levels when examining tobacco use patterns.