Jian Gao

Dr. Jian Gao

Office of Productivity, Efficiency, and Staffing, Office of Analytics and Performance Integration, United States Department of Veterans Affairs, Washington D.C., USA
orcid

Research Focus & Metrics

Academic Career Length

25Years (2002-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 December 2023 in Research Methods in Medicine & Health Sciences
Verified
Journal Article
Closed access
Jian GaoJian Gao
Jian Gao
Linear regression is a simple yet powerful tool that has been extensively used in all fields where the relationships among variables are of interest. When linear regression is applied, the coefficient of determination or R-squared ( R2) is commonly reported as a metric gauging the model’s goodness of fit. Despite its wide usage, however, R2 has been commonly misinterpreted as the proportion or percent of variation in the dependent variable that is explained by the independent variables (PVE -- percent of variation explained). This study demonstrated R2 substantially overstates the true PVE. When the assumptions of linear regression are met, R2 overstates PVE by up to 100%. For instance, when R2 is 0.99, 0.80, 0.50, or 0.10, the true PVE is 0.9, 0.55, 0.29, or 0.05, respectively. The misinterpretation of R2, which greatly exaggerates the effect of the interventions or causes on the outcomes, could exert undue influence on clinical decisions in medicine and policy decisions in other fields such as environmental protection and climate change research. Therefore, when linear regression is applied, reporting the true PVE is warranted.

1 February 2014 in Medical Care
Verified
Journal Article
Closed access
Jian GaoJian Gao
Jian Gao
EMEileen Moran
Eileen Moran
YLYu-Fang Li
Yu-Fang Li
PAPeter L. Md Almenoff
Peter L. Md Almenoff
Background: Hospitalizations due to ambulatory care sensitive conditions (ACSCs) are widely accepted as an indicator of primary care access and effectiveness. However, broad early intervention to all patients in a health care system may be deemed infeasible due to limited resources. Objective: To develop a predictive model to identify high-risk patients for early intervention to reduce ACSC hospitalizations, and to explore the predictive power of different variables. Methods: The study population included all patients treated for ACSCs in the VA system in fiscal years (FY) 2011 and 2012 (n=2,987,052). With all predictors from FY2011, we developed a statistical model using hierarchical logistic regression with a random intercept to predict the risk of ACSC hospitalizations in the first 90 days and the full year of FY2012. In addition, we configured separate models to assess the predictive power of different variables. We used a random split-sample method to prevent overfitting. Results: For hospitalizations within the first 90 days of FY2012, the full model reached c-statistics of 0.856 (95% CI, 0.853–0.860) and 0.856 (95% CI, 0.852–0.860) for the development and validation samples, respectively. For predictive power of the variables, the model with only a random intercept yielded c-statistics of 0.587 (95% CI, 0.582–0.593) and 0.578 (95% CI, 0.573–0.583), respectively; with patient demographic and socioeconomic variables added, the c-statistics improved to 0.725 (95% CI, 0.720–0.729) and 0.721 (95% CI, 0.717–0.726), respectively; adding prior year utilization and cost raised the c-statistics to 0.826 (95% CI, 0.822–0.830) and 0.826 (95% CI,0.822–0.830), respectively; the full model was reached with HCCs added. For the 1-year hospitalizations, only the full model was fitted, which yielded c-statistics of 0.835 (95% CI, 0.831–0.837) and 0.833 (95% CI, 0.830–0.837), respectively, for development and validation samples. Conclusions: Our analyses demonstrate that administrative data can be effective in predicting ACSC hospitalizations. With high predictive ability, the model can assist primary care providers to identify high-risk patients for early intervention to reduce ACSC hospitalizations.

24 June 2020 in BMC Medical Research Methodology
Verified
Journal Article
Open access
PDF file
Jian GaoJian Gao
Jian Gao
Background: In medical research and practice, the p-value is arguably the most often used statistic and yet it is widely misconstrued as the probability of the type I error, which comes with serious consequences. This misunderstanding can greatly affect the reproducibility in research, treatment selection in medical practice, and model specification in empirical analyses. By using plain language and concrete examples, this paper is intended to elucidate the p-value confusion from its root, to explicate the difference between significance and hypothesis testing, to illuminate the consequences of the confusion, and to present a viable alternative to the conventional p-value. Main text: The confusion with p-values has plagued the research community and medical practitioners for decades. However, efforts to clarify it have been largely futile, in part, because intuitive yet mathematically rigorous educational materials are scarce. Additionally, the lack of a practical alternative to the p-value for guarding against randomness also plays a role. The p-value confusion is rooted in the misconception of significance and hypothesis testing. Most, including many statisticians, are unaware that p-values and significance testing formed by Fisher are incomparable to the hypothesis testing paradigm created by Neyman and Pearson. And most otherwise great statistics textbooks tend to cobble the two paradigms together and make no effort to elucidate the subtle but fundamental differences between them. The p-value is a practical tool gauging the “strength of evidence” against the null hypothesis. It informs investigators that a p-value of 0.001, for example, is stronger than 0.05. However, p-values produced in significance testing are not the probabilities of type I errors as commonly misconceived. For a p-value of 0.05, the chance a treatment does not work is not 5%; rather, it is at least 28.9%. Conclusions: A long-overdue effort to understand p-values correctly is much needed. However, in medical research and practice, just banning significance testing and accepting uncertainty are not enough. Researchers, clinicians, and patients alike need to know the probability a treatment will or will not work. Thus, the calibrated p-values (the probability that a treatment does not work) should be reported in research papers.

23 December 2022 in Journal of Primary Care & Community Health
Verified
Journal Article
Open access
Jian GaoJian Gao
Jian Gao
EMEileen Moran
Eileen Moran
RGRachel Grimm
Rachel Grimm
ATAndrew Toporek
Andrew Toporek
CRChristopher Ruser
Christopher Ruser
Background: Since the 1980s, primary care (PC) in the US has been recognized as the backbone of healthcare providing comprehensive care to complex patients, coordinating care among specialists, and rendering preventive services to contain costs and improve clinical outcomes. However, the effect of PC visits on total patient care cost has been difficult to quantify. Objective: To assess the effect of PC visits on total patient care cost. Methods: This is a retrospective study of over 5 million patients assigned to a PC provider in the Veterans Health Administration (VHA) in each of the 4 fiscal years (FY 2016-2019). The main outcome of interest is total annual patient care cost. We assessed the effect of primary care visits on total patient care cost first by descriptive statistics, and then by multivariate regressions adjusting for severity of illness and other confounders. We conducted in-depth sensitivity analyses to validate the findings. Results: On average, each additional in-person PC visit was associated with a total cost reduction of $721 (per patient per year). The first PC visit was associated with the largest savings, $3976 on average, and a steady diminishing return was observed. Further, the higher the patient risk (severity of illness), the larger the cost reduction: Among the top 10% of high-risk patients, the first PC in-person visit was associated with a reduction of $16 406 (19%). Conclusions: These findings, substantiated by our exhaustive sensitivity analyses, suggest that expanding PC capacity can significantly reduce overall health care costs and improve patient care outcomes given the former is a strong proxy of the latter.

1 May 2010 in Health Services Management Research
Verified
Journal Article
Closed access
MFMichael S Finegan
Michael S Finegan
Jian GaoJian Gao
Jian Gao
DPDonald Pasquale
Donald Pasquale
JCJames Campbell
James Campbell
The rate of hospitalizations due to ambulatory care-sensitive conditions (ACSCs) has been widely accepted as an indicator of access and quality of primary care. This study aimed to examine the trends and geographic variation of ACSC hospitalizations in US veterans health-care system, to identify factors associated with ACSC hospitalizations and to develop a quality indicator that can monitor access and effectiveness of primary care at hospital level. Using fiscal years 1997–2007 data, we found total ACSC hospitalizations per 1000 ACSC patients decreased by 58%; ACSC hospitalizations as percentage of total hospitalizations decreased 9%. However, significant geographic variations of ACSC hospitalizations remained and we found that adjustment of case-mix or confounding factors was essential in making meaningful comparisons among hospitals in a health-care system. Further, this study also reveals that low-income veterans still had higher ACSC hospitalization rates and patient travel time less than 30 minutes to the nearest VA providers was associated with fewer ACSC hospitalizations, which possess important policy implications.

1 April 2011 in Health Affairs
Verified
Journal Article
Closed access
PDF file
Jian GaoJian Gao
Jian Gao
EMEileen Moran
Eileen Moran
PAPeter L. Almenoff
Peter L. Almenoff
MRMarta L. Render
Marta L. Render
JCJames Campbell
James Campbell
AJAshish K. Jha
Ashish K. Jha
There is widespread belief that the US health care system could realize significant improvements in efficiency, savings, and patient outcomes if care were provided in a more integrated and accountable way. We examined efficiency and its relationship to quality of care for medical centers run by the Veterans Health Administration of the Department of Veterans Affairs (VA), a national, vertically integrated health care system that is accountable for a large patient population. After devising a statistical model to indicate efficiency, we found that VA medical centers were highly efficient. We also found only modest variation in the level of efficiency and cost across VA medical centers, and a positive correlation overall between greater efficiency and higher inpatient quality. These findings for VA medical centers suggest that efforts to drive integration and accountability in other parts of the US health care system might have important payoffs in reducing variations in cost without sacrificing quality. Policy makers should focus on what aspects of certain VA medical centers allow them to provide better care at lower costs and consider policies that incentivize other providers, both within and outside the VA, to adopt these practices.