Background: Crowdsourcing is used increasingly in health and medical research. Crowdsourcing is the process of aggregating crowd wisdom to solve a problem. The purpose of this systematic review is to summarize quantitative evidence on crowdsourcing to improve health. Methods: We followed Cochrane systematic review guidance and systematically searched seven databases up to September 4th 2019. Studies were included if they reported on crowdsourcing and related to health or medicine. Studies were excluded if recruitment was the only use of crowdsourcing. We determined the level of evidence associated with review findings using the GRADE approach. Results: We screened 3508 citations, accessed 362 articles, and included 188 studies. Ninety-six studies examined effectiveness, 127 examined feasibility, and 37 examined cost. The most common purposes were to evaluate surgical skills (17 studies), to create sexual health messages (seven studies), and to provide layperson cardio-pulmonary resuscitation (CPR) out-of-hospital (six studies). Seventeen observational studies used crowdsourcing to evaluate surgical skills, finding that crowdsourcing evaluation was as effective as expert evaluation (low quality). Four studies used a challenge contest to solicit human immunodeficiency virus (HIV) testing promotion materials and increase HIV testing rates (moderate quality), and two of the four studies found this approach saved money. Three studies suggested that an interactive technology system increased rates of layperson initiated CPR out-of-hospital (moderate quality). However, studies analyzing crowdsourcing to evaluate surgical skills and layperson-initiated CPR were only from high-income countries. Five studies examined crowdsourcing to inform artificial intelligence projects, most often related to annotation of medical data. Crowdsourcing was evaluated using different outcomes, limiting the extent to which studies could be pooled. Conclusions: Crowdsourcing has been used to improve health in many settings. Although crowdsourcing is effective at improving behavioral outcomes, more research is needed to understand effects on clinical outcomes and costs. More research is needed on crowdsourcing as a tool to develop artificial intelligence systems in medicine. Trial registration: PROSPERO: CRD42017052835. December 27, 2016.

Introduction: Nearly 40 years into the HIV epidemic, the persistence of HIV stigma is a matter of grave urgency. Discrimination (i.e. enacted stigma) in healthcare settings is particularly problematic as it deprives people of critical healthcare services while also discouraging preventive care seeking by confirming fears of anticipated stigma. We review existing research on the effectiveness of stigma interventions in healthcare settings of low‐ and middle‐income countries (LMIC), where stigma control efforts are often further complicated by heavy HIV burdens, less developed healthcare systems, and the layering of HIV stigma with discrimination towards other marginalized identities. This review describes progress in this field to date and identifies research gaps to guide future directions for research.Methods: We conducted a scoping review of HIV reduction interventions in LMIC healthcare settings using Embase, Ovid MEDLINE, PsycINFO and Scopus (through March 5, 2020). Information regarding study design, stigma measurement techniques, intervention features and study findings were extracted. We also assessed methodological rigor using the Joanna Briggs Institute checklist for systematic reviews.Results and discussion: Our search identified 8766 studies, of which 19 were included in the final analysis. All but one study reported reductions in stigma following the intervention. The studies demonstrated broad regional distribution across LMIC and many employed designs that made use of a control condition. However, these strengths masked key shortcomings including a dearth of research from the lowest income category of LMIC and a lack of interventions to address institutional or structural determinants of stigma. Lastly, despite the fact that most stigma measures were based on existing instruments, only three studies described steps taken to validate or adapt the stigma measures to local settings.Conclusions: Combating healthcare stigma in LMIC demands interventions that can simultaneously address resource constraints, high HIV burden and more severe stigma. Our findings suggest that this will require more objective, reliable and culturally adaptable stigma measures to facilitate meaningful programme evaluation and comparison across studies. All but one study concluded that their interventions were effective in reducing healthcare stigma. Though encouraging, the fact that most studies measured impact using self‐reported measures suggests that social desirability may bias results upwards. Homogeneity of study results also hindered our ability to draw substantive conclusions about potential best practices to guide the design of future stigma reduction programmes.

Background: Sexual health among older adults is a major public health concern globally. The syphilis burden is increasing in older adults in China. This study aimed to describe factors associated with syphilis infection and diagnosis among older adults in China during a 16 year period.Methods: Using 16 years of data (2004–2019) from the syphilis case report system of Guangdong, China, we compared data from older adults (aged ≥50 years) with those from younger people (aged 15–49 years). We compared the two age group with the Chi-square test for difference, and Joinpoint regression models to assess the temporal trends.Results: During the study period, 242,115 new syphilis diagnoses were reported in older adults. The mean notification rate of new diagnoses was 64.1 per 100,000 population across the entire 16-year period, which significantly increased over time (average annual percent change [AAPC] 16.2%, 95% CI 13.7–18.7). Syphilis diagnoses increased significantly over time among less developed cities and older women. In 2019, compared with younger adults, newly diagnosed older adults were more likely to be male, native to reporting city, had unknown transmission routes, and were diagnosed late.Conclusion: Our findings call for an urgent need to deliver more targeted prevention interventions for older adults, such as strengthen awareness among health care providers, and integration of syphilis services and primary health care for older adults.

Background: Digital network–based methods may enhance peer distribution of HIV self-testing (HIVST) kits, but interventions that can optimize this approach are needed. We aimed to assess whether monetary incentives and peer referral could improve a secondary distribution program for HIVST among men who have sex with men (MSM) in China. Methods and findings: Between October 21, 2019 and September 14, 2020, a 3-arm randomized controlled, single-blinded trial was conducted online among 309 individuals (defined as index participants) who were assigned male at birth, aged 18 years or older, ever had male-to-male sex, willing to order HIVST kits online, and consented to take surveys online. We randomly assigned index participants into one of the 3 arms: (1) standard secondary distribution (control) group (n = 102); (2) secondary distribution with monetary incentives (SD-M) group (n = 103); and (3) secondary distribution with monetary incentives plus peer referral (SD-M-PR) group (n = 104). Index participants in 3 groups were encouraged to order HIVST kits online and distribute to members within their social networks. Members who received kits directly from index participants or through peer referral links from index MSM were defined as alters. Index participants in the 2 intervention groups could receive a fixed incentive ($3 USD) online for the verified test result uploaded to the digital platform by each unique alter. Index participants in the SD-M-PR group could additionally have a personalized peer referral link for alters to order kits online. Both index participants and alters needed to pay a refundable deposit ($15 USD) for ordering a kit. All index participants were assigned an online 3-month follow-up survey after ordering kits. The primary outcomes were the mean number of alters motivated by index participants in each arm and the mean number of newly tested alters motivated by index participants in each arm. These were assessed using zero-inflated negative binomial regression to determine the group differences in the mean number of alters and the mean number of newly tested alters motivated by index participants. Analyses were performed on an intention-to-treat basis. We also conducted an economic evaluation using microcosting from a health provider perspective with a 3-month time horizon. The mean number of unique tested alters motivated by index participants was 0.57 ± 0.96 (mean ± standard deviation [SD]) in the control group, compared with 0.98 ± 1.38 in the SD-M group (mean difference [MD] = 0.41),and 1.78 ± 2.05 in the SD-M-PR group (MD = 1.21). The mean number of newly tested alters motivated by index participants was 0.16 ± 0.39 (mean ± SD) in the control group, compared with 0.41 ± 0.73 in the SD-M group (MD = 0.25) and 0.57 ± 0.91 in the SD-M-PR group (MD = 0.41), respectively. Results indicated that index participants in intervention arms were more likely to motivate unique tested alters (control versus SD-M: incidence rate ratio [IRR = 2.98, 95% CI = 1.82 to 4.89, p-value < 0.001; control versus SD-M-PR: IRR = 3.26, 95% CI = 2.29 to 4.63, p-value < 0.001) and newly tested alters (control versus SD-M: IRR = 4.22, 95% CI = 1.93 to 9.23, p-value < 0.001; control versus SD-M-PR: IRR = 3.49, 95% CI = 1.92 to 6.37, p-value < 0.001) to conduct HIVST. The proportion of newly tested testers among alters was 28% in the control group, 42% in the SD-M group, and 32% in the SD-M-PR group. A total of 18 testers (3 index participants and 15 alters) tested as HIV positive, and the HIV reactive rates for alters were similar between the 3 groups. The total costs were $19,485.97 for 794 testers, including 450 index participants and 344 alter testers. Overall, the average cost per tester was $24.54, and the average cost per alter tester was $56.65. Monetary incentives alone (SD-M group) were more cost-effective than monetary incentives with peer referral (SD-M-PR group) on average in terms of alters tested and newly tested alters, despite SD-M-PR having larger effects. Compared to the control group, the cost for one more alter tester in the SD-M group was $14.90 and $16.61 in the SD-M-PR group. For newly tested alters, the cost of one more alter in the SD-M group was $24.65 and $49.07 in the SD-M-PR group. No study-related adverse events were reported during the study. Limitations include the digital network approach might neglect individuals who lack internet access. Conclusions: Monetary incentives alone and the combined intervention of monetary incentives and peer referral can promote the secondary distribution of HIVST among MSM. Monetary incentives can also expand HIV testing by encouraging first-time testing through secondary distribution by MSM. This social network–based digital approach can be expanded to other public health research, especially in the era of the Coronavirus Disease 2019 (COVID-19). Trial registration: Chinese Clinical Trial Registry (ChiCTR) ChiCTR1900025433

Background: Low syphilis testing uptake is a major public health issue among men who have sex with men (MSM) in many low- and middle-income countries. Syphilis self-testing (SST) may complement and extend facility-based testing. We aimed to evaluate the effectiveness and costs of providing SST on increasing syphilis testing uptake among MSM in China. Methods and findings: An open-label, parallel 3-arm randomized controlled trial (RCT) was conducted between January 7, 2020 and July 17, 2020. Men who were at least 18 years of age, had condomless anal sex with men in the past year, reported not testing for syphilis in the last 6 months, and had a stable residence with mailing addresses were recruited from 124 cities in 26 Chinese provinces. Using block randomization with blocks of size 12, enrolled participants were randomly assigned (1:1:1) into 3 arms: standard of care arm, standard SST arm, and lottery incentivized SST arm (1 in 10 chance to win US$15 if they had a syphilis test). The primary outcome was the proportion of participants who tested for syphilis during the trial period and confirmed with photo verification and between arm comparisons were estimated with risk differences (RDs). Analyses were performed on a modified intention-to-treat basis: Participants were included in the complete case analysis if they had initiated at least 1 follow-up survey. The Syphilis/HIV Duo rapid test kit was used. A total of 451 men were enrolled. In total, 136 (90·7%, 136/150) in the standard of care arm, 142 (94·0%, 142/151) in the standard of SST arm, and 137 (91·3%, 137/150) in the lottery incentivized SST arm were included in the final analysis. The proportion of men who had at least 1 syphilis test during the trial period was 63.4% (95% confidence interval [CI]: 55.5% to 71.3%, p = 0.001) in the standard SST arm, 65.7% (95% CI: 57.7% to 73.6%, p = 0.0002) in the lottery incentivized SST arm, and 14.7% (95% CI: 8.8% to 20.7%, p < 0.001) in the standard of care arm. The estimated RD between the standard SST and standard of care arm was 48.7% (95% CI: 37.8% to 58.4%, p < 0.001). The majority (78.5%, 95% CI: 72.7% to 84.4%, p < 0.001) of syphilis self-testers reported never testing for syphilis. The cost per person tested was US$26.55 for standard SST, US$28.09 for the lottery incentivized SST, and US$66.19 for the standard of care. No study-related adverse events were reported during the study duration. Limitation was that the impact of the Coronavirus Disease 2019 (COVID-19) restrictions may have accentuated demand for decentralized testing. Conclusions: Compared to standard of care, providing SST significantly increased the proportion of MSM testing for syphilis in China and was cheaper (per person tested). Trial registration: Chinese Clinical Trial Registry: ChiCTR1900022409.