29 April 2021 in Proceedings of the National Academy of Sciences
Many Americans fail to get life-saving vaccines each year, and the availability of a vaccine for COVID-19 makes the challenge of encouraging vaccination more urgent than ever. We present a large field experiment ( N = 47,306) testing 19 nudges delivered to patients via text message and designed to boost adoption of the influenza vaccine. Our findings suggest that text messages sent prior to a primary care visit can boost vaccination rates by an average of 5%. Overall, interventions performed better when they were 1) framed as reminders to get flu shots that were already reserved for the patient and 2) congruent with the sort of communications patients expected to receive from their healthcare provider (i.e., not surprising, casual, or interactive). The best-performing intervention in our study reminded patients twice to get their flu shot at their upcoming doctor’s appointment and indicated it was reserved for them. This successful script could be used as a template for campaigns to encourage the adoption of life-saving vaccines, including against COVID-19.
8 December 2021 in Nature
1 June 2020 in Management Science
Dynamic pricing through price promotions has been widely used by online retailers. We study how a promotion strategy, one that offers customers a discount for products in their shopping cart, affects customer behavior in the short and long term on a retailing platform. We conduct a randomized field experiment involving more than 100 million customers and 11,000 retailers with Alibaba Group, one of the world’s largest retailing platform. We randomly assign eligible customers to either receive promotions for products in their shopping cart (treatment group) or not receive promotions (control group). In the short term, our promotion program doubles the sales of promoted products on the day of promotion. In the long term, we causally document unintended consequences of this promotion program during the month after our treatment period. On the positive side, it boosts customer engagement, increasing the daily number of products that customers view and their purchase incidence on the platform. On the negative side, it intensifies strategic customer behavior in the posttreatment period in two ways: (1) by increasing the proportion of products that customers add to their shopping cart conditional on viewing them, possibly because of their intention to get more shopping cart promotions, and (2) by decreasing the price that customers subsequently pay for a product, possibly because of their strategic search for lower prices. Importantly, these long-term effects of price promotions on consumer engagement and strategic behavior spill over to sellers who did not previously offer promotions to customers. Finally, we examine heterogeneous treatment effects across promotion, seller, and consumer characteristics. These findings have important implications for platforms and retailers. This paper was accepted by Vishal Gaur, operations management.
1 November 2022 in Manufacturing & Service Operations Management
Problem definition: We study how algorithmic (versus human-based) task assignment processes change task recipients’ fairness perceptions and productivity. Academic/practical relevance: Since algorithms are widely adopted by businesses and often require human involvement, understanding how humans perceive algorithms is instrumental to the success of algorithm design in operations. Particularly, the growing concern that algorithms may reproduce inequality historically exhibited by humans calls for research about how people perceive the fairness of algorithmic decision making (relative to traditional human-based decision making) and, consequently, adjust their work behaviors. Methodology: In a 15-day-long field experiment with Alibaba Group in a warehouse where workers pick products following orders (or “pick lists”), we randomly assigned half of the workers to receive pick lists from a machine that ostensibly relied on an algorithm to distribute pick lists, and the other half to receive pick lists from a human distributor. Results: Despite that we used the same underlying rule to assign pick lists in both groups, workers perceive the algorithmic (versus human-based) assignment process as fairer by 0.94–1.02 standard deviations. This yields productivity benefits: receiving tasks from an algorithm (versus a human) increases workers’ picking efficiency by 15.56%–17.86%. These findings persist beyond the first day when workers were involved in the experiment, suggesting that our results are not limited to the initial phrase when workers might find algorithmic assignment novel. We replicate the main results in another field experiment involving a nonoverlapping sample of warehouse workers. We also show via online experiments that people in the United States also view algorithmic task assignment as fairer than human-based task assignment. Managerial implications: We demonstrate that algorithms can have broader impacts beyond offering greater efficiency and accuracy than humans: introducing algorithmic assignment processes may enhance fairness perceptions and productivity. This insight can be utilized by managers and algorithm designers to better design and implement algorithm-based decision making in operations. Supplemental Material: The e-companion is available at https://doi.org/10.1287/msom.2022.1120 .
1 November 2019 in Management Science
We study the value of short-lived and experientially oriented pop-up stores, a popular type of omnichannel retail strategy, on both retailers that participate in pop-up store events and retailing platforms that host these retailers. We conduct a large-scale, randomized field experiment with Alibaba Group involving approximately 800,000 customers. We randomly assign customers to either receive a message about an upcoming weeklong pop-up store event organized by Alibaba’s business-to-consumer platform (Tmall.com) or not receive any message about the event. We find that our message increased foot traffic to the pop-up store and in turn boosted expenditure at participating retailers’ online stores at Tmall after the event ended. Furthermore, we use advanced Wi-Fi technology to track customers’ visits to the pop-up store—a missing component from past research that commonly relies on point-of-sale data. We find that pop-up store visits substantially increased customers’ subsequent expenditure at participating retailers’ Tmall stores. In addition, from a platform perspective we show that pop-up store visits increased customers’ purchases at retailers that sell related products on Tmall but did not participate in the pop-up store event. Additional analyses shed light on possible mechanisms underlying the cross-channel and spillover effects of pop-up stores and demonstrate that these effects were concentrated on prospective consumers. This paper was accepted by Vishal Gaur, operations management.