Sensor networks are becoming increasingly pervasive. Existing methods of aggregation in sensor networks offer mostly standard mathematical operators over homogeneous data types. In this paper, we instead focus on supporting emerging scenarios in which applications will need to extract abstracted measurements from diverse sets of sensor network nodes. This paper introduces the virtual sensors abstraction that enables an application developer to programmatically specify an application's high-level data requirements. This paper reports on our initial work with the virtual sensors and the results of our prototype implementation.
19 June 2006 in IEEE Transactions on Software Engineering
Today's mobile applications require constant adaptation to their changing environments, or contexts. Technological advances have increased the pervasiveness of mobile computing devices such as laptops, handhelds, and embedded sensors. The sheer amount of context information available for adaptation places a heightened burden on application developers as they must manage and utilize vast amounts of data from diverse sources. Facilitating programming in this data-rich environment requires a middleware that provides context information to applications in an abstract form. In this paper, we demonstrate the feasibility of such a middleware that allows programmers to focus on high-level interactions among programs and to employ declarative abstract context specifications in settings that exhibit transient interactions with opportunistically encountered components. We also discuss the novel context-aware abstractions the middleware provides and the programming knowledge necessary to write applications using it. Finally, we provide examples demonstrating the infrastructure's ability to support differing tasks from a wide variety of application domains
6 March 2024 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Smart home assistants function best when user commands are direct and well-specified---e.g., "turn on the kitchen light"---or when a hard-coded routine specifies the response. In more natural communication, however, human speech is unconstrained, often describing goals (e.g., "make it cozy in here" or "help me save energy") rather than indicating specific target devices and actions to take on those devices. Current systems fail to understand these under-specified commands since they cannot reason about devices and settings as they relate to human situations. We introduce large language models (LLMs) to this problem space, exploring their use for controlling devices and creating automation routines in response to under-specified user commands in smart homes. We empirically study the baseline quality and failure modes of LLM-created action plans with a survey of age-diverse users. We find that LLMs can reason creatively to achieve challenging goals, but they experience patterns of failure that diminish their usefulness. We address these gaps with Sasha, a smarter smart home assistant. Sasha responds to loosely-constrained commands like "make it cozy" or "help me sleep better" by executing plans to achieve user goals---e.g., setting a mood with available devices, or devising automation routines. We implement and evaluate Sasha in a hands-on user study, showing the capabilities and limitations of LLM-driven smart homes when faced with unconstrained user-generated scenarios.
19 February 2019 in CCF Transactions on Pervasive Computing and Interaction
Driven by the increasing diffusion of embedded sensors and actuators, and more in general by “Internet of Things” (IoT) devices, pervasive computing is becoming a reality. Yet, most actual implementations of pervasive computing environments rely on rather centralized architectures and on middleware solutions that integrate only the minimal set of services to enable interoperabilty and data integration. In this article, after having overviewed the state of the art in the area of pervasive computing middleware, we discuss the many challenges that still have to be faced for pervasive computing middleware to be able to support elastic, easy to configure, easy to develop, safe, and ethically acceptable, pervasive computing services and applications.
It is widely held that debugging cyber-physical systems (CPS) is challenging, to date, empirical studies investigating research challenges in CPS verification and validation have not been done. As a result, the exact challenges facing CPS developers in the real world remain at best unquantified and at worst unknown, and the research directions the community should undertake are not clearly identified. In this paper, we review our recent empirical study of real-world CPS developers. This position paper then uses the findings from this study to highlight the discovered key challenges and to present a research trajectory to address these challenges.