We present the development of COMMODITY 12 , a Personal Health System (PHS) to assist in the provision of continuous and personalised health services to diabetic patients, thus empowering their lifestyle regardless of their location. COMMODITY 12 consists of ambient, wearable and portable devices, which acquire, monitor and communicate physiological parameters and other health-related context of an individual, such as physical activity and vital body signals. This data is interpreted by intelligent agents that use expert biomedical knowledge to derive important insights about the individual's health status, which are then presented in the form of active feedback to the patient directly from the device, or via health professionals who assist in diagnosis, treatment and life management. The emphasis of the work is on the design of the PHS in terms of its main components, their integration and deployment to address major problems of interest to both diabetic patients and doctors that treat diabetes.
We present a novel negotiation model that allows an agent to learn how to negotiate during concurrent bilateral negotiations in unknown and dynamic e-markets. The agent uses an actor-critic architecture with model-free reinforcement learning to learn a strategy expressed as a deep neural network. We pre-train the strategy by supervision from synthetic market data, thereby decreasing the exploration time required for learning during negotiation. As a result, we can build automated agents for concurrent negotiations that can adapt to different e-market settings without the need to be pre-programmed. Our experimental evaluation shows that our deep reinforcement learning based agents outperform two existing well-known negotiation strategies in one-to-many concurrent bilateral negotiations for a range of e-market settings.
1 January 2005 in Lecture Notes in Computer Science
This paper presents the computational logic foundations of a model of agency called the KGP (Knowledge, Goals and Plan model. This model allows the specification of heterogeneous agents that can interact with each other, and can exhibit both proactive and reactive behaviour allowing them to function in dynamic environments by adjusting their goals and plans when changes happen in such environments. KGP provides a highly modular agent architecture that integrates a collection of reasoning and physical capabilities, synthesised within transitions that update the agent's state in response to reasoning, sensing and acting. Transitions are orchestrated by cycle theories that specify the order in which transitions are executed while taking into account the dynamic context and agent preferences, as well as selection operators for providing inputs to transitions.