The wde adoption of deep neural networks has been accompanied by ever-increasing energy and performance demands due to the expensive nature of training them. Numerous special-purpose architectures have been proposed to accelerate training: both digital and hybrid digital-analog using ReRAM crossbars. ReRAM-based accelerators have demonstrated the effectiveness of ReRAM crossbars at performing matrix operations that are prevalent in training. However, they suffer from inefficiency due to the use of serial reads and writes for performing the weight gradient and update step. A few works have demonstrated the possibility of performing outer products in crossbars, which can be used to realize the weight gradient and update step without the use of serial reads and writes. However, these works have been limited to low precision operations which are not sufficient for typical training workloads. Moreover, they have been confined to a limited set of training algorithms for fully-connect layers only. To address these limitations, we propose a bit-slicing technique for enhancing the precision of ReRAM-based outer products. We incorporate this technique into a crossbar architecture with three variants catered to different training algorithms. We build an ISA-programmable training accelerator with compiler support to evaluate our design on both convolutional and fully-connected layers.
The advancement of human–computer interfaces and computational power enables the creation of believable virtual worlds. These were once limited to the gaming community but are now used for business purposes, including industrial applications, health, education.
Cybersecurity is a key risk for any business as the number of attacks are increasing. Growing attacks on cybersecurity are threatening our existence. Artificial Intelligence (AI) and machine learning (ML) can help detect threats and provide recommendations to cyber analysts. Advancing the adoption of AI/ML applied to cybersecurity requires partnering of industry, academia, and government on a global scale.
Artificial intelligence will be deployed increasingly in more systems that affect public health, safety, and welfare. These systems will better utilize scarce resources; prevent disasters; and increase safety, reliability, comfort, and convenience. Despite the technological challenges and public fears, these systems will improve the quality of life of millions of people worldwide.
Digital twins provide living digital models of physical systems that enable data-driven analysis and application of artificial intelligence to better manage selective aspects of the data center and drive efficiency for sustainability.