Morteza Hosseini

Morteza Hosseini

Auto-generated profile, based on publicly available information

Morteza Hosseini

Department of Computer Science and Electrical Engineering, University of Maryland at Baltimore County, Baltimore, MD 21250 USA

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
11 May 2021 in IEEE Design & Test
Verified
Journal Article
Closed access
AMArnab Neelim Mazumder
Arnab Neelim Mazumder
HRHaoran Ren
Haoran Ren
HRHasib-Al Rashid
Hasib-Al Rashid
MHMorteza Hosseini
Morteza Hosseini
VCVandana Chandrareddy
Vandana Chandrareddy
TMTinoosh Mohsenin
Tinoosh Mohsenin
Respiratory diseases are a leading cause of death in the world. This article proposes a deep convolutional neural network (DCNN) that can detect respiratory symptoms in a user using audio input, and with the assistance of additional physiological or demographic information.

15 November 2021 in IEEE Journal on Emerging and Selected Topics in Circuits and Systems
Verified
Journal Article
Closed access
MHMorteza Hosseini
Morteza Hosseini
TMTinoosh Mohsenin
Tinoosh Mohsenin
Because of their simple hardware requirements, low bitwidth neural networks (NN) have gained significant attention over the recent years, and have been extensively employed in the state-of-the-art devices that seek efficiency and performance. Research has shown that scaled-up low bitwidth NNs can have accuracy levels on par with their full-precision counterparts. As a result, there is a trade-off between quantization (q) and scaling (s) of NNs to maintain the accuracy. To capture that trade-off, in this paper, we propose QS-NAS which is a systematic approach to explore the best quantization and scaling factors for a NN architecture that satisfies a targeted accuracy level and results in the least energy consumption per inference when deployed to a hardware–FPGA in this work. We first approximate the accuracy of a NN using a polynomial regression based on experiencing over a span of q and s. Then, we design a hardware that is scalable with P processing engines (PE) and M multipliers per PE, and infer that the configuration of the most energy-efficient hardware as well as its energy per inference for a NN ⟨q, s⟩ are, in turn, a function of q and s. Experiencing the NNs with various q and s over our hardware, we approximate the energy consumption using another polynomial regression. Given the two approximators, we obtain a pair of q and s that minimizes the energy for a given targeted accuracy. The method was evaluated on SVHN, CIFAR-10, and ImageNet datasets trained on VGG-like and MobileNet-192 architectures, and the optimized models were deployed to Xilinx FPGAs for fully on-chip processing. The implementation results outperform the related work in terms of energy-efficiency and/or power consumption, yet having similar or higher accuracy. The proposed optimization method is fast, simple, and scalable to emerging technologies. Moreover, it can be used on top of other AutoML frameworks to maximize efficiency of running artificial intelligence on edge devices.

1 October 2021 in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
Verified
Journal Article
Closed access
MHMorteza Hosseini
Morteza Hosseini
NMNitheesh Kumar Manjunath
Nitheesh Kumar Manjunath
BPBharat Prakash
Bharat Prakash
AMArnab Mazumder
Arnab Mazumder
VCVandana Chandrareddy
Vandana Chandrareddy
TMTinoosh Mohsenin
Tinoosh Mohsenin
In deep convolutional neural networks (DCNNs), model size and computation complexity are two important factors governing throughput and energy efficiency when deployed to hardware for inference. Recent works on compact DCNNs as well as pruning methods are effective, yet with drawbacks. For instance, more than half the size of all MobileNet models lies in their last two layers, mainly because compact separable convolution (CONV) layers are not applicable to their last fully connected (FC) layers. Also, in pruning methods, the compression is gained at the expense of irregularity in the DCNN architecture, which necessitates additional indexing memory to address nonzero weights, thereby increasing memory footprint, decompression delays, and energy consumption. In this article, we propose cyclic sparsely connected (CSC) architectures, with memory/computation complexity of O(NlogN), where N is the number of nodes/channels given a DCNN layer that, contrary to compact depthwise separable layers, can be used as an overlay for both FC and CONV layers of O(N²). Also, contrary to pruning methods, CSC architectures are structurally sparse and require no indexing due to their cyclic nature. We show that both standard convolution and depthwise convolution layers are special cases of the CSC layers, whose mathematical function, along with FC layers, can be unified into one single formulation and whose hardware implementation can be carried out under one arithmetic logic component. We examine the efficacy of the CSC architectures for compression of LeNet, AlexNet, and MobileNet DCNNs with precision ranging from 2 to 32 bits. More specifically, we surge upon the compact 8-bit quantized 0.5 MobileNet V1 and show that by compressing its last two layers with CSC architectures, the model is compressed by ~1.5x with a size of only 873 kB and little accuracy loss. Finally, we design a configurable hardware that implements all types of DCNN layers including FC, CONV, depthwise, CSC-FC, and CSC-CONV indistinguishably within a unified pipeline. We implement the hardware on a tiny Xilinx field-programmable gate array (FPGA) for total on-chip processing of the compressed MobileNet that, compared to the related work, has the highest Inference/J while utilizing the smallest FPGA.