20 October 2016 in Circuits, Systems, and Signal Processing
2 May 2005 in IEEE Transactions on Circuits and Systems for Video Technology
This paper proposes a flexible hardware solution and the associated energy-aware IP core design for computing the variable-length discrete cosine transform/inverse discrete cosine transform (DCT/IDCT) required in the MPEG4 shape-adaptive DCT/IDCT (SA-DCT/IDCT). The proposed IP core has been developed based on the design concept of programmable processors to provide the flexibility in dynamically configuring the hardware. To achieve good performance both in area and speed, we optimize the proposed IP core both in the algorithmic computational complexity and hardware complexity. Furthermore, the proposed IP core possesses the feature of energy-aware design flexibility. The simulation shows that the proposed design has 44% energy reduction at the price of 0.3-dB signal quality degradation for the image compression applications. The implementation results show that the proposed IP core costs about 3100 gates along with 16 words (1 word = 16 bits) of memory, which can achieve the real-time processing of the texture coding in MPEG4 SP@L3 and ACE@L2 CODEC system for the CIF format video at 30 frames/s with 4:2:0 color format.
12 August 2014 in Circuits, Systems, and Signal Processing
12 July 2023 in IEEE Access
Although modern object detection AI models have the potential to be widely used in various applications such as autonomous vehicles, these models are very computationally demanding. Using high-resolution image data further increases the computational burden. Hence, we propose an acceleration method called Group of Picture (GoP) mode for object detection in video sequences by removing the temporal redundancy, unlike the existing model compression schemes. A GoP structure is composed of only one key frame and several non-key frames. In GoP-mode, object detection is adopted for key frames only, while object tracking is employed to predict the position of each object in the following non-key frames based on the tracked trajectory and momentum of each object. By using the proposed method, the thrilling latency saving can result in multiple times of execution speed acceleration so that both high detection accuracy and high execution speed can be obtained. In theory, if we adopt a GoP structure of one key frame with N non-key frames, the execution speed of object detection is accelerated to (1+N) times by equipping the GoP-mode. The effect of the number of non-key frames on the accuracy variation of an object detector equipped with GoP-mode has been analyzed. According to the experimental results, the mean average precision (mAP) of adopting GoP mode with four non-key frames in one GoP structure is competitive to that using object detection for all frames. Meanwhile, the execution frame rate is increased from the original 8 frames per second (FPS) to 35.8 FPS on the mobile platform-Jetson Nano, i.e. a speedup of 348%.
14 August 2014 in Circuits, Systems, and Signal Processing