Tianyi Zhang

Mr. Tianyi Zhang


Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
15 January 2024 in IEEE Sensors Journal
Verified
Journal Article
Closed access
TZTianyi Zhang
Tianyi Zhang
ZLZiran Li
Ziran Li
QWQi Wang
Qi Wang
KSKohei Shimasaki
Kohei Shimasaki
IIIdaku Ishii
Idaku Ishii
Akio NamikiAkio Namiki
Akio Namiki
This paper presents a novel pan-tilt-zoom (PTZ) camera with extended depth-of-field (DoF) to address the limited DoF of the images taken by the zoom lens in zoomed-in monitoring. Our concept pioneers the organic integration of the through-focus scanning (TFS) mechanism and the high-speed pan-tilt mechanism based on the Galvano mirror. The TFS mechanism consists of a variable zoom lens, a servo motor, and a gear mechanism, enabling the system scans at object distances between 3 m and 10 m at 0.067 s per TFS process. A high-frame-rate (HFR) focus stacking algorithm based on GPU is implemented with a high-speed camera, achieving the frame rate of the DoF-extended zoomed-in images at approximately 15 fps. The 2-axis Galvano mirror enables ultrafast and precise pan-tilt adjustment between adjacent TFS processes while stably remaining stationary during the TFS process. The comparative experiment showcases the advanced performance of simultaneous focus on multiple objects at varying distances with high image quality and high magnification. Functional experimental results demonstrate the proposed PTZ camera’s advanced capabilities in swift pan-tilt adjustment and real-time DoF-extended zoomed-in image generation, highlighting the proposed system’s potential for practical applications in small object tracking and detection.

20 June 2024 in Sensors
Verified
Journal Article
Open access
PDF file
TZTianyi Zhang
Tianyi Zhang
KSKohei Shimasaki
Kohei Shimasaki
IIIdaku Ishii
Idaku Ishii
Akio NamikiAkio Namiki
Akio Namiki
Active vision systems (AVSs) have been widely used to obtain high-resolution images of objects of interest. However, tracking small objects in high-magnification scenes is challenging due to shallow depth of field (DoF) and narrow field of view (FoV). To address this, we introduce a novel high-speed AVS with a continuous autofocus (C-AF) approach based on dynamic-range focal sweep and a high-frame-rate (HFR) frame-by-frame tracking pipeline. Our AVS leverages an ultra-fast pan-tilt mechanism based on a Galvano mirror, enabling high-frequency view direction adjustment. Specifically, the proposed C-AF approach uses a 500 fps high-speed camera and a focus-tunable liquid lens operating at a sine wave, providing a 50 Hz focal sweep around the object’s optimal focus. During each focal sweep, 10 images with varying focuses are captured, and the one with the highest focus value is selected, resulting in a stable output of well-focused images at 50 fps. Simultaneously, the object’s depth is measured using the depth-from-focus (DFF) technique, allowing dynamic adjustment of the focal sweep range. Importantly, because the remaining images are only slightly less focused, all 500 fps images can be utilized for object tracking. The proposed tracking pipeline combines deep-learning-based object detection, K-means color clustering, and HFR tracking based on color filtering, achieving 500 fps frame-by-frame tracking. Experimental results demonstrate the effectiveness of the proposed C-AF approach and the advanced capabilities of the high-speed AVS for magnified object tracking.