Kohei Shimasaki

Dr. Kohei Shimasaki

orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 January 2021 in IEEE Sensors Journal
Verified
Journal Article
Closed access
SHShaopeng Hu
Shaopeng Hu
KSKohei Shimasaki
Kohei Shimasaki
MJMingjun Jiang
Mingjun Jiang
TSTaku Senoo
Taku Senoo
IIIdaku Ishii
Idaku Ishii
This paper presents a novel dual-camera system that can simultaneously capture zoomed-in images using an ultrafast pan-tilt camera and a fixed wide-view camera using deep learning methods. An ultrafast pan-tilt camera can function as multiple virtual pan-tilt cameras by synchronizing a high-frame-rate zooming-view camera and an ultrafast pan-tilt mirror device that can switch over 500 different views in a second. A wide-view camera can obtain images in a fixed view in which multiple targets to be tracked are captured in low resolution and then recognized by processing the images using deep learning methods at a rate of dozens of frames per second. Based on the positions of all targets, recognized by the wide-view camera, the pan and tilt angles of multiple pan-tilt cameras are virtually controlled using an ultrafast pan-tilt camera through multithread viewpoint control to simultaneously capture the zoomed-in images of all targets. Our developed system can operate 10 virtual pan-tilt cameras (25 fps) with multithread viewpoint control and 4 ms time granularity in synchronization with convolutional neural-network-based recognition model operating at 25 fps, which is accelerated by a general-purpose computing on graphics processing units. The effectiveness of our system was demonstrated by the results of several experiments conducted on simultaneous zoom shooting of multiple running objects (persons and cars) in the range of approximately 80 m or higher in a natural outdoor scene, which was formerly too wide for a single fixed camera to capture clearly and simultaneously.

25 January 2021 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
MJMingjun Jiang
Mingjun Jiang
RSRyo Sogabe
Ryo Sogabe
KSKohei Shimasaki
Kohei Shimasaki
SHShaopeng Hu
Shaopeng Hu
TSTaku Senoo
Taku Senoo
IIIdaku Ishii
Idaku Ishii
This study proposes a visual tracking system with 500-fps image processing that can detect and track a fast-moving appearance-varying target in a 360-degree-field of view (FOV) from high-spatial-resolution images. The system consists of a high-speed camera, a pan-tilt Galvano-mirror system, and a mirror-drive high-speed pan control system with 360-degree-rotational capacity. Omnidirectional visual tracking of a remote object using complex visual features becomes possible due to the acquisition of high-spatial-resolution images of the target object via the system. We introduce an intelligent high frame rate (HFR) target-tracking algorithm that can simultaneously detect and track an appearance-varying object against a complex background for high-speed visual feedback control. Furthermore, the proposed surveillance system enables robust visual tracking under low-light conditions using a 3-D light detection and ranging (LiDAR) sensor system and a simultaneously controlled active spotlight projection system. The effectiveness of the proposed omnidirectional visual tracking system was demonstrated by conducting several omnidirectional detecting and tracking experiments on persons dozens of meters away using a 25-mm focal length lens under both daytime and night-time conditions.

1 July 2021 in Sensors
Verified
Journal Article
Open access
PDF file
ZAZulhaj Muhammad Aliansyah
Zulhaj Muhammad Aliansyah
KSKohei Shimasaki
Kohei Shimasaki
TSTaku Senoo
Taku Senoo
IIIdaku Ishii
Idaku Ishii
SUShuji Umemoto
Shuji Umemoto
Vision-based structural displacement methods allow convenient monitoring of civil structures such as bridges, though they are often limited due to the small number of measurement points, constrained spatial resolution, and inability to identify the acting forces of the measured displacement. To increase the number of measurement points in vision-based bridge displacement measurement, this study introduces a front-view tandem marker motion capture system with side-view traffic counting to identify the force-inducing passing vehicles on the bridge’s deck. The proposed system was able to measure structural displacement at submillimeter resolution on eight measurement points at once at a distance of 40.8–64.2 m from a front-view camera. The traffic counting system with a side-view camera recorded the passing vehicles from two opposing lanes. We conducted a 35-min experiment for a 25 m-span steel road bridge with hundreds of cars passing over it and confirmed dynamic displacement distributions with amplitudes of several millimeters when large vehicles passed.

11 February 2022 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
SHShaopeng Hu
Shaopeng Hu
HDHongyu Dong
Hongyu Dong
KSKohei Shimasaki
Kohei Shimasaki
MJMingjun Jiang
Mingjun Jiang
TSTaku Senoo
Taku Senoo
IIIdaku Ishii
Idaku Ishii
This study develops an omnidirectional panoramic video system that can simultaneously observe zoom-in images at dozens of different viewpoints in a 360-degree field of view by synchronizing hundreds of frames per second video shooting, with a rotation of tens-of-rotation-per-second mirror-rotator. When video shooting a scene with a certain exposure utilizing a mirror-rotator, apparent motion in the captured images becomes too large to observe non-blurred images, owing to its high-speed rotation. To reduce motion blurs caused by the rotation of a mirror-rotator, our system introduces an ultrafast pan-tilt mirror mechanism that can cancel apparent motion in images by executing frame-by-frame viewpoint control, so that the apparent speed in images becomes zero when the camera shutter is open, and it returns to its home position when the shutter is closed. Our system can capture 40 omnidirectionally different view images at 10 fps in real time by synchronizing 400-fps video shooting with frame-by-frame ultrafast pan-tilt mirror control for motion blur reduction when a mirror-rotator rotates at 10 rps. Its performance is verified by experimental results for several omnidirectional real scenes, and our system can capture clear and bright panoramic zoom-in images without decreasing the camera exposure when omnidirectionally observing dozens-of-meters-distance outdoor scenes.

21 April 2023 in Sensors
Verified
Journal Article
Open access
PDF file
QLQing Li
Qing Li
SHShaopeng Hu
Shaopeng Hu
KSKohei Shimasaki
Kohei Shimasaki
IIIdaku Ishii
Idaku Ishii
This study proposes a visual tracking system that can detect and track multiple fast-moving appearance-varying targets simultaneously with 500 fps image processing. The system comprises a high-speed camera and a pan-tilt galvanometer system, which can rapidly generate large-scale high-definition images of the wide monitored area. We developed a CNN-based hybrid tracking algorithm that can robustly track multiple high-speed moving objects simultaneously. Experimental results demonstrate that our system can track up to three moving objects with velocities lower than 30 m per second simultaneously within an 8-m range. The effectiveness of our system was demonstrated through several experiments conducted on simultaneous zoom shooting of multiple moving objects (persons and bottles) in a natural outdoor scene. Moreover, our system demonstrates high robustness to target loss and crossing situations.

15 January 2024 in IEEE Sensors Journal
Verified
Journal Article
Closed access
TZTianyi Zhang
Tianyi Zhang
ZLZiran Li
Ziran Li
QWQi Wang
Qi Wang
KSKohei Shimasaki
Kohei Shimasaki
IIIdaku Ishii
Idaku Ishii
Akio NamikiAkio Namiki
Akio Namiki
This paper presents a novel pan-tilt-zoom (PTZ) camera with extended depth-of-field (DoF) to address the limited DoF of the images taken by the zoom lens in zoomed-in monitoring. Our concept pioneers the organic integration of the through-focus scanning (TFS) mechanism and the high-speed pan-tilt mechanism based on the Galvano mirror. The TFS mechanism consists of a variable zoom lens, a servo motor, and a gear mechanism, enabling the system scans at object distances between 3 m and 10 m at 0.067 s per TFS process. A high-frame-rate (HFR) focus stacking algorithm based on GPU is implemented with a high-speed camera, achieving the frame rate of the DoF-extended zoomed-in images at approximately 15 fps. The 2-axis Galvano mirror enables ultrafast and precise pan-tilt adjustment between adjacent TFS processes while stably remaining stationary during the TFS process. The comparative experiment showcases the advanced performance of simultaneous focus on multiple objects at varying distances with high image quality and high magnification. Functional experimental results demonstrate the proposed PTZ camera’s advanced capabilities in swift pan-tilt adjustment and real-time DoF-extended zoomed-in image generation, highlighting the proposed system’s potential for practical applications in small object tracking and detection.