Jonathan Feng-Shun Lin

Jonathan Feng-Shun Lin

Auto-generated profile, based on publicly available information

Jonathan Feng-Shun Lin

University of Waterloo

Research Focus & Metrics

Academic Career Length

15Years (2012-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 January 2016 in IEEE Transactions on Human-Machine Systems
Verified
Journal Article
Closed access
JLJonathan Feng-Shun Lin
Jonathan Feng-Shun Lin
MKMichelle Karg
Michelle Karg
DKDana Kulic
Dana Kulic
Movement primitive segmentation enables long sequences of human movement observation data to be segmented into smaller components, termed movement primitives, to facilitate movement identification, modeling, and learning. It has been applied to exercise monitoring, gesture recognition, human-machine interaction, and robot imitation learning. This paper proposes a segmentation framework to categorize and compare different segmentation algorithms considering segment definitions, data sources, application-specific requirements, algorithm mechanics, and validation techniques. The framework is applied to human motion segmentation methods by grouping them into online, semionline, and offline approaches. Among the online approaches, distance-based methods provide the best performance, while stochastic dynamic models work best in the semionline and offline settings. However, most algorithms to date are tested with small datasets, and algorithm generalization across participants and to movement changes remains largely untested.

23 November 2012 in Physiological Measurement
Verified
Journal Article
Closed access
PDF file
JLJonathan F S Lin
Jonathan F S Lin
DKDana Kulić
Dana Kulić
Many applications in rehabilitation and sports training require the assessment of the patient’s status based on observation of their movement. Small wireless sensors, such as accelerometers and gyroscopes, can be utilized to provide a quantitative measure of the human movement for assessment. In this paper, a kinematics-based approach is developed to estimate human leg posture and velocity from wearable sensors during the performance of typical physiotherapy and training exercises. The proposed approach uses an extended Kalman filter to estimate joint angles from accelerometer and gyroscopic data and is capable of recovering joint angles from arbitrary 3D motion. Additional joint limit constraints are implemented to reduce drift, and an automated approach is developed for estimating and adapting the process noise during online estimation. The approach is validated through a user study consisting of 20 subjects performing knee and hip rehabilitation exercises. When compared to motion capture, the approach achieves an average root-mean-square error of 4.27 cm for unconstrained motion, with an average joint error of 6.5°. The average root-mean-square error is 3.31 cm for sagittal planar motion, with an average joint error of 4.3°.

2 May 2013 in IEEE Transactions on Neural Systems and Rehabilitation Engineering
Verified
Journal Article
Closed access
JLJonathan Feng-Shun Lin
Jonathan Feng-Shun Lin
DKDana Kulic
Dana Kulic
To enable automated analysis of rehabilitation movements, an approach for accurately identifying and segmenting movement repetitions is required. This paper proposes an approach for online, automated segmentation and identification of movement segments from continuous time-series data of human movement, obtained from body-mounted inertial measurement units or from motion capture data. The proposed approach uses a two-stage identification and recognition process, based on velocity features and stochastic modeling of each motion to be identified. In the first stage, motion segment candidates are identified based on a characteristic sequence of velocity features such as velocity peaks and zero velocity crossings. In the second stage, hidden Markov models are used to accurately identify segment locations from the identified candidates. The proposed approach is capable of online segmentation and identification, enabling interactive feedback in rehabilitation applications. The approach is validated on 20 healthy subjects and four rehabilitation patients performing rehabilitation movements, achieving segmentation accuracy of 87% with user specific templates and 79%-83% accuracy with user-independent templates.

29 July 2019 in IEEE Transactions on Robotics
Verified
Journal Article
Closed access
WJWanxin Jin
Wanxin Jin
DKDana Kulic
Dana Kulic
JLJonathan Feng-Shun Lin
Jonathan Feng-Shun Lin
SMShaoshuai Mou
Shaoshuai Mou
SHSandra Hirche
Sandra Hirche
In this paper, we consider a dynamical system whose trajectory is a result of minimizing a multiphase cost function. The multiphase cost function is assumed to be a weighted sum of specified features (or basis functions) with phase-dependent weights that switch at some unknown phase transition points. A new inverse optimal control approach for recovering the cost weights of each phase and estimating the phase transition points is proposed. The key idea is to use a length-adapted window moving along the observed trajectory, where the window length is determined by finding the minimal observation length that suffices for a successful cost weight recovery. The effectiveness of the proposed method is first evaluated on a simulated robot arm, and then, demonstrated on a dataset of human participants performing a series of squatting tasks. The results demonstrate that the proposed method reliably retrieves the cost function of each phase and segments each phase of motion from the trajectory with a segmentation accuracy above 90%.

7 July 2020 in Scientific Reports
Verified
Journal Article
Open access
PDF file
KWKevin Westermann
Kevin Westermann
JLJonathan Feng-Shun Lin
Jonathan Feng-Shun Lin
DKDana Kulić
Dana Kulić
Analysis of complex human movements can provide valuable insights for movement rehabilitation, sports training, humanoid robot design and control, and human–robot interaction. To accomplish complex movement, the central nervous system must coordinate the musculo-skeletal system to achieve task and internal (e.g., effort minimisation) objectives. This paper proposes an inverse optimal control approach for analysing complex human movement that does not assume that the control objective(s) remains constant throughout the movement. The movement trajectory is assumed to be optimal with respect to a cost function composed of the sum of weighted basis cost functions, which may be time varying. The weights of the cost function are recovered using a sliding window. To illustrate the proposed approach, a dataset consisting of standing broad jump to targets at three different distances is collected. The method can be used to extract control objectives that influence task success, identify different motion strategies/styles, as well as to observe how control strategy changes during the motor learning process. Kinematic analysis confirms that the identified control objectives, including centre-of-mass takeoff vector and foot placement upon landing are important to ensure that a given participant lands on the target. The dataset, including nearly 800 jump trajectories from 22 participants is also provided.

1 November 2016
Verified
Conference Paper
Closed access
JLJonathan Feng-Shun Lin
Jonathan Feng-Shun Lin
VBVincent Bonnet
Vincent Bonnet
APAdina M. Panchea
Adina M. Panchea
NRNacim Ramdani
Nacim Ramdani
GVGentiane Venture
Gentiane Venture
DKDana Kulic
Dana Kulic
A common hypothesis in human motor control is that human movement is generated by optimizing with respect to a certain criterion and is task dependent. In this paper, a method to segment human movement by detecting changes to the optimization criterion being used via inverse optimal control is proposed. The control strategy employed by the motor system is hypothesized to be a weighted sum of basis cost functions, with the basis weights changing with changes to the motion objective(s). Continuous time series data of movement is processed using a sliding fixed width window, estimating the basis weights of each cost function for each window by minimizing the Karush-Kuhn-Tucker optimality conditions. The quality of the cost function recovery is verified by evaluating the residual. The successfully estimated basis weights are averaged together to create a set of time varying basis weights that describe the changing control strategy of the motion and can be used to segment the movement with simple thresholds. The proposed algorithm is first demonstrated on simulation data and then demonstrated on a dataset of human subjects performing a series of squatting tasks. The proposed approach reliably identifies the squatting movements, achieving a segmentation accuracy of 84%.