Optimal Strategy for Sit-to-Stand Movement Using Reinforcement Learning
Journal Title: Journal of Rehabilitation Sciences and Research - Year 2017, Vol 4, Issue 3
Abstract
Background: Sit-to-stand motion is a frequent and challenging task in daily life activities especially for elderly and disabled people. Central nervous system uses several strategies for sit-to-stand movement. Many studies have been conducted to understand the underlying basis of the optimal approach. Reinforcement learning (RL) is a suitable method for modeling the control strategies that occur in neuro-musculoskeletal system. Methods: In this paper a dynamic model of human sit-to-stand was derived, and kinematic data of a healthy subject has been extracted in this task. An optimal control problem was formulated considering minimum energy and Q-Learning method has been utilized to find the optimal joint moments during sit to stand movement. Results: The simulation results have been compared to the experimental data. The lower extremity joint angles have been simulated and tracked the actual human angles extracted from the experiments. Also the joints moments showed a satisfactory precision by the proposed approach. Conclusion: An RL-based algorithm was used to model the human sit-to-stand, in which the model explores the state space with a Markov based approach and finds the best actions (joint moments) at each state (posture). In this approach the model successfully performs the task while consuming minimum energy. This was achieved by updating the algorithm in every trial using a Q-learning method.
Authors and Affiliations
Saeed Jamali, Sajjad Taghvaei, Seyyed Arash Haghpanah
Keywords
Related Articles
- EP ID EP374438
- DOI -
- Views 88
- Downloads 0
The Comparison of the Effects of Contrast Bath on Circulation of Contralateral Lower Limb in Type 2 Diabetic and Healthy Women
Background: Contrast bath is a thermal agent that is used as alternative heat and cold water on a target limb. Type 2 diabetes mellitus in long term leads to vascular insufficiency. It seems that contrast bath is useful...
Flexibility of Knee Joint Muscles in Women with Knee Osteoarthritis and Healthy Controls
Background: Osteoarthritis is one of the most common diseases in synovial joints. Due to high loading forces during weight-bearing activities, the knee joint is prone to degenerative processes. This study aimed to compar...
The Reliability of Smartphone and Goniometric Measurements of Hip Range of Motion
Background: Range of motion is an essential component of the hip examination. Handling issues with the goniometer often create challenges when measuring hip passive range of motion (PROM). Recent generations of smartphon...
Effect of Kinesiotaping and Stretching Exercise on Forward Shoulder Angle in Females with Rounded Shoulder Posture
Background: Rounded shoulder posture is a common abnormal posture in upper quarter. Kinesiotape is a new intervention that recently used in rehabilitation. There are no studies have examined the effect of kinesiotape on...
Comparison of Phonemic Fluency Test Results Using Different Letters among Persian Speakers
Background: The purpose of this study was to compare the results obtained from phonemic fluency test using “F”1, “A”2, “S”3 and “L”4, “T”5,”M”6 among Persian Speakers aged between 20 and 30 years. Methods: In this applie...