Beating-Time Gestures Imitation Learning for Humanoid Robots

Journal Title: EAI Endorsed Transactions on Creative Technologies - Year 2017, Vol 4, Issue 13

Abstract

Beating-time gestures are movement patterns of the hand swaying along with music, thereby indicating accented musical pulses. The spatiotemporal configuration of these patterns makes it diÿcult to analyse and model them. In this paper we present an innovative modelling approach that is based upon imitation learning or Programming by Demonstration (PbD). Our approach - based on Dirichlet Process Mixture Models, Hidden Markov Models, Dynamic Time Warping, and non-uniform cubic spline regression - is particularly innovative as it handles spatial and temporal variability by the generation of a generalised trajectory from a set of periodically repeated movements. Although not within the scope of our study, our procedures may be implemented for the sake of controlling movement behaviour of robots and avatar animations in response to music.

Authors and Affiliations

Denis Amelynck, Pieter-Jan Maes, Jean-Pierre Martens, Marc Leman

Keywords

Related Articles

Head pose estimation & TV Context: current technology

With the arrival of low-cost high quality cameras, implicit user behaviour tracking is easier and it becomes very interesting for viewer modelling and content personalization in a TV context. In this paper, we present a...

Evaluating music performance and context-sensitivity with Immersive Virtual Environments

This study explores a unique experimental protocol that evaluates how a musician’s sensitivity to social context during performance can be analysed through a combination of behavioral analysis, self-report and Immersive...

Inducing omnipotence or powerlessness in learners with developmental and attention difficulties through structuring technologies

Schoolwork of learners with developmental and attention difficulties is often characterised by low productivity, many errors due to carelessness or inattention and poor organizing ability. Focus learners have difficultie...

Dynamic Resource Allocation Scheme Using Cooperative Game for Multimedia Services in LTE Advanced System

In LTE Advanced system, it is critical to carry on various types of services for different user applications. Obviously, the system resource requirements are quite different for each individual service. In order to alloc...

Advancing Performability in Playable Media: A Simulation-based Interface as a Dynamic Score

When designing playable media with non-game orientation, alternative play scenarios to gameplay scenarios must be accompanied by alternative mechanics to game mechanics. Problems of designing playable media with non-game...

Download PDF file
  • EP ID EP45882
  • DOI http://dx.doi.org/10.4108/eai.8-11-2017.153335
  • Views 295
  • Downloads 0

How To Cite

Denis Amelynck, Pieter-Jan Maes, Jean-Pierre Martens, Marc Leman (2017). Beating-Time Gestures Imitation Learning for Humanoid Robots. EAI Endorsed Transactions on Creative Technologies, 4(13), -. https://europub.co.uk./articles/-A-45882