Video-Based Motion Capture for Measuring Human Movement

Video-Based Motion Capture for Measuring Human Movement

Chee Kwang Quah (Republic Polytechnic, Singapore), Michael Koh (Republic Polytechnic, Singapore), Alex Ong (Republic Polytechnic, Singapore), Hock Soon Seah (Nanyang Technological University, Singapore) and Andre Gagalowicz (INRIA, Le Chesnay, France)
DOI: 10.4018/978-1-60566-406-4.ch005
OnDemand PDF Download:


Through the advancement of electronics technologies, human motion analysis applications span many domains. Existing commercially available magnetic, mechanical and optical systems for motion capture and analyses are far from being able to operate in natural scenarios and environments. The current shortcoming of requiring the subject to wear sensors and markers on the body has prompted development directed towards a marker-less setup using computer vision approaches. However, there are still many challenges and problems in computer vision methods such as inconsistency of illumination, occlusion and lack of understanding and representation of its operating scenario. The authors present a videobased marker-less motion capture method that has the potential to operate in natural scenarios such as occlusive and cluttered scenes. In specific applications in sports biomechanics and education, which are stimulated by the usage of interactive digital media and augmented reality, accurate and reliable capture of human motion are essential.
Chapter Preview


Work on motion capture and analysis started as early as the 19th century, when Eadweard Muybridge began photographing horses to analyze their movement. During that period, a French physiologist Etienne-Jules Marey also embarked on his chronophotography work in studying the human performance filmed. Chronophotography is an application of the study of movement (science), and photography (art).The importance of motion capture (mocap in short), is motivated by its applications over a wide spectrum of areas. Tracking and following the movement of human joints over an image sequence, and recovering the 3D body posture and kinematics are especially useful for the study of the human locomotion and bio-mechanical applications (Corazza, 2006), such as gait analysis, injury prevention, rehabilitation and sports performance enhancement.

Since the mid-1970s, human motion analysis applications have made significant progress thanks largely to the tremendous advancement in digital electronics technologies. The measuring and analyzing of human movement have applications in many domains ranging from kinesiology, ergonomics, sports, 3D animation, 3D tele-presence, augmented reality, video surveillance, video data compression as well as medicine and clinical practice. Many, if not all, of these systems require the tracking of the motion trajectory of the subjects to yield kinematic information for further analysis.

There are many technologies developed to capture the human motion. They range from magnetic, mechanical and optical systems, for which the subject needs to wear sensors and markers on the body, to the non-intrusive one which is based purely on using video cameras. The kind of set-ups, methods and technologies that are used for motion capture are largely determined by their respective operational needs, that is, application specific. For example, it is a common practice in biomechanical studies for the subjects to wear reflective markers for movement analysis while operating in a very well-controlled environment.

In order to be suitable for human biomechanical applications, which is our main focus, the motion capture technique has to yield accurate and reliable quantitative information. To extend the applications, cluttered, outdoor and occlusive environments have to be considered. Also, the freedom of movement to the performer is an important consideration, which implies that wearing of sensors on the body has to be avoided. These issues are especially crucial if we are to consider a real scenario such as a sports tournament. Therefore, it has prompted many researchers to explore the use of video-based computer vision motion capture, which do not need any sensor or marker on the subject, for measuring the human movement.

Over the years, the use of video applications in the teaching of sports and physical activities have ranged from qualitative analyses to augment feedback in learning new sports skills (Koh & Anwari, 2004) to multimedia online environments with rich displays of animations and videos and embedded discussion forums to facilitate analysis and critique. These were designed to convey multiple representations of actual skilled sports performances and to facilitate the use of cognitive and social processes in learning and inquiry in a collaborative manner (Lim & Koh, 2006). However, efforts to use learning technologies are often hampered by prevailing attitudes and logistical issues. It is hoped that a marker-less motion capture system will circumvent the logistical issues and make for a seamless integration into novel pedagogical approaches in teaching sports and physical activities. Done well, this new form of learning technology has the potential to bring about a cultural change in the way we teach and learn.

Motivated by the enormous potential and widespread applications that lead to the pursuit of a video-based marker-less motion capture system, in this chapter we describe the application and technical advancements, future challenges and problems that lay ahead as we work towards a marker-less motion capture system. We will also present the work of our research team in the development of a marker-less motion capture system (see the following).

The outline of this chapter is as follows:

Complete Chapter List

Search this Book:
Editorial Advisory Board
Table of Contents
Graham Cuskelly
Nigel Pope, Kerri-Ann L. Kuhn, John J.H. Forster
Chapter 1
John J.H. Forster
One of the major forces shaping modern sport is the application of digital technology. This is transforming the mass consumption, distribution... Sample PDF
Digital Technologies and the Intensification of Economic and Organisational Mechanisms in Commercial Sport
Chapter 2
Sean Reilly, Peter Barron, Vinny Cahill, Kieran Moran, Mads Haahr
The area of computer-augmented sports is large and complex and spans several disciplines. This chapter presents a general-purpose taxonomy of... Sample PDF
A General-Purpose Taxonomy of Computer-Augmented Sports Systems
Chapter 3
Veljko Potkonjak, Miomir Vukobratovic, Kalman Babkovic, Branislav Borovac
This chapter relates biomechanics to robotics. The mathematical models are derived to cover the kinematics and dynamics of virtually any motion of a... Sample PDF
Dynamics and Simulation of General Human and Humanoid Motion in Sports
Chapter 4
Brendan Burkett
Monitoring of player activity within a competition is currently a reality within some high performance sporting teams, and the demand and level of... Sample PDF
Technologies for Monitoring Human Player Activity Within a Competition
Chapter 5
Chee Kwang Quah, Michael Koh, Alex Ong, Hock Soon Seah, Andre Gagalowicz
Through the advancement of electronics technologies, human motion analysis applications span many domains. Existing commercially available magnetic... Sample PDF
Video-Based Motion Capture for Measuring Human Movement
Chapter 6
Amin Ahmadi, David D. Rowlands, Daniel A. James
Tennis is a popular game played and viewed by millions of people around the world. There is a large impetus for players to improve their game and... Sample PDF
Technology to Monitor and Enhance the Performance of a Tennis Player
Chapter 7
Daniel A. James, Andrew Busch, Yuji Ohgi
The testing and monitoring of elite athletes in their natural training and performance environment is a relatively new area of development that has... Sample PDF
Quantitative Assessment of Physical Activity Using Inertial Sensors
Chapter 8
Volker Wulf, Florian ‘Floyd’ Mueller, Eckehard F. Moritz, Gunnar Stevens, Martin R. Gibbs
Augmenting existing sports experiences with computing technology is increasingly gaining attention due to its potential for performance enhancement.... Sample PDF
Computer Supported Collaborative Sports: An Emerging Paradigm
Chapter 9
Florian ‘Floyd’ Mueller
Recent advances in computing technology have contributed to a new trend that merges digital gaming with physical sports activities and combines the... Sample PDF
Digital Sport: Merging Gaming with Sports to Enhance Physical Activities Such as Jogging
Chapter 10
Lauren Silberman
Just at the moment when gaming has achieved broad cultural acceptance, a new way of using commercial sport video games is emerging, which adds a new... Sample PDF
Double Play: How Video Games Mediate Physical Performance for Elite Athletes
Chapter 11
Donald P. Roy, Benjamin D. Goss
The explosion of fantasy sports and the dearth of research about it create a need for investigation in this relatively new form of sport... Sample PDF
A League of Our Own: Empowerment of Sport Consumers Through Fantasy Sports Participation
Chapter 12
Jean-Pierre Dussault, Michael Greenspan, Jean-François Landry, Will Leckie, Marc Godard, Joseph Lam
We introduce pool and its variants, and describe the challenges of computationally simulating the game to create a robot capable of selecting and... Sample PDF
Computational and Robotic Pool
Chapter 13
Scott Bingley, Stephen Burgess
Sport plays a major part in the Australian psyche with millions of people participating every year. However organised sport at the local or social... Sample PDF
A Framework for the Adoption of the Internet in Local Sporting Bodies: A Local Sporting Association Example
Chapter 14
Anthony K. Kerr
Globalisation and advances in communications technology have greatly expanded the potential marketplace for professional teams, especially for those... Sample PDF
Online Questionnaires and Interviews as a Successful Tool to Explore Foreign Sports Fandom
Chapter 15
Gaoqi He, Zhigeng Pan, Weimin Pan, Jianfeng Liu
Virtual reality and the Olympic Games Museum are used to create a virtual digital Olympic museum (VDOM). This is available solely through the medium... Sample PDF
Virtual Digital Olympic Museum
Chapter 16
Kerri-Ann L. Kuhn
A multi-billion dollar industry, electronic games have been experiencing strong and rapid growth in recent times. The world of games is not only... Sample PDF
The Market Structure and Characteristics of Electronic Games
Chapter 17
Beth A. Cianfrone, James J. Zhang
This chapter introduces the new and unique sport promotional format of sport video game sponsorships and in-game advertising. Information on the... Sample PDF
Sport Video Game Sponsorships and In-Game Advertising
Chapter 18
Mark Lee, Rajendra Mulye, Constantino Stavros
This chapter reports a recent research study involving a sports video game which sought to provide an overview on the use of in-game advertising... Sample PDF
In-Game Advertising: Effectiveness and Consumer Attitudes
Chapter 19
Monica D. Hernandez, Sindy Chapa
The authors’ study examined factors affecting Mexican adolescent’s memory of brand placements contained in advergames. Specifically, two concerns... Sample PDF
The Effect of Arousal on Adolescent's Short-Term Memory of Brand Placements in Sports Advergames
Chapter 20
Ellen L. Bloxsome, Nigel K. Ll. Pope
This chapter presents marketers, sporting management and sports organizations with a technique for analyzing consumer schemas associated with... Sample PDF
Schemas of Disrepute: Digital Damage to the Code
About the Contributors