Using Augmented-Reality to Aid in Lego Construction: A Mobile Application

Using Augmented-Reality to Aid in Lego Construction: A Mobile Application

Conrado Ruiz Jr. (De La Salle University, Philippines), Juan Lorenzo Simeon (De La Salle University, Philippines), Kingston Anthony Koa (De La Salle University, Philippines), John Israel Domingo Caingles (De La Salle University, Philippines) and Anne Marielle Bagamaspad (De La Salle University, Philippines)
DOI: 10.4018/978-1-5225-9069-9.ch010

Abstract

LEGO structures are generally constructed by following an instruction manual in paper or digital form, which shows the LEGO model at different stages of assembly. Some instructions can be very complicated and difficult to illustrate on paper. Augmented reality (AR) is a technology that superimposes 3D models onto the physical world. This chapter explores the use of AR for assembly through a mobile application for Android devices that serves as an assembly guide for LEGO structures. The system can recognize the current step of the LEGO assembly using data captured via Microsoft Kinect while providing visual feedback through a mobile application. To identify the current step, the system obtains the color and depth data from the Kinect camera and converts the data into a point cloud, which is compared to stored LEGO model data. The system was evaluated based on the accuracy of the recognition, latency of the feedback and the assembly time of the user.
Chapter Preview
Top

Background

Augmented Reality (AR) has found applications in numerous areas and has received significant attention from the research community. Hou et al. (2015) found out that the use of AR can cognitively help in manual assembly. They conducted experiments to compare the inclusion and exclusion of AR as a substitute for paper-based manuals. Their conclusion was that using an animated AR system has a positive effect in the cognitive facilitation. Specifically, the learning curve of trainees significantly improved, and fewer errors were made.

Key Terms in this Chapter

3D Mesh: A collection of vertices, edges, and faces that represents a 3D object in computer graphics or solid modeling.

Depth Camera: A special camera capable of determining the depth information of objects which can be used for 3D reconstruction.

Point cloud: A set of data points in 2D or 3D space that are obtained from 3D scanners or depth cameras.

Mobile Devices: A portable computing device like smartphones or tablets.

LEGO: A brand of plastic construction toys that are manufactured by a private Danish company, The LEGO Group.

Augment Reality: A technology that superimposes a computer-generated images or 3D models to the user's view of the real world.

Complete Chapter List

Search this Book:
Reset