Artificial Intelligence Supported Non-Verbal Communication for Enriched Collaboration in Distributed E-Research Environments

Abstract

In face-to-face work, discussion and negotiation relies strongly on non-verbal feedback, which provides important clues to negotiation states such as agreement/disagreement and understanding/confusion, as well as indicating the emotional states and reactions of those around us. With the continued rise of virtual teams, collaboration increasingly requires tools to manage the reality of distributed e-research and remote work, which is often hampered by a lack of social cohesion and such phenomena as participant multitasking. This chapter discusses important concepts and current issues related to remote research teams and discusses current research in the use of Automatic Facial Expression Recognition Systems (AFERS) in solving some of the inherent problems of the existing online collaboration tools used to support collaborative and distributed research and work. The later half of this chapter describes a proof-of-concept artificial intelligence based software agent (Emotion Tracking Agent, or ETA) developed by the authors for the monitoring of presence and the emotional states of co-workers in virtual research meetings. The agent is intended as an innovative solution to the impaired awareness and attention resulting from continuous task switching or multitasking behaviours of collaborating remote team members. The ETA was developed and integrated into a CVE (Collaborative Virtual Environment), where an initial study was conducted to analyse its benefits and impact on the communicating participants. This chapter describes the results of this study and their implications for the future of distributed e-research and remote work.