Machine learning and deep learning play a vital role in making smart decisions, especially with huge amounts of data. Identifying the emotional intelligence levels of individuals helps them to avoid superfluous problems in the workplace or in society. Emotions reflect the psychological state of a person or represent a quick (a few minutes or seconds) reactions to a stimulus. Emotions can be categorized on the basis of a person's feelings in a situation: positive, negative, and neutral. Emotional intelligence seeks attention from computer engineers and psychologists to work together to address EI. However, identifying human emotions through deep learning methods is still a challenging task in computer vision. This chapter investigates deep learning models for the recognition and assessment of emotional states with diverse emotional data such as speech and video streaming. Finally, the conclusion summarises the usefulness of DL methods in assessing human emotions. It helps future researchers carry out their work in the field of deep learning-based emotional artificial intelligence.
TopIntroduction
The term Emotional Intelligence (EI) is referred to as the capability to distinguish emotions, to recognize the context of emotion and its associations with the behaviour and expression of the person. Determining the cause of emotions, and interpreting the problem can be solved on basis of the determining emotions. EI considers perceiving the observation of emotion, relating emotion-associated thoughts, interpreting, deriving the motive behind emotions, and regulating emotions (Dollmat & Abdullah, 2021).
Emotional intelligence is defined as “the capacity to reason about emotions, and of emotions to enhance thinking. It includes the abilities to accurately perceive emotions, to access and generate emotions to assist thought, to understand emotions and emotional knowledge, and to reflectively regulate emotions to promote emotional and intellectual growth” (Mayer et al. 2004). Emotions are important because humans can communicate with people (Ekman et al., 2002). Facial expressions are crucial in identifying an individual's emotions. These expression talks a lot about an individual as it possesses diversities. Extracting the information from the facial expressions is not an easy task. Automated recognition of facial emotions using different sensor devices is very much required in various applications. Therefore, it is necessary to develop a system using artificial intelligence techniques which will capture human emotions and facial expressions effectively. Hence, it is an open challenge among the research community. Emotions can also be recognized using the voice of an individual using a device (Schuller et al. 2003). Deep learning-based train models can detect the voice of the person and predict the feeling of a person and his mental state.
Figure 1.
Components of Emotional intelligence
Emotional programming is a field where engineers collect data related to different facial expressions, speech, and videos and identify and interpret the emotions of an individual in different situations. Further, the deep learning model is trained using the collected data to predict human emotions. These emotions help individuals to behave with others at their workplace and help humans to act intelligently to make healthy coordination with colleagues and friends. The most significant kind of natural human relationship involves emotion in a significant way. Emotional intelligence is used to process most aspects of human experience, including how we handle difficulties, express our feelings, and communicate with others. A person with emotional intelligence can communicate, empathize with others, and be both self- and socially aware. It has been demonstrated that having a high level of emotional intelligence helps students succeed academically, managers finish their tasks, and managers lead their teams more efficiently (Prentice et.al 2020). Therefore, emotional intelligence is important to human life.
Human beings possess two types of mind, one is emotional and another one is rational. A rational mind enables humans to think to make intelligent decisions. On the other hand, the emotional mind is about what a person feels. These two minds complement each other and carry the overall personality of a person. One cannot decide based on either a rational mind or an emotional mind. The challenge here is to incorporate these two bits of intelligence of mind to develop an intelligent system that reflects human behaviour. However, different definitions are proposed by various researchers in the literature (Alnuaim et al., 2022).Emotion Recognition is becoming a rapidly rising research field. The various application domains are exploiting emotion recognition techniques, such as game applications, health monitoring, and care, online shopping, and various online service applications like the cab, beauty care, home service, home appliance servicing, etc. Emotion plays a vital role in human life, it affects the psychological state of a person in a different situation. Emotions are a response to the stimulus which will last in a few minutes or seconds. As a result, a person, experiences feelings, and emotions, which can be classified into three labels: positive, negative, and neutral based on the feeling oneself in a particular situation (Lu, 2021)?