medición de procesos cognitivos y emocionales - pedro rosa phd

MMeasu

Copelabs Cognition and People centric Computing Labs

Pedro J. Rosa, Ph.D.

Measuring cognitive and emotional processes-

Medición de processos cognitivos y emocinales

Pedro J. Rosa, Ph.D.

JULIO 21-23

EMOTION

Defining emotion

Emotion is a complex and non-consensual phenomenon

JULIO 21-23

The fetish for emotions

A large body of literature has shown the intimacy between emotion and cognition.

(e.g. LeDoux, 2002; Rosa et al., 2014, 2015)

JULIO 21-23

Defining emotion

JULIO 21-23

Are “supraordinate programs” that orchestrate a concerted psychophysiological response to current situations of adaptive significance in our evolutionary past.

(Loewenstein, 2007)

Measuring a person’s emotional state is one of the most vexing problems in affective science.

(Mauss & Robisson, 2009)

Defining emotion

JULIO 21-23

JULIO 21-23

Emotional episode is not a state but a process in time, during which a response is triggered by a certain stimulus. According to appraisal theories of emotion, once a stimulating event occurs, the individual evaluates what the consequences of this event may be and how they may affect his well-being and goals. Immediately after, a response is triggered to adjust to the new situation or to take action to modify it into a more suiting one.

Emotional episode

Stages of emotional episode

JULIO 21-23(Lazarus, 1991;Scherer, 1984;Smith &Ellsworth, 1985),

Stages of emotional episode

JULIO 21-23

Subjective/Cognitive

Physiological

Behavior

ThreatFear

response

JULIO 21-23

Emotional components

Emotions have been traditionally divided into three main components (the so called‘emotional response triad’ - Scherer 2001): physiological arousal, motor expression, and subjective feeling.

Subjective/Cognitive Physiological Behavior

Measurement

JULIO 21-23

Is the assignment of a number to a characteristc of an object event.

(Pedhazur et al, 1991)

JULIO 21-23

Type of measurement

Subjective vs Objective

JULIO 21-23

Subjective measurement

People’s opinions on certain issues.

Responses on checklists and rating scales Questionnaires

Responses on checklists and rating scales (Self-reports)

JULIO 21-23

Subjective measurement

JULIO 21-23

Measurement of the subjective emotional

experience

Dimensional vs discrete approach

JULIO 21-23

Measurement of the subjective emotional

experience

Dimensional vs discrete approach

Dimensional approach (Russel, 1980)

JULIO 21-23

Dimensional approach (Russel, 1980)

JULIO 21-23

There are a few fundamental dimensions that organize emotional responses. The most commonly assumed dimensions are valence, arousal sometimes referred to as activation), and approach–avoidance.

(Davidson, 1999; Lang, Bradley, & Cuthbert, 1997; Russell & Barrett, 1999; Schneirla, 1959; Watson, Wiese, Vaidya,& Tellegen, 1999).

Dimensional approach (single-item instrument)

JULIO 21-23

Affective space

JULIO 21-23

Tecnostress 1

Arousal

1 2 3 4 5 6 7 8 9

1 2 3 4 5 6 7 8 9

Valence

Technostress

positive

Arousal

1 2 3 4 5 6 7 8 9

1 2 3 4 5 6 7 8 9

Valence

positive

Negative

Arousal

1 2 3 4 5 6 7 8 9

1 2 3 4 5 6 7 8 9

Valence

negative

Pros and Cons

PROS:

Pictorical instrument

Minimize the respondent’s fatigue

CONS: the inability to measure differentiated emotions is a very important weak point

Neutral

Arousal

1 2 3 4 5 6 7 8 9

1 2 3 4 5 6 7 8 9

Valence

Neutral

Affective space

Afective grid(AG; Russell, Weiss, & Mendelsohn, 1989)

X

Excited

Calm

Unpleasant Pleasant

Afective grid(AG; Russell, Weiss, & Mendelsohn, 1989)

PROS:

Just a X is needed to respond

Minimize the respondent’s fatigue

CONS: Unfamiliar format

Feling scale (FS; Hardy & Rejeski, 1989)

Feling scale (FS; Hardy & Rejeski, 1989

The Feeling Scale (FS; Hardy & Rejeski, 1989) is an ll-point bipolar scale of pleasure and displeasure that ranges from -5 to +5. Anchors are provided at o="Neutral" and at all odd integers, ranging from -5 = "Very bad" to +5 = "Very good.“

Feling scale (FS; Hardy & Rejeski, 1989

PROS:

The rating scale is more intuitive (negative valence linked to the minus sign, neutral =0, and positive valence linked to the plus sign)

Minimize the respondent’s fatigue

CONS:

Not a pictorical instrument

The Felt Arousal Scale (FAS) (Svebak & Murgatroyd, 1985)

Feling scale (FS; Hardy & Rejeski, 1989

It is a 6-point single-item scale ranging from 1 to 6, with anchors only at 1 = "Low arousal" and 6 = "High arousal."

PROS:

Quick response Minimize the respondent’s fatigue

CONS:

The rating range is small

Feling scale (FS; Hardy & Rejeski, 1989

PROS:

The rating scale is more intuitive (negative valence linked to the minus sign, neutral =0, and positive valence linked to the plus sign)

Minimize the respondent’s fatigue

CONS:

Not a pictorical instrument

FS & FAS

The FS and FAS have been adapted for children with the addition of a series of stylized drawings of faces ranging from very happy to very sad and from very sleepy to very alert (Hulley et al., 2008).

FS & FAS

The FS and FAS have been adapted for children with the addition of a series of stylized drawings of faces ranging from very happy to very sad and from very sleepy to very alert (Hulley et al., 2008).

PANAS(Multi-item instrument)

The PANAS (Watson et aI., 1988) was developed as the operationalization of the orthogonal dimensions of positive affect (now called positive activation) and negative affect (now called negative activation) that emerged from the analyses of Zevon and Tellegen (1982) and Watson and Tellegen (1985).

PANAS(Multi-item instrument)

It consists of 20 items, 10 for the PAscale (e.g., interested, excited) and 10 for the NA scale (e.g., distressed, upset). Each item is accompanied by a 5-point scale ranging from "Very slightly or not at all" to "Extremely."

PANAS(Multi-item instrument)

PROS:

A deeper understanding of the affective impact

CONS:

Takes a long time to fill up

PANAS(Multi-item instrument)

Discrete approach of emotions

The discrete emotions perspective contends that each emotion (e.g., anger, sadness, contempt) corresponds to a unique profile in experience, physiology, and behavior.

(Ekman, 1999; Panksepp, 2007).

Discrete approach of emotions

The DES instructions ask the respondents to consider the experience they described and to rate how often s/he experienced each emotion item during the experience.

The DES is formulated around ten emotions that are considered to be fundamental by Izard (1992): joy, surprise, anger, disgust, contempt, shame, guilt, fear, interest, and sadness. Each item is administered on a 5-point (never to very often) scale.

Differential Emotions Scale (DES)

Differential Emotions Scale (DES)

Never Very often

Interest

Enjoyment

Surprise

Distress

Anger

Disgust

Contempt

Shame

Fear

Guilt

Differential Emotions ScaleNever Very

oftenInterest

Enjoyment

Surprise

Distress

Anger

Disgust

Contempt

Shame

Fear

Guilt

Differential Emotions ScaleNever Very

oftenInterest

Enjoyment

Surprise

Distress

Anger

Disgust

Contempt

Shame

Fear

Guilt

Differential Emotions Scale

Self-reports of emotion are likely to be more valid to the extent that they relate to currently experienced emotions.

Even in this case, though, there are concerns that not all individuals are aware of and/or capable of reporting on their momentary emotional states.

AUTONOMIC MEASURES OF EMOTION

The autonomic nervous system (ANS) is a general-purpose physiological system responsible for modulating peripheral functions (Öhman, Hamm, & Hugdahl, 2000). This system consists of sympathetic and parasympathetic branches, which are generally associated with activation and relaxation, respectively.

AUTONOMIC MEASURES OF EMOTION

AUTONOMIC MEASURES OF EMOTION

The most commonly assessed indices of ANS activation are based on electrodermal (i.e., sweat gland) or cardiovascular (i.e., blood circulatory system) responses.

Electrodermal responding:

skin conductance level (SCL) short-duration skin conductance responses (SCRs).

Ohm’s LawR = V / I

AUTONOMIC MEASURES OF EMOTION

The most commonly used cardiovascular measures include heart rate (HR), blood pressure (BP) and heart rate variability (HRV).

For example, SCL predominantly reflect sympathetic activity, HR and BP reflect a combination of sympathetic and parasympathetic activity, and HRV has been closely linked to parasympathetic activity

(Cacioppo, Berntson, Larsen, Poehlmann, & Ito, 2000).

AUTONOMIC MEASURES OF EMOTION

Pupillary activity

More recent data have suggested that emotional arousal is akey element in modulating the pupil’s response.

(Lang et al, 2008; Rosa et al 2014, 2015)

AUTONOMIC MEASURES OF EMOTION

The pupil is a vegative-sensor. Pupil size at a given moment is the result of the antagonistic balance between the two components of the ANS .

Diameter depends on:

• Amount of light• Cognitive load• Emotions

Most investigated emotions

Kreibig, 2010)

• A large set of researchers has advocated that the physiological correlates of discrete emotions are likely to be found in the brain rather than in peripheral physiological responses

(Buck, 1999; Izard, 2007; Panksepp, 2007).

BRAIN STATES AS A MEASURE OF EMOTION

EEG

The most common EEG measure of this type is alpha power (8–13 Hz band), which is thought to be inversely related to regional cortical activation

(Allen, Urry, Hitt, & Coan, 2004).

BRAIN STATES AS A MEASURE OF EMOTION

Frontal asymmetry

• Davidson and Henriques (1990) found that greater left-sided activation at baseline predicted more intense experiences of positive than negative emotion.

• Along similar lines, Davidson, Ekman, Saron, Senulis, and Friesen (1990) a greater left-sided frontal activation subsequent to the emotional induction.

• Other sources of data converge on a similar model of frontal asymmetry. Of particular importance are studies that link anger, an unpleasant but approach-related emotion, to greater left-hemispheric activation (Harmon-Jones, 2006).

BRAIN STATES AS A MEASURE OF EMOTION

Neuroimaging studies

• fMRI (functional magnetic resonance imaging) or PET (positron emission tomography) technologies, can locate activation in far more specific brain regions than EEG.

• For this reason, it has been proposed that neuroimaging methods may be better suited than EEG to reveal emotion specificity in the brain (Panksepp, 1998).

• In both technologies, the assumption is that a greater signal reflects greater blood flow to a particular brain region, which in turn is thought to reflect activation of that region.

BRAIN STATES AS A MEASURE OF EMOTION

Neuroimaging studies

FEAR – Amygdala (Murphy et al., 2003; Phan et al., 2002).

DISGUST – Insula Phan et al. (2002)

SADNESS - mPFC Phan et al. (2002)

ANGER AND HAPPINESS – inconclusive studies

BRAIN STATES AS A MEASURE OF EMOTION

• Darwin (1965) suggested that emotions serve an evolved communicative function and thus should prime behaviours that reveal one’s emotional state to others.

Vocal characteristics

• The most consistent association reported in the literature is between arousal and vocal pitch, such that higher levels of arousal have been linked to higher-pitched vocal samples

(e.g. Kappas, Hess, & Scherer, 1991)• Emotions such as fear, joy, and anger, pitch is higher than lower arousal

emotions such as sadness.

Behavioral measurements

Facial behaviour

Darwin (1965) reasoned that facial displays are closely tied to the likely behaviour of the organism (e.g., biting in the case of anger, which would result in exposed teeth).

Observer ratings ( Manual FACS)

Face detection software ( e.g. NOLDUS, EMOtient)

Behavioral measurements

Facial behaviour

Darwin (1965) reasoned that facial displays are closely tied to the likely behaviour of the organism (e.g., biting in the case of anger, which would result in exposed teeth).

Observer ratings ( Manual FACS)

Face detection software ( e.g. NOLDUS, EMOtient)

Behavioral measurements

Electromyography (EMG)

Facial behaviours potentially indicative of emotion can also be assessed with facial EMG, which involves measuring electrical potential from facial muscles via the placement of electrodes on the face.

Corrugator muscle activity decreases linearly with the pleasantness of affective stimuli —responding to stimuli across the full valence spectrum, while zygomatic muscle activity increases linearly with the pleasantness of affective stimuli—responding to pleasant stimuli

Behavioral measurements

EYE tracking

• We move our eyes to particular area of the visual field (foveation).

• This process allow us a detailed information processing.

ATTENTION is closed linked to EMOTION !!!

(ROSA et al, 2014, 2015)

Behavioral measurements

• Measuring valid data on emotional response has been and remains to be a challenge to emotion research (e.g., Levenson, 1988; Stemmler, 2003).

• It is not possible to infer about a certain emotion only with a single measurement.

• Multimodal recording are needed to assure the robustness of data.

Conclusions

Thank you for your attention!pedro.rosa@ulusofona.pt

orpedrorosa.psi@gmail.com

JULIO 21-23