Social signals of deception and dishonesty

Judee K. Burgoon, Dimitri Metaxas, Thirimachos Bourlai, Aaron Elkins

Research output: Chapter in Book/Report/Conference proceedingChapter

1 Citation (Scopus)

Abstract

Social life is constituted of interactions with others - others whom we must rapidly classify as friend or foe, as trustworthy or not. Gauging another’s trustworthiness relies on successfully reading nonverbal signals - signals that have been selected through human evolution to serve precisely such a communicative function. These deeply ingrained signals - some part of our phylogenetic heritage and some part of our socially constructed communication system - form the unwritten “order" for cooperative encounters, enabling both individuals and societies to survive and thrive. Yet paradoxically, the same course of evolution has also remunerated, with greater prospects for survival, those who manipulate and falsely manufacture such signals; in short, those who cheat, dissemble and deceive. Put differently, the course of human development has produced a system of presumably reliable signals of veracity, authenticity, trust and trustworthiness, while simultaneously conferring advantages on sham portrayals of those same signals. The use of dishonest signals is not confined to humans; natural selection has also rewarded sophisticated forms of cheating among all manner of living organisms (Greenfield, 2006). Consequently, these nonverbal signals, many of which are universal and have similarities among other species, are among the most important for humans to produce and read and the most useful for computational methods to detect and track. In what follows, we foreground those aspects of social signaling related to veracity that have widespread use and recognition. These are the kinds of signals that Burgoon and Newton (1991) identified as corresponding to a social meaning model in that they are recurrent expressions that have consensually recognized meanings within a given community. In this chapter, we first provide the reader background on the nature of the aforementioned signals. Next, we discuss automated methods for human nonverbal communication computing, i.e., methods we used for identifying and tracking such signals. Then, we discuss computer vision technologies using sensors operating in different wavelengths of the infrared band and not only the visible band, which is conventionally used. We conclude with recommendations for promising future research directions where the latest technologies can be applied to this elemental aspect of social signaling.

Original languageEnglish (US)
Title of host publicationSocial Signal Processing
PublisherCambridge University Press
Pages404-428
Number of pages25
ISBN (Electronic)9781316676202
ISBN (Print)1107161266, 9781107161269
DOIs
StatePublished - Jan 1 2017

Fingerprint

Gaging
Computational methods
Computer vision
Communication systems
Infrared radiation
Wavelength
Communication
Sensors

All Science Journal Classification (ASJC) codes

  • Computer Science(all)

Cite this

Burgoon, J. K., Metaxas, D., Bourlai, T., & Elkins, A. (2017). Social signals of deception and dishonesty. In Social Signal Processing (pp. 404-428). Cambridge University Press. https://doi.org/10.1017/9781316676202.029
Burgoon, Judee K. ; Metaxas, Dimitri ; Bourlai, Thirimachos ; Elkins, Aaron. / Social signals of deception and dishonesty. Social Signal Processing. Cambridge University Press, 2017. pp. 404-428
@inbook{32e5241d18cd49a5ab82a0dec815983a,
title = "Social signals of deception and dishonesty",
abstract = "Social life is constituted of interactions with others - others whom we must rapidly classify as friend or foe, as trustworthy or not. Gauging another’s trustworthiness relies on successfully reading nonverbal signals - signals that have been selected through human evolution to serve precisely such a communicative function. These deeply ingrained signals - some part of our phylogenetic heritage and some part of our socially constructed communication system - form the unwritten “order{"} for cooperative encounters, enabling both individuals and societies to survive and thrive. Yet paradoxically, the same course of evolution has also remunerated, with greater prospects for survival, those who manipulate and falsely manufacture such signals; in short, those who cheat, dissemble and deceive. Put differently, the course of human development has produced a system of presumably reliable signals of veracity, authenticity, trust and trustworthiness, while simultaneously conferring advantages on sham portrayals of those same signals. The use of dishonest signals is not confined to humans; natural selection has also rewarded sophisticated forms of cheating among all manner of living organisms (Greenfield, 2006). Consequently, these nonverbal signals, many of which are universal and have similarities among other species, are among the most important for humans to produce and read and the most useful for computational methods to detect and track. In what follows, we foreground those aspects of social signaling related to veracity that have widespread use and recognition. These are the kinds of signals that Burgoon and Newton (1991) identified as corresponding to a social meaning model in that they are recurrent expressions that have consensually recognized meanings within a given community. In this chapter, we first provide the reader background on the nature of the aforementioned signals. Next, we discuss automated methods for human nonverbal communication computing, i.e., methods we used for identifying and tracking such signals. Then, we discuss computer vision technologies using sensors operating in different wavelengths of the infrared band and not only the visible band, which is conventionally used. We conclude with recommendations for promising future research directions where the latest technologies can be applied to this elemental aspect of social signaling.",
author = "Burgoon, {Judee K.} and Dimitri Metaxas and Thirimachos Bourlai and Aaron Elkins",
year = "2017",
month = "1",
day = "1",
doi = "10.1017/9781316676202.029",
language = "English (US)",
isbn = "1107161266",
pages = "404--428",
booktitle = "Social Signal Processing",
publisher = "Cambridge University Press",
address = "United Kingdom",

}

Burgoon, JK, Metaxas, D, Bourlai, T & Elkins, A 2017, Social signals of deception and dishonesty. in Social Signal Processing. Cambridge University Press, pp. 404-428. https://doi.org/10.1017/9781316676202.029

Social signals of deception and dishonesty. / Burgoon, Judee K.; Metaxas, Dimitri; Bourlai, Thirimachos; Elkins, Aaron.

Social Signal Processing. Cambridge University Press, 2017. p. 404-428.

Research output: Chapter in Book/Report/Conference proceedingChapter

TY - CHAP

T1 - Social signals of deception and dishonesty

AU - Burgoon, Judee K.

AU - Metaxas, Dimitri

AU - Bourlai, Thirimachos

AU - Elkins, Aaron

PY - 2017/1/1

Y1 - 2017/1/1

N2 - Social life is constituted of interactions with others - others whom we must rapidly classify as friend or foe, as trustworthy or not. Gauging another’s trustworthiness relies on successfully reading nonverbal signals - signals that have been selected through human evolution to serve precisely such a communicative function. These deeply ingrained signals - some part of our phylogenetic heritage and some part of our socially constructed communication system - form the unwritten “order" for cooperative encounters, enabling both individuals and societies to survive and thrive. Yet paradoxically, the same course of evolution has also remunerated, with greater prospects for survival, those who manipulate and falsely manufacture such signals; in short, those who cheat, dissemble and deceive. Put differently, the course of human development has produced a system of presumably reliable signals of veracity, authenticity, trust and trustworthiness, while simultaneously conferring advantages on sham portrayals of those same signals. The use of dishonest signals is not confined to humans; natural selection has also rewarded sophisticated forms of cheating among all manner of living organisms (Greenfield, 2006). Consequently, these nonverbal signals, many of which are universal and have similarities among other species, are among the most important for humans to produce and read and the most useful for computational methods to detect and track. In what follows, we foreground those aspects of social signaling related to veracity that have widespread use and recognition. These are the kinds of signals that Burgoon and Newton (1991) identified as corresponding to a social meaning model in that they are recurrent expressions that have consensually recognized meanings within a given community. In this chapter, we first provide the reader background on the nature of the aforementioned signals. Next, we discuss automated methods for human nonverbal communication computing, i.e., methods we used for identifying and tracking such signals. Then, we discuss computer vision technologies using sensors operating in different wavelengths of the infrared band and not only the visible band, which is conventionally used. We conclude with recommendations for promising future research directions where the latest technologies can be applied to this elemental aspect of social signaling.

AB - Social life is constituted of interactions with others - others whom we must rapidly classify as friend or foe, as trustworthy or not. Gauging another’s trustworthiness relies on successfully reading nonverbal signals - signals that have been selected through human evolution to serve precisely such a communicative function. These deeply ingrained signals - some part of our phylogenetic heritage and some part of our socially constructed communication system - form the unwritten “order" for cooperative encounters, enabling both individuals and societies to survive and thrive. Yet paradoxically, the same course of evolution has also remunerated, with greater prospects for survival, those who manipulate and falsely manufacture such signals; in short, those who cheat, dissemble and deceive. Put differently, the course of human development has produced a system of presumably reliable signals of veracity, authenticity, trust and trustworthiness, while simultaneously conferring advantages on sham portrayals of those same signals. The use of dishonest signals is not confined to humans; natural selection has also rewarded sophisticated forms of cheating among all manner of living organisms (Greenfield, 2006). Consequently, these nonverbal signals, many of which are universal and have similarities among other species, are among the most important for humans to produce and read and the most useful for computational methods to detect and track. In what follows, we foreground those aspects of social signaling related to veracity that have widespread use and recognition. These are the kinds of signals that Burgoon and Newton (1991) identified as corresponding to a social meaning model in that they are recurrent expressions that have consensually recognized meanings within a given community. In this chapter, we first provide the reader background on the nature of the aforementioned signals. Next, we discuss automated methods for human nonverbal communication computing, i.e., methods we used for identifying and tracking such signals. Then, we discuss computer vision technologies using sensors operating in different wavelengths of the infrared band and not only the visible band, which is conventionally used. We conclude with recommendations for promising future research directions where the latest technologies can be applied to this elemental aspect of social signaling.

UR - http://www.scopus.com/inward/record.url?scp=85048183492&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85048183492&partnerID=8YFLogxK

U2 - 10.1017/9781316676202.029

DO - 10.1017/9781316676202.029

M3 - Chapter

SN - 1107161266

SN - 9781107161269

SP - 404

EP - 428

BT - Social Signal Processing

PB - Cambridge University Press

ER -

Burgoon JK, Metaxas D, Bourlai T, Elkins A. Social signals of deception and dishonesty. In Social Signal Processing. Cambridge University Press. 2017. p. 404-428 https://doi.org/10.1017/9781316676202.029