Animated conversation: Rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents

Justine Cassell; Catherine Pelachaud; Norman Badler; Mark Steedman; Brett Achorn; Tripp Becket; Brett Douville; Scott Prevost; Matthew Stone

doi:10.1145/192161.192272

Animated conversation: Rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents

Justine Cassell, Catherine Pelachaud, Norman Badler, Mark Steedman, Brett Achorn, Tripp Becket, Brett Douville, Scott Prevost, Matthew Stone

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

395 Scopus citations

Abstract

We describe an implemented system which automatically generates and animates conversations between multiple human-like agents with appropriate and synchronized speech, intonation, facial expressions, and hand gestures. Conversations are created by a dialogue planner that produces the text as well as the intonation of the utterances. The speaker/listener relationship, the text, and the intonation in turn drive facial expressions, lip motions, eye gaze, head motion, and arm gesture generators. Coordinated arm, wrist, and hand motions are invoked to create semantically meaningful gestures. Throughout, we will use examples from an actual synthesized, fully animated conversation.

Original language	English (US)
Title of host publication	Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994
Publisher	Association for Computing Machinery, Inc
Pages	413-420
Number of pages	8
ISBN (Electronic)	0897916670, 9780897916677
DOIs	https://doi.org/10.1145/192161.192272
State	Published - Jul 24 1994
Externally published	Yes
Event	21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994 - Orlando, United States Duration: Jul 24 1994 → Jul 29 1994

Publication series

Name	Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994

Other

Other	21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994
Country/Territory	United States
City	Orlando
Period	7/24/94 → 7/29/94

All Science Journal Classification (ASJC) codes

Computer Graphics and Computer-Aided Design
Human-Computer Interaction

Access to Document

10.1145/192161.192272

Cite this

Cassell, J., Pelachaud, C., Badler, N., Steedman, M., Achorn, B., Becket, T., Douville, B., Prevost, S., & Stone, M. (1994). Animated conversation: Rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents. In Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994 (pp. 413-420). (Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994). Association for Computing Machinery, Inc. https://doi.org/10.1145/192161.192272

Cassell, Justine ; Pelachaud, Catherine ; Badler, Norman et al. / Animated conversation : Rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents. Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994. Association for Computing Machinery, Inc, 1994. pp. 413-420 (Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994).

@inproceedings{435fa46f147d4912bc4a139e82f5c220,

title = "Animated conversation: Rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents",

abstract = "We describe an implemented system which automatically generates and animates conversations between multiple human-like agents with appropriate and synchronized speech, intonation, facial expressions, and hand gestures. Conversations are created by a dialogue planner that produces the text as well as the intonation of the utterances. The speaker/listener relationship, the text, and the intonation in turn drive facial expressions, lip motions, eye gaze, head motion, and arm gesture generators. Coordinated arm, wrist, and hand motions are invoked to create semantically meaningful gestures. Throughout, we will use examples from an actual synthesized, fully animated conversation.",

author = "Justine Cassell and Catherine Pelachaud and Norman Badler and Mark Steedman and Brett Achorn and Tripp Becket and Brett Douville and Scott Prevost and Matthew Stone",

note = "Funding Information: This research is partially supported by NSF Grants IRI90-18513, IRI91-17110, CISE Grant CDA88-22719, NSF graduate fellowships, NSF VPW GER-9350179; ARO Grant DAAL03-89-C-0031 including participation by the U.S. Army Research Laboratory (Aberdeen); U.S. Air Force DEPTH contract through Hughes Missile Systems F33615-91-C-000; DMSO through the University of Iowa; National Defense Science and Engineering Graduate Fellowship in Computer Science DAAL03-92-G-0342; and NSF Instrumentation and Laboratory Improvement Program Grant USE-9152503. Publisher Copyright: {\textcopyright} ACM 1994.; 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994 ; Conference date: 24-07-1994 Through 29-07-1994",

year = "1994",

month = jul,

day = "24",

doi = "10.1145/192161.192272",

language = "English (US)",

series = "Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994",

publisher = "Association for Computing Machinery, Inc",

pages = "413--420",

booktitle = "Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994",

}

Cassell, J, Pelachaud, C, Badler, N, Steedman, M, Achorn, B, Becket, T, Douville, B, Prevost, S & Stone, M 1994, Animated conversation: Rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents. in Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994. Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994, Association for Computing Machinery, Inc, pp. 413-420, 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994, Orlando, United States, 7/24/94. https://doi.org/10.1145/192161.192272

Animated conversation : Rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents. / Cassell, Justine; Pelachaud, Catherine; Badler, Norman et al.

Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994. Association for Computing Machinery, Inc, 1994. p. 413-420 (Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Animated conversation

T2 - 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994

AU - Cassell, Justine

AU - Pelachaud, Catherine

AU - Badler, Norman

AU - Steedman, Mark

AU - Achorn, Brett

AU - Becket, Tripp

AU - Douville, Brett

AU - Prevost, Scott

AU - Stone, Matthew

N1 - Funding Information: This research is partially supported by NSF Grants IRI90-18513, IRI91-17110, CISE Grant CDA88-22719, NSF graduate fellowships, NSF VPW GER-9350179; ARO Grant DAAL03-89-C-0031 including participation by the U.S. Army Research Laboratory (Aberdeen); U.S. Air Force DEPTH contract through Hughes Missile Systems F33615-91-C-000; DMSO through the University of Iowa; National Defense Science and Engineering Graduate Fellowship in Computer Science DAAL03-92-G-0342; and NSF Instrumentation and Laboratory Improvement Program Grant USE-9152503. Publisher Copyright: © ACM 1994.

PY - 1994/7/24

Y1 - 1994/7/24

N2 - We describe an implemented system which automatically generates and animates conversations between multiple human-like agents with appropriate and synchronized speech, intonation, facial expressions, and hand gestures. Conversations are created by a dialogue planner that produces the text as well as the intonation of the utterances. The speaker/listener relationship, the text, and the intonation in turn drive facial expressions, lip motions, eye gaze, head motion, and arm gesture generators. Coordinated arm, wrist, and hand motions are invoked to create semantically meaningful gestures. Throughout, we will use examples from an actual synthesized, fully animated conversation.

AB - We describe an implemented system which automatically generates and animates conversations between multiple human-like agents with appropriate and synchronized speech, intonation, facial expressions, and hand gestures. Conversations are created by a dialogue planner that produces the text as well as the intonation of the utterances. The speaker/listener relationship, the text, and the intonation in turn drive facial expressions, lip motions, eye gaze, head motion, and arm gesture generators. Coordinated arm, wrist, and hand motions are invoked to create semantically meaningful gestures. Throughout, we will use examples from an actual synthesized, fully animated conversation.

UR - http://www.scopus.com/inward/record.url?scp=85029641276&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85029641276&partnerID=8YFLogxK

U2 - 10.1145/192161.192272

DO - 10.1145/192161.192272

M3 - Conference contribution

AN - SCOPUS:85029641276

T3 - Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994

SP - 413

EP - 420

BT - Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994

PB - Association for Computing Machinery, Inc

Y2 - 24 July 1994 through 29 July 1994

ER -

Cassell J, Pelachaud C, Badler N, Steedman M, Achorn B, Becket T et al. Animated conversation: Rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents. In Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994. Association for Computing Machinery, Inc. 1994. p. 413-420. (Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1994). doi: 10.1145/192161.192272

Animated conversation: Rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents

Abstract

Publication series

Other

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Cite this