TY - JOUR
T1 - The effects of information utility and teachers’ knowledge on evaluations of under-informative pedagogy across development
AU - Bass, Ilona
AU - Bonawitz, Elizabeth
AU - Hawthorne-Madell, Daniel
AU - Vong, Wai Keen
AU - Goodman, Noah D.
AU - Gweon, Hyowon
N1 - Funding Information:
We thank Shirley Abbelard, Brianna Ali, Grace Bennett-Pierre, Haneen Daas, Lauren Leotti, and Gabrielle Vicente for their assistance with data collection and coding. This work was supported by: the Varieties of Understanding grant from the John Templeton Foundation to HG; a Jacobs Foundation Early Career Research Fellowship to HG; NSF SMA SL-CN (#1640816) to EB; a Jacobs Foundation Early Career Research Fellowship to EB; the Jerome Davis Research Fund at Oberlin College to IB; the Henry Rutgers Presidential Fellowship to IB; and an American Fellowship from AAUW to IB. Portions of this work were previously published in the Proceedings of the 37th and 39th Annual Conferences of the Cognitive Science Society. Supplemental materials, data, and stimuli can be found at https://osf.io/mpnr9/?view_only=10ae4642a647435c83e6ae18cfaeb905.
Funding Information:
We thank Shirley Abbelard, Brianna Ali, Grace Bennett-Pierre, Haneen Daas, Lauren Leotti, and Gabrielle Vicente for their assistance with data collection and coding. This work was supported by: the Varieties of Understanding grant from the John Templeton Foundation to HG; a Jacobs Foundation Early Career Research Fellowship to HG; NSF SMA SL-CN ( #1640816 ) to EB; a Jacobs Foundation Early Career Research Fellowship to EB; the Jerome Davis Research Fund at Oberlin College to IB; the Henry Rutgers Presidential Fellowship to IB; and an American Fellowship from AAUW to IB. Portions of this work were previously published in the Proceedings of the 37th and 39th Annual Conferences of the Cognitive Science Society. Supplemental materials, data, and stimuli can be found at https://osf.io/mpnr9/?view_only=10ae4642a647435c83e6ae18cfaeb905 .
Publisher Copyright:
© 2021 Elsevier B.V.
PY - 2022/5
Y1 - 2022/5
N2 - Teaching is a powerful way to transmit knowledge, but with this power comes a hazard: When teachers fail to select the best set of evidence for the learner, learners can be misled to draw inaccurate inferences. Evaluating others’ failures as teachers, however, is a nontrivial problem; people may fail to be informative for different reasons, and not all failures are equally blameworthy. How do learners evaluate the quality of teachers, and what factors influence such evaluations? Here, we present a Bayesian model of teacher evaluation that considers the utility of a teacher's pedagogical sampling given their prior knowledge. In Experiment 1 (N=1168), we test the model predictions against adults’ evaluations of a teacher who demonstrated all or a subset of the functions on a novel device. Consistent with the model predictions, participants’ ratings integrated information about the number of functions taught, their values, as well as how much the teacher knew. Using a modified paradigm for children, Experiments 2 (N=48) and 3 (N=40) found that preschool-aged children (2a, 3) and adults (2b) make nuanced judgments of teacher quality that are well predicted by the model. However, after an unsuccessful attempt to replicate the results with preschoolers (Experiment 4, N=24), in Experiment 5 (N=24) we further investigate the development of teacher evaluation in a sample of seven- and eight-year-olds. These older children successfully distinguished teachers based on the amount and value of what was demonstrated, and their ability to evaluate omissions relative to the teacher's knowledge state was related to their tendency to spontaneously reference the teacher's knowledge when explaining their evaluations. In sum, our work illustrates how the human ability to learn from others supports not just learning about the world but also learning about the teachers themselves. By reasoning about others’ informativeness, learners can evaluate others’ teaching and make better learning decisions.
AB - Teaching is a powerful way to transmit knowledge, but with this power comes a hazard: When teachers fail to select the best set of evidence for the learner, learners can be misled to draw inaccurate inferences. Evaluating others’ failures as teachers, however, is a nontrivial problem; people may fail to be informative for different reasons, and not all failures are equally blameworthy. How do learners evaluate the quality of teachers, and what factors influence such evaluations? Here, we present a Bayesian model of teacher evaluation that considers the utility of a teacher's pedagogical sampling given their prior knowledge. In Experiment 1 (N=1168), we test the model predictions against adults’ evaluations of a teacher who demonstrated all or a subset of the functions on a novel device. Consistent with the model predictions, participants’ ratings integrated information about the number of functions taught, their values, as well as how much the teacher knew. Using a modified paradigm for children, Experiments 2 (N=48) and 3 (N=40) found that preschool-aged children (2a, 3) and adults (2b) make nuanced judgments of teacher quality that are well predicted by the model. However, after an unsuccessful attempt to replicate the results with preschoolers (Experiment 4, N=24), in Experiment 5 (N=24) we further investigate the development of teacher evaluation in a sample of seven- and eight-year-olds. These older children successfully distinguished teachers based on the amount and value of what was demonstrated, and their ability to evaluate omissions relative to the teacher's knowledge state was related to their tendency to spontaneously reference the teacher's knowledge when explaining their evaluations. In sum, our work illustrates how the human ability to learn from others supports not just learning about the world but also learning about the teachers themselves. By reasoning about others’ informativeness, learners can evaluate others’ teaching and make better learning decisions.
KW - Bayesian models
KW - Causal learning
KW - Pedagogy
KW - Social evaluation
UR - http://www.scopus.com/inward/record.url?scp=85122629888&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85122629888&partnerID=8YFLogxK
U2 - 10.1016/j.cognition.2021.104999
DO - 10.1016/j.cognition.2021.104999
M3 - Article
C2 - 35032868
AN - SCOPUS:85122629888
SN - 0010-0277
VL - 222
JO - Cognition
JF - Cognition
M1 - 104999
ER -