Analyzing Children’s Verbal Engagement with a Conversational Agent

Our lab has collaborated with PBS KIDS to create interactive science video programs where the lead character, empowered by artificial intelligence, actively engages with children. In contrast to traditional animated shows like Dora the Explorer, where the character briefly pauses to ask a question and then offers a predetermined response regardless of the child’s actual reply (a style we term “pseudo-interactive”), our “conversational videos” supports interactive verbal exchanges, allowing the media character to provide contingent feedback based on the child’s responses.

Highlights

As part of this broad study, I examined children’s verbal engagement with the conversational agent while they viewed the interactive videos as opposed to the pseudo-interactive ones.

Using a multi-level model, we found that children in the interactive condition became more likely to respond to the conversational agent as the episode progresses, whereas children in the pseudo-interactive condition became less likely to respond.

The interactive character seemed to bolster children’s inclination to respond, while the pseudo-interactive seemed to deter engagement. This observation aligns with the broader understanding that children adjust their behavior towards conversational partners, whether human or virtual, based on their interaction experiences and perceptions.

Publications

Xu, Y., He, K., Levine, J., Ritchie, D., Bustamante, A., & Warschauer, M. (2023). Artificial Intelligence Enhances Children’s Science Learning from Television Shows. Manuscript in preparation.