Researchers track facial expressions to improve teaching software
Research from North Carolina State University shows that software which tracks facial expressions can accurately assess the emotions of students engaged in interactive online learning and predict the effectiveness of online tutoring sessions. "This work is part of a larger effort to develop artificial intelligence software to teach students computer science," says Dr. Kristy Boyer, an assistant professor of computer science at NC State and co-author of a paper on the work. "The program, JavaTutor, will not only respond to what a student knows, but to each student's feelings of frustration or engagement. This is important because research shows that student emotion plays an important role in the learning process."
The researchers used the automated Computer Expression Recognition Toolbox (CERT) program to evaluate facial expressions of 65 college students engaged in one-on-one online tutoring sessions. The researchers found that CERT was able to identify facial movements associated with learning-centered emotions, such as frustration or concentration -- and that the automated program's findings were consistent with expert human assessments more than 85 percent of the time.
The researchers also had the students report how effective they felt the tutorial was, and tested the students before and after each tutoring session to measure how much they learned.
The researchers used observational data from CERT along with student self-assessments and test results to develop models that could predict how effective a tutorial session was, based on what the facial expressions of the students indicated about each student's feelings of frustration or engagement.
"This work feeds directly into the next stage of JavaTutor system development, which will enable the program to provide cognitive and emotion-based feedback to students," says Joseph Grafsgaard, a Ph.D. student at NC State and lead author of the paper.
The paper, "Automatically Recognizing Facial Expression: Predicting Engagement and Frustration," will be presented at the International Conference on Educational Data Mining, being held July 6-9 in Memphis, Tenn. The paper was co-authored by Joseph Wiggins, an undergraduate at NC State; Dr. Eric Wiebe, a professor of science, technology, engineering and math education at NC State; and Dr. James Lester, a professor of computer science at NC State. The research was supported by the National Science Foundation.
Source: North Carolina State University
- Researchers track facial expressions to improve teaching softwarefrom Science DailyThu, 27 Jun 2013, 21:00:29 EDT
- Software tracks facial expressions to gauge on-line learning successfrom UPIThu, 27 Jun 2013, 18:30:20 EDT
- Researchers track facial expressions to improve teaching softwarefrom PhysorgThu, 27 Jun 2013, 12:01:00 EDT
Latest Science NewsletterGet the latest and most popular science news articles of the week in your Inbox! It's free!
Check out our next project, Biology.Net
From other science news sites
Popular science news articles
- New Joint European Cardiovascular Prevention Guidelines launched today
- Mucus may play vital role in dolphin echolocation
- High performance golf club comes with annoying sound
- NASA scientist suggests possible link between primordial black holes and dark matter
- New tabletop instrument tests electron mobility for next-generation electronics
- Hot tubs and swimming pools are not as clean as you may think
- 'Canaries' of the ocean highlight threat to world's ecosystems
- First evidence of icy comets orbiting a sun-like star
- Natural regeneration of tropical forests helps global climate mitigation and forest restoration
- A tool to support public health decisions on Zika virus predicts most planned interventions to be cost-effective