George Dvorsky, contributing editor at Gizmodo and io9 notes, "Students taking an online course at Georgia Tech’s School of Interactive
Computing were duped into thinking one of their teaching assistants,
named Jill Watson, was an actual human. And how can you blame them—the
virtual TA managed to answer many of their questions with 97 percent
Now, being “certain” is not the same as being correct. But computer science professor Ashok Goel felt it was a sufficient level of confidence to allow the virtual TA, named Jill Watson, to answer student inquiries on her own. For nearly the entire month of April, Jill was responding directly to the class through an online student forum, but only when she was 97 percent sure her answers were correct.
The students weren’t told that they were interacting with a virtual TA until April 26. According to a Georgia Tech release, the student response was “uniformly positive.” One student said “her mind was blown” when the truth came out, while another jokingly asked if Jill could “come out and play.”
The course, titled Knowledge Based Artificial Intelligence (KBAI), is a core requirement of Georgia Tech’s online masters of science in computer science program. Around 300 students take the course each year, and they post roughly 10,000 messages in the online forums which is more than the course’s eight TAs can handle. To offset this workload, Goel and his graduate students built the virtual teaching assistant, which was built on IBM’s Watson platform (yes, the same Watson that defeated the world’s greatest Jeopardy players back in 2011).
To develop the system, Goel and his team collected roughly 40,000 questions that had been asked in the class forums since the course was launched back in 2014. They then fed Jill all these questions and answers.
“One of the secrets of online classes is that the number of questions increases if you have more students, but the number of different questions doesn’t really go up,” noted Goel. “Students tend to ask the same questions over and over again.”
This scenario is perfect for the Watson platform, a powerful natural language processor that specializes in answering questions with distinct, clear solutions.