The long read: With 850 million children worldwide shut out of schools, tech evangelists claim now is the time for AI education. But as the technologys power grows, so too do the dangers that come with it
For a child prodigy, learning didnt always come easily to Derek Haoyang Li. When he was three, his father a famous educator and author became so frustrated with his progress in Chinese that he vowed never to teach him again. He kicked me from here to here, Li told me, moving his arms wide.
Yet when Li began school, aged five, things began to click. Five years later, he was selected as one of only 10 students in his home province of Henan to learn to code. At 16, Li beat 15 million kids to first prize in the Chinese Mathematical Olympiad. Among the offers that came in from the countrys elite institutions, he decided on an experimental fast-track degree at Jiao Tong University in Shanghai. It would enable him to study maths, while also covering computer science, physics and psychology.
In his first year at university, Li was extremely shy. He came up with a personal algorithm for making friends in the canteen, weighing data on group size and conversation topic to optimise the chances of a positive encounter. The method helped him to make friends, so he developed others: how to master English, how to interpret dreams, how to find a girlfriend. While other students spent the long nights studying, Li started to think about how he could apply his algorithmic approach to business. When he graduated at the turn of the millennium, he decided that he would make his fortune in the field he knew best: education.
In person, Li, who is now 42, displays none of the awkwardness of his university days. A successful entrepreneur who helped create a billion-dollar tutoring company, Only Education, he is charismatic, and given to making bombastic statements. Education is one of the industries that Chinese people can do much better than western people, he told me when we met last year. The reason, he explained, is that Chinese people are more sophisticated, because they are raised in a society in which people rarely say what they mean.
Li is the founder of Squirrel AI, an education company that offers tutoring delivered in part by humans, but mostly by smart machines, which he says will transform education as we know it. All over the world, entrepreneurs are making similarly extravagant claims about the power of online learning and more and more money is flowing their way. In Silicon Valley, companies like Knewton and Alt School have attempted to personalise learning via tablet computers. In India, Byjus, a learning app valued at $6 billion, has secured backing from Facebook and the Chinese internet behemoth Tencent, and now sponsors the countrys cricket team. In Europe, the British company Century Tech has signed a deal to roll out an intelligent teaching and learning platform in 700 Belgian schools, and dozens more across the UK. Their promises are being put to the test by the coronavirus pandemic with 849 million children worldwide, as of March 2020, shut out of school, were in the midst of an unprecedented experiment in the effectiveness of online learning.
But its in China, where President Xi Jinping has called for the nation to lead the world in AI innovation by 2030, that the fastest progress is being made. In 2018 alone, Li told me, 60 new AI companies entered Chinas private education market. Squirrel AI is part of this new generation of education start-ups. The company has already enrolled 2 million student users, opened 2,600 learning centres in 700 cities across China, and raised $150m from investors. The companys chief AI officer is Tom Mitchell, the former dean of computer science at Carnegie Mellon University, and its payroll also includes a roster of top Chinese talent, including dozens of super-teachers an official designation given to the most expert teachers in the country. In January, during the worst of the outbreak, it partnered with the Shanghai education bureau to provide free products to students throughout the city.
Though the most ambitious features have yet to be built into Squirrel AIs system, the company already claims to have achieved impressive results. At its HQ in Shanghai, I saw footage of downcast human teachers who had been defeated by computers in televised contests to see who could teach a class of students more maths in a single week. Experiments on the effectiveness of different types of teaching videos with test audiences have revealed that students learn more proficiently from a video presented by a good-looking young presenter than from an older expert teacher.
When we met, Li rhapsodised about a future in which technology will enable children to learn 10 or even 100 times more than they do today. Wild claims like these, typical of the hyperactive education technology sector, tend to prompt two different reactions. The first is: bullshit teaching and learning is too complex, too human a craft to be taken over by robots. The second reaction is the one I had when I first met Li in London a year ago: oh no, the robot teachers are coming for education as we know it. There is some truth to both reactions, but the real story of AI education, it turns out, is a whole lot more complicated.
At a Squirrel AI learning centre high in an office building in Hangzhou, a city 70 miles west of Shanghai, a cursor jerked tentatively over the words Modern technology has opened our eyes to many things. Slouched at a hexagonal table in one of the centres dozen or so small classrooms, Huang Zerong, 14, was halfway through a 90-minute English tutoring session. As he worked through activities on his MacBook, a young woman with the kindly manner of an older sister sat next to him, observing his progress. Below, the trees of Xixi National Wetland Park barely stirred in the afternoon heat.
A question popped up on Huangs screen, on which a virtual dashboard showed his current English level, unit score and learning focus along with the sleek squirrel icon of Squirrel AI.
India is famous for ________ industry.
Huang read through the three possible answers, choosing to ignore treasure and typical and type t-e-c-h-n-o-l-o-g-y into the box.
T____ is changing fast, came the next prompt.
Huang looked towards the young woman, then he punched out e-c-h-n-o-l-o-g-y from memory. She clapped her hands together. Good! she said, as another prompt flashed up.
Huang had begun his English course, which would last for one term, a few months earlier with a diagnostic test. He had logged into the Squirrel AI platform on his laptop and answered a series of questions designed to evaluate his mastery of more than 10,000 knowledge points (such as the distinction between belong to and belong in). Based on his answers, Squirrel AIs software had generated a precise learning map for him, which would determine which texts he would read, which videos he would see, which tests he would take.
As he worked his way through the course with the occasional support of the human tutor by his side, or one of the hundreds accessible via video link from Squirrel AIs headquarters in Shanghai its contents were automatically updated, as the system perceived that Huang had mastered new knowledge.
Huang said he was less distracted at the learning centre than he was in school, and felt at home with the technology. Its fun, he told me after class, eyes fixed on his lap. Its much easier to concentrate on the system because its a device. His scores in English also seemed to be improving, which is why his mother had just paid the centre a further 91,000 RMB (about 11,000) for another year of sessions: two semesters and two holiday courses in each of four subjects, adding up to around 400 hours in total.
Anyone can learn, Li explained to me a few days later over dinner in Beijing. You just needed the right environment and the right method, he said.
The idea for Squirrel AI had come to him five years earlier. A decade at his tutoring company, Only Education, had left him frustrated. He had found that if you really wanted to improve a students progress, by far the best way was to find them a good teacher. But good teachers were rare, and turnover was high, with the best much in demand. Having to find and train 8,000 new teachers each year was limiting the amount students learned and the growth of his business.
The answer, Li decided, was adaptive learning, where an intelligent computer-based system adjusts itself automatically to the best method for an individual learner. The idea of adaptive learning was not new, but Li was confident that developments in AI research meant that huge advances were now within reach. Rather than seeking to recreate the general intelligence of a human mind, researchers were getting impressive results by putting AI to work on specialised tasks. AI doctors are now equal to or better than humans at analysing X-rays for certain pathologies, while AI lawyers are carrying out legal research that would once have been done by clerks.
Following such breakthroughs, Li resolved to augment the efforts of his human teachers with a tireless, perfectly replicable virtual teacher. Imagine a tutor who knows everything, he told me, and who knows everything about you.
In Hangzhou, Huang was struggling with the word hurry. On his screen, a video appeared of a neatly groomed young teacher presenting a three-minute masterclass about how to use the word hurry and related phrases (in a hurry etc). Huang watched along.
Moments like these, where a short teaching input results in a small learning output, are known as nuggets. Lis dream, which is the dream of adaptive education in general, is that AI will one day provide the perfect learning experience by ensuring that each of us get just the right chunk of content, delivered in the right way, at the right moment for our individual needs.
One way in which Squirrel AI improves its results is by constantly hoovering up data about its users. During Huangs lesson, the system continuously tracked and recorded every one of his key strokes, cursor movements, right or wrong answers, texts read and videos watched. This data was time-stamped, to show where Huang had skipped over or lingered on a particular task. Each nugget (the video to watch or text to read) was then recommended to him based on an analysis of his data, accrued over hundreds of hours of work on Squirrels platform, and the data of 2 million other students. Computer tutors can collect more teaching experience than a human would ever be able to collect, even in a hundred years of teaching, Tom Mitchell, Squirrel AIs chief AI officer, told me over the phone a few weeks later.
The speed and accuracy of Squirrel AIs platform will depend, above all, on the number of student users it manages to sign up. More students equals more data. As each student works their way through a set of knowledge points, they leave a rich trail of information behind them. This data is then used to train the algorithms of the thinking part of the Squirrel AI system.
This is one reason why Squirrel AI has integrated its online business with bricks-and-mortar learning centres. Most children in China do not have access to laptops and high-speed internet. The learning centres mean the company can reach kids they otherwise would not be able to. One of the reasons Mitchell says he is glad to be working with Squirrel AI is the sheer volume of data that the company is gathering. Were going to have millions of natural examples, he told me with excitement.
The dream of a perfect education delivered by machine is not new. For at least a century, generations of visionaries have predicted that the latest inventions will transform learning. Motion pictures, wrote the American inventor Thomas Edison in 1922, are destined to revolutionise our schools. The immersive power of movies would supposedly turbo-charge the learning process. Others made similar predictions for radio, television, computers and the internet. But despite small successes the Open University, TV universities in China in the 1980s, or Khan Academy today, which reaches millions of students with its YouTube lessons teachers have continued to teach, and learners to learn, in much the same way as before.
There are two reasons why todays techno-evangelists are confident that AI can succeed where other technologies failed. First, they view AI not as a simple innovation but as a general purpose technology that is, an epochal invention, like the printing press, which will fundamentally change the way we learn. Second, they believe its powers will shed new light on the working of the human brain how repetitive practice grows expertise, for instance, or how interleaving (leaving gaps between learning different bits of material) can help us achieve mastery. As a result, we will be able to design adaptive algorithms to optimise the learning process.
UCL Institute of Education professor and machine learning expert Rose Luckin believes that one day we might see an AI-enabled Fitbit for the mind that would allow us to perceive in real-time what an individual knows, and how fast they are learning. The device would use sensors to gather data that forms a precise and ever-evolving map of a persons abilities, which could be cross-referenced with insights into their motivational and nutritional state, say. This information would then be relayed to our minds, in real time, via a computer-brain interface. Facebook is already carrying out research in this field. Other firms are trialling eye tracking and helmets that monitor kids brainwaves.
The supposed AI education revolution is not here yet, and it is likely that the majority of projects will collapse under the weight of their own hype. IBMs adaptive tutor Knewton was pulled from US schools under pressure from parents concerned about their kids privacy, while Silicon Valleys Alt School, launched to much fanfare in 2015 by a former Google executive, has burned through $174m of funding without landing on a workable business model. But global school closures owing to coronavirus may yet relax public attitudes to online learning many online education companies are offering their products for free to all children out of school.
Daisy Christodoulou, a London-based education expert, suggests that too much time is spent speculating on what AI might one day do, rather than focusing on what it already can. Its estimated that there are 900 million young people around the world today who arent currently on track to learn what they need to thrive. To help those kids, AI education doesnt have to be perfect it just needs to slightly improve on what they currently have.
In their book The Future of the Professions, Richard and Daniel Susskind argue that we tend to conceive of occupations as embodied in a person a butcher or baker, doctor or teacher. As a result, we think of them as too human to be taken over by machines. But to an algorithm, or someone designing one, a profession appears as something else: a long list of individual tasks, many of which may be mechanised. In education, that might be marking or motivating, lecturing or lesson planning. The Susskinds believe that where a machine can do any one of these tasks better and more cheaply than the average human, automation of that bit of the job is inevitable.
The point, in short, is that AI doesnt have to match the general intelligence of humans to be useful or indeed powerful. This is both the promise of AI, and the danger it poses. Peoples behaviour is already being manipulated, Luckin cautioned. Devices that might one day enhance our minds are already proving useful in shaping them.
In May 2018, a group of students at Hangzhous Middle School No 11 returned to their classroom to find three cameras newly installed above the blackboard; they would now be under full-time surveillance in their lessons. Previously when I had classes that I didnt like very much, I would be lazy and maybe take naps, a student told the local news, but I dont dare be distracted after the cameras were installed. The head teacher explained that the system could read seven states of emotion on students faces: neutral, disgust, surprise, anger, fear, happiness and sadness. If the kids slacked, the teacher was alerted. Its like a pair of mystery eyes are constantly watching me, the student told reporters.
The previous year, Chinas state council had launched a plan for the role AI could play in the future of the country. Underpinning it were a set of beliefs: that AI can harmonise Chinese society; that for it to do so, the government should store data on every citizen; that companies, not the state, were best positioned to innovate; that no company should refuse access to the government to its data. In education, the paper called for new adaptive online learning systems powered by big data, and all-encompassing ubiquitous intelligent environments or smart schools.
At AIAED, a conference in Beijing hosted by Squirrel AI, which I attended in May 2019, classroom surveillance was one of the most discussed topics but the speakers tended to be more concerned about the technical question of how to optimise the effectiveness of facial and bodily monitoring technologies in the classroom, rather than the darker implications of collecting unprecedented amounts of data about children. These ethical questions are becoming increasingly important, with schools from India to the US currently trialling facial monitoring. In the UK, AI is being used today for things like monitoring student wellbeing, automating assessment and even in inspecting schools. Ben Williamson of the Centre for Research in Digital Education explains that this risks encoding biases or errors into the system and raises obvious privacy issues. Now the school and university might be said to be studying their students too, he told me.
While cameras in the classroom might outrage many parents in the UK or US, Lenora Chu, author of an influential book about the Chinese education system, argues that in China anything that improves a childs learning tends to be viewed positively by parents. Squirrel AI even offers them the chance to watch footage of their childs tutoring sessions. Theres not that idea here that technology is bad, said Chu, who moved from the US to Shanghai 10 years ago.
Rose Luckin suggested to me that a platform like Squirrel AIs could one day mean an end to Chinas notoriously punishing gaokao college entrance exam, which takes place for two days every June and largely determines a students education and employment prospects. If technology tracked a student throughout their school days, logging every keystroke, knowledge point and facial twitch, then the perfect record of their abilities on file could make such testing obsolete. Yet a system like this could also furnish the Chinese state or a US tech company with an eternal ledger of every step in a childs development. It is not hard to imagine the grim uses to which this information could be put for instance, if your behaviour in school was used to judge, or predict, your trustworthiness as an adult.
On the one hand, said Chu, the CCP wants to use AI to better prepare young people for the future economy, and to close the achievement gap between rural and urban schools. To this end, companies like Squirrel AI receive government support, such as access to prime office space in top business districts. At the same time, the CCP, as the state council put it, sees AI as opportunity of the millennium for social construction. That is, social control. The ability of AI to grasp group cognition and psychological changes in a timely manner through the surveillance of peoples movements, spending and other behaviours means it can play an irreplaceable role in effectively maintaining social stability.
The surveillance state is already penetrating deep into peoples lives. In 2019, there was a significant spike in China in the registration of patents for facial recognition and surveillance technology. All new mobile phones in China must now be registered via a facial scan. At the hotels I stayed in, Chinese citizens handed over their ID cards and checked in using face scanners. On the high-speed train to Beijing, the announcer repeatedly warned travellers to abide by the rules in order to maintain their personal credit. The notorious social credit system, which has been under trial in a handful of Chinese cities ahead of an expected nationwide roll out this year, awards or detracts points from an individuals trustworthiness score, which affects their ability to travel and borrow money, among other things.
The result, explained Chu, is that all these interventions exert a subtle control over what people think and say. You sense how the wind is blowing, she told me. For the 12 million Muslim Uighurs in Xinjiang, however, that control is anything but subtle. Police checkpoints, complete with facial scanners, are ubiquitous. All mobile phones must have Jingwang (clean net) app installed, allowing the government to monitor your movements and browsing. Iris and fingerprint scans are required to access health services. As many as 1.5 million Uighurs, including children, have been interned at some point in a re-education camp in the interests of harmony.
As we shape the use of AI in education, its likely that AI will shape us too. Jiang Xueqin, an education researcher from Chengdu, is sceptical that it will be as revolutionary as proponents claim. Parents are paying for a drug, he told me over the phone. He thought tutoring companies such as New Oriental, TAL and Squirrel AI were simply preying on parents anxieties about their kids performance in exams, and only succeeding because test preparation was the easiest element of education to automate a closed system with limited variables that allowed for optimisation. Jiang wasnt impressed with the progress made, or the way that it engaged every child in a desperate race to conform to the measures of success imposed by the system.
One student I met at the learning centre in Hangzhou, Zhang Hen, seemed to have a deep desire to learn about the world she told me how she loved Qu Yuan, a Tang dynasty romantic poet, and how she was a fan of Harry Potter but that wasnt the reason she was here. Her goal was much simpler: she had come to the centre to boost her test scores. That may seem disappointing to idealists who want education to offer so much more, but Zhang was realistic about the demands of the Chinese education system. She had tough exams that she needed to pass. A scripted system that helped her efficiently master the content of the high school entrance exam was exactly what she wanted.
On stage at AIAED, Tom Mitchell had presented a more ambitious vision for adaptive learning that went far beyond helping students cram for mindless tests. Much of what he was most excited by was possible only in theory, but his enthusiasm was palpable. As appealing as his optimism was, though, I felt unconvinced. It was clear that adaptive technologies might improve certain types of learning, but it was equally obvious that they might narrow the aims of education and provide new tools to restrict our freedom.
Li insists that one day his system will help all young people to flourish creatively. Though he allows that for now an expert human teacher still holds an edge over a robot, he is confident that AI will soon be good enough to evaluate and reply to students oral responses. In less than five years, Li imagines training Squirrel AIs platform with a list of every conceivable question and every possible response, weighting an algorithm to favour those labelled creative. That thing is very easy to do, he said, like tagging cats.
For Li, learning has always been like that like tagging cats. But theres a growing consensus that our brains dont work like computers. Whereas a machine must crunch through millions of images to be able to identify a cat as the collection of features that are present only in those images labelled cat (two triangular ears, four legs, two eyes, fur, etc), a human child can grasp the concept of cat from just a few real life examples, thanks to our innate ability to understand things symbolically. Where machines cant compute meaning, our minds thrive on it. The adaptive advantage of our brains is that they learn continually through all of our senses by interacting with the environment, our culture and, above all, other people.
Li told me that even if AI fulfilled all of its promise, human teachers would still play a crucial role helping kids learn social skills. At Squirrel AIs HQ, which occupies three floors of a gleaming tower next door to Microsoft and Mobike in Shanghai, I met some of the companys young teachers. Each sat at a work console in a vast office space, headphones on, eyes focused on a laptop screen, their desks decorated with plastic pot plants and waving cats. As they monitored the dashboards of up to six students simultaneously, the face of a young learner would appear on the screen, asking for help, either via a chat box or through a video link. The teachers reminded me of workers in the gig economy, the Uber drivers of education. When I logged on to try out a Squirrel English lesson for myself, the experience was good, but my tutor seemed to be teaching to a script.
Squirrel AIs head of communications, Joleen Liang, showed me photos from a recent trip she had taken to the remote mountains of Henan, to deliver laptops to disadvantaged students. Without access to the adaptive technology, their education would be a little worse. It was a reminder that Squirrel AIs platform, like those of its competitors worldwide, doesnt have to be better than the best human teachers to improve peoples lives, it just needs to be good enough, at the right price, to supplement what weve got. The problem is that it is hard to see technology companies stopping there. For better and worse, their ambitions are bigger. We could make a lot of geniuses, Li told me.
Follow the Long Read on Twitter at @gdnlongread, and sign up to the long read weekly email here.
Read more: https://www.theguardian.com/technology/2020/mar/19/can-computers-ever-replace-the-classroom
Recent Comments