China Focus: Data-labeling: the human power behind Artificial Intelligence

Source: Xinhua| 2019-01-17 20:42:21|Editor: ZX
Video PlayerClose

BEIJING, Jan. 17 (Xinhua) -- In a five-story building on the outskirts of Beijing, 22-year-old Zhang Yusen stares at a computer screen, carefully drawing boxes around cars in street photos.

As artificial voices replace human customer services in call centers and robots replace workers on production lines, Zhang, a vocational school graduate, has found a steady job: data-labeling, a new industry laying the groundwork for the development of AI technologies.

SUPERVISED LEARNING

As the "artificial" part of AI, data labeling receives much less media attention than the "intelligence" part of computer algorithms.

Facial recognition, self-driving, diagnosis of tumors by computer systems and the defeat of best human Go player by Alpha Go are ways AI technologies have amazed in recent years.

However, for researchers, the current AI technologies are still quite limited and at an early stage.

Professor Chen Xiaoping, director of Robotics Lab at the University of Science and Technology of China, said all AI technologies so far have come from "supervised" learning in which an AI system is trained with specific forms of data.

Take training a machine to recognize dogs for instance: the system must be fed vast numbers of pictures labeled by humans to tell the system which pictures have dogs and which don't.

Chen noted the human brain is excellent at processing unknown information with reasoning, but it is still impossible for AI. A kindergartener can make the guess of soccer ball from clues like "a black and white round object you can kick," but it's not a easy task for AI. An AI system might be able to tell all different kinds of dogs, but it cannot tell a stuffed animal is not real if such images are not sent to the system.

Yann LeCun, AI scientist at Facebook and widely considered one of the "godfathers" of machine-learning, said recently, "Our best AI systems have less common sense than a house cat."

Behind powerful AI algorithms are vast complicated dataset built and labeled by humans.

ImageNet is one of the world's largest visual databases designed to train AI systems to see. According to its inventors, it took nearly 50,000 people in 167 countries and regions to clean, sort and label nearly a billion images over more than three years.

QUALITY CHECKING

For top researchers like Chen Xiaoping, the next AI breakthrough is expected in self-supervised or unsupervised learning in which AI systems learn without human labeling. But no one knows when it will happen.

"I think in the next five to 10, maybe 15 years, AI systems will still rely on labeled data." said Du Lin, CEO and founder of data-labeling firm BasicFinder.

Du published his first paper about computer vision when he was in high school. After graduating from college, his first windfall came from selling a startup data-digging firm for 4 million U.S. dollars.

In 2014, Du and his partners noticed the rise of AI deep-learning and founded BasicFinder. The company is now a leading data-labeling company, with clients including Stanford University, the Chinese Academy of Sciences, China Mobile and Chinese AI startup SenseTime.

At BasicFinder, a typical work flow starts with taggers like Zhang Yusen. After training two to three months, they draw boxes around cars and pedestrians in street photos, tag ancient German letters, or transcribe snatches of speech.

The labeled images are submitted to quality inspectors who check 2,000 pictures a day. If one image is found inaccurately tagged in every 500 images in random checks, the company is not paid the original price. If the error rate exceeds 1 percent, clients can ask to change data-taggers.

Du said the company has been optimizing work flow to ensure greater accuracy as well as to protect intellectual property and privacy.

HUMAN IN LOOP

A model that requires human interaction is called "human in the loop" and humans remain in the loop much longer than many have expected, said Du.

Data-taggers now work on outsourcing platforms as far afield as Mexico, Kenya, India and Venezuela. Anyone can create an account to become a freelance data-tagger.

But Du strongly disagrees that data-labeling companies, depicted in some media reports as "the dirty little secret" of AI, resemble Foxconn's infamous iPhone factories.

He noted that due to the nature of AI deep-learning, it is the greater accuracy of labeled data that keeps a company alive and thriving, rather than low prices and cheap labor.

China's Caijing magazine reported in October last year that about half of data-labeling companies in China's Henan Province went bust in 2018 as orders dried up.

Du said that in the past two years, many found data-labeling a tough market. The first spurt of growth has ended and a lot of workshop-like companies have been knocked out.

A full-time data-tagger at BasicFinder can earn 6,000 to 7,000 yuan a month, along with accommodation and social benefits. In the first three quarters of 2018, the disposable income per capita in Beijing was 46,426 yuan, around 5,158 yuan a month, according to local government statistics.

Zhang Yusen and his girlfriend, who also works at BasicFinder as a quality inspector are so far enjoying their work.

TOP STORIES
EDITOR’S CHOICE
MOST VIEWED
EXPLORE XINHUANET
010020070750000000000000011100001377521541
快三赚钱平台推荐 乐发ll 乐发Ⅶ 凤凰彩票大厅 乐发lx 乐发彩票官方网站 彩神x 乐发彩票 乐发彩票 凤凰彩票大厅 大发彩票 乐发lv 大发彩票 快3彩票app下载 百姓彩票 乐发lv 乐发ll 乐发 乐发app 凤凰彩票 一分时时彩 乐发Vll 大发乐彩app 乐发彩票官方网站 凤凰彩票大厅 乐发lv 快3推荐平台 快3平台 网信快3 快彩彩票 盈彩网投资平台 彩神x 乐发Ⅲ 乐发app 凤凰彩票大厅 彩神app下载安卓版 快3平台 快3官方正版 快3app下载 极速快3 全民彩票 乐发彩票中心 凤凰快3 凤凰彩票 乐发2 凤凰彩票 网信彩票平台 快盈彩票 乐发彩票 大发彩票app 乐发VI 百姓彩票 凤凰快3 乐发ll 乐发ll 凤凰彩票app下载 盈彩网投资平台 快3app下载 乐发v官网 乐发3彩票APP 乐发III 乐发彩票官方网站 乐发lll welcome彩神 幸运快3 百姓彩票 500大发 乐发ll 乐发ll 凤凰彩票大厅 快3网站 快3平台推荐 凤凰彩票 一分时时彩 快盈彩票 彩神iv 乐发III 大发购彩 乐发lll 彩神购彩平台 幸运快3 快3平台 快3彩票官网平台 盈彩网投资平台 彩神x 凤凰快3 三分快3 乐发 大发welcome 快3平台 百姓彩票 分分快3 快3app下载 凤凰彩票app 乐发彩票ll 凤凰快3 乐发官网 凤凰彩票app 快盈彩票 网信快3 welcome凤凰彩票 大发彩票app 乐发iv首页 乐发app下载 乐发lll 乐发ll 大发彩票 大小单双平台 大发彩票 凤凰快3 乐发网投平台 乐发lv 乐发v官网 凤凰彩票app 快3网赚 快3软件 welcome彩神 幸运快3 大发官网 网信快3 乐发ll 大发500 大发彩票app 凤凰彩票购彩平台 大发彩票 快3平台官网 快3大小平台 快3彩票 分分快3 一分pk10 极速快3 乐发彩票app下载 500快3 大小单双平台 一分快3 网盟彩票 凤凰快3 welcome凤凰彩票 乐发lll 乐发 凤凰彩票大厅 网信彩票 大发官网 大发10分PK10 大发排列3 乐发∨Il 乐发lv 乐发IV 乐发ll下载app 乐发lv 乐发彩票 pk彩票 大发彩票 welcome凤凰彩票 快3官网 乐发 乐发iv首页 大发彩票 快3正规 乐发 大小单双平台 大发彩票 网盟彩票 凤凰彩票 乐发ll下载app 乐发Ⅶ 乐发app 彩神彩票官方网站 大发彩票 快3软件 快3官方 大发官网 网信快3 大发排列3 盈彩网投资平台 快3app 彩神ll平台 百姓彩票 快3大小平台 乐发app 一分pk10 极速快3 大发彩票 乐发彩票中心 凤凰彩票 凤凰彩票 网盟彩票 网信彩票 网信彩票 乐发 乐发登录入口 乐发lll下载 乐发VI 乐发 凤凰快3 乐发lv 乐发ll 大发排列3 快3彩票官网app 乐发彩票 乐发lv 凤凰彩票 快3助手 乐发3彩票APP 彩神xl 乐发彩票官方网站 彩神vl welcome彩神 乐发lx 乐发彩票2 乐发彩票中心 乐发彩票官方网站 乐发ll 快3首页 快3官网 大发彩票 快3彩票 乐发1 幸运快3官网 凤凰快3 彩神彩票官网首页 快彩彩票 快3购彩 快3app 三分快3 网信彩票 乐发app 凤凰快3 大发彩票 乐发网投资平台 彩神vl 凤凰彩票登录 全民彩票 乐发彩票app下载 乐发ll官网 乐发lv 乐发彩票ll 乐发彩票中心 乐发官网 乐发快3平台 凤凰快3 网信彩票 快3app 凤凰快3 乐发登录入口 乐发v平台 乐发1 乐发app下载 凤凰快3 乐发ll 快彩彩票 大小单双平台 乐发彩票 乐发welcome 凤凰快3 快3王者 快3平台app下载 彩神vl welcome彩神 全民彩票 大发官网 乐发app 乐发彩票app下载 乐发官网 彩神彩票 一分时时彩 快3官网 快3安全平台推荐 大发彩票 快3彩票 百姓彩票 一分pk10 彩神彩票 乐发iv 快彩彩票 百姓彩票网站网址 彩神x 快3app 大发彩票 乐发Vll 凤凰快3 乐发彩票官方网站 乐发lll 乐发lll 凤凰彩票大厅 全民彩票 快3平台 凤凰快3 乐发ll官网 乐发lll 乐发Ⅲ 乐发IV 凤凰彩票大厅 彩神xl 百姓彩票 500大发 乐发ll 乐发ll 凤凰彩票大厅 快3网站 快3平台推荐 凤凰彩票 一分时时彩 快盈彩票 彩神iv 乐发III 大发购彩 乐发lll 彩神购彩平台 幸运快3 快3平台 快3彩票官网平台 盈彩网投资平台 彩神x 凤凰快3 三分快3 乐发 大发welcome 快3平台 百姓彩票 分分快3 快3安全平台推荐 凤凰彩票 百姓彩票 一分pk10 乐发ll 大发彩票 凤凰彩票app下载 凤凰彩票 彩神x 网信平台官网 三分快3 乐发III 乐发lll下载 乐发lll 乐发 幸运快3 乐发lv 凤凰快3 乐发lv 大发彩票app 乐发lll 凤凰彩票 快3下载app 快3首页 快3平台 彩神xl 分分快3 彩神vl 乐发lll 彩神1 大发彩票 凤凰彩票官方网站 乐发lv 快3平台推荐 快3代理 快盈彩票 彩神iv welcome凤凰彩票 大发彩票 乐发app 网信快3 幸运快3 1分快3平台 网信快3 快3彩票官网平台 大发app 凤凰快3 三分快3 乐发lv 乐发app 大发彩票app 幸运5分彩快3 极速快3 凤凰彩票app 乐发lll安装 乐发ll 乐发lv 大发彩票app 乐发彩票 pk彩票 大发彩票 welcome凤凰彩票 快3官网 乐发 乐发iv首页 大发彩票 快3正规 乐发 大小单双平台 大发彩票 网盟彩票 凤凰彩票 乐发ll下载app 乐发Ⅶ 乐发app 彩神彩票官方网站 大发彩票 快3软件 快3官方 大发官网 网信快3 大发排列3 盈彩网投资平台 快3app 500彩票中快3 大发彩票 官方正规快3彩票平台 凤凰彩票 快3代理 乐发彩票 乐发 百姓彩票 网信彩票 彩神彩票 网信快3 凤凰彩票app下载 盈彩网投资平台 大发app 乐发iv游戏平台 乐发ll下载app 乐发Vll 乐发app 乐发彩票官方网站 凤凰彩票 乐发lll 极速快3 快3下载 乐发彩票中心 乐发lll安装 彩神彩票 快3赚钱平台推荐 乐发Ⅲ pk彩票 凤凰彩票大厅 百姓彩票 快3平台 乐发VI 乐发 凤凰快3 彩神彩票购彩平台 乐发lll 快3数据分析app 快3官网平台推荐 网盟彩票 凤凰彩票 网信彩票 快盈彩票 乐发3彩票APP 快3在线平台 welcome彩神 快3官方 快3app推荐 大发排列3 盈彩网投资平台 乐发彩票 凤凰快3 乐发彩票 乐发平台 百姓彩票 凤凰彩票官方 快3彩票 乐发app 大发彩票安卓下载 乐发lx 乐发彩票ll 乐发彩票中心 乐发官网 乐发快3平台 凤凰快3 网信彩票 快3app 凤凰快3 乐发登录入口 乐发v平台 乐发1 乐发app下载 凤凰快3 乐发ll 快彩彩票 大小单双平台 乐发彩票 乐发welcome 凤凰彩票大厅 乐发官网 凤凰快3 快3王者 快3平台app下载 彩神vl 大发官网 乐发app 乐发彩票app下载 乐发ll 凤凰快3 大小单双平台 快3官网平台推荐 快3彩票 网信彩票 快盈彩票 凤凰快3 welcome凤凰彩票 凤凰彩票 乐发IV welcome彩神 百姓彩票平台 大发官网 快3app推荐 乐发∨Il 乐发彩票 凤凰快3 凤凰彩票大厅 乐发lv 乐发lv 大发彩票app 快3彩票 彩神 一分pk10 大发彩票安卓下载 乐发lv入口 乐发app 乐发ll 乐发官网 大发彩票app 一分时时彩 pk彩票 凤凰快3 乐发II 乐发lll 快3网址 快3入口 快彩彩票 大小单双平台 彩神x 网盟彩票 乐发IV 乐发Vll 乐发lv 凤凰彩票app下载 彩神xl 快3平台app下载 快3大发 全民彩票 大发官网 凤凰快3 大发排列3 大发app 彩神welcome登录 一分时时彩 一分快3平台 彩神iv 快3安全平台推荐 凤凰彩票 百姓彩票 一分pk10 乐发ll 大发彩票 凤凰彩票app下载 凤凰彩票 彩神x 网信平台官网 三分快3 大发彩票 乐发ll登录 乐发III 乐发lll下载 乐发lll 乐发 幸运快3 乐发lv 大发彩票app 乐发lll 凤凰彩票 快3下载app 快3首页 快3平台