Smartphone augmented reality platform based on deep learning and computer vision released

Aug. 23, 2016
Baidu, China’s leading search engine, has announced the release of DuSee, a new augmented reality platform developed for smartphones that is based on computer vision and deep learning. 

Baidu, China’s leading search engine, has announced the release of DuSee, a new augmented reality platform developed forsmartphones that is based on computer vision and deep learning.

DuSee will be integrated into Baidu’s flagship platform apps, including the Mobile Baidu search app, and is a collaboration between Baidu Research'sInstitute of Deep Learning (IDL) and Baidu's search products, sales and marketing teams. The release, according to a press release, is the culmination of a 3D vision research project that began nearly two years ago.

Designed to be used in such applications as interactive advertising and marketing, DuSee has already been deployed in a Mercedes Benz E-Class Long Wheelbase search engine marketing campaign, as well as Ultra DOUX, a new hair care brand of L'Oreal China.

"DuSee is a natural extension of Baidu's AI expertise,” said Andrew Ng, Chief Scientist of Baidu. “The platform uses sophisticated computer vision and deep learning to understand and then augment a scene," he said. "The path to better AR is through better AI."

Instead of using goggles or other hardware that may be used in other augmented reality applications, Baidu leverages existing smartphone hardware.

IDL Director Yuanqing Lin stated: "Many smartphone AR apps today work by 'pasting' a cartoon on top of the camera image, regardless of that image's contents. The next generation of AR apps will use AI to understand the 3D environment, and create virtual objects that have rich interactions with the user and the real world. We are excited about future directions such as integrating AR with speech recognition and natural language processing."

View a press release onDuSee.

Share your vision-related news by contactingJames Carroll, Senior Web Editor, Vision Systems Design

To receive news like this in your inbox,
click here.

Join ourLinkedIn group | Like us on Facebook | Follow us on Twitter

Learn more: search the Vision Systems Design Buyer's Guide for companies, new products, press releases, and videos

About the Author

James Carroll

Former VSD Editor James Carroll joined the team 2013.  Carroll covered machine vision and imaging from numerous angles, including application stories, industry news, market updates, and new products. In addition to writing and editing articles, Carroll managed the Innovators Awards program and webcasts.

Voice Your Opinion

To join the conversation, and become an exclusive member of Vision Systems Design, create an account today!