Tango (platform)
Original author(s) | |
---|---|
Developer(s) | |
Initial release | June 5, 2014 |
Development status | Active |
Platform | Android |
Available in | English |
Type | Mobile computer vision technology platform |
Website | Tango |
Tango (formerly named Project Tango in-testing) is a technology platform developed and authored by Google that uses computer vision to enable mobile devices, such as smartphones and tablets, to detect their position relative to the world around them without using GPS or other external signals. This allows application developers to create user experiences that include indoor navigation, 3D mapping, physical space measurement, environmental recognition, augmented reality, and windows into a virtual world.
The first product to emerge from ATAP's Skunkworks group,[1] Tango was developed by a team led by computer scientist Johnny Lee, a core contributor to Microsoft's Kinect. In an interview in June 2015, Lee said, "We're developing the hardware and software technologies to help everything and everyone understand precisely where they are, anywhere."[2]
Google has produced two devices to demonstrate the Tango technology: the discontinued Peanut phone and the Yellowstone 7-inch tablet. More than 3,000 of these devices had been sold as of June 2015,[3] chiefly to researchers and software developers interested in building applications for the platform. In the summer of 2015, Qualcomm and Intel both announced that they are developing Tango reference devices as models for device manufacturers who use their mobile chipsets.[4][5]
At CES, in January 2016, Google announced a partnership with Lenovo to release a consumer smartphone during the summer of 2016 to feature Tango technology marketed at consumers, noting a less than $500 price-point and a small form factor below 6.5 inches. At the same time, both companies also announced an application incubator to get applications developed to be on the device on launch.
At Lenovo Tech World 2016, Lenovo launched the world's first consumer phone based on Tango, as well as releasing it as "Tango".[6]
Overview
Tango is different from other emerging 3D-sensing computer vision products, in that it's designed to run on a standalone mobile phone or tablet and is chiefly concerned with determining the device's position and orientation within the environment.
The software works by integrating three types of functionality:
- Motion-tracking: using visual features of the environment, in combination with accelerometer and gyroscope data, to closely track the device's movements in space
- Area learning: storing environment data in a map that can be re-used later, shared with other Tango devices, and enhanced with metadata such as notes, instructions, or points of interest
- Depth perception: detecting distances, sizes, and surfaces in the environment
Together, these generate data about the device in "six degrees of freedom" (3 axes of orientation plus 3 axes of motion) and detailed three-dimensional information about the environment.
Applications on mobile devices use Tango's C and Java APIs to access this data in real time. In addition, an API is also provided for integrating Tango with the Unity game engine; this enables the rapid conversion or creation of games that allow the user to interact and navigate in the game space by moving and rotating a Tango device in real space. These APIs are documented on the Google developer website.[7]
Applications
Tango enables apps to track a device's position and orientation within a detailed 3D environment, and to recognize known environments. This makes possible applications such as in-store navigation, visual measurement and mapping utilities, presentation and design tools, and a variety of immersive games. At Augmented World Expo 2015,[8] Johnny Lee demonstrated a construction game that builds a virtual structure in real space, an AR showroom app that allows users to view a full-size virtual automobile and customize its features, a hybrid Nerf gun with mounted Tango screen for dodging and shooting AR monsters superimposed on reality, and a multiplayer VR app that lets multiple players converse in a virtual space where their avatar movements match their real-life movements.[9]
Tango apps are distributed through Play. Google has encouraged the development of more apps with hackathons, an app contest, and promotional discounts on the development tablet.[10]
Some of the Tango apps are MeasureIt (for measuring objects), Solar Simulator, Wayfair (for testing furniture arrangements in rooms), and Cydalion (navigation app for people with visual impairments), among many others.[11]
Devices
As a platform for software developers and a model for device manufacturers, Google has created two Tango devices to date.
The Yellowstone tablet
"Yellowstone" is a 7-inch tablet with full Tango functionality, released in June 2014, and sold as the Project Tango Tablet Development Kit.[12] It features a 2.3 GHz quad-core Nvidia Tegra K1 processor, 128GB flash memory, 1920x1200-pixel touchscreen, 4MP color camera, fisheye-lens (motion-tracking) camera, an IR projector with RGB-IR camera for integrated depth sensing, and 4G LTE connectivity.[13][14] The device is sold through the official Project Tango website[15] and the Google Play Store.
The Peanut phone
"Peanut" was the first production Tango device, released in the first quarter of 2014. It was a small Android phone with a Qualcomm MSM8974 quad-core processor and additional special hardware including a fisheye motion camera, "RGB-IR" camera for color image and infrared depth detection, and Movidius Vision processing units. A high-performance accelerometer and gyroscope were added after testing several competing models in the MARS lab at the University of Minnesota.
Several hundred Peanut devices were distributed to early-access partners including university researchers in computer vision and robotics, as well as application developers and technology startups. Google stopped supporting the Peanut device in September 2015, as by then the Tango software stack had evolved beyond the versions of Android that run on the device.
Testing by NASA
In May 2014, two Peanut phones were delivered to the International Space Station to be part of a NASA project to develop autonomous robots that navigate in a variety of environments, including outer space. The soccer-ball-sized, 18-sided polyhedral SPHERES robots were developed at the NASA Ames Research Center, adjacent to the Google campus in Mountain View, California. Andres Martinez, SPHERES manager at NASA, said "We are researching how effective [Tango's] vision-based navigation abilities are for performing localization and navigation of a mobile free flyer on ISS.[16]
First smartphone with Tango
Lenovo's Phab 2 Pro is the first smartphone with the Tango Technology, the device was announced at the beginning of the year 2016.
Collaborators and partners
In creating Project Tango, Google has collaborated with developers in nine countries including Bosch, Bsquare, CompalComm, ETH Zurich, Flyby Media, George Washington University, MMSolutions, Movidius, University of Minnesota MARS Lab,[17] JPL Computer Vision Group,[18] OLogic, OmniVision, Open Source Robotics Foundation, Paracosm, Sunny Optical Technology, PMD Technologies, Mantis Vision, Prizmiq, and SagivTech.
Partnerships have been announced[19][20] with companies that include apelab, Autodesk, Aisle411, Bosch, Defective Studios, Durovis (Dive), Infineon, JPL, Left Field Labs, Limbic, moBack, NVYVE, OmniVision, Otherworld Interactive, PMD Technologies, Sagivtech, SideKick, Speck Design, Stinkdigital, and Inuitive.
See also
References
- ↑ Announcement on ATAP Google+ site, 30 January 2015
- ↑ "Future Phones Will Understand, See the World". 3 June 2015. Retrieved 4 November 2015.
- ↑ "Slamdance: inside the weird virtual reality of Google's Project Tango". 29 May 2015.
- ↑ Qualcomm Powers Next Generation Project Tango Development Platform, 2015-05-29
- ↑ IDF 2015: Intel teams with Google to bring RealSense to Project Tango, 2015-08-18
- ↑ http://blog.smartprix.com/lenovo-phab-2-pro-becomes-first-google-tango-smartphone/
- ↑ https://developers.google.com/project-tango/ Google developer website
- ↑ http://augmentedworldexpo.com/ Augmented World Expo 2015
- ↑ AWE 2015, "Mobile 3D Tracking and Perception"
- ↑ Google says these are the best apps for Project Tango, 2 November 2015
- ↑ "Google's Project Tango : All you need to know! - i9finite". 2016-07-25. Retrieved 2016-08-25.
- ↑ Product announcement on ATAP Google+ page, 5 June 2014, retrieved 4 November 2015
- ↑ Specs on official site, retrieved 4 November 2015
- ↑ "Tango Tablet Development Kit User Guide | Tango | Google Developers". Google Developers. Retrieved 2016-09-11.
- ↑ https://www.google.com/atap/project-tango/ Project Tango website
- ↑ Google's Project Tango headed to International Space Station, 20 March 2014
- ↑ http://mars.cs.umn.edu/ University of Minnesota MARS Lab
- ↑ https://www-robotics.jpl.nasa.gov/groups/ComputerVision JPL Computer Vision Group
- ↑ AWE 2015, "Mobile 3D Tracking and Perception"
- ↑ List of partners on official site, retrieved 4 November 2015
External links
- Official website
- Project Tango developer site (API and documentation).
- Project Tango developer community.
- Project Tango Smartphone Development Platform page at Qualcomm.
- "Intel Expands Developer Opportunities As Computing Expands Across All Areas of Peoples' Lives". Intel Developer Forum. 20 August 2015.
- "Google and Intel bring RealSense to phones with Project Tango dev kit". Engadget. 18 August 2015.
- "Google I/O 2015 - Project Tango - Mobile 3D tracking and perception". Johnny Lee, Google I/O 2015. YouTube. 29 May 2015.
- "Project Tango Concepts". Johnny Lee, YouTube. 21 April 2015.
- "Project Tango Tablet Teardown". iFixit. 15 August 2014.