IllumiRoom

IllumiRoom proof-of-concept, on the screen Red Eclipse

IllumiRoom is a Microsoft Research project that augments a television screen with images projected onto the wall and surrounding objects. The current proof-of-concept uses a Kinect sensor and video projector. The Kinect sensor captures the geometry and colors of the area of the room that surrounds the television, and the projector displays video around the television that corresponds to a video source on the television, such as a video game or movie.

History

IllumiRoom was first introduced at the 2013 Consumer Electronics Show.[1] At the show, Microsoft, with Samsung, showed a video presentation of the system. At CHI 2013, Microsoft presented more details of the system, including a paper written with a researcher at the University of Illinois at Urbana-Champaign.[2][3]

System

The system prototype uses a wide field of view projector and a Kinect for Windows sensor. The Kinect captures the color and geometry of the room environment and the projector renders images onto the depth map acquired by the sensor.

Technology

The IllumiRoom concept is based on prior work and research using focus-plus-context screens and projection mapping. The focus-plus-context technology generally uses a high resolution screen surrounded by a lower resolution display. Microsoft's CHI 2013 research paper cites Philips' Ambilight as an example of a focus-plus-context display. In the case of IllumiRoom, the television represents the high resolution screen and the surrounding projection is the lower resolution display. The purpose of this technology is to provide the user with additional visual information in the visual periphery, both simulating and taking advantage of peripheral vision. While the center of a person's gaze is in high-resolution and is sensitive to color and detail, peripheral vision is less sensitive to color and detail, but highly sensitive to movement.

IllumiRoom combines the focus-plus-context concept with real-time projection mapping. This allows the system to be used in any room, not just one where a television is surrounded by flat, white wall.

The Kinect sensor is used to calibrate the system and projection. The projector displays a system of gray patterns and the Kinect camera reads the size of the pattern across the projection in order to map the 3D environment. Once calibrated, the Kinect sensor is no longer needed for the IllumiRoom system and can be used for gaming.[3] IllumiRoom was developed with the open-source first-person shooter Red Eclipse as prototype application.[4]

Modes

The system can currently display video game video in one of several modes. These modes require the system to have access to the game's rendering process:[3]

Without access to the game's rendering, several other projection modes are available:[3]

Commercial use

Although widely expected to be used in an Xbox application, the researchers have stated that the technology is, for now, only a research project and not ready for commercial use.[5]

RoomAlive

RoomAlive, a related Microsoft Research project, also uses a depth camera and video projector in a projector-camera, or "procam" setup. It is a scalable system for dynamic, real-time interactive projection mapping in which multiple such procams can be used together in a room to generate an immersive unified projection mapping that is automatically adapted to the room environment, and which users can interact with physically. Unlike IllumiRoom, which implements focus-plus-context visual presentation centered on a television screen, RoomAlive focuses on spatial augmented reality applications.[6]

In April 2015, Microsoft released the RoomAlive Toolkit, an open-source MIT licensed[7] software development kit for calibrating a network of video projectors and Kinect sensors, which can be used to develop systems like those of the RoomAlive and IllumiRoom projects.[8] The source code is available via github.com.

References

  1. ↑ Tom Warren (14 January 2013). "Microsoft just teased the next Xbox at CES". The Verge. Vox Media. Retrieved 29 April 2013.
  2. ↑ Tom Warren (29 April 2013). "Microsoft IllumiRoom is a coffee table projector designed for the next-generation Xbox". The Verge. Vox Media. Retrieved 29 April 2013.
  3. 1 2 3 4 Jones, Brett R; Benko, Hrvoje; Ofek, Eyal; Wilson, Andrew D (2013). "IllumiRoom: Peripheral Projected Illusions for Interactive Experiences" (PDF). Retrieved 29 April 2013.
  4. ↑ IllumiRoom_CHI2013 by Microsoft Research "The majority of the illusions were paired with an open-source first-person shooter (Red Eclipse). This created a rich, interactive experience, enabled by access to source code. The Snow illusion was paired with a racing game with a snow level (SuperTuxKart 3), triggered with controller input."
  5. ↑ Steve Dent (30 April 2013). "Microsoft says Illumiroom isn't yet ready for next Xbox, but will get public demo in July". Engadget. AOL. Retrieved 30 April 2013.
  6. ↑ Jones, Brett; Sodhi, Rajinder; Murdock, Michael; Mehra, Ravish; Benko, Hrvoje; Wilson, Andrew D.; Ofek, Eyal; MacIntyre, Blair; Raghuvanshi, Nikunj; Shapira, Lior (5 October 2014). "RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units". UIST '14: proceedings of the 27th annual ACM symposium on user interface software and technology. New York: Association for Computing Machinery: 637–644. doi:10.1145/2642918.2647383.
  7. ↑ License on github.com
  8. ↑ "RoomAlive Toolkit unveiled at Build 2015". Kinect for Windows Product Blog. Microsoft. 30 April 2015. Retrieved 27 May 2015.

External links

This article is issued from Wikipedia - version of the 6/9/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.