Microsoft Patent | Mixed Reality World Integration Of Holographic Buttons In A Mixed Reality Device

Patent: Mixed Reality World Integration Of Holographic Buttons In A Mixed Reality Device

Publication Number: 20180374143

Publication Date: 2018-12-27

Applicants: Microsoft

Abstract

Disclosed is system and method for mixed reality world that incorporates a holographic button (e.g., a 3D object) that can be downloaded from the website of a provider of a good, data content, or a service (item). The holographic button enables a user in the mixed reality world to order the item by interacting with the holographic button. The user in the mixed reality world can place the holographic button relative to a relevant real-world object. Whenever the user interacts with the real-world object through their mixed reality world (i.e., virtual interaction with the real-world object), the holographic button can appear with that real-word object, allowing the user to order the item associated with the holographic button.

Background

A mixed reality world integrates virtual objects (holograms) with a user’s view of the real world. Mixed reality devices augment the real world with virtual objects that aim to look as if they are really placed within that world. A mixed reality device allows the user to view their real-world surrounding through a semi-transparent display in the case of a wearable device, or a live video feed in the case of a laptop device, a smartphone, or other handheld computer. Virtual objects can then be presented on the display, which appear superimposed on the user’s view of their real-world surrounding, thus merging virtual reality with physical reality.

A mixed reality devices can lock the position of a virtual object relative to real-world objects (referred to as “world locking” a virtual object). For example, a virtual flower pot can be placed onto a real-world table and appear as if it is on the surface of the real-world table. The virtual flower pot is spatially locked with respect to the surface of the real-world table, and may leave the user’s field of view as the user moves about in their real-world surrounding. If the virtual object is world locked to a moving real-world object, the virtual object may move with the moving real-world object.

Additionally, mixed reality devices can also show notifications and other forms of information in a way that is locked to the display of the mixed reality device, rather than to real-world objects. This viewing mode can be useful for invoking applications such as a web browser, an email client, and so on. In this viewing mode, the virtual object merely overlays the user’s field of view independently of real-world objects in their field of view.

Summary

A mixed reality device in accordance with the present disclosure can include a display, one or more computer processors, and a computer-readable storage medium comprising instructions for controlling the one or more computer processors. Processing performed by the one or more computer processor can include instantiating a holographic button (virtual 3-dimensional object) associated with an item of interest to a user of the mixed reality device. Item-related data associated with the item can be received from the website of a provider of the item. The item-related data can include holographic data to display the holographic button on a display of the mixed reality device. The holographic button can be world-locked to a fixed spatial location in a real-world surrounding relative to the mixed reality device.

The user of the mixed reality device can be provided with access to the holographic button, thus allowing the user to obtain the item by interacting with the holographic button. For example, the holographic button can be presented on the display to superimpose the holographic button onto a view of the user’s real-world surrounding. The mixed reality device can detect a user-made gesture directed to the holographic button, and in response generate and send an order request for the item to the provider.

The following detailed description and accompanying drawings provide further understanding of the nature and advantages of the present disclosure.