Google Patent | Intelligent Command Batching in an Augmented and/or Virtual Reality Environment

Patent: Intelligent Command Batching in an Augmented and/or Virtual Reality Environment

Publication Number: 20180356956

Publication Date: 2018-12-13

Applicants: Google

Abstract

In an augmented reality and/or a virtual reality system, detected commands may be intelligently batched to preserve the relative order of the batched commands while maintaining a fluid virtual experience for the user. Commands detected in the virtual environment may be assigned to a batch command, of a plurality of batch commands, based on a temporal window in which the command(s) are detected, based on an operational type associated with the command(s), or based on a spatial position at which the command is detected in the virtual environment. The commands included in a batched set of commands may be executed in response to an un-do command and/or a re-do command and/or a re-play command.

Background

An augmented reality (AR) and/or virtual reality (VR) system may generate an immersive, three-dimensional (3D) virtual environment. A user may interact with virtual objects, elements, features and the like in this virtual environment using various electronic devices, such as, for example, a helmet or other head mounted device including a display, glasses or goggles that a user looks through when viewing a display device, one or more handheld electronic devices such as controllers, joysticks and the like, gloves fitted with sensors, keyboards, mouse, and other electronic devices.

Summary

In one aspect, a method may include detecting, in a three dimensional (3D) virtual environment generated by a computing device, a plurality of commands to be executed in the virtual environment; executing the plurality of commands; and assigning each command of the plurality of commands to a batch, of a plurality of batches, based on at least one of a moving temporal window associated with the detection of the command, a classification of an operation to be executed in connection with the command, or a spatial position in the virtual environment associated with the detection of the command. The method may also include executing a supplementary command associated with at least one of the plurality of batches of commands and executing the supplementary command.

In another aspect, a computer program product may be embodied on a non-transitory computer readable medium, the computer readable medium having stored thereon a sequence of instructions. When executed by a processor, the instructions may cause the processor to execute a method, the method including generating a three dimensional (3D) virtual environment; detecting a plurality of commands to be executed in the virtual environment; and assigning each command of the plurality of commands to a batch, of a plurality of batches, based on at least one of a moving temporal window associated with the detection of the command, a classification of an operation to be executed in connection with the command, or a spatial position in the virtual environment associated with the detection of the command. The method may also include detecting a supplementary command associated with at least one of the plurality of batches of commands; and executing the supplementary command.