Intel Patent | Methods And Apparatus To Map A Virtual Environment To A Physical Environment

Patent: Methods And Apparatus To Map A Virtual Environment To A Physical Environment

Publication Number: 20200312031

Publication Date: 20201001

Applicants: Intel

Abstract

Methods, apparatus, systems and articles of manufacture are disclosed to map a virtual environment to a physical environment using a weighted linear mapping technique. Example methods disclosed herein include accessing dimensional data corresponding to the virtual environment. Disclosed example methods further include determining areas of relative importance in the virtual environment. Disclosed example methods also include accessing dimensional data corresponding to the physical environment and generating a mapped environment based on the dimensional data corresponding to the virtual environment, the dimensional data corresponding to the physical environment, and the areas of relative importance.

FIELD OF THE DISCLOSURE

[0001] This disclosure relates generally to virtual reality simulation, and, more particularly, to mapping a virtual environment to a physical environment.

BACKGROUND

[0002] In recent years, virtual reality has become increasingly popular, especially in the entertainment industry. Virtual reality enables the depiction of a virtual environment that has interactive elements in the physical environment. Virtual reality implementations often use a combination of visual and tactile stimuli, implemented via devices such as headsets, controllers and various feedback devices. For a virtual reality device to depict an interactive virtual environment in a user’s physical space, a virtual reality device is configured so a user’s movement in the physical environment results in a corresponding movement in the virtual environment.

BRIEF DESCRIPTION OF THE DRAWINGS

[0003] FIGS. 1A, 1B, and 1C are illustrations of an example environment of use in which a user interacts with a virtual environment and a corresponding physical environment.

[0004] FIG. 2 is a diagram of a virtual environment, a physical environment, and the virtual environment mapped to the physical environment using a direct linear mapping.

[0005] FIG. 3 is a diagram of a virtual environment, a physical environment, and a mapped environment as constructed in accordance with the teachings of this disclosure using importance-weighted linear mapping.

[0006] FIG. 4 is a diagram comparing the virtual environment mapped using the direct linear mapping of FIG. 3 with the virtual environment mapped using importance-weighted linear mapping of FIG. 3.

[0007] FIG. 5 is a block diagram showing an example implementation of the virtual reality device of FIG. 1.

[0008] FIG. 6 is a flowchart representative of machine readable instructions that may be used to implement the example virtual environment mapper of FIG. 5 to perform importance-weighted linear mapping.

[0009] FIG. 7 is a flowchart representative of machine readable instructions that may be used to implement the example virtual environment mapper of FIG. 5 to determine weights of areas of a virtual environment.

[0010] FIG. 8 is a flowchart representative of machine readable instructions that may be used to implement the example virtual environment mapper of FIG. 5 to generate a map of the virtual environment for the physical environment using the virtual environment mapper of FIG. 5.

[0011] FIG. 9 is a flowchart representative of machine readable instructions that may be used to implement the example virtual environment mapper of FIG. 5 to determine dimensions and coordinates for units from the virtual environment in a first direction.

[0012] FIG. 10 is a flowchart representative of machine readable instructions that may be used to implement the example virtual environment mapper of FIG. 5 to determine dimensions and coordinates for units from the virtual environment in a second direction.

[0013] FIG. 11 is a schematic illustration of an example of a virtual environment being mapped in the physical environment by the virtual environment mapper of FIG. 5.

[0014] FIG. 12 is a block diagram of an example processing platform that may execute the instructions of FIGS. 6, 7, 8, 9 and/or 10 to implement the virtual environment mapper of FIG. 5.

[0015] Wherever possible, the same reference numbers will be used throughout the drawing(s) and accompanying written description to refer to the same or like parts. The figures are not to scale.

DETAILED DESCRIPTION

[0016] As virtual reality (VR) becomes increasingly popular, a demand for seamless, streamlined VR environments has precipitated. VR systems simulate a VR environment using audio and/or video media. Typically, media including audio and video is accessed via the Internet or through locally stored VR data on a VR device. The VR environment (e.g., an environment that is created by the audio and video media) can be displayed in any number of ways such as, for example, via a computer monitor, a head- mounted device, speakers, sensors, interactive implements, etc. Additionally, sensors can be used in a VR implementation to monitor the physical environment and any user movement or interactions (e.g., grasping an object, throwing an object, walking, running, etc.). For example, some implementations may use an image sensor to track body movements and to obtain visual data of the dimensions and characteristics of the physical environment. Additionally or alternatively, wearable sensors may be mounted to, worn by, and/or carried on one or more body parts to detect motion of part of a user’s body. Most VR implementations attempt to create an immersive, interactive experience that feels as close to reality as possible. For example, users expect that a movement in physical space results in a corresponding and natural movement in the virtual environment. As such, methods to implement a virtual environment that corresponds to a user’s physical environment in a way that appears and feels natural are necessary.

[0017] Conventionally, VR implementations use either a teleport solution, an infinite solution, or a direct walk solution to relate the virtual environment to the physical environment. The teleport solution involves moving the user in the virtual environment without a similar corresponding movement (e.g., walking) in the physical environment. For example, the user may indicate using a controller, a voice command, a body motion, or some other indication that they would like to be transported to a different location in the virtual environment. In other examples, a user may walk in a certain direction or to a certain near-term destination and be transported to a different location in the virtual environment. While this solution allows the user to move around the virtual environment, it fails to resemble reality.

[0018] The infinite solution for representing virtual environments in physical environments involves a movable platform for the user to stand upon which is responsive to the push of a user’s step to move the platform. This solution enables the space to be mapped at a 1:1 ratio, wherein a step in the physical environment corresponds to an equivalent motion in the virtual environment. However, this implementation requires extensive equipment, which inherently makes its use feel artificial and limits its scope. Further, motion sickness and a feeling of unnatural movement are often experienced by users in a VR implementation using the infinite solution.

[0019] In some more realistic implementations, the direct walk approach may be implemented to map the virtual environment to the physical environment. In such an approach, the user’s motion is directly tracked as they walk around the physical space to move them correspondingly in the virtual environment. To implement a direct walk solution, some conventional implementations use redirected walking. In some implementations of this approach, the virtual environment is rotated around the user as they move, so that the user slightly rotates their body in the physical environment to move straight in the virtual environment. In a large physical environment, a user can continually walk straight in the virtual environment but actually move in a curved path in the physical environment to avoid collision with the boundaries of the physical environment. However, this implementation may result in motion sickness and additionally is noticeably unrealistic when making sudden motions.

[0020] Example methods, apparatus, systems and articles of manufacture disclosed herein utilize importance-weighted linear mapping to map virtual environments to physical environments. For example, these techniques may be utilized in a VR headset that receives sensor information about the physical space surrounding the headset and maps a virtual environment to the physical environment to be used during gameplay. In additional or alternative examples, the techniques disclosed herein may be implemented by a computer, console, or other device capable of connecting to and/or including a virtual reality device. Examples disclosed herein enable weighted mapping wherein areas of the virtual environment can be variably mapped to represent different sized areas in the physical environment. For example, an area of the virtual environment that includes interactive aspects may be given a different weight than an area of the virtual environment with no interactive aspects when determining the amount of space that is to correspond to these areas in the physical environment.

[0021] In contrast with conventional approaches to addressing movement in virtual environments, example virtual reality devices that map virtual environments to physical environment using an importance-weighted linear approach in accordance with the teachings of this disclosure enable a realistic user experience by providing non-uniform mapping of a virtual environment to a physical environment to more efficiently utilize the physical environment for interactive areas.

[0022] Although examples disclosed herein may be discussed in the context of VR implementations for entertainment applications, examples disclosed herein can be utilized in other applications. For example, the VR implementation may instead be in the context of sports training applications, military training applications, medical rehabilitation, vocational training, etc. As such, the discussion of VR implementations for entertainment applications is for illustrative purposes only and does not limit the applicability of this disclosure to other VR applications.

[0023] FIGS. 1A, 1B and 1C are illustrations of an example environment of use in which a user interacts with a virtual environment and a corresponding physical environment. FIG. 1A depicts a virtual environment including a user 102 with a virtual reality device 104 and virtual reality feedback device 106. The virtual environment includes an interactive area 108 including an interactive object 110.

[0024] The example user 102 is a person engaging in a virtual reality simulation. In the illustrated example of FIG. 1A, the user 102 is engaging in a basketball video game VR simulation. However, as noted above, any other type of VR application may additionally or alternatively be used such as, for example, an entertainment application, a sports training application, a military training application, a medical rehabilitation application, a vocational training application, etc.

[0025] The example virtual reality device 104 is a virtual reality headset (e.g., a head mounted display). In other examples, the virtual reality device 104 may be a display, a projector, glasses, a full-room immersion device, a mobile device, or any other type of device to present a virtual environment. In some examples, the virtual reality headset includes multiple screens to provide a high field of view display (e.g., one hundred and ten degrees), head tracking sensors, a camera, headphones, and other features.

[0026] The example virtual reality feedback device 106 works in tandem with the virtual reality device 104 to provide feedback to the user of events and interactions in the virtual environment, and to the virtual reality device 104 of the motion and interactions of the user in the physical environment. In the illustrated example of FIG. 1A, the virtual reality feedback device 106 is a pair of haptic feedback gloves. In some examples, the virtual reality feedback device 106 may be a controller, clothing with sensors, or any other device to provide enhanced capability to the virtual reality device 104. In some examples, the virtual reality device 104 itself may include feedback and sensing capabilities, with or without supplementary virtual reality feedback device 106.

[0027] The example interactive area 108 of the illustrated example of FIG. 1A is the area within the virtual environment where the user 102 can perform an interaction. In the illustrated example of FIG. 1A, the interaction includes picking up a virtual basketball from the interactive object 110 and throwing or shooting the virtual basketball in the virtual environment. The user is located in the interactive area 108 to perform this task. Accordingly, the interactive area may be considered to be more important to the simulation than other surrounding areas where an interaction is not possible. In some examples, the interactive area 108 may not include an interactive object 110, but may simply be an area where a designated action can be taken (e.g., hitting a golf ball from a tee box, where the user carries over the golf ball and golf club to the interactive area 108).

[0028] The example interactive object 110 of the illustrated example of FIG. 1A is an item with which the user 102 can virtually interact. In the illustrated example of FIG. 1A, the interactive object 110 is a rack of basketballs. The user may be able to pick up a basketball and throw it, or move the interactive object 110 by grabbing it. The interactive object 110 can be any item in the virtual environment with which the user 102 can interact.

[0029] FIG. 1B is a schematic illustration of the user 102 including the virtual reality device 104 and the virtual reality feedback device 106 interacting in the mapped environment that has been mapped using linear mapping (without importance weighting). The schematic further includes a linearly mapped interactive area 112 and interference objects 114 and 116.

[0030] The example linearly interactive area 112 of the illustrated example of FIG. 1B is the area that has been mapped during linear mapping to perform the interactions available in interactive area 108 in the virtual environment. The example linearly mapped interactive area 112 is relatively small in the mapped environment compared to the interactive area 108 the user 102 has available in the virtual environment. As a result, it is difficult for the user to perform interactions in the virtual environment without resulting in contact with interference objects 114 and 116 in the mapped environment. Further, in the interactive areas, a small motion in the mapped environment corresponds to a significantly larger motion in the virtual environment, which may seem unnatural and make some interactions more difficult. The example linearly mapped interactive area 112 may be significantly smaller due to a much smaller overall usable physical environment as compared to the size of the virtual environment. Since the linearly mapped interactive area 112 has been mapped proportionally, the overall virtual space that has been reduced to fit the physical environment during mapping has resulted in a proportional reduction in size of the linearly mapped interactive area 112.

[0031] The example interference object 114 of the illustrated example of FIG. 1B is a bookshelf. The example interference object 116 of the illustrated example of FIG. 1B is a wall. In some examples, the interference objects may be a couch, a table, or any other items that exist in the physical environment. When unweighted linear mapping is used, the linearly mapped interactive area 112 may be very small due to the overall downscaling of the virtual environment. If interactions can only be performed within these areas, the interactions may be difficult and/or result in contact with interference objects in the physical environment.

[0032] FIG. 1C is a schematic illustration of an importance-weighted linearly mapped environment in which there is an expanded interactive area 118. The schematic includes the user 102, the virtual reality device 104, the virtual reality feedback device 106, and the interference objects 114 and 116 interacting in the mapped environment. The schematic includes an expanded interactive area 118 (as compared to the linearly mapped interactive area 112 of FIG. 1B) due to importance-weighting.

[0033] The expanded interactive area 118 of the illustrated example of FIG. 1C is generated using a weighting scheme that applies a higher weight value during mapping to areas that likely involve interaction, such as the interactive area 108 of the virtual environment. The schematic illustration shows a user with significantly more space to perform the interaction available in the virtual environment. As a result, the user 102 can more easily avoid contact with interference objects 114 and 116. As compared to an unweighted linear mapping solution, the importance-weighted linear mapping solution illustrated in FIG. 1C and constructed in accordance with the teachings of this disclosure enables an enhanced virtual reality device 104 with a mapping mechanism that emphasizes the space allocated to important areas of the virtual environment (e.g., interactive areas).

[0034] FIG. 2 is a diagram of a virtual environment, a physical environment, and the virtual environment mapped to the physical environment using a direct linear mapping. The example virtual reality implementation 200 includes a virtual environment 202 further including an interactive area 204 and a non-interactive area 206. The example virtual reality implementation 200 further includes a physical environment 208. The physical environment 208 includes a usable area 210 and a user 212. The virtual environment 202 is then mapped to the physical environment 208, resulting in a mapped environment 214. The mapped virtual environment 214 includes the user 212, a linear mapped interactive area 216 and a mapped non-interactive area 218.

[0035] The example virtual environment 202 is a VR representation of a space. In some examples, the virtual environment may include audio elements or interactive elements. The virtual environment 202 may correspond to a real-world physical environment (e.g., a gymnasium, a park, a hiking trail, etc.), may correspond to unrecognizable environment (e.g., an unidentifiable place, such as an empty room) or may correspond to any other conceivable space that can be represented by VR data. While the virtual environment 202 is displayed as a rectangle, the virtual environment 202 may be any shape or form. Additionally, while only two dimensions of the virtual environment 202 are shown in the illustrated example of FIG. 2, a virtual environment can include space in the third dimension as well.

[0036] The example interactive area 204 of the virtual environment 202 is an area where a user can engage in an interaction (e.g., interact with an object, receive or provide instructions, interact with another being, etc.). In some examples, the interactive area 204 may include multiple different interactions possible at any given location in the interactive area 204. In some examples, the interactive area 204 may only correspond to one possible interaction. In some examples, the interactive area 204 may represent the area in the virtual environment 202 that is a specific threshold distance away from an available interaction. For example, any area which is within a specified distance (e.g., within three feet) of an area at which a user can perform an interaction may be considered to be part of the interactive area 204.

[0037] The example non-interactive area 206 of the virtual environment 202 is an area where a user cannot engage in an area-specific interaction. For example, this area may simply be included in the virtual environment 202 for visual effect to provide a realistic landscape, or to provide separation between interactive areas. In some examples, nominal interactions that are available at any location (e.g., pointing, clapping, etc.) may be possible in the non-interactive area 206.

[0038] The example physical environment 208 is the area surrounding a virtual reality implementation in the real world. The physical environment 208 may be bounded by physical barriers (e.g., walls, furniture, objects, etc.), may be bounded by software or hardware requirements (e.g., maximum camera visual range, maximum allowable physical environment size, etc.), or bounded in any other manner. Additionally, while only two dimensions of the physical environment 208 are shown in the illustration, a physical environment can include space in the third dimension as well. The example physical environment 208 is of a rectangular shape, but the physical environment may be any shape or form.

[0039] The example usable space 210 is the total space to which the virtual environment can be mapped in the physical environment 208. In the illustrated example, the usable space 210 is equal to the entire physical environment 208. This may be the case in, for example, a relatively small and empty room. In other cases, some areas of the physical environment 208 may not be usable for mapping. For example, such areas may include furniture, obstacles, additional walls, or other interference features.

[0040] The example user 212 is a person engaging with a VR implementation. The user 212 may wear a VR headset or may have other equipment to interact with the VR simulation. The user 212 exists in the physical environment 208 and the mapped virtual environment 214. While in the illustrated example of FIG. 2, a single user is shown, there may be any number of users.

[0041] The example mapped environment 214 is a representation of the virtual environment 202 in the physical environment 208. The mapped environment 214 may be of the same proportions as the virtual environment 202 or of different proportions. In the illustrated example of FIG. 2, the mapped environment 214 is of the same proportions, and has been translated using direct linear mapping (e.g., a one to one mapping). Direct linear mapping refers to the proportional translation of the virtual environment 202 onto the physical environment 208. The relative proportions of each area to the overall space are identical for the virtual environment 202 and the mapped environment 214. In some applications, this is a sufficient use of physical space. However, in some applications this results in significant mapped non-interactive spaces 218 and/or relatively small linear mapped interactive areas 216. Since the virtual environment 202 is often larger than the physical environment 208, using a proportional mapped area for the interactive area 204 may result in a very small linear mapped interactive area 216 for the user 212 to engage in interactions.

[0042] The example linear mapped interactive area 216 is an area which has been translated from the interactive area 204 of the virtual environment 202 to the physical environment 208. The linear mapped interactive area 216 is proportional relative to the entire mapped virtual environment 214 when compared to the interactive area 204 relative to the entire virtual environment 202, since linear mapping has been utilized. The actual size of the linear mapped interactive area 216 may be the same or different from the interactive area 204 of the virtual environment 202, depending upon the sizes of the virtual environment 202 and the physical environment 208. The linear mapped interactive area 216 is the physical area in which the corresponding interactions of the interactive area 204 of the virtual environment 202 can be performed.

[0043] The example mapped non-interactive area 218 is an area which has been translated from the non-interactive area 206 of the virtual environment 202. As direct linear mapping has been used in the illustrated example of FIG. 2, the mapped non-interactive area 218 relative to the area of the total mapped virtual environment 214 is proportional to the non-interactive area 207 relative to the area of the total virtual environment 202. The mapped non-interactive area 218 of the mapped virtual environment 214 is the area in which no interactions are available in the VR simulation.

[0044] FIG. 3 is a diagram of a virtual environment, a physical environment, and a mapped environment as constructed in accordance with the teachings of this disclosure using importance-weighted linear mapping. The example virtual reality implementation 300 includes the virtual environment 202 and the contents included therein as well as the physical environment 208 and the contents included therein, substantially identical to the environments previously described in association with FIG. 2.

[0045] The example mapped environment 314 of the illustrated example of FIG. 3 is generated using importance-weighted linear mapping. Unlike in the previous illustrated example of FIG. 2, the weighted mapped interactive area 316 may or may not be of the same proportion relative to the total mapped virtual environment 314 as the interactive area 204 to the virtual environment 202. The mapping approach illustrated in FIG. 3 enables areas of more importance (e.g., areas with interaction possible, areas with higher importance interactions, areas with preferred gameplay or effects, etc.) to take up more physical area in the mapped environment 314. In some examples, a binary weighting style may be used, enabling some areas to be included in the mapped environment 314 and other areas to be excluded from the mapped environment. In some examples, multiple weights may be possible for any given area. For example, some areas may be more critical to the advancement of gameplay than others. However, any area which contains interaction may be more important than those that do not. In such a case, an area with interaction that is of high importance may receive a weight of “three,” any other areas with interaction may receive a weight of “two,” and areas without interaction may receive a weight of “one.” Any method of assigning weights to achieve any objective (e.g., enlarge important gameplay areas, enlarge advertising areas, etc.) may be used.

[0046] Additionally, weighted linear mapping may incorporate adjustments, thresholds or modifications for non-rectangular physical environments or environments with object interference. For example, in a rectangular environment with a large couch in the center, the mapping technique may not use the space where the couch sits. In such an example, the weighted linear mapping may be configured to put interactive content on one side of the couch so as not to create interference during an interaction. Additionally, any modification can be made to account for irregularities or non-uniformity in the physical environment.

[0047] The example weighted mapped interactive area 316 represents the interactive area 204 of the virtual environment 202, as mapped to the physical environment 208. As the mapped virtual environment 314 is generated using importance-weighted linear mapping, the weighted mapped interactive area 316 is larger than the linear mapped interactive area 216 generated using non-weighted linear mapping (as shown in FIG. 2). In the illustrated example of FIG. 3, the interactive area 204 is assigned a weight that is twice that of the non-interactive area 206. As a result, the mapped interactive area 314 stretches in the vertical direction, as well as in the horizontal direction for the top and bottom triangular elements. The user 212 thus has more of the usable space 210 available to perform the interactions of the virtual environment 202.

[0048] The example mapped non-interactive area 318 is the non-interactive area 206, as mapped to the physical environment 208. The mapped non-interactive area 318 is smaller relative to the mapped non-interactive area 218 of the illustrated example of FIG. 2, where linear mapping was utilized without weights. As a result, the non-interactive area is reduced to enable more physical area for the interactions available in the virtual environment 302.

[0049] FIG. 4 is a diagram comparing the virtual environment mapped using the direct linear mapping of FIG. 3 with the virtual environment mapped using importance-weighted linear mapping of FIG. 3. FIG. 4 includes the linear mapped interactive area 216 of the mapped environment 214 from FIG. 2 and the weighted mapped interactive area 316 of the mapped environment 314 from FIG. 3. In the illustrated example of FIG. 4, the linear mapped interactive area 216 has been placed directly over the weighted mapped interactive area 316 to display the difference in size and geometry between these two mapping approaches. The linear mapped interactive area 216, which has been mapped using linear mapping, is significantly smaller than the weighted mapped interactive area 316, which has been mapped using importance-weighted linear mapping using the techniques disclosed herein. The weighted mapped interactive area 316 has a larger overall area for a user to perform interactions within since the interactive area 204 of the virtual environment has been given a higher weight than the non-interactive area 206. Utilizing importance-weighted linear mapping therefore results in a large weighted mapped interactive area 316 relative to the linear mapped interactive area 216, improving the mapped environment presented by the virtual reality device 104.

[0050] FIG. 5 is a block diagram showing an example implementation of the virtual reality device of FIG. 1. The example virtual reality device 104 includes a data store 502 and a virtual environment mapper 504. The virtual environment mapper 504 includes a virtual environment data receiver 506, a virtual environment analyzer 508, a physical environment data receiver 510, a physical environment analyzer 512, a mapped environment generator 514, and a mapped environment outputter 516. The virtual reality device 104 further includes environment sensors 518 and a presenter 520.

[0051] The example data store 502 of the illustrated example of FIG. 5 stores VR data for use by the virtual reality device 104. The example data store 502 of the illustrated example of FIG. 5 is implemented by any memory, storage device and/or storage disc for storing data such as, for example, flash memory, magnetic media, optical media, etc. Furthermore, the data stored in the example data store 502 may be in any data format such as, for example, binary data, comma delimited data, tab delimited data, structured query language (SQL) structures, etc. While in the illustrated example the data store 502 is illustrated as a single element, the example data store 502 and/or any other data storage elements described herein may be implemented by any number and/or type(s) of memories. In the illustrated example of FIG. 5, the example data store 502 stores virtual reality data pertaining to a virtual environment. The example data store 502 may transmit the VR data to the virtual environment data receiver 506. The data store 502 may be physical storage located on the virtual reality device 104, may be removable storage that can be connected to the virtual reality device 104, may be a virtual storage location accessible via a network (e.g., the Internet) or may be in any other location or configuration.

[0052] The example virtual environment mapper 504 of the illustrated example of FIG. 5 is capable of performing importance-weighted linear mapping in accordance with the teachings of this disclosure. The virtual environment mapper 504 receives requests for the presentation of virtual environments, accesses and analyzes virtual and physical environment data, generates mapped environments, and prepares mapped environments for output by other devices such as the presenter 520. The virtual environment mapper 504 includes the virtual environment data receiver 506, the virtual environment analyzer 508, the physical environment data receiver 510, the physical environment analyzer 512, the mapped environment generator 514 and the mapped environment outputter 516. In some examples, the virtual environment mapper 504 itself may present the mapped environment. In some examples, the virtual environment mapper 504 is separate from the virtual reality device 104. For example, the virtual environment mapper 504 may be on a computer that provides mapped environments to the virtual reality device 104. In some examples, the virtual environment mapper 504 is implemented via software. In such examples, the virtual environment mapper 504 may be stored on the virtual reality device 104 or may be accessible via a network.

[0053] The example virtual environment data receiver 506 of the illustrated example of FIG. 5 accesses virtual environment data including visual data, audio data, interaction data, metadata, and any other data pertaining to the virtual environment. The virtual environment data receiver 506 may receive requests for the presentation of a virtual environment or may initiate the data retrieval based on a predetermined ordering of environments to display (e.g., as in a demo configuration) or based on specific conditions of the virtual reality device 104 (e.g., a time of day, a location of the virtual reality device 104, etc.). In some examples, the virtual environment data receiver 506 may process a request for the environment to be mapped based on an updated position of the virtual reality device 104. The virtual environment data receiver 506 may retrieve virtual environment data from the data store 502 or from any other location.

[0054] The example virtual environment analyzer 508 of the illustrated example of FIG. 5 assigns weights to areas in the virtual environment for use in generating an importance-weighted linearly mapped environment. The virtual environment analyzer 508 divides the virtual environment into units by dividing the overall virtual environment at an interval in a first and a second direction. For example, the virtual environment analyzer 508 may divide a rectangular environment into smaller rectangular units. The virtual environment analyzer 508 determines weights of the units of the virtual environment based on various criteria (e.g., areas of the physical environment of higher importance, areas involving more interaction, areas including critical gameplay features, etc.). The virtual environment analyzer 508 determines if units include interactive elements or features available within the unit bounds. The virtual environment analyzer 508 identifies the presence of interactive features within the unit bounds. In some examples, the virtual environment analyzer 508 may be configured with thresholds to determine the kind of features that qualify as interactive features. For example, interactive features which are universal (e.g., available anywhere in the virtual environment) may not qualify as interactive features in determining if a unit includes interactive features.

[0055] In some examples, the virtual environment analyzer 508 assigns units with interactive features a high weight value relative to units without interactive features. In some examples, a tiered or multi-level weighting system may be used. In such examples, the virtual environment analyzer 508 assigns numerous weights to different units. In examples where a multi-weight system is used, the virtual environment analyzer 508 assigns multiple weight values for varying levels of interaction and importance. In such examples, a variable system can be used wherein the weight value corresponds to a measure associated with the number of interactive elements available in a unit (e.g., a weight value of “one” for one interactive element, a weight value of “two” for two interactive elements, etc.).

[0056] Additional factors may be incorporated into determining the weight values assigned to units. For example, a unit’s distance from an optimal path through the environment, a unit’s proximity to other important units, a unit’s similarity to neighboring units, or any other aspect may be included in determining a weight value for the unit. In some examples, a binary system may be utilized wherein units including interactive features receive one weight value and units without interactive features receive a different weight value. The virtual environment analyzer 508 may additionally determine the dimensions of the virtual environment, for use by the mapped environment generator 514.

[0057] In some examples, the example virtual environment analyzer 508 additionally applies a smoothing function or algorithm to blur the boundary between units of different weights. For example, instead of a sharp drop in weight value between two units, a unit may have a variable weight that gradually increases or decreases to match the weight value of a neighboring unit at its boundary. In some examples, applying the smoothing function involves reanalyzing and reprocessing the units. In some examples, the smoothing function may cause reanalysis and/or re-processing of weight values for areas that are identified as including boundaries that meet a specific threshold to be smoothed (e.g., a quantified transition in weight values within a specified number of units or distance).

[0058] The example physical environment data receiver 510 of the illustrated example of FIG. 5 is implemented by one or more sensors to access data pertaining to the physical environment to determine the dimensions of the physical environment. The example physical environment data receiver 510 collects dimensional data, or data used to determine dimensional data, from the environment sensors 518. For example, the physical environment data receiver 510 may process, collect, and combine data streams to generate dimensional data to be passed to the physical environment analyzer 512. In some examples, the physical environment data receiver 510 receives user input data regarding the physical environment. For example, a user may specify that only a designated area of the physical environment is usable by inputting dimensions of a usable space. The data accessed by the physical environment data receiver 510 may be dimensions, may be direct sensor outputs, or may be any other data to help the physical environment analyzer 512 determine the dimension and map of the physical environment.

[0059] The example physical environment analyzer 512 of the illustrated example of FIG. 5 determines, based on the physical environment data received by the physical environment data receiver 510, the dimensions of the physical environment. In some examples, the physical environment analyzer 512 may additionally determine features of the physical environment, including any objects in the environment, obstacles, the shape of the environment, and any other features to better understand and enable mapping of the physical environment. In some examples, the physical environment analyzer 512 may process, combine, or otherwise manipulate the outputs of environment sensors 518 to determine the characteristics of the physical environment.

[0060] The example mapped environment generator 514 of the illustrated example of FIG. 5 utilizes a weighted linear mapping technique to map the virtual environment to the physical environment. The mapped environment generator 514 determines dimensions and coordinates for units from the virtual environment in the mapped environment in the X-direction (e.g., horizontally) and Y-direction (e.g., vertically). In examples disclosed herein, the mapped environment generator 514 utilizes an algorithm to assign units of the virtual environment to the mapped environment. The algorithm may be described in accordance with the weighted linear function represented by Equation 1 and Equation 2 below:

x ’ = W i = 1 W f ( i , y ) * x i * i = 1 x f ( i , y ) * x i Equation 1 y ’ = L i = 1 L f ( x , i ) * y i * i = 1 y f ( x , i ) * y i Equation 2 ##EQU00001##

[0061] In the illustrated example of Equation 1, the variable x’ refers to the horizontal coordinate in the mapped environment, W refers to the overall width of the physical environment, f(I,y) refers to the weighting function, x.sub.i refers to the instantaneous position in the horizontal direction, and y refers to the position in the vertical direction.

[0062] Similarly, in the illustrated example of Equation 2, the variable y’ refers to the vertical coordinate in the mapped environment, L refers to the overall length of the physical environment, f(x,i) refers to the weighting function, y.sub.i refers to the instantaneous position in the vertical direction, and x refers to the position in the horizontal direction.

[0063] The weighting function (e.g., (f(x,i)) as used in Equation 1 and Equation 2, can be any function to emphasize areas of higher importance. In examples disclosed herein, weights are assigned corresponding to step sizes (e.g., at each interval) by the virtual environment analyzer 508. In such examples, the weight values may be constant values associated with the presence or amount of interactive features in a unit (e.g., at a given step interval). In some examples, Equation 1 and Equation 2 are solved substantially simultaneously.

[0064] In some examples, one direction is analyzed first (e.g., X’ values are determined for units, and then Y’ values are determined for units, or the reverse order). The mapped environment generator 514 may successively select columns, (e.g., units aligned vertically in the Y-direction), for analysis. To calculate unit dimensions and coordinates in the Y-direction, the mapped environment generator 514 determines the sum of the weighting values present in the column by adding the weight values previously assigned by the virtual environment analyzer 508 to units in the column. The example mapped environment generator 514 determines the dimension in the Y-direction for the column to be equal to the Y-direction range (e.g., the maximum dimension in the Y-direction) for the physical environment. In some examples, the mapped environment generator 514 determines the dimension in the Y-direction based on data received by the physical environment data receiver 508 from the environment sensors 518. In some examples, the dimension may be uniform throughout the physical environment (e.g., in a rectangular physical environment). In other examples, the mapped environment generator 514 may determine the dimension in the Y-direction based upon the dimension in the Y-direction of the column’s corresponding projected position in the physical environment. The example mapped environment generator 514 then divides the dimension in the Y-direction by the sum of the weighting values to create a scale value representative of the height of a unit with a weight of one in the mapped environment. The mapped environment generator 514 applies the scale value to units to determine an adjusted dimension for units by multiplying the scale value and the weight value for a given unit.

[0065] The virtual environment generator 514 utilizes the adjusted dimension to determine coordinates in the mapped environment for units. For example, the mapped environment generator 514 may determine a first and a second value in the Y-direction for a unit in the mapped environment based on the adjusted dimension and the second Y-value of the previous unit in the column. In some examples, the same process can be utilized to calculate unit dimensions and coordinates in the X-direction, analyzing rows instead of columns. Dimensions and coordinates for units in the mapped environment are stored by the virtual environment generator 514 in the data store 502 or in any other accessible storage location. In some examples, dimensions and coordinates for units in the X-direction and Y-direction are stored in the same location. The mapped environment generator 514 generates dimensions and coordinates for rows and columns until the rows and columns of the virtual environment have been analyzed. In some locations, dimensions and coordinates for units in the X-direction are stored in a different location than dimensions and coordinates for units in the Y-direction. In some examples, the mapped environment generator 514 may additionally take into account a user’s location and orientation in the physical environment, as ascertained by the environment sensors 518, when generating the mapped environment.

[0066] The example mapped environment outputter 516 of the illustrated example of FIG. 5 prepares a representation of the mapped environment for display. The mapped environment outputter 516 transmits or communicates this representation to the presenter 520, which presents this representation to a participant of the VR simulation. The mapped environment outputter 516 may dimensionally compress the visual data of the virtual environment according to the mapped environment (e.g., visually shrink the environment to fit the physical environment). The mapped environment outputter 516 may determine the appropriate audio data, interactive data, and other VR data to display to represent the mapped environment and transmit or communicate this data to the presenter 520.

[0067] The example environment sensors 518 of the illustrated example of FIG. 5 are sensors associated with the virtual reality device 104 that are capable of obtaining data pertaining to the physical environment. In some examples, the data collected by the environment sensors 518 may include dimensional data. In some examples, the data collected by the environment sensors 518 may be processed to determine dimensions and other features of the physical environment. The environment sensors 518 may include, but are not limited to, vision sensors (e.g., cameras), gyroscopes, magnetometers, infrared sensors, capacitive transducers, ultrasonic sensors, proximity sensors, position sensors, and any other type of sensors to collect data on the physical environment. In some examples, the environment sensors 518 may be used to determine a user’s location and orientation.

[0068] The example presenter 520 of the illustrated example of FIG. 5 is capable of presenting the representation of the mapped environment. In some examples, the presenter 520 may present the mapped environment via a display built into the virtual reality device 104 (e.g., a display on the headset) or via a separate device (e.g., a projector). The presenter 520 may include additional features such as speakers, haptic response mechanisms, and/or any other output devices to create a realistic, multi-faceted representation of the mapped environment.

[0069] In operation, the data store 502 supplies the virtual environment data receiver 506 with virtual reality data corresponding to a virtual environment. The virtual environment analyzer 508 analyzes the VR data received by the virtual environment data receiver 506 by dividing the virtual environment into units and assigning importance weights to the units. The physical environment data receiver 510 receives data pertaining to the physical environment from the environment sensors 518 that the physical environment analyzer 512 utilizes to determine the dimensions and features of the physical environment. The mapped environment generator 514 then uses the physical environment dimensions and features and the analyzed virtual environment to generate an importance-weighted, linearly mapped environment. After the mapped environment has been generated, the mapped environment outputter 516 assembles and prepares the appropriate VR data to represent the mapped environment. The mapped environment outputter 516 outputs this representation to the presenter 520 to generate a presentation of the mapped environment.

[0070] While an example of implementing the virtual reality device 104 of FIG. 1 is illustrated in FIG. 5, one or more of the elements, processes and/or devices illustrated in FIG. 5 may be combined, divided, re-arranged, omitted, eliminated, and/or implemented in any other way. Further, the example data store 502, the example virtual environment mapper 504, the example virtual environment data receiver 506, the example virtual environment analyzer 508, the example physical environment data receiver 510, the example physical environment analyzer 512, the example mapped environment generator 514, the example mapped environment outputter 516, the example environment sensors 518, the example presenter 520 and/or, more generally, the example virtual reality device 104 of FIG. 5 may be implemented by hardware, software, firmware and/or any combination of hardware, software and/or firmware. Thus, for example, any of the example data store 502, the example virtual environment mapper 504, the example virtual environment data receiver 506, the example virtual environment analyzer 508, the example physical environment data receiver 510, the example physical environment analyzer 512, the example mapped environment generator 514, the example mapped environment outputter 516, the example environment sensors 518, the example presenter 520 and/or, more generally, the example virtual reality device 104 and/or, more generally, the example virtual reality device 104 of FIG. 5 could be implemented by one or more analog or digital circuit(s), logic circuits, programmable processor(s), application specific integrated circuit(s) (ASIC(s)), programmable logic device(s) (PLD(s)) and/or field programmable logic device(s) (FPLD(s)). When reading any of the apparatus or system claims of this patent to cover a purely software and/or firmware implementation, at least one of the example, data store 502, the example virtual environment mapper 504, the example virtual environment data receiver 506, the example virtual environment analyzer 508, the example physical environment data receiver 510, the example physical environment analyzer 512, the example mapped environment generator 514, the example mapped environment outputter 516, the example environment sensors 518, the example presenter 520 and/or, more generally, the example virtual reality device 104 of FIG. 5 is/are hereby expressly defined to include a non-transitory computer readable storage device or storage disk such as a memory, a digital versatile disk (DVD), a compact disk (CD), a Blu-ray disk, etc. including the software and/or firmware. Further still, the example virtual reality device 104 of FIG. 5 may include one or more elements, processes and/or devices in addition to, or instead of, those illustrated in FIG. 5, and/or may include more than one of any or all of the illustrated elements, processes, and devices.

……
……
……