Apple Patent | Augmented Reality Display System

Patent: Augmented Reality Display System

Publication Number: 20200258480

Publication Date: 20200813

Applicants: Apple

Abstract

An augmented reality display system included in a vehicle generates an augmented reality display, on one or more transparent surfaces of the vehicle. The augmented reality display can include an indicator of the vehicle speed which is spatially positioned according to the speed of the vehicle relative to the local speed limit. The augmented reality display can include display elements which conform to environmental objects and can obscure and replace content displayed on the objects. The augmented reality display can include display elements which indicate a position of environmental objects which are obscured from direct perception through the transparent surface. The augmented reality display can include display elements which simulate one or more particular environmental objects in the environment, based on monitoring manual driving performance of the vehicle by a driver. The augmented reality display can include display elements which identify environmental objects and particular zones in the environment.

[0001] This application is a 371 of PCT Application No. PCT/US2016/053182, filed Sep. 22, 2016, which claims benefit of priority to U.S. Provisional Patent Application No. 62/232,855, filed Sep. 25, 2015. The above applications are incorporated herein by reference. To the extent that any material in the incorporated application conflicts with material expressly set forth herein, the material expressly set forth herein controls.

BACKGROUND

[0002] In many situations, a graphical overlay can be provided on an environment that is perceived through a transparent surface, including a window. A graphical overlay can provide information to an observer, including information which is relevant to one or more portions of the perceived environment. In some cases, a graphical overlay is used in a vehicle, where a graphical overlay can be perceived by an occupant of the vehicle and provides information relevant to one or more of the vehicle, including vehicle speed, and one or more portions of the environment in which the vehicle is located. Such information can be provided on a transparent surface, including a forward window, also referred to herein as a windscreen, windshield, etc., such that the information can be perceived by an operator of the vehicle, including a driver, near the line of sight of the operator as the operator observes the environment through which the vehicle is navigated, including an oncoming roadway.

[0003] In some cases, the graphics displayed should be able to overlay certain objects located in the environment perceived though the transparent surface and can augment, alter, control, information related to the environment which is provided to an observer via the transparent surface. Such graphical overlays can be referred to as an augmented reality display.

BRIEF DESCRIPTION OF THE DRAWINGS

[0004] FIG. 1 illustrates a vehicle, according to some embodiments.

[0005] FIG. 2A-B illustrate a vehicle comprising a transparent surface which provides an augmented reality display indicating a spatial indication of a speed of the vehicle relative to a local speed limit, according to some embodiments.

[0006] FIG. 3A-B illustrate a vehicle comprising a transparent surface which provides an augmented reality display which modifies occupant-perceived information presented by a sign located in the external environment, according to some embodiments.

[0007] FIG. 4A-B illustrate a vehicle comprising a transparent surface which provides an augmented reality display which provides a representation of a static object in the environment which is presently obscured from direct view through the transparent surface of the vehicle, according to some embodiments.

[0008] FIG. 5A-B illustrate a vehicle comprising a transparent surface which provides an augmented reality display which provides a representation of at least one dynamic object in the environment which is presently obscured from direct view through the transparent surface of the vehicle, according to some embodiments.

[0009] FIG. 6A-B illustrate a vehicle comprising a transparent surface which provides an augmented reality display which provides a dynamically controllable representation of a driving route along which a vehicle is being navigated, according to some embodiments.

[0010] FIG. 7A-B illustrate a vehicle which simulates, via one or more of a transparent surface which provides an augmented reality display and an active suspension system, one or more objects in the environment, according to some embodiments.

[0011] FIG. 8A-B illustrate a vehicle comprising a transparent surface which provides an augmented reality display which indicates a particular driving zone in the environment, according to some embodiments.

[0012] FIG. 9 illustrates a transparent surface which provides an augmented reality display of one or more portions of an environment, according to some embodiments.

[0013] FIG. 10 illustrates a vehicle comprising a transparent surface which provides an augmented reality display which enables user selection of a portion of the environment perceived via the transparent surface and which enables video communication with a remotely-located user via the transparent surface, according to some embodiments.

[0014] FIG. 11 illustrates an example computer system that may be configured to include or execute any or all of the embodiments described above.

DETAILED DESCRIPTION

[0015] This specification includes references to “one embodiment” or “an embodiment.” The appearances of the phrases “in one embodiment” or “in an embodiment” do not necessarily refer to the same embodiment. Particular features, structures, or characteristics may be combined in any suitable manner consistent with this disclosure.

[0016] “Comprising.” This term is open-ended. As used in the appended claims, this term does not foreclose additional structure or steps. Consider a claim that recites: “An apparatus comprising one or more processor units … .” Such a claim does not foreclose the apparatus from including additional components (e.g., a network interface unit, graphics circuitry, etc.).

[0017] “Configured To.” Various units, circuits, or other components may be described or claimed as “configured to” perform a task or tasks. In such contexts, “configured to” is used to connote structure by indicating that the units/circuits/components include structure (e.g., circuitry) that performs those task or tasks during operation. As such, the unit/circuit/component can be said to be configured to perform the task even when the specified unit/circuit/component is not currently operational (e.g., is not on). The units/circuits/components used with the “configured to” language include hardware–for example, circuits, memory storing program instructions executable to implement the operation, etc. Reciting that a unit/circuit/component is “configured to” perform one or more tasks is expressly intended not to invoke 35 U.S.C. .sctn. 112, sixth paragraph, for that unit/circuit/component. Additionally, “configured to” can include generic structure (e.g., generic circuitry) that is manipulated by software and/or firmware (e.g., an FPGA or a general-purpose processor executing software) to operate in manner that is capable of performing the task(s) at issue. “Configure to” may also include adapting a manufacturing process (e.g., a semiconductor fabrication facility) to fabricate devices (e.g., integrated circuits) that are adapted to implement or perform one or more tasks.

[0018] “First,” “Second,” etc. As used herein, these terms are used as labels for nouns that they precede, and do not imply any type of ordering (e.g., spatial, temporal, logical, etc.). For example, a buffer circuit may be described herein as performing write operations for “first” and “second” values. The terms “first” and “second” do not necessarily imply that the first value must be written before the second value.

[0019] “Based On.” As used herein, this term is used to describe one or more factors that affect a determination. This term does not foreclose additional factors that may affect a determination. That is, a determination may be solely based on those factors or based, at least in part, on those factors. Consider the phrase “determine A based on B.” While in this case, B is a factor that affects the determination of A, such a phrase does not foreclose the determination of A from also being based on C. In other instances, A may be determined based solely on B.

[0020] FIG. 1 illustrates a vehicle, according to some embodiments. The vehicle 110 is located in an external environment 100 and can include a vehicle navigation system (VNS) 140.

[0021] In some embodiments, the VNS 140 can autonomously control one or more vehicle control elements 150 to cause the vehicle 110 to be autonomously navigated along one or more driving routes through the environment 100. In some embodiments, VNS 140 controls display of information to one or more occupants of the vehicle via one or more interfaces 130. At least one of the interfaces 130 can include a transparent surface via which an occupant can perceive one or more portions of the environment 100, and the VNS 140 can control a display of information to the occupant via a graphical overlay on the transparent surface which provides an augmented reality display of one or more portions of the environment perceived by the occupant via the transparent surface.

[0022] Vehicle 110 includes one or more sets of external sensors 116 which generate sensor data representations of one or more portions of the external environment 100. The external sensors 116 can include one or more of visible light camera devices, infrared camera devices, near-infrared camera devices, light beam scanning devices, ultrasonic sensor devices, audio sensor devices, depth camera devices, radar devices, geographic position detection devices, some combination thereof, etc. Sensor data representations generated by one or more of the external sensors 116 can be communicated to the VNS 140, and the VNS can generate and maintain a world model of one or more portions of the environment 100 based on the sensor data representations generated by the external sensors 116. In some embodiments, the VNS 140 generates and maintains a world model based at least in part upon information received from a remote service, system, device, etc. via one or more communication networks.

[0023] Vehicle 110 includes a set of one or more internal sensors 118 which generate sensor data representations of one or more portions of a vehicle interior included in the vehicle 110, including sensor data representations of one or more occupants of the vehicle, also referred to herein as users. The internal sensors 118 can include one or more of visible light camera devices, infrared camera devices, near-infrared camera devices, light beam scanning devices, ultrasonic sensor devices, audio sensor devices, depth camera devices, radar devices, some combination thereof, kinematic sensor devices, etc. In some embodiments, one or more internal sensors 118 generates sensor data associated with a state of one or more portions of the vehicle, including one or more of the control elements 150. Such one or more internal sensors can include one or more of an accelerometer, a speedometer, etc.

[0024] Vehicle 110 includes one or more control elements 150 which cause the vehicle to be navigated. Control elements can include one or more of a steering control element, a motor, a throttle control element, a brake control element, etc.

[0025] Vehicle 110 includes one or more interfaces 130, which can include one or more user interfaces installed in the vehicle with which one or more occupants can interact, one or more communication interfaces which can communicate with one or more remotely located devices, vehicles, services, systems, etc. via one or more communication networks. Vehicle 110 includes one or more transparent surfaces 134 via which one or more occupants can perceive one or more portions of the environment 100 from within the vehicle interior, etc. In some embodiments, VNS 140 can generate, manage, control, etc. one or more graphical displays, including one or more augmented reality displays, which are displayed on one or more particular transparent surfaces 134 in the vehicle.

[0026] As shown, the VNS 140 can include an augmented reality display module 111, also referred to herein as an augmented reality display system. In some embodiments, one or more of the VNS 140 and the module 111 can be implemented by one or more computer systems. In some embodiments, the VNS 140 and the module 111 are implemented by separate computer systems. Module 111 can generate one or more various augmented reality displays which are provided to one or more occupants via one or more transparent surfaces 134 in the vehicle 110 based on information received via processing data received from one or more of the interfaces 130, external sensors 116, and internal sensors 118.

[0027] FIG. 2A-B illustrate a vehicle comprising a transparent surface which provides an augmented reality display which includes a spatially positioned representation of a speed of the vehicle relative to a local speed limit, according to some embodiments. The vehicle and transparent surface illustrated in FIG. 2A-B can be included in any of the embodiments of vehicles and transparent surfaces included herein.

[0028] In some embodiments, an augmented reality display provided to an occupant of a vehicle, via being displayed on one or more transparent surfaces of the vehicle, includes a display element which provides a three-dimensional representation of a speed of the vehicle where representation of the speed is spatially positioned, in the environment, based on a difference between the vehicle speed and a local speed limit. The vehicle can include an augmented reality system which, based on sensor data generated by one or more internal sensors, external sensors interfaces, etc, can determine a present speed of the vehicle and a local speed limit in the portion of the environment through which the vehicle is presently being navigated.

[0029] The augmented reality display system can generate an augmented reality display on a transparent surface of the vehicle which includes a display element which both indicates a speed of the vehicle and provides at least a spatial indication of the speed of the vehicle, relative to the local speed limit. In some embodiments, the display element includes a representation of at least the speed of the vehicle. The augmented reality display can comprise an overlay of at least a portion of the portion of the environment visible, also referred to herein as perceptible, via the transparent surface. The overlay can include display elements, also referred to herein as representations, which provide three-dimensional representations of one or more various graphical icons, such that the three-dimensional representations are perceptible as being positioned in the external environment when the environment is perceived via the augmented reality display presented on the transparent surface. A display element which provides a three-dimension representation of a graphical icon at a particular position in the environment can be referred to as being spatially positioned in the environment and can be referred to as being spatially positioned. Where to display element provides a three-dimensional representation of a graphical icon in a particular position in the environment based on relative vehicle speed, the display element can be referred to as providing a spatial indication of the relative vehicle speed. Spatial positioning of a representation presented by a display element in the augmented reality display can be implemented via controlling one or more of the size and position of the graphical icon comprised in the display element presented on the transparent surface, so that the graphical icon can appear to be further away from the transparent surface, nearer to the transparent surface, in different portions of the environment, etc., based on the relative speed of the vehicle.

[0030] As shown in FIG. 2A-B, a vehicle 200 in which an occupant 210 is located can include a transparent surface 220, including a windshield, via which the occupant perceives at least a portion of the external environment 290. The occupant 210 can be a driver of the vehicle 210, positioned in a driver position in the vehicle, some combination thereof, etc., and the transparent surface 220 can include a windshield via which the occupant can perceive a portion of the environment 290 which is ahead of the vehicle along a direction of travel while the vehicle navigates along a roadway 292 in the environment.

[0031] As shown, an augmented reality display 230 can be displayed (“presented”, “provided”, etc.) on surface 220, so that the display 230 is perceptible by occupant 210 monitoring the portion of the environment 290 via the surface 220 and the display 230 is perceptible as an overlay upon the environment perceptible by occupant 210 via surface 220. As shown in FIG. 2A-B, the display 230 can include one or more display elements 232A-C which include content which indicates at least a speed of the vehicle, such that the display elements comprise representations of at least the speed of the vehicle. For example, element 232A indicates a speed of 40 mph, element 232B indicates a speed of 35 mph, and element 232C indicates a speed of 30 mph. In some embodiments, the illustrated elements 232A-C indicate different states and configuration of a single element when the vehicle 200 is navigating at different speeds, such that the individual element is perceptible as being spatially positioned at an individual position in the environment.

[0032] As further shown, in some embodiments, the element 232A-C can include content indicating a local speed limit associated with the environment, including the local roadway 292. FIG. 2A-B shows that the local speed limit is 35 mph, and the display 230 includes an element 232A-C which indicates both the present speed of the vehicle and the local speed limit.

[0033] In some embodiments, the one or more display elements 232 presented via display 230 are adjustably controlled to cause the perceived elements 232 to provide three-dimensional representations of one or more graphical icons which are spatially positioned in one or more portions of the environment perceptible through surface 220 based on the relative speed of the vehicle relative to a local speed limit. The spatial positioning can include adjusting one or more various parameters of the one or more display elements 232, including one or more of a size, color, position, etc. of the elements 232 in the display 230, to cause the element 232 to be perceived as being spatially positioned in the environment 290 based on the relative speed of the vehicle 200. The parameters of an individual display element 232 can be dynamically adjusted based on variations in the vehicle speed, local speed limit, etc., so that the three-dimensional representation of a spatial position of the graphical icon in the environment is dynamically adjusted.

[0034] As shown in FIG. 2A-B, the spatial positioned representation of an icon in the environment by the display element 232 in the display 230, based on the relative speed of the vehicle 210, can include adjustably controlling one or more parameters of the display element to cause the representation of the icon to be spatially positioned closer to the occupant 210 in the vehicle 200 as the speed of the vehicle 200 increases beyond the local speed limit and to cause the y controlling one or more parameters of the display element to cause the representation to be spatially positioned further from the occupant 210 in the vehicle 200 as the speed of the vehicle 200 decreases below the local speed limit.

[0035] For example, icon 232 is shown to be displayed in configuration 232B, so that the icon 232 is displayed as being positioned a particular distance from the vehicle 200 along roadway 292, where the vehicle speed matches the local speed limit, shown here as 35 mph. In some embodiments, the display 230 can be controlled to cause the displayed icon 232 to be positioned 234 within a certain portion of the roadway 292, so that the element 232 is repositioned in the display 230 to cause the three-dimensional representation of the graphical icon indicating the vehicle speed to appear to follow various turns, slopes, etc. of the roadway 292 while remaining a particular perceived distance from the vehicle in the environment 290.

[0036] As shown in FIG. 2A-B, one or more parameters of the element 232 can be adjusted, via adjusting one or more parameters of the displayed element 232, so that the three-dimensional representation of the icon is positioned in a configuration 232A in the environment which is located closer to vehicle 200 as the vehicle speed increases beyond the local speed limit. The repositioning 234 can be dynamic, so that the icon is dynamically spatially repositioned in the environment 290 in accordance with the speed of the vehicle 200. As shown in FIG. 2B, spatial repositioning can include adjusting a size and position of the element 232 so that the representation of the icon appears larger and nearer as vehicle speed is greater than the local speed limit and smaller and further away as the vehicle speed is less than the local speed limit. The spatial positioning of the graphical icon in the environment provided by the three-dimensional representation of the icon presented by the display element 232 can provide the occupant 210 with a visual cue with regards to the relative speed of the vehicle 200, thereby augmenting the occupant’s situational awareness, particularly where the occupant 210 is a driver of the vehicle 200, thereby augmenting vehicle navigation by the driver occupant 210.

[0037] As shown in FIG. 2A-B, the repositioning 234 of the perceived position of icon in the environment 290 by element 232 can be adjusted to cause a perceived elevation of the element 232 in the environment to be adjusted based on the relative speed of the vehicle, relative to a local speed limit. As shown in FIG. 2A, for example, parameters of the displayed icon presented by element 232 can be adjusted to cause the displayed icon to appear at a higher elevation in accordance with the vehicle speed being greater than a local speed limit, as shown at 232A, and to cause the displayed icon, which can also be referred to herein as a representation of the vehicle speed, to appear at a lower elevation in accordance with the vehicle speed being less than a local speed limit, as shown at 232C. Such adjustment of perceived elevation can occur concurrently with adjustment of a perceived proximity of the icon from the vehicle, as shown in FIG. 2A.

[0038] FIG. 3A-B illustrate a vehicle comprising a transparent surface which provides an augmented reality display which modifies occupant-perceived information presented by a sign located in the external environment, according to some embodiments. The vehicle and transparent surface illustrated in FIG. 3A-B can be included in any of the embodiments of vehicles and transparent surfaces included herein.

[0039] In some embodiments, an augmented reality display system generates, on a transparent surface, an augmented reality display of a portion of an external environment which can be perceived via the transparent surface, where the augmented reality display comprises display elements which overlay one or more portions of the environment which include one or more objects in the environment and which at least partially conform to one or more boundaries of the one or more objects in the environment. The display elements can overlay content included on the external surfaces of the objects and can include replacement content which can be generated by the augmented reality display system, such that the augmented reality display element which overlays at least a portion of the object, as perceived via the transparent surface, obscures at least a portion of the content included on the object in the environment with augmented reality content generated by the augmented reality display system.

[0040] As shown in FIG. 3A-B, vehicle 300 in which occupant 310 is located includes a transparent surface 320 and an external sensor 340 which monitors 342 one or more portions of environment 390 in which vehicle 300 is located, including a roadway 392 along which the vehicle 300 is navigated. Based on sensor data representations of the monitored environment, which are generated by the sensors 340, an augmented reality display system included in vehicle 300 can identify one or more objects located in the environment 390, including a roadway 392 and road signs 350, 370. Based on processing the sensor data, the augmented reality display system can identify content 352, 372, 374 presented on the signs. For example, the system can identify sign 350 as a speed limit sign and further identify that content 352 presented on the sign 350 includes a local speed limit of roadway 392, and the system can further identify sign 370 as a distance indication sign and further identify that content 372 presented on the sign includes an indication of a distance to a particular landmark and that content 374 presented on the sign includes an indication of a distance to another particular landmark.

[0041] In some embodiments, the augmented reality system included in vehicle 300 generates an augmented reality display, on surface 320, which includes display elements 360, 380 which overlay and conform to one or more boundaries of one or more particular portions of particular objects 350, 370 in the environment 390.

[0042] The display elements can be selectively generated, and can include content selectively generated by the augmented reality display system, based on monitoring one or more of personal data associated with the occupant, a driving route along which the vehicle is being navigated, the environment 390, etc. For example, the augmented reality display system can determine, based on monitoring environmental conditions via sensors 340, that environmental conditions, that environmental conditions are associated with an adjustment to the local speed limit. Where the present environmental conditions are determines to include a rainstorm, for example, the augmented reality system can determine, based on comparing the determined environmental condition with a database of speed limit adjustments and associated environmental conditions, that the local speed limit is to be adjusted downwards by 5 mph. As a result, the augmented reality display system can generate a display element 360 which is perceived by occupant 310 to overlay and conform to the dimensions, boundaries, etc. of the content-including portion of sign 350 and includes content 362 which includes a local speed limit which is adjusted from the speed limit 352 actually included on sign 350 in accordance with the detected environmental condition. The display element 360 can provide a representation of the sign 350 which overlays the portion of the sign 350 which includes content 352, so that the content 352 is obscured and content 362 is visible when the sign 350 is perceived via the augmented reality display presented on surface 320.

[0043] In another example, shown in FIG. 3B, the augmented reality display system can process distance information presented on sign 370 and compare the information 372, 374 with a driving route along which the vehicle 300 is being navigated. The augmented reality display system can generate one or more display elements which selectively highlight one or more indicated landmarks, directions, etc., selectively obscure one or more indicated landmarks, directions, etc. based on the driving route. In some embodiments, the system can translate content presented on a sign into another language, including a language associated with one or more of the vehicle, an occupant included in the vehicle, personal data associated with an occupant included in the vehicle, etc., and generate a display element which overlays the content and provides a translated version of the content on the sign.

[0044] As shown in FIG. 3B, based on a determination that content 372 is associated with the present driving route along which the vehicle 300 is being navigated, for example, a destination of the driving route, a checkpoint along the driving route, some combination thereof, etc., the augmented reality display system included in vehicle 300 can generate a display element 380 which has a particular size, shape, and position on surface 320 to cause the element 380, when perceived by occupant 310 via surface 320, to overlay and conform to a portion of sign 370 on which content 374 which is unrelated to the driving route is displayed, so that the element 380 obscures the unrelated content 374 so that the perceived content on the sign 370 is restricted to the relevant content 372.

[0045] In some embodiments, based on a determination that one or more instances of content on the 370 is related to a driving route along which the vehicle 300 is being navigated, the augmented reality display system can generate a display element which highlights one or more instances of content displayed on a sign in the environment.

[0046] Display elements presented on surface 320 as part of the augmented reality display on surface 320 can be generated based on sensor data generated by sensors 340, where the display elements are adjusted based on the dynamic relative positions of the objects 350, 370 to vehicle 300, so that the display elements 360, 380 are perceived to remain conformed to the objects 350, 370 as the vehicle changes position relative to the objects.

[0047] In some embodiments, the augmented reality display system generated display elements on surface 320 based on personal data associated with occupant 310. For example, the display system can determine, based on processing sensor data representations of sign 370, that content 372 indicates a landmark which is a commonly-navigated destination associated with personal data of the occupant 310. As a result, the augmented reality display system can provide an augmented reality display of the environment 390 which is relevant to the occupant’s 310 interests.

[0048] Users can selectively block use of, or access to, personal data. A system incorporating some or all of the technologies described herein can include hardware and/or software that prevents or blocks access to such personal data. For example, the system can allow users to “opt in” or “opt out” of participation in the collection of personal data or portions of portions thereof. Also, users can select not to provide location information, or permit provision of general location information (e.g., a geographic region or zone), but not precise location information.

[0049] Entities responsible for the collection, analysis, disclosure, transfer, storage, or other use of such personal data should comply with established privacy policies and/or practices. Such entities should safeguard and secure access to such personal data and ensure that others with access to the personal data also comply. Such entities should implement privacy policies and practices that meet or exceed industry or governmental requirements for maintaining the privacy and security of personal data. For example, an entity should collect users’ personal data for legitimate and reasonable uses, and not share or sell the data outside of those legitimate uses. Such collection should occur only after receiving the users’ informed consent. Furthermore, third parties can evaluate these entities to certify their adherence to established privacy policies and practices.

[0050] FIG. 4A-B illustrate a vehicle comprising a transparent surface which provides an augmented reality display which includes a display element which provides a representation of a static object in the environment which is presently obscured from direct view through the transparent surface of the vehicle, according to some embodiments. The representation can include a three-dimensional representation of the static object in the environment. The vehicle and transparent surface illustrated in FIG. 4A-B can be included in any of the embodiments of vehicles and transparent surfaces included herein.

[0051] In some embodiments, an augmented reality display system generates an augmented reality display, on a transparent surface, which includes display elements providing representations of objects, in an environment perceivable via the transparent surface, which are at least partially obscured from direct observation via the transparent surface.

[0052] In some embodiments, the augmented reality display system included in a vehicle 410 navigating along a roadway 400 through environment 490 receives information regarding various static objects, including one or more structures, signs, landmarks, plants, etc., in the environment 490, via a communication link 452 with a remotely located system 450. The information can include location information, dimensions, etc. associated with an object. For example, where environment 490 includes static object 430 located adjacent to roadway 400, information indicating the location and dimensions of object 430 can be received at vehicle 410 via link 452.

[0053] In some embodiments, the augmented reality display system included in vehicle 410 determines a blind spot 440 associated with sensor data representations of the environment 490 which are generated by sensor devices included in the vehicle 410, based on a presence of one or more various objects, including the illustrated vehicle 420, in the environment. In some embodiments, based on a determination that a dynamic object 420 is at least partially obscuring perception of a static object 430 via a transparent surface 480 in the vehicle 410, the augmented reality display system included in the vehicle can generate an augmented reality display which includes display elements 492-496 which comprise representations of the position and boundaries of one or more portions of one or more obscured elements in the environment 492, including an element 492 which indicates at least a portion of the obscured static object 430. As also shown in FIG. 4B, the display elements presented via the transparent surface 480 can include representations of portions 494-496 of the roadway which are obscured by object 420.

[0054] In some embodiments, the augmented reality display system selectively generates display elements 492 which comprise representations of one or more of a position, boundary, etc. of at least a portion of an obscured static object in the environment based on a determination that the static object is associated with one or more of a driving route along which the vehicle is being navigated, one or more instances of personal data associated with one or more of the occupants of the vehicle 410, some combination thereof, etc.

[0055] FIG. 5A-B illustrate a vehicle comprising a transparent surface which provides an augmented reality display which provides a representation of at least one dynamic object in the environment which is presently obscured from direct view through the transparent surface of the vehicle, according to some embodiments. The vehicle and transparent surface illustrated in FIG. 5A-B can be included in any of the embodiments of vehicles and transparent surfaces included herein.

[0056] In some embodiments, an augmented reality display system included in a vehicle 510 navigating through an environment 590 which includes a roadway can generate, on a transparent surface 580 included in the vehicle 510, an augmented reality display element 596 which represents a position and dimension of a dynamic element 530, in the environment 590, which is at least partially obscured 560 from monitoring by vehicle 510 by another dynamic element 520 in the environment 590.

[0057] In some embodiments, the augmented reality display system receives information associated with the obscured object 530, including sensor data representations of the object 530, based on communication with one or more of a remote system 550 via a communication link 552, vehicle-to-vehicle (“V2V”) communication with one or more vehicles 520, 540 which can directly monitor the object 530 via links 553, etc. The augmented reality display system can generate the augmented reality display elements 592-596, including the element 596 which indicates a position and dimensions of the dynamic element 430 in the environment, based on information received from one or more of the vehicles 520, 540, systems 550, etc.

[0058] FIG. 6A-B illustrate a vehicle comprising a transparent surface which provides an augmented reality display which provides a dynamically controllable representation of a driving route along which a vehicle is being navigated, according to some embodiments. The vehicle and transparent surface illustrated in FIG. 6A-B can be included in any of the embodiments of vehicles and transparent surfaces included herein.

[0059] In some embodiments, an augmented reality display system included in a vehicle generates an augmented reality display, on one or more transparent surfaces of the vehicle, which includes display elements which comprise a representation of a driving route along which the vehicle is being navigated. As referred to herein, a representation comprised by a display element can include a three-dimensional representation. The display elements can comprise representations of various navigation actions which can be executed by control elements of the vehicle, including braking, accelerating, turning, etc.

……
……
……