Meta Patent | Optical devices and methods for adjustable light attenuation based on electrochromism

In some embodiments, the medium 220 includes three layers, namely the first layer 214 containing electrochromic material, the second layer 216, and a third layer 212. In some embodiments, the third layer 212 is an ion-storage layer. The ion-storage layer may store cations, such as protons or lithium ions, to facilitate electrochromic operations. In some embodiments, the ion-storage layer includes nickel oxide (NiO), iron oxide (IrO₂), or vanadium oxide (V₂O₅), or any combination thereof. In some embodiments, the third layer 212 includes electrochromic material (e.g., nickel oxide (NiO), iridium oxide (IrO₂), or rhodium oxide (Rh₂O₃), or any combination thereof). As seen from these examples, some of the materials used for the ion-storage layer also have electrochromic properties.

In some embodiments, the second layer 216 includes an electrolyte. The electrolyte facilitates the function of the second layer 216 as the ion-conductor layer. In some embodiments, the second layer 216 includes solid electrolyte, such as tantalum oxide (Ta₂O₅) or zirconium oxide (ZrO₂), or non-solid electrolyte, such as gel electrolyte (e.g., containing ethylene carbonate, propylene carbonate, etc.), or a combination thereof.

In some embodiments, the medium 220 includes liquid crystals 222. For example, in some embodiments, as shown in FIG. 1A, the first layer 214 includes the liquid crystals 222. In some embodiments, the liquid crystals 222 are or include nematic liquid crystals (e.g., 4-cyano-4′-pentylbiphenyl, 4-pentyl-4′-cyanobiphenyl, HTW106700-100, or HFW59200-200). In some embodiments, the liquid crystals 222 are or include twist-bend chiral nematic liquid crystals. In some embodiments, the liquid crystals 222 are or include polymer dispersed liquid crystals. In some embodiments, the liquid crystals 222 are coupled with the electrochromic materials (e.g., electrochromic dye-doped liquid crystal). In some cases, the coupling of the electrochromic materials 224 with the liquid crystals 222 facilitates adjustment of the electrochromic materials 224 by adjusting the orientation of the liquid crystals 222. In some embodiments, the second layer 216 or the third layer 212 includes liquid crystals.

In some embodiments, the medium 220 includes polymer stabilizers 226. In some embodiments, the first layer 214 includes the polymer stabilizers 226. In some embodiments, as shown in FIG. 1A, the polymer stabilizers 226 improve stability of the medium 220 and slow weathering from ultraviolet radiation. In some embodiments, the second layer 216 or the third layer 212 includes polymer stabilizers.

In some embodiments, the medium 220 includes dopants 228. In some embodiments, the first layer 214 includes the dopants 228. In some embodiments, the second layer 216 or the third layer 212 includes dopants 228. In some embodiments, the dopants include chiral dopants. In some embodiments, the dopants include dye dopants.

In some embodiments, the liquid crystals 222 include liquid crystalline nanoparticles (e.g., liquid crystal nanodroplets or liquid crystal nanoemulsions). In some embodiments, the liquid crystal nanodroplets include droplets of nematic liquid crystals in polymers (also called polymer dispersed liquid crystals or PDLC). In some embodiments, the liquid crystalline nanoparticles include a mixture of liquid crystals and nanoparticles. In some embodiments, the nanoparticles are ferroelectric, ferromagnetic, or ferroic.

In some embodiments, the medium 220 includes ionic liquid crystal elastomers. Ionic liquid crystal elastomers refer to at least partially crosslinked crystalline polymer networks (e.g., polymer network 232 shown in FIG. 2). In some embodiments, the liquid crystal elastomers include a polymer with mesogens in the polymer chain. In some embodiments, the liquid crystal elastomers include mesogens attached via side chains (e.g., alkyl spacer).

In some embodiments, the liquid crystals 222 include ionic liquid crystals. In some embodiments, the ionic liquid crystals include thermotropic ionic liquid crystals, polymeric ionic liquid crystals, or lyotropic ionic liquid crystals. Ionic liquid crystals generally have solvation and conductive properties similar to those of ionic liquid while containing liquid crystals.

In some embodiments, the optical device is electrically coupled with an electrical source 260. The electrical source 260 may provide a voltage or current to the optical device (e.g., across or between the first electrode 210 and the second electrode 230). For example, in some embodiments, the first electrode 210 and the second electrode 230 are electrically coupled with the electrical source 260. In some embodiments, the optical device includes the electrical source 260. In some embodiments, the electrical source 260 is not part of the optical device.

As shown in FIGS. 1A and 1B, in some embodiments, the electrical source 260 includes one or more voltage sources 262 and 264. In some embodiments, the electrical source 260 includes one or more current sources 266. In some embodiments, the electrical source 260 includes one or more voltage sources 262 and 264 and one or more current sources 266. In some embodiments, the electrical source 260 includes one or more voltage sources 262 and 264 without one or more current sources 266. In some embodiments, the electrical source 260 includes one or more current sources 266 without one or more voltage sources 262 and 264.

In some embodiments, the electrical source 260 includes an electrical power storage (e.g., a battery or a capacitor).

As shown in FIGS. 1A and 1B, in some embodiments, the one or more current sources 266 are electrically connected in parallel to one or more impedances 268 (e.g., resistors). In some embodiments, one or more current sources are electrically connected in parallel.

As shown in FIGS. 1A and 1B, in some embodiments, the one or more voltage sources 262 and 264 are electrically connected in parallel (e.g., the voltage source 262 is electrically connected in parallel to the voltage source 264). In some embodiments, the one or more voltage sources 262 and 264 are electrically connected in series. In some embodiments, the one or more voltage sources 262 and 264 include a direct-current voltage source. In some embodiments, the one or more voltage sources 262 and 264 include an alternating-current voltage source (or a dynamic voltage source that provides voltages in a non-sinusoidal pattern). In some embodiments, the one or more voltage sources 262 and 264 include both a direct-current voltage source and an alternating-current voltage source (or a dynamic voltage source).

In some embodiments, the electrical source 260 provides a first electrical input V1 (e.g., a zero-voltage input or an electrical input below a predefined electrical threshold, such as a voltage threshold) across the first electrode 210 and the second electrode 230 at a first time (e.g., while the optical device is in a first mode 100A of operation as shown in FIG. 1A). Such electrical input does not cause rearrangement of molecules or structures within the medium 220. As a result, the optical device may have a first set of optical properties (e.g., low transmittance spectrum for visible wavelengths).

In some embodiments, the electrical source 260 provides a second electrical input V2 (e.g., a non-zero voltage input or an electrical input above the predefined electrical threshold, such as the voltage threshold) across the first electrode 210 and the second electrode 230 at a second time (e.g., while the optical device is in a second mode 100B of operation as shown in FIG. 1B). Such electrical input causes rearrangement of molecules or structures within the medium 220. As a result, the optical device may have a second set of optical properties (e.g., high transmittance spectrum for visible wavelengths) distinct from the first set of optical properties.

For example, the optically dimmable filter can provide (i) a first transmittance (e.g., a low transmittance, such as 0%, 0.1%, 1%, 2%, 3%, 4%, 5%, 10%, 15%, 20%, 25%, 30%, 35%, 40%, 45%, or 49%, or within any interval between any two of the aforementioned values) while the optically dimmable filter or the optical device is in the first state and (ii) a second transmittance (e.g., a high transmittance, such as 100%, 99.9%, 99%, 98%, 97%, 96%, 95%, 90%, 85%, 80%, 75%, 70%, 65%, 60%, 55%, or 50%, or within an interval between any two of the aforementioned values) while the optically dimmable filter or the optical device is in the second state. In some embodiments, the first transmittance is a first total transmittance. In some embodiments, the second transmittance is a second total transmittance.

Although FIGS. 1A and 1B represent two modes of operation for the optical device (e.g., an “on” state and an “off” state or vice versa), in some embodiments, the opaqueness of the optical device (or the optically dimmable filter) may be switched to three or more distinct states (e.g., low or no opaqueness, medium opaqueness, and high opaqueness).

FIGS. 3A and 3B are schematic diagrams illustrating an optical device 300 with an actuator 310 in accordance with some embodiments.

The optical device 300 is similar to the optical device 200 except that the optical device 300 includes one or more actuators 310 coupled (directly or indirectly) with the electrodes 210 and 230 for adjusting a distance between the electrodes 210 and 230. In some embodiments, as shown in FIGS. 3A and 3B, the actuator 310 is electrically coupled with an electrical controller 320, which provides electrical signals to the actuator 310 for adjusting the distance between the electrodes 210 and 230. Because the absorbance (or transmittance) of the optical device 300 depends at least partially on the thickness of the medium 220, adjusting the thickness of the medium 220 by the one or more actuators 310 also changes the absorbance (or transmittance) of the optical device 300. In some embodiments, the actuator 310 includes, or is, a piezoelectric actuator. In some embodiments, the actuator 310 includes, or is, an electromagnetic actuator (e.g., an actuator that includes an electromagnetic coil for generating an electromagnetic field to move one or more components). In some embodiments, the actuator 310 includes a rotary or linear motor (e.g., an electrical motor). In some embodiments, the actuator 310 includes, or is, a thermal actuator.

FIG. 3A illustrates the optical device 300 in a mode 300A where the electrode 210 and the electrode 230 are separated by a distance D1, and FIG. 3B illustrates the optical device 300 in a mode 300B where the electrode 210 and the electrode 230 are separated by a distance D2 less than D1. In transitioning from the mode 300A to the mode 300B, the actuator 310 moves the electrode 210 (and the substrate 240) and/or the electrode 230 (and the substrate 250) so that the distance between the electrode 210 and the electrode 230 decreases from D1 to D2. By reducing the thickness of the medium 220, the optical device 300 has a lower absorbance and a higher transmittance. Thus, reducing the distance between the electrode 210 and the electrode 230 further reduces the transition time in shifting from an opaque state to a transparent state. In transitioning from the mode 300B to the mode 300A, the actuator 310 moves the electrode 210 (and the substrate 240) and/or the electrode 230 (and the substrate 250) so that the distance between the electrode 210 and the electrode 230 increases from D2 to D1. By increasing the thickness of the medium 220, the optical device 300 has a higher absorbance and a lower transmittance. Thus, increasing the distance between the electrode 210 and the electrode 230 further reduces the transition time in shifting from the transparent state to the opaque state.

Although FIGS. 3A and 3B do not show the electrical source 260 shown in FIGS. 1A and 1B, in some embodiments, the optical device 300 is coupled with, or includes, the electrical source 260. In addition, the modes 300A and 300B are not mutually exclusive to the modes 100A and 100B described with respect to FIGS. 1A and 1B. For example, the optical device may be in both modes 100A and 300A concurrently (e.g., the increased thickness of the medium 220 associated with mode 300A may increase the absorbance of the optical device while in mode 100A), and the optical device may be in both modes 100B and 300B concurrently (e.g., the reduced thickness of the medium 220 associated with mode 300B may decrease the absorbance of the optical device while in mode 100B). Similarly, the optical device may be in both modes 100A and 300B concurrently, or in both modes 100B and 300A concurrently.

FIGS. 4A and 4B are schematic diagrams illustrating is a schematic diagram illustrating one or more electrodes on substrates in accordance with some embodiments.

FIG. 4A illustrates a substrate 400 (corresponding to the substrate 240 or 250) a planar surface of which is entirely covered by an electrode 410. The top portion of FIG. 4A illustrates a plan view of the substrate 400 and the electrode 410 and the bottom portion of FIG. 4A illustrates a cross-sectional view of the substrate 400 and the electrode 410 (taken from a plane indicated by the dashed line). In some embodiments, the electrode 410 absorbs a certain wavelength range of light (e.g., visible light). As a result, the electrode 410 has a color tint, which may be perceived by a user, even when the optical device is in a transparent state.

FIG. 4B illustrates the substrate 400 with electrodes 420-1, 420-2, and 420-3 which cover only a subset, less than all, of the planar surface of the substrate 400. The top portion of FIG. 4B illustrates a plan view of the substrate 400 and the electrodes 420-1, 420-2, and 420-3 and the bottom portion of FIG. 4A illustrates a cross-sectional view of the substrate 400 and the electrodes 420-1, 420-2, and 420-3 (taken from a plane indicated by the dashed line). Because the electrodes 420-1, 420-2, and 420-3 cover only a portion of the substrate 400, the absorption by the electrodes 420-1, 420-2, and 420-3 is less than that by the electrode 410 shown in FIG. 4A. This reduces the color tint associated with an optically dimmable filter. In some embodiments, a respective electrode of the electrodes 420-1, 420-2, and 420-3 has a width of 1μ, 2 μm, 3μ, 4 μm, 5 μm, 6 μm, 7μ, 8 μm, 9μ, 10μ, 11 μm, 12 μm, 13 μm, 14 μm, 15 μm, 16 μm, 17 μm, 18 μm, 19 μm, 20 μm, 25 μm, 30 μm, 35 μm, 40 μm, 45 μm, 50 μm, or within an interval between any two of the forementioned distances. In some embodiments, the respective electrode has a width greater than 50 μm.

FIGS. 5A and 5B are schematic diagrams illustrating optical devices in accordance with some embodiments. In FIGS. 5A and 5B, optical devices are illustrated in exploded views to show components of such optical devices with clarity.

The optical devices shown in FIGS. 5A and 5B include a first transparent electrode 510, a second transparent electrode 570, and a medium 520.

FIG. 5A shows an optical device 500A with a single first optically dimmable filter, which corresponds to an optical device 200 or 300 described with respect to FIGS. 1A-1B, 2, and 3A-3B, in accordance with some embodiments. The single first optically dimmable filter includes the first transparent electrode 510, the second transparent electrode 570 and the medium 520. In some embodiments, the sandwiched structure of the medium 520 between the two transparent electrodes (e.g., first transparent electrode 510 and the second transparent electrode 570) encompasses the entire display region for the augmented reality device. Uniform modulation of the optical properties associated with the display of the optical device with the single first optically dimmable filter is achievable when the first optically dimmable filter extends across a surface of the entire display region.

This allows the first optically dimmable filter to adjust the optical properties (e.g., transmittance) across an aperture of the optical device. For example, the optical properties of the optical device may be uniform across the entire aperture of the optical device.

In some other embodiments, the sandwiched medium 520 along with the two transparent electrodes can encompass only a portion of the display region for the optical device. This allows the first optically dimmable filter to adjust the optical properties (e.g., transmittance) across the portion of the aperture of the optical device. For example, the transmittance of the optical device will not be uniform across the entire aperture of the optical device. In some embodiments, the first optically dimmable filter extends substantially (e.g., at least 70%, 80%, 90%, or 95% but less than 100%) across a surface of the entire display region.

FIG. 5B shows an optical device 500B, which includes an array of optically dimmable filters (e.g., corresponding to electrodes 510-1 and 510-2). Each dimmable filter may correspond to an optical device 200 or 300 described with respect to FIGS. 1A-1B, 2, and 3A-3B, in accordance with some embodiments. This allows the optical device 500B to adjust the optical properties for only a portion, less than all, of the aperture of the optical device. For example, an optically dimmable filter corresponding to the electrode 510-1 may be turned on while the optically dimmable filter corresponding to the electrode 510-2 may be turned off so that regions corresponding to the optically dimmable filter corresponding to the electrode 510-1 and the optically dimmable filter corresponding to the electrode 510-2 have different optical properties (e.g., transmittances). In some embodiments, respective optically dimmable filters in the array of optically dimmable filters are independently activatable (e.g., a particular optically dimmable filter may be turned on or off independently of whether the rest of the optically dimmable filters are turned on or off).

In some embodiments, a first voltage is provided to the optically dimmable filter corresponding to the electrode 510-1 while the optically dimmable filter corresponding to the electrode 510-1 is turned on and a second voltage, distinct from the first voltage, is provided the optically dimmable filter corresponding to the electrode 510-2 while the optically dimmable filter corresponding to the electrode 510-2 is turned on. This provides for different degrees of opaqueness (or transparency) that are controllable simultaneously and independently across at least a portion of the display region of the optical device.

In some embodiments, the array of optically dimmable filters are arranged as pixels across the aperture of the optical device. In some embodiments, each pixel has a shape of a square having a size of 1 mm×1 mm, although the pixel may have a different size or shape (e.g., the pixel may be bigger or smaller, wider or narrower, taller or shorter, and may have a square shape, a non-square rectangular shape, or any other shape).

Although FIGS. 5A and 5B illustrate optical devices with a single layer of one or more optically dimmable filters, in some embodiments, the optical device includes a stack of two or more optically dimmable filter layers.

FIGS. 6A and 6B are schematic diagrams illustrating cross-sectional views of optical devices in accordance with some embodiments.

As described above, the thickness of the medium affects the optical properties of an optical device that includes electrochromic material or liquid crystals. Thus, in some configurations, it is important to control the thickness of the medium (which is often located between two electrodes).

FIG. 6A illustrates a cross-sectional view of an optical device in accordance with some embodiments. The optical device includes an electrode 610 located on a substrate 640 and an electrode 630 located on a substrate 650. Located between the electrodes 610 and 630 is a medium 620 that includes electrochromic material (e.g., electrochromic gel) and/or liquid crystals. The distance between the electrodes 610 and 630 is determined by spacers 660 and 670. In some embodiments, a respective spacer has a shape of a ball, rod, fiber, pedestal (e.g., a substantially rectangular prism), or pyramid.

In some embodiments, the spacer 660 and the spacer 670 have the same thickness (leading to the substrate 640 and the substrate 650 in parallel positions). In some embodiments, as shown in FIG. 6A, the spacer 660 and the spacer 670 have distinct thicknesses (leading to the substrate 640 and the substrate 650 in non-parallel positions). The non-parallel placement of the substrates 640 and 650 provide different thicknesses along the length of the optical device, providing a gradient tint.

In some embodiments, the spacers 660 and 670 are static spacers (e.g., spacers that do not change their thicknesses significantly, for example less than 10%, 9%, 8%, 7%, 6%, 5%, 4%, 3%, 2%, or 1%). In some embodiments, at least one active spacer (e.g., a spacer that changes its thickness significantly, for example by at least 10%, 20%, 30%, 40%, 50%, 60%, 70%, 80%, 90%, or 100%) is used in place of the spacer 660 or the spacer 670.

FIG. 6B illustrates a cross-sectional view of an optical device, which is similar to the optical device illustrated in FIG. 6A, except that the optical device illustrated in FIG. 6B includes adjustable spacers 680 and 690 (also called active spacers) instead of spacers 660 and 670.

In some embodiments, the adjustable spacer 680 or 690 is configured to change its thickness in response to a change in a temperature. For example, in some embodiments, the adjustable spacer 680 or 690 includes a material having a large coefficient of thermal expansion (e.g., greater than 10×10⁻⁶/° C.). An adjustable spacer with a material having a large coefficient of thermal expansion may be controlled by changing its temperature (e.g., using a heater and/or cooler).

In some embodiments, the adjustable spacer 680 or 690 is configured to change its thickness in response to an incoming light. For example, in some embodiments, the adjustable spacer 680 or 690 includes a material that can change its size in response to light (e.g., BiFeO₃ crystals or metal halide perovskite films).

In some embodiments, the adjustable spacer 680 or 690 is configured to change its thickness in response to a change in an electrical field. In some embodiments, the adjustable spacer 680 or 690 is configured to change its thickness in response to a change in a magnetic field. For example, in some embodiments, the adjustable spacer 680 or 690 includes a structure that changes its size in response to an electric field or a magnetic field (e.g., a magnetic actuator that includes a magnet or an electromagnetic coil, or an electrostatic actuator that includes a charge plate). By changing heat, light, or electric or magnetic field provided to the optical device, the adjustable spacer 680 or 690 changes its thickness, thereby changing the optical properties of the optical device (e.g., lowering the absorbance by reducing the distance between the electrodes or increasing the absorbance by increasing the distance between the electrodes).

FIGS. 6C-6E illustrate changing tint gradients in accordance with some embodiments. By adjusting the thicknesses of the adjustable spacers 680 and 690, the gradient of the tint can change (e.g., the direction of tint and/or the degree of tint).

In some embodiments, optical devices described with respect to FIGS. 1A-1B, 2, 3A-3B, 5A-5B, and 6A-6B are used in display devices such as head-mounted display devices. In some embodiments, such optical devices may be implemented as multifunctional optical components in near-eye displays for augmented reality (“AR”), virtual reality (“VR”), and/or mixed reality (“MR”). For example, the disclosed optical elements or devices may be implemented as optical dimming elements (e.g., variable intensity filters), etc., which may significantly reduce the weight and size, and enhance the optical performance of the head-mounted display devices. Example embodiments of head-mounted display devices for implementing such optical devices are described with respect to FIGS. 7-9.

FIG. 7 illustrates display device 700 in accordance with some embodiments. In some embodiments, display device 700 is configured to be worn on a head of a user (e.g., by having the form of spectacles or eyeglasses, as shown in FIG. 7) or to be included as part of a helmet that is to be worn by the user. When display device 700 is configured to be worn on a head of a user or to be included as part of a helmet, display device 700 is called a head-mounted display or a wearable display. Alternatively, display device 700 is configured for placement in proximity of an eye or eyes of the user at a fixed location, without being head-mounted (e.g., display device 700 is mounted in a vehicle, such as a car or an airplane, for placement in front of an eye or eyes of the user). As shown in FIG. 7, display device 700 includes display 710. Display 710 is configured for presenting visual contents (e.g., augmented reality contents, virtual reality contents, mixed reality contents, or any combination thereof) to a user.

In some embodiments, display device 700 includes one or more components described herein with respect to FIG. 8. In some embodiments, display device 700 includes additional components not shown in FIG. 8.

FIG. 8 is a block diagram of system 800 in accordance with some embodiments. The system 800 shown in FIG. 8 includes display device 805, imaging device 835, and input interface 840 that are each coupled to console 810. While FIG. 8 shows an example of system 800 including one display device 805, imaging device 835, and input interface 840, in other embodiments, any number of these components may be included in system 800. For example, there may be multiple display devices 805 each having associated input interface 840 and being monitored by one or more imaging devices 835, with each display device 805, input interface 840, and imaging devices 835 communicating with console 810. In alternative configurations, different and/or additional components may be included in system 800. For example, in some embodiments, console 810 is connected via a network (e.g., the Internet or a wireless network) to system 800 or is self-contained as part of display device 805 (e.g., physically located inside display device 805). In some embodiments, display device 805 is used to create mixed reality by adding in a view of the real surroundings. Thus, display device 805 and system 800 described here can deliver augmented reality, virtual reality, and mixed reality.

In some embodiments, as shown in FIG. 7, display device 805 is a head-mounted display that presents media to a user. Examples of media presented by display device 805 include one or more images, video, audio, or some combination thereof. In some embodiments, audio is presented via an external device (e.g., speakers and/or headphones) that receives audio information from display device 805, console 810, or both, and presents audio data based on the audio information. In some embodiments, display device 805 immerses a user in an augmented environment.

In some embodiments, display device 805 also acts as an augmented reality (AR) headset. In these embodiments, display device 805 augments views of a physical, real-world environment with computer-generated elements (e.g., images, video, sound, etc.). Moreover, in some embodiments, display device 805 is able to cycle between different types of operation. Thus, display device 805 operate as a virtual reality (VR) device, an augmented reality (AR) device, as glasses or some combination thereof (e.g., glasses with no optical correction, glasses optically corrected for the user, sunglasses, or some combination thereof) based on instructions from application engine 855.

Display device 805 includes electronic display 815, one or more processors 816, eye tracking module 817, adjustment module 818, one or more locators 820, one or more position sensors 825, one or more position cameras 822, memory 828, inertial measurement unit (IMU) 830, one or more optical elements 860 or a subset or superset thereof (e.g., display device 805 with electronic display 815, one or more processors 816, and memory 828, without any other listed components). Some embodiments of display device 805 have different modules than those described here. Similarly, the functions can be distributed among the modules in a different manner than is described here.

One or more processors 816 (e.g., processing units or cores) execute instructions stored in memory 828. Memory 828 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM or other random access solid state memory devices; and may include non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. Memory 828, or alternately the non-volatile memory device(s) within memory 828, includes a non-transitory computer readable storage medium. In some embodiments, memory 828 or the computer readable storage medium of memory 828 stores programs, modules and data structures, and/or instructions for displaying one or more images on electronic display 815.

Electronic display 815 displays images to the user in accordance with data received from console 810 and/or processor(s) 816. In various embodiments, electronic display 815 may comprise a single adjustable display element or multiple adjustable display elements (e.g., a display for each eye of a user). In some embodiments, electronic display 815 is configured to display images to the user by projecting the images onto one or more optical elements 860.

In some embodiments, the display element includes one or more light emission devices and a corresponding array of spatial light modulators. A spatial light modulator is an array of electro-optic pixels, opto-electronic pixels, some other array of devices that dynamically adjust the amount of light transmitted by each device, or some combination thereof. These pixels are placed behind one or more lenses. In some embodiments, the spatial light modulator is an array of liquid crystal based pixels in an LCD (a Liquid Crystal Display). Examples of the light emission devices include: an organic light emitting diode, an active-matrix organic light-emitting diode, a light emitting diode, some type of device capable of being placed in a flexible display, or some combination thereof. The light emission devices include devices that are capable of generating visible light (e.g., red, green, blue, etc.) used for image generation. The spatial light modulator is configured to selectively attenuate individual light emission devices, groups of light emission devices, or some combination thereof. Alternatively, when the light emission devices are configured to selectively attenuate individual emission devices and/or groups of light emission devices, the display element includes an array of such light emission devices without a separate emission intensity array. In some embodiments, electronic display 815 projects images to one or more reflective elements 860, which reflect at least a portion of the light toward an eye of a user.

One or more lenses direct light from the arrays of light emission devices (optionally through the emission intensity arrays) to locations within each eyebox and ultimately to the back of the user's retina(s). An eyebox is a region that is occupied by an eye of a user located proximity to display device 805 (e.g., a user wearing display device 805) for viewing images from display device 805. In some cases, the eyebox is represented as a 10 mm×10 mm square. In some embodiments, the one or more lenses include one or more coatings, such as anti-reflective coatings.

In some embodiments, the display element includes an infrared (IR) detector array that detects IR light that is retro-reflected from the retinas of a viewing user, from the surface of the corneas, lenses of the eyes, or some combination thereof. The IR detector array includes an IR sensor or a plurality of IR sensors that each correspond to a different position of a pupil of the viewing user's eye. In alternate embodiments, other eye tracking systems may also be employed. As used herein, IR refers to light with wavelengths ranging from 700 nm to 1 mm including near infrared (NIR) ranging from 750 nm to 1500 nm.

Eye tracking module 817 determines locations of each pupil of a user's eyes. In some embodiments, eye tracking module 817 instructs electronic display 815 to illuminate the eyebox with IR light (e.g., via IR emission devices in the display element).

A portion of the emitted IR light will pass through the viewing user's pupil and be retro-reflected from the retina toward the IR detector array, which is used for determining the location of the pupil. Alternatively, the reflection off of the surfaces of the eye is used to also determine location of the pupil. The IR detector array scans for retro-reflection and identifies which IR emission devices are active when retro-reflection is detected. Eye tracking module 817 may use a tracking lookup table and the identified IR emission devices to determine the pupil locations for each eye. The tracking lookup table maps received signals on the IR detector array to locations (corresponding to pupil locations) in each eyebox. In some embodiments, the tracking lookup table is generated via a calibration procedure (e.g., user looks at various known reference points in an image and eye tracking module 817 maps the locations of the user's pupil while looking at the reference points to corresponding signals received on the IR tracking array). As mentioned above, in some embodiments, system 800 may use other eye tracking systems than the embedded IR one described herein.

Adjustment module 818 generates an image frame based on the determined locations of the pupils. In some embodiments, this sends a discrete image to the display that will tile subimages together thus a coherent stitched image will appear on the back of the retina. Adjustment module 818 adjusts an output (i.e., the generated image frame) of electronic display 815 based on the detected locations of the pupils. Adjustment module 818 instructs portions of electronic display 815 to pass image light to the determined locations of the pupils. In some embodiments, adjustment module 818 also instructs the electronic display to not pass image light to positions other than the determined locations of the pupils. Adjustment module 818 may, for example, block and/or stop light emission devices whose image light falls outside of the determined pupil locations, allow other light emission devices to emit image light that falls within the determined pupil locations, translate and/or rotate one or more display elements, dynamically adjust curvature and/or refractive power of one or more active lenses in the lens (e.g., microlens) arrays, or some combination thereof.

Optional locators 820 are objects located in specific positions on display device 805 relative to one another and relative to a specific reference point on display device 805. A locator 820 may be a light emitting diode (LED), a corner cube reflector, a reflective marker, a type of light source that contrasts with an environment in which display device 805 operates, or some combination thereof. In embodiments where locators 820 are active (e.g., an LED or other type of light emitting device), locators 820 may emit light in the visible band (e.g., about 500 nm to 750 nm), in the infrared band (e.g., about 750 nm to 1 mm), in the ultraviolet band (about 100 nm to 500 nm), some other portion of the electromagnetic spectrum, or some combination thereof.

In some embodiments, locators 820 are located beneath an outer surface of display device 805, which is transparent to the wavelengths of light emitted or reflected by locators 820 or is thin enough to not substantially attenuate the wavelengths of light emitted or reflected by locators 820. Additionally, in some embodiments, the outer surface or other portions of display device 805 are opaque in the visible band of wavelengths of light. Thus, locators 820 may emit light in the IR band under an outer surface that is transparent in the IR band but opaque in the visible band.

IMU 830 is an electronic device that generates calibration data based on measurement signals received from one or more position sensors 825. Position sensor 825 generates one or more measurement signals in response to motion of display device 805. Examples of position sensors 825 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of IMU 830, or some combination thereof. Position sensors 825 may be located external to IMU 830, internal to IMU 830, or some combination thereof.

Based on the one or more measurement signals from one or more position sensors 825, IMU 830 generates first calibration data indicating an estimated position of display device 805 relative to an initial position of display device 805. For example, position sensors 825 include multiple accelerometers to measure translational motion (forward/back, up/down, left/right) and multiple gyroscopes to measure rotational motion (e.g., pitch, yaw, roll). In some embodiments, IMU 830 rapidly samples the measurement signals and calculates the estimated position of display device 805 from the sampled data. For example, IMU 830 integrates the measurement signals received from the accelerometers over time to estimate a velocity vector and integrates the velocity vector over time to determine an estimated position of a reference point on display device 805. Alternatively, IMU 830 provides the sampled measurement signals to console 810, which determines the first calibration data. The reference point is a point that may be used to describe the position of display device 805. While the reference point may generally be defined as a point in space; however, in practice the reference point is defined as a point within display device 805 (e.g., a center of IMU 830).

In some embodiments, IMU 830 receives one or more calibration parameters from console 810. As further discussed below, the one or more calibration parameters are used to maintain tracking of display device 805. Based on a received calibration parameter, IMU 830 may adjust one or more IMU parameters (e.g., sample rate). In some embodiments, certain calibration parameters cause IMU 830 to update an initial position of the reference point so it corresponds to a next calibrated position of the reference point. Updating the initial position of the reference point as the next calibrated position of the reference point helps reduce accumulated error associated with the determined estimated position. The accumulated error, also referred to as drift error, causes the estimated position of the reference point to “drift” away from the actual position of the reference point over time.

Imaging device 835 generates calibration data in accordance with calibration parameters received from console 810. Calibration data includes one or more images showing observed positions of locators 820 that are detectable by imaging device 835. In some embodiments, imaging device 835 includes one or more still cameras, one or more video cameras, any other device capable of capturing images including one or more locators 820, or some combination thereof. Additionally, imaging device 835 may include one or more filters (e.g., used to increase signal to noise ratio). Imaging device 835 is configured to optionally detect light emitted or reflected from locators 820 in a field of view of imaging device 835. In embodiments where locators 820 include passive elements (e.g., a retroreflector), imaging device 835 may include a light source that illuminates some or all of locators 820, which retro-reflect the light towards the light source in imaging device 835. Second calibration data is communicated from imaging device 835 to console 810, and imaging device 835 receives one or more calibration parameters from console 810 to adjust one or more imaging parameters (e.g., focal length, focus, frame rate, ISO, sensor temperature, shutter speed, aperture, etc.).

In some embodiments, display device 805 optionally includes one or more optical elements 880 (e.g., lenses, reflectors, gratings, etc.). In some embodiments, electronic display device 805 includes a single optical element 860 or multiple optical elements 860 (e.g., an optical element 860 for each eye of a user). In some embodiments, electronic display 815 projects computer-generated images on one or more optical elements 860, such as a reflective element, which, in turn, reflect the images toward an eye or eyes of a user. The computer-generated images include still images, animated images, and/or a combination thereof. The computer-generated images include objects that appear to be two-dimensional and/or three-dimensional objects. In some embodiments, one or more optical elements 860 are partially transparent (e.g., the one or more optical elements 860 have a transmittance of at least 15%, 20%, 25%, 30%, 35%, 50%, 55%, or 50%), which allows transmission of ambient light. In such embodiments, computer-generated images projected by electronic display 815 are superimposed with the transmitted ambient light (e.g., transmitted ambient image) to provide augmented reality images.

In some embodiments, one or more optical elements 860, or a subset there of, are positioned to modify light (e.g., ambient light) transmitted to electronic display 815. For example, the one or more optical elements 860 may include an optical dimmer to selectively reduce the intensity of light passing through the optical dimmer. In some embodiments, optical elements 860 include an optical device described above with respect to FIGS. 1A-1B, 2, 3A-3B, 5A-5B, and 6A-6B.

Input interface 840 is a device that allows a user to send action requests to console 810. An action request is a request to perform a particular action. For example, an action request may be to start or end an application or to perform a particular action within the application. Input interface 840 may include one or more input devices. Example input devices include: a keyboard, a mouse, a game controller, data from brain signals, data from other parts of the human body, or any other suitable device for receiving action requests and communicating the received action requests to console 810. An action request received by input interface 840 is communicated to console 810, which performs an action corresponding to the action request. In some embodiments, input interface 840 may provide haptic feedback to the user in accordance with instructions received from console 810. For example, haptic feedback is provided when an action request is received, or console 810 communicates instructions to input interface 840 causing input interface 840 to generate haptic feedback when console 810 performs an action.

Console 810 provides media to display device 805 for presentation to the user in accordance with information received from one or more of: imaging device 835, display device 805, and input interface 840. In the example shown in FIG. 8, console 810 includes application store 845, tracking module 850, and application engine 855. Some embodiments of console 810 have different modules than those described in conjunction with FIG. 8. Similarly, the functions further described herein may be distributed among components of console 810 in a different manner than is described here.

When application store 845 is included in console 810, application store 845 stores one or more applications for execution by console 810. An application is a group of instructions, that when executed by a processor, is used for generating content for presentation to the user. Content generated by the processor based on an application may be in response to inputs received from the user via movement of display device 805 or input interface 840. Examples of applications include: gaming applications, conferencing applications, video playback application, or other suitable applications.

When tracking module 850 is included in console 810, tracking module 850 calibrates system 800 using one or more calibration parameters and may adjust one or more calibration parameters to reduce error in determination of the position of display device 805. For example, tracking module 850 adjusts the focus of imaging device 835 to obtain a more accurate position for observed locators on display device 805. Moreover, calibration performed by tracking module 850 also accounts for information received from IMU 830. Additionally, if tracking of display device 805 is lost (e.g., imaging device 835 loses line of sight of at least a threshold number of locators 820), tracking module 850 re-calibrates some or all of system 800.

In some embodiments, tracking module 850 tracks movements of display device 805 using second calibration data from imaging device 835. For example, tracking module 850 determines positions of a reference point of display device 805 using observed locators from the second calibration data and a model of display device 805. In some embodiments, tracking module 850 also determines positions of a reference point of display device 805 using position information from the first calibration data. Additionally, in some embodiments, tracking module 850 may use portions of the first calibration data, the second calibration data, or some combination thereof, to predict a future location of display device 805. Tracking module 850 provides the estimated or predicted future position of display device 805 to application engine 855.

Application engine 855 executes applications within system 800 and receives position information, acceleration information, velocity information, predicted future positions, or some combination thereof of display device 805 from tracking module 850. Based on the received information, application engine 855 determines content to provide to display device 805 for presentation to the user. For example, if the received information indicates that the user has looked to the left, application engine 855 generates content for display device 805 that mirrors the user's movement in an augmented environment. Additionally, application engine 855 performs an action within an application executing on console 810 in response to an action request received from input interface 840 and provides feedback to the user that the action was performed. The provided feedback may be visual or audible feedback via display device 805 or haptic feedback via input interface 840.

FIG. 9 is an isometric view of display device 900 in accordance with some embodiments. In some other embodiments, display device 900 is part of some other electronic display (e.g., a digital microscope, a head-mounted display device, etc.). In some embodiments, display device 900 includes light emission device 910 (e.g., a light emission device array) and an optical assembly 930, which may include one or more lenses and/or other optical components. In some embodiments, display device 900 also includes an IR detector array.

Light emission device 910 emits image light and optional IR light toward the viewing user. Light emission device 910 includes one or more light emission components that emit light in the visible light (and optionally includes components that emit light in the IR). Light emission device 910 may include, e.g., an array of LEDs, an array of microLEDs, an array of organic LEDs (OLEDs), an array of superluminescent LEDs (sLEDS) or some combination thereof.

In some embodiments, light emission device 910 includes an emission intensity array (e.g., a spatial light modulator) configured to selectively attenuate light emitted from light emission device 910. In some embodiments, the emission intensity array is composed of a plurality of liquid crystal cells or pixels, groups of light emission devices, or some combination thereof. Each of the liquid crystal cells is, or in some embodiments, groups of liquid crystal cells are, addressable to have specific levels of attenuation. For example, at a given time, some of the liquid crystal cells may be set to no attenuation, while other liquid crystal cells may be set to maximum attenuation. In this manner, the emission intensity array is able to provide image light and/or control what portion of the image light is transmitted. In some embodiments, display device 900 uses the emission intensity array to facilitate providing image light to a location of pupil 950 of eye 940 of a user, and minimize the amount of image light provided to other areas in the eyebox. In some embodiments, display device 900 includes, or is optically coupled with, electro-optic devices operating as a display resolution enhancement component. In some embodiments, display device 900 is an augmented reality display device. In such embodiments, display device 900 includes, or is optically coupled with, electro-optic devices operating as a waveguide-based combiner or as a polarization selective reflector.

In some embodiments, the display device 900 includes one or more lenses. The one or more lenses receive modified image light (e.g., attenuated light) from light emission device 910, and direct the modified image light to a location of pupil 950. The optical assembly may include additional optical components, such as color filters, mirrors, etc.

In some embodiments, the optical assembly 930 includes an optical device described above with respect to FIGS. 1A-1B, 2, 3A-3B, 5A-5B, and 6A-6B. The optical device has a variable transmittance (e.g., has a first transmittance curve at a first time and a second transmittance curve distinct from the first transmittance curve at a second time mutually exclusive from the first time). The optical device conditionally reduces intensity of light passing through the optical device. In some embodiments, the optical device has only a single window that has a uniform transmittance across the window at each time (e.g., the optical device operates as a single variable intensity filter). In some embodiments, the optical device has a plurality of regions, as shown in FIG. 9, where each region may have a transmittance independent of transmittances of other regions. For example, the optical device may include an array of the structure shown in any of FIGS. 1A-1B, 2, 3A-3B, and 6A-6B.

An optional IR detector array detects IR light that has been retro-reflected from the retina of eye 940, a cornea of eye 940, a crystalline lens of eye 940, or some combination thereof. The IR detector array includes either a single IR sensor or a plurality of IR sensitive detectors (e.g., photodiodes). In some embodiments, the IR detector array is separate from light emission device 910. In some embodiments, the IR detector array is integrated into light emission device 910.

In some embodiments, light emission device 910 including an emission intensity array make up a display element. Alternatively, the display element includes light emission device 910 (e.g., when light emission device 910 includes individually adjustable pixels) without the emission intensity array. In some embodiments, the display element additionally includes the IR array. In some embodiments, in response to a determined location of pupil 950, the display element adjusts the emitted image light such that the light output by the display element is refracted by one or more lenses toward the determined location of pupil 950, and not toward other locations in the eyebox.

In some embodiments, display device 900 includes one or more broadband sources (e.g., one or more white LEDs) coupled with a plurality of color filters, in addition to, or instead of, light emission device 910.

In light of these principles and examples, we now turn to certain embodiments.

In accordance with some embodiments, an optical device includes a first optically dimmable filter that includes: a first set of one or more electrodes (e.g., electrode 210); a second set of one or more electrodes (e.g., electrode 230) distinct and separate from the first set of one or more electrodes; and a medium (e.g., medium 220) located between the first set of one or more electrodes and the second set of one or more electrodes. The medium including one or more electrochromic materials (e.g., electrochromic materials 224) and liquid crystals (e.g., liquid crystals 222).

In some embodiments, the optical device includes one or more actuators (e.g., actuator 310) coupled with the first set of one or more electrodes (e.g., electrode 210) or the second set of one or more electrodes (e.g., electrode 230) for moving the first set of one or more electrodes or the second set of one or more electrodes to change a distance between the first set of one or more electrodes or the second set of one or more electrodes.

In some embodiments, the first optically dimmable filter also includes: a first substrate (e.g., substrate 240) positioned adjacently to the first set of one or more electrodes; and a second substrate (e.g., substrate 250) positioned adjacently to the second set of one or more electrodes. The second substrate is distinct and separate from the first substrate. The first set of one or more electrodes encompasses a subset, less than all, of a surface of the first substrate or the second set of one or more electrodes encompasses a subset, less than all, of a surface of the second substrate (e.g., FIG. 4B). In some embodiments, the first set of one or more electrodes encompasses a subset, less than all, of the surface of the first substrate and the second set of one or more electrodes encompasses a subset, less than all, of the surface of the second substrate.

In some embodiments, the optical device includes an array of optically dimmable filters, including the first optically dimmable filter. Respective optically dimmable filters of the array of optically dimmable filters are activatable independently of any other optically dimmable filters of the array of optically dimmable filters.

In some embodiments, the optical device includes an electrical source (e.g., electrical source 260) coupled with the first set of one or more electrodes (e.g., electrode 210) and the second set of one or more electrodes (e.g., electrode 230) for providing first electrical signals (e.g., sinusoidal signal, sawtooth wave signal, square wave signal, etc.) between the first set of one or more electrodes and the second set of one or more electrodes for activating the first optically dimmable filter or providing second electrical signals (e.g., zero-voltage signal) between the first set of one or more electrodes and the second set of one or more electrodes for deactivating the first optically dimmable filter. In some embodiments, the electrical source switches between providing the first electrical signals and providing the second electrical signals in less than 100 milliseconds.

In accordance with some embodiments, an optical device includes a first optically dimmable filter that includes: a first spacer (e.g., spacer 660) having a first thickness; a second spacer (e.g., spacer 670) having a second thickness distinct from the first thickness; a first set of one or more electrodes (e.g., electrode 610); a second set of one or more electrodes (e.g., electrode 630). The first set of one or more electrodes and the second set of one or more electrodes are separated by the first spacer and the second spacer (e.g., FIG. 6A). The first optically dimmable filter also includes a medium (e.g., medium 620) located between the first set of one or more electrodes and the second set of one or more electrodes. The medium includes one or more electro-optic materials. In some embodiments, the one or more electro-optic materials include one or more electrochromic materials. In some embodiments, the one or more electro-optic materials include one or more liquid crystals.

In some embodiments, at least one of the first spacer and the second spacer is an adjustable spacer configured to change its thickness (e.g., spacers 680 and 690 in FIG. 6B). In some embodiments, at least one of the first spacer and the second spacer is a static spacer configured to maintain its thickness (e.g., spacers 660 and 670 in FIG. 6A).

Although head-mounted displays are illustrated as apparatus that include the described optical devices, such optical devices may be used in other systems, devices, and apparatus. For example, the optical devices described herein may be used in augmented reality devices and applications.

Terms, “and” and “or” as used herein, may include a variety of meanings that are also expected to depend at least in part upon the context in which such terms are used. Typically, “or” if used to associate a list, such as A, B, or C, is intended to mean A, B, and C, here used in the inclusive sense, as well as A, B, or C, here used in the exclusive sense. In addition, the term “one or more” as used herein may be used to describe any feature, structure, or characteristic in the singular or may be used to describe some combination of features, structures, or characteristics. However, it should be noted that this is merely an illustrative example and claimed subject matter is not limited to this example. Furthermore, the term “at least one of” if used to associate a list, such as A, B, or C, can be interpreted to mean any combination of A, B, and/or C, such as A, AB, AC, BC, AA, ABC, AAB, AABBCCC, etc.

The terms “first state” and “second state” refer to different states, and do not indicate a particular sequence of the states or transitions. In addition, “first state” could be called “second state” and “second state” could be called “first state.”

The methods, systems, and devices discussed above are examples. Various embodiments may omit, substitute, or add various procedures or components as appropriate. For instance, in alternative configurations, the methods described may be performed in an order different from that described, and/or various stages may be added, omitted, and/or combined. Also, features described with respect to certain embodiments may be combined in various other embodiments. Different aspects and elements of the embodiments may be combined in a similar manner. Also, technology evolves and, thus, many of the elements are examples that do not limit the scope of the disclosure to those specific examples.

Specific details are given in the description to provide a thorough understanding of the embodiments. However, embodiments may be practiced without these specific details. For example, well-known circuits, processes, systems, structures, and techniques have been shown without unnecessary detail in order to avoid obscuring the embodiments. This description provides example embodiments only, and is not intended to limit the scope, applicability, or configuration of the invention. Rather, the preceding description of the embodiments will provide those skilled in the art with an enabling description for implementing various embodiments. Various changes may be made in the function and arrangement of elements without departing from the spirit and scope of the present disclosure.

Although various drawings illustrate operations of particular components or particular groups of components with respect to one eye, a person having ordinary skill in the art would understand that analogous operations can be performed with respect to the other eye or both eyes. For brevity, such details are not repeated herein.

Although some of various drawings illustrate a number of logical stages in a particular order, stages which are not order dependent may be reordered and other stages may be combined or broken out. While some reordering or other groupings are specifically mentioned, others will be apparent to those of ordinary skill in the art, so the ordering and groupings presented herein are not an exhaustive list of alternatives. Moreover, it should be recognized that the stages could be implemented in hardware, firmware, software or any combination thereof.

The foregoing description, for purpose of explanation, has been described with reference to specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the scope of the claims to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The embodiments were chosen in order to best explain the principles underlying the claims and their practical applications, to thereby enable others skilled in the art to best use the embodiments with various modifications as are suited to the particular uses contemplated.