Meta Patent | Optical assemblies, head-mounted displays, and related methods
Patent: Optical assemblies, head-mounted displays, and related methods
Patent PDF: 20230418070
Publication Number: 20230418070
Publication Date: 2023-12-28
Assignee: Meta Platforms Technologies
Abstract
Optical assemblies may include a projector assembly, a waveguide, and at least two standoffs. The projector assembly may include at least one light projector and a housing. The waveguide may include at least one input grating corresponding to the at least one light projector. The standoffs may be between the housing and the waveguide, and may be configured for aligning the at least one light projector with the at least one input grating. Related head-mounted displays, systems, and methods are also disclosed.
Claims
What is claimed is:
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17.
18.
19.
20.
Description
CROSS REFERENCE TO RELATED APPLICATION
This application claims the benefit of U.S. Provisional Application No. 63/355,929, filed 27 Jun. 2022, the disclosures of which is incorporated, in its entirety, by this reference.
BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings illustrate a number of example embodiments and are a part of the specification. Together with the following description, these drawings demonstrate and explain various principles of the present disclosure.
FIG. 1 is a plan view of a head-mounted display, according to at least one embodiment of the present disclosure.
FIG. 2 is a detailed view of a light projector mounted to a frame of the head-mounted display, taken at dashed circle A of FIG. 1, according to at least one embodiment of the present disclosure.
FIG. 3 illustrates optical alignment of a projected pattern as viewed by a camera, according to at least one embodiment of the present disclosure.
FIG. 4 is a cross-sectional view of a head-mounted display with alignment cameras, according to at least one embodiment of the present disclosure.
FIGS. 5A and 5B are respectively a top plan view and a perspective view of a light projector assembly, according to at least one embodiment of the present disclosure.
FIGS. 6A-6E are top plan view of light projector assemblies, according to various embodiments of the present disclosure.
FIG. 7 is a detailed plan view of an optical assembly, according to at least one embodiment of the present disclosure.
FIG. 8 is a cross-sectional side view of the optical assembly of FIG. 7.
FIG. 9 is a flow chart illustrating a method of fabricating an optical assembly, according to at least one embodiment of the present disclosure.
FIG. 10 is an illustration of example augmented-reality glasses that may be used in connection with embodiments of this disclosure.
FIG. 11 is an illustration of an example virtual-reality headset that may be used in connection with embodiments of this disclosure.
Throughout the drawings, identical reference characters and descriptions indicate similar, but not necessarily identical, elements. While the example embodiments described herein are susceptible to various modifications and alternative forms, specific embodiments have been shown by way of example in the drawings and will be described in detail herein. However, the example embodiments described herein are not intended to be limited to the particular forms disclosed. Rather, the present disclosure covers all modifications, equivalents, and alternatives falling within the scope of the appended claims.
DETAILED DESCRIPTION OF EXAMPLE EMBODIMENTS
Artificial reality is a form of reality that has been adjusted in some manner before presentation to a user, which may include, for example, a virtual reality, an augmented reality, a mixed reality, a hybrid reality, or some combination and/or derivative thereof. Artificial-reality content may include completely computer-generated content or computer-generated content combined with captured (e.g., real-world) content. The artificial-reality content may include video, audio, haptic feedback, or some combination thereof, any of which may be presented in a single channel or in multiple channels (such as stereo video that produces a three-dimensional (3D) effect to the viewer). Additionally, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to, for example, create content in an artificial reality and/or are otherwise used in (e.g., to perform activities in) an artificial reality.
Head-mounted displays (HMDs) including one or more near-eye displays are often used to present visual content to a user for use in artificial-reality applications. One type of near-eye display includes a waveguide that directs light from a projector to a location in front of the user's eyes. Because of the visual sensitivity of human eyes, slight deviations in optical quality can be very apparent to the user. Proper alignment of projectors and waveguides with each other, with a supporting frame, relative to the user, and/or relative to the overall sensory system can be important to inhibit such deviations and to improve the user's experience viewing visual content presented by near-eye displays.
The present disclosure is generally directed to systems and methods for aligning optical components (e.g., of near-eye displays), such as for aligning a waveguide with corresponding projectors, one or more projectors with a frame, a waveguide with a frame, and/or a projector and waveguide assembly with a frame. For example, embodiments of the present disclosure may include optical assemblies including a projector assembly, a waveguide, and at least two standoffs between the housing and the waveguide. The standoffs may be configured for aligning at least one light projector of the projector assembly and at least one input grating of the waveguide. For example, one or more standoffs may be formed and/or machined to height to orient and position the projector assembly at a predetermined position and orientation relative to the waveguide.
Features from any of the embodiments described herein may be used in combination with one another in accordance with the general principles described herein. These and other embodiments, features, and advantages will be more fully understood upon reading the following detailed description in conjunction with the accompanying drawings and claims.
With reference to FIGS. 1 and 2, the following will describe example head-mounted displays and components thereof, according to embodiments of the present disclosure. The optical alignment of a projected pattern as viewed by a camera will then be described with reference to FIG. 3. Next, an embodiment of a head-mounted display and cameras for alignment will be described with reference to FIG. 4. With reference to FIGS. 5A-6E, the following will provide detailed descriptions of various example light projector assemblies. An example embodiment of a waveguide assembly will then be described with reference to FIG. 7. With reference to FIG. 8, the following will describe an example optical assembly. With reference to FIG. 9, an example method of fabricating optical assemblies will then be described. Finally, example augmented-reality glasses and virtual-reality headsets that may be used in connection with embodiments of this disclosure will be descried with reference to FIGS. 10 and 11.
FIG. 1 is a plan view of a head-mounted display 100, according to at least one embodiment of the present disclosure. The head-mounted display 100 may include a frame 102 and a display assembly 104 coupled to the frame 102. The display assembly 104 for each eye may include a light projector 106 (shown in dashed lines in FIG. 1) and a waveguide 108 configured to direct images from the light projector 106 to a user's eye. In some examples, the light projector 106 may include a plurality of (e.g., three) subprojectors 106A, 106B, 106C that are configured to project light of different wavelengths (e.g., colors, such as red, green, blue, infrared, etc.). The waveguide 108 may include at least one input grating 110 positioned adjacent to and optically aligned with the light projector 106. The input grating 110 may be configured to enable light from the subprojectors 106A, 106B, 106C to enter into the waveguide 108 to be directed to the center of the waveguide 108 for presentation to the user's eye. For example, as shown in FIG. 1 in dashed lines, the input grating 110 may include three optical apertures respectively aligned with the three subprojectors 106A, 106B, 106C of the light projector 106.
In some examples, the head-mounted display 100 may be implemented in the form of augmented-reality glasses. Accordingly, the waveguide 108 may be at least partially transparent to visible light to allow the user to view a real-world environment through the waveguide 108. Images presented to the user's eye by the light projectors 106 may overlay the user's view of the real-world environment.
The waveguide 108 may be physically secured to the frame 102 in a manner that aligns the waveguide 108 to the light projectors 106, to a user's view, and/or to the frame 102. For example, the light projectors 106 may first be aligned with and secured to the frame 102. Then, the input gratings 110 of the waveguides 108 may be optically aligned with the light projectors 106.
In some embodiments, the waveguide 108 may be secured to the frame 102 with an adhesive material, one or more fasteners, an adhesive, a clip, etc., such as after completion of the optical alignment of the waveguides 108 with the respective light projectors 106. For example, an adhesive material may be positioned between the waveguide 108 and the frame 102 at multiple (e.g., two, three, or more than three) distinct locations 114 to maintain the relative position between the waveguide 108 and the light projector 106. In additional embodiments, the waveguide 108 may be secured to the frame 102 in a continuous manner, such as along one or more peripheral edges of the waveguide 108 by an adhesive, a clip, a frame cover element, etc.
FIG. 2 is a detailed view of the light projector 106 mounted to the frame 102 of the head-mounted display 100, taken at dashed circle A of FIG. 1, according to at least one embodiment of the present disclosure. As shown in FIG. 2, the light projector 106 may be mounted on the frame 102 of the head-mounted display 100, such as in an upper corner of the frame 102. The first subprojector 106A may include a blue light source, the second subprojector 106B may include a red light source, and the third subprojector 106C may include a green light source. Other colors and arrangements of the subprojectors 106A, 106B, 106C may also be possible.
To assemble the head-mounted display 100, the three subprojectors 106A, 106B, 106C may be initially assembled with each other (e.g., three subprojectors mounted to a common substrate 107, three collimating lenses aligned on the three subprojectors, etc.) to form the light projector 106 as a unit. The light projector 106 (e.g., the substrate 107 of the light projector 106) may include one or more projector fiducial marks 116, which may be used in optically aligning (e.g., positioning, orienting, securing) the light projector 106 with the frame 102. In some examples, the frame 102 may likewise include one or more frame fiducial marks 118 to assist in the optical alignment of the light projector 106 with the frame 102.
Optical alignment of the light projector 106 relative to the frame 102 may involve viewing the light projector 106 and/or frame 102 during placement of the light projector 106 in or on the frame 102 with one or more cameras, which may be used to identify the location and orientation of the projector fiducial mark(s) 116 relative to the location and orientation of the frame fiducial mark(s) 118. The projector fiducial mark(s) 116 and the frame fiducial mark(s) 118 are each shown in FIG. 2 in the shape of a plus sign. In additional examples, other shapes, physical features (e.g., of the light projector 106 and/or of the frame 102), reflective surfaces, or other optical identifiers may be used to optically align the light projector 106 relative to the frame 102. In some embodiments, the light projector 106 may be aligned relative to the frame 102 using an image projected by the light projector 106, such as is explained below with reference to FIG. 3.
After the light projector 106 is aligned with and secured to the frame 102, the waveguide 108 may be aligned with the light projector 106 and secured to the frame 102. For example, the waveguide 108 may include a waveguide fiducial mark 109, which may be used in optically aligning (e.g., positioning, orienting, securing) the waveguide 108 to the frame 102 and/or to the light projector 106. In addition, the input gratings 110 of the waveguide 108 may be optically aligned with the subprojectors 106A, 106B, 106C. In some examples, the input gratings 110 may be smaller than respective apertures of the subprojectors 106A, 106B, 106C as shown in FIG. 2. In additional examples, the input gratings 110 may be substantially the same size as or larger than the respective apertures of the subprojectors 106A, 106B, 106C.
FIG. 3 illustrates optical alignment of a projected pattern 302 as viewed by a camera, according to at least one embodiment of the present disclosure. The projected pattern 302 may be aligned with a camera target 304. The projected pattern 302 may be produced by a light projector, such as the light projector 106 described above. One or more cameras may view the projected pattern 302 and compare the location and orientation of the projected pattern 302 to the camera target 304. The light projector and/or a frame to which the light projector is to be mounted may be moved (e.g., laterally shifted, angled, rotated, etc.) to align the projected pattern 302 with the camera target 304 to an acceptable resolve (e.g., within an acceptable tolerance) before the light projector is fixed in position relative to the frame. In some examples, the alignment of the projected pattern 302 with the camera target 304 may be performed while exposing the light projector 106 and the frame 102 to conditions that may be expected during use of the resulting assembly. For example, a heat load may be applied to the light projector 106 during alignment to mimic thermal loading that may occur during use.
FIG. 4 is a cross-sectional view of a head-mounted display 400 with alignment cameras 424, according to at least one embodiment of the present disclosure. In at least some respects, the head-mounted display 400 may be similar to the head-mounted display 100 described above. For example, the head-mounted display 400 may include a frame 402, and a display assembly 404 including a light projector 406 and a waveguide 408 mounted to the frame 402.
The alignment cameras 424 may be used during assembly of the head-mounted display 400 to optically align the light projector 406 with the frame 402 and/or to optically align the waveguide 408 (e.g., input gratings of the waveguide 408) with the light projector 406. For example, the alignment cameras 424 may be used to detect the location and/or orientation of a fiducial mark (e.g., the projector fiducial marks 116, the frame fiducial marks 118, the waveguide fiducial marks 109, etc.), a physical component or feature, a reflective material, etc. In additional examples, the alignment cameras 424 may be used to detect a location and/or orientation of a projected pattern (e.g., the projected pattern 302) relative to a target (e.g., the camera target 304). This detected information may be used to adjust a position and/or orientation of the light projector 406 relative to the frame 402 and/or of the waveguide 408 relative to the light projector 406 and/or frame 402.
FIGS. 5A and 5B are respectively a top plan view and a perspective view of a light projector assembly 500, according to at least one embodiment of the present disclosure. The light projector assembly 500 may include at least one light projector 502 supported by a housing 504. Standoffs 506A, 506B, 506C (collectively referred to as “standoffs 506”) may extend from a face 508 of the housing 504 on a side of the housing 504 where the light projectors 502 are located. By way of example and not limitation, at least two standoffs 506 may be included. In some examples, as illustrated in FIGS. 5A and 5B, three standoffs 506 may extend from the face 508 of the housing 504.
Light projection may be provided by one, two, three (as illustrated in FIGS. 5A and 5B), or more light projectors 502. For example, the light projectors 502 may be configured to respectively emit light of different wavelengths (e.g., red, green, blue, infrared, etc.). In additional examples, a single light projector 502 may be a multi-color light projector 502 configured to emit light of different wavelengths.
The standoffs 506 may be configured for aligning the light projectors 502 with one or more corresponding input gratings of a waveguide. For instance, the standoffs 506 may be used to abut against a waveguide assembly (e.g., against the waveguide itself, against a mask attached to the waveguide, against a waveguide holder, etc.) to maintain the light projectors 502 in a predetermined position (e.g., orientation, distance, etc.) relative to corresponding input gratings of the waveguide assembly. In some examples, the standoffs 506 may be positioned in a triangular arrangement on the housing 504 to provide a stable interface between the standoffs 506 and the waveguide assembly.
As illustrated in FIG. 5B, a first standoff 506A may have a first length LA extending from the face 508 of the housing 504 to a distal end of the first standoff 506A. A second standoff 506B may have a second length LB extending from the face 508 of the housing 504 to a distal end of the second standoff 506B. A third standoff 506C may have a third length LC extending from the face 508 of the housing 504 to a distal end of the third standoff 506C. The first, second, and third lengths LA-C are collectively referred to herein as lengths L.
The angle and distance of the light projectors 502 relative to the corresponding input gratings of the waveguide may affect optical quality of a resulting optical assembly. Adjusting one or more of the lengths L may facilitate properly aligning the light projectors with the input gratings. In some examples, at least one of the lengths L may be different than the other lengths L to adjust an angle and/or distance of the light projectors 502 relative to the waveguide. For example, to adjust an orientation (e.g., projection angle) of the light projectors 502 to better align with corresponding input gratings of a waveguide, the first length LA may be shortened, such as by machining. Shortening the first length LA may result in the light projectors 502 being angled toward the second and third standoffs 506B, 506C after assembly with the standoffs 506 abutting against a waveguide assembly. In additional embodiments, all three of the lengths L may be shortened, such as to position the light projectors 502 a predetermined distance from the corresponding input gratings of the waveguide. In yet further embodiments, the standoffs 506 may be formed (e.g., built, printed, positioned on the housing 504, etc.) to have the desired lengths L.
Due to manufacturing tolerances and uncertainties, each individual light projector assembly 500 may be formed with the light projectors 502 positioned slightly differently on the housing 504. Similarly, each individual waveguide assembly may also be formed with the input gratings thereof in slightly different locations relative to the waveguides and/or another component of the waveguide assembly. Thus, each individual light projector assembly 500 and/or corresponding waveguide assembly may be tested to determine a proper alignment of the light projectors 502 with the input gratings. After a proper alignment (e.g., an alignment within a predetermined tolerance) is determined, one or more of the standoffs 506 may be formed and/or machined to height to achieve the proper alignment after the standoffs 506 are abutted against the waveguide assembly.
As illustrated in FIGS. 5A and 5B, in some embodiments the distal ends of the standoffs 506 may be rounded. This rounded shape may result in each of the standoffs 506 abutting against a corresponding waveguide assembly at a single point. Thus, in a light projector assembly 500 with three standoffs 506, the light projector assembly 500 may touch the waveguide assembly at three distinct points, which may improve a predictability of how the light projector assembly 500 is oriented and positioned relative to the waveguide assembly.
FIGS. 6A-6E are top plan view of light projector assemblies 600A-600E, according to various embodiments of the present disclosure.
As shown in FIG. 6A, a light projector assembly 600A may include four subprojectors 602, 604, 606, 608 arranged on a substrate 601. The four subprojectors 602, 604, 606, 608 may be positioned on the substrate 601 in any suitable configuration, such as in a diamond shape as shown in FIG. 6A, in a straight line, in a curve, in a rectangle shape, etc. The four subprojectors 602, 604, 606, 608 may be configured to respectively emit light of four different wavelengths, such as red, green, blue, and infrared. Each of the subprojectors 602, 604, 606, 608 may include an array of pixels that may be selectively activated to be combined to create an image for display to a user. In some examples, one of the subprojectors 602, 604, 606, 608 may be configured to emit infrared light, such as a structured infrared light pattern, an infrared glint, or a flood of infrared light to facilitate eye tracking.
The light projector assembly 600A may also include three standoffs 610. In some examples, at least one of the standoffs 610 may be different in length than the other standoffs 610, such as to provide an interface between the light projector assembly 600A and a corresponding waveguide assembly. The different lengths may help align (e.g., in distance, angle, and/or position) the subprojectors 602, 604, 606, 608 of the light projector assembly 600A to respective input gratings of the waveguide assembly to within a predetermined threshold.
As shown in FIG. 6B, a light projector assembly 600B may include two subprojectors 612, 614 on the substrate 601. FIG. 6B illustrates that the subprojectors 612, 614 may be different sizes. For example, the subprojector 612 may be configured to emit light of one wavelength or range of wavelengths and the larger subprojector 614 may be configured to emit light of another, different wavelength or range of wavelengths. In one example, the subprojector 612 may be configured to emit infrared light (e.g., for eye tracking) and the larger subprojector 614 may be configured to emit visible light (e.g., red, green, blue, and/or white light for producing an image for display to the user).
The light projector assembly 600B may include two standoffs 610. The two standoffs 610 may be positioned and configured to align the subprojectors 612, 614 with corresponding input gratings of a waveguide assembly. For example, one of the standoffs 610 may be shorter than the other standoff 610 to result in the subprojectors 612, 614 being at a desired angle and/or distance relative to the input gratings.
As shown in FIG. 6C, a light projector assembly 600C may include a single light source 613 on the substrate 601. The single light source 613 may be configured to emit light of a single wavelength or of multiple wavelengths. For example, the single light source 613 may include an array of pixels capable of emitting various colors (e.g., red, blue, green, white, infrared, etc.) and patterns.
The light projector assembly 600C may include three standoffs 610. The three standoffs 610 may be positioned and configured to align the single light source 613 with a corresponding input grating of a waveguide assembly. For example, at least one of the standoffs 610 may be shorter than the other standoffs 610 to result in the single light source 613 being at a desired angle and/or distance relative to the input grating.
As shown in FIG. 6D, a light projector assembly 600D may include three subprojectors 616, 618, 620. Three subprojectors 106A, 106B, 106C were illustrated in FIGS. 1 and 2 in a triangular configuration. However, as illustrated in FIG. 6D, the three subprojectors 616, 618, 620 may be arranged in a line.
The light projector assembly 600D may include three standoffs 610. In some examples, at least one of the standoffs 610 may be different in length than the other standoffs 610, such as to provide an interface between the light projector assembly 600D and a corresponding waveguide assembly. The different lengths may help align (e.g., in distance, angle, and/or position) the subprojectors 616, 618, 620 of the light projector assembly 600D to respective input gratings of the waveguide assembly to within a predetermined threshold.
In examples and figures described above, the light projectors, light sources, and standoffs are illustrated as each having a circular shape. However, the present disclosure is not so limited. For example, as shown in FIG. 6E, a light projector assembly 600E may include one or more light sources 622 having a non-circular shape, such as square or rectangular. In addition, the light projector assembly 600E may include standoffs 611 having a non-circular shape, such as square or rectangular.
Accordingly, light projector assemblies of various shapes, sizes, and arrangements of light sources, subprojectors, and/or standoffs may be used in conjunction with embodiments of the present disclosure.
FIG. 7 is a detailed plan view of an optical assembly 700, according to at least one embodiment of the present disclosure. FIG. 8 is a cross-sectional side view of the optical assembly 700 of FIG. 7.
In some examples, the optical assembly 700 may be a head-mounted display (e.g., augmented-reality glasses, a virtual-reality headset, etc.). In some respects, the optical assembly 700 may be similar to the head-mounted display 100 described above with reference to FIGS. 1 and 2. For example, the optical assembly 700 may include a frame 702 and a display assembly 704 coupled to the frame 702. The display assembly 704 may include a light projector 706 and a waveguide 708 configured to direct images from the light projector 706 to a user's eye. In some examples, the light projector 706 may include multiple (e.g., three) subprojectors 706A, 706B, 706C that are configured to project light of different wavelengths (e.g., red, green, blue, infrared, white, etc.).
The waveguide 708 may include at least one input grating 710 positioned adjacent to and optically aligned with the light projector 706. The input grating 710 may be configured to enable light from the subprojectors 706A, 706B, 706C to enter into the waveguide 708 (e.g., through three respective optical apertures 712) and to be directed to a central region of the waveguide 708 for presentation to the user's eye. For example, as illustrated in FIG. 7, the input grating 710 may be configured to direct light within respective angular ranges 720 toward the central region of the waveguide 708.
The subprojectors 706A, 706B, 706C may be mounted on a projector housing 722. Standoffs 724 may extend from the projector housing 722. As discussed above with reference to FIGS. 5A and 5B, the standoffs 724 may have lengths (e.g., different lengths) selected to align the subprojectors 706A, 706B, 706C to the respective optical apertures 712 of the input grating 710.
As noted above, in some embodiments a mask 726 may be secured (e.g., adhered, bonded, etc.) to the waveguide 708 and positioned between the projector housing 722 and the waveguide 708. As illustrated in FIG. 8, the standoffs 724 may abut against the mask 726 rather than directly against the waveguide 708. Thus, the mask 726 may physically protect the waveguide 708 from damage that might otherwise occur from the standoffs 724 applying forces against the waveguide 708, such as during assembly and manufacturing of the optical assembly 700.
As illustrated in FIG. 7, in some examples, the mask 726 may be configured to avoid interfering with light projection from the light projector 706. For example, the mask 726 may be shaped and/or positioned to not overlap the input grating 710 (e.g., the optical apertures 712 and/or the angular ranges 720 within which light from the light projector 706 is directed).
As shown in FIG. 8, after making the standoffs 724 to appropriate respective lengths for aligning the light projector 706 with the input grating 710 of the waveguide 708, the standoffs 724 may be positioned over the mask 726 to abut against the mask 726. The projector housing 722 may then be secured to the mask 726, such as with an adhesive 728 (e.g., a liquid-dispensed adhesive) that is dispensed in a space between the projector housing 722 and the mask 726 and cured (e.g., via heat, time, exposure to radiation, and/or a chemical curing agent, etc.).
Referring again to FIG. 8, after assembly, the subprojectors 706A, 706B, 706C may be aligned with respective optical apertures 712 of the input grating 710 to within an acceptable tolerance (e.g., within 5 arcminutes of rotation, within 2 arcminutes of rotation, within 1 mm of translation, within 500 μm of translation, etc.). Light 730 projected from the light projector 706 may be directed into the waveguide 708 through the input grating 710 and along the waveguide 708 (e.g., to the right from the perspective of FIG. 8) for presentation of an image to the user's eye(s). The standoffs 724 may improve an optical quality of the image presented to the user's eye(s) by facilitating and controlling the alignment of the light projector 706 with the input grating 710 of the waveguide 708.
Although the standoffs 724 have been described above as being positioned on and extending from the projector housing 722, the present disclosure is not so limited. In additional examples, the standoffs 724 may be positioned on and extend from the mask 726. In this case, the standoffs 724 may be formed to length as discussed above, and then abutted against the projector housing 722 for aligning the light projector 706 to the input grating 710 of the waveguide 708.
FIG. 9 is a flow chart illustrating a method 900 of fabricating an optical assembly, according to at least one embodiment of the present disclosure. At operation 910, a position and orientation of a projector assembly relative to a waveguide may be determined to align the projector assembly with the waveguide. Operation 910 may be performed in a variety of ways. For example, a process as described above with reference to FIG. 3 may be performed. Light may be projected by the projector assembly through the waveguide, and a projected image may be compared to a target image. A corrective movement (e.g., translation and/or rotation) of the projector assembly relative to the waveguide may be determined to align the projected image with the target image to within a predetermined threshold.
At operation 920, at least a portion of a standoff of a plurality of standoffs extending from the projector assembly may be removed to achieve the determined position and orientation. Operation 920 may be performed in a variety of ways. For example, at least one standoff may be precision machined and/or laser ablated to a length determined to result in the determined position and orientation of the projector assembly relative to the waveguide after abutting the plurality of standoffs against a waveguide assembly that includes the waveguide.
At operation 930, the projector assembly may be mounted to the waveguide using the plurality of standoffs to maintain the determined position and orientation of the projector assembly relative to the waveguide. Operation 930 may be performed in a variety of ways. For example, the plurality of standoffs may be abutted against a mask secured to the waveguide. The projector assembly may then be secured to the waveguide, such as with an adhesive dispensed between the projector assembly and the mask.
Accordingly, the present disclosure includes optical assemblies, head-mounted displays, and related methods that may exhibit improved optical quality and that may facilitate manufacturing. For example, optical assemblies may include a projector assembly and a waveguide for redirecting light from the projector assembly. The projector assembly may include at least one light projector and a housing. At least two standoffs may be positioned between the housing and the waveguide. The standoffs may be configured for aligning the at least one light projector with at least one input grating of the waveguide. For example, at least one of the standoffs may be formed (e.g., machined, laser ablated, etc.) to a length to align the light projector with the input grating to within a predetermined threshold. The standoffs may facilitate assembly in a way that achieves a desired optical quality.
Embodiments of the present disclosure may include or be implemented in conjunction with various types of artificial-reality systems. Artificial reality is a form of reality that has been adjusted in some manner before presentation to a user, which may include, for example, a virtual reality, an augmented reality, a mixed reality, a hybrid reality, or some combination and/or derivative thereof. Artificial-reality content may include completely computer-generated content or computer-generated content combined with captured (e.g., real-world) content. The artificial-reality content may include video, audio, haptic feedback, or some combination thereof, any of which may be presented in a single channel or in multiple channels (such as stereo video that produces a three-dimensional (3D) effect to the viewer). Additionally, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to, for example, create content in an artificial reality and/or are otherwise used in (e.g., to perform activities in) an artificial reality.
Artificial-reality systems may be implemented in a variety of different form factors and configurations. Some artificial-reality systems may be designed to work without near-eye displays (NEDs). Other artificial-reality systems may include an NED that also provides visibility into the real world (such as, e.g., augmented-reality system 1000 in FIG. 10) or that visually immerses a user in an artificial reality (such as, e.g., virtual-reality system 1100 in FIG. 11). While some artificial-reality devices may be self-contained systems, other artificial-reality devices may communicate and/or coordinate with external devices to provide an artificial-reality experience to a user. Examples of such external devices include handheld controllers, mobile devices, desktop computers, devices worn by a user, devices worn by one or more other users, and/or any other suitable external system.
Turning to FIG. 10, the augmented-reality system 1000 may include an eyewear device 1002 with a frame 1010 configured to hold a left display device 1015(A) and a right display device 1015(B) in front of a user's eyes. The display devices 1015(A) and 1015(B) may act together or independently to present an image or series of images to a user. While the augmented-reality system 1000 includes two displays, embodiments of this disclosure may be implemented in augmented-reality systems with a single NED or more than two NEDs.
In some embodiments, the augmented-reality system 1000 may include one or more sensors, such as sensor 1040. The sensor 1040 may generate measurement signals in response to motion of the augmented-reality system 1000 and may be located on substantially any portion of the frame 1010. The sensor 1040 may represent one or more of a variety of different sensing mechanisms, such as a position sensor, an inertial measurement unit (IMU), a depth camera assembly, a structured light emitter and/or detector, or any combination thereof. In some embodiments, the augmented-reality system 1000 may or may not include the sensor 1040 or may include more than one sensor. In embodiments in which the sensor 1040 includes an IMU, the IMU may generate calibration data based on measurement signals from the sensor 1040. Examples of the sensor 1040 may include, without limitation, accelerometers, gyroscopes, magnetometers, other suitable types of sensors that detect motion, sensors used for error correction of the IMU, or some combination thereof.
In some examples, the augmented-reality system 1000 may also include a microphone array with a plurality of acoustic transducers 1020(A)-1020(J), referred to collectively as acoustic transducers 1020. The acoustic transducers 1020 may represent transducers that detect air pressure variations induced by sound waves. Each acoustic transducer 1020 may be configured to detect sound and convert the detected sound into an electronic format (e.g., an analog or digital format). The microphone array in FIG. 10 may include, for example, ten acoustic transducers: 1020(A) and 1020(B), which may be designed to be placed inside a corresponding ear of the user, acoustic transducers 1020(C), 1020(D), 1020(E), 1020(F), 1020(G), and 1020(H), which may be positioned at various locations on the frame 1010, and/or acoustic transducers 1020(I) and 1020(J), which may be positioned on a corresponding neckband 1005.
In some embodiments, one or more of the acoustic transducers 1020(A)-(J) may be used as output transducers (e.g., speakers). For example, the acoustic transducers 1020(A) and/or 1020(B) may be earbuds or any other suitable type of headphone or speaker.
The configuration of the acoustic transducers 1020 of the microphone array may vary. While the augmented-reality system 1000 is shown in FIG. 10 as having ten acoustic transducers 1020, the number of acoustic transducers 1020 may be greater or less than ten. In some embodiments, using higher numbers of acoustic transducers 1020 may increase the amount of audio information collected and/or the sensitivity and accuracy of the audio information. In contrast, using a lower number of acoustic transducers 1020 may decrease the computing power required by an associated controller 1050 to process the collected audio information. In addition, the position of each acoustic transducer 1020 of the microphone array may vary. For example, the position of an acoustic transducer 1020 may include a defined position on the user, a defined coordinate on the frame 1010, an orientation associated with each acoustic transducer 1020, or some combination thereof.
The acoustic transducers 1020(A) and 1020(B) may be positioned on different parts of the user's ear, such as behind the pinna, behind the tragus, and/or within the auricle or fossa. Or, there may be additional acoustic transducers 1020 on or surrounding the ear in addition to the acoustic transducers 1020 inside the ear canal. Having an acoustic transducer 1020 positioned next to an ear canal of a user may enable the microphone array to collect information on how sounds arrive at the ear canal. By positioning at least two of the acoustic transducers 1020 on either side of a user's head (e.g., as binaural microphones), the augmented-reality device 1000 may simulate binaural hearing and capture a 3D stereo sound field around about a user's head. In some embodiments, the acoustic transducers 1020(A) and 1020(B) may be connected to the augmented-reality system 1000 via a wired connection 1030, and in other embodiments the acoustic transducers 1020(A) and 1020(B) may be connected to the augmented-reality system 1000 via a wireless connection (e.g., a BLUETOOTH connection). In still other embodiments, the acoustic transducers 1020(A) and 1020(B) may not be used at all in conjunction with the augmented-reality system 1000.
The acoustic transducers 1020 on the frame 1010 may be positioned in a variety of different ways, including along the length of the temples, across the bridge, above or below the display devices 1015(A) and 1015(B), or some combination thereof. The acoustic transducers 1020 may also be oriented such that the microphone array is able to detect sounds in a wide range of directions surrounding the user wearing the augmented-reality system 1000. In some embodiments, an optimization process may be performed during manufacturing of the augmented-reality system 1000 to determine relative positioning of each acoustic transducer 1020 in the microphone array.
In some examples, the augmented-reality system 1000 may include or be connected to an external device (e.g., a paired device), such as the neckband 1005. The neckband 1005 generally represents any type or form of paired device. Thus, the following discussion of the neckband 1005 may also apply to various other paired devices, such as charging cases, smart watches, smart phones, wrist bands, other wearable devices, hand-held controllers, tablet computers, laptop computers, other external compute devices, etc.
As shown, the neckband 1005 may be coupled to the eyewear device 1002 via one or more connectors. The connectors may be wired or wireless and may include electrical and/or non-electrical (e.g., structural) components. In some cases, the eyewear device 1002 and neckband 1005 may operate independently without any wired or wireless connection between them. While FIG. 10 illustrates the components of the eyewear device 1002 and neckband 1005 in example locations on the eyewear device 1002 and neckband 1005, the components may be located elsewhere and/or distributed differently on the eyewear device 1002 and/or neckband 1005. In some embodiments, the components of the eyewear device 1002 and neckband 1005 may be located on one or more additional peripheral devices paired with the eyewear device 1002, neckband 1005, or some combination thereof.
Pairing external devices, such as the neckband 1005, with augmented-reality eyewear devices may enable the eyewear devices to achieve the form factor of a pair of glasses while still providing sufficient battery and computation power for expanded capabilities. Some or all of the battery power, computational resources, and/or additional features of the augmented-reality system 1000 may be provided by a paired device or shared between a paired device and an eyewear device, thus reducing the weight, heat profile, and form factor of the eyewear device overall while still retaining desired functionality. For example, the neckband 1005 may allow components that would otherwise be included on an eyewear device to be included in the neckband 1005 since users may tolerate a heavier weight load on their shoulders than they would tolerate on their heads. The neckband 1005 may also have a larger surface area over which to diffuse and disperse heat to the ambient environment. Thus, the neckband 1005 may allow for greater battery and computation capacity than might otherwise have been possible on a stand-alone eyewear device. Since weight carried in the neckband 1005 may be less invasive to a user than weight carried in the eyewear device 1002, a user may tolerate wearing a lighter eyewear device and carrying or wearing the paired device for greater lengths of time than a user would tolerate wearing a heavy standalone eyewear device, thereby enabling users to more fully incorporate artificial-reality environments into their day-to-day activities.
The neckband 1005 may be communicatively coupled with the eyewear device 1002 and/or to other devices. These other devices may provide certain functions (e.g., tracking, localizing, depth mapping, processing, storage, etc.) to augmented-reality system 1000. In the embodiment of FIG. 10, neckband 1005 may include two acoustic transducers (e.g., 1020(I) and 1020(J)) that are part of the microphone array (or potentially form their own microphone subarray). Neckband 1005 may also include a controller 1025 and a power source 1035.
Acoustic transducers 1020(I) and 1020(J) of neckband 1005 may be configured to detect sound and convert the detected sound into an electronic format (analog or digital). In the embodiment of FIG. 10, acoustic transducers 1020(I) and 1020(J) may be positioned on neckband 1005, thereby increasing the distance between the neckband acoustic transducers 1020(I) and 1020(J) and other acoustic transducers 1020 positioned on eyewear device 1002. In some cases, increasing the distance between acoustic transducers 1020 of the microphone array may improve the accuracy of beamforming performed via the microphone array. For example, if a sound is detected by acoustic transducers 1020(C) and 1020(D) and the distance between acoustic transducers 1020(C) and 1020(D) is greater than, e.g., the distance between acoustic transducers 1020(D) and 1020(E), the determined source location of the detected sound may be more accurate than if the sound had been detected by acoustic transducers 1020(D) and 1020(E).
Controller 1025 of neckband 1005 may process information generated by the sensors on neckband 1005 and/or augmented-reality system 1000. For example, controller 1025 may process information from the microphone array that describes sounds detected by the microphone array. For each detected sound, controller 1025 may perform a direction-of-arrival (DOA) estimation to estimate a direction from which the detected sound arrived at the microphone array. As the microphone array detects sounds, controller 1025 may populate an audio data set with the information. In embodiments in which augmented-reality system 1000 includes an inertial measurement unit, controller 1025 may compute all inertial and spatial calculations from the IMU located on eyewear device 1002. A connector may convey information between augmented-reality system 1000 and neckband 1005 and between augmented-reality system 1000 and controller 1025. The information may be in the form of optical data, electrical data, wireless data, or any other transmittable data form. Moving the processing of information generated by augmented-reality system 1000 to neckband 1005 may reduce weight and heat in eyewear device 1002, making it more comfortable to the user.
Power source 1035 in neckband 1005 may provide power to eyewear device 1002 and/or to neckband 1005. Power source 1035 may include, without limitation, lithium ion batteries, lithium-polymer batteries, primary lithium batteries, alkaline batteries, or any other form of power storage. In some cases, power source 1035 may be a wired power source. Including power source 1035 on neckband 1005 instead of on eyewear device 1002 may help better distribute the weight and heat generated by power source 1035.
As noted, some artificial-reality systems may, instead of blending an artificial reality with actual reality, substantially replace one or more of a user's sensory perceptions of the real world with a virtual experience. One example of this type of system is a head-worn display system, such as virtual-reality system 1100 in FIG. 11, that mostly or completely covers a user's field of view. Virtual-reality system 1100 may include a front rigid body 1102 and a band 1104 shaped to fit around a user's head. Virtual-reality system 1100 may also include output audio transducers 1106(A) and 1106(B). Furthermore, while not shown in FIG. 11, front rigid body 1102 may include one or more electronic elements, including one or more electronic displays, one or more inertial measurement units (IMUs), one or more tracking emitters or detectors, and/or any other suitable device or system for creating an artificial-reality experience.
Artificial-reality systems may include a variety of types of visual feedback mechanisms. For example, display devices in augmented-reality system 1000 and/or virtual-reality system 1100 may include one or more liquid crystal displays (LCDs), light emitting diode (LED) displays, microLED displays, organic LED (OLED) displays, digital light project (DLP) micro-displays, liquid crystal on silicon (LCoS) micro-displays, and/or any other suitable type of display screen. These artificial-reality systems may include a single display screen for both eyes or may provide a display screen for each eye, which may allow for additional flexibility for varifocal adjustments or for correcting a user's refractive error. Some of these artificial-reality systems may also include optical subsystems having one or more lenses (e.g., concave or convex lenses, Fresnel lenses, adjustable liquid lenses, etc.) through which a user may view a display screen. These optical subsystems may serve a variety of purposes, including to collimate (e.g., make an object appear at a greater distance than its physical distance), to magnify (e.g., make an object appear larger than its actual size), and/or to relay (to, e.g., the viewer's eyes) light. These optical subsystems may be used in a non-pupil-forming architecture (such as a single lens configuration that directly collimates light but results in so-called pincushion distortion) and/or a pupil-forming architecture (such as a multi-lens configuration that produces so-called barrel distortion to nullify pincushion distortion).
In addition to or instead of using display screens, some of the artificial-reality systems described herein may include one or more projection systems. For example, display devices in augmented-reality system 1000 and/or virtual-reality system 1100 may include micro-LED projectors that project light (using, e.g., a waveguide) into display devices, such as clear combiner lenses that allow ambient light to pass through. The display devices may refract the projected light toward a user's pupil and may enable a user to simultaneously view both artificial-reality content and the real world. The display devices may accomplish this using any of a variety of different optical components, including waveguide components (e.g., holographic, planar, diffractive, polarized, and/or reflective waveguide elements), light-manipulation surfaces and elements (such as diffractive, reflective, and refractive elements and gratings), coupling elements, etc. Artificial-reality systems may also be configured with any other suitable type or form of image projection system, such as retinal projectors used in virtual retina displays.
The artificial-reality systems described herein may also include various types of computer vision components and subsystems. For example, augmented-reality system 1000 and/or virtual-reality system 1100 may include one or more optical sensors, such as two-dimensional (2D) or 3D cameras, structured light transmitters and detectors, time-of-flight depth sensors, single-beam or sweeping laser rangefinders, 3D LiDAR sensors, and/or any other suitable type or form of optical sensor. An artificial-reality system may process data from one or more of these sensors to identify a location of a user, to map the real world, to provide a user with context about real-world surroundings, and/or to perform a variety of other functions.
The artificial-reality systems described herein may also include one or more input and/or output audio transducers. Output audio transducers may include voice coil speakers, ribbon speakers, electrostatic speakers, piezoelectric speakers, bone conduction transducers, cartilage conduction transducers, tragus-vibration transducers, and/or any other suitable type or form of audio transducer. Similarly, input audio transducers may include condenser microphones, dynamic microphones, ribbon microphones, and/or any other type or form of input transducer. In some embodiments, a single transducer may be used for both audio input and audio output.
In some embodiments, the artificial-reality systems described herein may also include tactile (i.e., haptic) feedback systems, which may be incorporated into headwear, gloves, body suits, handheld controllers, environmental devices (e.g., chairs, floormats, etc.), and/or any other type of device or system. Haptic feedback systems may provide various types of cutaneous feedback, including vibration, force, traction, texture, and/or temperature. Haptic feedback systems may also provide various types of kinesthetic feedback, such as motion and compliance. Haptic feedback may be implemented using motors, piezoelectric actuators, fluidic systems, and/or a variety of other types of feedback mechanisms. Haptic feedback systems may be implemented independent of other artificial-reality devices, within other artificial-reality devices, and/or in conjunction with other artificial-reality devices.
By providing haptic sensations, audible content, and/or visual content, artificial-reality systems may create an entire virtual experience or enhance a user's real-world experience in a variety of contexts and environments. For instance, artificial-reality systems may assist or extend a user's perception, memory, or cognition within a particular environment. Some systems may enhance a user's interactions with other people in the real world or may enable more immersive interactions with other people in a virtual world. Artificial-reality systems may also be used for educational purposes (e.g., for teaching or training in schools, hospitals, government organizations, military organizations, business enterprises, etc.), entertainment purposes (e.g., for playing video games, listening to music, watching video content, etc.), and/or for accessibility purposes (e.g., as hearing aids, visual aids, etc.). The embodiments disclosed herein may enable or enhance a user's artificial-reality experience in one or more of these contexts and environments and/or in other contexts and environments.
The following example embodiments are also included in this disclosure:
Example 1: An optical assembly, which may include: a projector assembly including at least one light projector and a housing; a waveguide configured for redirecting light from the at least one light projector, the waveguide including at least one input grating corresponding to the at least one light projector; and at least two standoffs between the housing and the waveguide, wherein the at least two standoffs are configured for aligning the at least one light projector with the at least one input grating.
Example 2: The optical assembly of Example 1, further including a mask positioned between the projector assembly and the waveguide.
Example 3: The optical assembly of Example 2, wherein the at least two standoffs abut against the mask.
Example 4: The optical assembly of any of Examples 2 or 3, wherein the at least two standoffs extend from the housing and abut against the mask.
Example 5: The optical assembly of any of Examples 2 through 4, wherein: the mask is secured to the waveguide; and the housing of the projector assembly is secured to the mask with an adhesive.
Example 6: The optical assembly of any of Examples 1 through 5, wherein the at least two standoffs include at least three standoffs.
Example 7: The optical assembly of any of Examples 1 through 6, wherein the at least two standoffs have different respective lengths extending away from the housing of the projector assembly.
Example 8: The optical assembly of any of Examples 1 through 7, wherein at least one of the standoffs is machined to height to achieve an alignment between the at least one light projector and the at least one input grating of the waveguide to within a predetermined threshold.
Example 9: The optical assembly of any of Examples 1 through 8, wherein the at least one light projector includes at least three light projectors, each of the at least three light projectors being configured for projecting a different respective wavelength of light.
Example 10: The optical assembly of Example 9, wherein each of the at least three light projectors is configured for projecting one of: red light; blue light; green light; infrared light; or white light.
Example 11: The optical assembly of Example 10, wherein the at least three light projectors include a red light projector, a blue light projector, and a green light projector.
Example 12: The optical assembly of any of Examples 1 through 11, wherein at each standoff of the at least two standoffs has a rounded end.
Example 13: A head-mounted display, which may include: an optical assembly, including: a projector assembly including at least one light projector and a housing; a waveguide configured for redirecting light from the at least one light projector to a position in front of a user's eyes, the waveguide including at least one input grating corresponding to the at least one light projector; and standoffs between the housing and the waveguide, wherein the standoffs are configured for optically aligning the at least one light projector with the at least one input grating; and a frame configured for mounting the optical assembly on a head of the user with at least a portion of the waveguide in front of the eyes of the user.
Example 14: The head-mounted display of Example 13, wherein the head-mounted display includes augmented-reality glasses.
Example 15: The head-mounted display of any of Examples 13 or 14, wherein the projector assembly is mounted to an upper corner of the waveguide when the frame is worn on the head of a user.
Example 16: The head-mounted display of any of Examples 13 through 15, wherein the standoffs include three standoffs.
Example 17: The head-mounted display of any of Examples 13 through 16, wherein at least one of the standoffs has a shorter length than at least one other of the standoffs.
Example 18: A method of fabricating an optical assembly, which may include: determining a position and orientation of a projector assembly relative to a waveguide to optically align the projector assembly with the waveguide; removing at least a portion of a standoff of a plurality of standoffs extending from the projector assembly to achieve the determined position and orientation of the projector assembly relative to the waveguide when the standoffs are used to mount the projector assembly to the waveguide; and mounting the projector assembly to the waveguide using the plurality of standoffs to maintain the determined position and orientation.
Example 19: The method of Example 18, wherein removing the portion of the standoff of the plurality of standoffs includes at least one of: laser ablating the standoff; or machining the standoff.
Example 20: The method of Example 18 or Example 19, wherein mounting the projector assembly to the waveguide using the plurality of standoffs includes abutting each standoff of the plurality of standoffs against a mask disposed between the projector assembly and the waveguide.
The process parameters and sequence of the steps described and/or illustrated herein are given by way of example only and can be varied as desired. For example, while the steps illustrated and/or described herein may be shown or discussed in a particular order, these steps do not necessarily need to be performed in the order illustrated or discussed. The various example methods described and/or illustrated herein may also omit one or more of the steps described or illustrated herein or include additional steps in addition to those disclosed.
The preceding description has been provided to enable others skilled in the art to best utilize various aspects of the example embodiments disclosed herein. This example description is not intended to be exhaustive or to be limited to any precise form disclosed. Many modifications and variations are possible without departing from the spirit and scope of the present disclosure. The embodiments disclosed herein should be considered in all respects illustrative and not restrictive. Reference should be made to the appended claims and their equivalents in determining the scope of the present disclosure.
Unless otherwise noted, the terms “connected to” and “coupled to” (and their derivatives), as used in the specification and claims, are to be construed as permitting both direct and indirect (i.e., via other elements or components) connection. In addition, the terms “a” or “an,” as used in the specification and claims, are to be construed as meaning “at least one of.” Finally, for ease of use, the terms “including” and “having” (and their derivatives), as used in the specification and claims, are interchangeable with and have the same meaning as the word “comprising.”
