Lumus Patent | Image projector
Patent: Image projector
Drawings: Click to check drawins
Publication Number: 20220030205
Publication Date: 20220127
Applicants: Lumus
Abstract
An image projector includes an illumination arrangement with a number of illumination sources and a tilt-mirror assembly, all operating under control of a controller. An optical arrangement directs illumination from the illumination sources towards the mirror and on to an image plane. A collimating arrangement collimates the illumination from the image plane to generate a collimated image directed to an exit stop. The controller (830) modulates an intensity of each of the illumination sources (808) synchronously with tilt motion of the mirror (814) according to the content of the digital image. In certain implementations, the illumination sources (808) are spaced apart. Although the tilt motion brings each illumination source to scans across only part of a dimension of the field of view, all of the illumination sources together scans across the entirety of the one dimension.
Claims
1. An image projector for projecting a collimated image via an exit stop for injection into an input stop of a light-guide optical element, said collimated image being a representation of a digital image with a field of view, the image projector comprising: (a) an illumination arrangement comprising a plurality of illumination sources; (b) a tilt-mirror assembly comprising a mirror and a driver for driving tilt motion of said mirror; (c) a controller in electronic connection with said driver and said illumination arrangement; and (d) an optical arrangement comprising a plurality of optical elements deployed to: (i) direct illumination from said plurality of illumination sources towards said mirror; (ii) direct the illumination reflected from said mirror towards an image plane; and (iii) collimate illumination from said image plane to generate a collimated image directed to said exit stop, wherein said controller modulates an intensity of each of said illumination sources synchronously with said tilt motion of said mirror according to the content of the digital image, and wherein said plurality of illumination sources are spaced apart and said tilt motion is such that illumination from each of said illumination sources scans across only part of one dimension of the field of view while illumination from the plurality of illumination sources together scans across the entirety of the one dimension.
2. The image projector of claim 1, wherein said optical arrangement substantially images said mirror to said exit stop.
3. The image projector of claim 1, wherein said tilt-mirror assembly is part of a two-axis scanning arrangement such that illumination from each of said illumination sources scans across said image plane in a two-dimensional scanning pattern.
4. The image projector of claim 3, wherein said spaced-apart illumination sources are part of a two dimensional array of illumination sources spaced apart in two dimensions, and wherein said two-dimensional scanning pattern is such that illumination from each of said illumination sources scans across only part of each dimension of the field of view while illumination from the plurality of illumination together scans across the entirety of both dimensions of the field of view.
5. The image projector of claim 1, wherein each of said spaced-apart illumination sources is part of a group of illumination sources that cooperate to generate a substantially continuous illumination pattern spanning a dimension of the field of view perpendicular to a scanning-direction dimension of the field of view.
6. The image projector of claim 1, wherein said optical arrangement is configured to focus the illumination reflected from said mirror at said image plane such that each of said illumination sources generates an instantaneous spot at said image plane corresponding to a single pixel of said digital image.
7. The image projector of claim 1, further comprising a spatial light modulator deployed at said image plane, and wherein said optical arrangement is configured to generate a patch of illumination from each of said illumination sources illumination a plurality of pixel elements of said spatial light modulator, said spatial light modulator being driven by said controller in coordination with said illumination arrangement to generate a reproduction of the digital image.
8. The image projector of claim 1, wherein all of said plurality of illumination sources are of a single color, and wherein each of said plurality of illumination sources is associated with two additional illumination sources of different colors, making up a triplet of red, green and blue colored illumination sources.
9. (canceled)
10. (canceled)
11. An image projector for projecting a collimated image via an exit stop for injection into an input stop of a light-guide optical element, said collimated image being a representation of a digital image with a field of view, the image projector comprising: (a) an illumination arrangement comprising a plurality of illumination sources of different colors; (b) a tilt-mirror assembly comprising a mirror and a driver for driving tilt motion of said mirror between a plurality of positions; (c) a spatial light modulator having individually controlled pixel elements; (d) a controller in electronic connection with said spatial light modulator and said driver; and (e) an optical arrangement comprising a plurality of optical elements, said optical arrangement being configured to: (i) direct illumination from said plurality of illumination sources towards said mirror; (ii) direct the illumination reflected from said mirror towards said spatial light modulator such that illumination from one of said illumination sources illuminates said spatial light modulator; and (iii) collimate illumination from said spatial light modulator to generate a collimated image directed to said exit stop, wherein said controller drives said driver to displace said mirror between a first of said positions, in which said spatial light modulator is fully illuminated by a first of said illumination sources, and a second of said positions, in which said spatial light modulator is fully illuminated by a second of said illumination sources, thereby switching between colors of illumination, said controller actuating said spatial light modulator synchronously with switching between colors of illumination to generate corresponding content of the digital image for each of the colors of illumination.
12. The image projector of claim 11, wherein, in each of said positions of said mirror, said optical arrangement is configured to focus an image of one of said illumination sources onto said spatial light modulator.
13. An image projector for projecting a collimated image via an exit stop onto an entrance stop of a light-guide optical element, said collimated image being a representation of a digital image with a field of view, the image projector comprising: (a) an illumination arrangement comprising at least one illumination source; (b) a first tilt-mirror assembly comprising a first mirror and a first driver for driving tilt motion of said first mirror about a first tilt axis; (c) a second tilt-mirror assembly comprising a second mirror and a second driver for driving tilt motion of said second mirror about a second tilt axis; (d) a controller in electronic connection with said first and second drivers and with said illumination arrangement; and (e) an optical arrangement comprising a plurality of optical elements deployed to: (i) direct illumination from said at least one illumination source towards said first mirror; (ii) direct the illumination reflected from said mirror towards said second mirror; and (iii) collimate illumination from said second mirror to generate a collimated image directed to said exit stop, wherein said controller modulates an intensity of said at least one illumination source synchronously with said tilt motion of said first and second mirrors according to the content of the digital image, and wherein said optical arrangement is configured such that both said first mirror and said second mirror are located substantially in planes containing an image of the entrance stop of the light-guide optical element.
14. The image projector of claim 13, wherein said at least one illumination source is implemented as a plurality of spaced-apart illumination sources, and wherein said tilt motion of one of said first and second mirrors is such that illumination from each of said illumination sources scans across only part of one dimension of the field of view while illumination from the plurality of illumination sources together scans across the entirety of the one dimension.
15. The image projector of claim 14, wherein said spaced-apart illumination sources are part of a two dimensional array of illumination sources spaced apart in two dimensions, and wherein said tilt motion of each of said first and second mirrors is such that illumination from each of said illumination sources scans across only part of each dimension of the field of view while illumination from the plurality of illumination together scans across the entirety of both dimensions of the field of view.
Description
FIELD AND BACKGROUND OF THE INVENTION
[0001] The present invention relates to image projectors and, in particular, it concerns image projectors with various configurations for illuminating an entrance to a waveguide.
[0002] It is known to project an image by illuminating a spatial light modulator, such as a liquid crystal display (LCD), liquid crystal on silicon (LCOS) modulator or a digital micromirror device of a digital light processing (DLP) system, and collimating the modulated image for output to an eye of a user. Such projectors are often used in near eye displays, where the projected image is typically introduced into a light guide along which the image propagates by internal reflection until being coupled out to the eye of the user, typically by partially-reflective surfaces or by diffractive elements, which may contribute to expansion of the effective optical aperture from which the image is projected towards the eye.
[0003] Near eye displays typically include two major modules: a light-guide optical element ("LOE" or "waveguide") and an image projector, sometimes referred to as a "projecting optical device" or "POD". The entrance pupil into the waveguide dictates the exit pupil required from the projector. The exit pupil of the projector is therefore located at some distance forward from its optics. The optical coupling arrangement of light from the projector into the waveguide determines this distance.
[0004] FIG. 1A shows an existing diagonal approach where a projector 12A transmits image light through a prism 13 into a waveguide 14. In this configuration the optical distance between projector 12A and waveguide entrance pupil is relatively short.
[0005] FIG. 1B shows perpendicular approach to couple light into waveguide. In this figure projector 12B is shown to transmit the chief ray 16A. The light ray is reflected from mirror surface 18 at such angle that it is trapped by total internal reflection (TIR) within waveguide 14.
[0006] In both FIGS. 1A and 1B, a critical point (actually, an edge extending into the page of the drawing) 32 determines the entrance pupil into the waveguide, at least in the width dimension as illustrated. It is apparent that the optical path from the projector to this entrance pupil is shorter in FIG. 1A than in FIG. 1B.
[0007] The optical apertures of the waveguides are actually defined in two dimensions. In particularly preferred implementations, two dimensions of aperture expansion are performed between the projector exit pupil and the observer's eye. This may be achieved by using an independent waveguide for a first dimension of expansion, as exemplified by the waveguide of FIG. 2A (corresponding to FIG. 12 of PCT publication WO2018065975, which is hereby incorporated in its entirety by reference), where an entrance pupil to the waveguide 24 is defined by two edges 26 and 28. These edges are not necessarily on the same plane. FIG. 2B shows a "1D" or slab-type waveguide 30 performing 2D aperture expansion by use of two sets of included partially-reflecting surfaces. In this case, waveguide edges 34 determine one side of the entrance pupil (marked area) while the edge on the other dimension 35 is not uniquely defined (schematically shown as arrow 36), allowing the entrance pupil in this dimension to vary along the waveguide plane.
SUMMARY OF THE INVENTION
[0008] The present invention is an image projector.
[0009] According to the teachings of an embodiment of the present invention there is provided, an image projector for projecting a collimated image via an exit stop for injection into an input stop of a light-guide optical element, the collimated image being a representation of a digital image with a field of view, the image projector comprising: (a) an illumination arrangement comprising a plurality of illumination sources; (b) a tilt-mirror assembly comprising a mirror and a driver for driving tilt motion of the mirror; (c) a controller in electronic connection with the driver and the illumination arrangement; and (d) an optical arrangement comprising a plurality of optical elements deployed to: (i) direct illumination from the plurality of illumination sources towards the mirror; (ii) direct the illumination reflected from the mirror towards an image plane; and (iii) collimate illumination from the image plane to generate a collimated image directed to the exit stop, wherein the controller modulates an intensity of each of the illumination sources synchronously with the tilt motion of the mirror according to the content of the digital image, and wherein the plurality of illumination sources are spaced apart and the tilt motion is such that illumination from each of the illumination sources scans across only part of one dimension of the field of view while illumination from the plurality of illumination sources together scans across the entirety of the one dimension.
[0010] According to a further feature of an embodiment of the present invention, the optical arrangement substantially images the mirror to the exit stop.
[0011] According to a further feature of an embodiment of the present invention, the tilt-mirror assembly is part of a two-axis scanning arrangement such that illumination from each of the illumination sources scans across the image plane in a two-dimensional scanning pattern.
[0012] According to a further feature of an embodiment of the present invention, the spaced-apart illumination sources are part of a two dimensional array of illumination sources spaced apart in two dimensions, and wherein the two-dimensional scanning pattern is such that illumination from each of the illumination sources scans across only part of each dimension of the field of view while illumination from the plurality of illumination together scans across the entirety of both dimensions of the field of view.
[0013] According to a further feature of an embodiment of the present invention, each of the spaced-apart illumination sources is part of a group of illumination sources that cooperate to generate a substantially continuous illumination pattern spanning a dimension of the field of view perpendicular to a scanning-direction dimension of the field of view.
[0014] According to a further feature of an embodiment of the present invention, the optical arrangement is configured to focus the illumination reflected from the mirror at the image plane such that each of the illumination sources generates an instantaneous spot at the image plane corresponding to a single pixel of the digital image.
[0015] According to a further feature of an embodiment of the present invention, there is also provided a spatial light modulator deployed at the image plane, and wherein the optical arrangement is configured to generate a patch of illumination from each of the illumination sources illumination a plurality of pixel elements of the spatial light modulator, the spatial light modulator being driven by the controller in coordination with the illumination arrangement to generate a reproduction of the digital image.
[0016] According to a further feature of an embodiment of the present invention, all of the plurality of illumination sources are of a single color, and wherein each of the plurality of illumination sources is associated with two additional illumination sources of different colors, making up a triplet of red, green and blue colored illumination sources.
[0017] There is also provided according to the teachings of an embodiment of the present invention, an image projector for projecting a collimated image via an exit stop for injection into an input stop of a light-guide optical element, the collimated image being a representation of a digital image with a field of view, the image projector comprising: (a) an illumination arrangement comprising a plurality of illumination sources; (b) a tilt-mirror assembly comprising a mirror and a driver for driving tilt motion of the mirror; (c) a spatial light modulator having individually controlled pixel elements; (d) a controller in electronic connection with the spatial light modulator, the driver and the illumination arrangement; and (e) an optical arrangement comprising a plurality of optical elements deployed to: (i) direct illumination from the plurality of illumination sources towards the mirror; (ii) direct the illumination reflected from the mirror towards the spatial light modulator such that illumination from each of the illumination sources generates a patch of illumination illuminating a plurality of the pixel elements of the spatial light modulator; and (iii) collimate illumination from the spatial light modulator to generate a collimated image directed to the exit stop, wherein the controller drives the spatial light modulator in coordination with modulation of an intensity of each of the illumination sources synchronously with the tilt motion of the mirror to generate a reproduction of the digital image, and wherein the plurality of illumination sources comprises at least one group of individually controlled illumination sources generating a substantially continuous illumination pattern spanning at least part of a dimension of the field of view perpendicular to a primary scanning-direction dimension of the field of view.
[0018] According to a further feature of an embodiment of the present invention, the group of individually controlled illumination sources generates a substantially continuous illumination pattern spanning an entirety of a dimension of the field of view perpendicular to the primary scanning-direction dimension of the field of view.
[0019] There is also provided according to an embodiment of the present invention, an image projector for projecting a collimated image via an exit stop for injection into an input stop of a light-guide optical element, the collimated image being a representation of a digital image with a field of view, the image projector comprising: (a) an illumination arrangement comprising a plurality of illumination sources of different colors; (b) a tilt-mirror assembly comprising a mirror and a driver for driving tilt motion of the mirror between a plurality of positions; (c) a spatial light modulator having individually controlled pixel elements; (d) a controller in electronic connection with the spatial light modulator and the driver; and (e) an optical arrangement comprising a plurality of optical elements, the optical arrangement being configured to: (i) direct illumination from the plurality of illumination sources towards the mirror; (ii) direct the illumination reflected from the mirror towards the spatial light modulator such that illumination from one of the illumination sources illuminates the spatial light modulator; and (iii) collimate illumination from the spatial light modulator to generate a collimated image directed to the exit stop, wherein the controller drives the driver to displace the mirror between a first of the positions, in which the spatial light modulator is fully illuminated by a first of the illumination sources, and a second of the positions, in which the spatial light modulator is fully illuminated by a second of the illumination sources, thereby switching between colors of illumination, the controller actuating the spatial light modulator synchronously with switching between colors of illumination to generate corresponding content of the digital image for each of the colors of illumination.
[0020] According to a further feature of an embodiment of the present invention, in each of the positions of the mirror, the optical arrangement is configured to focus an image of one of the illumination sources onto the spatial light modulator.
[0021] There is also provided according to an embodiment of the present invention, an image projector for projecting a collimated image via an exit stop for injection into an input stop of a light-guide optical element, the collimated image being a representation of a digital image with a field of view, the image projector comprising: (a) an illumination arrangement comprising at least one illumination source; (b) a first tilt-mirror assembly comprising a first mirror and a first driver for driving tilt motion of the first mirror about a first tilt axis; (c) a second tilt-mirror assembly comprising a second mirror and a second driver for driving tilt motion of the second mirror about a second tilt axis; (d) a controller in electronic connection with the first and second drivers and with the illumination arrangement; and (e) an optical arrangement comprising a plurality of optical elements deployed to: (i) direct illumination from the at least one illumination source towards the first mirror; (ii) direct the illumination reflected from the mirror towards the second mirror; and (iii) collimate illumination from the second mirror to generate a collimated image directed to the exit stop, wherein the controller modulates an intensity of the at least one illumination source synchronously with the tilt motion of the first and second mirrors according to the content of the digital image, and wherein the optical arrangement is configured such that both the first mirror and the second mirror are located substantially in planes containing an image of the exit stop of the image projector.
[0022] According to a further feature of an embodiment of the present invention, the at least one illumination source is implemented as a plurality of spaced-apart illumination sources, and wherein the tilt motion of one of the first and second mirrors is such that illumination from each of the illumination sources scans across only part of one dimension of the field of view while illumination from the plurality of illumination sources together scans across the entirety of the one dimension.
[0023] According to a further feature of an embodiment of the present invention, the spaced-apart illumination sources are part of a two dimensional array of illumination sources spaced apart in two dimensions, and wherein the tilt motion of each of the first and second mirrors is such that illumination from each of the illumination sources scans across only part of each dimension of the field of view while illumination from the plurality of illumination together scans across the entirety of both dimensions of the field of view.
BRIEF DESCRIPTION OF THE DRAWINGS
[0024] The invention is herein described, by way of example only, with reference to the accompanying drawings, wherein:
[0025] FIGS. 1A and 1B, discussed above, are schematic side views of an image projector optically coupled to a light-guide optical element according to two conventional approaches;
[0026] FIGS. 2A and 2B, discussed above, are schematic isometric views illustrating certain geometrical definitions relating to coupling-in of an image into a light-guide optical element;
[0027] FIGS. 3A and 3B are two schematic representations of an image projector, constructed and operative according to the teachings of certain embodiments of the present invention;
[0028] FIGS. 4A-4C are schematic side views of a first optical arrangement for implementing an image projector, constructed and operative according to an embodiment of the present invention, illustrating different subsets of the ray paths through the arrangement;
[0029] FIGS. 5A-5D are schematic side views of a second optical arrangement for implementing an image projector, constructed and operative according to an embodiment of the present invention, illustrating different subsets of the ray paths through the arrangement, with and without scanning mirror displacement;
[0030] FIGS. 6A and 6B are a schematic side view and bottom view of a third optical arrangement for implementing an image projector and output waveguide, constructed and operative according to an embodiment of the present invention;
[0031] FIGS. 7A-7C are schematic side views of a fourth optical arrangement for implementing an image projector, constructed and operative according to an embodiment of the present invention, employing two single-axis tilt-mirror assemblies, illustrating different subsets of the ray paths through the arrangement;
[0032] FIGS. 7D-7F are schematic side views of a fifth optical arrangement for implementing an image projector, constructed and operative according to an embodiment of the present invention, employing two single-axis tilt-mirror assemblies, both located at different planes in which the exit pupil is reimaged, illustrating different subsets of the ray paths through the arrangement;
[0033] FIGS. 8A-8D are schematic representations of various illumination patterns and corresponding scanning patterns for use in an image projector according to the teachings of an embodiment of the present invention;
[0034] FIG. 9A is a schematic side view of an optical arrangement similar to FIG. 7A illustrating use of spaced-apart illumination sources to achieve reduced scanning angle requirements;
[0035] FIGS. 9B-9D are schematic representations of various illumination patterns and corresponding scanning patterns for use in an image projector according to FIG. 9A;
[0036] FIG. 10A is a schematic side view of an optical arrangement for implementing a projector in which a scanning arrangement is used for switching between illumination sources;
[0037] FIG. 10B is a schematic representation of a footprint of a spatial light modulator on the plurality of illumination sources, selecting a central LED;
[0038] FIGS. 10C and 10D are views similar to FIGS. 10A and 10B, respectively, illustrating selection of an alternative LED;
[0039] FIG. 11 is a block diagram of a system for implementing various embodiments of the present invention; and
[0040] FIG. 12 is a schematic representation of a reduced-intensity illumination scheme employing variable intensity illumination.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0041] The present invention is an image projector.
[0042] The principles and operation of image projectors according to the present invention may be better understood with reference to the drawings and the accompanying description.
[0043] By way of introduction, the present invention relates to image projectors with various arrangements employing a tilt-mirror assembly with an illumination system as part of the image generating subsystem. The subject matter described herein can be conceptually subdivided into a number of different aspects of the invention which each stands alone in its own right, but which are most preferably used to advantage in various combinations. All combinations of the various aspects of the invention discussed below should be considered within the scope of the invention, except where specifically indicated to be incompatible.
[0044] Referring now to the drawings, FIG. 3A illustrates schematically an image projector according to a first aspect of the present invention, for projecting a collimated image via an exit stop 45. The image passes through an image plane 46 where, at least in certain embodiments, an image is generated by a spatial light modulator (SLM) providing a two dimensional array of pixel elements, each of the pixel elements being controllable to modulate a property, typically polarization, of light transmitted or reflected by the pixel element. An example of a transmitted light SLM is a liquid crystal display (LCD), while an example of a reflective SLM is a liquid crystal on silicon (LCOS) device or a digital light processing (DLP) device. The schematic representation here illustrates progression along an optical path from left to right, but it will be appreciated that this optical path can be folded at various reflective elements, including at LCOS 46, as will be exemplified in examples below. A collimating arrangement 44 of at least one optical element is configured to collimate illumination from the image plane (e.g., spatial light modulator) to generate a collimated image directed to exit stop 45, for injection into an input stop of a light-guide optical element (waveguide).
[0045] The image projector also includes an illumination arrangement delivering illumination from an illumination stop 42, and illumination optics 43 deployed in the optical path between illumination stop 42 and image plane 46. Preferably, in order to achieve high optical efficiency, illumination optics 43 and collimating arrangement 44 are configured such that an image of illumination stop 42 falls substantially on exit stop 45. This achieves "pupil imaging", ensuring that illumination rays directed from illumination stop 42 towards the SLM are efficiently directed towards the exit stop 45.
[0046] Light can be delivered to entrance stop 42 from any suitable light source 41, and can be concentrated by any suitable components, whether optical imaging components (lenses, mirrors) or non-imaging (light-pipe, diffusers) components. After illumination stop 42, only imaging optical components are used, so that "pupil-imaging" is achieved. Exit stop 45 is preferably the entrance into a light-guide optical element, such as those illustrated in FIGS. 1A, 1B, 2A and 2B, that relays the image to the observer (not shown). In a case of perfect pupil imaging, any light ray passing through stop 42 and falling on illumination optics 43 will reach exit stop 45 (subject to image modulation) and enter the waveguide, thereby achieving maximal illumination efficiency. Practically, much of the advantage of this aspect of the invention can be achieved by having the image of the illumination stop falling "substantially" on exit stop 45, taken here to mean that at least half of the rays exiting illumination stop 42 and reaching illumination optics 43, and more preferably at least 80 percent, fall on exit stop 45.
[0047] The image passing through exit stop 45 to an LOE must be collimated, i.e., where every point in the image is represented by a set of parallel rays that fill stop 45 uniformly. Image formation can be achieved using three main alternatives: [0048] 1. Scanning: The source 41 is a point source and the image is generated by using a scanning mirror at stop 42 to scan successive pixels, together with synchronized modulation of the illumination intensity according to the image information for each pixel of the image. In this case, no modulator is required at image plane 46. [0049] 2. Spatial modulation: A spatial light modulator is placed at the image plane 46, which corresponds to the focal plane of collimating arrangement 44. The modulator can be, for example, an LCOS, an LCD or a DLP device. [0050] 3. Combination: scanning at stop 42 with spatial modulation at plane 46.
[0051] FIG. 3B shows architecture equivalent to FIG. 3A only with larger distance between exit pupil 45 and first lens 44, more suitable for implementing certain optical designs, such as the perpendicular coupling in of FIG. 1B. The larger distance between 45 and 44 dictates use of a larger lens 44, and also shifts the pupil image plane 42 closer to image plane 46. As a result, space limitations typically dictate placing lens 43 adjacent to illumination stop 42, and typically prior to the illumination stop along the optical path.
[0052] In the examples given below, reference will be made to an LCOS spatial light modulator, but it should be noted that this is a non-limiting example of a spatial light modulator, and that variant implementations employing other types of spatial light modulator may readily be implemented by a person having ordinary skill in the art on the basis of the description herein.
Optical Arrangement of Double PBS Incorporating Scanner
[0053] FIGS. 4A-4C shows an architecture equivalent to FIG. 3A based on two PBS (Polarizing Beam Splitters). Light source 51 transmits light onto PBS 40a, to lens 53 and onto scanning reflecting mirror 52. Hereafter, throughout this document, it is taken as a given that a quarter wave-plate is used after PBS reflection and before PBS transmission, and vice versa, as is known in the art, but this detail will be omitted for simplicity of presentation. The light reflects from mirror 52 and is transmitted through PBS 40a, reflected by mirror 57 (which may be a plane mirror as shown or may have optical power), reflected by PBS 40a and by PBS 40b so as to be directed onto LCOS imaging matrix 56. From the LCOS, the light pass through PBS 40b onto lens 54, back to PBS 40b and onto exit pupil 55 that is also the entrance pupil to the waveguide.
[0054] FIG. 4B shows only part of the rays that are focused on scanning mirror 52 and focus once again by the optics on pupil 55. This way the scanning mirror at image of exit pupil can perform scanning while maintaining illumination into pupil 55.
[0055] FIG. 4C shows a single point in image field that is focused on LCOS 56 and also being focused also in source plane 51. This way scanner 52 can scan illumination spot from 51 into LCOS 56. In preferred embodiment, if a single spot source is used (such as a laser) then a diffuser is placed in the optical path multiple pixels are illuminated on LCOS. Alternatively, the LCOS can be replaced by a reflecting lens (flat or curved) and laser maintained focused by imaging optics all the optical path without diffusers or other non-imaging components.
[0056] It is apparent that in configuration of FIGS. 4A-4C the distance between image plane 56 and the pupil image 52 is relatively large (as a result of a relatively short distance between pupil 55 and lens 54) therefore this configuration is more appropriate for diagonal coupling as described in FIG. 1A.
[0057] In FIG. 5A, the exit pupil 65 is further away from lens 64 therefore the scanning mirror 63 placed at shorter optical path from the image at 66 relative to the configuration in FIG. 4A. As shown in FIG. 5B, here exit pupil 65 is refocused to plane 62 without an additional optical path through PBS 40a. This configuration is equivalent to the one shown in FIG. 3B and useful when implementing the coupling arrangement shown in FIG. 1B.
[0058] FIGS. 5C and 5D show scanning of mirror 62 so light source 61 illuminates different angular points of the field as exiting pupil 65 or as illuminating LCOS 66.
[0059] As previously mentioned, it is also possible to place a static mirror at 66 (without any spatial light modulator) and use a focused beam from a small-spot illumination source (e.g., laser beam, S-LED, edge-emitting diode or the like) for which the focused illumination spot at the focal plane is no larger than dimensions of a pixel of the image to achieve efficient image generation by scanning only.
Single Axis Scanner without Pupil Imaging
[0060] FIGS. 6A and 6B show an optical arrangement of a projector with perpendicular coupling as described in FIG. 1B. FIG. 6A shows a side view and FIG. 6B shows a bottom view. In this case, waveguide 14 has an entrance pupil defined by 32. The coupling orientation of reflecting mirror 18 is perpendicular to the orientation of the projector PBS, so that it is better seen in the bottom view of FIG. 6B.
[0061] According to the principles set out thus far for preferred implementations, the entrance pupil 32 of the waveguide (shown as light rays focus 166C) would be imaged onto scanning mirror 162 (as was illustrated in FIGS. 4B and 5B). However, if the scanner scans only in one dimension and the scanning axis is as shown by the dashed line in FIG. 6B, then the pupil imaging requirement can be relaxed, provided that a suitable waveguide configuration is chosen. In this example, the image of the pupil is at 166D (not on mirror 162). In this case, the scanning will cause the exit pupil from the projector to travel along arrow 36 (FIG. 2B). This type of pupil movement along the waveguide does not degrade coupling efficiency, so long as the waveguide includes two-dimensional pupil expansion.
Separate Pupils
[0062] In certain embodiments of the present invention, such as will be described in more detail below, it may be desirable to perform two-dimensional scanning of the illumination across the image plane, typically in a raster pattern, where a first, more rapid, scanning direction is referred to as the primary scanning direction, and a direction perpendicular to the primary scanning direction is referred to as a secondary scanning direction. Although two-axis scanning can be performed using a single mirror, in many cases, lower costs and improved reliability can be achieved by employing two separate scanning mirrors, each with its own actuator, each providing tilt about a single axis. Where two single axis scanners are used, it is impossible to place these two axis mirrors in a single plane that is the image of the exit pupil. According to an aspect of the present invention, each single axis scanning mirror can be placed substantially at a plane containing an image of the effective waveguide pupil for the corresponding axis. These distinct locations for the waveguide pupil for two different axes are exemplified in FIG. 2A as edges 26 and 28, and in FIG. 2B as dimensions 34 and 35.
[0063] FIG. 7A shows an exemplary system with two tilt-mirror assemblies including two distinct mirrors 302, 304, each with its own actuator as part of a driver (not shown). The light originates from source 300, is reflected onto first scanning mirror 302 then second scanning mirror 304. The light then continues to LCOS (or mirror) 306 and collimating lens 308, before being projected into the waveguide (not shown) where it impinges on folding mirror 18 and then waveguide entrance 312. This system is a further example of a system having two effectively distinct entrance apertures to the waveguide: the entrance pupil in the dimension in which the illumination is guided within the waveguide is delimited by waveguide aperture 312 (corresponding to edge 34 of FIG. 1B) while the pupil stop in the transverse dimension (perpendicular to the drawing plane) may be designed to lie at folding mirror 18 (although other locations are also possible).
[0064] FIG. 7B illustrates that a point on folding mirror 18 is imaged to scanning mirror 302. It follows that the scanning axis of scanning mirror 302 should be horizontal to the page (shown by dot-dash line). FIG. 7C illustrates that a point on pupil plane 312 is imaged onto scanning mirror 304. It follows that scanning mirror 304 should be implemented with a rotation axis perpendicular to drawing plane.
Double Pupil Imaging
[0065] As an alternative to the approach of FIG. 7A, according to another aspect of the present invention, two-axis scanning can advantageously be achieved by twice imaging of the exit pupil 312 on both separated mirrors. FIG. 7D shows schematically how first pupil image 42V (vertical scanner) is reimaged onto another pupil image 42H (horizontal scanner).
[0066] FIGS. 7E and 7F show optical arrangement including double pupil imaging where a point source 300 is scanning the image without spatial image modulator. FIG. 7E shows point from exit pupil 312 is imaged onto first vertical scanning mirror 42V and being reimaged onto horizontal scanning mirror 42H. FIG. 312 shows that point source is collimated at exit pupil 312. This architecture can be used to advantage when scanning with a single laser or other single-pixel illumination source modulated to generate an image. Alternatively, it may be used to advantage with various multi-source illumination schemes, and is particularly suited to the various "spaced sources" illumination schemes described below.
Scanned Illumination Schemes
[0067] Up to this point, a number of novel optical arrangements have been presented to provide capabilities of scanned illumination, either as a primary image generation mechanism or for use in combination with a spatial light modulator. Presented below are a number of particular implementations which are facilitated by, and can advantageously be implemented using, one or more of the above optical arrangements.
[0068] By way of introduction, FIG. 11 is a block diagram illustrating the main components of an image projector, generally designated 800, for projecting a collimated image via an exit stop for injection into an input stop of a light-guide optical element (waveguide entrance 802). The collimated image is a representation of a digital image with a certain desired field of view, as provided to the system as an image input 804. In general terms, image projector 800 includes an illumination arrangement 806 which includes a plurality of illumination sources 808, numbered here as sources 1, 2 . . . n (although certain implementations may have only two illumination sources). The types of illumination sources 808 used, and the relative deployment of those sources, will be discussed in detail below in the context of each application. A scanning arrangement 810 includes at least one tilt-mirror assembly 812 that has a mirror 814 and a driver 816 for driving tilt motion of the mirror 814. The tilt-mirror assembly may be implemented using a range of commercially available products well known in the art. Where two-axis scanning is required, either a two-axis tilt-mirror assembly may be used, also as commercially available, or a single axis tilt-mirror assembly 812 may be used as a primary scanning mechanism, supplemented by a secondary tilt-mirror assembly 818 with its own mirror 820 and driver 822.
[0069] Various aspects of the present invention (although not all, as detailed below) also employ a spatial light modulator (SLM) 824 having individually controlled pixel elements in a pixel array 826 driven by suitable driver circuitry 828, all as is well known in the art. The SLM may employ any suitable technology, such as for example LCD for transmission configurations or an LCOS or a DLP device for reflective configurations. In each case, the SLM is in itself typically a standard commercially available product.
[0070] A controller 830, typically including one or more processors 832 and at least one data storage device 834, is provided in electronic connection with spatial light modulator 824 (if present), tilt-mirror assembly driver(s) 816 (and 822 if present) and the illumination arrangement 806. Controller 830 may be implemented using dedicated circuitry, general purpose processors operating under suitable software, or any other combination of hardware, firmware and/or software, as is known in the art. Furthermore, the structure and functions of controller 830 may be subdivided between two or more physical subsystems, and some of its functions may be performed by remote devices and/or dynamically allocated resources of a virtual machine or otherwise defined "cloud" computer.
[0071] The optical relationships between the various components are defined by an optical arrangement 836 including a plurality of optical elements (typically including collimating optics and illumination optics based on any combination of reflective and/or refractive lenses, mirrors, beam splitters, quarter wave-plates, and transparent blocks defining surfaces for maintaining components in optical alignment. Examples of suitable optical arrangements for implementing various aspects of the present invention may be found in the designs of FIGS. 3A-7C, as described above.
[0072] In general, the various elements of optical arrangement 836 are deployed so as to direct illumination from plurality of illumination sources 808 towards mirror 814 (and 820 if present), to direct the illumination reflected from the mirror(s) towards the SLM 824 (where present), and to collimate illumination from SLM 824 to generate a collimated image directed to the exit stop and the waveguide entrance.
[0073] Although the present invention may be implemented using solely refractive optical components and free-space optics, it is considered preferable in many cases to employ implementations without an air gap in the optical path between the illumination optics and the exit stop, and most preferably, from the illumination stop to the exit stop. At least some if not all elements with optical power are preferably implemented as reflective lenses. The optical path of the devices described herein typically includes certain components, such as laser light sources and scanning mirror components, which inherently include some internal air space. Even here, however, the components are preferably encapsulated components which can be integrated with the rest of the optical system without any "inter-component air gaps", i.e., where there are no air gaps other than internal spaces within encapsulated components. The use of an architecture without inter-component air gaps helps to ensure minimal performance degradation over time due to environmental changes or penetration of dirt into the system.
[0074] Various implementations of the present invention as described herein employ a plurality of independently controllable (i.e., intensity modulated) illumination sources which each scan across an SLM while instantaneously illuminating a plurality of pixel elements. In other words, illumination from each of the illumination sources generates a patch of illumination illuminating a plurality of the pixel elements of the spatial light modulator, and the intensity of illumination of each patch is varied as the scanning arrangement moves the illumination pattern across the SLM. The resulting sequential illumination of different regions of the two-dimensional pixel array allows savings in illumination power in various ways. Firstly, in regions where no image content is required, the illumination source need not be actuated, thereby saving significant power. An example of such an application is an augmented reality application where much of the display area is left inactive, to allow an undisturbed review of the real world, and only selected regions of the display are actuated to provide the augmented reality content.
[0075] In other situations, even where a region of the display is active, it may still be possible to save display power in accordance with a local maximum required display intensity. Specifically, according to a further aspect of certain implementations of the present invention, the display controller is configured to: (a) determine a maximum required intensity of a pixel of the digital image in a part of the digital image corresponding to each of the regions of the two-dimensional array; (b) determine a reduced illumination level for at least one of the regions sufficient to generate the corresponding maximum required intensity within the regions; (c) generate a modified pixel intensity map for pixels within the at least one region for generating a required projected image intensity based on the reduced illumination level; and (d) actuate the illumination arrangement to illuminate at least one region with the reduced illumination level while the pixel elements within the at least one region are actuated according to the modified pixel intensity map.
[0076] This feature is illustrated here with reference to a one-dimensional scanning pattern, but can equally be implemented for more complex illumination scanning patterns. FIG. 12 illustrates a simple pattern 900 (for illustrative purposes) corresponding to an input image for display over a field of view 908. The input image has variable image intensity over field of view 908. The darker image here portrays higher intensity. This image is for a single color and three such images generate every frame for all colors. The dashed lines are for ease of reference to features between the different representations of the Figure. Parenthetically, whenever reference is made herein to a "field of view", this refers interchangeably to the span of angles (angular field of view) spanned by pixels of the image in the collimated image at the projector exit pupil and to the spatial field of view at the image plane (e.g., LCOS surface).
[0077] If the LCOS were to be scanned with a beam at constant maximum intensity, this image as illustrated in pattern 900 would be loaded as is, and scanning with the maximum intensity beam would generate the desired output image. As an alternative, according to an aspect of the present invention, graph 902 illustrates a "maximum required intensity" for each column of FIG. 900. This pattern is then used to set a corresponding profile of laser intensity as the illuminating pattern (here assumed to be a line spanning a dimension perpendicular to the primary scanning direction) scans across the LCOS. In a region for which the illumination intensity is reduced, less attenuation is required from the LCOS 824. Image 904 shows the resulting illumination intensity across the LCOS. At beginning of scan (covering area 905a of the array) there is no laser illumination. For area 905b, an intermediate intensity is used, corresponding to a "reduced illumination level". Area 905c is illuminated with maximal intensity and at the final section (area 905d) requires no illumination.
[0078] Image 906 corresponds to a modified pixel intensity map such that the product of the modified pixel intensity of 906 and the illumination level for a given column (or more generally, illumination region) from 904 will generate the desired output image intensity 900. Thus, the image 906 (the actual image loaded to the LCOS) is generated by dividing the required image 900 by the illumination image 904.
[0079] In practice, each illumination region typically covers a number of columns in the scanning direction simultaneously and, as a result, the illumination image 904 will typically be smooth with gradual transitions, even if the illumination output is driven by a step function, as the overall intensity of illumination for each column will be the integral of the illumination as the illumination line passes. The calculation of the loaded image 906 as the desired output image 900 divided by the illumination level 904 remains valid. In each case, controller 830 drives the spatial light modulator 824 in coordination with modulation of an intensity of each of the illumination sources 808 synchronously with the tilt motion of the mirror 814 to generate a reproduction of the digital image.
Vector of Sources
[0080] In certain implementations of the present invention, the plurality of illumination sources 808 include at least one group of individually controlled illumination sources generating a substantially continuous illumination pattern spanning at least part, and in some cases the entirety, of a dimension of the field of view perpendicular to the primary scanning-direction dimension of the field of view. This reduces the required repetition frequency and/or scanning motion speed required by the scanning arrangement.
[0081] FIG. 8A shows an architecture where the light from source (for example 51 or 61) is distributed as a line or other oblong shape 260 as imaged across LCOS active area 258 (56 or 66). This line distribution can be generated by an elliptical diffuser placed along the optical path before or near the scanning mirror. It can also be generated by imaging the emitting output facet of a laser onto the LCOS, or by a combination of the above.
[0082] Here and in other examples, illumination source 808 is most preferably a laser, and is collimated by suitable optics onto scanning mirror 814, preferably implemented as a high-speed mirror (typically using MEMS technology). Non-collimated illumination may also be used, as long as the SLM is properly illuminated. It is preferable that the spot size is large enough to cover a relatively large number of pixels at any instant, typically at least 10, preferably at least 100, and in some preferred cases at least 1000 pixels or in excess of 10,000 pixels (e.g., 100.times.100 pixels or larger), thereby reducing scanning speed requirements. The shape of the illuminating spot can be modified, for example, by the shape of the emitter beam from source 808, optical properties of the source collimation optics, deployment of a diffuser on the scanning mirror and/or deployment of a diffuser in the illumination path. Where diffusers are used, the diffuser is preferably a structured diffuser with a specifically chosen angular distribution of the output light, such as those commercially available from RPC Photonics (NY, USA).
[0083] In contrast to the single source illustrated in FIG. 8A, FIGS. 8B-8D illustrate more preferred implementations in which at least one group of individually controlled illumination sources generating a substantially continuous illumination pattern spanning at least part, and in some cases the entirety, of a dimension of the field of view perpendicular to the primary scanning-direction dimension of the field of view. In this case, the scanning motion is preferably such that the illumination patch from each individual illumination source does not scan over the entire image field of view, but that the plurality of illumination sources (for any given color) together with the scanning motion ensure that the entire active area of the SLM 824 is covered (for each color).
[0084] FIG. 8B shows the illumination distribution of an array of lasers 600 (in this case three lasers placed in a line at source plane 51 or 61) where every laser illuminates a strip or patch that is individually only part of a dimension of the LCOS, but together span an entirety of one dimension of the LCOS. This allows the use of simple one-axis scanning by tilt-mirror assembly 812 to cover the entire active area of the SLM. Each strip or patch illuminates multiple pixels of the LCOS simultaneously. The intensity of each laser is modulated according to the maximum image intensity required in the corresponding strip or patch, and the intensity of the LCOS pixels are modulated in order to provide the desired pixel intensity scaled according to the illumination intensity, as explained above with reference to FIG. 12. Thus, if the maximum pixel intensity within the region corresponding to a certain laser at a certain position is 60% of the maximum intensity, the corresponding laser is preferably actuated at 60% intensity, while LCOS pixels with 60% intensity will be actuated at 100% (maximum) intensity and pixels requiring 40% intensity output will be actuated at 66% intensity. If in the neighboring region there is a pixel requiring 80% intensity, the corresponding laser is preferably actuated at 80% intensity, and any pixel in that region requiring 40 intensity will be actuated at 50% brightness level.
[0085] The same principles can be applied with slightly more complex calculations where a continuous scanning action is used, and the overall pixel intensity depends on the integral of the illumination intensity for the period the laser illumination pattern is passing across a given pixel as well as the pixel intensity setting. As previously described, a rectangular or elliptical diffuser (or circular as shown) can be used to generate the illumination pattern for each laser, but with lower angular divergence than that of FIG. 8A.
[0086] If mechanical limitations prevent placing the lasers side-by-side then a staggered configuration may be used, as shown schematically in FIG. 8C. A staggered configuration is also possible if different arrays are needed for the different colors (e.g., R, G and B). In this case, the linear scanning motion should be long enough to ensure that each illumination region scans across the entire active area of the LCOS.
[0087] FIG. 8D shows schematically that the staggered configuration can also be used for 2D scanning thereby enabling reduced scanning speed of the second axis of the scanner.
[0088] The scanner can be activated in step-and-illuminate mode if the image of the illuminating source covers a substantial area of the LCOS.
[0089] Here a laser refers to a high brightness source. For example, a bright LED with small divergence (such as an S-LED or edge-emitting LED) can also be used.
Scanning Spaced Sources
[0090] As an addition, or alternative, to the contiguously grouped illumination patterns described above, according to another aspect of the present invention, certain implementations of the present invention employ illumination sources that are spaced apart to reduce the angular extent of a scanning motion which is required to span a field of view of the image to be projected. Specifically, by using spaced-apart illumination sources, the tilt motion of tilt-mirror assembly 812 can be reduced such that illumination from each of the illumination sources scans across only part of one dimension of the field of view while illumination from the plurality of illumination sources together scans across the entirety of the one dimension.
[0091] By way of introduction to this feature, and for the purpose of facilitating an understanding of the invention without in any way limiting the invention to any specific theoretical basis, the scanning mirrors of the projector must typically preserve the etendue (product of angular and spatial size) of the system. For example if the entrance pupil to the waveguide is 2.5 mm and the angular field of the image injected is 40 degrees then the etendue will be:
2.5 [mm].times.40[deg]=100 [mm deg]
[0092] The scanning mirror must fulfill this parameter by having the product of size and angular tilt having same value. For example, a mirror having aperture of 2 mm must have an optical scan angle of:
100 [mm deg]/2 [mm]=50 [deg].
[0093] However, in many cases it is difficult to obtain large aperture and large angular scan at same component. According to an aspect of the present invention, spaced sources are used to segment the image field, thereby reducing etendue requirements of the scanning mirror. This configuration is applicable for illuminating an image generating matrix (LCOS) as previously described or for laser point scan of the image, where modulation of scanned laser point illumination is the sole image generation mechanism. FIG. 9A shows architecture similar to FIG. 7A in which laser sources 630A, 631A and 632A are equivalent laser sources individually modulated while surface 636 is a reflecting mirror (or lens) without an SLM. This way the lasers beams are collimated when exiting pupil 312 into the waveguide. Scanners 304 and 302 are positioned at appropriate pupil image locations (as explained above with reference to FIG. 7A) and have appropriate size.
[0094] The equivalent laser sources illuminate points 630B-632B (respectively) in different sub-fields of the image field 640 as shown in FIG. 9B. The points in the field 630B, 631B and 632B are the angular illumination points (size as small as possible and defines image sharpness) within aperture 312 as generated by the corresponding lasers. These spots are scanned across the field as shown schematically by curved line arrows. The arrangement of 3.times.1 lasers illumination separates the image field 640 to three (in this example) smaller sub-fields associated with every laser show as dashed rectangle. Consequently, the required angular scanning amplitude of mirror 304 (the primary high-speed scanner) is reduced by a factor of 3 to: 50/3=17 degrees of optical deflection (side to side). During the scan, every laser is modulated individually in order to generate the appropriate part of the image being scanned by the specific laser.
[0095] In FIG. 9C, a 3.times.2 arrangement is shown, so that the horizontal angular image scanning (by mirror 304) is again divided by 3 while the vertical scanning by mirror 302 is divided by two.
[0096] FIG. 9D shows the color sources to be angularly separated. Here the color lasers 637R, 637G and 637B are separated (for example by spatial location in plane 300). The scanning mirrors scan the illumination angler points across the image simultaneously for all sub-fields and colors.
[0097] The multiple separated lasers in FIG. 9 are each responsible for providing only a subsection of the overall image brightness, and can therefore provide a higher brightness display output without exceeding eye-safety levels.
[0098] In a system with direct laser illumination (no LCOS), the placement of lasers at 300 can be on a curved profile according to field curvature of the optics. Specifically, every laser may advantageously be placed at an average focal distance of its assigned sub-field. This way a substantial part of the field curvature can be compensated for.
[0099] Although suitable for implementing a direct-scanning image generation mechanism, this aspect of the invention is not limited to such applications, and can also be used to advantage according to the principles described above, where each illumination source illuminates a group (plurality) of pixels of a SLM located at plane 636. In this case, each of the aforementioned spaced-apart illumination sources is advantageously part of a group of illumination sources that cooperate to generate a substantially continuous illumination pattern spanning at least part of the field of view perpendicular to the primary scanning-direction dimension of the field of view.
Switching Sources
[0100] Turning now to FIGS. 10A-10D, there is illustrated a further aspect of the present invention according to which a tilt-mirror assembly is used to switch between illumination sources of different colors. Specifically, the plurality of illumination sources 808 here include illumination sources of different colors, and the controller 830 drives the scanning arrangement driver 816 to displace mirror 814 between at least a first position, in which the spatial light modulator 824 is fully illuminated by a first of the illumination sources, and a second position, in which the spatial light modulator is fully illuminated by a second of the illumination sources, thereby switching between colors of illumination. Controller 830 also actuates the spatial light modulator 824 synchronously with switching between colors of illumination to generate corresponding content of the digital image for each of the colors of illumination. This eliminates the need to employ a light-pipe or diffuser to mix illumination sources of different colors.
[0101] FIG. 10A shows a first position of a scanning mirror 506. In this position, the center LED 660 is imaged onto the LCOS 507. FIG. 10B shows the footprint of the LCOS 680 on the center LED 660, preferably providing full frame illumination by LED 660.
[0102] FIG. 10C shows scanning mirror 506 tilted in a second position. In this state, LED 670 (for example having a different color) is activated and imaged onto the LCOS 507 as shown by the footprint 680 in FIG. 12D. This illumination switch is synchronized with loading of the corresponding color separation image onto the LCOS. A fast sequence of illumination switch between different color LEDs and appropriate image loading generates a perceived full color image.
[0103] Optionally, the LED configuration can also include a white LED (not shown) in addition to the three RGB LEDs.
[0104] Part or all of the LEDs 650, 660 and 670 can be replaced with a matrix of a single color mini-LEDs thereby achieving sequential selective illumination per color. In this case, the appropriate illumination pattern is loaded to the illumination matrix in sync with loading to the LCOS.
[0105] Part or all of the LEDs 650, 660 and 670 can be replaced with a laser illuminated diffuser, thereby achieving more collimated illumination (less loss) while the mirror 506 vibrates slightly during each laser illumination to eliminate speckles.
[0106] It will be appreciated that the above descriptions are intended only to serve as examples, and that many other embodiments are possible within the scope of the present invention as defined in the appended claims.
