Lumus Patent | Augmented reality imaging system

Patent: Augmented reality imaging system

Drawings: Click to check drawins

Publication Number: 20190377122

Publication Date: 20191212

Applicants: Lumus

Abstract

An optical system is presented for use in an augmented reality imaging system. The optical system comprises a light directing device, and a projecting optical device. The light directing device is configured for directing input light, including light indicative of an augmented image to be projected and input light indicative of a real image of an external scene, to propagate to an imaging plane. The projecting optical device has a fixed field of view and has a plurality of different focal parameters at different regions thereof corresponding to different vision zones within the field of view. The projecting optical device is configured to affect propagation of at least one of light indicative of the augmented image and light indicative of the real image, such that, for each of the different regions, interaction of a part of the light indicative of the augmented image and a part of the light indicative of the real image with said region of projecting optical device directs the parts of augmented image light and real image along a substantially common output propagation path, corresponding to the focal parameter of said region.

Claims

1. An optical system for use in an augmented reality imaging system, the optical system comprising: a light directing device configured for directing input light, including light indicative of an augmented image to be projected and input light indicative of a real image of an external scene, to propagate to an imaging plane; a projecting optical device having a fixed field of view and having a plurality of different focal parameters at different regions thereof corresponding to different vision zones within said field of view, said projecting optical device being configured to affect propagation of at least one of light indicative of the augmented image and light indicative of the real image, such that, for each of said different regions, interaction of a part of said light indicative of the augmented image and a part of said light indicative of the real image with said region directs said part of said light indicative of the augmented image and said part of the light indicative of the real image along a substantially common output propagation path, corresponding to the focal parameter of said region, thereby providing in-focus images in said imaging plane for said part of the light indicative of the augmented image and said parts of the light indicative of the real image of the external scene.

2. The optical system according to claim 1, wherein said different regions of the different focal parameters are discrete regions arranged in a spaced-apart relationship within the field of view of the projecting optical device.

3. The optical system according to claim 1, wherein the projecting optical device has a continuously varying focus across the field of view, thereby said different regions of the different focal parameters.

4. (canceled)

5. The optical system according to claim 3, wherein said light directing device comprises at least one plate having as at least partially reflective or diffractive surface and being configured for reflecting or diffracting said light indicative of the augmented image and transmitting the light indicative of the real image towards the image plane.

6. The optical system according to claim 1, wherein said different vision zones are defined by different regions of the projecting optical device, such that when the optical system is in use, user's line of sight in its different angular orientations intersect with said different regions.

7. The optical system according to claim 1, wherein said plurality of different focal parameters comprises at least first and second focal parameters at the at least first and second regions of the projecting optical device corresponding to at least far and near vision zones for observing far and near objects.

8. The optical system according to claim 1, wherein said projecting optical device is configured to affect light propagation therethrough such that a virtual focal plane is created, which is slanted with respect to an optical axis of the optical system.

9-11. (canceled)

12. The optical system according to claim 1, configured for use in an augmented reality system to be placed in front of a personal multi-focal lens of an observer, said projecting optical device comprising a light projecting unit located in an optical path of light being output from the light directing device and propagating towards the image plane, said light projecting unit having a predetermined optical power profile defining said different focal parameters compensating an optical power profile of the personal multi-focal lens of an observer.

13. The optical system according to claim 1, wherein said projecting optical device comprises an augmented image projecting device and a real image projecting device, each of said augmented image projecting device and real image projecting device comprising at least one respective projecting unit and having the fixed field of view and said plurality of different focal parameters at the different regions thereof corresponding to different vision zones within said field of view, said augmented image projecting device and said real image projecting device being arranged in a spaced-apart relationship along a common optical axis and configured in an opposite symmetric manner, such that said plurality of focal parameters of the real image projecting device compensate effects of said plurality of different focal parameters of the augmented image projecting device.

14. The optical system according to claim 13, wherein the augmented image projecting device and the real image projecting device are accommodated at fixed locations at opposite sides of the light directing device, such that said real image projecting device is located in an optical path of the light indicative of the real image propagating towards the light directing device, and the augmented image projecting device is accommodated at output of the light directing device being in optical path of both the light indicative of the augmented image and the light indicative of the real image.

15. The optical system according to claim 13, wherein each of the augmented image projecting device and the real image projecting device comprises at least one lens, the lenses of said augmented image projecting device and real image projecting device having similar optical properties and being located in a spaced-apart substantially parallel planes along the common optical axis while being oriented in said opposite symmetric manner with respect to a plane of the light directing device, thereby applying opposite optical effects to the light passing therethrough.

16. The optical system according to claim 5, wherein the light directing device comprises a light transmitting waveguide configured for receiving the input light indicative of an augmented image to be projected, guiding said input light by total internal reflection, and coupling the light out of the waveguide to propagate to the image plane.

17. The optical system according to claim 13, wherein: the light directing device comprises an array of at least two light directing units located in a spaced-apart relationship along an optical axis of the system, the light directing units being operable to selectively involve one of them in an imaging session; and the projecting optical device comprises a plurality of light projecting units located in a spaced-apart relationship along an optical axis of the system such that each of the light directing units is located between the light projecting units, providing that depending on the selected light directing unit being involved in the imaging session, one or more of the light projecting units are located in an optical path of the light indicative of the real image propagating towards the selected light directing unit, and one or more of the other light projecting units are located at output of the selected light directing unit and are in optical path of both the light indicative of the augmented image and the light indicative of the real image.

18. The optical system according to claim 17, wherein each of the light projecting units comprises at least one lens having a predetermined optical power profile defining said different focal parameters, each of the light projecting units being configured such that, location of the selected light directing unit defines selected one or more of the light projecting units interacting with the light indicative of the augmented image and the light indicative of the real image, and defines one or more of the other light projecting units interacting only with the light indicative of the real image.

19. The optical system according to claim 18, wherein the light projecting units are configured to induce a compensation optical effect on the light indicative of the real image, such that the interaction of a part of the light indicative of augmented image with one or more regions of said one or more light projecting units, respectively, induces a desired effect of focal distance change on said part of the light indicative of augmented image, while the interaction of a part of the light indicative of the real image with one or more regions of said one or more of the other light projecting units induces said compensation optical effect on the part of the light indicative of the real image, thus keeping a focal distance of said part of the light indicative of the real image substantially unchanged.

20. (canceled)

21. The optical system according to claim 1, wherein the projecting optical device comprises at least one lens, the lens having one of the following configurations: a bifocal lens, trifocal lens, continuously changing focal distance lens.

22. An optical system for use in augmented reality system, the optical system comprising: a light directing device configured for directing input light, including light indicative of an augmented image to be projected and input light indicative of a real image of an external scene, to propagate to an imaging plane; and a projecting optical device configured with a fixed field of view and one or more fixed profiles of optical properties within said field of view, said projecting optical device being configured for affecting at least the light indicative of the augmented image to create a virtual focal plane slanted with respect to an optical axis of the optical system.

23-24. (canceled)

25. An optical system for use in an augmented reality imaging system, the optical system comprising: a light directing device configured for directing input light, including light indicative of an augmented image to be projected and input light indicative of a real image of an external scene, to propagate to an imaging plane, wherein the light directing device comprises an array of at least two light directing units located in a spaced-apart relationship along an optical axis of the system, the light directing units being configured to selectively involve one of them in an imaging session; and a projecting optical device having a fixed field of view and having a plurality of different focal parameters at different regions thereof corresponding to different vision zones within said field of view, the projecting optical device comprising a plurality of light projecting units located in a spaced-apart relationship along the optical axis of the system such that each of the light directing units is enclosed between a pair of the light projecting units, providing that depending on the selected light directing unit being involved in the imaging session, one or more of the light projecting units are located in an optical path of the light indicative of the real image propagating towards the selected light directing unit, and one or more of the other light projecting units are located at output of the selected light directing unit and are in optical path of both the light indicative of the augmented image and the light indicative of the real image, wherein the light projecting units are configured to induce a compensation optical effect on the light indicative of the real image, such that interaction of a part of the light indicative of the augmented image with one or more regions of said one or more light projecting units, respectively, induces a desired effect of focal distance change on said part of the light indicative of augmented image, while interaction of a part of the light indicative of the real image with one or more regions of said one or more of the other light projecting units induces said compensation optical effect on the part of the light indicative of the real image, thus keeping a focal distance of said part of the light indicative of the real image substantially unchanged.

26. The optical system according to claim 25, wherein each of the light projecting units comprises at least one lens having a predetermined optical power profile defining said different focal parameters, each of the light projecting units being configured such that, location of the selected light directing unit defines selected one or more of the light projecting units interacting with the light indicative of the augmented image and the light indicative of the real image, and defines one or more of the other light projecting units interacting only with the light indicative of the real image.

27. (canceled)

Description

TECHNOLOGICAL FIELD AND BACKGROUND

[0001] The present invention is generally in the field of augmented reality techniques, and relates to an optical system and method for projecting light in augmented reality systems. In particular, such optical system may be incorporated within a see-through near-eye display, or head-mounted display (e.g. helmet- or eyeglasses-mounted display), which has the capability of reflecting projected images as well as allowing the user to see through it.

[0002] A near-eye display is a wearable device that creates a display in front of a field of vision of a user. Near-eye displays include such main components as an image generator and an optical combiner. The image generator provides digitally reproduced images, e.g. utilizing a spatial light modulator (SLM) or similar devices typically including a pixel matrix which is imaged to infinity by a collimating lens and is transmitted into the eye of the viewer by reflecting or partially reflecting surface(s) acting as a combiner for, respectively, non-see-through and see-through applications. For an augmented reality display, the optical combiner works to combine light from the external world and from the image generator into a single presentation of visual data to the imaging optics and eyes.

[0003] A near-eye display presents image information to a viewer within viewing pupils (also referred to as "eyeboxes"), which when aligned with the pupils of the eyes of the viewer, produces virtual images within the field of view of the viewer. Combiners, or waveguides, of near-eye displays convey image information toward the eyes of a viewer from positions outside the field of view of the viewer.

[0004] Various example of such waveguides suitable for use in augmented reality systems are described in the following patent publications, all assigned to the assignee of the present application: U.S. Pat. Nos. 8,098,439; 7,643,214; 8,000,020; 7,724,442; 8,004,765; 7,577,326; 6,829,095; US2015138451; WO16075689; WO16103251; U.S. Pat. Nos. 9,513,481; 9,551,880; 9,551,874. In such waveguides, light carrying an augmented image is guided by total internal reflection to a partially reflective surface from which it is reflected to a viewer.

GENERAL DESCRIPTION

[0005] There is a need in the art for a novel approach for configuring an optical device for use in an augmented reality system. It should be understood that in an augmented reality system, a virtual image is augmented onto the real scene image. Accordingly, in the augmented reality system, implemented in a see-through near-eye display, high-quality images should be concurrently provided for both the real image and virtual/augmented image within the entire field of view of the system, for differently distanced real and virtual objects.

[0006] In order to provide comfort to a viewer for observing both the augmented and real images, in many cases either of these images or both are to be modified. It is known to implement electronically controlled dynamic lenses, enabling the user to dynamically control the focus of the image.

[0007] The situation is different in a so-called "static" augmented reality system in a see-through near-eye display, namely the system having fixed optical properties such as field of view, optical power/focal parameters' profile within the field of view of the system. The present invention provides for achieving the required comfort by improving the concurrent appearance of both the augmented and real images to a viewer using the so-called static optical system. To this end, the optical system of the invention is configured such as to cause projected light portions indicative of the augmented and real images, respectively, to propagate to the viewer's eyes (image plane) along a common optical path for far distanced objects virtual and real objects and a common optical path for closer distanced virtual and real objects. In this connection, it should be noted that, although in the description below, the invention is exemplified as being used for applying a focal change in upper part and lower part of the field of view of the optical system, the principles of the invention are not limited to this specific example, and the focal change can be applied to any other part(s)/section(s) across the field of view of the system.

[0008] In most cases, in the augmented reality systems, nothing needs to be done with the real image of an external scene, i.e. far and close distanced objects are to be presented to a viewer as they are. However, in some cases, the real image projection is to be performed in a way similar to that of a multi-focal lens (e.g.

[0009] progressive lens), such that both the augmented image and the external world (real image) are focused to infinity in the upper segment of the FOV where the real objects are far and in the lower segment of the FOV where real objects are typically near. This requires modification of light indicative of the real image being projected.

[0010] In most cases, the appearance of a virtual image, which is to be properly augmented on the real scene image is to be improved. This is achieved by affecting/modifying convergence (focusing) of light indicative of the augmented image being projected. The convergence of light indicative of the augmented image may be affected prior to this light interaction with a light combining surface, which combines output propagation paths of the augmented-image light and real image light, thus leaving the real-image light unaffected.

[0011] In some cases, the system configuration requires that the augmented-image projection be affected just in front of the user's eyes, namely while in the combined projection path of both the augmented-image and real-image light rays. Accordingly, this effect is to be compensated for the real-image appearance.

[0012] The present invention provides a novel optical system (at times referred to as image projector) for use in augmented reality system. The image projector of the invention is configured with a fixed field of view (FOV) and fixed profile of optical properties within said FOV, and affects light propagation therethrough such that a virtual focal plane is created, which is slanted/tilted with respect to an optical axis of the image projector.

[0013] According to some embodiments of the invention, there is provided an optical system for use in an augmented reality imaging system, the optical system comprising:

[0014] a light directing device configured for directing input light, including light indicative of an augmented image being projected and input light indicative of a real image of an external scene, to propagate in a general propagation direction to an imaging plane; and

[0015] a projecting optical device having a fixed field of view and having a plurality of different focal parameters at different regions thereof corresponding to different vision zones within said field of view, the projecting optical device being configured to affect propagation of at least one of the light indicative of the augmented image, such that, for each of said different regions, interaction of a part of said light indicative of the augmented image and a part of said light indicative of the real image with said region directs the parts of the light indicative of the augmented image and light indicative of the real image along a substantially common output path corresponding to the focal parameter of said region, thereby providing in-focus images in said imaging plane for said parts of light indicative of the augmented image and light indicative of the real image.

[0016] It should be understood that when speaking about augmented reality imaging system, such as see-through near-eye display or head-mounted display, the term "imaging plane" actually refers to a so-called eyebox. The latter is a volume of space within which an effectively viewable image is formed by an imaging system, representing a combination of exit pupil size and eye relief distance.

[0017] Generally, the light directing device is configured to define at least one light combining surface located in optical paths of the input light indicative of the augmented image and the input light indicative of the real image for reflecting one of these lights and transmitting the other to propagate towards the image plane. In the see-through near eye augmented reality systems, the light combining surface reflects the augmented-image light and transmits the real-image light. In some embodiments, the light directing device includes a light-guiding optical element (LOE) which is transmitting for light from an external source, and is configured to guide light propagation thereinside (augmented-image light) to and from a light output surface. For example, such LOE may be configured to guide light therethrough by total internal reflection from inner major surfaces thereof and output light therefrom by light interaction with one or more partially reflective or diffractive surfaces, each serving as the above-described light combining surface for directing the augmented-image light and real-image light.

[0018] The different vision zones are defined by regions of the projecting optical device, such that when the optical system is in use, these regions are aligned with (intersected by) user's line of sight in its different angular orientations, when the user is moving his pupils to observe differently distanced objects. For example, the projecting optical device may define far and near vision regions with different focal parameters/optical power for far and near distanced objects (similar to bi-focal lens), or may have the optical power/focal parameters' profile similar to that of a progressive lens. Thus, generally, these regions of different focal parameters may be implemented as discrete regions or as continuously varying focus across the field of view.

[0019] In some embodiments, the projecting optical device comprises an augmented image projecting unit located in an optical path of the input light indicative of the augmented image while propagating towards the light directing device. In this case, the projecting optical device is configured for affecting propagation of the light indicative of the augmented image being projected, while not affecting propagation of the input light indicative of the real image of the scene.

[0020] The augmented image projecting unit may comprise at least one lens having the plurality of different focal parameters.

[0021] In some other embodiments, the projecting optical device comprises an augmented image projecting unit and a real image projecting unit having the same field of view, and located in a spaced-apart relationship in optical path of light emerging from the light directing device. In other words, in this configuration, the projecting optical device affects the augmented-image light and the real-image light. Each of these projecting units has the plurality of different focal parameters, which may be implemented as discrete regions or as continuously varying focus across the field of view. The augmented image projecting unit and the real image projecting unit are configured in an opposite symmetric manner, such that the plurality of focal parameters of the real image projecting unit compensate effects of the plurality of different focal parameters of the augmented image projecting unit. The augmented image projecting unit and the real image projecting unit are accommodated (at fixed locations) at opposite sides of the light directing device.

[0022] It should be understood that an augmented image projecting unit located at the output of the light directing unit actually interacts with (affects propagation of) both the light indicative of the augmented image and the light indicative of the real image. Therefore, for such embodiments, the term "augmented image projecting unit" is used solely in order to distinguish this unit from a "real image projecting unit" which interacts only with the light indicative of the real image; but the configuration and function of the augmented image projecting unit should be properly understood and interpreted.

[0023] Each of such units may comprise at least one lens, where the lenses of these units have similar optical properties (the plurality of different focal parameters) and are located in a spaced-apart substantially parallel planes along a common optical axis while being oriented in the opposite symmetric manner with respect to a plane of the light directing device. As a result, these units apply opposite optical effects to the light passing therethrough.

[0024] In any of the above-described embodiments, the projecting optical device comprises at least one lens, having one of the following configurations: a bifocal lens, trifocal lens, continuously changing focal distance lens (progressive lens); which can be ; realized as one of: refractive lens, diffractive lens, Fresnel lens or reflecting surface.

[0025] In some other embodiments of the invention, the optical system includes a light directing device and an optical projecting device, where each of these devices is a multi-unit assembly/device. More specifically, the light directing device includes an array of at least two light directing units, each being configured as described above, namely guiding augmented-image light towards a light output surface (light combining surface) and transmitting the real-image light to interact with said light output surface; and the light projecting device includes an array of light projecting units. The configuration is such that all these units, i.e. light directing units and light projecting units are located in a spaced-apart relationship along a common axis, such that real-image light successively propagates through (interacts with) all these units. Moreover, each light directing unit is enclosed between two of the light projecting units.

[0026] In such multi-unit light directing device, each light directing unit is selectively operated. More specifically, each light directing unit may be operated independently, i.e. may be associated with its own augmented image source; or all of them (or at least some of them) may be associated with a common image source, which is configured to be selectively switchable to direct augmented-image light to one of the light directing units.

[0027] Each of the light projecting units is configured (i.e. has optical profile) such that, depending on which one of the light directing units is in operation in an imaging session, the respective light projecting units (i.e. those with which both the augmented-image light and real-image light interact) affect light propagation therethrough such that interaction of the augmented-image light with the respective light projecting units provides a desired effect (focal distance change), while interaction of the real-image light with the respective light projecting units on its way through the system does not induce any focal distance change.

[0028] The invention also provides an augmented reality system comprising an augmented image source producing input light indicative of an augmented image to be projected to a viewer, and the above-described optical system. The augmented image source may comprise an image generator and a collimating module, such that the input light received by the light directing device is collimated light indicative of the augmented image to be projected.

[0029] According to another broad aspect of the invention, it provides an optical system for use in an augmented reality imaging system, the optical system comprising:

[0030] a light-transmitting waveguide configured for receiving input light indicative of an augmented image to be projected, guiding said input light indicative of the augmented image, and coupling said light out of the waveguide to propagate along an output path towards an imaging plane;

[0031] a projecting optical device comprising an augmented image projecting unit and a real image projecting unit, each unit having a fixed field of view and a plurality of different focal parameters at different regions thereof corresponding to different vision zones within said field of view, the augmented image projecting unit and the real image projecting unit being located in spaced-apart substantially parallel planes along a common optical axis at opposite sides of the light-transmitting waveguide, and being configured in an opposite symmetric manner with respect to the waveguide, such that said plurality of different focal parameters of the real image projecting unit compensate effects of said plurality of different focal parameters of the augmented image projecting unit, such that interaction of said light indicative of the augmented image and said light indicative of the real image with each of said different regions directs said light indicative of the augmented image and said light indicative of the real image along a substantially common output path, thereby providing in-focus images in said imaging plane for said light indicative of the augmented image and said light indicative of the real image.

[0032] According to yet another broad aspect, the present invention provides an optical system for use in an augmented reality imaging system, the optical system comprising:

[0033] a light directing device comprising at least one light combining plate configured for directing input light indicative of an augmented image to propagate along an output path in a predetermined direction and directing input light indicative of a real image of a scene propagating along said output path;

[0034] a projecting optical device having a fixed field of view and a plurality of different focal parameters at different regions thereof corresponding to different vision zones within said field of view, the projecting optical device comprising an augmented image projecting unit located in an optical path of said input light indicative of the augmented image while propagating towards the light directing device, such that when the optical system is in use, user's line of sight in different angular orientations thereof intersect with said different regions thereby providing in-focus viewing of differently distanced objects.

[0035] The invention, in its yet further aspect provides an optical system for use in an augmented reality imaging system, the optical system comprising:

[0036] a light directing device comprising at least one light combining plate configured for directing input light indicative of an augmented image to propagate along an output path in a predetermined direction and directing input light indicative of a real image of a scene propagating along said output path;

[0037] a projecting optical device having a fixed field of view and a plurality of different focal parameters at different regions thereof corresponding to different vision zones within said field of view, the optical device comprising a real image projecting unit located in an optical path of the light indicative of the real image propagating towards the light directing device, which combines said light indicative of the real image with the light indicative of the augmented image being projected and directs them along a common path to an imaging plane.

[0038] According to yet another broad aspect of the invention, it provides an optical system for use in an augmented reality imaging system, the optical system comprising:

[0039] a light directing device configured for directing input light, including light indicative of an augmented image to be projected and input light indicative of a real image of an external scene, to propagate to an imaging plane, wherein the light directing device comprises an array of at least two light directing units located in a spaced-apart relationship along an optical axis of the system, the light directing units being configured to selectively involve one of them in an imaging session; and

[0040] a projecting optical device having a fixed field of view and having a plurality of different focal parameters at different regions thereof corresponding to different vision zones within said field of view, the projecting optical device comprising a plurality of light projecting units located in a spaced-apart relationship along the optical axis of the system such that each of the light directing units is enclosed between a pair of the light projecting units, providing that depending on the selected light directing unit being involved in the imaging session, one or more of the light projecting units are located in an optical path of the light indicative of the real image propagating towards the selected light directing unit, and one or more of the other light projecting units are located at output of the selected light directing unit and are in optical path of both the light indicative of the augmented image and the light indicative of the real image, wherein the light projecting units are configured to induce a compensation optical effect on the light indicative of the real image, such that interaction of a part of the light indicative of the augmented image with one or more regions of said one or more light projecting units, respectively, induces a desired effect of focal distance change on said part of the light indicative of augmented image, while interaction of a part of the light indicative of the real image with one or more regions of said one or more of the other light projecting units induces said compensation optical effect on the part of the light indicative of the real image, thus keeping a focal distance of said part of the light indicative of the real image substantially unchanged.

[0041] The invention also provides an optical system for use in an augmented reality imaging system, the optical system comprising:

[0042] a light directing device configured for directing input light, including light indicative of an augmented image to be projected and input light indicative of a real image of an external scene, to propagate to an imaging plane;

[0043] a projecting optical device having a fixed field of view and having a plurality of different focal parameters at different regions thereof corresponding to different vision zones within said field of view, said projecting optical device comprising a light projecting unit located in optical path of light indicative of the augmented image and light indicative of the real image being output from the light directing device and propagating towards the image plane, said light projecting unit having a predetermined optical power profile defining said different focal parameters configured in accordance with an optical power profile of a personal multi-focal lens of an observer, configured to induce a compensation optical effect on the light indicative of the real image, such that, for each of the regions of the projecting optical device, interaction of a part of the light indicative of the augmented image and light indicative of the real image with said region induces a focal change on the light, said focal change compensating a focal change to be successively induced by the light interaction with an aligned region of the multi-focal lens.

BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to better understand the subject matter that is disclosed herein and to exemplify how it may be carried out in practice, embodiments will now be described, by way of non-limiting example only, with reference to the accompanying drawings, in which:

[0045] FIG. 1 is a schematic illustration of a light propagation scheme in a waveguide structure used in an head up display system;

[0046] FIGS. 2A and 2B exemplify an effect of appearance of an augmented image in, respectively, conventional augmented reality system and that utilizing the optical system of the present invention;

[0047] FIGS. 3A and 4A illustrate, by ways of a block diagram, two examples of an augmented reality system utilizing the optical system of different embodiments of the present invention, respectively;

[0048] FIGS. 3B and 4B illustrate more specifically the system configurations of the embodiments of FIGS. 3A and 4A, respectively;

[0049] FIGS. 5 and 6 more specifically illustrate the light propagation schemes affected by, respectively, the augmented image projecting unit and the real image projecting unit in the system configuration of FIG. 4A;

[0050] FIG. 7 exemplify the light propagation scheme affected by the augmented image projecting unit and real image projecting unit in the system configuration of FIG. 4A, where these units are implemented as bi-focal lenses;

[0051] FIG. 8 illustrates the operation of a two eye display system with convergence utilizing the optical systems of the embodiment of FIG. 4A;

[0052] FIG. 9 exemplifies FOVs for eye-box of a non-symmetric shape;

[0053] FIG. 10A exemplifies the use of the optical system of the embodiment of FIG. 4A in the progressive near eye display designed to be used in front of personal progressive lenses;

[0054] FIG. 10B illustrates yet another embodiment of the optical system of the invention for use in augmented reality system designed to be used in front of personal progressive lenses;

[0055] FIG. 11 schematically illustrates the configuration and operation of the optical system according to yet another embodiment of the invention, where the optical projecting device may include only the real image projecting unit;

[0056] FIG. 12 more specifically illustrates the light propagation scheme produced by the real image projecting unit, in either one of the embodiments of FIG. 4A or FIG. 11 with various convergence of image from both eyes;

[0057] FIG. 13 more specifically illustrates the effect on light propagation produced by the projecting optical device in the embodiment of FIG. 4A or FIG. 10A;

[0058] FIGS. 14A to 14C exemplify the configurations of lenses in the augmented image and real image projecting units; and

[0059] FIG. 15 schematically illustrates yet another example of the projecting optical device of the invention, in which both light directing device and light projecting device are configured as a multi-unit assembly.

DETAILED DESCRIPTION OF EMBODIMENTS

[0060] The invention provides a novel optical system for use in an augmented reality imaging system, e.g. see-through near-eye display, or head up display systems. In this connection, reference is first made to FIG. 1 which schematically illustrates the general configuration and operational principles of some known head up display systems utilizing optical systems of the kind to which the present invention relates.

[0061] FIG. 1 illustrates a light propagation scheme in an optical system 100 which includes a light-transmitting waveguide 20 (e.g. planar waveguide) configured as a light-guide optical element (LOE) or substrate to guide light therethrough via total internal reflection (TIR). The waveguide 20 has a light input region 21 (which is aligned with an output of an augmented image source 5 (including an image generator 4 and possibly also a collimating module 6), and light directing interfaces 16 and 22 arranged with proper orientation inside the waveguide.

[0062] As shown, light waves 18 indicative of the augmented image output from the augmented image source 5 and being properly collimated interact with the reflective interface 16 which reflects these light waves such that they are trapped inside the planar waveguide substrate 20 by total internal reflection. After several reflections from the major lower and upper surfaces 26, 28 of the substrate 20, the trapped light waves reach a partially reflecting surface(s) 22, which couples the light out of the waveguide to propagate in a general propagation direction towards a pupil 25 of viewer's eye 24.

[0063] As shown in the figure, it is known to use in the optical device 100 an optical element, such as a lens 82 which focuses augmented-image light L.sub.aug and real-image light L.sub.real onto a prescribed focal plane and optionally corrects other aberrations of the viewer's eye, e.g. astigmatism. Such optical system is described for example in the above-indicated publications WO 2016/103251 assigned to the assignee of the present application.

[0064] Reference is now made to FIGS. 2A and 2B which schematically illustrate an effect which unavoidably occurs in the conventional augmented reality systems, such as system 100 illustrated in Fig.1, either utilizing a correcting lens 82 or not. FIG. 2A illustrates the virtual/augmented image as being presented to the user/viewer in the above-described system 100 of FIG. 1. As can be seen, the image (text in the present example) as presented to the user appears as a "flat" image in the focal plane (or a conjugate plane) defined by the optical system 100. Accordingly, in such a flat image, all the letters (features) in the text are of the same size and virtual distance, which is due to the constant predetermined optical power of the optical system (e.g. defined by the collimating module).

[0065] FIG. 2B illustrates the augmented image of the same text in a different presentation which is desired in some augmented reality applications. As can be seen, the same originally flat image/text appears to be slanted with respect to the optical axis of the system. As a result, the letter's size varies in the virtual image such that the letters (features) corresponding to near distanced objects appear larger than those of farer distanced objects. In the present example, the features' size varies gradually. In other words, larger letters in the augmented text image seem to appear at a closer virtual distance to the user and smaller letters seem to appear at a farther virtual distance from the user, despite of the fact that they all are actually of the same size/scale and angular orientation (with respect to line of sight) in the augmented image generated by the image source. Consequently, the document (augmented image) will be presented in front of the observer in a slanted plane, i.e. not perpendicular to the optical axis defined by the augmented reality imaging system. The appearance of the augmented image is consistent with the focus and the convergence distance, as will be described further below.

[0066] As will be described further below, the optical system of the present invention provides for achieving the above effect of the augmented image presentation/projection exemplified in FIG. 2B, while not affecting the presentation/projection of the real image of the scene. It should also be understood that considering the specific not limiting example of FIG. 2B, a change in a focal distance of the virtual object appearance may be in an opposite direction: (i) the larger letters in the augmented text image seem to appear at a farther virtual distance to the user and smaller letters seem to appear at a closer virtual distance from the user, despite of the fact that they all are actually of the same size/scale and angular orientation (with respect to line of sight) in the augmented image generated by the image source; the letters/features may be of different sizes at closer and farther distances, while the induced focal change causes them to appear as if of the same size.

[0067] Generally, the optical system of the invention is aimed at improving the concurrent appearance of both the augmented and real images to a viewer. This is achieved in the invention by configuring the optical system such as to cause projected light portions indicative of the augmented and real images, respectively, to propagate to the viewer's eyes (image plane) along common optical path(s). For example, augmented and real images of near distanced objects propagate along a common projection path (i.e. the same convergence/same focal distance), and augmented and real images of far distanced objects propagate along a common projection path.

[0068] To this end, the optical system of the invention includes an additional specifically designed projecting optical device. In some embodiments of the invention, the projecting optical device is configured to apply a change of optical power onto the augmented image while avoiding such change in the real image being projected. In some other embodiments, the projecting optical device is configured to apply optical power changes onto both the augmented image and the real image such that, in the image plane, the augmented image is modified while the real image is maintained. In yet further embodiments, the optical system of the invention is configured to affect only the light indicative of the real image. This way both the virtual image and the external world are focused to infinity in the far vision zone (upper FOV) where real objects are far and in the near vision zone (lower FOV) where real objects are typically near.

[0069] Reference is made to FIGS. 3A and 4A which illustrate, by way of block diagrams, two embodiments of an imaging system 200 for use in augmented reality applications, utilizing an optical system 202 of the invention. To facilitate understanding, the same reference numbers are used for identifying components that are common in all the examples.

[0070] Generally, the augmented reality imaging system 200 includes such main parts (functional and structural parts) as an augmented image source 205, a light directing device 210, and a projecting optical device 240 configured and operable according to the invention. Common for all the configurations of system 200 is that the light directing device 210 is configured for directing input light, L.sub.aug, indicative of an augmented image which is to be projected and input light, L.sub.real, indicative of a real image of an external scene, to propagate in a general propagation direction to an imaging plane (i.e. to viewer's eyes). Such a light directing device 210 may have any suitable configuration defining one or more beam combining surfaces (e.g. partially reflective and/or diffractive surfaces), each for reflecting/diffracting augmented-image light, L.sub.aug, and transmitting real-image light, L.sub.real, to the imaging plane.

[0071] The projecting optical device 240 of the present invention has a fixed field of view (FOV) and has a plurality of different focal parameters at different regions of the device corresponding to different vision zones (at least first and second vision zones) within the FOV. Typically, such at least first and second vision zones are constituted by at least far and near vision zones.

[0072] It should be understood that, for the purposes of the present application, different vision zones are physical zones/regions of the device 240 corresponding to different focal parameters thereof in its FOV. These regions of the device 240 are regions of intersection with the observer/viewer's line of sight at different orientations thereof, when the observer/viewer is moving his pupils to observe differently distanced objects.

[0073] The projecting optical device 240 is configured such that each focal parameter thereof (corresponding region/zone) provides in-focus images, in the imaging plane IP, for the augmented-image light, L.sub.aug. As for the real image of the scene, it is not affected by the projecting optical device 240, and therefore is observed by the viewer based in the viewer's vision. As will be exemplified further below, the viewer may or may not use his spectacles or contact lenses, and his vision is thus defined accordingly. In other words, each focal parameter of the device 240, and a respective zone/region of the device, defines a different focus for the augmented image. Generally, the projecting optical device 240 is configured to affect light, L.sub.aug, indicative of the augmented image. Thus, for example, images of far and near distanced objects in the augmented image are affected by respective different focal parameters (e.g. optical power) of the projecting optical device 240.

[0074] Referring to the embodiment of FIG. 3A, the projecting optical device 240 comprises an augmented image projecting unit 240A located in an optical path OP.sub.1 of light L.sub.aug propagating from the augmented image source 205 towards the light directing device 210. Accordingly, the projecting optical device 240 affects only propagation of the augmented-image light L.sub.aug prior to its interaction with the light directing device 210, while propagation of the real-image light L.sub.real remains unchanged. Thus, for example, the slanted augmented image may be produced as exemplified in FIG. 2B, while the real-world scene remains unaffected by the device 202.

[0075] As indicated above, the projecting optical device 240 is configured to have a plurality of different focal parameters across its field of view. These different focal parameters are associated with corresponding different vision zones which are different regions of the projecting optical device 240, which, when the system is in use (worn by viewer), are aligned with different angular orientations of the user's line of sight when observing differently distanced objects.

[0076] Thus, collimated light L.sub.aug indicative of augmented image, created by the image source 205, interacts with (e.g. passes through) the augmented image projecting unit 240A at a certain region/zone thereof and undergoes respective focusing/convergence (defined by the focal parameter of said certain region/zone), and is then reflected by the partially reflective surface (light combining surface) of the light directing device 210 towards the projecting path CP to be focused on the imaging plane IP (viewer's eyes or eyebox). Concurrently, the real-image light L.sub.real propagating along path CP interacts with (e.g. passes through) the partially reflective surface of the light directing device 210 without being changed and continues to propagate in its original projecting path CP to be focused on the imaging plane IP (viewer's eyes).

[0077] It should be understood that, generally, the propagation paths of light parts L.sub.aug and L.sub.real are combined into the common output projecting path CP if said propagation paths of light parts L.sub.aug and L.sub.real correspond to the same focal distances. Thus, in the specific configuration of the projecting optical device 240 having only augmented image projecting unit 240A, as exemplified in FIG. 3A, the focal distance of the augmented-image light L.sub.aug is affected at the interaction zone with the augmented image projecting unit 240A to be properly modified. The operation of such augmented image projecting unit 240A will be described more specifically further below with reference to FIG. 3B.

[0078] Generally, common for all the embodiments of the invention, the projecting optical device 240 may include one or more lenses, e.g. a bifocal lens, trifocal lens, continuously changing focal distance lens (progressive lens), and/or any other optical device or assembly having varying focal parameters within its field of view. As a virtual object moves from an upper section of the FOV of the projecting optical device to a lower section of the FOV, its focal distance changes and the convergence of augmented image light rays changes accordingly. In the embodiment of FIG. 4A, the projecting optical device 240 is a two-part device including an augmented image projecting unit 240B and a real image projecting unit 240C accommodated at opposite sides, respectively, of the light directing device 210 in a spaced-apart parallel planes along a common optical axis. Each of the augmented image projecting unit 240B and the real image projecting unit 240C has the same fixed field of view FOV. The augmented image projecting unit 240B is accommodated at the front side of the light directing device 210 and the real image projecting optical unit 240C is accommodated at the back side of the light directing device 210 with respect to the imaging plane. Consequently, real image projecting unit 240C is located at the optical path of real-image light L.sub.real, while the augmented image projecting unit 240B is located at the optical path of both real-image light L.sub.real and augmented-image light L.sub.aug. The arrangement of the light directing device 210 and the projecting optical unit 240 is "static", in the meaning that the optical properties of this arrangement are fixed (i.e. field of view, optical power/focal profile across the FOV).

[0079] As described above, the light directing device 210 may have any suitable configuration having at least one beam combining surface (partially reflective/diffractive surface) for directing the augmented- and real-image light parts incident thereon. For example, in the embodiment of FIG. 4A, the light directing device 210 is configured as an optically transmitting light-guiding optical element LOE having fully reflecting inner major surfaces for directing/guiding augmented-image light L.sub.aug by total internal reflection and at least one partially-reflecting surface for reflecting light L.sub.aug towards the projecting path, and being transmitting for the external light L.sub.real to thereby transmit the real-image L.sub.real towards the viewer.

[0080] The need for the augmented image projecting unit 240B (as well as unit 240A described above with reference to FIG. 3A) may be associated with the need for the "slanted" effect described above with reference to FIGS. 2A-2B. However, in the configuration of the augmented image projecting unit 240B being in the output path of the augmented-image light L.sub.aug, such augmented image projecting unit 240B unavoidably affects also the real-image light L.sub.real. To this, the real image projecting unit 240C is provided and is configured to compensate the effect of augmented image projecting unit 240B on the real-image light L.sub.real.

[0081] More specifically, the augmented image projecting unit 240B and the real image projecting unit 240C have the same FOV. Each of the augmented image projecting unit 240B and the real image projecting unit 240C is configured to have a plurality of different focal parameters corresponding to different regions/zones thereof within the field of view, and the units 240B and 240C are aligned in an opposite symmetric manner with respect to a plane of the light directing device 210. This means that optical power profile across the FOV (i.e. different regions having different focal parameters) of the augmented image projecting unit 240B is aligned in an opposite symmetric manner with the optical power profile of the real image projecting unit 240C. Such an alignment results in that real-image light L.sub.real while propagating in its original direction passes through unit 240C where it undergoes focal modification (in case projecting unit 240B applies defocusing, the projecting unit 240C applies a corresponding focusing effect) that will then be compensated by the real-image light L.sub.real passage through the augmented projecting unit 240B, which applies the effective (non-compensated) focal modification to the augmented-image light L.sub.aug. Thus, the real image projecting unit 240C is utilized here as a compensating optical unit nullifying the optical effects of the augmented image projecting unit 240B on light L.sub.real.

[0082] For example, the real and augmented image projecting units 240B and 240C may include progressive lenses (continuously varying focus across the FOV of the lens) which are aligned in an opposite symmetric manner as follows: One of these lenses may be a progressive lens with continuously increasing optical power from the lower segment of the lens, i.e. lower section of the FOV (typically used for observing near-distanced objects) towards the upper segment of the lens, i.e. upper section of the FOV (typically used for observing far-distanced objects), and the other lens with the same FOV is a progressive lens with continuously decreasing optical power from the lower segment of the lens towards the upper segment of the lens.

[0083] Referring now to FIG. 3B, operation of the system 200 of the embodiment of FIG. 3A is more specifically illustrated. In this embodiment, the projecting optical device 240 includes only the augmented image projecting unit 240A located in optical path OP.sub.1 of augmented-image light L.sub.aug propagating towards the light directing device. Input augmented-image light L.sub.aug from the image source 205 interacts with (e.g. passes through) a region of the augmented image projecting unit 240A, which has certain fixed FOV and has different focal parameters at different regions thereof. In the present not limiting example, the augmented image projecting unit 240A has a lens with continuously varying focus, e.g. progressive lens. As indicated above, the principles of the invention are limited neither to the use of progressive lens nor to any other configuration of continuously varying focus. The convergence of the augmented-image light L.sub.aug propagation is modified by interaction with the region of the lens in accordance with the focal parameter at said region. The so-modified augmented-image light L.sub.aug propagating with said convergence is incident onto the light combining surface of the light directing device 210, which directs this light to the user's eyes (image plane). Thus, the augmented-image light interaction with each of different regions of the lens 240A having different focal parameter provides appearance of the respective augmented object/feature at a different virtual distance from the image plane, presenting virtual object/feature located closer or farer from the viewer.

[0084] As shown in the figure, the modification of the convergence of the augmented-image light L.sub.aug by interaction thereof with the different regions of the lens having different focal parameters provides different appearance of the virtual object. In the present example, such different appearance is exemplified as appearance of the close and far distanced objects NO and FO, respectively, as being observed by the user.

[0085] As shown in FIG. 3B, the observer is looking through the light directing device 210 of the near eye display 200 and sees augmented-image light from virtual objects FO and NO. The augmented-image light passes through the lens 240A that changes the focus of the virtual image differently across the lens. Augmented image light interacting with a segment of the lens 240A having minimal negative optical power, provides the virtual object appearance as the far distanced object FO (for example at 6 meters). The augmented-image light interacting with a segment of the unit (e.g. lens) 240A having stronger negative optical power provides the virtual object appearance as the near distanced object NO (for example at 1 meter). A continuous focal change of the unit 240A generates continuous change in the distance of the appearance of virtual objects along the virtual focal plane FP.

[0086] Considering the example of continuously varying focus of the projecting optical device, it creates a virtual focal plane FP. In this connection, it should be understood that, generally, and this is common for all the embodiment of the invention, a virtual focal profile may or may not be continuous, e.g. it may be not continuous for a case of discrete regions of different focal parameters across the projecting optical device. In other words, the shape of the virtual focal profile corresponds to the focal/optical power profile across the FOV of the projecting optical device.

[0087] As also shown in the figure, the real-image light L.sub.real propagating from a real far object RO (for example 6 m), passes through the light combining surface of the light directing device 210 into the viewer's eye. Thus, in this example, the progressive lens 240A is introduced in the optical path of the augmented-image light L.sub.aug only, while the light L.sub.real from the real `world` is not affected by the optics of the system.

[0088] It should be noted that, generally and common for all the embodiments, the implementation of the projecting optical device 240 into the system 200 can be done by modification of the system optics, by introducing the device 240 (or one or more of its lenses) internally, or by modification of the surface of the light directing device 210 (with minimal distortion to the `world`). This will be described further below.

[0089] Thus, the projecting optical device 240A provides that the augmented-image light portions, having convergences corresponding to the near and far distanced virtual objects, are coupled out of the light directing unit 210, along different projecting paths CP.sub.N and CP.sub.F which are common paths for the real image light originated at near and far distanced real objects RO.

[0090] Referring to FIG. 4B, there is more specifically illustrated an example of the operation of the system of the embodiment of FIG. 4A, where the projecting optical unit 240 includes an augmented image projecting unit 240B and a real image projecting unit 240C. The augmented image projecting unit 240B is located in the optical path of both the augmented-image light L.sub.aug and the real-image light L.sub.real being output from the light directing device 210. The light directing device 210 may be a light-transmitting waveguide guiding input augmented-image light L.sub.aug by total internal reflection from its major surfaces (as shown in FIG. 1) and coupling it out by reflection from partially reflective surface. This is a light combining surface which transmits the real-image light L.sub.real. The real-image projecting unit 240C is located in the optical path of real image light L.sub.real.

[0091] In this specific but not limiting example, the projecting units 240B and 240C are in the form of opposite symmetric progressive lenses. As described above, it should be understood that, generally, the projecting units have opposite symmetric focal/optical power profiles across the identical fields of view, and these profiles may correspond to continuous variation of focus or discrete regions of different foci.

[0092] The observer is looking through the optical system 202 of a near eye display system 200 and sees light from virtual objects, being far and near distanced objects FO and NO in this example. To this end, the augmented image projecting unit 240B (e.g. progressive lens) provides that interaction of light L.sub.aug and light L.sub.real with the same region of the lens induces respective convergence on both of these light portions. More specifically, the upper segment of the lens 240B (the upper section of the FOV) applies minimal negative optical power to the interacting light, and accordingly the respective virtual image appears to originate from far distanced object FO (for example at 6 meters). The lower segment of the lens 240B (lower section of the FOV) introduces stronger negative optical power to the virtual image light, and thus the virtual image will appear to originate from a near distanced object NO (for example at 1 meter). A continuous focal change of the lens 240B would generate continuous change in virtual focal plane FO. As described above, generally, the shape of the virtual focal profile corresponds to the focal/optical power profile across the FOV of the projecting optical device 240.

[0093] In this configuration, the real image light experiences the same focal change (convergence change) by the augmented projecting unit 240B as the augmented image light. However, such change is not needed for the real image light. Therefore, the compensating real image projecting unit 240C is provided being configured as described above. The real image associated progressive lens 240C is placed adjacent and on the opposite side of light directing device 210 and is designed to have the opposite optical power profile of lens 240B. This way real `world` objects will not be affected by the system.

[0094] Reference is made to FIGS. 5 and 6 which more specifically illustrate the light propagation schemes affected by, respectively, the augmented image projecting unit and the real image projecting unit in the system configuration of FIG. 4A.

[0095] As shown in FIG. 5, the waveguide of the light directing device 210 outputs parallel light beams of the augmented image light L.sub.aug for each of two virtual images associated with objects NO and FO. As this light passes the augmented image projecting unit, which is a progressive diverging lens 240B in this example, the light at different interaction locations/regions of the lens 240B experiences different amount of divergence. Consequently, the two virtual objects FO and NO appear to be at different virtual distances. Thus, the so modified augmented image light rays arrive at the image plane, i.e. the location in space where observer eye will experience the designed performance. It should be noted that points FO and NO are only an example, while actually a continuous virtual focal plane or any other discrete focal profile (of a bifocal lens for example) can be created by the augmented image projecting unit 240B. The orientation of the virtual focal profile can be other than top down. It can also be side oriented.

[0096] The optical scheme for the real image light propagation is shown in FIG. 6. The light rays from real far and near objects ROE and RON are incident on real image projecting unit 240C (varying focal lens). The different regions of the lens 240C having different focal parameters, with which the far- and near-object associated light rays interact, apply respective different focal changes on these light rays, which then pass through the waveguide 210. This way the real image light rays for the predefined distance RON and ROE and the augmented image light rays emerging from the waveguide 210 are all collimated (focused to infinity), and thereby correlated. Although not specifically shown in the figure, it should be understood that all rays, those of real-image and augmented-image light may then pass through the lens 240B to generate the virtual image plane.

[0097] FIG. 7 exemplifies the operation of the optical system of the invention utilizing a bifocal configuration of the projecting optical device 240 including the augmented image projecting unit (bifocal lens) 240B and real image projecting unit (opposite bifocal lens) 240C configured and arranged as described above. As shown, in this configuration the focal profile FP is in the form of discrete focal distances/positions FPF and FPN to generate distinct two separate virtual images. The upper section of the FOV generates focal position FPF and the lower section generates focal position FPN. In a similar way, trifocal lenses, as well as any other discrete focal values' lenses can be used generating corresponding discrete-values focal profile.

[0098] FIG. 8 illustrates, in a self-explanatory manner the optical system 202 configurations for use in a two-eye display system. The system 202 includes two similar units 202A and 202B. Each such unit is configured as described above implementing the embodiment of FIG. 4A. It should, however, be understood that the embodiment of FIG. 3A can be used, as well as another embodiment described below with reference to FIG. 11 can be used.

[0099] It should be understood that the projecting optical devices 240 in the units 202A and 202B are configured in opposite symmetric manner with respect to a central line CL between them parallel to their optical axes. This provides that, for each focal parameter, virtual objects created by the units 202A and 202B coincide in space. This is exemplified in the figure for virtual objects NO and FO. The progressive change in focal distances of virtual objects is accompanied by continuous change in convergence of the augmented image light rays being output of the augmented image projecting unit. It should be noted that, in some cases, the convergence is designed (i.e. the respective lenses are configured) to be less then nominal for focus in order to maintain margins for different eye distance of observers.

[0100] FIG. 9 shows some examples for the shape/geometry of the elements of the optical system 202 in the augmented reality applications. As shown, the eye boxes (for left and right eyes) have an opposite symmetric shapes with respect to the central line CL between them which in this illustration is perpendicular to their optical axes. Also, each of these optical elements can be of a non-symmetric shape, because short range observation mostly utilizes narrower FOV and eye tend to converge. As also shown in the figure, the same is relevant for a two-eye single eye box, where the FOV can be arranged as `portrait`.

[0101] Reference is made to FIG. 10A, exemplifying the use of the optical system of the invention in front of personal progressive lenses (known in spectacles market) used by the observer. In this embodiment, the personal progressive lens 50 is closer than the optical system 202, i.e. is located downstream of the optical system 202 with respect to the light propagation to the user's eye. In the present non-limiting example, where the system has general configuration of FIG. 4A, the progressive lens 50 is located closer than the augmented image projecting unit 240B. Generally, the optical system of the invention can be conveniently used by progressive spectacle users. In two eye configuration, the convergence of the augmented image light rays can be performed according to the focal profile of personal progressive lens 50. However, since progressive spectacles introduce minimal convergence between both eyes or none at all (thereby generating accommodation-convergence inconsistency especially at close distance), the induced convergence (modification) of the virtual image light rays according to the present invention can be set to minimal or none at all. Thereby, the convergence of the virtual image light rays is set to generate accommodation-convergence consistency.

[0102] Referring to FIG. 10B, there is schematically illustrated optical system 202 of the invention having a somewhat different configuration, being configured to augmented reality system which is to be used by an observer having personal multifocal spectacles 50. In this embodiment, the system 202 includes a light directing unit 210, and a projecting optical device including only an augmented image projecting unit 240B located at the output of the light directing unit 210. Such configuration might be advantageous for the case where the observer prefers to use the near eye display while the virtual image as well as the `world` are focused to infinity all across the FOV without the need to take of his spectacles. This is because in most cases spectacles also correct aberrations. In this embodiment, the augmented image projecting unit (e.g. multi-focal lens) 240B is configured to cancel/nullify the optical effect of progressive focus (generally, focal change) of the spectacles 50. Thus, the light projecting unit 240B has a predetermined optical power profile (defining the different focal parameters (across the FOV) configured in accordance with the predetermined optical power profile of a personal multi-focal lens of an observer, to be oppositely symmetric with respect to the optical axis of the system. Hence, for each of the regions of the unit 240B, interaction of a part of the augmented-image light and real-image light with this region induces a focal change on the interacting light, and this focal change compensates for a focal change which is successively induced by the light interaction with an aligned region of the multi-focal lens 50.

[0103] Reference is now made to FIG. 11 illustrating schematically an example of configuration and operation of an optical system 202 according to yet another embodiment of the present invention. In this embodiment, the system includes a light directing device 210 defining at least one light combining surface/plate for reflecting/diffracting and transmitting respectively augmented image light and real image light; and a projecting optical device 240 which may include only real image projecting unit 240C. As described above, in some cases, the real image projection is to be performed similar to that of a multi-focal lens (e.g. progressive lens), such that both the augmented image and the external world are focused to infinity in the upper segment/section of the FOV where the real objects are far ROE and in the lower segment/section of the FOV where real objects are typically near RON. This requires modification of light indicative of the real image being projected. In this configuration the observer sees the real and the virtual images focused to infinity

[0104] FIG. 12 more specifically illustrates the light propagation scheme produced by the optical systems of the invention exemplified in FIG. 11. It should be noted that the variable compensation for real-image light convergence across the FOV might be difficult to achieve in progressive lenses. Element RO represent far-distanced real object that is imaged by progressive lens. The light rays L.sub.real (solid lines) are parallel for every eye related propagation path, but are not parallel between the eyes. A virtual image can be made electronically to have required light pattern (represented as dashed lines). This is convenient when observing simultaneously real and virtual objects. However, when observing virtual image only it will be more convenient to have convergence to fit the accommodation as presented by the dot-dash lines.

[0105] FIG. 13 schematically illustrates the advantageous feature of the optical system of the invention. It should be understood that although this is exemplified with respect to the optical system configuration of FIGS. 4A and 4B, the same is true also for all the system configurations, e.g. the system configurations of the above-described FIGS. 3A-3B and 11, as well as the example described below with reference to FIG. 15. The observer, when using the near-eye display system incorporating the optical system of the invention, is moving his head with respect to the display system, as depicted by arrows 75. Accordingly, the virtual focal plane FP is being the path shown by arrow 75. However, the virtual image can be set electronically to maintain relative orientation in space, and appear to move up and further away in direction 77 along the focal plane FP. The system is configured to enable the user to change focus or virtual distance as required. Alternatively, the user can move the virtual object up in the field of view without the head movement. This will have the same result: the object will appear to move up and away along arrow 77. Generally, both of these methods can be used by the observer to change object distance and correlate it with real objects distance.

[0106] Reference is made to FIGS. 14A to 14C exemplifying some geometrical features of the projecting optical device, e.g. progressive lens(es). The design of a multifocal lens (e.g. progressive lens) is well known methodology. However, for the purposes of the present application, the multifocal lens should preferably occupy a minimal volume of the optical system. This can be achieved if the lens back surface 80 is designed to be conformal with the adjacent outer surface of the light directing device (waveguide) 210. In most cases, this is a flat plane (as exemplified in FIGS. 14A-14B). For best optical performance, the opposite lens should also be adjacent and have a conformal back surface 82. This surface can be attached to the waveguide 210 as long as it maintains total internal reflection within the waveguide. These features, as well as various examples of the manufacturing technique to achieve these features, are described in the above-indicated WO 2016/103251 assigned to the assignee of the present application and also in a co-pending application No. PCT/2016/050523, both being incorporated herein by reference with respect to this aspect of the invention.

[0107] According to the present invention, the shape of surfaces 84 and 86 can be modified to generate the required progressive optical power. The design of these shapes may be based on weighted average.

[0108] As shown in FIG. 14C, the surface of the lens by which it faces the waveguide may not be planar. This is exemplified in the figure for surface 82' of one of the lenses. However, it should be understood that this feature can be used in any one of the above-described embodiments, for one or more of the lenses.

[0109] The method of optimization for the shape of the facing surfaces of the lenses can include various parameters, similar to that performed in progressive lens design for spectacles. The basic approach for deriving the outer surface of the lens is hereby described. However, it should be understood that other known suitable methods can be used.

[0110] According to the basic approach, the following parameters are used: r being the position on lens surface; R being the position on object real space to be collimated on the virtual focal plane FP; P being the height/position of lens surface designed to create wave-front from point R correlating wave-front from waveguide (plane-wave in most cases), and can be derived using optical simulation software; f being the weighting function depending on various parameters such as position of eye-box 90 constituting the eye pupil (for example rays outside eye-box are of no significance).

[0111] The profile P(r) of the lens surface 84 is therefore averaged:

P ( r ) = .intg. P ( r , R ) .times. f ( r , R ) .times. dR .intg. f ( r , R ) .times. dR ##EQU00001##

A more complex iteration can be used to optimize lens surfaces such as surfaces 86 with 84. All the surfaces/interfaces of the projecting optical device can also me optimized (e.g. surfaces 80, 82 (or 82'), 84 and 86).

[0112] As further exemplified in FIG. 14B, the optical lens to be used as the projecting optical unit in the system of the invention may be is based on Fresnel lens. As sown in the figure, surfaces 186 and 184 of such lens have same optical properties as those of surface 86 and 84 respectively in the above example of FIG. 14A. As known, the use of Fresnel lens provides for reducing weight and size of the optical system.

[0113] FIG. 15 schematically illustrates a projecting optical device 240 configured according to yet another example of the invention. The device 240 of this example is configured generally similar to the embodiment of FIG. 4A, namely includes a light directing device 210 and image projecting device 240 in the optical path of both the augmented image light and the real image light. However, in this example, the light directing device 210 and the image projecting device 240 are configured as multi-unit devices/assemblies. More specifically, the light directing device 210 includes an array (generally at least two light directing units)--three such light directing units 210a, 210b, 210c being shown in the present example; and the light projecting device 240 includes an array of light projecting units--units 240B', 240B'', 240B''', 240C in the present example. It should be understood that light projecting unit 240C is the only one which interacts only with the real-image light and does not interact with the augmented image light. Each light directing unit in the array is configured as described above, namely for guiding input augmented-image light towards a light output surface (light combining surface) and transmitting the real-image light to interact with the light output surface. The light directing units and light projecting units are located in a spaced-apart relationship along a common axis (optical axis of the system). Each light directing unit (generally at least one or at least some of them) is enclosed between two of the light projecting units. As shown in the figure, light directing unit 210a is located between light projecting units 240C and 240B'; light directing unit 210b is located between light projecting units 240B' and 240B''; light directing unit 210c is located between light projecting units 240B'' and 240B'''.

[0114] Hence, the real-image light successively propagates through (interacts with) all these units. As for the light directing units, each of them is selectively operated. More specifically, each light directing unit may be operated independently: Each light directing unit may be associated with its own augmented image source, in which case the multiple image sources may be selectively operated one-by-one, or at least some of them or all of them are operated concurrently. Alternatively, at least some of the light directing units or all of them may be associated with a common image source. In the latter case, the common image source is selectively switchable between different operational modes to direct augmented-image light to different one or more of the light directing units. The selection of the light directing unit and/or image source to be operated in a certain imaging session can be implemented sequentially (the system scans the light directing units and injects the appropriate augmented image to each one); and/or using an eye tracker based system (the system identifies, using an eye tracker, where the observer is looking (i.e. orientation of the line of sight) and injects the image to the appropriate waveguide considering the virtual image focus at that region).

[0115] Each of the light projecting units 210a, 210b, 210c has an optical profile (different focal parameters across the FOV) such that, depending on the light directing unit(s) being selected for operation in the imaging session, the respective light projecting units (i.e. those with which both the augmented-image light and real-image light interact) affect light propagation through the system. To this end, the optical profiles of the light projecting units 240B', 240B'', 240B''', 240C are configured such that interaction of the augmented-image light with the respective light projecting units provides a desired effect (focal distance change), while interaction of the real-image light with the respective light projecting units on its way through the system does not induce any focal distance change.

[0116] Thus, in the example of FIG. 15, light directing units (waveguides) 210a, 210b, 210c form together the light directing device 210, and light projecting units (lenses having different focal parameters/optical power profiles across the fixed FOV) 240B', 240B'', 240B''', 240C form together the optical projecting device 240. The combination of some of the units of the optical projecting device 240 forming the above-described augmented image projecting device and real image projecting device may be different in various imaging sessions. Here, at least two of the lenses are progressive lenses. Thus, a plurality of virtual focal planes FPa, FPb and FPc may be generated by the light projecting units operating as the augmented image projecting units and the waveguides, and the real-image projecting unit(s) (lens(es)), e.g. 240C, compensate(s) for real world aberrations. The orientation of virtual focal planes FPa, FPb and FPc can be arbitrarily modified according to the augmented image affecting progressive lenses 240B', 240B'', 240B'''.

[0117] It should be understood that in the configuration of FIG. 15, the optical power profiles of all the light projecting units (lenses) are configured to provide that, selectively, optical effect (focal change) of one or more of them is compensated by one or more others, such that the lens(es) of the augmented image projecting unit in a specific session and lenses of the real image projecting unit in said session should be configured to compensate for the real-image light modification induced by the augmented image projecting unit.

[0118] More specifically, for the example of FIG. 15, lens 240C is configured to apply a compensating/opposite effect for the effect induced by lenses 240B', 240B'' and 240B''' (for the case only waveguide 210a is in operation); lenses 240B' and 240C are configured to compensate for the real-image modification induced by lenses 240B'' and 240B''' (e.g. only waveguide 210b is in operation), and lenses 240C, 240B', 240B'' are configured to compensate for effect of lens 240B''' (only waveguide 210C is in operation).

[0119] Thus, the present invention provides a novel solution for configuration and operation of an optical system for use in an augmented reality system (such as see-through near-eye display system). The technique of the present invention enables the use of the optical system having a fixed field of view, while providing for required focal distance change across said field of view being applied to the augmented image light and/or real image light being projected onto the image plane (eyebox).