Sony Patent | Information Processing Apparatus, Information Processing Method, Program, And Moving Body

Patent: Information Processing Apparatus, Information Processing Method, Program, And Moving Body

Publication Number: 20200184219

Publication Date: 20200611

Applicants: Sony

Abstract

The present technique relates to an information processing apparatus, an information processing method, a program, and a moving body that can appropriately display content on top of a scene viewed by a user. An aspect of the present technique provides an information processing apparatus that sets a frame as a superimposition location of content in a region corresponding to a surface of an object on the basis of a movement state of a user and generates visual information for displaying the content in the region corresponding to the set frame. The present technique can be applied to an apparatus that performs AR display of content.

TECHNICAL FIELD

[0001] The present technique relates to an information processing apparatus, an information processing method, a program, and a moving body, and particularly, to an information processing apparatus, an information processing method, a program, and a moving body that can appropriately display content on top of a scene viewed by a user.

BACKGROUND ART

[0002] There is a technique of using a head-up display to project, to a windshield, information regarding a facility or the like included in a visual field of a driver and presenting the information to the driver. The driver views various types of information on top of a scene spreading in front of the driver.

[0003] PTL 1 discloses a technique of displaying an AR (Augmented Reality) image regarding a facility in association with a real scene viewed by the driver, in which the AR image is displayed far when the vehicle speed is fast, and the AR image is displayed close when the vehicle speed is slow.

CITATION LIST

Patent Literature

[PTL 1]

[0004] Japanese Patent Laid-Open No. 2015-77876

SUMMARY

Technical Problem

[0005] It is desirable to present information in a form that the information can be viewed as if the information is fit into the scene. By displaying the information such that the information is fit into the scene, the driver can view the information while concentrating on the drive.

[0006] The present technique has been made in view of the circumstances, and the present technique can appropriately display content on top of a scene viewed by a user.

Solution to Problem

[0007] An aspect of the present technique provides an information processing apparatus including a setting unit that sets a frame as a superimposition location of content in a region corresponding to a surface of an object on the basis of a movement state of a user, and a display control unit that generates visual information for displaying the content in the region corresponding to the set frame.

[0008] In the aspect of the present technique, the frame as the superimposition location of the content is set in the region corresponding to the surface of the object on the basis of the movement state of the user, and the visual information for displaying the content is generated in the region corresponding to the set frame.

Advantageous Effect of Invention

[0009] According to the present technique, the content can be appropriately displayed on top of the scene viewed by the user.

[0010] Note that the advantageous effect described here may not necessarily be limited, and the advantageous effect may be any of the advantageous effects described in the present disclosure.

BRIEF DESCRIPTION OF DRAWINGS

[0011] FIG. 1 is a diagram illustrating an interior of a vehicle provided with a vehicle control system according to a first embodiment of the present technique.

[0012] FIG. 2 is a diagram illustrating an example of an appearance of content.

[0013] FIG. 3 depicts diagrams each illustrating a display example of the content for realizing the appearance illustrated in FIG. 2.

[0014] FIG. 4 is a diagram schematically illustrating display of the content.

[0015] FIG. 5 is a diagram illustrating an example of the appearance of the content after a lapse of certain time from the state of FIG. 2.

[0016] FIG. 6 is a diagram illustrating an example of the appearance of the content after a lapse of certain time from the state of FIG. 5.

[0017] FIG. 7 is a diagram illustrating an example of the appearance of the content after a lapse of certain time from the state of FIG. 6.

[0018] FIG. 8 is a block diagram illustrating a configuration example of the vehicle control system of the first embodiment.

[0019] FIG. 9 is a block diagram illustrating a functional configuration example of an output control unit of FIG. 8.

[0020] FIG. 10 is a block diagram illustrating a configuration example of an information superimposition appropriate visual field setting unit of FIG. 9.

[0021] FIG. 11 is a diagram illustrating an example of a three-dimensional model of an object.

[0022] FIG. 12 is a diagram illustrating an example of setting information superimposition possible frames.

[0023] FIG. 13 is a diagram illustrating an example of the information superimposition possible frames excluded by an exclusion rule 1.

[0024] FIG. 14 is a diagram illustrating an example of the information superimposition possible frames excluded by an exclusion rule 2.

[0025] FIG. 15 is a diagram illustrating an example of the information superimposition possible frames excluded by an exclusion rule 3.

[0026] FIG. 16 is a diagram illustrating an example of the information superimposition possible frames excluded by an exclusion rule 4.

[0027] FIG. 17 is a diagram illustrating an example of the information superimposition possible frames excluded by an exclusion rule 5.

[0028] FIG. 18 is a diagram illustrating an example of the information superimposition possible frames excluded by an exclusion rule 6.

[0029] FIG. 19 is a diagram illustrating an example of transition of a vehicle position.

[0030] FIG. 20 is a diagram illustrating an example of a change in direction of the vehicle.

[0031] FIG. 21 depicts diagrams illustrating scene images at vehicle positions.

[0032] FIG. 22 is a diagram illustrating an example of an angular velocity in a user visual field.

[0033] FIG. 23 is a diagram illustrating an example of an angle with respect to a vehicle traveling direction.

[0034] FIG. 24 is a diagram illustrating an example of an exposed area ratio.

[0035] FIG. 25 is a diagram illustrating the example of the exposed area ratio.

[0036] FIG. 26 is a diagram illustrating an example of stay time in the user visual field.

[0037] FIG. 27 is a diagram illustrating an example of setting an information superimposition appropriate visual field.

[0038] FIG. 28 is a block diagram illustrating a configuration example of a superimposition target frame selection unit of FIG. 9.

[0039] FIG. 29 depicts diagrams each illustrating an example of content information items.

[0040] FIG. 30 depicts diagrams each illustrating an example of fitness.

[0041] FIG. 31 is a diagram illustrating an example of setting superimposition locations.

[0042] FIG. 32 is a diagram illustrating an example of the superimposition locations.

[0043] FIG. 33 is a block diagram illustrating a configuration example of a display control unit of FIG. 9.

[0044] FIG. 34 is a diagram illustrating an example of adjustment of contrast on the basis of fitting contrast.

[0045] FIG. 35 is a diagram illustrating an example of display of a front object.

[0046] FIG. 36 is a flow chart describing an information display process.

[0047] FIG. 37 is a flow chart describing an information superimposition appropriate visual field setting process executed in step S3 of FIG. 36.

[0048] FIG. 38 is a flow chart following FIG. 37, describing the information superimposition appropriate visual field setting process executed in step S3 of FIG. 36.

[0049] FIG. 39 is a flow chart describing a superimposition target frame selection process executed in step S4 of FIG. 36.

[0050] FIG. 40 is a flow chart describing a display process executed in step S5 of FIG. 36.

[0051] FIG. 41 is a flow chart describing a pre-analysis process of content.

[0052] FIG. 42 is a diagram describing a summary of an example of superimposing, defocusing, and displaying the content on information superimposition appropriate frames according to a visual point position of the user when there is one user according to a second embodiment of the present technique.

[0053] FIG. 43 is a diagram describing a setting example of a defocus range in a case where there is one information superimposition appropriate frame.

[0054] FIG. 44 is a diagram describing a setting example of defocus ranges in a case where there is a plurality of information superimposition appropriate frames and describing a display example when a projection unit is a transmissive display.

[0055] FIG. 45 is a diagram describing a configuration example of the display control unit according to the second embodiment of the present technique.

[0056] FIG. 46 is a diagram describing a configuration example of a display processing unit of FIG. 45.

[0057] FIG. 47 is a flow chart describing a display process of the display control unit of FIG. 45.

[0058] FIG. 48 is a flow chart describing a defocus range map generation process of step S202 in FIG. 47.

[0059] FIG. 49 is a diagram describing a configuration example of the display processing unit when the projection unit is a non-transmissive display according to a modification of the second embodiment of the present technique.

[0060] FIG. 50 is a flow chart describing a display process of the display control unit of FIG. 45 in which the display processing unit of FIG. 49 is applied.

[0061] FIG. 51 is a diagram describing a setting example of the defocus ranges in a case where there is a plurality of information superimposition appropriate frames and describing a display example when the projection unit is a non-transmissive display.

[0062] FIG. 52 is a diagram describing a summary of an example of superimposing, defocusing, and displaying the content on the information superimposition appropriate frames according to the visual point positions of a plurality of users when there is a plurality of users according to a third embodiment of the present technique.

[0063] FIG. 53 is a diagram describing a configuration example of a display unit using a liquid crystal polarization shutter in the case of superimposing, defocusing, and displaying the content on the information superimposition appropriate frames according to the visual point positions of a plurality of users when there is a plurality of users.

[0064] FIG. 54 is a block diagram illustrating a configuration example of the vehicle control system of the third embodiment.

[0065] FIG. 55 is a block diagram illustrating a configuration example of the display processing unit when the liquid crystal polarization shutter is used for the display unit in the display control unit of the output control unit in the vehicle control system of FIG. 54.

[0066] FIG. 56 is a flow chart describing a display process of the display control unit of FIG. 45 in which the display processing unit of FIG. 55 is applied.

[0067] FIG. 57 is a diagram describing a configuration example of the display unit using lenticular lenses in the case of superimposing, defocusing, and displaying the content on the information superimposition appropriate frames according to the visual point positions of a plurality of users when there is a plurality of users.

[0068] FIG. 58 is a block diagram illustrating a configuration example of the display processing unit when the lenticular lenses are used for the display unit in the display control unit of the output control unit in the vehicle control system of FIG. 54.

[0069] FIG. 59 is a flow chart describing a display process of the display control unit of FIG. 45 in which the display processing unit of FIG. 58 is applied.

[0070] FIG. 60 is a block diagram illustrating a configuration example of a computer.

DESCRIPTION OF EMBODIMENTS

[0071] Hereinafter, embodiments of the present technique will be described. The embodiments will be described in the following order.

1.* First Embodiment*

1-1.* Display Example of Content*

1-2.* Configuration Example of Vehicle Control System*

1-3.* Motion of Vehicle Control System*

1-4.* Modification*

2.* Second Embodiment*

2-1.* Summary of Second Embodiment*

2-2.* Setting Example of Defocus Range*

2-3.* Setting Example of Defocus Ranges in Case Where There Is Plurality Of Information Superimposition Appropriate Frames*

2-4.* Configuration Example of Second Embodiment of Display Control Unit*

2-5.* Modification*

3.* Third Embodiment*

3-1.* Summary of Third Embodiment*

3-2.* Configuration Example of Vehicle Control System*

3-3. Display Process of Display Processing Unit in FIG. 55

3-4.* Modification*

1.* First Embodiment*

<<1-1. Display Example of Content>>

[0072] FIG. 1 is a diagram illustrating an interior near a driver’s seat of a vehicle provided with a vehicle control system according to an embodiment of the present technique.

[0073] As illustrated in FIG. 1, a windshield G is provided beyond a dashboard as viewed from a user (driver) sitting on the driver’s seat. The vehicle control system displays content by, for example, projecting an image on the windshield G. The user views the content on top of a scene that can be viewed through the windshield G.

[0074] Note that, although the occupant of the vehicle viewing the content is the driver in the case described below, the user viewing the content may also be another user sitting on the front seat or the back seat.

……
……
……