LG Patent | Head mounted display with separate wire connected controller

Patent: Head mounted display with separate wire connected controller

Publication Number: 10185390

Publication Date: 2019-01-24

Applicants: LG

Abstract

A system includes a head mounted display (HMD) having at least one of a display unit and a sensing unit and configured to be connected to a mobile terminal in a wired manner, and a mobile terminal configured to control the HMD, wherein the mobile terminal includes a terminal body, an interface unit provided in the terminal body and configured to be connected to the HMD in a wired manner, a sensing unit configured to sense a movement of the terminal body, and a controller configured to output a preset first region of a virtual space on the display unit of the HMD and control the display unit of the HMD to display a second region of the virtual space different from the first region of the virtual space on the basis of a movement of the HMD sensed through the sensing unit of the HMD.

Background

1. Field of the Invention

The present disclosure relates to a system including a mobile terminal capable of controlling a head-mounted display (HMD), and a method of controlling the same.

2. Background of the Invention

Terminals may be generally classified as mobile/portable terminals or stationary terminals according to their mobility. Mobile terminals may also be classified as handheld terminals or vehicle mounted terminals according to whether or not a user can directly carry the terminal.

Mobile terminals have become increasingly more functional. Examples of such functions include data and voice communications, capturing images and video via a camera, recording audio, playing music files via a speaker system, and displaying images and video on a display. More recently, mobile terminals have been configured to receive broadcast and multicast signals which permit viewing of content such as videos and television programs.

As functions of the terminal become more diversified, the terminal can support more complicated functions such as capturing images or video, reproducing music or video files, playing games, receiving broadcast signals, and the like. By comprehensively and collectively implementing such functions, the mobile terminal may be embodied in the form of a multimedia player or a device.

Recently, wearable glass type terminals configured to be mounted on part of a human body have been developed. A glass type terminal mounted on a user’s head may be a head-mounted display (HMD).

The head-mounted display (HMD) refers to various display devices that may be worn on a user’s head, like glasses, to allow the user to view an image (content). As digital devices have been reduced in weight and size, various wearable computers have been developed, and an HMD is also widely used.

A display device provided in a glass type terminal such as an HMD may be combined with an augmented reality technology, N screen technology, and the like, beyond a simple image output function, to provide various user convenience.

In order to support and increase functions of the terminals and HMDs, improvement of structural part and/or software part of a terminal and a structural part and/or software part of an HMD may be considered.

Summary

Therefore, an aspect of the detailed description is to provide a system for controlling a head mounted display (HMD) through a mobile terminal in an optimized manner, and a method for controlling the same.

Another aspect of the detailed description is to provide a system for controlling screen information that can be output on an HMD using a mobile terminal, and a method for controlling the same.

To achieve these and other advantages and in accordance with the purpose of this specification, as embodied and broadly described herein, a system including a mobile terminal and a head mounted display (HMD) includes: an HMD having at least one of a display unit and a sensing unit and configured to be connected to the mobile terminal in a wired manner; and a mobile terminal configured to control the HMD, wherein the mobile terminal includes: a terminal body; an interface unit provided in the terminal body and configured to be connected to the HMD in a wired manner; a sensing unit configured to sense a movement of the terminal body; and a controller configured to output a preset first region of a virtual space on the display unit of the HMD and control the display unit of the HMD to display a second region of the virtual space different from the first region of the virtual space on the basis of a movement of the HMD sensed through the sensing unit of the HMD, wherein in a state in which the second region is output on the display unit of the HMD, when a movement of the terminal body corresponds to a preset movement, the controller outputs the preset first region, instead of the second region, on the display unit of the HMD with respect to a current posture of the HMD.

In an exemplary embodiment of the present disclosure, when the terminal body is moved as the preset movement in a state in which the second region is output, the controller may output the preset first region on the display unit of the HMD even though a movement of the HMD is not sensed.

In an exemplary embodiment of the present disclosure, the controller may relatively rotate the virtual space with respect to the HMD such that the preset first region is output on the display unit of the HMD in response to the preset movement.

In an exemplary embodiment of the present disclosure, the preset first region may be at least one of a default region of the virtual space, a region including a specific object among objects included in the virtual space, and a specific region set by a user.

In an exemplary embodiment of the present disclosure, a movement of the HMD may be sensed by using the sensing unit provided in the mobile terminal.

To achieve these and other advantages and in accordance with the purpose of this specification, as embodied and broadly described herein, a system including a mobile terminal and a head mounted display (HMD) includes: an HMD having at least one of a display unit, a sensing unit, and a user input unit and configured to be connected to the mobile terminal in a wired manner; and a mobile terminal configured to control the HMD, wherein the mobile terminal includes: an interface unit configured to be connected to the HMD in a wired manner; a touch screen; and a controller configured to, when the HMD is moved in a state in which a user input applied to at least one of a touch screen of the mobile terminal and the user input unit of the HMD is maintained in a state in which one portion of a virtual space is output on the display unit of the HMD, maintain output of the one portion of the virtual space on the display unit of the HMD.

In an exemplary embodiment of the present disclosure, when the HMD is moved in a state in which a user input is not applied to the touch screen and the user input unit, the controller may output a portion of the virtual space different from the one portion of the virtual space on the display unit of the HMD.

In an exemplary embodiment of the present disclosure, the system may further include: a wireless communication unit, wherein when an event occurs through the wireless communication unit, the controller may form event information related to the event in the virtual space, and at least a portion of the event information may be displayed on the display unit of the HMD in order to inform about the occurrence of the event.

In an exemplary embodiment of the present disclosure, in a state in which one portion of the event information is output on the display unit of the HMD, when the HMD is rotated in a direction in which the event information is formed, a size of the one portion of the event information output on the display unit of the HMD may be increased.

In an exemplary embodiment of the present disclosure, in a state in which the event information is output on the display unit of the HMD, when the terminal body is moved as a specific movement, the controller may perform an operation related to the event.

In an exemplary embodiment of the present disclosure, the sensing unit of the HMD may sense eyes of the user who wears the HMD and the virtual space may include at least one graphic object associated with a preset function, wherein when it is sensed that the user gazes at any one of the at least one graphic object, the controller may perform a function associated with the any one graphic object.

In an exemplary embodiment of the present disclosure, a selection window for selecting any one of at least two operations may be output on the display unit of the HMD, and when the terminal body is moved in a state in which the selection window is output, the controller may perform any one of the at least two operations on the basis of a direction in which the terminal body is moved.

In an exemplary embodiment of the present disclosure, when the terminal body is moved in a first direction, the controller may perform a first operation, and when the terminal body is moved in a second direction different from the first direction, the controller may perform a second operation different from the first operation.

To achieve these and other advantages and in accordance with the purpose of this specification, as embodied and broadly described herein, a method for controlling a system including a mobile terminal and a head mounted display (HMD) includes: outputting, by the mobile terminal, a preset first region of a virtual space on a display unit of the HMD connected to the mobile terminal in a wired manner; outputting, by the mobile terminal, a second region of the virtual space different from the first region of the virtual space on the display unit of the HMD on the basis of a movement of the HMD; and when a movement of a terminal body of the mobile terminal corresponds to a preset movement in a state in which the second region is output on the display unit of the HMD, controlling, by the mobile terminal, the HMD to output the preset first region, instead of the second region, on the display unit of the HMD with respect to a current posture of the HMD.

In an exemplary embodiment of the present disclosure, in the controlling, when the terminal body is moved as the preset movement in a state in which the second region is output, the mobile terminal may output the preset first region on the display unit of the HMD even though a movement of the HMD is not sensed.

Further scope of applicability of the present application will become more apparent from the detailed description given hereinafter. However, it should be understood that the detailed description and specific examples, while indicating preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the scope of the invention will become apparent to those skilled in the art from the detailed description.