HTC Patent | Eye Tracking Method, Electronic Device, And Non-transitory Computer Readable Storage Medium

Patent: Eye Tracking Method, Electronic Device, And Non-transitory Computer Readable Storage Medium

Publication Number: 20180335840

Publication Date: 2018-11-22

Applicants: HTC Corporation

Abstract

An eye tracking method includes: capturing, by a camera, an image of an eye; detecting, by a processing circuit, a pupil region of interest in the image of the eye; analyzing, by the processing circuit, the pupil region of interest to obtain a gaze vector of the pupil region of interest; calculating, by the processing circuit, a viewpoint of the eye according to the gaze vector based on an eye model, in which the eye model includes a matrix indicating relationship between the viewpoint of the eye and the gaze vector of the pupil region of interest; and tracking, by the processing circuit, a motion of the eye based on the viewpoint calculated using the eye model.

BACKGROUND 

Technical Field

The present disclosure relates to an electronic device and an eye tracking method. More particularly, the present disclosure relates to the electronic device and the eye tracking method in a head mount display (HMD).

Description of Related Art

Nowadays, eye tracking methods are used in various applications. For example, in virtual reality (VR) or augmented reality (AR) application, eye tracking methods are used in the VR/AR system to trace a user's gazing direction in order to provide corresponding reaction and/or control in the VR/AR environment.

SUMMARY 

One aspect of the present disclosure is related to an eye tracking method. The eye tracking method includes capturing, by a camera, an image of an eye; detecting, by a processing circuit, a pupil region of interest in the image of the eye; analyzing, by the processing circuit, the pupil region of interest to obtain a gaze vector of the pupil region of interest; calculating, by the processing circuit, a viewpoint of the eye according to the gaze vector based on an eye model, in which the eye model includes a matrix indicating relationship between the viewpoint of the eye and the gaze vector of the pupil region of interest; and tracking, by the processing circuit, a motion of the eye based on the viewpoint calculated using the eye model.

Another aspect of the present disclosure is related to an electronic device. In accordance with some embodiments of the present disclosure, the electronic device includes a camera, a processing circuit electrically connected to the camera, a memory electrically connected to the processing circuit, and one or more programs. The one or more programs are stored in the memory and configured to be executed by the processing circuit. The one or more programs including instructions for: controlling the camera to capture an image of an eye; detecting a pupil region of interest in the image of the eye; analyzing the pupil region of interest to obtain a gaze vector of the pupil region of interest; calculating a viewpoint of the eye according to the gaze vector based on an eye model, in which the eye model includes a matrix indicating relationship between the viewpoint of the eye and the gaze vector of the pupil region of interest; and tracking a motion of the eye based on the viewpoint calculated using the eye model.

Another aspect of the present disclosure is related to a non-transitory computer readable storage medium. In accordance with some embodiments of the present disclosure, the non-transitory computer readable storage medium stores one or more programs including instructions, which when executed, causes a processing circuit to perform operations including: controlling a camera to capture an image of an eye; detecting a pupil region of interest in the image of the eye; analyzing the pupil region of interest to obtain a gaze vector of the pupil region of interest; calculating a viewpoint of the eye according to the gaze vector based on an eye model, in which the eye model includes a matrix indicating relationship between the viewpoint of the eye and the gaze vector of the pupil region of interest; and tracking a motion of the eye based on the viewpoint calculated using the eye model.

It is to be understood that both the foregoing general description and the following detailed description are by examples, and are intended to provide further explanation of the disclosure as claimed.