HEAD MOUNT DISPLAY DEVICE PROVIDING EYE GAZE CALIBRATION AND CONTROL METHOD THEREOF
First Claim
1. A head mounted display (HMD) device comprising:
- a camera unit configured to sense an image of surroundings located in front of the HMD device;
an image processing unit configured to detect a reference object from the sensed image of the surroundings;
an eye gaze detection unit configured to detect an eye gaze direction in which a user gazes at the detected reference object; and
a controller configured to perform eye gaze calibration based on the detected reference object and the detected eye gaze direction,wherein the image processing unit is configured todetect at least one object contained in the sensed image of the surroundings as a first object,detect a hand of the user contained in the sensed image of the surroundings as a second object,detect an event of the second object with respect to the first object, anddecide the first object, on which the event has been detected, as the reference object.
1 Assignment
0 Petitions
Accused Products
Abstract
An eye gaze calibration method includes sensing an image of surroundings located in front of the HMD device using a camera unit, detecting a reference object from the sensed image of the surroundings using an image processing unit, detecting an eye gaze direction in which a user gazes at the detected reference object using an eye gaze detection unit, and performing eye gaze calibration based on the detected reference object and the detected eye gaze direction using a controller, wherein detecting the reference object includes detecting at least one object contained in the sensed image as a first object, detecting a hand of the user contained in the sensed image as a second object, detecting an event of the second object with respect to the first object, and deciding the first object, on which the event has been detected, as the reference object.
-
Citations
21 Claims
-
1. A head mounted display (HMD) device comprising:
-
a camera unit configured to sense an image of surroundings located in front of the HMD device; an image processing unit configured to detect a reference object from the sensed image of the surroundings; an eye gaze detection unit configured to detect an eye gaze direction in which a user gazes at the detected reference object; and a controller configured to perform eye gaze calibration based on the detected reference object and the detected eye gaze direction, wherein the image processing unit is configured to detect at least one object contained in the sensed image of the surroundings as a first object, detect a hand of the user contained in the sensed image of the surroundings as a second object, detect an event of the second object with respect to the first object, and decide the first object, on which the event has been detected, as the reference object. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. An eye gaze calibration method of an HMD device comprising:
-
sensing an image of surroundings located in front of the HMD device using a camera unit; detecting a reference object from the sensed image of the surroundings using an image processing unit; detecting an eye gaze direction in which a user gazes at the detected reference object using an eye gaze detection unit; and performing eye gaze calibration based on the detected reference object and the detected eye gaze direction using a controller, wherein the step of detecting the reference object comprises; detecting at least one object contained in the sensed image of the surroundings as a first object; detecting a hand of the user contained in the sensed image of the surroundings as a second object; detecting an event of the second object with respect to the first object; and deciding the first object, on which the event has been detected, as the reference object.
-
-
20. An eye gaze calibration method of an HMD device comprising:
-
sensing an image of surroundings located in front of the HMD device using a camera unit; detecting a reference object from the sensed image of the surroundings using an image processing unit; detecting an eye gaze direction in which a user gazes at the detected reference object using an eye gaze detection unit; and performing eye gaze calibration based on the detected reference object and the detected eye gaze direction using a controller, wherein the step of detecting the reference object comprises; detecting a hand of the user contained in the sensed image of the surroundings as a first object; detecting at least one object contained in the sensed image of the surroundings as a second object; detecting an event of the first object with respect to the second object; and deciding the second object, on which the event has been detected, as the reference object.
-
-
21. An HMD device comprising:
-
a camera unit configured to sense an image of surroundings located in front of the HMD device; an image processing unit configured to detect a reference object from the sensed image of the surroundings; an eye gaze detection unit configured to detect an eye gaze direction in which a user gazes at the detected reference object; and a controller configured to perform eye gaze calibration based on the detected reference object and the detected eye gaze direction, wherein the image processing unit is configured to detect a hand of the user contained in the sensed image of the surroundings, detect a gesture performed by the hand of the user, and decide the detected hand of the user together with the gesture as the reference object.
-
Specification