HEAD TRACKING METHOD AND DEVICE

• US 20140240218A1
• Filed: 01/20/2014
• Published: 08/28/2014
• Est. Priority Date: 01/18/2013
• Status: Abandoned Application

• Current Assignee: Neo Medical Systems S.A.
• Original Assignee: Scalais, Francois
• Inventors: Scalais, Franois, Fradier, Emmanuel, Stricker, Didier, Schmitz, Norbert
• Application Number:
  US14/159,035
• Publication Number:
  US 20140240218A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/03 Arrangements for converting the position or the displacement of a member into a coded form
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/10152 Varying illumination
• CPC Class Codes: G06T 2207/20076 Probabilistic image processing
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/251 involving models
• CPC Class Codes: G06T 7/277 involving stochastic approaches, e.g. using Kalman filters
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes

Abstract

The invention extends to a tracking device for tracking a position of a moving object such as a human head or eyes, the device comprising a camera, a radiation source radiating electro-magnetic radiation, and a processor for calculating variables indicative of the position of an object relative to the camera, wherein the camera is adapted to capture images using illumination provided by the radiation source, wherein the radiation source comprises a source of infrared radiation and the camera comprises a monocular image input. Further aspects of the invention relate to an associated method for tracking a moving object; to quickly sorting a set of competing models of the users head; the use of threshold conversion to distinguish characteristics of captured images, and controlling the output of a three dimensional display in dependence on the tracked position of a user'"'"'s head.

Claims

1. A tracking device for tracking a position of a user'"'"'s head, the device comprising a camera, a radiation source radiating electro-magnetic radiation, and a processor for calculating parameters indicative of the position of the head relative to the camera, wherein the camera is adapted to capture images using illumination provided by the radiation source, wherein the radiation source comprises a source of infrared radiation and the camera comprises a monocular image input, wherein

the tracking device further comprises a display adapter for controlling a three dimensional display, wherein the display adapter is adapted to control a three dimensional display in dependence on the calculated variables indicative of the position of the head.

2. The tracking device according to claim 1 wherein the processor is adapted to designate an area of a captured image as the head on the basis of recognizing one or more eyes and/or recognizing one or more tracking markers attached to the head, and/or the processor is adapted to recognize a user according to the presence of a recognition marker.

5. The tracking device according to claim 1, wherein the processor is adapted to control the display adapter to display three dimensional information when a user is recognized and display two dimensional information when a user is not recognized, wherein the tracking marker or the recognition markers comprise one or more markers adhered to clothing.

7. The tracking device according to claim 1, wherein the camera captures successive images and wherein each image corresponds to an illumination of the head by the radiation source, wherein the radiation source radiates infrared radiation, and wherein the radiation source comprises two sets of infrared light sources arranged so that a first set is closer to the camera than a second set, and wherein the processor is adapted to compare an image captured when the first set is activated, and the second set is not activated, to an image captured when the second set is activated and the first set is not activated and/or wherein the processor is adapted to process images captured when the first set of infrared light sources is activated for information relating to recognition markers and/or tracking markers attached to the head.

12. The tracking device according to claim 1, wherein the processor is adapted to generate a model corresponding to the object and evaluate a likelihood that the model represents the object and wherein the processor is adapted to perform the evaluation of the likelihood using a threshold conversion of one or more regions of the image, wherein the model comprises a three dimensional model of the head, and wherein the three dimensional model of the head comprises three dimensional locations for two eyes and one or more markers, and wherein the processor is adapted to produce a plurality of models arranged in a first list, each model being representative of a change in position of the object, and select one or more models from said plurality of models to correspond to a change in position of the object, wherein the processor is adapted to select the one or more models on the basis of:

ascribing a weight to each of the plurality of models;

creating an indexed list of the first list of the plurality of models by indexing each model in accordance with a weight of each model; and

performing a binary search on the indexed list.

16. The tracking device according to claim 12, wherein the model is a two dimensional model.

17. The tracking device according to claim 1, wherein the processor comprises a central processing unit connected to a memory storing a computer program, the central processing unit being adapted to process the computer program.

18. A system for displaying three dimensional information comprising a tracking device according to claim 1 and a three dimensional display wherein the three dimensional display is connected to the display adapter, and wherein the three dimensional display is an autostereoscopic display for simultaneously displaying a left-eye image and a right-eye image, wherein the display adapter is adapted to swap the left-eye image and the right-eye image in dependence on the location of the user'"'"'s head relative to the three dimensional display.

3-4. -4. (canceled)

6. (canceled)

8-11. -11. (canceled)

13-15. -15. (canceled)

19. (canceled)

20. A method of tracking a position of a user'"'"'s head comprising:

illuminating the user'"'"'s head using radiation emitted by a radiation source;

capturing images of the user'"'"'s head using a camera;

wherein the radiation source comprises a source of infrared radiation and the camera comprises a monocular image input,

calculating parameters indicative of the position of the head relative to the camera, and

controlling a three dimensional display in dependence on the calculated parameters.

21. The method according to claim 20, further comprising:

designating an area of a captured image as the head on the basis of recognizing one or more eyes of the head and/or one or more tracking markers;

recognizing a user according to the presence of one or more recognition markers, wherein three dimensional information is displayed when a user is recognized and two dimensional information is displayed when a user is not recognized;

capturing successive images wherein each image corresponds to an illumination of the head by the radiation source, wherein the radiation source radiates electromagnetic radiation predominantly as infrared radiation, and wherein the radiation source comprises two sets of infrared light sources arranged so that a first set is closer to the camera than a second set;

comparing an image captured when the first set is activated, and the second set is not activated, to an image captured when the second set is activated and the first set is not activated;

processing images captured when the first set of infrared light sources is activated for information relating to the recognition and/or tracking markers;

generating a model corresponding to the object and evaluating a likelihood that the model represents the object and wherein the evaluation of the likelihood involves using a threshold conversion of one or more regions of the image;

wherein the one or more tracking markers and/or the one or more recognition markers are adhered to the clothing of the user.

32. The method according to claim 21, wherein said model comprises a three dimensional model of the head, wherein the three dimensional model of the head comprises three dimensional locations for two eyes and one or more markers;

and wherein the method further comprises;

producing a plurality of models arranged in a first list, each model being representative of a change in position of the object, and selecting one or more models from said plurality of models to correspond to a change in position of the object, wherein the processor is adapted to select the one or more models on the basis of;

ascribing a weight to each of the plurality of models;

creating an indexed list of the first list of the plurality of models by indexing each model in accordance with a weight of each model; and

performing a binary search on the indexed list.

35. The method according to claim 32, wherein the model is a two dimensional model.

36. The method according to claim 20 wherein the three dimensional display is an autostereoscopic display for simultaneously displaying a left-eye image and a right-eye image, and wherein controlling the three dimensional display in dependence on the calculated parameters comprises swapping the left-eye image and the right-eye image in dependence on the location of the user'"'"'s head relative to the three dimensional display.

22-31. -31. (canceled)

33-34. -34. (canceled)