Image tracking system and method and observer tracking autostereoscopic display

• US 6,075,557 A
• Filed: 04/16/1998
• Issued: 06/13/2000
• Est. Priority Date: 04/17/1997
• Status: Expired due to Fees

• Current Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Holliman, Nicholas Steven, Woodgate, Graham John, Ezra, David, Hong, Qi He
• Primary Examiner(s): Kelley, Chris S.
• Assistant Examiner(s): Philippe, Gims S.
• Application Number:
  US09/061,690
• Time in Patent Office: 789 Days
• Field of Search: 348/51, 348/56, 348/59, 348/60, 348/54, 348/169, 348/170, 351/237, 351/246, 359/463, 359/465, 359/630, 382/117, 382/103, 382/173
• US Class Current: 348/51
• CPC Class Codes: G02B 30/26 of the autostereoscopic type
• CPC Class Codes: H04N 13/10 Processing, recording or transmission of stereoscopic or multi-view image signals
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/286 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/31 using parallax barriers
• CPC Class Codes: H04N 13/32 using arrays of controllable light sources; using moving apertures or moving light sources
• CPC Class Codes: H04N 13/327 Calibration thereof
• CPC Class Codes: H04N 13/346 using prisms or semi-transparent mirrors
• CPC Class Codes: H04N 13/373 for tracking forward-backward translational head movements, i.e. longitudinal movements
• CPC Class Codes: H04N 13/376 for tracking left-right translational head movements, i.e. lateral movements
• CPC Class Codes: H04N 13/378 for tracking rotational head movements around an axis perpendicular to the screen
• CPC Class Codes: H04N 13/38 for tracking vertical translational head movements
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding

Abstract

An image tracking system which is configured to present a sequence of images, determine the position of a target image in a previously presented image, determine movement of the target image between the previously presented image and a subsequently presented image, and indicate the position of the target image in the subsequently presented image as the aforementioned determined position modified by the determined movement.

Claims

1. An image tracking system which determines a position of a target image as the position of the target image varies, the image tracking system comprising:

first means for presenting a sequence of images,

second means for determining the position of the target image in a previously presented image from the first means,

third means for determining movement of the target image between the previously presented image and a subsequently presented image from the first means, and

fourth means for producing an output indicating the position of the target image in the subsequently presented image as the position determined by the second means modified by the movement determined by the third means,

wherein the third means is arranged to determine movement at a plurality of image elements in a second image portion which is wholly within and smaller than the target image,

the third means is arranged to determine translational movement of the target image, and

the third means is arranged to solve a set of equations;

space="preserve" listing-type="equation">f.sub.1 (x.sub.i,y.sub.i)=f.sub.2 (X.sub.i,y.sub.i)+Δ

xδ

f.sub.2 (x.sub.i,y.sub.i)/δ

x+Δ

yδ

f.sub.2 (x.sub.i,y.sub.i)/δ

y

where x_i and y_i are Cartesian coordinates of an ith image element, i is each integer such that 1≦

i≦

j and j is an integer greater than one, f₁ and f₂ are functions representing the previously and subsequently presented images and Δ

x and Δ

y are the Cartesian components of the movement.

2. A system as claimed in claim 1, wherein the subsequently presented image is consecutive with the previously presented image.

3. A system as claimed in claim 1, wherein the previously presented image comprises each of the images of the sequence in turn.

4. A system as claimed in claim 1, wherein the first means is arranged to present the sequence of images in real time.

5. A system as claimed in claim 4, wherein the first subsequently presented image is the currently presented image.

6. A system as claimed in claim 4, wherein the means comprises a video camera.

7. A system as claimed in claim 1, wherein the first means comprises a memory for storing the previously presented image and the subsequently presented image.

8. A system as claimed in claim 1, wherein the sequence of images comprises consecutive fields of interlaced fields.

9. A system as claimed in claim 1, wherein the second, third and fourth means comprise a programmed data processor.

10. A system as claimed in claim 1, wherein the fourth means is arranged to add the movement determined by the third means to the position determined by the second means.

11. A system as claimed in claim 1, wherein the third means is arranged to determine the movement as soon as the subsequently presented image has been presented by the first means.

12. A system as claimed in claim 11, wherein the second means is arranged to determine the position of the target image on the subsequently presented image as soon as the third means has determined the movement.

13. A system as claimed in claim 1, wherein the second means is arranged to search for the target image in a first image portion which is smaller than the images of the sequence and which includes the position indicated by the fourth means.

14. A system as claimed in claim 13, wherein the position indicated by the fourth means is substantially at the center of the first image portion.

17. A System as claimed in claim 13, wherein the second means is arranged to perform template matching of the target image at a plurality of first positions in the first image portion to find the best match.

21. A system as claimed in claim 1, further comprising fifth means for capturing the target image by storing a portion of one of the images of the sequence.

22. A system as claimed in claim 21, wherein the fifth means comprises a display for displaying the sequence of images, an image generator for generating a border image on the display, and a user operable control for actuating capture of an image region within the border image.

23. A system as claimed in claim 22, wherein the fifth means comprises a further user operable control for controlling the position of the border image on the display.

24. A system as claimed in claim 1, wherein the third means is arranged to determine movement at a plurality of image elements in a second image portion which is wholly within and smaller than the target image.

25. A system as claimed in claim 24, wherein the third means is arranged to determine translational movement of the target image.

26. An observer tracking autostereoscopic display including a system as claimed in claim 1.

27. A display as claimed in claim 26, wherein the first means comprises a video camera disposed at an optical center of the display.

15. An image tracking system which determines a position of a target image as the position of the target image varies, the image tracking system comprising:

first means for presenting a sequence of images,

second means for determining the position of the target image in a previously presented image from the first means,

third means for determining movement of the target image between the previously presented image and a subsequently presented image from the first means, and

fourth means for producing an output indicating the position of the target image in the subsequently presented image as the position determined by the second means modified by the movement determined by the third means,

wherein the second means is arranged to search for the target image in a first image portion which is smaller than the images of the sequence and which includes the position indicated by the fourth means, and

the second means is arranged to search for the target image in the whole of the previously presented image if the search in the first image portion is unsuccessful.

16. An image tracking system which determines a position of a target image as the position of the target image varies, the image tracking system comprising:

first means for presenting a sequence of images,

second means for determining the position of the target image in a previously presented image from the first means,

third means for determining movement of the target image between the previously presented image and a subsequently presented image from the first means, and

fourth means for producing an output indicating the position of the target image in the subsequently presented image as the position determined by the second means modified by the movement determined by the third means,

wherein the second means is arranged to search for the target image in a first image portion which is smaller than the images of the sequence and which includes the position indicated by the fourth means, and

the second means is arranged to search for the target image in the whole of an initial previously presented image.

18. An image tracking system which determines a position of a target image as the position of the target image varies, the image tracking system comprising:

first means for presenting a sequence of images,

second means for determining the position of the target image in a previously presented image from the first means,

third means for determining movement of the target image between the previously presented image and a subsequently presented image from the first means, and

fourth means for producing an output indicating the position of the target image in the subsequently presented image as the position determined by the second means modified by the movement determined by the third means,

wherein the second means is arranged to search for the target image in a first image portion which is smaller than the images of the sequence and which includes the position indicated by the fourth means,

the second means is arranged to perform template matching of the target image at a plurality of first positions in the first image portion to find the best match, and

the second means is arranged to perform template matching of the target image at a plurality of second positions which are more finely spaced than the first positions and which are disposed adjacent a position corresponding to the best match.

19. An image tracking system which determines a position of a target image as the position of the target image varies, the image tracking system comprising:

first means for presenting a sequence of images,

second means for determining the position of the target image in a previously presented image from the first means,

third means for determining movement of the target image between the previously presented image and a subsequently presented image from the first means, and

fourth means for producing an output indicating the position of the target image in the subsequently presented image as the position determined by the second means modified by the movement determined by the third means,

wherein the second means is arranged to search for the target image in a first image portion which is smaller than the images of the sequence and which includes the position indicated by the fourth means,

the second means is arranged to perform template matching of the target image at a plurality of first positions in the first image portion to find the best match, and

the second means is arranged to perform a correlation between the target image and a region corresponding to the first position and a correlation between the target image and a region corresponding to the second position and to select the highest correlation.

20. A system as claimed in claim 19, wherein the second means is arranged to compare the highest correlation with a threshold for acceptability.

28. An image tracking method for sequentially presented images, comprising determining the position of a target image in a previously presented image, determining movement of the target image between the previously presented image and a subsequently presented image, and indicating the position of the target image in the subsequently presented image as the position in the previously presented image modified by the determined movement

wherein the step of determining movement comprises the steps of determining movement at a plurality of image elements in a second image portion which is wholly within and smaller than the target image, determining translational movement of the target image, and solving a set of equations:

space="preserve" listing-type="equation">f.sub.1 (x.sub.i, y.sub.i)=f.sub.2 (x.sub.i,y.sub.i)+Δ

xδ

f.sub.2 (x.sub.i,y.sub.i)/δ

x+Δ

yδ

f.sub.2 (x.sub.i,y.sub.i)/δ

y

where x_i and y_i are Cartesian coordinates of an ith image element, i is each integer such that 1≦

i≦

j and j is an integer greater than one, f₁ and f₂ are functions representing the previously and subsequently presented images and Δ

x and Δ

y are the Cartesian components of the movement.