View Projection for Dynamic Configurations

• US 20090073324A1
• Filed: 06/18/2008
• Published: 03/19/2009
• Est. Priority Date: 09/18/2007
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Tan, Kar-Han, Bagg, Edward
• Granted Patent: US 7,978,928 B2
• Time in Patent Office: Days
• US Class Current: 348/745
• CPC Class Codes: G03B 21/005 Projectors using an electronic spatial light modulator but not peculiar thereto
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14

Abstract

A method and system for compensating for a moving object placed between a projector and a projection scene is shown. The method/system dividing a movement pattern of the moving object into N discrete position states, and for each of said N position states determining a corresponding view projection matrix. While projecting an image within any of the N position states, multiplying a desired projection image by the corresponding view projection matrix.

Claims

1. Method of reducing distortion of an image projected onto a moving object, said method comprising the following steps:

i) dividing a movement pattern of said moving object into N discrete position states;

ii) for each discrete position state;

a) obtaining a light transport matrix T relating a projector to a camera whose field-of-vision includes said moving object;

b) for each row in light transport matrix T, comparing matrix entries along a common row of said light transport matrix T, retaining the highest valued matrix entry in the common row and assigning a null value to remaining entries in said common row to create a modified light transport matrix T*;

c) identifying, in turn, each column in modified light transport matrix T* as a target column, and for each target column calculating normalized values for non-null values in said target column with reference to said target column;

d) creating an intermediate matrix of equal size as said modified light transport matrix T*;

e) populating each column in said intermediate matrix with the calculated normalized values of its corresponding target column in said modified light transport matrix T*, each normalized value in each populated column in said intermediate matrix maintaining a one-to-one correspondence with said non-null entry values in its corresponding column in said modified light transport matrix T*;

f) applying a transpose matrix operation on said intermediate matrix to create a view projection matrix V_CI, and correlating said created view projection matrix to the current discrete position state of said moving object;

g) creating a transformed image p_I of a desired projection image by multiplying said desired projection image by its corresponding view projection matrix V_CI as determined by the moving object'"'"'s current discrete position state DP_I, said current discrete position state DP_I being the one of said N discrete position states within which said moving object currently resides, said transformed image p_I being correlated to its corresponding current discrete position state DP_I; and

iii) having said projector project transformed images correlated to the discrete position state within which said moving object currently resides.

2. The method of claim 1, wherein as said moving object moves through said N discrete position states, said projector projects transformed images corresponding to said N discrete position states as correlated by the N view projection matrices.

3. The method of claim 2, wherein said projector is synchronized to said moving object to determine in which of said N discrete projection states said moving object resides at any given time.

4. The method of claim 1, wherein a feedback communication link is establish between said projector and said moving object to determine in which of said N discrete projection states said moving object resides at any given time.

5. The method of claim 4, wherein said feedback communication link is established by providing a plurality of light emitting sources on said moving object and providing at least one light sensor on said projector.

6. The method of claim 4, wherein said feedback communication link is established by providing radio communications between said moving object and said projector.

7. The method of claim 4, wherein said feedback communication link is established by providing a wired link between said moving object and said projector.

8. The method of claim 1, further comprising:

dividing a memory space into N sectors, each storing a corresponding one of said N view projection matrices; and

providing a memory space pointer for selecting within said memory space one of said N sectors in accordance with the one of said N discrete position states through which said moving object is moving at any given time.

9. The method of claim 1, further comprising:

providing N memory spaces, each storing a corresponding one of said N view projection matrices;

simultaneously applying N multiplication operations by multiplying a common desired image by each of the N view projection matrices when said moving object is moving through any of said N discrete position states, each of said N multiplication operations producing a corresponding one of N transformed images;

applying said N transformed images to a multiplexer having a Matrix_Select control input for outputting a selected one of said N transformed images;

using said Matrix_Select input to select for output the transformed image corresponding to the discrete position state though which said moving object is currently moving;

wherein said projector projects the transformed image outputted by said multiplexer.

10. The method of claim 1, further comprising:

providing N memory spaces, each storing a corresponding one of said N view projection matrices;

providing a switching network for submitting to a multiplication operation a desired projection image, said multiplication operation being matrix multiplication of said desired projection image by a selected one view projection matrix within a selected one of said N memory spaces to produce a transformed image, as determined by the one of N discrete position states though which said moving object is currently moving, said selected one of said N memory spaces being selected by application of a corresponding enable input;

wherein said projector projects the transformed image created by said matrix multiplication.

11. The method of claim 1, wherein step ii) further comprises

h) storing the created transformed image into a collection of such-created transformed images;

wherein in said step iii), said projector obtains the transformed image for projecting from said collection of such-created transformed images.

12. The method of claim 11, wherein the said transformed images are further transformed into one of an mpeg 1, mpeg 11, avi, or avc format prior to being added to said collection of such-created transformed images.

13. The method of claim 11, wherein said collection of such-created transformed images are transferred to film prior to being projected by said projector.

14. The method of claim 1, wherein said moving object is an advertisement display.

15. The method of claim 14, wherein said transformed image p_I provides additional information related to said advertisement display.

16. A projection system for reducing distortion of an image projected onto a moving object having a predefined movement pattern defined into N discrete position states, said method comprising:

a view projection matrix generator for generating N individual view projection matrices V_CI each correlated to a corresponding one of said N discrete position states;

an image transformer for creating a transformed image p_I of a desired projection image by multiplying said desired projection image by a corresponding one of N view projection matrices V_CI as determined by the moving object'"'"'s current discrete position state DP_I, said current discrete position state DP_I being the one of said N discrete position states within which said moving object currently resides, said transformed image p_I being correlated to its corresponding current discrete position state DP_I and

a projector for projecting transformed images correlated to the discrete position state within which said moving object currently resides.

17. The projection system of claim 16, wherein said view projection matrix generator generates each of said N individual view projection matrices V_CI for each of said N discrete position states by:

a) obtaining a light transport matrix T for each of said N discrete position states, said light transport matrix T relating said projector to a camera whose field-of-vision includes said moving object;

b) for each row in light transport matrix T, comparing matrix entries along a common row of said light transport matrix T, retaining the highest valued matrix entry in the common row and assigning a null value to remaining entries in said common row to create a modified light transport matrix T*;

c) identifying, in turn, each column in modified light transport matrix T* as a target column, and for each target column calculating normalized values for non-null values in said target column with reference to said target column;

d) creating an intermediate matrix of equal size as said modified light transport matrix T*;

e) populating each column in said intermediate matrix with the calculated normalized values of its corresponding target column in said modified light transport matrix T*, each normalized value in each populated column in said intermediate matrix maintaining a one-to-one correspondence with said non-null entry values in its corresponding column in said modified light transport matrix

f) applying a transpose matrix operation on said intermediate matrix to create said view projection matrix V_CI, and correlating said created view projection matrix to the current discrete position state of said moving object.

18. The projection system of claim 16, wherein as said moving object moves through said N discrete position states, said projector projects transformed images corresponding to said N discrete position states as correlated by the N view projection matrices.

19. The projection system of claim 18, wherein said projector is synchronized to said moving object to determine in which of said N discrete projection states said moving object resides at any given time.

20. The projection system of claim 16, wherein a feedback communication link is establish between said projector and said moving object to determine in which of said N discrete projection states said moving object resides at any given time.

21. The projection system of claim 20, wherein said feedback communication link is established by providing a plurality of light emitting sources on said moving object and providing at least one light sensor on said projector.

22. The projection system of claim 20, wherein said feedback communication link is established by providing radio communications between said moving object and said projector.

23. The projection system of claim 20, wherein said feedback communication link is established by providing a wired link between said moving object and said projector.

24. The projection system of claim 16, further comprising:

a matrix selection device for dividing a memory space into N sectors, each storing a corresponding one of said N view projection matrices, and for providing a memory space pointer for selecting within said memory space one of said N sectors in accordance with the one of said N discrete position states through which said moving object is moving at any given time.

25. The projection system of claim 16, further comprising:

a matrix selection device providing N memory spaces, each storing a corresponding one of said N view projection matrices;

said matrix selection device further simultaneously applying N multiplication operations by multiplying a common desired image by each of the N view projection matrices when said moving object is moving through any of said N discrete position states, each of said N multiplication operations producing a corresponding one of N transformed images;

said matrix selection device further applying said N transformed images to a multiplexer having a Matrix_Select control input for outputting a selected one of said N transformed images, said Matrix_Select input being effective for selecting for output the transformed image corresponding to the discrete position state though which said moving object is currently moving;

wherein said projector projects the transformed image outputted by said multiplexer.

26. The projection system of claim 16, further comprising:

N memory spaces, each storing a corresponding one of said N view projection matrices;

a switching network for submitting to a multiplication operation a desired projection image, said multiplication operation being matrix multiplication of said desired projection image by a selected one view projection matrix within a selected one of said N memory spaces to produce a transformed image, as determined by the one of N discrete position states though which said moving object is currently moving, said selected one of said N memory spaces being selected by application of a corresponding enable input;

wherein said projector projects the transformed image created by said matrix multiplication.

27. The projection system of claim 16, wherein said image transformer further stores the created transformed image into a collection of such-created transformed images, and said projector obtains the transformed image for projecting from said collection of such-created transformed images.

28. The projection system of claim 27, wherein the said transformed images are further transformed into one of an mpeg 1, mpeg 11, avi, or avc format prior to being added to said collection of such-created transformed images.

29. The projection system claim 27, wherein said collection of such-created transformed images are transferred to film prior to being projected by said projector.

30. The projection system of claim 16, wherein said moving object is an advertisement display.