IMAGE PROCESSING FOR PROJECTION ON A PROJECTION SCREEN

• US 20130222386A1
• Filed: 02/20/2013
• Published: 08/29/2013
• Est. Priority Date: 02/23/2012
• Status: Abandoned Application

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: TANNHUSER, FALK, ROUSSEAU, PASCAL
• Application Number:
  US13/772,140
• Publication Number:
  US 20130222386A1
• Time in Patent Office: Days
• US Class Current: 345/428
• CPC Class Codes: G06F 3/1446 display composed of modules, e.g. video walls
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G09G 2320/0693 Calibration of display systems
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: H04N 9/3147 Multi-projection systems displays in general H04N9/12; video walls G06F3/1446, G09G2300/026
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

A method of processing an original image for projection on a projection screen by a projector, comprising performing pixel interpolation between pixels of a first image associated with the original image and pixels of a second image associated with a pixel grid of the projector, wherein at least one of the first image and the second image has a pixel resolution greater than the resolution of, respectively, the original image and the pixel grid.

Embodiments of the invention provide pixelization artifacts reduction in displaying high-definition videos with flexibility and low complexity.

Claims

1. A method of processing an original image for projection on a projection screen by a projector, comprising performing pixel interpolation between pixels of a first image associated with the original image and pixels of a second image associated with a pixel grid of the projector, wherein at least one of the first image and the second image has a pixel resolution greater than the resolution of, respectively, the original image and the pixel grid.

2. A method according to claim 1, further comprising upscaling the original image for obtaining the first image, thereby leading to a pixel resolution of the first image greater than the pixel resolution of the original image.

3. A method according to claim 2, wherein the original image is upscaled according to an upscale factor determined in order to reduce a difference between a first pixel density of the obtained first image and a second pixel density of the second image.

4. A method according to claim 3, wherein the original image is upscaled to said second pixel density.

5. A method according to claim 3, wherein the second pixel density of the second image is chosen to be substantially equal to said first pixel density.

6. A method according to claim 2, wherein the original image is upscaled according to an upscale factor determined according to a zoom command.

7. A method according to claim 6, wherein, when receiving a zoom in command, a current upscale factor, used for the upscaling, is increased.

8. A method according to claim 6, wherein when receiving a zoom out command, a current upscale factor, used for the upscaling, is decreased.

9. A method according to claim 1, wherein the second image has a pixel resolution greater than the resolution of the pixel grid and wherein the method further comprising downscaling the second image after performing pixel interpolation between the first image and the second image to the resolution of the pixel grid.

10. A method according to claim 1, wherein at least one of the upscaling and the downscaling is performed in a frequency domain.

11. A method according to claim 1, wherein the pixel interpolation is at least one of

a nearest-neighbour interpolation,

a bi-cubic interpolation, and

a bi-linear interpolation.

12. A method according to claim 9, wherein said second image is downscaled according to a downscale factor determined according to a zoom command.

13. A method according to claim 12, wherein when receiving a zoom in command, a current downscale factor used for downscaling the second image obtained after performing the pixel interpolation is decreased.

14. A method according to claim 12, wherein when receiving a zoom out command, a current downscale factor used for downscaling the second image obtained after performing the pixel interpolation is increased.

15. A method of processing an original image for projection on a projection screen by a plurality of projectors, comprising the following steps:

dividing said original image into image portions, each image portion being intended to be projected on the projection screen by a respective projector, and

processing each image portion according to claim 1.

16. A method according to claim 15, further comprising upscaling the image portions for obtaining the respective first images, thereby leading to a pixel resolution of the first images greater than the pixel resolution of the respective image portions, and a step of blending the image portions after upscaling.

35. A non-transitory information storage means readable by a computer or a microprocessor storing instructions of a computer program, wherein the instructions of the computer program for implementing a method according to claim 1 when the program is loaded and executed by the computer or the microprocessor.

17. An image processing device for processing an original image for projection on a projection screen by a projector, comprising a control unit configured to perform pixel interpolation between pixels of a first image associated with the original image and pixels of a second image associated with a pixel grid of the projector, wherein at least one of the first image and the second image has a pixel resolution greater than the resolution of, respectively, the original image and the pixel grid.

18. A device according to claim 17, wherein the control unit is further configured to upscale the original image for obtaining the first image, thereby leading to a pixel resolution of the first image greater than the pixel resolution of the original image.

19. A device according to claim 18, wherein the original image is upscaled according to an upscale factor determined in order to reduce a difference between a first pixel density of the obtained first image and a second pixel density of the second image.

20. A device according to claim 19, wherein the original image is upscaled to said second pixel density.

21. A device according to claim 19, wherein the second pixel density of the second image is chosen to be substantially equal to said first pixel density.

22. A device according to claim 19, wherein the original image is upscaled according to an upscale factor determined according to a zoom command.

23. A device according to claim 22, wherein the control unit is further configured for increasing a current upscale factor used for the upscaling, when receiving a zoom in command.

24. A device according to claim 22, wherein the control unit is further configured to decrease a current upscale factor used for the upscaling when receiving a zoom out command.

25. A device according to claim 17, wherein the second image has a pixel resolution greater than the resolution of the pixel grid and wherein the control unit is further configured to downscale the second image after performing pixel interpolation between the first image and the second image to the resolution of the pixel grid.

26. A device according to claim 17, wherein at least one of the upscaling and the downscaling is performed in a frequency domain.

27. A device according to claim 17, wherein the pixel interpolation is at least one of:

a nearest-neighbour interpolation,

a bi-cubic interpolation, and

a bi-linear interpolation.

28. A device according to claim 25, wherein said second image is downscaled according to a downscale factor determined according to a zoom command.

29. A device according to claim 28, wherein the control unit is further configured for decreasing a current downscale factor used for downscaling the second image obtained after performing the pixel interpolation when receiving a zoom in command.

30. A device according to claim 28, wherein the control unit is further configured to increase a current downscale factor used for downscaling the second image obtained after performing the pixel interpolation when receiving a zoom out command.

31. An image processing device for processing an original image for projection on a projection screen by a plurality of projectors, according to claim 17, wherein the control unit is further configured to divide said original image into image portions, each image portion being intended to be projected on the projection screen by a respective projector, and for at least one image portion, to perform pixel interpolation between pixels of a first image associated with the image portion and a second image associated with a pixel grid of the respective projector, wherein at least one of the first image and the second image has a pixel resolution greater than the resolution of, respectively, the image portion and the pixel grid.

32. A device according to claim 31, wherein the control unit is further configured to perform blending on the at least one image data portion after upscaling.

33. A video projection system comprising:

at least one device according to claim 17, and

at least one projector for projecting images processed by the device on a projection screen.

34. A system according to claim 33, wherein the at least one projector embeds the control unit of said device.

36. A method of processing image data for projection on a projection screen by a plurality of projectors projecting respective image portions of an image, the method comprising the following steps:

receiving a first command associated with a modification of at least one portion of said image, and

transmitting a second command for synchronous action to a first set of control units, based on the first command, said second command enabling said first set of control units to synchronously perform at least one action, by at least one projector of the plurality, in order to carry out said modification.

37. A method according to claim 36, further comprising determining, according to said modification, at least one projection parameter for said at least one image portion of the image, and wherein said action comprises a projection configuration based on said at least one projection determined parameter.

38. A method according to claim 37, further comprising transmitting said at least one determined parameter to said first set of control units.

39. A method according to claim 38, further comprising determining said first set of control units by determining projectors whose projection is affected by said determined parameter.

40. A method according to claim 36, wherein said first command originates from a user.

41. A method according to claim 36, wherein said first command is a forwarded command.

42. A method according to claim 36, wherein said synchronous configuration is based on an event detectable by said first set of control units.

43. A method according to claim 42, wherein said event is indicated in said second command.

44. A method according to claim 42, wherein said event takes into account a type of processing needed for the configuration of the projection, by at least one projector of the plurality, of said at least one portion of the image, according to said modification.

45. A method according to claim 42, wherein said event takes into account a transmission delay for transmission of said second command.

46. A method according to claim 42, wherein said event is a time-based event.

47. A method according to claim 42, wherein said event is a video frame-based event.

48. A method according to claim 36, wherein said second command is transmitted by encapsulation into a video frame.

49. A method according to claim 47, wherein the event is associated with a number of video frames starting from the video frame comprising the second command.

50. A method according to claim 36, further comprising performing at least one action, in order to carry out said modification, in synchronization with the set of control units.

51. A method according to claim 36, further comprising:

receiving at least one third command for synchronous action, for synchronously perform at least one action, by at least one projector of the plurality, in order to carry out the same modification as the modification associated with the first command, and

performing at least one action, in order to carry out said modification, in synchronization with the set of control units based on a synchronization element selected among synchronization elements respectively associated with said second and at least one third command.

52. A method according to claim 51, wherein said synchronization elements are associated with respective event, and wherein the selected synchronization element is the one associated with the event occurring the latest.

53. A method according to claim 42, further comprising monitoring said event.

54. A method according to claim 36, further comprising a step of preparation of said at least one action.

55. A method according to claim 54 wherein said step of preparation of said at least one action is performed after checking whether said preparation is needed, based on the modification associated with the first command.

56. A method according to claim 54, wherein said step of preparation of said at least one action is performed based on external information relating to at least one another control unit of another projector of the system.

57. A method according to claim 56, wherein said external information is obtained from said at least one another control unit of another projector of the system or by performing calculations.

58. A method according to claim 55, wherein said external information is obtained after checking whether said external information is needed, based on the modification associated with the first command.

59. A method according to claim 36, wherein said first command comprises at least one of:

a digital zoom;

an optical zoom;

an image shifting;

a brightness control;

a colour control.

60. A method according to claim 36, further comprising determining, according to said modification, at least one projection parameter for said at least one image portion of the image, and wherein said action comprises a projection configuration based on said at least one projection determined parameter, and wherein said at least one projection parameter comprises at least one of:

a rescaling parameter,

an image cut parameter;

an image data routing parameter;

an upscaling parameter;

a downscaling parameter;

an interpolation parameter.

67. A non-transitory information storage means readable by a computer or a microprocessor storing instructions of a computer program, for implementing a method according to claim 36 when the program is loaded and executed by the computer or microprocessor.

61. A device for processing image data for projection on a projection screen by a plurality of projectors projecting respective image portions of an image, the device comprising a control unit configured for receiving a first command associated with a modification of at least one portion of said image, and for transmitting a second command for synchronous action to a first set of control units, based on the first command, said second command enabling said first set of control units to synchronously perform at least one action, by at least one projector of the plurality, in order to carry out said modification.

62. A video projection system comprising:

at least one device according to claim 61, and

at least one projector for projecting images processed by the device on a projection screen.

63. A system according to claim 62, wherein the at least one projector embeds the control unit of said device.

64. A system according to claim 62 further comprising a remote control for issuing the first command.

65. A system according to claim 62, further comprising a device configured for receiving said second command and synchronously executing said at least one action.

66. A system according to claim 65, wherein at least one projector embeds the control unit of said device configured for receiving said second command and synchronously executing said at least one action.