Image display device, image display method, program, and projection system

• US 20030021492A1
• Filed: 07/23/2002
• Published: 01/30/2003
• Est. Priority Date: 07/24/2001
• Status: Active Grant

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: Matsuda, Takashi, Kasahara, Tsuyoshi, Nakagomi, Kouichi, Matsuoka, Takeshi, Matsui, Shinichi, Iizuka, Nobuo
• Granted Patent: US 7,039,253 B2
• Time in Patent Office: Days
• US Class Current: 382/295
• CPC Class Codes: G06F 3/0386 for light pen
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886

Abstract

A data processing apparatus includes a central control section, an image analysis section, a RAM (Random Access Memory), an external memory section and a user operation input section. The central control section is connected to the image analysis section, the RAM and the external memory section via a bus. Based on image data prepared by an image input section, the image analysis section performs a process of specifying where on the display screen of a display section a portion specified by the image input section lies.

Claims

1. An image display device comprising:

an image pickup section which picks up a spot and an area including said spot from an arbitrary position;

a generation section which generates image data of said area picked up by said image pickup section;

a display section which displays an image based on said image data generated by said generation section;

a processing section which processes said image data in such a way that said image data is adequately displayed on a display screen of said display section;

a measuring section which measures positional coordinates of said spot in said area; and

a coordinate conversion section which converts said positional coordinates of said spot measured by said measuring section to positional coordinates that are reflected on post-processing image data acquired as a result of a process performed by said processing section.

2. The image display device according to claim 1, wherein said area is constituted by a projected image and said spot is a dot of light on said projected image, which has a specific wavelength and whose luminance is set equal to or higher than a luminance of an other portion of said projected image.

3. The image display device according to claim 1, wherein said image pickup section picks up said display screen from an arbitrary position.

4. The image display device according to claim 1, wherein said area is an area surrounded by at least four points whose positional coordinates have been set beforehand.

5. The image display device according to claim 4, wherein said processing section has an area setting section which inputs information designating said at least four points surrounding said area and sets a region surrounded by said points indicated by said input information as said area.

6. The image display device according to claim 4, wherein said processing section has an area setting section which specifies at least four spots included in an image represented by image data before processing and sets said specified spots as points surrounding said area.

7. The image display device according to claim 4, wherein said display section has a section which displays a figure for extracting an area surrounded by at least four points in an area to be picked up by said image pickup section, and

said processing section has an area setting section which extracts at least four points from said figure for extracting said area represented by image data before processing and sets said extracted points as points surrounding said area.

8. The image display device according to claim 1, wherein an area before processing represented by image data before processing is a quadrangle and an area after processing represented by image data after processing performed by said processing section is a rectangle, and

said processing section acquires a first pair of lines that pass through a spot in said area after processing and perpendicularly intersect opposite two sides of said rectangle, which defines said area after processing, acquires a second pair of lines that internally divide opposite two sides of said quadrangle, which defines said area before processing, by an interior division ratio by which said first pair of lines internally divide said opposite two sides of said rectangle, and processes said image data in such a way that a spot at a point of intersection of said second pair of lines comes to a point of intersection of said first pair of lines after processing.

9. The image display device according to claim 1, wherein an area before processing represented by image data before processing is a quadrangle and an area after processing represented by image data after processing performed by said processing section is a rectangle, and

said processing section performs a process of determining in which one of four quadrangles obtained by quadrisecting said quadrangle that defines said area before processing by two lines each connecting a point of intersection of one of two sets of opposite two sides of said quadrangle that defines said area before processing to a point of intersection of diagonal lines of said quadrangle said spot is included, and then moving a point lying in said rectangle that defines said area after processing in a direction of a vertex equivalent to a vertex, among vertexes of a quadrangle determined as including said spot, that also serves as a vertex of said quadrangle defining said area before processing by a predetermined amount which becomes smaller as a number of times quadrisecting of said quadrangle is performed becomes larger, and processes said image data in such a way that in a case where said process is repeated further until said point lying in said rectangle that defines said area after processing converges to substantially a given position, regarding said quadrangle determined as including said spot as a quadrangle defining said area before processing, a position of said point which reaches convergence becomes a position of a spot represented by said image data after processing.

10. The image display device according to claim 1, wherein said area is comprised of a plurality of regions, and

said measuring section specifies a region in which said spot is included, and measures said positional coordinates of said spot in said area by measuring positional coordinates of said spot in said specified region.

11. The image display device according to claim 1, wherein said display section has a section which displays a curve indicating a track along which a spot has moved, over an image based on image data after processing.

12. The image display device according to claim 1, wherein said processing section has a section which specifies one of plural levels to which a luminance of a spot represented by image data before processing corresponds, and

said display section displays a spot having said luminance whose level has been specified by said processing section.

13. The image display device according to claim 1, wherein said measuring section detects a spot identification pattern comprised of a plurality of spots from image data before processing and measures positional coordinates of said detected spot identification pattern as positional coordinates of a spot.

14. The image display device according to claim 1, wherein said measuring section has a section which specifies positions and velocity of a spot at two times based on plural pieces of image data before processing, and

said processing section determines an estimated position of said spot between said two times based on said positions and velocity of said spot at said two times specified by said measuring section, and processes image data before processing in such a way that an image having said spot positioned at said determined estimated position is shown.

15. The image display device according to claim 1, wherein said measuring section specifies positions of a spot at a plurality of times based on plural pieces of image data before processing, determines a representative position representing a position of said spot in a time zone including said plurality of times based on said specified positions, and treats positional coordinates of said determined representative position as results of measuring positional coordinates of said spot.

16. The image display device according to claim 1, further comprising a color change detection section which detects a change in color of a spot represented by plural pieces of image data before processing based on said plural pieces of image data.

17. The image display device according to claim 1, wherein said measuring section has a section which specifies a velocity of a spot based on plural pieces of image data before processing, and

said processing section determines a position in an image indicated by image data after processing which said spot is to occupy next, based on said velocity specified by said measuring section and a latest position in said image indicated by image data after processing which said spot has occupied, and processes image data in such a way that said spot comes to said determined position.

18. The image display device according to claim 1, further comprising a spot-shape determining section which determines a shape of a spot to be represented by image data after processing performed by said processing section, based on said positional coordinates of said spot measured by said measuring section.

19. The image display device according to claim 1, wherein said processing section has a section which externally receives a signal indicating that a light source of said spot is emitting light and processes image data in response to said received signal.

20. An image display method comprising:

an image pickup step which picks up a spot and an area including said spot from an arbitrary position;

a generation step which generates image data of said area picked up in said image pickup step;

a display step which displays an image based on said image data generated in said generation step on a display screen;

a processing step which processes said image data in such a way that said image data is adequately displayed on said display screen in said display step;

a measuring step which measures positional coordinates of said spot in said area; and

a coordinate conversion step which converts said positional coordinates of said spot measured in said measuring step to positional coordinates that are reflected on post-processing image data acquired as a result of a process performed in said processing step.

21. The image display method according to claim 20, wherein said area is constituted by a projected image and said spot is a dot of light on said projected image, which has a specific wavelength and whose luminance is set equal to or higher than a luminance of an other portion of said projected image.

22. The image display method according to claim 20, wherein said image pickup step picks up said display screen from an arbitrary position.

23. The image display method according to claim 20, wherein said area is an area surrounded by at least four points whose positional coordinates have been set beforehand.

24. The image display method according to claim 23, wherein said processing step includes an area setting step which inputs information designating at least four points surrounding said area and sets a region surrounded by said points indicated by said input information as said area.

25. The image display method according to claim 23, wherein said processing step includes an area setting step which specifies at least four spots included in an image represented by image data before processing and sets said specified spots as points surrounding said area.

26. The image display method according to claim 23, wherein said display step displays a figure for extracting an area surrounded by at least four points in an area to be picked up in said image pickup step, and

said processing step includes an area setting step which extracts at least four points from said figure for extracting said area represented by image data before processing and sets said extracted points as points surrounding said area.

27. The image display method according to claim 20, wherein an area before processing represented by image data before processing is a quadrangle and an area after processing represented by image data after processing performed in said processing step is a rectangle, and

said processing step acquires a first pair of lines that pass through a spot in said area after processing and perpendicularly intersect opposite two sides of said rectangle, which defines said area after processing, acquires a second pair of lines that internally divide opposite two sides of said quadrangle, which defines said area before processing, by an interior division ratio by which said first pair of lines internally divide said opposite two sides of said rectangle, and processes said image data in such a way that a spot at a point of intersection of said second pair of lines comes to a point of intersection of said first pair of lines after processing.

28. The image display method according to claim 20, wherein an area before processing represented by image data before processing is a quadrangle and an area after processing represented by image data after processing performed in said processing step is a rectangle, and

said processing step performs a process of determining in which one of four quadrangles obtained by quadrisecting said quadrangle that defines said area before processing by two lines each connecting a point of intersection of one of two sets of opposite two sides of said quadrangle that defines said area before processing to a point of intersection of diagonal lines of said quadrangle said spot is included, and then moving a point lying in said rectangle that defines said area after processing in a direction of a vertex equivalent to a vertex, among vertexes of a quadrangle determined as including said spot, that also serves as a vertex of said quadrangle defining said area before processing by a predetermined amount which becomes smaller as a number of times quadrisecting of said quadrangle is performed becomes larger, and processes said image data in such a way that in a case where said process is repeated further until said point lying in said rectangle that defines said area after processing converges to substantially a given position, regarding said quadrangle determined as including said spot as a quadrangle defining said area before processing, a position of said point which reaches convergence becomes a position of a spot represented by said image data after processing.

29. The image display method according to claim 20, wherein said area is comprised of a plurality of regions, and

said measuring step specifies a region in which said spot is included, and measures said positional coordinates of said spot in said area by measuring positional coordinates of said spot in said specified region.

30. The image display method according to claim 20, wherein said display step displays a curve indicating a track along which a spot has moved, over an image based on image data after processing.

31. The image display method according to claim 20, wherein said processing step specifies one of plural levels to which a luminance of a spot represented by image data before processing corresponds, and

said display step displays a spot having said luminance whose level has been specified in said processing step.

32. The image display method according to claim 20, wherein said measuring step detects a spot identification pattern comprised of a plurality of spots from image data before processing and measures positional coordinates of said detected spot identification pattern as positional coordinates of a spot.

33. The image display method according to claim 20, wherein said measuring step specifies positions and velocity of a spot at two times based on plural pieces of image data before processing, and

said processing step determines an estimated position of said spot between said two times based on said positions and velocity of said spot at said two times specified in said measuring step, and processes image data before processing in such a way that an image having said spot positioned at said determined estimated position is shown.

34. The image display method according to claim 20, wherein said measuring step specifies positions of a spot at a plurality of times based on plural pieces of image data before processing, determines a representative position representing a position of said spot in a time zone including said plurality of times based on said specified positions, and treats positional coordinates of said determined representative position as results of measuring positional coordinates of said spot.

35. The image display method according to claim 20, further comprising a color change detection step which detects a change in color of a spot represented by plural pieces of image data before processing based on said plural pieces of image data.

36. The image display method according to claim 20, wherein said measuring step specifies a velocity of a spot based on plural pieces of image data before processing, and

said processing step determines a position in an image indicated by image data after processing which said spot is to occupy next, based on said velocity specified in said measuring step and a latest position in said image indicated by image data after processing which said spot has occupied, and processes image data in such a way that said spot comes to said determined position.

37. The image display method according to claim 20, further comprising a spot-shape determining step which determines a shape of a spot to be represented by image data after processing acquired as a result of processing performed in said processing step, based on said positional coordinates of said spot measured in said measuring step.

38. The image display method according to claim 20, wherein said processing step externally receives a signal indicating that a light source of said spot is emitting light and processes image data in response to said received signal.

39. A program for allowing a computer connected to an image display device and an image pickup section to function as an image pickup control section which causes said image pickup section to pick up a spot and an area including said spot from an arbitrary position, a generation section which generates image data of said area picked up by said image pickup control section, and a display control section which displays an image based on said image data generated by said generation section on a display screen of said display section, and

to further function as a processing section which processes said image data in such a way that said image data is adequately displayed on said display screen of said display section, a measuring section which measures positional coordinates of said spot in said area, and a coordinate conversion section which converts said positional coordinates of said spot measured by said measuring section to positional coordinates that are reflected on post-processing image data acquired as a result of a process performed by said processing section.

40. A program for allowing a computer connected to an image display device and a plurality of image pickup sections to function as an image pickup control section which causes said plurality of image pickup sections to pick up a spot and an area including said spot from a plurality of arbitrary positions, a generation section which generates image data of a plane in space picked up by said image pickup control section, and a display control section which displays an image based on said image data generated by said generation section on said display section, and

to further function as a processing section which processes said image data generated by said generation section in such a way that said image data is adequately displayed on a display screen of said display section, a measuring section which measures positional coordinates of said spot in said space, a spot-shape determining section which determines a shape of a spot to be represented by image data after processing performed by said processing section, based on said positional coordinates of said spot measured by said measuring section, and a coordinate conversion section which converts said positional coordinates of said spot measured by said measuring section to positional coordinates that are reflected on post-processing image data.

41. A projection system having a projector, comprising:

an image pickup section which picks up an area projected by said projector from an arbitrary position;

a generation section which generates image data of said area picked up by said image pickup section;

a processing section which is capable of displaying and outputting said image data generated by said generation section as an adequate display screen;

a detection section which detects a spot area which emits light having a specific wavelength from said projected area;

a measuring section which measures positional coordinates of said spot area detected by said detection section; and

a coordinate conversion section which converts said positional coordinates measured by said measuring section to positional coordinates that are reflected on image data processed by said processing section.