Interactive whiteboards and programs

• US 9,024,901 B2
• Filed: 08/12/2011
• Issued: 05/05/2015
• Est. Priority Date: 08/25/2010
• Status: Expired due to Fees

• Current Assignee: Hitachi Solutions Limited (Hitachi, Ltd.)
• Original Assignee: Hitachi Solutions Limited (Hitachi, Ltd.)
• Inventors: Miyazaki, Hiroshi
• Primary Examiner(s): Awad, Amr
• Assistant Examiner(s): FLORES, ROBERTO W
• Application Number:
  US13/818,397
• Publication Number:
  US 20130154985A1
• Time in Patent Office: 1,362 Days
• Field of Search: 345156-183, 345 4- 9, 715700-866
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Provided is a technique of correcting influences of optical environment to correctly recognize the color of an input object used for inputting of coordinates, and enabling automatic designation of a color to be used for drawing. A coordinate detection unit detects coordinates of an input object. Next, display light on the display plane in the vicinity of the coordinates is estimated from display data, and a correction value to remove influences of the display light is calculated. A captured image of an input object used for input operations on the display plane is extracted, and the color of the captured image is corrected with a display light correction value. Thereby, influences of the display light added to the input object are removed, enabling the original color of the input object to be identified.

Claims

1. An interactive whiteboard, comprising:

a coordinate detection unit configured to detect, as two-dimensional coordinates on a display plane, a contact position of an input object with reference to the display plane or an operating position of the input object with reference to a detection plane set in front side of the display plane;

an image-capturing unit configured to capture, as a color image, an image of a vicinity of at least a region where two-dimensional coordinates are detected, wherein a range where the coordinate detector can detect the two-dimensional coordinates is set as an imageable range;

a display light correction value calculation unit configured to calculate a display light correction value to correct a variation in image color that is caused by light addition to an image of the input object, the light being from the display plane in a vicinity of the coordinates of the input object detected by the coordinate detection unit, the calculation being performed on a basis of a display color of the display plane in the vicinity of the detected coordinates;

a background removal unit configured to extract an image of the input object only from the color image captured by the image-capturing unit;

a color correction unit configured to correct color information of the image of the input object extracted by the background removal unit with the display light correction value;

a color identification unit configured to identify a color of the image of the input object subjected to color correction by the color correction unit;

a display control unit configured to draw an object having a color identified by the color identification unit and a predetermined size at the detected coordinates of the display plane; and

an environment light correction value measurement screen display control unit configured to make the display plane display an environment light correction value measurement screen,

wherein;

when the coordinate detection unit detects the input object during displaying of the environment light correction value measurement screen by the environment light correction value measurement screen display control unit, the environment light correction value calculation unit calculates an environment light correction value to correct a variation in image color that is generated by addition of environment light on a basis of an image of an achromatic-colored input object having an achromatic range for reference, the image being extracted by the background removal unit, and

the color correction unit corrects the image of the input object on the basis of the environment light correction value and the display light correction value.

2. The interactive whiteboard according to claim 1, wherein:

when the background removal unit fails in background removal or when both or any one of a saturation and a brightness of the image of the input object after the color correction is in a predetermined determination range, the color identification unit identifies the color of the input object as any predetermined achromatic color.

3. The interactive whiteboard according to claim 1, further comprising:

a background plate to be imaged as a background of the input object when the image-capturing unit captures an image of the input object,

wherein;

the background plate protrudes by a predetermined length in a direction perpendicular to the display plane toward a front direction from a position surrounding a range where the coordinate detection unit can detect two-dimensional coordinates.

4. The interactive whiteboard according to claim 3, wherein the background plate is a predetermined achromatic color.

5. The interactive whiteboard according to claim 1, further comprising:

a brightness correction unit configured to reduce a brightness difference without changing hue of pixels in the color image captured by the image-capturing unit; and

an in-shadow determination unit configured to determine whether or not the input object enters a shadow in the color image captured by the image-capturing unit,

wherein;

the background removal unit extracts an image of the input object only from the color image subjected to brightness correction by the brightness correction unit, and

the color correction unit performs predetermined color correction only when the in-shadow determination unit determines that the input object does not enter a shadow.

6. The interactive whiteboard according to claim 1, wherein

when the background removal unit fails to extract the image of the input object or when either of a saturation or a brightness of the image of the input object after the color correction are less than a predetermined value, the color identification unit identifies the color of the input object as any predetermined achromatic color.

7. The interactive whiteboard according to claim 1, further comprising:

a background plate to be imaged as a background of the input object when the image-capturing unit captures an image of the input object, wherein

the background plate protrudes by a predetermined length in a direction perpendicular to the display plane toward a front direction from a position surrounding a range where the coordinate detection unit can detect two-dimensional coordinates.

8. The interactive whiteboard according to claim 1, further comprising:

a brightness correction unit configured to reduce a brightness difference without changing hue of pixels in the color image captured by the image-capturing unit; and

an in-shadow determination unit configured to determine whether or not the input object enters a shadow in the color image captured by the image-capturing unit,

wherein;

the background removal unit extracts an image of the input object only from the color image subjected to brightness correction by the brightness correction unit, and

the color correction unit performs predetermined color correction only when the in-shadow determination unit determines that the input object does not enter a shadow.

9. A non-transitory, computer readable medium with instructions stored thereon that, when executed by a computer configuring an interactive whiteboard, instruct the computer to function as the following units, comprising:

a coordinate detection unit configured to detect, as two-dimensional coordinates on a display plane, a contact position of an input object with reference to the display plane or an operating position of the input object with reference to a detection plane set in front side of the display plane;

a display light correction value calculation unit configured to calculate a display light correction value to correct a variation in image color that is generated by light addition to an image of the input object, the light being from the display plane in a vicinity of the coordinates of the input object detected by the coordinate detection unit, the calculation being performed on a basis of a display color of the display plane in the vicinity of the detected coordinates;

a background removal unit configured to extract an image of the input object only from the color image captured in least a vicinity of a region where two-dimensional coordinates are detected;

a color correction unit configured to correct color information of the image of the input object extracted by the background removal unit with the display light correction value;

a color identification unit configured to identify a color of the image of the input object subjected to color correction by the color correction unit;

a display control unit configured to draw an object having a color identified by the color identification unit and a predetermined size at the detected coordinates of the display plane; and

an environment light correction value measurement screen display control unit configured to make the display plane display an environment light correction value measurement screen,

wherein;

when the coordinate detection unit detects the input object during displaying of the environment light correction value measurement screen by the environment light correction value measurement screen display control unit, the environment light correction value calculation unit calculates an environment light correction value to correct a variation in image color that is generated by addition of environment light on a basis of an image of an achromatic-colored input object having an achromatic range for reference, the image being extracted by the background removal unit, and

the color correction unit corrects the image of the input object on the basis of the environment light correction value and the display light correction value.

10. The non-transitory, computer readable medium according to claim 9, wherein:

when the background removal unit fails in background removal or when both or any one of a saturation and a brightness of the image of the input object after the color correction is in a predetermined determination range, the color identification unit identifies the color of the input object as any predetermined achromatic color.

11. The non-transitory, computer readable medium according to claim 9, with instructions stored thereon that, when executed by the computer, further instruct the computer to function as the following units, comprising:

a brightness correction unit configured to reduce a brightness difference without changing hue of pixels in the color image captured by the image-capturing unit; and

an in-shadow determination unit configured to determine whether or not the input object enters a shadow in the color image captured by the image-capturing unit,

wherein;

the background removal unit extracts an image of the input object only from the color image subjected to brightness correction by the brightness correction unit, and

the color correction unit performs predetermined color correction only when the in-shadow determination unit determines that the input object does not enter a shadow.

12. The non-transitory, computer readable medium according to claim 9, wherein:

when the background removal unit fails to extract the image of the input object or when either of a saturation or a brightness of the image of the input object after the color correction are less than a predetermined value, the color identification unit identifies the color of the input object as a predetermined achromatic color.

13. The non-transitory, computer readable medium according to claim 9, with instructions stored thereon that, when executed by the computer, further instruct the computer to function as the following units, comprising:

a brightness correction unit configured to reduce a brightness difference without changing hue of pixels in the color image captured by the image-capturing unit; and

an in-shadow determination unit configured to determine whether or not the input object enters a shadow in the color image captured by the image-capturing unit,

wherein;

the background removal unit extracts an image of the input object only from the color image subjected to brightness correction by the brightness correction unit, and

the color correction unit performs predetermined color correction only when the in-shadow determination unit determines that the input object does not enter a shadow.