SYSTEM AND METHOD FOR REPORTING DATA IN A COMPUTER VISION SYSTEM

• US 20120319945A1
• Filed: 05/21/2010
• Published: 12/20/2012
• Est. Priority Date: 05/21/2010
• Status: Abandoned Application

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: McCarthy, John, Campbell, Robert, Suggs, Bradley Neal
• Application Number:
  US13/581,944
• Publication Number:
  US 20120319945A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0428 by sensing at the edges of the touch surface the interruption of optical paths, e.g. an illumination plane, parallel to the touch surface which may be virtual sensing beam interruptions in a planar beam grid of an optical touch-screen G06F3/0421
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

Embodiments of the present invention disclose a system and method for reporting data in a computer vision system. According to one embodiment, the presence of an object is detected within a display area of a display panel via at least one three-dimensional optical sensor. Measurement data associated with the object is received, and processor extracts at least one set of at least seven three-dimensional target coordinates from the measurement data. Furthermore, a control operation for the computer vision system is determined based on the at least one set of target coordinates.

Claims

1. A method for reporting data in a computer vision system including a display panel and processor, the method comprising:

detecting the presence of an object within a display area of a display panel via at least one three-dimensional optical sensor;

receiving, via the processor, measurement data associated with the object from the at least one optical sensor; and

extracting, via the processor, at least one set of at least seven target coordinates from the measurement data, wherein the target coordinates are (x, y, z) coordinates in a three-dimensional coordinate system and relate to only a portion of the detected object,

wherein a control operation for the computer vision system is determined based on the at least one set of target coordinates.

2. The method of claim 1, further comprising:

reporting, via the processor, the at least one set of seven target coordinates to a system control unit; and

determining, via the control unit, an appropriate control operation based on the received set of target coordinates.

3. The system of claim 1, wherein the object is a user'"'"'s arm and hand positioned within a display area and field of view of at least one optical sensor.

4. The method of claim 3, wherein the step of extracting at least one set of target coordinates further comprises:

determining a quantity of sets of target coordinates to extract based on a quantity of arms and hands detected within the display area of the display panel.

5. The method of claim 4, wherein the set of seven target coordinates includes (x, y, z) coordinates for each of the user'"'"'s fingertips, a central area of the user'"'"'s palm, and a central area of the user'"'"'s elbow.

6. The method of claim 4, wherein the control operation is an executable instruction by the processor that performs a specific function on the computer system.

7. The method of claim 1, wherein a plurality of optical sensors are arranged along an upper perimeter side of the display panel on opposite corners of the front side of the display panel.

8. A display system comprising:

a display panel including a perimeter and configured to display images on a front side; and

at least one three-dimensional optical sensor arranged around the perimeter of the display panel and configured to capture measurement data of an object within a field of view of the optical sensor,

a processor coupled to the at least one three-dimensional optical sensor and configured to extract at least one set of at least seven target coordinates from the measurement data, wherein the target coordinates are (x, y, z) coordinates in a three-dimensional coordinate system and relate to only a portion of the detected object, and

wherein only the at least one set of seven target coordinates are used for determining an appropriate control operation for the system.

9. The system of claim 8, further comprising:

a system control unit coupled to the processer and configured to receive the at least one set of seven target coordinates from the processor for determining the control operation.

10. The system of claim 8, wherein the object is a user'"'"'s arm including a hand and elbow positioned within a display area and field of view of at least one optical sensor.

11. The system of claim 10, wherein the set of seven target coordinates includes (x, y, z) coordinates for each of the user'"'"'s fingertips, a central area of the user'"'"'s palm, and a central area of the user'"'"'s elbow.

12. The system of claim 11, wherein the control operation is an executable instruction by the processor that performs a specific function on the computer system.

13. The system of claim 12, wherein at least two sets of target coordinates representing each of the user'"'"'s arms and hands are returned to the processor for determining a control operation.

14. The system of claim 8, wherein a plurality of optical sensors are arranged along an upper perimeter side of the display panel on opposite corners of the front side of the display panel.

15. A computer readable storage medium having stored executable instructions, that when executed by a processor, causes the processor to:

detect the presence of an object within a display area of a display panel via at least one three-dimensional optical sensor;

receive measurement data from the at least one optical sensor; and

extract at least one set of seven target coordinates from the measurement data, wherein the target coordinates are (x, y, z) coordinates in a three-dimensional coordinate system and relate to only a portion of the detected object; and

determine a control operation based on only the at least one set of target coordinates.

16. The computer readable storage medium of claim 15, executable instructions to further cause the processor to:

report the at least one set of seven target coordinates to a system control unit; and

determine an appropriate control operation based on the received set of target coordinates.

17. The computer readable storage medium of claim 15, wherein the object is a user'"'"'s arm and hand positioned within a display area and field of view of at least one optical sensor.

18. The computer readable storage medium of claim 17, wherein the step of extracting at least one set of seven target coordinates includes executable instructions to further cause the processor to:

determine a quantity of sets of target coordinates to extract based on a quantity of arms and hands detected within the display area of the display panel.

19. The computer readable storage medium of claim 18, wherein the set of seven target coordinates includes (x, y, z) coordinates for each of the user'"'"'s fingertips, a central area of the user'"'"'s palm, and a central area of the user'"'"'s elbow.

20. The computer readable storage medium of claim 15, wherein the control operation is an executable instruction by the processor that performs a specific function on the computer system.