CONTROLLING A DOCUMENT BASED ON USER BEHAVIORAL SIGNALS DETECTED FROM A 3D CAPTURED IMAGE STREAM

• US 20080170748A1
• Filed: 01/12/2007
• Published: 07/17/2008
• Est. Priority Date: 01/12/2007
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Goldman, Steven D., Sessa, Anthony J., Arnold, Kenneth C., Paolini, Michael A., Albertson, Jacob C.
• Granted Patent: US 7,877,706 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A computer-implemented method, system, and program product comprises a behavior processing system for capturing a three-dimensional movement of a user within a particular environment, wherein the three-dimensional movement is determined by using at least one image capture device aimed at the user. The behavior processing system identifies a three-dimensional object properties stream using the captured movement. The behavior processing system identifies a particular defined behavior of the user from the three-dimensional object properties stream by comparing the identified three-dimensional object properties stream with multiple behavior definitions each representing a separate behavioral signal for directing control of the document. A document control system selects at least one document element to represent the at least one particular defined behavior and inserts the selected document element into the document.

Claims

1. A computer-implemented method for controlling a document based on user behavior, comprising:

capturing a three-dimensional movement of a user, wherein the three-dimensional movement is determined using at least one image capture device aimed at the user;

identifying a three-dimensional object properties stream using the captured movement;

identifying at least one particular defined behavior of the user from the three-dimensional object properties stream by comparing the identified three-dimensional object properties stream with a plurality of behavior definitions each representing a separate behavioral signal which triggers control of the document;

selecting at least one document element to represent the at least one particular defined behavior; and

inserting the selected document element into the document.

2. The method according to claim 1, wherein capturing a three-dimensional movement of the user further comprises capturing the three-dimensional movement using a stereoscopic image device to identify and track a particular three-dimensional movement of the user.

3. The method according to claim 1, wherein capturing a three-dimensional movement of the user further comprises capturing at least one image frame of a user at a first point in time and comparing at least one additional image frame from a second point in time with the image frame from the first point in time.

4. The method according to claim 1, wherein identifying at least one particular defined behavior representing a particular behavioral signal from the three-dimensional object properties stream further comprises calculating a percentage probability that the captured three-dimensional movement represents the at least one particular defined behavior.

5. The method according to claim 1, wherein selecting at least one document element to represent the at least one particular defined behavior further comprises:

selecting the at least one document element comprising a textual indicator of the at least one particular defined behavior to insert into a transcript recorded in the document at a location specified by a time stamp associated with the captured three-dimensional object properties stream.

6. The method according to claim 1, wherein selecting at least one document element to represent the at least one particular defined behavior further comprises:

translating the at least one particular defined behavior into at least one programming code element, programming code equation, and programming code module.

7. The method according to claim 1, wherein selecting at least one document element to represent the at least one particular defined behavior further comprises:

selecting the at least one document element representing the at least one particular defined behavior to insert into a particular position in the document identified by a position pointed to by the user on a display of the document.

8. The method according to claim 1, further comprising:

selecting at least one function to perform on the document to represent the at least one particular defined behavior; and

triggering an application to perform the at least one function on the document.

9. The method according to claim 1 wherein triggering an application to perform the function on the document further comprises triggering the application to perform the function of formatting the document.

10. A system for controlling a document based on user behavior, comprising:

a behavior processing system communicative connected to a network, further comprising;

means for capturing a three-dimensional movement of a user, wherein the three-dimensional movement is determined using at least one image capture device aimed at the user;

means for identifying a three-dimensional object properties stream using the captured movement;

means for identifying at least one particular defined behavior of the user from the three-dimensional object properties stream by comparing the identified three-dimensional object properties stream with a plurality of behavior definitions each representing a separate behavioral signal which triggers control of the document; and

a document control system communicatively connected to the behavior processing system via the network for selecting at least one document element to represent the at least one particular defined behavior and inserting the selected document element into the document.

11. The system according to claim 10, wherein the means for capturing a three-dimensional movement of the user further comprises means for capturing the three-dimensional movement using a stereoscopic image device to identify and track a particular three-dimensional movement of the user.

12. The system according to claim 10, wherein the means for capturing a three-dimensional movement of the user further comprises means for capturing at least one image frame of a user at a first point in time and means for comparing at least one additional image frame from a second point in time with the image frame from the first point in time.

13. The system according to claim 10, wherein the means for identifying at least one particular defined behavior representing a particular behavioral signal from the three-dimensional object properties stream further comprises means for calculating a percentage probability that the captured three-dimensional movement represents the at least one particular defined behavior.

14. The system according to claim 10, the document control system further comprising:

means for selecting the at least one document element comprising a textual indicator of the at least one particular defined behavior to insert into a transcript recorded in the document at a location specified by a time stamp associated with the captured three-dimensional object properties stream.

15. The system according to claim 10, the document control system further comprising:

means for selecting the at least one document element by translating the at least one particular defined behavior into at least one programming code element, programming code equation, and programming code module.

16. The system according to claim 10, the document control system further comprising:

means for selecting the at least one document element representing the at least one particular defined behavior to insert into a particular position in the document identified by a position pointed to by the user on a display of the document.

17. The system according to claim 10, the document control system further comprising:

means for selecting at least one function to perform on the document to represent the at least one particular defined behavior; and

means for triggering an application to perform the at least one function on the document.

18. A program product comprising a storage-type computer-usable medium including a computer-readable program for controlling a document based on user behavior, wherein the computer-readable program when executed on a computer cause the computer to:

capture a three-dimensional movement of a user, wherein the three-dimensional movement is determined using at least one image capture device aimed at the user;

identify a three-dimensional object properties stream using the captured movement;

identify at least one particular defined behavior of the user from the three-dimensional object properties stream by comparing the identified three-dimensional object properties stream with a plurality of behavior definitions each representing a separate behavioral signal which triggers control of the document;

select at least one document element to represent the at least one particular defined behavior; and

insert the selected document element into the document.

19. The program product of claim 18, wherein said computer-readable program is transmitted over a network.

20. The program product of claim 18, wherein the computer-readable program when executed on the computer further causes the computer to select the at least one document element comprising a textual indicator of the at least one particular defined behavior to insert into a transcript recorded in the document at a location specified by a time stamp associated with the captured three-dimensional object properties stream.