ADJUSTING A CONSUMER EXPERIENCE BASED ON A 3D CAPTURED IMAGE STREAM OF A CONSUMER RESPONSE

• US 20080172261A1
• Filed: 01/12/2007
• Published: 07/17/2008
• Est. Priority Date: 01/12/2007
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: ALBERTSON, JACOB C, Goldman, Steven D., Sessa, Anthony J., Arnold, Kenneth C., Paolini, Michael A.
• Granted Patent: US 8,295,542 B2
• Time in Patent Office: Days
• US Class Current: 705/7
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

A response processing system captures a three-dimensional movement of the consumer within a consumer environment, wherein the three-dimensional movement is determined using at least one image capture device aimed at the consumer. The response processing system identifies at least one behavior of the consumer in response to at least one stimulus within the consumer environment from a three-dimensional object properties stream of the captured movement. A consumer interaction system detects whether the at least one behavior of the consumer indicates a type of response to the at least one stimulus requiring adjustment of the consumer environment. Responsive to detecting that the behavior of the consumer indicates a type of response to the at least one stimulus requiring adjustment of the consumer environment, the consumer interaction system generates a control signal to trigger at least one change of the at least one stimulus within the consumer environment.

Claims

1. A computer-implemented method for adjusting a consumer experience within a consumer environment, comprising:

capturing a three-dimensional movement of the consumer within the consumer environment, wherein the three-dimensional movement is determined using at least one image capture device aimed at the consumer;

identifying at least one behavior of the consumer in response to at least one stimulus within the consumer environment from a three-dimensional object properties stream of the captured movement;

detecting whether the at least one behavior of the consumer indicates a type of response to the at least one stimulus requiring adjustment of the consumer environment by comparing the type of response indicated by the at least one behavior with a plurality of response rules and identifying at least one particular response rule applicable for the type of response to the at least one stimulus; and

responsive to detecting that the behavior of the consumer indicates a type of response to the at least one stimulus requiring adjustment of the consumer environment, generating a control signal according to the particular response rule to trigger at least one change of the at least one stimulus within the consumer environment.

2. The method according to claim 1, wherein capturing a three-dimensional movement of the consumer further comprises capturing the three-dimensional movement using a stereoscopic image device to identify and track a particular three-dimensional movement of the consumer.

3. The method according to claim 1, wherein capturing a three-dimensional movement of the consumer further comprises capturing the three-dimensional movement using at least one stereoscopic image device and at least one sensor enabled device to detect content accessible to a consumer at an interface within the consumer environment, wherein the content is the stimulus within the consumer environment.

4. The method according to claim 1, wherein identifying at least one behavior of the consumer in response to at least one stimulus within the consumer environment from a three-dimensional object properties stream of the captured movement further comprises calculating a percentage probability that the captured three-dimensional movement represents a particular behavior defined in a plurality of behavior definitions.

5. The method according to claim 1, wherein identifying at least one behavior of the consumer in response to at least one stimulus within the consumer environment from a three-dimensional object properties stream of the captured movement further comprises identifying at least one of body movement of the consumer comprising a fine granularity movement of at least one of a facial expression, an eye movement, a muscle contraction, and change in skin surface characteristics of the consumer within the three-dimensional object properties stream matching at least one of a plurality of behavior definitions.

6. The method according to claim 1, further comprising:

responsive to detecting the consumer within the consumer environment comprising at least one of a first selected area comprising a point of sale terminal, a second selected area comprising a display within a store, a third selected area comprising a kiosk within a store, and access to an online store interface, capturing the three-dimensional movement of the consumer within the consumer environment.

7. The method according to claim 1, wherein identifying at least one behavior of the consumer in response to at least one stimulus within the consumer environment from a three-dimensional object properties stream of the captured movement further comprises:

identifying at least one behavior responsive to the at least one stimulus of a particular product by detecting at least one of the consumer glancing at the particular product, the consumer picking up the particular product, the consumer reading a label affixed to the product, the consumer reading the price tag for the product, and the consumer hesitating while interacting with the product.

8. The method according to claim 1, wherein generating a control signal according to the particular response rule to trigger at least one change of the at least one stimulus within the consumer environment further comprises:

generating the control signal according to the particular response rule to trigger a program controller to adjust the content displayed on an interface within the consumer environment.

9. The method according to claim 1, wherein generating a control signal according to the particular response rule to trigger at least one change of the at least one stimulus within the consumer environment further comprises:

generating the control signal according to the particular response rule to trigger a store attendant system to prompt at least one store attendant within the consumer environment to provide additional aid to the consumer.

10. The method according to claim 1, wherein generating a control signal according to the particular response rule to trigger at least one change of the at least one stimulus within the consumer environment further comprises:

generating the control signal according to the particular response rule to trigger running an additional computer system associated with the consumer environment to provide a service to the consumer.

11. A system for adjusting a consumer experience within a consumer environment, comprising:

a response processing system communicatively connected to a network, further comprising;

means for capturing a three-dimensional movement of the consumer within the consumer environment, wherein the three-dimensional movement is determined using at least one image capture device aimed at the consumer;

means for identifying at least one behavior of the consumer in response to at least one stimulus within the consumer environment from a three-dimensional object properties stream of the captured movement;

a customer interaction system communicatively connected to the response processing system via the network, further comprising;

means for detecting whether the at least one behavior of the consumer indicates a type of response to the at least one stimulus requiring adjustment of the consumer environment by comparing the type of response indicated by the at least one behavior with a plurality of response rules and identifying at least one particular response rule applicable for the type of response to the at least one stimulus; and

means, responsive to detecting that the behavior of the consumer indicates a type of response to the at least one stimulus requiring adjustment of the consumer environment, for generating a control signal according to the particular response rule to trigger at least one change of the at least one stimulus within the consumer environment.

12. The system according to claim 11, wherein the means for capturing a three-dimensional movement of the consumer further comprises means for capturing the three-dimensional movement using a stereoscopic image device to identify and track a particular three-dimensional movement of the consumer.

13. The system according to claim 11, wherein the means for capturing a three-dimensional movement of the consumer further comprises means for capturing the three-dimensional movement using at least one stereoscopic image device and at least one sensor enabled device to detect content accessible to a consumer at an interface within the consumer environment, wherein the content is the stimulus within the consumer environment.

14. The system according to claim 11, wherein the means for identifying at least one behavior of the consumer in response to at least one stimulus within the consumer environment from a three-dimensional object properties stream of the captured movement further comprises means for identifying at least one of body movement of the consumer comprising a fine granularity movement of at least one of a facial expression, an eye movement, a muscle contraction, and change in skin surface characteristics of the consumer within the three-dimensional object properties stream matching at least one of a plurality of behavior definitions.

15. The system according to claim 11, the response processing system further comprising:

means, responsive to detecting the consumer within the consumer environment comprising at least one of a first selected area comprising a point of sale terminal, a second selected area comprising a display within a store, a third selected area comprising a kiosk within a store, and access to an online store interface, for capturing the three-dimensional movement of the consumer within the consumer environment.

16. The system according to claim 11, wherein the means for identifying at least one behavior of the consumer in response to at least one stimulus within the consumer environment from a three-dimensional object properties stream of the captured movement further comprises:

means for identifying at least one behavior responsive to the at least one stimulus of a particular product by detecting at least one of the consumer glancing at the particular product, the consumer picking up the particular product, the consumer reading a label affixed to the product, the consumer reading the price tag for the product, and the consumer hesitating while interacting with the product.

17. The system according to claim 11, wherein the means for generating a control signal according to the particular response rule to trigger at least one change of the at least one stimulus within the consumer environment further comprises at least one of means for generating the control signal according to the particular response rule to trigger a program controller to adjust the content displayed on an interface within the consumer environment, means for generating the control signal according to the particular response rule to trigger a store attendant system to prompt at least one store attendant within the consumer environment to provide additional aid to the consumer, and means for generating the control signal according to the particular response rule to trigger running an additional computer system associated with the consumer environment to provide a service to the consumer.

18. A program product comprising a storage-type computer-usable medium including a computer-readable program for adjusting a consumer experience within a consumer environment, wherein the computer-readable program when executed on a computer causes the computer to:

capture a three-dimensional movement of the consumer within the consumer environment, wherein the three-dimensional movement is determined using at least one image capture device aimed at the consumer;

identify at least one behavior of the consumer in response to at least one stimulus within the consumer environment from a three-dimensional object properties stream of the captured movement;

detect whether the at least one behavior of the consumer indicates a type of response to the at least one stimulus requiring adjustment of the consumer environment by comparing the type of response indicated by the at least one behavior with a plurality of response rules and identifying at least one particular response rule applicable for the type of response to the at least one stimulus; and

generate a control signal according to the particular response rule to trigger at least one change of the at least one stimulus within the consumer environment.

19. The program product of claim 18, wherein said computer-readable program is transmitted over a network.

20. The program product of claim 18, wherein the computer-readable program when executed on a computer further causes the computer to capture the three-dimensional movement using a stereoscopic image device to identify and track a particular three-dimensional movement of the consumer.