Selecting an interaction scenario based on an object

• US 9,324,292 B2
• Filed: 09/27/2012
• Issued: 04/26/2016
• Est. Priority Date: 09/27/2012
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Bender, Roberto, de Lima, Diogo Strube, Cordeiro, Otavio Correa, do Prado, Rodrigo Menezes, Santhiveeran, Soma Sundaram
• Primary Examiner(s): MA, CALVIN
• Application Number:
  US13/629,508
• Publication Number:
  US 20140085180A1
• Time in Patent Office: 1,307 Days
• Field of Search: 382/118, 382/124, 358/1.18, 345/156, 345/633
• US Class Current: 1/1
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

Techniques for selecting an interaction scenario based on an object are described in various implementations. A method that implements the techniques may include receiving, at a computer system and from an image capture device, an image that depicts a viewing area proximate to a presentation device. The method may also include processing the image, using the computer system, to detect a user in the viewing area presenting an object in a manner that indicates desired interaction with the presentation device. The method may also include selecting, using the computer system, an interaction scenario for presentation on the presentation device based on the object.

Claims

1. A method comprising:

receiving, at a computer system and from an image capture device, an image that depicts a viewing area proximate to an electronic display device;

processing the image, using the computer system, to detect a user in the viewing area holding an object to present the object to the electronic display device in a manner that indicates an opt-in decision to initiate a desired interaction with the electronic display device, wherein the electronic display device is to present information according to a plurality of interaction scenarios; and

in response to the opt-in decision, selecting, using the computer system, an interaction scenario of the plurality of interaction scenarios for presentation of information on the electronic display device based on the object,

wherein the object is a physical item that is held by the user.

2. The method of claim 1, wherein selecting the interaction scenario comprises comparing visual features of the object to visual features of a set of known objects, recognizing the object as a particular one of the set of known objects based on the comparison, and selecting the interaction scenario associated with the particular one of the set of known objects.

3. The method of claim 1, wherein the object comprises a user identifier, and wherein the interaction scenario comprises a user sign-in procedure for signing the user into a system.

4. The method of claim 3, wherein the interaction scenario further comprises presenting customer account information of the user on the electronic display device when the user is signed into the system.

5. The method of claim 4, wherein the validation of the user comprises facial recognition of the user based on the image.

6. The method of claim 1, wherein the object comprises a product, and wherein the interaction scenario comprises presenting product information associated with the product.

7. The method of claim 6, wherein the product information comprises at least one of a user review, another similar product, another complementary product, a coupon, and dynamic pricing of the product.

8. The method of claim 1, further comprising causing the interaction scenario to be presented on the electronic display device.

9. A presentation system comprising:

a display device;

an image capture device that captures an image of a viewing area proximate to the display device;

an image analyzer, executing on a processor, that analyzes the image to detect a user in the viewing area presenting an object in a manner that indicates an opt-in decision to initiate an interaction with the presentation system; and

a scenario selection engine, executing on a processor, that selects, in response to the opt-in decision, an interaction scenario for presentation on the display device based on the object,

wherein the object is a physical item that is held by the user.

10. The presentation system of claim 9, further comprising a known object database that contains a set of known objects, visual features associated with the known objects, and interaction scenarios associated with the known objects, wherein the image analyzer extracts visual features of the object from the image, and wherein the scenario selection engine compares the extracted visual features to the visual features associated with the known objects to recognize the object as a particular one of the set of known objects, and selects the interaction scenario associated with the particular one of the set of known objects.

11. The presentation system of claim 9, wherein the object comprises a user identifier, and wherein the interaction scenario comprises a user sign-in procedure for signing the user into a system.

12. The presentation system of claim 11, wherein the interaction scenario further comprises presenting customer account information of the user on the electronic display device when the user is signed into the system.

13. The presentation system of claim 9, wherein the object comprises a product, and wherein the interaction scenario comprises presenting product information associated with the product.

14. The presentation system of claim 13, wherein the product information comprises at least one of a user review, another similar product, another complementary product, a coupon, and dynamic pricing of the product.

15. A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors, cause the one or more processors to:

receive an image that depicts a viewing area proximate to a retail store presentation device comprising an electronic display;

process the image to detect a user in the viewing area holding an object to present the object to the retail store presentation device in a manner that indicates an opt-in decision to initiate an interaction with the retail store presentation device, wherein the object includes a unique identifier for the user, wherein the retail store presentation device is to present information according to a plurality of interaction scenarios; and

select, in response to the opt-in decision, an interaction scenario of the plurality of interaction scenarios for presentation on the retail store presentation device based on the unique identifier included in the object, wherein the interaction scenario comprises displaying customer account information of the user on the retail store presentation display device.

16. The non-transitory computer-readable storage medium of claim 15, wherein selecting the interaction scenario comprises comparing visual features of the object to visual features of a set of known objects, recognizing the object as a particular one of the set of known objects based on the comparison, and selecting the interaction scenario associated with the particular one of the set of known objects.

17. The non-transitory computer-readable storage medium of claim 15, wherein the unique identifier is a customer loyalty identifier for a retail store.

18. The non-transitory computer-readable storage medium of claim 17, wherein the interaction scenario comprises displaying customer loyalty information for the user.

19. The non-transitory computer-readable storage medium of claim 18, wherein the validation of the user comprises facial recognition of the user based on the image.

20. The non-transitory computer-readable storage medium of claim 15, wherein the interaction scenario comprises displaying a discount offer specific to the user.