Apparatus For Monitoring a Person Having an Interest to an Object, and Method Thereof

• US 20080228577A1
• Filed: 07/31/2006
• Published: 09/18/2008
• Est. Priority Date: 08/04/2005
• Status: Active Grant

• Current Assignee: Signify Holding B.V. (Signify N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Van De Sluis, Bartel Marinus, Van Loenen, Evert Jan, Decre, Michel Marcel Jose
• Granted Patent: US 10,460,346 B2
• Time in Patent Office: Days
• US Class Current: 705/14
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0255 based on user history
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G09F 27/00 Combined visual and audible advertising or displaying, e.g. for public address

Abstract

The invention relates to a method of monitoring a person having an interest to an object. The method comprising steps of: (210) providing a data processor (111) for obtaining interaction data related to a remote interaction between the person and at least one of a plurality of the objects (131, 132, 133), (240) using the data processor for analysis of the interaction data to identify a particular one of the objects (133), to which the person has the interest, and (250) obtaining additional data related to the particular object for informing the person about the particular object. The analysis of the interaction data may comprise a step (220) of identifying a remote location where the interest of the person is focused, and a step (230) of determining locations of the objects with respect to the remote location.

Claims

1. A method of monitoring a person (101) having an interest to an object, the method comprising steps of:

(210) providing a data processor (111) for obtaining interaction data related to a remote interaction between the person and at least one of a plurality of the objects (131, 132, 133),

(240) using the data processor for analysis of the interaction data to identify a particular one of the objects (133), to which the person has the interest,

(250) obtaining additional data related to the particular object for informing the person about the particular object,

Providing the additional data to person.

2. The method of claim 1, wherein the analysis of the interaction data comprises:

a step (220) of identifying a remote location where the interest of the person is focused, and

a step (230) of determining locations of the objects with respect to the remote location.

3. The method of claim 1, comprising any one or a combination of:

a step of using at least one video camera (141, 142) for obtaining video data being the interaction data related to the remote interaction, and providing the video data to the data processor,

a step of using at least one microphone for obtaining audio data being the interaction data related to the remote interaction, and providing the audio data to the data processor,

a step of using a touch detector for obtaining touch input data being the interaction data related to the remote interaction, the touch detector being remote to the objects, and providing the touch input data to the data processor.

4. The method of claim 1, wherein the data processor is configured as an eye-gaze detector for determining a direction (D) of a person'"'"'s look and an intersection of the direction with the particular object.

5. The method of claim 1, wherein more than one particular object is identified, further comprising a step of determining a further particular object out of the particular objects, the further particular object having attracted most of the person'"'"'s interest.

6. The method of claim 1, wherein the objects are displayed on a screen (120).

7. The method of claim 6, further comprising a step of enabling the person to view the additional data on a display.

8. The method of claim 1, wherein one or more objects are physical items visible to the person.

9. The method of claim 8, further comprising a step of using the additional data for actively demonstrating the particular object to the person through an illumination or physical motion of the particular object.

10. The method of claim 8, wherein locations of the objects and corresponding types of the remote interaction are variably defined on an interaction map.

11. The method of claim 8, wherein the objects are located in a shop area.

14. A computer program product enabling a programmable device, when executing a computer program of said product, to implement the method of claim 1.

12. An apparatus (110) for monitoring a person (101) having an interest to an object, the apparatus comprising a data processor (111) for

obtaining interaction data related to a remote interaction between the person and at least one of a plurality of the objects (131, 132, 133),

analysing of the interaction data to identify a particular one of the objects (133), to which the person has the interest,

obtaining and providing additional data related to the particular object for informing the person about the particular object.

13. A system (100) for monitoring a person (101) having an interest to an object, the system comprising an apparatus (110) as claimed in claim 12, and any one or a combination of:

a video camera (141, 142) for obtaining video data being the interaction data related to the remote interaction, and providing the video data to the apparatus,

a microphone for obtaining audio data being the interaction data related to the remote interaction, and providing the audio data to the apparatus,

a touch detector for obtaining touch input data being the interaction data related to the remote interaction, the touch detector being remote to the objects, and providing the touch input data to the apparatus.