Apparatus for monitoring a person having an interest to an object, and method thereof

• US 10,460,346 B2
• Filed: 07/31/2006
• Issued: 10/29/2019
• Est. Priority Date: 08/04/2005
• Status: Active Grant

• Current Assignee: Signify Holding B.V. (Signify N.V.)
• Original Assignee: Signify Holding B.V. (Signify N.V.)
• Inventors: Decre, Michel Marcel Jose, Van Loenen, Evert Jan, Van De Sluis, Bartel Marinus
• Primary Examiner(s): Ojiaku, Chikaodinaka
• Application Number:
  US11/997,174
• Publication Number:
  US 20080228577A1
• Time in Patent Office: 4,838 Days
• Field of Search: 705 1458, 705 35, 705 7, 340573, 600301
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0255 based on user history
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G09F 27/00 Combined visual and audible advertising or displaying, e.g. for public address

Abstract

The invention relates to a method of monitoring a person (101) having an interest to an object. The method comprising steps of: (210) providing a data processor (111) for obtaining interaction data related to a remote interaction between the person and at least one of a plurality of the objects (131, 132, 133), (240) using the data processor for analysis of the interaction data to identify a particular one of the objects (133), to which the person has the interest, and (250) obtaining additional data related to the particular object for informing the person about the particular object. The analysis of the interaction data may comprise a step (220) of identifying a remote location where the interest of the person is focused, and a step (230) of determining locations of the objects with respect to the remote location.

Claims

1. A method of monitoring a person having an interest in a physical object in an area, the method comprising steps of:

monitoring the person by at least one video camera,

obtaining interaction data from said at least one video camera, the interaction data relating to an interaction between the person and at least one of a plurality of three-dimensional, physical objects, wherein the person does not have physical contact with the physical objects, and wherein each of said at least one cameras is physically detached from each of the plurality of three-dimensional physical objects,

analyzing the interaction data by a data processor to identify a particular one of the physical objects to which the person has the interest, wherein said analyzing step comprises determining a direction (D) of a person'"'"'s look and an intersection of the direction with the particular object using a grid of detectors in the area to detect an identifier on the physical object,

obtaining additional data related to the identified particular physical object for immediately informing the person about the identified particular physical object, wherein said obtaining additional data step is performed without any further action by the person, and

providing the additional data to the person.

2. The method of claim 1, wherein said analyzing step comprises:

a step of identifying a remote location where the interest of the person is focused, and

a step of determining locations of the objects with respect to the remote location.

3. The method of claim 1,

wherein said obtaining step further comprises any one or a combination of:

a step of using at least one microphone for obtaining audio data as additional interaction data related to the remote interaction, and providing the audio data to the data processor,

a step of using a touch detector for obtaining touch input data as additional interaction data related to the remote interaction, the touch detector being remote to the objects, and providing the touch input data to the data processor, and

wherein said analyzing step further comprises analyzing at least some of the additional interaction data.

4. The method of claim 1, wherein more than one particular object is identified, further comprising a step of determining a further particular object out of the particular objects, the further particular object having attracted most of the person'"'"'s interest.

5. The method of claim 1, wherein said providing step comprises displaying the additional data on a display.

6. The method of claim 1, wherein one or more of the physical objects are visible to the person.

7. The method of claim 6, further comprising a step of using the additional data for actively demonstrating the particular object to the person through an illumination or physical motion of the particular object.

8. The method of claim 6, wherein the physical objects are located in a shop area.

9. A method of monitoring a person having an interest in physical objects in an area, the method comprising steps of:

monitoring the person by at least one video camera,

obtaining interaction data from said at least one video camera, the interaction data relating to an interaction between the person and at least one of a plurality of three dimensional, physical objects, wherein the person does not have physical contact with the physical objects, and wherein each of said at least one cameras is physically detached from each of the plurality of three-dimensional physical objects,

analyzing the interaction data by a data processor to identify a particular one of the physical objects to which the person has the interest, wherein said analyzing step comprises determining a direction (D) of a person'"'"'s look and an intersection of the direction with the particular physical object, wherein locations of the physical objects are coordinately defined on an interaction map, and wherein the map and direction are used to determine the particular physical object,

obtaining additional data related to the identified particular physical object for immediately informing the person about the identified particular physical object, wherein said obtaining additional data step is performed without any further action by the person, and

providing the additional data to the person.

10. A system for monitoring a person having an interest in a physical object, the system comprising:

at least one video camera for obtaining interaction data relating to an interaction between the person and at least one of a plurality of three-dimensional, physical objects, wherein the person does not have physical contact with the physical objects, and wherein each of said at least one cameras is physically detached from each of the plurality of three-dimensional physical objects, and

a data processor for

analyzing the interaction data to identify a particular one of the objects to which the person has the interest, wherein said analyzing function comprises determining a direction (D) of a person'"'"'s look and an intersection of the direction with the particular object using a grid of detectors in the area to detect an identifier on the physical object, and

obtaining and providing additional data related to the identified particular physical object for immediately informing the person about the identified particular physical object.

11. The system of claim 10 further comprising any one or a combination of:

a microphone for obtaining audio data as additional interaction data related to the interaction, and providing the audio data to the data processor,

a touch detector for obtaining touch input data as additional interaction data related to the interaction, and providing the touch input data to the data processor.

12. A method of monitoring a person having an interest to an object, the method comprising steps of:

by a data processor, obtaining interaction data related to a remote interaction between the person and at least one of a plurality of objects, and analyzing the interaction data to identify a particular one of the objects to which the person has the interest, and

by the data processor, obtaining additional data related to the particular object to provide additional data to the person,

wherein the interaction data comprises touch data indicative of one or more touches by the person to a window located in front of the plurality of objects, and

wherein identifying the particular object comprises detecting a position of touches on the window based on the touch data and then projecting the touch position onto coordinates of the objects to identify the particular object.