SYSTEM AND METHOD FOR SELECTION OF AN OBJECT OF INTEREST DURING PHYSICAL BROWSING BY FINGER FRAMING

• US 20090110235A1
• Filed: 10/26/2007
• Published: 04/30/2009
• Est. Priority Date: 10/26/2007
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Marti, Stefan
• Granted Patent: US 8,073,198 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/043 using propagating acoustic waves
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L

Abstract

A system and method selecting an object from a plurality of objects in a physical environment is disclosed. The method may include framing an object located in a physical environment by positioning an aperture at a selected distance from a user'"'"'s eye, the position of the aperture being selected such that the aperture substantially encompasses the object as viewed from the user'"'"'s perspective, detecting the aperture by analyzing image data including the aperture and the physical environment, and selecting the object substantially encompassed by the detected aperture. The method may further include identifying the selected object based on its geolocation, collecting and merging data about the identified object from a plurality of data sources, and displaying the collected and merged data.

Claims

1. A system for selecting an object from a plurality of objects in a physical environment, the system comprising:

an aperture configured to frame an object located in a physical environment, wherein the aperture is positioned at a selected distance from a user'"'"'s eye, the position of the aperture being selected such that the aperture substantially encompasses the object as viewed from the user'"'"'s perspective; and

an image analysis subsystem configured to analyze image data including the aperture and the physical environment to thereby detect the aperture and select the object substantially encompassed by the detected aperture.

2. The system of claim 1, further comprising:

a sensor subsystem configured to detect a wink of the user; and

an image capture subsystem configured to capture the image data including the aperture and the physical environment in response to detecting the wink.

3. The system of claim 1, wherein the image analysis subsystem is further configured to determine a distance from the user to the object.

4. The system of claim 3, wherein the image analysis subsystem is further configured to determine the distance from the user to the object in response to not detecting the aperture.

5. The system of claim 3, wherein the image analysis subsystem is further configured to determine the size of the aperture, and determine the size of the object based at least in part on the determined size of the aperture and the determined distance to the object.

6. The system of claim 3, further comprising an autofocus or depth sensor subsystem configured to determine the distance to the object.

7. The system of claim 1, further comprising:

a directional subsystem configured to sense a direction that the user is viewing the object; and

an object location subsystem configured to determine a location of the object relative to the user based on the determined distance and the sensed viewing direction.

8. The system of claim 7, further comprising:

a geo-location subsystem configured to determine a geo-location of the user; and

wherein the object location subsystem is further configured to determine a geo-location of the object based on the geo-location of the user and the determined location of the object relative to the user.

9. The system of claim 1, wherein the aperture comprises at least a portion of one or both of the user'"'"'s hands.

10. A method of selecting an object from a plurality of objects in a physical environment, the method comprising:

framing an object located in a physical environment by positioning an aperture at a selected distance from a user'"'"'s eye, the position of the aperture being selected such that the aperture substantially encompasses the object as viewed from the user'"'"'s perspective;

detecting the aperture by analyzing image data including the aperture and the physical environment; and

selecting the object substantially encompassed by the detected aperture.

11. The method of claim 10 further comprising:

detecting a wink of the user; and

capturing the image data including the aperture and the physical environment in response to detecting the wink.

12. The method of claim 10, further comprising determining a distance from the user to the object.

13. The method of claim 12, wherein determining the distance comprises determining the distance from the user to the object in response to not detecting the aperture.

14. The method of claim 12, further comprising:

determining the size of the aperture; and

determining the size of the object based at least in part on the determined size of the aperture and the determined distance to the object.

15. The method of claim 12, wherein determining the distance from the user to the object comprises determining a distance at which an autofocus subsystem focuses a lens or determining a distance with a depth sensor.

16. The method of claim 10, further comprising:

sensing a direction that the user is viewing the object; and

determining a location of the object relative to the user based on the determined distance and the sensed viewing direction.

17. The method of claim 16, further comprising:

determining a geo-location of the user; and

determining a geo-location of the object based on the geo-location of the user and the determined location of the object relative to the user.

18. The method of claim 10, wherein framing the object comprises the user forming the aperture using at least a portion of one or both of the user'"'"'s hands.

19. A system for selecting an object from a plurality of objects in a physical environment, the system comprising:

means for framing an object located in a physical environment by positioning an aperture at a selected distance from a user'"'"'s eye, the position of the aperture being selected such that the aperture substantially encompasses the object as viewed from the user'"'"'s perspective;

means for detecting the aperture by analyzing image data including the aperture and the physical environment; and

means for selecting the object substantially encompassed by the detected aperture.

20. The system of claim 19, further comprising:

means for detecting a wink of the user; and

means for capturing the image data including the aperture and the physical environment in response to detecting the wink.

21. The system of claim 19, wherein the means for framing comprises at least a portion of one or both of the user'"'"'s hands.