Computer Interface for Remotely Controlled Objects and Wearable Articles with Absolute Pose Detection Component

• US 20160252965A1
• Filed: 01/11/2016
• Published: 09/01/2016
• Est. Priority Date: 01/30/2004
• Status: Active Grant

• Current Assignee: Electronic Scripting Products, Inc.
• Original Assignee: Electronic Scripting Products, Inc.
• Inventors: Mandella, Michael J., Gonzalez-Banos, Hector H., Alboszta, Marek
• Granted Patent: US 9,939,911 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A63F 13/20 Input arrangements for video game devices
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/812 Ball games, e.g. soccer or baseball
• CPC Class Codes: G01B 21/04 by measuring coordinates of points
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/73 : using feature-based methods
• CPC Class Codes: G06V 10/17 : using hand-held instruments

Abstract

A remotely controlled object (e.g., an aircraft) or a wearable article (e.g., virtual or augmented reality glasses) using high optical contrast features and a photodetector that detects light produced, reflected or scattered by the features and outputs data indicative thereof. The remotely controlled object or wearable article uses one or more controllers to determine its position and/or orientation in the real three-dimensional environment based on data from the photodetector. Data from one or more auxiliary motion sensing devices, e.g., a relative motion sensor such as an inertial device or other auxiliary motion device relying on acoustics, optics or electromagnetic waves within or outside the visible spectrum, can be used to supplement the position and/or orientation data from the photodetector.

Claims

1. A wearable article cooperating with a first plurality of high optical contrast features disposed in a real three-dimensional environment, said wearable article comprising:

a) a photodetector configured to detect said first plurality of high optical contrast features and generate photodetector data representative of the positions of said first plurality of high optical contrast features; and

b) a controller configured to identify a derivative pattern of said first plurality of high optical contrast features from said photodetector data, wherein said derivative pattern is indicative of the position of said photodetector.

2. The wearable article of claim 1, wherein said first plurality of high optical contrast features are invariant features disposed in a known pattern within said real three-dimensional environment.

3. The wearable article of claim 1, wherein said derivative pattern is computed with at least one absolute pose recovery technique selected from the group consisting of geometric invariance, triangulation, ranging, path integration and motion analysis.

4. The wearable article of claim 3, wherein said at least one absolute pose recovery technique comprises geometric invariance computed under application of the rules of perspective geometry.

5. The wearable article of claim 1 deployed in an application selected from the group consisting of virtual reality and augmented reality.

6. The wearable article of claim 5, wherein said wearable article comprises glasses.

7. The wearable article of claim 1, further comprising an auxiliary motion detection component.

8. A wearable article cooperating with a first plurality of high optical contrast features disposed in a real three-dimensional environment, said wearable article comprising:

a) a photodetector configured to detect said first plurality of high optical contrast features and generate photodetector data representative of the positions of said first plurality of high optical contrast features; and

b) a controller configured to identify a derivative pattern of said first plurality of high optical contrast features from said photodetector data, wherein said derivative pattern is indicative of the orientation of said photodetector.

9. The wearable article of claim 8, wherein said first plurality of high optical contrast features are invariant features disposed in a known pattern within said real three-dimensional environment.

10. The wearable article of claim 8, wherein said derivative pattern is computed with at least one absolute pose recovery technique selected from the group consisting of geometric invariance, triangulation, ranging, path integration and motion analysis.

11. The wearable article of claim 10, wherein said at least one absolute pose recovery technique comprises geometric invariance computed under application of the rules of perspective geometry.

12. The wearable article of claim 8, deployed in an application selected from the group consisting of virtual reality and augmented reality.

13. The wearable article of claim 12, wherein said wearable article comprises glasses.

14. The wearable article of claim 8, further comprising an auxiliary motion detection component.

15. A remotely controlled object cooperating with a first plurality of high optical contrast features disposed in a real three-dimensional environment, said remotely controlled object comprising:

a) a photodetector configured to detect said first plurality of high optical contrast features and generate photodetector data representative of the positions of said first plurality of high optical contrast features; and

b) a controller configured to identify a derivative pattern of said first plurality of high optical contrast features from said photodetector data, wherein said derivative pattern is indicative of the position of said photodetector.

16. The remotely controlled object of claim 15, wherein said first plurality of high optical contrast features are invariant features disposed in a known pattern within said real three-dimensional environment.

17. The remotely controlled object of claim 15, wherein said derivative pattern is computed with at least one absolute pose recovery technique selected from the group consisting of geometric invariance, triangulation, ranging, path integration and motion analysis.

18. The remotely controlled object of claim 17, wherein said at least one absolute pose recovery technique comprises geometric invariance computed under application of the rules of perspective geometry.

19. The remotely controlled object of claim 15, wherein said remotely controlled object comprises an aircraft.

20. The wearable article of claim 15, further comprising an auxiliary motion detection component.

21. A remotely controlled object cooperating with a first plurality of high optical contrast features disposed in a real three-dimensional environment, said remotely controlled object comprising:

a) a photodetector configured to detect said first plurality of high optical contrast features and generate photodetector data representative of the positions of said first plurality of high optical contrast features; and

b) a controller configured to identify a derivative pattern of said first plurality of high optical contrast features from said photodetector data, wherein said derivative pattern is indicative of the orientation of said photodetector.

22. The remotely controlled object of claim 21, wherein said first plurality of high optical contrast features are invariant features disposed in a known pattern within said real three-dimensional environment.

23. The remotely controlled object of claim 21, wherein said derivative pattern is computed with at least one absolute pose recovery technique selected from the group consisting of geometric invariance, triangulation, ranging, path integration and motion analysis.

24. The remotely controlled object of claim 23, wherein said at least one absolute pose recovery technique comprises geometric invariance computed under application of the rules of perspective geometry.

25. The remotely controlled object of claim 21, wherein said remotely controlled object comprises an aircraft.

26. The wearable article of claim 21, further comprising an auxiliary motion detection component.