APPARATUS, SYSTEMS AND METHODS FOR PROVIDING MOTION TRACKING USING A PERSONAL VIEWING DEVICE

• US 20120262558A1
• Filed: 04/06/2012
• Published: 10/18/2012
• Est. Priority Date: 11/02/2006
• Status: Active Grant

• Current Assignee: Razer (Asia-Pacific) Pte. Ltd. (Razer Incorporated)
• Original Assignee: Sensics Incorporated
• Inventors: Machlin, Meir, Boger, Yuval, Korakin, Yosef
• Granted Patent: US 9,891,435 B2
• Time in Patent Office: Days
• US Class Current: 348/61
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

An apparatus, methods and systems to provide a personal viewing device configured to display an image. The personal viewing device configured to be worn by a user. At least one sensor coupled to the personal viewing device. At least one camera coupled to the personal viewing device and facing outwardly with respect to the personal viewing device. A processor configured for interaction analysis. The processor in communication with the personal viewing device, the at least one sensor and the at least one camera.

Claims

1. An apparatus, comprising:

a personal viewing device configured to display an image, the personal viewing device configured to be worn by a user;

at least one sensor coupled to the personal viewing device;

at least one camera coupled to the personal viewing device and facing outwardly with respect to the personal viewing device; and

a processor configured for interaction analysis, the processor in communication with the personal viewing device, the at least one sensor and the at least one camera.

2. The apparatus of claim 1, wherein the processor is configured to determine whether an interaction is occurring within an image, based on data received by the at least one camera.

3. The apparatus of claim 1, wherein the at least one sensor is at least one of a position sensor, a motion sensor, a thermal sensor, a moisture sensor, a pressure sensor, a light sensor or an audio sensor.

4. The apparatus of claim 1, wherein the processor is configured to identify if an object in the image is interactive.

5. The apparatus of claim 1, wherein the processor is configured to identify a type of interaction that is possible with an object in the image.

6. The apparatus of claim 1, wherein the processor is configured to cause the display of an object in the image based on data received from the at least one camera.

7. The apparatus of claim 1, wherein the processor is configured to identify a type of interaction from a plurality of types of interactions associated with an object in the image.

8. The apparatus of claim 1, wherein the processor is configured to identify at least one parameter associated with an interaction with an object in the image.

9. The apparatus of claim 1, wherein the camera is one of a plurality of cameras, the plurality of cameras being configured for motion capture.

21. The apparatus of claim 1, wherein the processor is configured to calculate a distance to an object in the image.

22. The apparatus of claim 1, wherein the processor is configured to calculate a direction to an object in the image.

10. A non-transitory processor-readable medium storing code representing instructions to be executed by a processor, the code comprising code to cause the processor to:

receive data from at least one outward-facing camera coupled to a personal viewing device, the personal viewing device configured to be coupled to a user;

receive data from at least one sensor coupled to the personal viewing device; and

display a plurality of images based on the data received from the at least one camera and the at least one sensor.

11. The non-transitory processor-readable medium of claim 10, further comprising code to cause the processor to determine if an object in an image is an interactive object.

12. The non-transitory processor-readable medium of claim 10, wherein the at least one outward-facing camera is one of a plurality of outward facing cameras, each of the at least one outward-facing cameras configured to detect motion of an object.

13. The non-transitory processor-readable medium of claim 10, wherein the code to display the plurality of images includes code to display at least a portion of an image based on the data received from the at least one outward-facing camera.

14. The non-transitory processor readable medium of claim 10, further comprising code to display a direction of motion of an object based on the data received from the at least one outward-facing camera.

15. A system, comprising:

a motion capture module configured to receive data associated with images captured by at least one outward-facing camera coupled to a personal viewing device;

a sensor data capture module configured to receive sensor data associated with at least one sensor coupled to the personal viewing device; and

an image analysis module configured to communicate with the motion capture module to coordinate a display of images based on the data received by the motion capture module.

16. The system of claim 15, wherein the image analysis module is further configured to communicate with the sensor data capture module to coordinate the display of images based on the data received by the sensor data capture module.

17. The system of claim 15, wherein the image analysis module is configured to identify a type of interaction possible for an object in an image based on the data received from the image capture module and the sensor data capture module.

18. The system of claim 15, wherein the personal viewing device is coupled to a body of a user.

19. The system of claim 15, the at least one outward-facing camera is one of a plurality of outward-facing motion capture cameras, the system further comprising an outward-facing image capture camera.

20. The system of claim 19, wherein the image capture camera is configured to receive data associated with an object and cause the display of a representation of the object in the display of images.