Apparatus, systems and methods for providing motion tracking using a personal viewing device

• US 9,891,435 B2
• Filed: 04/06/2012
• Issued: 02/13/2018
• Est. Priority Date: 11/02/2006
• Status: Active Grant

• Current Assignee: Razer (Asia-Pacific) Pte. Ltd. (Razer Incorporated)
• Original Assignee: Sensics Incorporated
• Inventors: Boger, Yuval, Machlin, Meir, Korakin, Yosef
• Primary Examiner(s): Senfi, Behrooz
• Assistant Examiner(s): NASRI, MARYAM A
• Application Number:
  US13/441,401
• Publication Number:
  US 20120262558A1
• Time in Patent Office: 2,139 Days
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

An apparatus, methods and systems to provide a personal viewing device configured to display an image. The personal viewing device configured to be worn by a user. At least one sensor coupled to the personal viewing device. At least one camera coupled to the personal viewing device and facing outwardly with respect to the personal viewing device. A processor configured for interaction analysis. The processor in communication with the personal viewing device, the at least one sensor and the at least one camera.

Claims

1. An apparatus, comprising:

a personal viewing device configured to display an image of a simulated environment, the personal viewing device configured to be worn by a user;

at least one sensor coupled to the personal viewing device;

at least one camera coupled to the personal viewing device and facing outwardly with respect to the personal viewing device; and

a processor in communication with the personal viewing device, the at least one sensor and the at least one camera, the processor configured to;

create the simulated environment, the simulated environment including the user,

define a representation of the user'"'"'s health within the simulated environment,

identify a projectile captured by the camera and assign a health modifier to the projectile,

identify the projectile striking the user, and

modify the representation of the user'"'"'s health within the simulated environment based on the projectile striking the user.

2. The apparatus of claim 1, wherein the processor is configured to identify that the projectile struck the user based on data received by the at least one camera.

3. The apparatus of claim 1, wherein the at least one sensor is at least one of a position sensor, a motion sensor, a thermal sensor, a moisture sensor, a pressure sensor, a light sensor or an audio sensor.

4. The apparatus of claim 1, wherein the processor is configured to identify an object as the projectile and identify a type of physical interaction that is possible with the projectile.

5. The apparatus of claim 1, wherein the processor is configured to cause the personal viewing device to display a representation of the projectile in the image based on data received from the at least one camera, the representation of the projectile being different from an image of the projectile.

6. The apparatus of claim 1, wherein the processor is configured to identify a type of physical interaction from a plurality of types of physical interactions associated with the projectile in the image.

7. The apparatus of claim 1, wherein the camera is one of a plurality of cameras, the plurality of cameras being configured for motion capture.

8. The apparatus of claim 1, wherein the processor is configured to calculate a distance to the projectile in the image.

9. The apparatus of claim 1, wherein the processor is configured to calculate a direction to the projectile in the image.

10. A non-transitory processor-readable medium storing code representing instructions to be executed by a processor, the code comprising code to cause the processor to:

receive data from an outward-facing camera coupled to a personal viewing device, the personal viewing device configured to be coupled to a user;

receive data from a sensor coupled to the personal viewing device;

define a simulated environment based, in part, based on the data received from the outward-facing camera and the sensor, the simulated environment including the user, the user having a representation of health within the simulated environment, the simulated environment including a representation of a projectile captured by the camera;

display a plurality of images of the simulated environment;

determine that the projectile captured by the camera can be physically interacted with;

assign a health modifier to the projectile;

identify the projectile striking the user based on data received from the camera; and

apply the health modifier to the representation of health to modify the representation of health based on the projectile striking the user.

11. The non-transitory processor-readable medium of claim 10, wherein the outward-facing camera is from a plurality of outward-facing cameras configured to detect motion of the projectile.

12. The non-transitory processor readable medium of claim 10, further comprising code to display a direction of motion of the projectile based on the data received from the outward-facing camera.

13. A system, comprising a processor, the processor configured to:

receive data captured by at least one outward-facing camera coupled to a personal viewing device, the data including data associated with a beverage bottle captured by the at least one outward-facing camera;

receive sensor data associated with at least one sensor coupled to the personal viewing device;

coordinate a display of images based on the data received by the motion capture module, the images representing a simulated environment including the user;

define a representation of the user'"'"'s health within the simulated environment;

identify the user drinking from the beverage bottle based on the data received from the motion capture module and the sensor data capture module; and

modify the representation of the user'"'"'s health based on the user drinking from the beverage bottle.

14. The system of claim 13, wherein the processor is configured to coordinate the display of images based on the data received by the motion capture module.

15. The system of claim 13, wherein the personal viewing device is configured to be coupled to a body of a user.

16. The system of claim 13, the at least one outward-facing camera includes an outward-facing motion capture camera and an outward-facing image capture camera.

17. The system of claim 16, wherein:

the image capture camera is configured to capture an image of the beverage bottle and;

the processor is configured to cause the display of a representation of the beverage bottle in the display of images, the representation of the beverage bottle being different from the image of the beverage bottle.