Systems and methods for utilizing compressed sensing in an entertainment system

• US 9,995,823 B2
• Filed: 07/31/2015
• Issued: 06/12/2018
• Est. Priority Date: 07/31/2015
• Status: Active Grant

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Cheatham, III, Jesse R., Hyde, Roderick A., Ishikawa, Muriel Y., Kare, Jordin T., Mundie, Craig J., Myhrvold, Nathan P., Petroski, Robert C., Rudder, Eric D., Tan, Desney S., Tegreene, Clarence T., Whitmer, Charles, Wilson, Andrew, Wing, Jeannette M., Wood, Jr., Lowell L., Wood, Victoria Y. H.
• Primary Examiner(s): Baghdasaryan, Hovhannes
• Application Number:
  US14/815,538
• Publication Number:
  US 20170031021A1
• Time in Patent Office: 1,047 Days
• CPC Class Codes: G01S 13/522 using transmissions of interrupted pulse modulated waves
• CPC Class Codes: G01S 13/862 Combination of radar systems with sonar systems
• CPC Class Codes: G01S 13/89 for mapping or imaging
• CPC Class Codes: G01S 15/52 Discriminating between fixed and moving objects or between objects moving at different speeds
• CPC Class Codes: G01S 15/62 Sense-of-movement determination G01S15/588 takes precedence
• CPC Class Codes: G01S 15/86 Combinations of sonar systems with lidar systems; Combinations of sonar systems with systems not using wave reflection
• CPC Class Codes: G01S 15/89 for mapping or imaging

Abstract

The present disclosure provides systems and methods for using compressed sensing for imaging an object for use in combination with an entertainment or infotainment device. For example, the system may utilize a few—(e.g., 1, 2, 3 . . . ) pixel imaging sensor to obtain coarse image data from each of a plurality of subregions of a region of interest. Compressed sensing techniques may then be used to estimate a higher resolution image of the region of interest using the coarse image data from the plurality of subregions.

Claims

1. An entertainment device for generating an image of an object within a region, comprising:

an ultrasonic transmitter that transmits ultrasound into the region;

an ultrasonic receiver that receives an ultrasonic reflection of the transmitted ultrasound from a plurality of sites on the object within the region;

a first imaging module that generates coarse image data of the object at a first resolution based on the received ultrasonic reflections, wherein the object includes one or more human controllers of the entertainment device;

an identification module that identifies a portion of interest on the object based on the generated coarse image data;

an electromagnetic radiation transmitter that transmits electromagnetic radiation into the identified portion of interest of the object within the region, wherein the identified portion corresponds to a particular body part of one of the human controllers;

an electromagnetic radiation receiver that receives electromagnetic radiation from the identified portion of interest on the object;

a second imaging module that generates fine image data of the portion of interest on the object at a second resolution based on electromagnetic radiation received by the electromagnetic radiation receiver, wherein the second resolution is greater than the first resolution;

a compressed sensing module that enhances the fine image data using compressed sensing techniques;

a kinematic determination module that determines a first kinematic value associated with the portion of interest on the object based on at least one of received electromagnetic radiation and received ultrasonic reflections; and

a modification module that modifies a state of the entertainment device based on the first kinematic value associated with the portion of interest on the object.

2. The entertainment device of claim 1, wherein a signal from the entertainment device is used to identify one of the plurality of sites on the object at which to calculate the first kinematic value.

3. The entertainment device of claim 1, wherein a signal from the entertainment device is used to identify a direction in which to calculate the first kinematic value.

4. The entertainment device of claim 1, wherein a signal from the entertainment device is used to identify the portion of interest on the object for which to determine the first kinematic value.

5. The entertainment device of claim 1, further comprising:

a second ultrasonic receiver that is physically separated from the ultrasonic receiver, wherein the second ultrasonic receiver is configured to receive an ultrasonic reflection from at least one site of the plurality of sites on the object;

wherein a shift module is configured to detect a shift of the ultrasonic reflection received by the second ultrasonic receiver, and

wherein the first kinematic value module is configured to calculate a second kinematic value associated with the portion of interest on the object based on the detected shift of the ultrasonic reflection received by the second ultrasonic receiver.

6. The entertainment device of claim 5, further comprising:

a third ultrasonic receiver that is physically separated from the ultrasonic receiver and the second ultrasonic receiver, wherein the third ultrasonic receiver is configured to receive an ultrasonic reflection from at least one site of the plurality of sites on the object,

wherein the shift module is configured to detect a shift of the ultrasonic reflection received by the third ultrasonic receiver, and

wherein the first kinematic value module is configured to calculate a third kinematic value associated with the portion of interest on the object based on the detected shift of the ultrasonic reflection received by the third ultrasonic receiver.

7. The entertainment device of claim 6, further comprising:

a prediction module configured to predict a relative position of the object at a future time based on (1) the first kinematic value associated with the portion of interest on the object, (2) the second kinematic value associated with the portion of interest on the object, and (3) the third kinematic value associated with the portion of interest on the object.

8. The entertainment device of claim 6, wherein the ultrasonic receiver, the second ultrasonic receiver, and the third ultrasonic receiver are non-collinear with respect to one another.

9. The entertainment device of claim 6, wherein the ultrasonic receiver, the second ultrasonic receiver, and the third ultrasonic receiver are part of an ultrasonic system.

10. The entertainment device of claim 1, wherein at least one of the ultrasonic reflections comprises a direct ultrasonic reflection from at least one site of the plurality of sites on the object to the ultrasonic receiver.

11. The entertainment device of claim 1, wherein the ultrasonic transmitter is configured to transmit one or more directional ultrasonic pulses.

12. The entertainment device of claim 11, wherein at least one directional ultrasonic pulse is directed to a location of the first surface selected to generate an ultrasonic reflection to at least one site of the plurality of sites on the object.