Determination of mobile display position and orientation using micropower impulse radar
First Claim
1. A mobile device comprising:
- a front face and an opposite rear face;
a display on the front face to present images;
radar components to generate a plurality of radar signal pulses and to generate distance data based on received return signals, wherein the radar components are micropower impulse radar (MIR) components;
a plurality of rear facing radar antennae to transmit a first plurality of radar signal pulses in a first direction and to receive a first set of return signals resulting from reflection of the first plurality of radar signal pulses;
a plurality of front facing radar antennae to transmit a second plurality of radar signal pulses in an opposite second direction and to receive a second set of return signals resulting from reflection of the second plurality of radar signal pulses, the second plurality of radar pulses being directed towards a user of the mobile device; and
a processor to process signals and data, wherein the processor is to;
process the first set of return signals received by the plurality of rear facing radar antennae to determine a current position and orientation of the display with respect to real objects in an environment,process the second set of return signals received by the plurality of front facing radar signals to determine and track a position of a current vantage point of a user of the mobile device, wherein the current vantage point of the user is a current position of a dominant eye of the user in relation to the mobile device, andgenerate and update an augmented image including rendering a virtual object and superimposing the virtual object on an image including one or more real objects, the rendering of the virtual image being based at least in part on the determined current position and orientation of the display and the determined current vantage point of the user of the mobile device, wherein generation of the augmented image includes the processor to generate and update a viewing matrix for the mobile device, the viewing matrix being updated to define a viewing frustum that corresponds to the current vantage point of the user of the mobile device.
2 Assignments
0 Petitions
Accused Products
Abstract
Embodiments are generally directed to determination of mobile display position and orientation using micropower impulse radar. An embodiment of an apparatus includes a display to present images; radar components to generate radar signal pulses and to generate distance data based on received return signals; radar antennae to transmit the radar signal pulses and to receive the return signals; and a processor to process signals and data, wherein the processor is to: process the return signals received by the radar antennae to determine a position and orientation of the display with respect to real objects in an environment and to determine a position of a vantage point of a user of the apparatus, and generate an augmented image including rendering a virtual object and superimposing the virtual object on an image including one or more real objects, the rendering of the virtual image being based at least in part on the determined position and orientation of the display and the determined vantage point of the user of the apparatus.
68 Citations
18 Claims
-
1. A mobile device comprising:
-
a front face and an opposite rear face; a display on the front face to present images; radar components to generate a plurality of radar signal pulses and to generate distance data based on received return signals, wherein the radar components are micropower impulse radar (MIR) components; a plurality of rear facing radar antennae to transmit a first plurality of radar signal pulses in a first direction and to receive a first set of return signals resulting from reflection of the first plurality of radar signal pulses; a plurality of front facing radar antennae to transmit a second plurality of radar signal pulses in an opposite second direction and to receive a second set of return signals resulting from reflection of the second plurality of radar signal pulses, the second plurality of radar pulses being directed towards a user of the mobile device; and a processor to process signals and data, wherein the processor is to; process the first set of return signals received by the plurality of rear facing radar antennae to determine a current position and orientation of the display with respect to real objects in an environment, process the second set of return signals received by the plurality of front facing radar signals to determine and track a position of a current vantage point of a user of the mobile device, wherein the current vantage point of the user is a current position of a dominant eye of the user in relation to the mobile device, and generate and update an augmented image including rendering a virtual object and superimposing the virtual object on an image including one or more real objects, the rendering of the virtual image being based at least in part on the determined current position and orientation of the display and the determined current vantage point of the user of the mobile device, wherein generation of the augmented image includes the processor to generate and update a viewing matrix for the mobile device, the viewing matrix being updated to define a viewing frustum that corresponds to the current vantage point of the user of the mobile device. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A method comprising:
-
capturing an image of an environment with a camera of a mobile device; transmitting a first plurality of radar signal pulses in a first direction from a plurality of rear facing radar antennae in the mobile device; transmitting a second plurality of radar signal pulses in a second opposite direction from a plurality of front facing radar antennae in the mobile device, the second plurality of radar signal pulse being directed towards a user of the mobile device; receiving a first set of return signals resulting from reflection of the first plurality of radar signal pulses, the first set of return signals being received at the plurality of rear facing radar antennae, and receiving a second set of return signals resulting from reflection of the second plurality of radar signal pulses, the second set of return signals being received at the plurality of front facing radar antennae; processing the first set of return signals received at the plurality of rear facing radar antennae to determine a current position and orientation of a display screen of the mobile device with respect to real objects in the environment and processing the second set of return signals received at the plurality of front facing radar antennae to determine and track a position of a current vantage point of the user of the mobile device, wherein the current vantage point of the user is a current position of a dominant eye of the user in relation to the mobile device; rendering a 3D (three-dimensional) virtual object, wherein the rendering of the virtual object is based at least in part on the determined current position and orientation of the display screen and the determined position of the current vantage point of the user; and generating an augmented reality image by superimposing the virtual object on the image of the environment, wherein generation of the augmented image includes generating and updating a viewing matrix for the mobile device, the viewing matrix being updated to define a viewing frustum that corresponds to the current vantage point of the user of the mobile device; wherein the radar signal pulses are transmitted using a micropower impulse radar (MIR) system. - View Dependent Claims (8, 9, 10)
-
-
11. A mobile device comprising:
-
a front face and an opposite rear face; a touchscreen display on the front face to present images; a camera to capture an image of an environment; a micropower impulse radar (MIR) system to generate a first plurality of radar signal pulses in a first direction and to generate a first set distance data based on a first set of received return signals resulting from reflection of the first plurality of radar signal pulses, and to generate a second plurality of radar signal pulses in a second opposite direction and to generate a second set of distance data based on a first set of received return signals resulting from reflection of the second plurality of radar signal pulses, the MIR system including a plurality of rear facing radar antennae and a plurality of front facing radar antennae to transmit the radar signal pulses and receive the return signals resulting from reflection of the radar signal pulses; and a processor to process signals and data, wherein the processor is to; process the first set of return signals received by the plurality of rear facing radar antennae to determine a current position and orientation of the display with respect to real objects in the environment, process the second set of return signals received by the plurality of front facing radar signals to determine and track a position of a current vantage point of a user of the mobile device, wherein the current vantage point of the user is a current position of a dominant eye of the user in relation to the mobile device, and generate an augmented image including rendering one or more virtual objects and superimposing the one or more virtual objects on the image of the environment, the rendering of the one or more virtual images being based at least in part on the determined current position and orientation of the display and the determined current vantage point of the user of the mobile device, wherein generation of the augmented image includes the processor to generate and update a viewing matrix for the mobile device, the viewing matrix being updated to define a viewing frustum that corresponds to the current vantage point of the user of the mobile device. - View Dependent Claims (12, 13, 14)
-
-
15. A non-transitory computer-readable storage medium having stored thereon data representing sequences of instructions that, when executed by a processor, cause the processor to perform operations comprising:
-
capturing an image of an environment with a camera of a mobile device; transmitting a first set of micropower impulse radar signal pulses in a first direction from a plurality of rear facing radar antennae in the mobile device; transmitting a second set of micropower impulse radar signal pulses in a second opposite direction from a plurality of front facing radar antennae in the mobile device, the second set of micropower impulse radar signal pulses being directed towards a user of the mobile device; receiving a first set of return signals resulting from reflection of the first plurality of radar signal pulses, the first set of return signals being received at the plurality of rear facing radar antennae, and receiving a second set of return signals resulting from reflection of the second plurality of radar signal pulses, the second set of return signals being received at the plurality of front facing radar antennae; processing the first set return signals received at the plurality of rear facing radar antennae to determine a current position and orientation of a display screen of the mobile device with respect to real objects in the environment and processing the second set of return signals received at the plurality of front facing radar antennae to determine and track a current position of a dominant eye of a user of the mobile device in relation to the mobile device; rendering a virtual object, wherein the rendering of the virtual object is based at least in part on the determined current position and orientation of the display screen and the determined current position of the dominant eye of the user; and generating an augmented reality image by superimposing the virtual object on the image of the environment, wherein generation of the augmented image includes the processor to generate and update a viewing matrix for the mobile device, the viewing matrix being updated to define a viewing frustum that corresponds to the current position of the dominant eye of the user of the mobile device. - View Dependent Claims (16, 17, 18)
-
Specification