VISUALIZATION OF PHYSICAL CHARACTERISTICS IN AUGMENTED REALITY

• US 20150187138A1
• Filed: 12/31/2013
• Published: 07/02/2015
• Est. Priority Date: 12/31/2013
• Status: Active Grant

• Current Assignee: META Platforms Technologies LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Original Assignee: DAQRI, LLC
• Inventors: Mullins, Brian
• Granted Patent: US 9,626,801 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes
• CPC Class Codes: G06T 2219/2021 Shape modification
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

A system and method for visualization of physical characteristics are described. A sensor coupled to an object generates live data. Physical characteristics of the object are computed using the live data. A visualization of the physical characteristics of the object is generated and communicated to a viewing device configured to capture an image of the object. The viewing device augments the image of the object with the visualization of the physical characteristics of the object.

Claims

1. A server comprising:

a sensor coupled to an object; and

a processor comprising an augmented reality application, the augmented reality application having;

a physical characteristics identification module configured to access live data generated by the sensor and to compute physical characteristics of the object using the live data; and

a physical characteristics visualization module configured to generate a visualization of the physical characteristics of the object, and to communicate the visualization of the physical characteristics of the object to a viewing device configured to capture an image of the object, the viewing device configured to augment the image of the object with the visualization of the physical characteristics of the object.

2. The server of claim 1, wherein the physical characteristics identification module is configured to:

receive an identification of the object from the viewing device; and

access live data corresponding to the identification of the object.

3. The server of claim 2, wherein the physical characteristics visualization module is configured to:

communicate the live data to the viewing device,

wherein the viewing device is configured to compute the physical characteristics of the object using the live data, and to generate the visualization of the physical characteristics of the object.

4. The server of claim 3, wherein the viewing device is configured to:

display the visualization of the physical characteristics of the object in relation to the image of the object in a display of the viewing device.

5. The server of claim 1, wherein the visualization comprises an animation with movements based on the live data, or the visualization comprises visual indicators having shapes and colors that change according to the live data.

6. The server of claim 1, wherein the physical characteristics of the object include a weight, a force, a pressure, a heart rate, a pressure rate, or EEG data.

7. The server of claim 1, wherein the physical characteristics visualization module is configured to:

access historical physical characteristics of the object; and

generate the visualization of the physical characteristics of the object in relation to the historical physical characteristics of the object.

8. The server of claim 1, wherein the physical characteristics identification module is configured to:

receive a parameter related to the object from the viewing device;

and

compute modified physical characteristics of the object based on the live data affected by the parameter,

wherein the physical characteristics visualization module is configured to;

generate a visualization of the modified physical characteristics of the object; and

communicate the visualization of the modified physical characteristics of the object to the viewing device.

9. The server of claim 1, wherein the physical characteristics visualization module is configured to:

render a virtual object using the computed physical characteristics; and

communicate the rendered virtual object to the viewing device, the viewing device configured to display the rendered virtual object in relation to a position of the viewing device relative to the object.

10. The server of claim 1, wherein the viewing device comprises:

an optical device configured to capture the image of the object; and

a display configured to display the visualization of the physical characteristics of the object in a transparent display, a position and size of the visualization of the physical characteristics of the object in the transparent display based on a position and orientation of the viewing device relative to the object.

11. A method comprising:

accessing live data generated by a sensor coupled to an object;

computing physical characteristics of the object using the live data;

generating a visualization of the physical characteristics of the object; and

communicating the visualization of the physical characteristics of the object to a viewing device configured to capture an image of the object, the viewing device configured to augment the image of the object with the visualization of the physical characteristics of the object.

12. The method of claim 11, further comprising:

receiving an identification of the object from the viewing device; and

accessing live data corresponding to the identification of the object.

13. The method of claim 12, further comprising:

communicating the live data to the viewing device;

computing the physical characteristics of the object using the live data at the viewing device; and

generating the visualization of the physical characteristics of the object at the viewing device.

14. The method of claim 13, further comprising:

displaying the visualization of the physical characteristics of the object in relation to the image of the object in a display of the viewing device.

15. The method of claim 11, wherein the visualization comprises an animation with movements based on the live data, or visual indicators having shapes and colors that change according to the live data.

16. The method of claim 11, wherein the physical characteristics of the object include a weight, a force, a pressure, a heart rate, a pressure rate, or EEG data.

17. The method of claim 11, further comprising:

receiving a parameter related to the object from the viewing device;

computing modified physical characteristics of the object based on the live data affected by the parameter;

generating a visualization of the modified physical characteristics of the object; and

communicating the visualization of the modified physical characteristics of the object to the viewing device.

18. The method of claim 11, further comprising:

rendering a virtual object using the computed physical features;

communicating the rendered virtual object to the viewing device;

displaying, at the viewing device, the rendered virtual object in relation to a position of the viewing device relative to the object.

19. The method of claim 11, further comprising:

capturing the image of the object with an optical device of the viewing device; and

displaying the visualization of the physical characteristics of the object in a transparent display of the viewing device, a position and size of the visualization of the physical characteristics of the object in the transparent display based on a position and orientation of the viewing device relative to the object.

20. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

accessing live data generated by a sensor coupled to an object;

computing physical characteristics of the object using the live data;

generating a visualization of the physical characteristics of the object; and

communicating the visualization of the physical characteristics of the object to a viewing device configured to capture an image of the object, the viewing device configured to augment the image of the object with the visualization of the physical characteristics of the object.