METHOD AND APPARATUS FOR CONTENT ASSOCIATION AND HISTORY TRACKING IN VIRTUAL AND AUGMENTED REALITY

• US 20140067768A1
• Filed: 08/29/2013
• Published: 03/06/2014
• Est. Priority Date: 08/30/2012
• Status: Active Grant

• Current Assignee: West Texas Technology Partners LLC
• Original Assignee: Atheer, Inc.
• Inventors: Fateh, Sina, Yang, Allen Yang, Itani, Sleiman, Butterworth, Ron, Chehade, Mohamed Nabil Haji
• Granted Patent: US 9,589,000 B2
• Time in Patent Office: Days
• US Class Current: 707/684
• CPC Class Codes: G06F 16/219 Managing data history or versioning querying versioned data G06F16/2474; querying temporal data G06F16/2477
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/24569 Query processing with adaptation to specific hardware, e.g. adapted for using GPUs or SSDs
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80

Abstract

A machine-implemented method includes establishing a virtual or augmented reality entity, and establishing a state for the entity having a state time and state properties including a state spatial arrangement. The data entity and state are stored, and are subsequently received and outputted at a time other than the state time so as to exhibit a “virtual time machine” functionality. An apparatus includes a processor, a data store, and an output. A data entity establisher, a state establisher, a storer, a data entity receiver, a state receiver, and an outputter are instantiated on the processor.

Claims

1. An apparatus, comprising:

a processor adapted to execute executable instructions;

a data entity establisher instantiated on said processor, said data entity establisher comprising executable instructions adapted for establishing a data entity comprising at least one of a group consisting of an augmented reality entity and a virtual reality entity;

a state establisher instantiated on said processor, said state establisher comprising executable instructions adapted for establishing a state for said data entity, said state comprising;

a state time;

a plurality of state properties at least substantially corresponding to properties of said data entity substantially at said state time, said plurality of state properties comprising a state spatial arrangement of said data entity;

a data store in communication with said processor;

a storer instantiated on said processor, said storer comprising executable instructions adapted for storing in said data store said data entity and said state so as to enable output of said data entity to at least one of an augmented reality environment and a virtual reality environment with said data entity exhibiting at least one of said plurality of state properties as at said state time, said output of said data entity being at an output time substantially different from said state time.

2. The apparatus of claim 1, comprising:

a chronometer adapted to determine said output time.

3. The apparatus of claim 1, comprising:

at least one sensor in communication with said processor.

4. The apparatus of claim 3, wherein:

said at least one sensor is adapted to determine at least one of a group consisting of a spatial arrangement of said apparatus at said state time, a spatial arrangement of said apparatus at said output time, and said state spatial arrangement of said data entity.

5. The apparatus of claim 3, wherein:

said at least one sensor comprises at least one of a group consisting of an accelerometer, a gyroscope, an imager, a stereo pair of imagers, a GPS sensor, a magnetometer, a structured light sensor, a time-of-flight sensor, an ultrasonic sensor, and a wireless signal triangulation sensor.

6. The apparatus of claim 3, wherein:

said at least one sensor comprises at least one of a group consisting of a bar code reader, a chemical sensor, an electrical sensor, an electrical field sensor, a gas detector, a humidity sensor, an imager, a stereo pair of imagers, a light sensor, a magnetic field sensor, a microphone, a motion sensor, a pressure sensor, a radar sensor, a radiation sensor, an RFID sensor, a smoke sensor, a spectrometer, a thermal sensor, an ultrasonic sensor, and a vibration sensor.

7. The apparatus of claim 1, comprising:

a data entity distinguisher instantiated on said processor, said data entity distinguisher comprising executable instructions adapted for distinguishing said data entity from a surrounding thereof.

8. The apparatus of claim 1, comprising:

an identifier instantiated on said processor, said data entity identifier comprising executable instructions adapted for identifying at least one of a group consisting of said data entity, a parent entity for said data entity, and at least one of said state properties.

9. The apparatus of claim 1, wherein:

at least a portion of said apparatus is disposed on a head mounted display.

10. The apparatus of claim 1, comprising:

a data entity receiver instantiated on said processor, said data entity receiver comprising executable instructions adapted receiving said data entity from said data store;

a state receiver instantiated on said processor, said state receiver comprising executable instructions adapted for receiving from said data store said state for said data entity;

an output in communication with said processor, said output being adapted to output said data entity;

an outputter instantiated on said processor, said outputter comprising executable instructions adapted for outputting said data entity to at least one of an augmented reality environment and a virtual reality environment at an output time substantially different from said state time, with said data entity exhibiting at least one of said plurality of state properties as at said state time.

11. An apparatus, comprising:

a processor adapted to execute executable instructions;

a data store in communication with said processor;

a data entity receiver instantiated on said processor, said data entity receiver comprising executable instructions adapted for receiving from said data store a data entity, said data entity comprising at least one of a group consisting of an augmented reality entity and a virtual reality entity;

a state receiver instantiated on said processor, said state receiver comprising executable instructions adapted for receiving from said data store a state for said data entity, said state comprising;

a state time;

a plurality of state properties at least substantially corresponding to properties of said data entity substantially at said state time, said plurality of state properties comprising a state spatial arrangement of said data entity;

an output in communication with said processor, said output being adapted to output said data entity;

an outputter instantiated on said processor, said outputter comprising executable instructions adapted for outputting said data entity to at least one of an augmented reality environment and a virtual reality environment at an output time substantially different from said state time, with said data entity exhibiting at least one of said plurality of state properties as at said state time.

12. The apparatus of claim 11, comprising:

a chronometer adapted to determine said output time.

13. The apparatus of claim 11, comprising:

at least one sensor in communication with said processor.

14. The apparatus of claim 13, wherein:

said at least one sensor is adapted to determine at least one of a group consisting of a spatial arrangement of said apparatus at said state time, a spatial arrangement of said apparatus at said output time, and said state spatial arrangement of said data entity.

15. The apparatus of claim 13, wherein:

said at least one sensor comprises at least one of a group consisting of an accelerometer, a gyroscope, an imager, a stereo pair of imagers, a GPS sensor, a magnetometer, a structured light sensor, a time-of-flight sensor, an ultrasonic sensor, and a wireless signal triangulation sensor.

16. The apparatus of claim 11, wherein:

said output comprises a visual display.

17. The apparatus of claim 11, wherein:

said output comprises a stereo pair of visual displays.

18. The apparatus of claim 11, wherein:

at least a portion of said apparatus is disposed on a head mounted display.

19. A method comprising:

instantiating on a processor a data entity establisher, said data entity establisher comprising executable instructions adapted for establishing a data entity comprising at least one of a group consisting of an augmented reality entity and a virtual reality entity;

instantiating on said processor a state establisher, said state establisher comprising executable instructions adapted for establishing a state for said data entity, said state comprising;

a state time;

a plurality of state properties at least substantially corresponding to properties of said data entity substantially at said state time, said plurality of state properties comprising a state spatial arrangement of said data entity;

instantiating on said processor a storer, said storer comprising executable instructions adapted for storing said data entity and said state so as to enable output of said data entity to at least one of an augmented reality environment and a virtual reality environment with said data entity exhibiting at least one of said plurality of state properties as at said state time, said output of said data entity being at an output time substantially different from said state time.

20. The method of claim 19, wherein:

said data entity establisher is adapted to select said data entity, said data entity being in existence prior to a selection thereof.

21. The method of claim 19, wherein:

said data entity establisher is adapted to create said data entity.

22. The method of claim 19, wherein:

said data entity establisher is adapted to generate said data entity from a parent entity.

23. The method of claim 22, wherein:

said parent entity comprises at least one of a group consisting of a physical object, a physical background, a physical environment, a physical creature, and a physical phenomenon.

24. The method of claim 22, wherein:

said parent entity comprises at least one of a group consisting of an augmented reality object and a virtual reality object.

25. The method of claim 19, comprising:

instantiating on said processor a data entity distinguisher, said data entity distinguisher comprising executable instructions adapted for distinguishing said data entity from a surrounding thereof.

26. The method of claim 19, comprising:

instantiating on said processor an identifier, said identifier comprising executable instructions adapted for identifying at least one of a group consisting of said data entity, a parent entity for said data entity, and at least one of said state properties.

27. The method of claim 19, comprising:

instantiating on said processor a data entity receiver, said data entity receiver comprising executable instructions adapted for receiving from said data store said data entity;

instantiating on said processor a state receiver, said state receiver comprising executable instructions adapted for receiving from said data store said state;

instantiating on said processor an outputter, said outputter comprising executable instructions adapted for outputting said data entity to at least one of an augmented reality environment and a virtual reality environment at said output time, with said data entity exhibiting at least one of said plurality of state properties as at said state time.

28. A method comprising:

instantiating on said processor a data entity receiver, said data entity receiver comprising executable instructions adapted for receiving from a data store a data entity, said data entity comprising at least one of a group consisting of an augmented reality entity and a virtual reality entity;

instantiating on said processor a state receiver, said state receiver comprising executable instructions adapted for receiving from said data store a state for said data entity, said state comprising;

a state time;

a plurality of state properties at least substantially corresponding to properties of said data entity substantially at said state time, said plurality of state properties comprising a state spatial arrangement of said data entity;

instantiating on said processor an outputter, said outputter comprising executable instructions adapted for outputting said data entity to at least one of an augmented reality environment and a virtual reality environment at an output time substantially different from said state time, with said data entity exhibiting at least one of said plurality of state properties as at said state time.

29. The method of 28, wherein:

said state receiver is adapted to receive from said data store a first state for said data entity, said first state comprising;

a first state time;

a plurality of first state properties at least substantially corresponding to properties of said data entity substantially at said first state time, said plurality of first state properties comprising a first state spatial arrangement of said data entity;

said state receiver is adapted to receive from said data store a second state for said data entity, said second state comprising;

a second state time;

a plurality of second state properties at least substantially corresponding to properties of said data entity substantially at said second state time, said plurality of second state properties comprising a second state spatial arrangement of said data entity;

said outputter is adapted to output at said output time a first iteration of said data entity exhibiting at least one of said plurality of first state properties as at said first state time; and

said outputter is adapted to output at said output time a second iteration of said data entity exhibiting at least one of said plurality of second state properties as at said second state time.

30. The method of 28, wherein:

said state receiver is adapted to receive from said data store a first state for said data entity, said first state comprising;

a first state time;

a plurality of first state properties at least substantially corresponding to properties of said data entity substantially at said first state time, said plurality of first state properties comprising a first state spatial arrangement of said data entity;

said state receiver is adapted to receive from said data store a second state for said data entity, said second state comprising;

a second state time;

a plurality of second state properties at least substantially corresponding to properties of said data entity substantially at said second state time, said plurality of second state properties comprising a second state spatial arrangement of said data entity;

said outputter is adapted to output at a first output time substantially different from said first state time a first iteration of said data entity exhibiting at least one of said plurality of first state properties as at said first state time; and

said outputter is adapted to output at a second output time subsequent to said first output time a second iteration of said data entity exhibiting at least one of said plurality of second state properties as at said second state time.