ENVIRONMENT ACTUATION BY ONE OR MORE AUGMENTED REALITY ELEMENTS

• US 20140292807A1
• Filed: 03/27/2013
• Published: 10/02/2014
• Est. Priority Date: 03/27/2013
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Raffa, Giuseppe, Anderson, Glen J., Nachman, Lama, Wu, Yi, Shah, Rahul C.
• Granted Patent: US 9,489,772 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G05B 2219/32014 Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Apparatuses, systems, media and methods may provide for environment actuation by one or more augmented reality elements. A location module may determine a location of one or more networked devices in a real space and/or establish a location of the one or more augmented reality elements in a virtual space, which may be mapped to the real space. A coordinator module may coordinate a virtual action in the virtual space of the one or more augmented reality elements with an actuation event by the one or more networked devices in the real space. The actuation event may correspond to the virtual action in the virtual space and be discernible in the real space.

Claims

9. At least one computer-readable medium comprising one or more instructions that when executed on a computing device cause the computing device to:

coordinate a virtual action of one or more elements in a virtual space that is to be mapped to a real space with an actuation event by one or more networked devices in the real space, wherein the actuation event is to correspond to the virtual action and be discernible in the real space.

10. The at least one medium of claim 9, wherein when executed the one or more instructions cause the computing device to enable the virtual action or the actuation event to occur regardless of a display of the one or more elements.

11. The at least one medium of claim 9, wherein when executed the one or more instructions cause the computing device to generate a three-dimensional model of the real space or to determine the location of one or more of an appliance and a fixture.

12. The at least one medium of claim 9, wherein when executed the one or more instructions cause the computing device to coordinate the virtual action of the one or more elements with a tactile, auditory, visual or olfactory actuation event by the one or more networked devices.

13. The at least one medium of claim 9, wherein when executed the one or more instructions cause the computing device to coordinate an action that is to include a change in the virtual location of the one or more elements within the virtual space with an actuation event that is to include a sensory output by the one or more networked devices in the real space independently of a display device.

14. The at least one medium of claim 13, wherein when executed the one or more instructions cause the computing device to enable the element to include a pet element, the real space to include a living space, the virtual action to include a change in the virtual location via a virtual walk within the virtual space, and the actuation event to include an observable actuation event by a user in the living space independently of the display device.

15. The at least one medium of claim 9, wherein when executed the one or more instructions cause the computing device to adapt the virtual action of the one or more elements based at least on context information.

16. The at least one medium of claim 15, wherein when executed the one or more instructions cause the computing device to enable the element to include a pet element, the real space to include a living space, and the virtual action to include a virtual behavior based at least on the context information, wherein the context information is to include one or more of a pet element owner, an environmental condition, and proximity to the pet element in the real space.

17. The at least one medium of claim 9, wherein when executed the one or more instructions cause the computing device to adapt the virtual action of the one or more elements based at least on group information.

18. The at least one medium of claim 17, wherein when executed the one or more instruction cause the computing device to enable the element to include a pet element, the real space to include a living space, and the virtual action to be a virtual behavior based at least on the group information, wherein the group information is to include one or more of social network group information and geographic group information.

19. The at least one medium of claim 9, wherein when executed the one or more instructions cause the computing device to adapt the virtual action of the one or more elements based at least on a command from a user located in the real space to the one or more elements.

20. The at least one medium of claim 19, wherein when executed the one or more instructions cause the computing device to enable the element to include a pet element, the command to include a fetch command for content, the virtual action to include a download action corresponding to the content, and the actuation event to include an observable actuation event by the user in the real space, wherein the content is to be automatically displayed using a networked device that is most proximate to the user.

21. The at least one medium of claim 9, wherein when executed the one or more instructions cause the computing device to perform an association between the virtual action of the one or more elements and the actuation event by the one or more networked devices.

22. The at least one medium of claim 9, wherein when executed the one or more instructions cause the computing device to determine a location of one or more networked devices in the real space or to establish a location of one or more augmented reality elements in the virtual space.

23. A method comprising:

coordinating a virtual action of one or more elements in a virtual space that is to be mapped to a real space with an actuation event by one or more networked devices in the real space, wherein the actuation event corresponds to the virtual action and is to be discernible in the real space.

1. An apparatus comprising:

a network interface;

a location module to determine via information received at the network interface a location of one or more networked devices in a real space and to establish a location of one or more augmented reality elements in a virtual space that is to be mapped to the real space; and

a coordinator module to coordinate a virtual action of the one or more elements in the virtual space with an actuation event by the one or more networked devices in the real space, wherein the actuation event is to correspond to the virtual action in the virtual space and be discernible in the real space.

2. The apparatus of claim 1, wherein the virtual action or the actuation event is to occur regardless of a display of the one or more elements.

3. The apparatus of claim 1, wherein the virtual action or the actuation event is to occur based on a display of the one or more elements.

4. The apparatus of claim 1, further comprising:

a pair module to perform an association between the virtual action of the one or more elements and the actuation event by the one or more networked devices;

a context module to allow the virtual action of the one or more elements to be adapted based at least on context information;

an affiliation module to allow the virtual action of the one or more elements to be adapted based at least on group information;

or

a user command module to allow the virtual action of the one or more elements to be adapted based at least on a command from a user located in the real space to the one or more elements.

5. The apparatus of claim 4, wherein the pair module is to provide a user interface or a database to perform the association between the virtual action of the one or more elements and the actuation event by the one or more networked devices.

6. The apparatus of claim 4, wherein the location module is to determine a networked device location, an object location, a user location, or the context information from a motion sensor, an audio sensor, an image sensor, or an environmental sensor.

7. The apparatus of claim 1, wherein the actuation event is to include a visual display of the one or more elements by the one or more networked devices in the real space independently of an intermediate display device.

8. The apparatus of claim 1, wherein the location module is to generate a three-dimensional model of the real space or wherein the location determined by the location module is to correspond to an appliance or a fixture.

24. The method of claim 23, wherein the virtual action or the actuation event occur regardless of a display of the one or more elements.

24-1. The method of claim 23, further comprising:

determining a location of one or more networked devices in the real space;

establishing a location of one or more augmented reality elements in the virtual space;

performing an association between the virtual action of the one or more elements and the actuation event by the one or more networked devices;

or

adapting the virtual action of the one or more elements based at least on context information, group information, or user command information.