Environment actuation by one or more augmented reality elements

• US 9,489,772 B2
• Filed: 03/27/2013
• Issued: 11/08/2016
• Est. Priority Date: 03/27/2013
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Raffa, Giuseppe, Anderson, Glen J., Nachman, Lama, Wu, Yi, Shah, Rahul C.
• Primary Examiner(s): McDowell, Jr., Maurice L
• Assistant Examiner(s): Ricks, Donna J
• Application Number:
  US13/851,394
• Publication Number:
  US 20140292807A1
• Time in Patent Office: 1,322 Days
• US Class Current: 1/1
• CPC Class Codes: G05B 2219/32014 Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Apparatuses, systems, media and methods may provide for environment actuation by one or more augmented reality elements. A location module may determine a location of one or more networked devices in a real space and/or establish a location of the one or more augmented reality elements in a virtual space, which may be mapped to the real space. A coordinator module may coordinate a virtual action in the virtual space of the one or more augmented reality elements with an actuation event by the one or more networked devices in the real space. The actuation event may correspond to the virtual action in the virtual space and be discernible in the real space.

Claims

1. An apparatus comprising:

a network interface;

a location module to determine via information received at the network interface a location of one or more networked devices in a real space and to establish a location of one or more augmented reality elements in a virtual space that is to be mapped to the real space;

a coordinator module to coordinate a virtual action of the one or more elements in the virtual space with an actuation event by the one or more networked devices in the real space, wherein the actuation event is to correspond to the virtual action in the virtual space and be discernible in the real space, wherein the virtual action to include a download action corresponding to content, and wherein the content is to be automatically displayed using a networked device that is most proximate to a user located in the real space.

2. The apparatus of claim 1, wherein the virtual action of the one or more elements is to be displayed.

3. The apparatus of claim 1, further comprising:

a pair module to perform an association between the virtual action of the one or more elements and the actuation event by the one or more networked devices;

a context module to allow the virtual action of the one or more elements to be adapted based at least on context information;

or

a user command module to allow the virtual action of the one or more elements to be adapted based at least on a command from a user located in the real space to the one or more elements.

4. The apparatus of claim 3, wherein the pair module is to provide a user interface or a database to perform the association between the virtual action of the one or more elements and the actuation event by the one or more networked devices.

5. The apparatus of claim 3, wherein the location module is to determine a networked device location, a real object location, a user location, or the context information from a motion sensor, an audio sensor, an image sensor, or an environmental sensor.

6. The apparatus of claim 1, wherein the actuation event is to include a visual display of the one or more elements by the one or more networked devices in the real space independently of an intermediate display device.

7. The apparatus of claim 1, wherein the location module is to generate a three-dimensional model of the real space or wherein the location determined by the location module is to correspond to an appliance or a fixture.

8. The apparatus of claim 1, wherein the virtual action or the actuation event is to occur regardless of a display of the one or more elements.

9. The apparatus of claim 1, further comprising an affiliation module to allow the virtual action of the one or more elements to be adapted based at least on group information, wherein the virtual action is to be a virtual behavior based at least on the group information, and wherein the group information is to include one or more of social network group information and geographic group information.

10. At least one non-transitory computer-readable medium comprising one or more instructions that when executed on a computing device cause the computing device to:

coordinate a virtual action of one or more elements in a virtual space that is to be mapped to a real space with an actuation event by one or more networked devices in the real space, wherein the actuation event is to correspond to the virtual action and be discernible in the real space, wherein the virtual action to include a download action corresponding to content, and wherein the content is to be automatically displayed using a networked device that is most proximate to a user located in the real space.

11. The at least one non-transitory medium of claim 10, wherein when executed the one or more instructions cause the computing device to generate a three-dimensional model of the real space or to determine the location of one or more of an appliance and a fixture.

12. The at least one non-transitory medium of claim 10, wherein when executed the one or more instructions cause the computing device to coordinate the virtual action of the one or more elements with a tactile, auditory, visual or olfactory actuation event by the one or more networked devices.

13. The at least one non-transitory medium of claim 10, wherein when executed the one or more instructions cause the computing device to coordinate an action that is to include a change in a virtual location of the one or more elements within the virtual space with an actuation event that is to include a sensory output by the one or more networked devices in the real space independently of a display device.

14. The at least one non-transitory medium of claim 13, wherein when executed the one or more instructions cause the computing device to enable the one or more elements to include a pet element, the real space to include a living space, the virtual action to include a change in the virtual location via a virtual walk within the virtual space, and the actuation event to include an observable actuation event by a user in the living space independently of the display device.

15. The at least one non-transitory medium of claim 10, wherein when executed the one or more instructions cause the computing device to adapt the virtual action of the one or more elements based at least on context information.

16. The at least one non-transitory medium of claim 15, wherein when executed the one or more instructions cause the computing device to enable the one or more elements to include a pet element, the real space to include a living space, and the virtual action to include a virtual behavior based at least on the context information, wherein the context information is to include one or more of a pet element owner, an environmental condition, and proximity to the pet element in the real space.

17. The at least one non-transitory medium of claim 10, wherein when executed the one or more instructions cause the computing device to adapt the virtual action of the one or more elements based at least on a command from the user located in the real space to the one or more elements.

18. The at least one non-transitory medium of claim 17, wherein when executed the one or more instructions cause the computing device to enable the one or more elements to include a pet element, the command to include a fetch command for the content, and the actuation event to include an observable actuation event by the user in the real space.

19. The at least one non-transitory medium of claim 10, wherein when executed the one or more instructions cause the computing device to perform an association between the virtual action of the one or more elements and the actuation event by the one or more networked devices.

20. The at least one non-transitory medium of claim 10, wherein when executed the one or more instructions cause the computing device to determine a location of one or more networked devices in the real space or to establish a location of one or more augmented reality elements in the virtual space.

21. The at least one medium of claim 10, wherein when executed the one or more instructions cause the computing device to enable the virtual action or the actuation event to occur regardless of a display of the one or more elements.

22. The at least one non-transitory medium of claim 10, wherein when executed the one or more instructions cause the computing device to adapt the virtual action of the one or more elements based at least on group information, wherein the virtual action is to be a virtual behavior based at least on the group information, and wherein the group information is to include one or more of social network group information and geographic group information.

23. A method comprising:

coordinating a virtual action of one or more elements in a virtual space that is mapped to a real space with an actuation event by one or more networked devices in the real space, wherein the actuation event corresponds to the virtual action and is discernible in the real space, wherein the virtual action includes a download action corresponding to content, and wherein the content is automatically displayed using a networked device that is most proximate to a user located in the real space.

24. The method of claim 23, further comprising:

determining a location of one or more networked devices in the real space;

establishing a location of one or more augmented reality elements in the virtual space;

performing an association between the virtual action of the one or more elements and the actuation event by the one or more networked devices;

or

adapting the virtual action of the one or more elements based at least on context information or user command information.

25. The method of claim 23, wherein the virtual action or the actuation event occurs regardless of a display of the one or more elements.

26. The method of claim 23, further comprising adapting the virtual action of the one or more elements based at least on group information, wherein the virtual action is a virtual behavior based at least on the group information, and wherein the group information includes one or more of social network group information and geographic group information.

27. At least one non-transitory computer-readable medium comprising one or more instructions that when executed on a computing device cause the computing device to:

coordinate a virtual action of one or more elements in a virtual space that is to be mapped to a real space with an actuation event by one or more networked devices in the real space, wherein the actuation event is to correspond to the virtual action and be discernible in the real space; and

adapt the virtual action of the one or more elements based at least on a command from a user located in the real space to the one or more elements, wherein the one or more elements are to include a pet element, the command is to include a fetch command for content, the virtual action is to include a download action corresponding to the content, and the actuation event is to include an observable actuation event by the user in the real space, and wherein the content is to be automatically displayed using a networked device that is most proximate to the user.

28. A method comprising:

coordinating a virtual action of one or more elements in a virtual space that is mapped to a real space with an actuation event by one or more networked devices in the real space, wherein the actuation event corresponds to the virtual action and is discernible in the real space; and

adapting the virtual action of the one or more elements based at least on a command from a user located in the real space to the one or more elements, wherein the one or more elements include a pet element, the command includes a fetch command for content, the virtual action includes a download action corresponding to the content, and the actuation event includes an observable actuation event by the user in the real space, and wherein the content is automatically displayed using a networked device that is most proximate to the user.

29. An apparatus comprising:

a network interface;

a location module to determine via information received at the network interface a location of one or more networked devices in a real space and to establish a location of one or more augmented reality elements in a virtual space that is to be mapped to the real space;

a coordinator module to coordinate a virtual action of the one or more elements in the virtual space with an actuation event by the one or more networked devices in the real space, wherein the actuation event is to correspond to the virtual action in the virtual space and be discernible in the real space; and

a user command module to allow the virtual action of the one or more elements to be adapted based at least on a command from a user located in the real space to the one or more elements, wherein the one or more elements are to include a pet element, the command is to include a fetch command for content, the virtual action is to include a download action corresponding to the content, and the actuation event is to include an observable actuation event by the user in the real space, and wherein the content is to be automatically displayed using a networked device that is most proximate to the user.