Method and apparatus for providing immersive interaction via everyday devices

• US 9,635,159 B2
• Filed: 05/08/2012
• Issued: 04/25/2017
• Est. Priority Date: 05/08/2012
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Baldini, Diego, Bauer, Steven, Rawlings, Steven James
• Primary Examiner(s): Lai, Daniel
• Application Number:
  US14/400,046
• Publication Number:
  US 20150111547A1
• Time in Patent Office: 1,813 Days
• Field of Search: None
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: H04L 67/08 specially adapted for terminal emulation, e.g. Telnet
• CPC Class Codes: H04L 69/18 Multiprotocol handlers, e.g. single devices capable of handling multiple protocols
• CPC Class Codes: H04M 1/72409 by interfacing with external accessories hands-free H04M1/60
• CPC Class Codes: H04W 4/18 Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals
• CPC Class Codes: H04W 56/001 Synchronization between nodes
• CPC Class Codes: H04W 8/22 Processing or transfer of terminal data, e.g. status or physical capabilities
• CPC Class Codes: H04W 88/06 adapted for operation in multiple networks or having at least two operational modes, e.g. multi-mode terminals

Abstract

An approach is provided for providing immersive interaction via everyday devices based on one or more interaction events. In an example embodiment, an immersion service processes content presented at a device to determine one or more interaction events. The immersion service further determines (a) one or more control signals for controlling the device, one or more other devices, or a combination thereof to cause, at least in part, the one or more interaction events; (b) one or more protocols for transmitting the one or more control signals; or (c) a combination thereof. The immersion service also causes, at least in part, a transmission of the one or more control signals to the device, the one or more other devices, or a combination thereof.

Claims

1. A method comprising:

processing, by an apparatus, content presented at a device, wherein the content is presented, at least in part, using a functionality of the device associated with the presenting of the content, to determine one or more interaction events between a user of the device and one or more virtual characters in a virtual world presented in the content;

determining, by the apparatus, (a) one or more control signals for controlling the device, one or more other devices, or a combination thereof to initiate a presentation of the one or more interaction events in the virtual world; and

(b) one or more protocols for transmitting the one or more control signals;

initiating, by the apparatus, a transmission of the one or more control signals to the device, the one or more other devices, or a combination thereof, using the one or more protocols;

initiating, by the apparatus, a combination of virtual information associated with the content with native information associated with the device, the one or more other devices, or a combination thereof, at one or more user interfaces associated with the device, the one or more other devices, or a combination thereof based, at least in part, on the one or more interaction events; and

initiating, by the apparatus, a presentation of information of the one or more virtual characters and information of real world contacts of the user using an identical format in a contact application of the device,

wherein the virtual information coincides with the native information, a format of the native information, or a combination thereof, associated with the device, the one or more other devices, or a combination thereof.

2. A method of claim 1, further comprising:

initiating a presentation of information of the one or more interaction events between the user and the one or more virtual characters as well as information of real world events of the user using an identical format in a calendar application of the device,

wherein the device, the one or more other devices, or a combination thereof have at least one functionality beyond a functionality for presenting, at least in part, the content, to interact with the content based on the one or more interaction events.

3. A method of claim 1, further comprising:

determining one or more capabilities of the device, the one or more other devices, or a combination thereof,

wherein the one or more interaction events, the one or more control signals, the one or more protocols, or a combination thereof are based, at least in part, on the one or more capabilities.

4. A method of claim 1, further comprising:

determining one or more virtual devices represented in the content; and

initiating a simulation of one or more actions, one or more functions, one or more characteristics, or a combination thereof associated with the one or more virtual devices at the device, the one or more other devices, or a combination thereof based, at least in part, on the one or more control signals.

5. A method of claim 4, further comprising:

initiating a synchronization of the one or more actions, the one or more functions, the one or more characteristics, or a combination thereof of the one or more virtual devices with an execution of the one or more control signals at the device, the one or more other devices, or a combination thereof.

6. A method of claim 4, further comprising:

in response to the one or more interaction events between the user and the one or more virtual characters,

initiating a presentation of virtual navigation through the virtual world on the device, based on one or more navigation applications on the device.

7. A method of claim 6, further comprising:

initiating a presentation of the one or more virtual communications and real world communications of the device using an identical format,

wherein the one or more virtual communications include one or more phone calls, one or more text messages, one or more multimedia messages, one or more emails, or a combination thereof.

8. A method of claim 1, further comprising:

initiating a querying of the one or more other devices, the device, or a combination thereof for one or more supported control signals, one or more supported protocols, or a combination thereof; and

determining the one or more control signals, the one or more protocols, or a combination thereof based, at least in part, on the one or more supported control signals, the one or more supported protocols, or a combination thereof.

9. A method of claim 1, further comprising:

initiating an insertion of one or more representations of the content into the device, the one or more other devices, or a combination thereof;

determining one or more interactions between the one or more representations of the content and the device, the one or more other devices, or a combination thereof; and

at least one of processing or facilitating a processing of the one or more interactions to determine the one or more interaction events,

wherein the apparatus connects to the device via a network.

10. A method of claim 9, further comprising:

initiating a modification of the content, an interaction with the content, or a combination thereof based, at least in part, on the one or more interactions, the one to more interaction events, or a combination thereof.

11. A method of claim 9,

wherein the one or more other devices include one or more home appliances.

12. A method of claim 11,

wherein the one or more home appliances include a microwave oven, a refrigerator, a washing machine, a dryer, or a combination thereof.

13. An apparatus comprising:

circuitry including a hardware implementation comprising at least one processor or a portion of a processor and at least one memory including computer program code, the circuitry, when in operation, causing the apparatus to;

process content presented at a device, wherein the content is presented, at least in part, using a functionality of the device associated with the presenting of the content, to determine one or more interaction events between a user of the device and one or more virtual characters in a virtual world presented in the content;

determine (a) one or more control signals for controlling the device, one or more other devices, or a combination thereof to initiate a presentation of the one or more interaction events in the virtual world; and

(b) one or more protocols for transmitting the one or more control signals;

initiate a transmission of the one or more control signals to the device, the one or more other devices, or a combination thereof, using the one or more protocols;

initiate a combination of virtual information associated with the content with native information associated with the device, the one or more other devices, or a combination thereof, at one or more user interfaces associated with the device, the one or more other devices, or a combination thereof based, at least in part, on the one or more interaction events; and

initiate a presentation of information of the one or more virtual characters and information of real world contacts of the user using an identical format in a contact application of the device,

wherein the virtual information coincides with the native information, a format of the native information, or a combination thereof, associated with the device, the one or more other devices, or a combination thereof.

14. An apparatus of claim 13, wherein the apparatus is further caused to:

determine one or more capabilities of the device, the one or more other devices, or a combination thereof,

wherein the one or more interaction events, the one or more control signals, the one or more protocols, or a combination thereof are based, at least in part, on the one or more capabilities.

15. An apparatus of claim 13, wherein the apparatus is further caused to:

determine one or more virtual devices represented in the content; and

initiate a simulation of one or more actions, one or more functions, one or more characteristics, or a combination thereof associated with the one or more virtual devices at the device, the one or more other devices, or a combination thereof based, at least in part, on the one or more control signals.

16. An apparatus of claim 15, wherein the apparatus is further caused to:

initiate a synchronization of the one or more actions, the one or more functions, the one or more characteristics, or a combination thereof of the one or more virtual devices with an execution of the one or more control signals at the device, the one or more other devices, or a combination thereof.

17. An apparatus of claims 13, wherein the apparatus is further caused to:

initiate a querying of the one or more other devices, the device, or a combination thereof for one or more supported control signals, one or more supported protocols, or a combination thereof; and

determine the one or more control signals, the one or more protocols, or a combination thereof based, at least in part, on the one or more supported control signals, the one or more supported protocols, or a combination thereof.

18. An apparatus of claim 13, wherein the apparatus is further caused to:

initiate an insertion of one or more representations of the content into the device, the one or more other devices, or a combination thereof;

determine one or more interactions between the one or more representations of the content and the device, the one or more other devices, or a combination thereof; and

at least one of process or facilitate a processing of the one or more interactions to determine the one or more interaction events.

19. An apparatus of claim 18, wherein the apparatus is further caused to:

initiate a combination of virtual information associated with the content with native information associated with the device, the one or more other devices, or a combination thereof at one or more user interfaces associated with the device, the one or more other devices, or a combination thereof based, at least in part, on the one or more interaction events.

20. An apparatus of claim 19, wherein the virtual information coincides with the native information, a format of the native information, or a combination thereof associated with the device, the one or more other devices, or a combination thereof.

21. An apparatus of claim 18, wherein the apparatus is further caused to:

initiate a modification of the content, an interaction with the content, or a combination thereof based, at least in part, on the one or more interactions, the one to more interaction events, or a combination thereof.

22. An apparatus of claim 18, wherein the apparatus is further caused to:

in response to the one or more interaction events between the user and the one or more virtual characters,

initiate a presentation of virtual navigation through the virtual world on the device, based on one or more navigation applications on the device.