METHOD, APPARATUS AND COMPUTER PROGRAM PRODUCT FOR JOINING THE DISPLAYS OF MULTIPLE DEVICES

• US 20110252317A1
• Filed: 04/08/2010
• Published: 10/13/2011
• Est. Priority Date: 04/08/2010
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Lucero, Andres, Korhonen, Hannu, Keränen, Jaakko
• Granted Patent: US 9,213,480 B2
• Time in Patent Office: Days
• US Class Current: 715/702
• CPC Class Codes: G06F 1/1698 the I/O peripheral being a sending/receiving arrangement to establish a cordless communication link, e.g. radio or infrared link, integrated cellular phone details of antennas disposed inside a computer H01Q1/2266
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/1446 display composed of modules, e.g. video walls
• CPC Class Codes: G09G 2356/00 Detection of the display position w.r.t. other display screens
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications
• CPC Class Codes: H04M 2250/10 including a GPS signal receiver
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041

Abstract

A method is provided for enhancing a user interface with a mobile device by joining the displays of multiple devices together to function together with one another. In particular, example methods may provide for detecting a first touch or drag event, receiving a message indicating a second touch or drag event from a nearby device occurring during the first touch or drag event, creating a join event, and providing for transmission of the join event to the nearby device. The method may also include updating a registry of nearby devices in response to receiving a message regarding a touch or drag event from a nearby device. The method may further include providing for presentation of content on a display of a device and direction of content to be presented on a display of the nearby device, wherein the content to be presented on the display of the nearby device is related to the content on the display of the device.

Claims

1. A method comprising:

detecting a first touch or a drag event;

receiving a message indicating a second touch or drag event from a nearby device occurring during the first touch or drag event;

creating a join event; and

providing for transmission of the join event to the nearby device.

2. A method according to claim 1, further comprising receiving a message indicating the end of the second touch or drag event from the nearby device.

3. A method according to claim 1, further comprising updating a registry of nearby devices in response to receiving a message regarding a touch or drag event from a nearby device.

4. A method according to claim 1, wherein the join event includes join event rules and wherein the join event rules include data regarding content to be displayed on the nearby device.

5. A method according to claim 1, wherein detecting the first touch or drag event comprises determining a drag event direction.

6. The method according to claim 1, further comprising:

providing for presentation of content on a display of a device; and

providing for direction of content to be presented on a display of the nearby device, wherein the content to be presented on the display of the nearby device is related to the content presented on the display of the device.

7. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform:

detect a first touch or drag event;

receive a message indicating a second touch or drag event from a nearby device occurring during the first touch or drag event;

create a join event; and

provide for transmission of the join event to the nearby device.

8. An apparatus according to claim 7, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to receive a message indicating the end of the second touch or drag event from the nearby device.

9. An apparatus according to claim 7, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to update a registry of nearby devices in response to receiving a message regarding a touch or drag event from a nearby device.

10. An apparatus according to claim 7, wherein the join event includes join event rules and wherein the join event rules include data regarding content to be displayed on the nearby device.

11. An apparatus according to claim 7, wherein detecting the first touch or drag event comprises determining a drag event direction.

12. An apparatus according to claim 7, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to provide for presentation of content on a display of a device and provide for direction of content to be presented on a display of the nearby device, wherein the content to be presented on the display of the nearby device is related to the content presented on the display of the device.

13. An apparatus according to claim 7, wherein detecting the first touch or drag event comprises detecting the direction of a touch moving from a first position to a second position on a touch-sensitive display.

14. A computer program product comprising at least one computer-readable storage medium having computer-executable program code instructions stored therein, the computer-executable program code instructions comprising:

program code instructions for detecting a first touch or a drag event;

program code instructions for receiving a message indicating a second touch or drag event from a nearby device occurring during the first touch or drag event;

program code instructions for creating a join event; and

program code instructions for providing for transmission of the join event to the nearby device.

15. A computer program product according to claim 14, further comprising program code instructions for receiving a message indicating the end of the second touch or drag event from the nearby device.

16. A computer program product according to claim 14, further comprising program code instructions for updating a registry of nearby devices in response to receiving a message regarding a touch or drag event from a nearby device.

17. A computer program product according to claim 14, wherein the join event includes join event rules and wherein the join event rules include data regarding content to be displayed on the nearby device.

18. A computer program product according to claim 14, wherein the program code instructions for detecting a touch or drag event comprises program code instructions for determining a drag event direction.

19. A computer program product according to claim 14, further comprising program code instructions for providing for presentation of content on a display of a device and program code instructions for directing of content to be presented on a display of the nearby device, wherein the content to be presented on the display of the nearby device is related to the content presented on the display of the device.

20. A computer program product according to claim 14, wherein program code instructions for detecting the first touch or drag event includes program code instructions for detecting the direction of a touch moving from a first position to a second position on a touch-sensitive display.