Systems and methods for interacting with mobile devices using external displays

• US 8,866,699 B2
• Filed: 12/02/2008
• Issued: 10/21/2014
• Est. Priority Date: 12/02/2008
• Status: Expired due to Fees

• Current Assignee: Fujifilm Business Innovation Corp. (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Inventors: Roth, Volker, Denoue, Laurent, Liu, Qiong, Carter, Scott
• Primary Examiner(s): MARINELLI, PATRICK
• Application Number:
  US12/326,767
• Publication Number:
  US 20100134385A1
• Time in Patent Office: 2,149 Days
• Field of Search: 345156-184, 345 11- 16, 345/104
• US Class Current: 345/1.2
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2340/145 related to small screens
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information

Abstract

A system and method for interacting with a mobile device using an external display is disclosed, where a mobile device provides representations of an object and action to an external display for a user to select and then input back to the mobile device. An application on a mobile device provides representation data of an object and an action to a host system driving an external display. The host system arranges the representation data into a representation on the external display and allows the user to interact with the representations. The user then selects a representation and inputs the selected representation into the mobile device, where the application processes the representation to carry out the appropriate actions on the appropriate objects. The representation may be inputted to the mobile device using a photo of the representation taken by a mobile device camera, or by inputting a code provided with each representation on the external display.

Claims

1. A method for interacting with a mobile device using an external display, the method comprising:

sending representation data from a mobile device to a host system;

sending a code corresponding to each representation of the representation data to the host system;

arranging a plurality of representations from the representation data at the host system;

rendering the plurality of representations of the arranged representation data on an external display;

selecting at least one representation of the plurality of representations from a combination of an object and an action from a set of actions to be performed on the object on the mobile device;

inputting the selected at least one representation and the code to the mobile device;

mapping the inputted at least one representation to the combination of the object and the action; and

performing the action upon the object at the mobile device in response to the inputting,

wherein the code is displayed with each of the plurality of representations on the external display, and

wherein the code corresponding to each of the plurality of representations encodes a respective object and a respective action to be performed on the respective object on the mobile device.

2. The method of claim 1, further comprising selecting a mobile device from a group consisting of a mobile phone, personal digital assistant (“

PDA”

), or laptop.

3. The method of claim 2, further comprising selecting a touch-screen external display that is larger than a display on the mobile device.

4. The method of claim 3, further comprising selecting a shared, public display as the external display.

5. The method of claim 1, further comprising permitting the user to re-arrange the at least one representation on the external display.

6. The method of claim 1, further comprising inputting a picture of the selected representation to the mobile device.

7. The method of claim 6, wherein inputting the picture of the selected representation to the mobile device comprises capturing the picture of the selected representation with a camera of the mobile device.

8. The method of claim 1, further comprising inputting a picture of the code of the selected representation to the mobile device.

9. A system for interacting with a mobile device using an external display, comprising:

a mobile device for creating representation data for displaying a plurality of representations on an external display;

a host system for receiving the representation data from the mobile device and arranging the representation data for rendering the plurality of representations on the external display;

an input module for inputting at least one representation of the plurality of representations to the mobile device as selected by a user; and

an application on the mobile device for creating the representation data from a combination of an object and an action from a set of actions to be performed on the object on the mobile device;

wherein the application on the mobile device performs the action upon the object in response to the inputting,

wherein the mobile device further creates a code corresponding to each at least one representation,

wherein the code is displayed with each of the plurality of representations on the external display,

wherein the code corresponding to each of the plurality of representations encodes a respective object and a respective action to be performed on the respective object on the mobile device,

wherein the at least one representation is mapped to the combination of the object and the action, and

wherein the code of the at least one representation selected by the user is inputted to the mobile device.

10. The system of claim 9, wherein the mobile device is selected from a group consisting of a mobile phone, personal digital assistant (“

PDA”

), or laptop.

11. The system of claim 10, wherein the external display is a touch-screen display that is larger than a display on the mobile device.

12. The system of claim 11, wherein the external display is a public, shared display.

13. The system of claim 9, wherein the user can re-arrange the at least one representation on the external display.

14. The system of claim 9, wherein the at least one representation being inputted to the mobile device is a picture of the selected at least one representation.

15. The method of claim 14, wherein the mobile device comprises a camera and wherein inputting the picture of the selected at least one representation is conducted by capturing a snapshot of the picture with the camera.

16. The system of claim 9, wherein a picture of the code is inputted to the mobile device.

17. A non-transitory computer-readable medium embodying a set of instructions, the set of instructions, when executed by one or more processors, causing the one or more processors to perform a method for interacting with a mobile device using an external display, the method comprising:

sending representation data from a mobile device to a host system;

sending a code corresponding to each representation of the representation data to the host system;

arranging the representation data into a plurality of representations at the host system;

rendering the arranged plurality of representations on an external display;

selecting at least one representation of the plurality of representations from a combination of an object and an action from a set of actions to be performed on the object on the mobile device;

inputting the selected at least one representation and the code to the mobile device;

mapping the inputted at least one representation to the combination of the object and the action; and

performing the action upon the object at the mobile device in response to the inputting,

wherein the code is displayed with each of the plurality of representations on the external display, and

wherein the code corresponding to each of the plurality of representations encodes a respective object and a respective action to be performed on the respective object on the mobile device.