DISPLAY CONTROL APPARATUS, DISPLAY CONTROL METHOD, AND PROGRAM

• US 20140223323A1
• Filed: 10/04/2012
• Published: 08/07/2014
• Est. Priority Date: 11/16/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Kasahara, Shunichi
• Granted Patent: US 9,880,713 B2
• Time in Patent Office: Days
• US Class Current: 715/740
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2370/06 Consumer Electronics Control, i.e. control of another device by a display or vice versa
• CPC Class Codes: G09G 2380/14 Electronic books and readers

Abstract

An information processing system that acquires captured image data corresponding to a user interface displayed on a first display, the user interface including a plurality of graphic representations each corresponding to a respective function; and controls a second display to display a representation of the user interface based on a recognition process performed on the user interface, the representation of the user interface indicating whether a function corresponding the plurality of the graphic representations is capable of being accessed.

Claims

1. An information processing system, comprising:

one or more processing units that

acquire captured image data corresponding to a user interface displayed on a first display, the user interface including a plurality of graphic representations each corresponding to a respective function; and

control a second display to display a representation of the user interface based on a recognition process performed on the user interface, the representation of the user interface indicating whether a function corresponding the plurality of the graphic representations is capable of being accessed.

2. The information processing system of claim 1, further comprising:

an image capturing unit that captures the image data corresponding to the user interface displayed on the first display.

3. The information processing system of claim 1, wherein

the one or more processing units acquire at least one of configuration information and authority information corresponding to the user interface displayed on the first display.

4. The information processing system of claim 3, wherein

the configuration information indicates a position at which each of the plurality of graphic representations are displayed on the first display.

5. The information processing system of claim 3, wherein

the one or more processing units generate the representation of the user interface based on the acquired configuration information.

6. The information processing system of claim 1, wherein

the one or more processing units control the second display to display the representation of the user interface such that a predetermined visual effect is applied to at least one of the plurality of graphic representations corresponding to a function that is not capable of being accessed.

7. The information processing system of claim 1, wherein

the one or more processing units control the second display to display the representation of the user interface such that at least one of the plurality of graphic representations corresponding to a function that is not capable of being accessed is omitted.

8. The information processing system of claim 1, wherein

the one or more processing units control the second display to display the representation of the user interface such that an image is superimposed on at least one of the plurality of graphic representations corresponding to a function that is not capable of being accessed is omitted.

9. The information processing system of claim 1, further comprising:

a user interface that receives a selection of one of the plurality of graphic representations displayed in the representation of user interface displayed on the second display.

10. The information processing system of claim 9, further comprising:

a communication interface, wherein the one or more processing units control the communication interface to transmit information corresponding to the selection of the one of the plurality of graphic representations displayed in the representation of user interface displayed on the second display to an information processing apparatus including the first display.

11. The information processing system of claim 9, further comprising:

a communication interface, wherein the one or more processing units control the communication interface to transmit command identification information corresponding to the selection of the one of the plurality of graphic representations displayed in the representation of user interface displayed on the second display to an information processing apparatus including the first display.

12. The information processing system of claim 9, wherein

one of the plurality of graphic representations corresponds to an photo browsing application.

13. The information processing system of claim 12, further comprising:

a user interface that receives a selection of the graphic representation corresponding to the photo browsing application displayed in the representation of user interface displayed on the second display; and

a communication interface, wherein the one or more processing units control the communication interface to transmit information corresponding to the selection of the graphic representation corresponding to the photo browsing application to an information processing apparatus including the first display, wherein

the information processing apparatus executes the photo browsing application in response to receiving the information corresponding to the selection of the graphic representation.

14. The information processing system of claim 1, wherein

the information processing system is a first information processing apparatus and the plurality of graphic representations each corresponding to a respective function implemented at a second information processing apparatus.

15. The information processing system of claim 1, wherein

the captured image data corresponding to a user interface displayed on a first display is still image data.

16. The information processing system of claim 1, further comprising:

a user interface that receives authentication information corresponding to a function that is not capable of being accessed.

17. The information processing system of claim 16, wherein

the one or more processing units controls the display to change the representation of the user interface to indicate that a function is capable of being accessed based on the received authentication information.

18. The information processing apparatus of claim 16, wherein

the user interface displays a screen to input the authentication information when an graphic representation corresponding to a function that is not capable of being accessed is selected at the second display.

19. An information processing method performed by an information processing system, the method comprising:

acquiring captured image data corresponding to a user interface displayed on a first display, the user interface including a plurality of graphic representations each corresponding to a respective function; and

controlling a second display to display a representation of the user interface based on a recognition process performed on the user interface, the representation of the user interface indicating whether a function corresponding the plurality of the graphic representations is capable of being accessed.

20. A non-transitory computer-readable medium including computer program instructions, which when executed by an information processing system, cause the information processing system to perform a process, the process comprising:

acquiring captured image data corresponding to a user interface displayed on a first display, the user interface including a plurality of graphic representations each corresponding to a respective function; and

controlling a second display to display a representation of the user interface based on a recognition process performed on the user interface, the representation of the user interface indicating whether a function corresponding the plurality of the graphic representations is capable of being accessed.