Mobile client device, operation method, recording medium, and operation system

• US 9,542,096 B2
• Filed: 01/14/2016
• Issued: 01/10/2017
• Est. Priority Date: 07/18/2012
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Mobile Communications Incorporated (Sony Group Corp.)
• Inventors: Hatanaka, Yosuke
• Primary Examiner(s): Dharia, Prabodh M
• Application Number:
  US14/995,971
• Publication Number:
  US 20160139800A1
• Time in Patent Office: 362 Days
• Field of Search: 345/7, 345/8, 345156-184, 710/316, 715/733
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/30 User interface
• CPC Class Codes: G08C 2201/93 Remote control using other portable devices, e.g. mobile phone, PDA, laptop
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42209 for displaying non-command information, e.g. electronic program guide [EPG], e-mail, messages or a second television channel
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72

Abstract

An information processing apparatus that detects an input operation to a touch panel based on an output of the touch panel; creates an operation command to change content displayed on a display apparatus based on a detected input operation to the touch panel; and controls a wireless interface to transmit the operation command to the display apparatus controlling the display apparatus to change the content displayed on the display apparatus.

Claims

1. An information processing apparatus comprising:

a touch panel; and

circuitry configured to

detect a swipe input operation to the touch panel;

create operation information to cause a display apparatus to change content displayed on the display apparatus based on the detected swipe input operation to the touch panel, the content including a two-dimensional array of graphical representations, the operation information including information to cause the display apparatus to scroll at least some of the content in a direction corresponding to a swipe input direction such that said at least some of the content continues to move after an end of the swipe input operation for a time determined by a speed of the swipe input operation; and

control a wireless interface to transmit the operation information to the display apparatus to cause the display apparatus to change the content displayed on the display apparatus by scrolling said at least some of the content in the direction corresponding to the swipe input direction.

2. The information processing apparatus of claim 1, wherein

the circuitry is configured to divide the touch panel into a plurality of detection areas for detecting the swipe input operation.

3. The information processing apparatus of claim 2, wherein

the circuitry is configured to create different operation information based on at least one of the plurality of detection areas in which the swipe input operation is detected.

4. The information processing apparatus of claim 3, wherein

the plurality of detection areas include a top area, a bottom area, a left area, a right area, and a center area.

5. The information processing apparatus of claim 2, wherein

the plurality of detection areas includes at least a first detection area and a second detection area, and

the circuitry is further configured to:

detect a tap input operation as an additional input operation to the touch panel;

create, as additional operation information, first information to cause the display apparatus to display a first menu when the tap input operation is detected in the first detection area, and second information to cause the display to display a second menu when the tap input operation is detected in the second detection area; and

control the wireless interface to transmit the additional operation information to the display apparatus.

6. The information processing apparatus of claim 1, wherein the scrolling is a scrolling of only a part of the content.

7. The information processing apparatus of claim 1, further comprising:

a display, wherein the touch panel is formed on or integrally with the display, wherein the circuitry is further configured to

control the display to display a graphical representation corresponding to a remote control program executed by the circuitry;

create activation information to cause the display apparatus to activate when an input operation is detected on the touch panel in a position corresponding to the displayed graphical representation; and

control the wireless interface to transmit the activation information to the display apparatus.

8. The information processing apparatus of claim 1, wherein the circuitry is further configured to:

detect an additional swipe input operation as an additional input operation to the touch panel and a direction corresponding to the additional swipe input operation;

create, as additional operation information, information to cause the display apparatus to sequentially change a channel of programming displayed by the display apparatus based on the direction corresponding to the additional swipe input operation; and

control the wireless interface to transmit the additional operation information to the display apparatus.

9. The information processing apparatus of claim 1, wherein the circuitry is further configured to:

detect an upward swipe input operation as an additional input operation to the touch panel;

create, as additional operation information, information to cause the display apparatus to reduce a size of content being reproduced by the display apparatus and display a menu simultaneously with the reduced size content; and

control the wireless interface to transmit the additional operation information to the display apparatus.

10. The information processing apparatus of claim 9, wherein the circuitry is further configured to:

detect a horizontal swipe input operation as another additional input operation to the touch panel when the reduced size content and the menu are simultaneously displayed by the display apparatus;

create, as other additional operation information, information to cause the display apparatus to scroll the menu in a direction corresponding to the direction of the horizontal swipe input operation; and

control the wireless interface to transmit the other additional operation information to the display apparatus.

11. The information processing apparatus of claim 1, wherein the circuitry is further configured to:

detect a tap input operation as an additional input operation to the touch panel;

create, as additional operation information, information to cause the display apparatus to display a menu for switching between content displayed by the display apparatus; and

control the wireless interface to transmit the additional operation information to the display apparatus.

12. The information processing apparatus of claim 11, wherein the circuitry is further configured to:

detect an additional swipe input operation as another additional input operation to the touch panel;

create, as other additional operation information, information to cause the display apparatus to scroll the menu in a direction corresponding to the additional swipe input operation; and

control the wireless interface to transmit the other additional operation information to the display apparatus.

13. The information processing apparatus of claim 1, further comprising:

an image capturing unit configured to capture an image of the display apparatus.

14. The information processing apparatus of claim 13, wherein the circuitry is further configured to perform image recognition on the image of the display apparatus to determine a manufacturer of the display apparatus.

15. The information processing apparatus of claim 14, wherein the circuitry is configured to control the wireless interface to transmit the operation information to the display apparatus based on the determined manufacturer of the display apparatus.

16. The information processing apparatus of claim 1, wherein the circuitry is further configured to determine a state of the display apparatus.

17. The information processing apparatus of claim 14, wherein the circuitry is configured to determine a state of the display apparatus by controlling the wireless interface to transmit the captured image of the display apparatus and information corresponding to the manufacturer of the display apparatus to a database, and receiving, from the database via the wireless interface, the state of the display apparatus.

18. A method performed by an information processing apparatus, the method comprising:

detecting a swipe input operation to a touch panel;

creating operation information to cause a display apparatus to change content displayed on the display apparatus based on the detected swipe input operation to the touch panel, the content including a two-dimensional array of graphical representations, the operation information including information to cause the display apparatus to scroll at least some of the content in a direction corresponding to a swipe input direction such that said at least some of the content continues to move after an end of the swipe input operation for a time determined by a speed of the swipe input operation; and

controlling a wireless interface to transmit the operation information to the display apparatus to cause the display apparatus to change the content displayed on the display apparatus.

19. A non-transitory computer-readable medium including computer program instructions, which when executed by an information processing apparatus, cause the information processing apparatus to:

detect a swipe input operation to a touch panel;

create operation information to cause a display apparatus to change content displayed on the display apparatus based on the detected swipe input operation to the touch panel, the content including a two-dimensional array of graphical representations, the operation information including information to cause the display apparatus to scroll at least some of the content in a direction corresponding to a swipe input direction such that said at least some of the content continues to move after an end of the swipe input operation for a time determined by a speed of the swipe input operation; and

control a wireless interface to transmit the operation information to the display apparatus to cause the display apparatus to change the content displayed on the display apparatus by scrolling said at least some of the content in the direction corresponding to the swipe input direction.