Mobile client device, operation method, recording medium, and operation system

• US 9,268,424 B2
• Filed: 07/09/2013
• Issued: 02/23/2016
• Est. Priority Date: 07/18/2012
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Mobile Communications Incorporated (Sony Group Corp.)
• Inventors: Hatanaka, Yosuke
• Primary Examiner(s): Dharia, Prabodh M
• Application Number:
  US13/937,797
• Publication Number:
  US 20140022192A1
• Time in Patent Office: 959 Days
• Field of Search: 345/7, 345/8, 345156-184, 710/316, 715/733
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04166 Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving Synchronisation with the driving of the display or the backlighting unit to avoid interferences generated internally G06F3/04184
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G08C 17/02 using a radio link
• CPC Class Codes: G08C 2201/30 User interface
• CPC Class Codes: G08C 2201/93 Remote control using other portable devices, e.g. mobile phone, PDA, laptop
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42209 for displaying non-command information, e.g. electronic program guide [EPG], e-mail, messages or a second television channel
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72

Abstract

An information processing apparatus that detects an input operation to a touch panel based on an output of the touch panel; creates an operation command to change content displayed on a display apparatus based on a detected input operation to the touch panel; and controls a wireless interface to transmit the operation command to the display apparatus controlling the display apparatus to change the content displayed on the display apparatus.

Claims

1. An information processing apparatus comprising:

a touch panel; and

circuitry configured to

detect a drag input operation to the touch panel and a drag input direction corresponding to the drag input operation based on an output of the touch panel;

detect a distance of the drag input operation;

determine whether the distance of the drag input operation exceeds a threshold;

detect a speed of the drag input operation;

create an operation command to change content displayed on a display apparatus based on the detected drag input operation to the touch panel, the content including a two-dimensional array of icons, the operation command including a command to scroll at least some of the content in a direction corresponding to the drag input direction to move one of the icons to a predetermined location, the operation command being created when the distance of the drag input operation exceeds the threshold such that said at least some of the content continues to move after an end of the drag input operation for a time determined by the speed of the drag input operation; and

control a wireless interface to transmit the operation command to the display apparatus controlling the display apparatus to change the content displayed on the display apparatus by scrolling said at least some of the content in the direction corresponding to the drag input direction.

2. The information processing apparatus of claim 1, wherein

a plurality of detection areas for detecting an input operation are set in relation to the touch panel.

3. The information processing apparatus of claim 2, wherein

the circuitry is configured to create different operation commands based on which of the plurality of detection areas an input operation is detected.

4. The information processing apparatus of claim 3, wherein

the plurality of detection areas include a top area, a bottom area, a left area, a right area, and a center area.

5. The information processing apparatus of claim 2, wherein

the plurality of detection areas includes at least a first detection area and a second detection area, and

the circuitry is further configured to:

detect a tap input operation as an additional input operation to the touch panel;

create, as an additional operation command, a first command commanding the display apparatus to display a first menu when the tap input operation is detected in the first detection area, and a second command commanding the display to display a second menu when the tap input operation is detected in the second detection area; and

control the wireless interface to transmit the additional operation command to the display apparatus.

6. The information processing apparatus of claim 1, wherein the command to scroll is a command to scroll only a part of the content.

7. The information processing apparatus of claim 1, further comprising:

a display, wherein the touch panel is formed on or integrally with the display, wherein the circuitry is further configured to

control the display to display an icon corresponding to a remote control program executed by the circuitry;

create an activation command to activate the display apparatus when an input operation is detected on the touch panel in a position corresponding to the displayed icon; and

control the wireless interface to transmit the activation command to the display apparatus.

8. The information processing apparatus of claim 1, wherein the circuitry is further configured to:

detect a swipe input operation as an additional input operation to the touch panel and a direction corresponding to the swipe input operation;

create, as an additional operation command, a command commanding the display apparatus to sequentially change a channel of programming displayed by the display apparatus based the direction corresponding to the swipe input operation; and

control the wireless interface to transmit the additional operation command to the display apparatus.

9. The information processing apparatus of claim 1, wherein the circuitry is further configured to:

detect an upward swipe input operation as an additional input operation to the touch panel;

create, as an additional operation command, a command commanding the display apparatus to reduce a size of content being reproduced by the display apparatus and display a menu simultaneously with the reduced size content; and

control the wireless interface to transmit the additional operation command to the display apparatus.

10. The information processing apparatus of claim 9, wherein the circuitry is further configured to:

detect a horizontal swipe input operation as another additional input operation to the touch panel when the reduced size content and the menu are simultaneously displayed by the display apparatus;

create, as another additional operation command, a command commanding the display apparatus to scroll the menu in a direction corresponding to the direction of the horizontal swipe input operation; and

control the wireless interface to transmit the other additional operation command to the display apparatus.

11. The information processing apparatus of claim 1, wherein the circuitry is further configured to:

detect a tap input operation as an additional input operation to the touch panel;

create, as an additional operation command, a command commanding the display apparatus to display a menu for switching between content displayed by the display apparatus; and

control the wireless interface to transmit the additional operation command to the display apparatus.

12. The information processing apparatus of claim 11, wherein the circuitry is further configured to:

detect a swipe input operation as another additional input operation to the touch panel;

create, as another additional operation command, a command commanding the display apparatus to scroll the menu in a direction corresponding to the swipe input operation; and

control the wireless interface to transmit the other additional operation command to the display apparatus.

13. The information processing apparatus of claim 1, further comprising:

an image capturing unit configured to capture an image of the display apparatus.

14. The information processing apparatus of claim 13, wherein the circuitry is further configured to perform image recognition on the image of the display apparatus to determine a manufacturer of the display apparatus.

15. The information processing apparatus of claim 14, wherein the circuitry is configured to control the wireless interface to transmit the operation command to the display apparatus based on the determined manufacturer of the display apparatus.

16. The information processing apparatus of claim 14, wherein the circuitry is configured to determine a state of the display apparatus by controlling the wireless interface to transmit the captured image of the display apparatus and information corresponding to the manufacturer of the display apparatus to a database, and receiving, from the database via the wireless interface, a state of the display apparatus.

17. The information processing apparatus of claim 1, wherein the circuitry is further configured to determine a state of the display apparatus.

18. A method performed by an information processing apparatus, the method comprising:

detecting a drag input operation to a touch panel and a drag input direction corresponding to the drag input operation based on an output of the touch panel;

detect a distance of the drag input operation;

determine whether the distance of the drag input operation exceeds a threshold;

detect a speed of the drag input operation;

creating an operation command to change content displayed on a display apparatus based on the detected drag input operation to the touch panel, the content including a two-dimensional array of icons, the operation command including a command to scroll at least some of the content in a direction corresponding to the drag input direction to move one of the icons to a predetermined location, the operation command being created when the distance of the drag input operation exceeds the threshold such that said at least some of the content continues to move after an end of the drag input operation for a time determined by the speed of the drag input operation; and

control a wireless interface to transmit the operation command to the display apparatus controlling the display apparatus to change the content displayed on the display apparatus.

19. A non-transitory computer-readable medium including computer program instructions, which when executed by an information processing apparatus, cause the information processing apparatus to:

detect a drag input operation to a touch panel and a drag input direction corresponding to the drag input operation based on an output of the touch panel;

detect a distance of the drag input operation;

determine whether the distance of the drag input operation exceeds a threshold;

detect a speed of the drag input operation;

create an operation command to change content displayed on a display apparatus based on the detected drag input operation to the touch panel, the content including a two-dimensional array of icons, the operation command including a command to scroll at least some of the content in a direction corresponding to the drag input direction to move one of the icons to a predetermined location, the operation command being created when the distance of the drag input operation exceeds the threshold such that said at least some of the content continues to move after an end of the drag input operation for a time determined by the speed of the drag input operation; and

control a wireless interface to transmit the operation command to the display apparatus controlling the display apparatus to change the content displayed on the display apparatus.