Terminal apparatus and associated methodology for automated scroll based on moving speed

• US 9,632,642 B2
• Filed: 07/23/2015
• Issued: 04/25/2017
• Est. Priority Date: 05/25/2012
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Mobile Communications Incorporated (Sony Group Corp.)
• Inventors: Tokutake, Kenji
• Primary Examiner(s): Sternbane, Larry
• Assistant Examiner(s): Ritchie, Darlene M
• Application Number:
  US14/807,221
• Publication Number:
  US 20150324039A1
• Time in Patent Office: 642 Days
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence

Abstract

To improve ease of operation in a case where a display device and a small terminal apparatus are connected to each other, and coordinated display is performed. When a contact or approach of an object having a size greater than or equal to a threshold value with or toward the surface of a display panel is detected, a video or an instruction corresponding to the motion detected by the motion sensor is output. The display device, on the basis of the video or the instruction that is output, displays a video in which the position of a pointer or the like is changed in response to the motion detected by a motion sensor.

Claims

1. A terminal apparatus comprising:

a display panel arranged on a housing of the terminal apparatus; and

circuitry configured to

process an image displayed on the display panel,

output, to an external device, at least one of the processed image by the circuitry or an instruction regarding the processed image using wireless communication,

detect a motion of the housing, and

output, to the external device, an updated instruction corresponding to the motion detected by the circuitry, the updated instruction including an instruction to display an electronic mail (e-mail) application,

wherein the circuitry causes a scrolling operation instruction of the processed image on the external device or a moving operation instruction of a pointer position on the external device based on whether or not a movement speed of the housing is smaller than or equal to a threshold value,

wherein the circuitry is further configured to adjust a relationship between a movement amount of the housing and a movement amount of the pointer position during the moving operation through an operation of one or more keys on the housing of the display panel, and

wherein at least a portion of the display of the external device is switched from the image application to the e-mail application.

2. The terminal apparatus of claim 1, wherein

the circuitry responds to an inclination movement of the housing by performing a tap operation that selects a specific location on the display panel.

3. The terminal apparatus of claim 1, wherein

the circuitry responds to an up-and-down or a side-to-side movement of the housing by performing a scrolling operation on the display panel.

4. The terminal apparatus of claim 1, wherein the circuitry is further configured to perform one or more character input selection operations, on the external device, based on the detected motion of the housing.

5. The terminal apparatus of claim 1, wherein the updated instruction includes an instruction to erase the processed image and update the processed image with the e-mail application, the e-mail application including an e-mail creation message.

6. The terminal apparatus of claim 1, wherein the circuitry further includes a touch panel configured to detect a contact or approach of an object with or toward a surface of the display panel.

7. The terminal apparatus of claim 6, wherein the circuitry is further configured to output the processed image or the instruction corresponding to the motion detected by the circuitry when the touch panel detects the contact or approach of the object having a greater size than or equal to a predetermined size.

8. The terminal apparatus of claim 6, wherein the circuitry deactivates detecting further contact or approach of the object when the circuitry detects the contact or approach of the object of greater than or equal to a predetermined size.

9. The terminal apparatus of claim 6, wherein the circuitry detects the motion of the housing when the circuitry detects the contact or approach of the object of greater than or equal to a predetermined size.

10. The terminal apparatus of claim 9, wherein the circuitry identifies a movement of the housing that is not a swinging movement as corresponding to a tap operation that selects a specific location on the display panel.

11. The terminal apparatus of claim 10, wherein the circuitry causes the pointer position to move by an amount that corresponds to a movement amount of the housing.

12. The terminal apparatus of claim 11, wherein

after the pointer position has been moved, the circuitry determines that an operation other than movement of the pointer is performed in response to the housing being moved faster than the threshold value.

13. The terminal apparatus of claim 1, further comprising:

a plurality of keys, wherein

when the circuitry determines that a user'"'"'s palm is placed on the touch-panel, actuation of the plurality of keys is recognized as a pointing device.

14. The terminal apparatus of claim 13, wherein

the circuitry recognizes actuation of a predetermined key as a left-click operation.

15. The terminal apparatus of claim 13, wherein

the circuitry recognizes actuation of a predetermined key as a right-click operation.

16. The terminal apparatus of claim 13, wherein

the circuitry recognizes actuation of a predetermined key as a scroll operation.

17. A display method comprising:

displaying an image on a display panel arranged on a housing of a terminal apparatus;

processing, with circuitry, the image displayed on the display panel;

outputting, to an external device, the processed image by the circuitry or an instruction regarding the processed image;

detecting a motion of the housing;

outputting, to the external device, an updated instruction corresponding to the motion detected by the circuitry, the updated instruction including an instruction to display an electronic mail (e-mail) application;

causing, with the circuitry, a scrolling operation instruction of the processed image on the external device or a moving operation instruction of a pointer position on the external device based on whether or not a movement speed of the housing is smaller than or equal to a threshold value;

adjusting, with the circuitry, a relationship between a movement amount of the housing and a movement amount of the pointer position during the moving operation through an operation of one or more keys on the housing of the display panel; and

switching at least a portion of the display of the external device from the image application to the e-mail application.

18. The method of claim 17, further comprising:

deactivating a touch panel from further detecting when the detecting includes detecting a contact or approach of an object with or toward a surface of the display panel of greater than or equal to a predetermined size.

19. The method of claim 17, wherein

the motion of a housing is detected when a contact or approach of an object of greater than or equal to a predetermined size is detected.

20. A non-transitory computer readable storage device having computer readable instructions that when executed by processing circuitry cause the processing circuitry to perform a display method comprising:

displaying an image on a display panel arranged on a housing of a terminal apparatus;

processing the image displayed on the display panel;

outputting, to an external device, the processed image or an instruction regarding the processed image;

detecting a motion of the housing;

outputting, to the external device, an updated instruction corresponding to the motion detected, the updated instruction including an instruction to display an electronic mail (e-mail) application;

causing a scrolling operation instruction of an image on the external device or a moving operation instruction of a pointer position on the external device based on whether or not a movement speed of the housing is smaller than or equal to a threshold value;

adjusting a relationship between a movement amount of the housing and a movement amount of the pointer position during the moving operation through an operation of one or more keys on the housing of the display panel; and

switching at least a portion of the display of the external device from the image application to the e-mail application.