Apparatus and control method based on motion

• US 9,880,613 B2
• Filed: 12/01/2015
• Issued: 01/30/2018
• Est. Priority Date: 12/19/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Mobile Communications Incorporated (Sony Group Corp.)
• Inventors: Aizawa, Takahiro
• Primary Examiner(s): Johnson, Gerald
• Application Number:
  US14/955,100
• Publication Number:
  US 20160077580A1
• Time in Patent Office: 791 Days
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 3/20 Linear translation of whole images or parts thereof, e.g. panning
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting

Abstract

A device includes a display panel configured to display an interface. The device includes a motion sensor configured to detect a motion of the device and to output a detection signal in response to the detection of the motion. The device includes circuitry configured to control, based on the detection signal, the display panel such that at least one of a display position and a display size of an element displayed in the interface changes, wherein when the motion includes a physical shock on the device, the detection signal includes an indication of a hitting position corresponding to a position on the device where the physical shock is detected by the motion sensor, and the circuitry controls the display panel such that the at least one of the display position and the display size of the element changes based on the hitting position.

Claims

1. A device comprising:

a motion sensor configured to detect a motion of the device and to output a detection signal corresponding to the detected motion; and

circuitry configured to

identify information regarding a change in both strength and direction of the detected motion based on the detection signal, and

control, in response to the detected motion, a display panel such that display of an interface element on the display panel is changed based on the identified information regarding the change in both the strength and the direction of the detected motion.

2. The device according to claim 1, wherein the motion sensor is configured to

measure a magnitude and a direction of a first detected acceleration within the detected motion;

measure a magnitude and a direction of a second detected acceleration within the detected motion; and

include the measured magnitude and direction of the first detected acceleration and the measured magnitude and direction of the second detected acceleration in the detection signal.

3. The device according to claim 2, wherein the circuitry is configured to

determine an acceleration pattern of the detected motion based on the measured magnitude and direction of the first detected acceleration and the measured magnitude and direction of the second detected acceleration;

and

change the display of the interface element based on the determined acceleration pattern of the detected motion.

4. The device according to claim 1, wherein

the motion sensor is configured to measure a magnitude of an acceleration within the detected motion and to include the measured magnitude of the acceleration in the detection signal;

and

the circuitry is configured to change a display position or a display size of the interface element based on the measured magnitude of the acceleration.

5. The device according to claim 4, wherein the circuitry is configured to change the display position or the display size of the interface element when the measured magnitude of the acceleration exceeds a predetermined threshold.

6. The device according to claim 1, wherein the circuitry is configured to change the display of the interface element to a default display of the interface element after a predetermined time elapses since the change in the display of the interface element in response to the detected motion of the device.

7. The device according to claim 1, wherein the circuitry is configured to change a display size of the interface element based on a detected touch position detected by a touch sensor of the display panel.

8. The device according to claim 1, wherein the circuitry is configured to

determine whether the detected motion corresponds to a physical shock on the device;

determine a hitting position corresponding to a position on the device where the physical shock is applied in response to a determination result that the detected motion corresponds to the physical shock on the device; and

change a display position or a display size of the interface element based on the determined hitting position in response to the determination result that the detected motion corresponds to the physical shock on the device.

9. The device according to claim 8, further comprising

a memory configured to store a maximum reach distance corresponding to a furthest point on the display panel reachable by a user'"'"'s hand when the hand is holding the device, wherein

the circuitry is configured to change the display position or the display size of the interface element such that at least a portion of the interface element is displayed within the maximum reach distance from the hitting position.

10. The device according to claim 8, wherein the circuitry is configured to change the display position or the display size of the interface element such that a moving distance of the interface element is determined based on a magnitude of the physical shock.

11. The device according to claim 1, wherein the circuitry is configured to

determine whether the detected motion corresponds to one or more physical shocks on the device;

determine a number of the one or more physical shocks on the device; and

change a display position or a display size of the interface element based on the determined number of the one or more physical shocks on the device in response to the determination result that the detected motion corresponds to the one or more physical shocks on the device.

12. The device according to claim 11, wherein the circuitry is configured to change the display position or the display size of the interface element such that a moving distance of the interface element is determined based on the determined number of the one or more physical shocks on the device.

13. The device according to claim 11, wherein the circuitry is configured to change the display size of the interface element such that a reduction ratio of the display size of the interface element is determined based on the determined number of the one or more physical shocks on the device.

14. The device according to claim 1, wherein

the circuitry is configured to restore the display of the interface element to an original condition in response to a touch operation performed on a surface of the display panel subsequent to the change in the display of the interface element in response to the detected motion;

and

the original condition corresponds to the display of the interface element prior to the change in the display of the interface element in response to the detected motion.

15. The device according to claim 1, wherein

the interface element is a window of a plurality of windows displayed on the display panel;

and

the circuitry is configured to alter, based on the detection signal, an arrangement of the window with respect to the plurality of windows.

16. The device according to claim 1, wherein

the circuitry is configured to further change the display of the interface element when the motion sensor detects a second motion following a change in the display of the interface element in response to the detected motion.

17. The device according to claim 16, wherein

the circuitry is configured to restore the display of the interface element to an original condition in response to the second detected motion;

and

the original condition corresponds to the display of the interface element prior to the change in the display of the interface element in response to the detected motion.

18. A method of controlling a display panel configured to display an interface element, the method comprising:

detecting, by a motion sensor of a device, a motion of the device;

generating, by the motion sensor, a detection signal corresponding to the detected motion;

identifying, by circuitry of the device, information regarding a change in both strength and direction of the detected motion based on the detection signal; and

controlling, by the circuitry of the device in response to the detected motion, the display panel such that display of the interface element on the display panel is changed based on the identified information regarding the change in both the strength and the direction of the detected motion.

19. A non-transitory computer readable medium having instructions stored therein that when executed by one or more processors cause a device including a motion sensor to perform a method comprising:

detecting, by the motion sensor of the device, a motion of the device;

generating, by the motion sensor, a detection signal corresponding to the detected motion;

identifying information regarding a change in both strength and direction of the detected motion based on the detection signal; and

controlling, in response to the detected motion, a display panel such that display of an interface element on the display panel is changed based on the identified information regarding the change in both the strength and the direction of the detected motion.

20. A communication apparatus comprising:

a touch panel display;

a communication circuit configured to perform wireless communication with another communication apparatus;

a motion sensor configured to detect a motion of the device and to output a detection signal corresponding to the detected motion; and

circuitry configured to

identify information regarding a change in both strength and direction of the detected motion based on the detection signal, and

execute a control regarding display of the touch panel display based on the identified information regarding the change in both the strength and the direction of the detected motion.