Information processing apparatus, information processing method, and program

• US 10,416,785 B2
• Filed: 09/02/2016
• Issued: 09/17/2019
• Est. Priority Date: 07/21/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Miyazaki, Reiko, Okumura, Yasushi
• Primary Examiner(s): Hicks, Charles V
• Application Number:
  US15/255,458
• Publication Number:
  US 20160370884A1
• Time in Patent Office: 1,110 Days
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04M 1/72415 for remote control of appliances
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42222 : Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/42224 : Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/43615 : Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805

Abstract

An information processing apparatus that controls a display to display first layer data, detects movement of the information processing apparatus, and controls the display to display second layer data corresponding to the first layer data together with the first layer data based on a movement detected by the detection unit.

Claims

1. An information processing apparatus, comprising:

circuitry configured to

control display of first data and other data on a display;

detect a touch operation on the display at a location within an image representation of the first data;

detect a tilt movement of the information processing apparatus;

select the first data based on the touch operation and the tilt movement of the information processing apparatus; and

control removal of all displayed data, including the other data, on the display that is located outside of the image representation of the first data from the display based on the touch operation and the tilt movement.

2. The information processing apparatus of claim 1, wherein the circuitry is further configured to detect swing and rotation movements of the information processing apparatus and angles of respective movements from a predetermined reference point.

3. The information processing apparatus of claim 1, further comprising:

the display;

a touch sensor on the display, the touch sensor detecting the touch operation, wherein

the circuitry is further configured to transmit the first data to one of a plurality of devices based on a movement of the information processing apparatus in a first and a second direction detected by the circuitry; and

the one of the plurality of devices reproduces the first data.

4. The information processing apparatus of claim 3, wherein

the circuitry controls the display to display second data upon receiving an input selecting the first data at the touch panel, and

the second data corresponds to a process to be performed on the first data.

5. The information processing apparatus of claim 4, wherein the circuitry controls the display to display the second data upon receiving the input selecting the first data at the touch panel, the second data being different from the first data.

6. The information processing apparatus of claim 1, wherein the circuitry controls a process corresponding to the first data based on a selection corresponding to a process to be performed on the first data.

7. The information processing apparatus of claim 1, wherein

the circuitry controls display of second data based on a movement of the information processing apparatus in a first direction detected by the circuitry, and

the second data corresponds to a process to be performed on the first data.

8. The information processing apparatus of claim 7, wherein the circuitry controls display of the second data based on a movement of the information processing apparatus in a second direction detected by the circuitry, the second direction different from the first direction.

9. The information processing apparatus of claim 8, wherein the circuitry controls display of a plurality of graphics corresponding to the second data based on a movement of the information processing apparatus in the second direction detected by the circuitry.

10. The information processing apparatus of claim 9, wherein the plurality of graphics correspond to a playlist.

11. The information processing apparatus of claim 10, wherein, upon selection of one of the plurality of graphics, the circuitry adds a corresponding item of the first data to the playlist.

12. The information processing apparatus of claim 1, wherein

the circuitry controls display of a plurality of graphics corresponding to second data based on a movement of the information processing apparatus in a first direction detected by the circuitry, and

the second data corresponds to a process to be performed on the first data.

13. The information processing apparatus of claim 12, wherein each of the graphics corresponds to the process to be performed on the first data.

14. The information processing apparatus of claim 13, wherein the each of the plurality of graphics corresponds to a process of transferring the first data to a respective one of a plurality of devices capable of reproducing the first data.

15. The information processing apparatus of claim 14, wherein, upon selection of one of the plurality of graphics, the circuitry instructs one of the plurality of devices corresponding to the one of the plurality of graphics to reproduce the first data.

16. The information processing apparatus of claim 12, wherein the circuitry controls display of a scrolling operation of the plurality of graphics corresponding to the second data based on a movement of the information processing apparatus in a second direction different from the first direction.

17. The information processing apparatus of claim 1, wherein the circuitry includes a GPS device, geomagnetic sensor, acceleration sensor, gyro sensor, or atmospheric pressure sensor.

18. A method performed by an information processing apparatus including circuitry, the method comprising:

controlling, by the circuitry, display of first data and other data on a display;

detecting, by the circuitry, a touch operation on the display at a location within an image representation of the first data;

detecting, by the circuitry, a tilt movement of the information processing apparatus;

selecting, by the circuitry, an item of the first layer data based on the touch operation and the tilt movement of the information processing apparatus; and

controlling, by the circuitry, removal of all displayed data, including the other data, on the display that is located outside of the image representation of the first data from the display based on the touch operation and the tilt movement.

19. A non-transitory computer-readable medium storing computer program executable instructions, which when executed by an information processing apparatus, cause the information processing apparatus to:

control display of first data and other data on a display;

detect a touch operation on the display at a location within an image representation of the first data;

detect a tilt movement of the information processing apparatus;

select an item of the first layer data based on the touch operation and the tilt movement of the information processing apparatus; and

control removal of all displayed data, including the other data, on the display that is located outside of the image representation of the first data from the display based on the touch operation and the tilt movement.