Information processing apparatus and information processing method

• US 20100134411A1
• Filed: 11/16/2009
• Published: 06/03/2010
• Est. Priority Date: 12/03/2008
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Maruo, Jun, Tsumura, Takeo
• Application Number:
  US12/590,903
• Publication Number:
  US 20100134411A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/0382 Plural input, i.e. interface arrangements in which a plurality of input device of the same type are in communication with a PC
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/42227 the keys being reprogrammable, e.g. soft keys
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video

Abstract

An information processing apparatus is provided which includes an image send unit for displaying a 3D image of a remote operation device as a virtual remote controller, at least one imaging unit for taking an image of a user, a 3D image detection unit for detecting a user'"'"'s motion based on a video taken by the imaging unit, an instruction detection unit for determining whether the user has pressed a predetermined operation button arranged on the virtual remote controller, based on a detection result by the 3D image detection unit and a position of the predetermined operation button arranged on the virtual remote controller displayed by the image send unit, and an instruction execution unit for performing a predetermined processing corresponding to the user-pressed operation button on the virtual remote controller based on a determination result by the instruction detection unit.

Claims

1. An information processing apparatus comprising:

an image send unit for displaying a 3D image of a remote operation device as a virtual remote controller;

at least one imaging unit for taking an image of a user;

a 3D image detection unit for detecting a user'"'"'s motion based on a video taken by the imaging unit;

an instruction detection unit for determining whether the user has pressed a predetermined operation button arranged on the virtual remote controller, based on a detection result by the 3D image detection unit and a position of the predetermined operation button arranged on the virtual remote controller displayed by the image send unit; and

an instruction execution unit for performing a predetermined processing corresponding to the user-pressed operation button on the virtual remote controller based on a determination result by the instruction detection unit.

2. The information processing apparatus according to claim 1, further comprising a shape detection unit for specifying a user in an imaging region of the imaging unit by detecting part of the user'"'"'s body based on a video taken by the imaging unit and comparing the detected part with previously registered information on parts of the user'"'"'s body,

wherein the image send unit displays a previously registered virtual remote controller adapted to the user specified by the shape detection unit.

3. The information processing apparatus according to claim 2, further comprising:

a sound collection unit such as microphone for collecting a voice; and

a voice detection unit for specifying a user who has generated the voice collected through the sound collection unit by comparing the voice collected by the sound collection unit with previously registered information on a user'"'"'s voice,

wherein the image send unit displays a previously registered virtual remote controller adapted to the user specified by the voice detection unit.

4. The information processing apparatus according to claim 3, wherein the image send unit changes a shape of the virtual remote controller, and kinds or positions of operation buttons to be arranged on the virtual remote controller based on a determination result by the instruction detection unit.

5. The information processing apparatus according to claim 4, wherein the image send unit changes and displays a color and/or shape of only an operation button which is determined to have been pressed by the user in the instruction detection unit among the operation buttons arranged on the virtual remote controller.

6. The information processing apparatus according to claim 5, wherein the image send unit changes a display position of the virtual remote controller in response to the user'"'"'s motion such that the virtual remote controller is displayed to the user detected by the 3D image detection unit.

7. The information processing apparatus according to claim 6, wherein the image send unit changes a display position of the virtual remote controller depending on a user'"'"'s operation when the user'"'"'s operation detected by the 3D image detection unit matches with a previously registered predetermined operation corresponding to an instruction of changing the display position of the virtual remote controller.

8. The information processing apparatus according to claim 7, wherein the instruction execution unit powers on the information processing apparatus when a user'"'"'s operation detected by the 3D image detection unit matches with a previously registered predetermined operation corresponding to the power-on instruction.

9. The information processing apparatus according to claim 8, wherein the instruction execution unit powers on the information processing apparatus when a sound detected by the voice detection unit matches with a previously registered predetermined sound corresponding to the power-on instruction.

10. The information processing apparatus according to claim 9, further comprising an external device'"'"'s remote controller specification input unit for acquiring information on a remote controller specification of an external device operating in association with the information processing apparatus,

wherein the image send unit displays a virtual remote controller on which operation buttons corresponding to predetermined functions provided in the external device are arranged, based on the information on a remote controller specification of the external device.

11. The information processing apparatus according to claim 1, wherein when multiple users are present in an imaging region of the imaging unit, the image send unit displays a previously registered virtual remote controller adapted to only one user to the user.

12. The information processing apparatus according to claim 1, wherein when multiple users are present in an imaging region of the imaging unit, the image send unit displays previously registered virtual remote controllers adapted to the respective users to each user at the same time.

13. An information processing method comprising the steps of:

displaying a 3D image of a remote operation device as a virtual remote controller;

continuously taking an image of a user by at least one imaging unit;

detecting a user'"'"'s motion based on a video taken by the imaging step;

determining whether the user has pressed a predetermined operation button arranged on the virtual remote controller based on a detection result by the 3D image detection step and a position of the predetermined operation button arranged on the virtual remote controller displayed by the image send step; and

executing a predetermined processing corresponding to the user-pressed operation button on the virtual remote controller based on a determination result by the instruction detection step.