Terminal device and image capturing method

• US 9,438,805 B2
• Filed: 05/29/2013
• Issued: 09/06/2016
• Est. Priority Date: 06/08/2012
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Mobile Communications Incorporated (Sony Group Corp.)
• Inventors: Takatsuka, Susumu, Naruse, Tetsuya, Ide, Yuji
• Primary Examiner(s): Ho, Tuan
• Assistant Examiner(s): Wu, Zhenzhen
• Application Number:
  US13/904,757
• Publication Number:
  US 20130329113A1
• Time in Patent Office: 1,196 Days
• Field of Search: 348/333.12, 348/333.01
• US Class Current: 1/1
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body

Abstract

An information processing apparatus that acquires image data captured by an image capturing device; performs an analysis on the image data prior to cropping the image data for display to detect a specified image from the image data; generates an image for display by cropping the image data; controls a display to display the image for display; and executes predetermined processing when the specified image is detected in the image data as a result of performing the analysis on the image data prior to the cropping.

Claims

1. An information processing apparatus, comprising:

circuitry configured to

acquire moving image data captured by a moving image capturing device;

generate a moving image for display by cropping the moving image data;

perform an analysis on the moving image data by detecting a hand in a portion of the moving image data that is cropped and not included in the moving image for display;

control a display to display the generated moving image after cropping the moving image data for display; and

execute predetermined processing based on the detection of the hand in the portion of the moving image data that is cropped and not included in the moving image for display, wherein

the predetermined processing comprises determining that a gesture made by the hand detected by the analysis on the moving image data corresponds to a predetermined command, and

the circuitry is configured to control the display to display the generated moving image after cropping the moving image data for display while keeping acquiring the moving image data including the moving image data that is cropped and not included in the moving image for display so that the circuitry can execute the predetermined processing based on the detection of the hand in the portion of the moving image data that is cropped and not included in the moving image for display even after the hand in the portion of the moving image data is cropped and not included in the moving image for display.

2. The information processing apparatus of claim 1, further comprising:

the moving image capturing device configured to capture the moving image data.

3. The information processing apparatus of claim 1, wherein the circuitry is configured to:

determine that the gesture made by the hand detected by the analysis on the moving image data corresponds to a command to rotate the base to which the information processing apparatus is coupled; and

control the base to rotate based on the detected gesture made by the hand.

4. The information processing apparatus of claim 1, wherein the circuitry is configured to:

determine that the gesture made by the hand detected by the analysis on the moving image data corresponds to a command to perform a zoom operation corresponding to the moving image for display; and

control the display to enlarge the moving image for display based on the detected gesture made by the hand.

5. The information processing apparatus of claim 1, wherein the circuitry is configured to:

determine that the gesture made by the hand detected by the analysis on the moving image data corresponds to a command to perform a moving image capture operation; and

control the moving image capturing device to capture a moving image based on the detected gesture made by the hand.

6. The information processing apparatus of claim 1, wherein the circuitry is configured to:

determine that the gesture made by the hand detected by the analysis on the moving image data corresponds to a tip of a user'"'"'s finger being pointed upright and rotated in a clockwise or counter clockwise direction; and

control the display to enlarge or reduce a size of the moving image for display based on the detected gesture made by the hand.

7. The information processing apparatus of claim 1, wherein the circuitry is configured to:

compare a pattern of the gesture made by the hand detected by the analysis on the moving image data to stored pattern data corresponding to a command to rotate the base to which the information processing apparatus is coupled; and

control the base to rotate based on the detected gesture made by the hand when the pattern of the gesture made by the hand matches the stored pattern data.

8. The information processing apparatus of claim 1, wherein the circuitry is configured to:

compare a pattern of the gesture made by the hand detected by the analysis on the moving image data to stored pattern data corresponding to the command to change the tilt angle of the base to which the information processing apparatus is coupled; and

control the base to tilt based on the detected gesture made by the hand when the pattern of the gesture made by the hand matches the stored pattern data.

9. The information processing apparatus of claim 1, wherein the circuitry is configured to:

compare a pattern of the gesture made by the hand detected by the analysis on the moving image data to stored pattern data corresponding to a command to perform a zoom operation corresponding to the moving image for display; and

control the display to enlarge the moving image for display based on the detected gesture made by the hand when the pattern of the gesture made by the hand matches the stored pattern data.

10. The information processing apparatus of claim 1, wherein the circuitry is configured to:

compare a pattern of the gesture made by the hand detected by the analysis on the moving image data to stored pattern data corresponding to a command to perform a moving image capture operation; and

control the moving image capturing device to capture a moving image based on the detected gesture made by the hand when the pattern of the gesture made by the hand matches the stored pattern data.

11. The information processing apparatus of claim 1, wherein

the predetermined processing comprises determining that the gesture made by the hand detected by the analysis on the moving image data corresponds to a command to change a tilt angle of a base to which the information processing apparatus is coupled, and controlling the base to tilt based on the detected gesture made by the hand.

12. A method performed by an information processing apparatus, the method comprising:

acquiring moving image data captured by a moving image capturing device;

generating a moving image for display by cropping the moving image data;

performing an analysis on the moving image data by detecting a hand in a portion of the moving image data that is cropped and not included in the moving image for display;

controlling a display to display the generated moving image after cropping the moving image data for display; and

executing predetermined processing based on the detection of the hand in the portion of the moving image data that is cropped and not included in the moving image for display, wherein

the predetermined processing comprises determining that a gesture made by the hand detected by the analysis on the moving image data corresponds to a predetermined command, and

the controlling includes controlling the display to display the generated moving image after cropping the moving image data for display while keeping acquiring the moving image data including the moving image data that is cropped and not included in the moving image for display so that the circuitry can execute the predetermined processing based on the detection of the hand in the portion of the moving image data that is cropped and not included in the moving image for display even after the hand in the portion of the moving image data is cropped and not included in the moving image for display.

13. A non-transitory computer-readable medium including computer-program instructions, which when executed by an information processing apparatus, cause the information processing apparatus to:

acquire moving image data captured by a moving image capturing device;

generate a moving image for display by cropping the moving image data;

perform an analysis on the moving image data by detecting a hand in a portion of the moving image data that is cropped and not included in the moving image for display;

control a display to display the generated moving image after cropping the moving image data for display; and

execute predetermined processing based on the detection of the hand in the portion of the moving image data that is cropped and not included in the moving image for display, wherein

the predetermined processing comprises determining that a gesture made by the hand detected by the analysis on the moving image data corresponds to a predetermined command, and

the control of the display includes controlling the display to display the generated moving image after cropping the moving image data for display while keeping acquiring the moving image data including the moving image data that is cropped and not included in the moving image for display so that the circuitry can execute the predetermined processing based on the detection of the hand in the portion of the moving image data that is cropped and not included in the moving image for display even after the hand in the portion of the moving image data is cropped and not included in the moving image for display.