Information processing device and method, photographing device, and program

• US 7,917,020 B2
• Filed: 06/01/2006
• Issued: 03/29/2011
• Est. Priority Date: 06/09/2005
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Yamaguchi, Yoshihiro, Kurata, Masatomo, Clarkson, Brian, Murata, Makoto
• Primary Examiner(s): Laballe; Clayton E
• Assistant Examiner(s): PARKER, AUTUMN H
• Application Number:
  US11/444,467
• Publication Number:
  US 20060291840A1
• Time in Patent Office: 1,762 Days
• Field of Search: 396/50, 396/52, 348/231.3, 348/333.1, 386/117, 116/213
• US Class Current: 396/50
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal

Abstract

An information processing device includes a processing unit that recognizes an action based on sensor data output by a sensor and obtained in a same timing as a photographing timing of an image string. The processing unit associates information indicating the action as information for a selection of a reproduction position at a time of a reproduction of the image string with the image string. In addition, the processing unit extracts a plurality of features from the sensor data. The processing unit recognizes the action based on a time series of the plurality of features using a model for a recognition.

Claims

1. An information processing device, comprising:

associating means for recognizing an action based on sensor data output by a sensor and obtained in a same timing as a photographing timing of an image string, for extracting a plurality of features from said sensor data, and for recognizing the action based on a time series of the plurality of features using a model for a recognition; and

display controlling means for displaying a distribution of scenes of the image string for a selection of a reproduction position at a time of a reproduction of said image string, the distribution based on the action.

2. The information processing device according to claim 1, further comprising:

reproduction controlling means for reproducing one of the scenes of said image string, said one of the scenes associated with the action selected from among a plurality of actions recognizable by said associating means.

3. The information processing device according to claim 1, wherein the display controlling means displays the distribution of scenes associated with respective actions by an action type.

4. The information processing device according to claim 1, wherein said model for the recognition is provided in advance.

5. The information processing device according to claim 1, wherein said sensor is included in one of the information processing device itself and a device having a casing different from a casing of the information processing device.

6. The information processing device according to claim 5, further comprising:

communicating means for, when said sensor is included in the device having the casing different from the casing of the information processing device, performing radio communication with the device, and for obtaining said sensor data.

7. The information processing device according to claim 1, further comprising:

image processing means for clustering images forming said image string according to contents of the images; and

action correcting means for associating one of a plurality of actions with one entire scene formed by images including contents determined to be similar to each other based on a result of a processing by said image processing means.

8. An information processing method implemented by an information processing device, the information processing method comprising:

recognizing an action based on sensor data output by a sensor and obtained in a same timing as a photographing timing of an image string;

extracting a plurality of features from said sensor data; and

displaying a distribution of scenes of the image string for a selection of a reproduction position at a time of a reproduction of said image string, the distribution based on the action, wherein the recognizing is defined by recognizing the action, with the information processing device, based on a time series of the plurality of features using a model for a recognition.

9. A computer-readable, non-transitory storage medium encoded with a program for making a computer perform a process comprising:

recognizing an action based on sensor data output by a sensor and obtained in a same timing as a photographing timing of an image string;

extracting a plurality of features from said sensor data; and

displaying a distribution of scenes of the image string for a selection of a reproduction position at a time of a reproduction of said image string, the distribution based on the action, wherein the recognizing is defined by recognizing the action based on a time series of the plurality of features using a model for a recognition.

10. A photographing device, comprising:

photographing means;

associating means for recognizing an action based on sensor data output by a sensor and obtained in a same timing as a timing of a photographing of an image string by said photographing means, for extracting a plurality of features from said sensor data, and for recognizing the action based on a time series of the plurality of features using a model for a recognition; and

display controlling means for displaying a distribution of scenes of the image string for a selection of a reproduction position at a time of a reproduction of said image string, the distribution based on the action.

11. An information processing device, comprising:

a processing unit configured to recognize an action based on sensor data output by a sensor and obtained in a same timing as a photographing timing of an image string, to extract a plurality of features from said sensor data, and to recognize the action based on a time series of the plurality of features using a model for a recognition; and

an interface configured for a display of a distribution of scenes of the image string for a selection of a reproduction position at a time of a reproduction of said image string, the distribution based on the action.

12. A photographing device, comprising:

a camera unit;

an associating section configured to recognize an action based on sensor data output by a sensor and obtained in a same timing as a timing of a photographing of an image string by said camera unit, to extract a plurality of features from said sensor data, and to recognize the action based on a time series of the plurality of features using a model for a recognition; and

an interface configured for a display of a distribution of scenes of the image string for a selection of a reproduction position at a time of a reproduction of said image string, the distribution based on the action.