INFORMATION PROCESSING DEVICE AND INFORMATION PROCESSING METHOD

• US 20160156944A1
• Filed: 07/01/2014
• Published: 06/02/2016
• Est. Priority Date: 07/19/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Hattori, Shinobu, Hirabayashi, Mitsuhiro, Nakagami, Ohji, Chinen, Toru, Shi, Runyu, Tsuji, Minoru, Yamamoto, Yuki
• Granted Patent: US 10,523,975 B2
• Time in Patent Office: Days
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/85406 involving a specific file format, e.g. MP4 format
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus

Abstract

The present disclosure relates to an information processing device and information processing method capable of recognizing an acquisition position of voice data on an image. A web server transmits image frame size information indicating image frame size of image data and audio position information indicating acquisition position of voice data. The present disclosure is applicable to an information processing system or other like system including file generation device, web server, and video playback terminal to perform tiled streaming using a manner compliant with moving picture experts group phase-dynamic adaptive streaming over HTTP (MPEG-DASH).

Claims

1. An information processing device comprising:

a transmitter configured to transmit image frame size information and voice position information, the image frame size information indicating an image frame size of image data, the voice position information indicating an acquisition position of voice data.

2. The information processing device according to claim 1,

wherein the image frame size information is configured as information indicating an angle of view in horizontal and vertical directions of the image data and a distance between a base point of the angle of view and an image plane.

3. The information processing device according to claim 1,

wherein the voice position information is configured as information indicating an angle in horizontal and vertical directions of a line connecting a position in which the voice data is acquired and a base point and a distance between the position in which the voice data is acquired and the base point.

4. The information processing device according to claim 1, further comprising:

a metafile generator configured to generate a metadata file of the voice data including the voice position information; and

an information generator configured to generate, as control information, information used to specify the image frame size information and the metadata file,

wherein the transmitter is configured to transmit the control information generated by the information generator and the metadata tile generated by the metafile generator.

5. The information processing device according to claim 1,

wherein the transmitter is configured to transmit the voice data corresponding to a display area that is an area to be displayed in an image corresponding to the image data, the voice data being requested based on the image frame size information and the voice position information.

6. The information processing device according to claim 5,

wherein the voice data is voice data in units of objects, and

wherein the transmitter is configured to transmit voice data of the object corresponding to the display area.

7. The information processing device according to claim 6, further comprising:

a voice file generator configured to generate a voice file including voice data of a plurality of the objects and data position information indicating a position of each of the objects in the voice file of the voice data,

wherein the transmitter is configured to transmit voice data of the object corresponding to the display area in the voice file generated by the voice file generator.

8. The information processing device according to claim 6, further comprising:

a voice file generator configured to generate a voice file including each of the voice data of a plurality of the objects,

wherein the transmitter is configured to transmit file specifying information used to specify the voice file of each of the objects and to transmit the voice file including the voice data of the object corresponding to the display area, the voice data being requested based on the image frame size information, the voice position information, and the file specifying information.

9. An information processing method comprising:

a transmission step of transmitting image frame size information and voice position information by an information processing device, the image frame size information indicating an image frame size of image data, the voice position information indicating an acquisition position of voice data.

10. An information processing device comprising:

a receiver configured to receive image frame size information and voice position information, the image frame size information indicating an image frame size of image data, the voice position information indicating an acquisition position of voice data; and

a position determination unit configured to determine an acquisition position of the voice data on an image corresponding to the image data based on the image frame size information of the image data and the voice position information received by the receiver.

11. The information processing device according to claim 10,

wherein the image frame size information is configured as information indicating an angle of view in horizontal and vertical directions of the image data and a distance between a base point of the angle of view and an image plane.

12. The information processing device according to claim 10,

wherein the voice position information is configured as information indicating an angle in horizontal and vertical directions of a line connecting a position in which the voice data is acquired and a base point, and a distance between the position in which the voice data is acquired and the base point.

13. The information processing device according to claim 10,

wherein the voice data is voice data in units of objects, and

wherein the position determination unit is configured to determine an acquisition position of the voice data of each of the objects on an image corresponding to the image data based on the image frame size information and the voice position information of each of the objects.

14. The information processing device according to claim 13, further comprising:

a voice selector configured to select voice data of the object corresponding to a display area that is an area to be displayed in an image corresponding to the image data based on the acquisition position of the voice data of each of the objects determined by the position determination unit,

wherein the receiver is configured to receive the voice data selected by the voice selector.

15. The information processing device according to claim 14,

wherein the receiver is configured to receive voice data of the object selected by the voice selector, the voice data of the object being contained in a voice file including the voice data of a plurality of the objects and data position information indicating a position of each of the objects in the voice file of the voice data.

16. The information processing device according to claim 14,

wherein the receiver is configured to receive the voice file including voice data of the object selected by the voice selector among voice files including each of voice data of a plurality of the objects.

17. The information processing device according to claim 13, further comprising:

a voice synthesis processor configured to synthesize voice data of a plurality of the objects based on the acquisition position of the voice data of each of the objects determined by the position determination unit.

18. The information processing device according to claim 17, further comprising:

a converter configured to convert a size of image data in an display area that is an area to be displayed in an image corresponding to the image data to a size of the image data,

wherein the position determination unit is configured to determine an acquisition position of the voice data of each of the objects on an image corresponding to image data of the display area having the size converted by the converter, based on the image frame size information of the image data, the voice position information of each of the objects, and image frame size information of the display area.

19. The information processing device according to claim 18,

wherein the image frame size information of the display area is configured as information indicating an angle of view in horizontal and vertical directions of the display area and a distance between a base point of the angle of view and an image plane.

20. An information processing method comprising:

a reception step of receiving image frame size information and voice position information, the image frame size information indicating an image frame size of image data, the voice position information indicating an acquisition position of voice data; and

a position determination step of determining an acquisition position of the voice data on an image corresponding to the image data, based on the image frame size information of the image data and the voice position information received by a process in the reception step.