Information processing apparatus, information processing system, recording medium, and method for transmission and reception of moving image data

• US 9,699,518 B2
• Filed: 03/23/2015
• Issued: 07/04/2017
• Est. Priority Date: 10/10/2012
• Status: Active Grant

• Current Assignee: Fujitsu Client Computing Limited (Lenovo Group Ltd.)
• Original Assignee: Fujitsu Limited
• Inventors: Ohbitsu, Toshiro
• Primary Examiner(s): Parra, Omar S
• Application Number:
  US14/665,300
• Publication Number:
  US 20150195625A1
• Time in Patent Office: 834 Days
• Field of Search: None
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/68 involving the insertion of resynchronisation markers into the bitstream
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/234381 by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/44245 Monitoring the upstream path of the transmission network, e.g. its availability, bandwidth
• CPC Class Codes: H04N 21/4425 Monitoring of client processing errors or hardware failure
• CPC Class Codes: H04N 21/4621 Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/6338 directed to network
• CPC Class Codes: H04N 21/6379 directed to encoder , e.g. for requesting a lower encoding rate
• CPC Class Codes: H04N 21/64738 Monitoring network characteristics, e.g. bandwidth, congestion level data switched network analysis H04L41/14; monitoring functioning in data switched networks H04L43/0817; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/64792 Controlling the complexity of the content stream, e.g. by dropping packets intermediate media network packet handling H04L65/765; proxy provisioning conversion or adaptation for reducing the amount or size of exchanged application data H04L67/5651; negotiation of resources in wireless networks H04W28/16

Abstract

An information processing apparatus includes a storage unit that stores first moving image data and a processor. The processor performs processes including monitoring a state of a communication network, generating second moving image data in accordance with a result of the monitoring by deleting a frame from the first moving image data in a manner such that a first frame rate indicating a first number of frames per unit time of the first moving image data becomes a second frame rate that is lower than the first frame rate, generating frame information related to the deleted frame, and transmitting the second moving image data and the frame information.

Claims

1. An information processing apparatus comprising:

a storage unit that stores first moving image data; and

a processor that performs processes including;

monitoring a state of a communication network, the state including a bandwidth of the communication network;

obtaining a resolution of a display of moving image data;

generating second moving image data by adjusting a resolution of the first moving image data to the obtained resolution of the display in addition to deletion of a frame whose similarity to another frame is equal to or greater than a predetermined threshold, from among consecutive frames of the first moving image data, in accordance with a result of the monitoring so as to make a transmission rate of the second moving image data equal or lower than a predetermined value adapted to the bandwidth of the communication network;

generating frame information indicating a position of the deleted frame of the second moving image data; and

transmitting the second moving image data and the frame information, wherein

when the transmission rate during a first period does not become equal or lower than the predetermined value after adjusting the resolution of the first moving image in addition to deletion all of frames whose similarity to another frame is equal or greater than the predetermined threshold from among consecutive frames of the first moving image data within the first period, the generating the second moving image data generates the second moving image by deleting frames whose similarity to another frame is equal or greater than the predetermined threshold, from among consecutive frames of the first moving image data within a second period which is longer than the first period, so as to make the transmission rate during the second period equal or lower than the predetermined value.

2. The information processing apparatus according to claim 1, wherein

the generating frame information adds the frame information to meta information related to the second moving image data, and

the transmitting transmits the second moving image data and the meta information.

3. The information processing apparatus according to claim 1, wherein

the frame information includes a start number of the deleted frame and a period of the deleted frame.

4. An information processing apparatus comprising:

a processor that performs processes including;

receiving second moving image data and frame information, the second moving image data being generated by adjusting a resolution of first moving image data to a resolution of a display of moving image data in addition to deletion of a frame whose similarity to another frame is equal to or greater than a predetermined threshold, from among consecutive frames of the first moving image data, in accordance with a result of monitoring a state of a communication network so as to make a transmission rate of the second moving image data equal or lower than a predetermined value adapted to a bandwidth of the communication network, the second moving image data being generated, when the transmission rate during a first period does not become equal or lower than the predetermined value after adjusting the resolution of the first moving image in addition to deletion all of frames whose similarity to another frame is equal or greater than the predetermined threshold from among consecutive frames of the first moving image data within the first period, by deleting frames whose similarity to another frame is equal or greater than the predetermined threshold, from among consecutive frames of the first moving image data within a second period which is longer than the first period, so as to make the transmission rate during the second period equal or lower than the predetermined value, the state including the bandwidth of the network, the frame information indicating a position of the deleted frame of the second moving image data;

generating a complementary image for complementing an image of the deleted frame by using the frame information; and

generating moving image data by inserting the complementary image at the position indicated by the frame information.

5. The information processing apparatus according to claim 4, wherein

the generating a complementary image generates the complementary image according to change points between frames preceding and following the deleted frame.

6. A non-transitory computer-readable recording medium having stored therein a program for causing a computer to execute a process comprising:

monitoring a state of a communication network, the state including a bandwidth of the communication network;

generating second moving image data by adjusting a resolution of the first moving image data to the obtained resolution of the display in addition to deletion of a frame whose similarity to another frame is equal to or greater than a predetermined threshold, from among consecutive frames of a first moving image data, in accordance with a result of the monitoring so as to make a transmission rate of the second moving image data equal or lower than a predetermined value adapted to the bandwidth of the communication network;

generating frame information indicating a position of the deleted frame of the second moving image data; and

transmitting the second moving image data and the frame information, wherein

when the transmission rate during a first period does not become equal or lower than the predetermined value after adjusting the resolution of the first moving image in addition to deletion all of frames whose similarity to another frame is equal or greater than the predetermined threshold from among consecutive frames of the first moving image data within the first period, the generating the second moving image data generates the second moving image by deleting frames whose similarity to another frame is equal or greater than the predetermined threshold, from among consecutive frames of the first moving image data within a second period which is longer than the first period, so as to make the transmission rate during the second period equal or lower than the predetermined value.