Digital video network interface

• US 6,438,604 B1
• Filed: 10/05/1998
• Issued: 08/20/2002
• Est. Priority Date: 10/05/1998
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Zhou, Wei, Beck, Gregory F., Slick, Royce Earle, England, Trent Lee, Kuver, Walter D., Montenegro, Elias, Oktay, Osman Ozay, Ip, Tony K., Purpura, Don Francis, Wadsworth, Robert D.
• Primary Examiner(s): Coulter, Kenneth R.
• Application Number:
  US09/166,487
• Time in Patent Office: 1,415 Days
• Field of Search: 709/224, 709/231, 709/213, 709/214, 709/234, 710/52, 710/53, 710/56, 710/57, 711/170
• US Class Current: 709/234
• CPC Class Codes: H04L 12/40058 Isochronous transmission
• CPC Class Codes: H04L 12/40097 Interconnection with other networks LAN interconnection over a bridge based backbone H04L12/462; single bridge functionality H04L12/462
• CPC Class Codes: H04L 12/40117 Interconnection of audio or video/imaging devices home automation networks H04L12/2803; bitstream network arrangements specially adapted for distribution of digital video signals H04N7/24
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/22 Traffic shaping
• CPC Class Codes: H04L 47/431 using padding or de-padding
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04N 21/4363 Adapting the video stream to a specific local network, e.g. a Bluetooth® network
• CPC Class Codes: H04N 21/43632 involving a wired protocol, e.g. IEEE 1394 high-speed IEEE 1394 serial bus H04L12/40052
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 21/64707 for transferring content from a first network to a second network, e.g. between IP and wireless
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/148 Interfacing a video terminal to a particular transmission medium, e.g. ISDN

Abstract

A digital video network interface for transferring isochronous video data over an asynchronous local area network, including an isochronous interface for transmitting digital video data isochronously, a memory comprising first and second buffers for storing the isochronous video data, a network interface for transmitting video data from either the first or second buffers over the asynchronous local area network, and a memory buffer manager for controlling the output of the video data over the asynchronous local area network and for controlling the input/output of video data into/from the first or second buffers, wherein, when either the first or second buffers is filled with video data, the memory buffer manager shifts the input of data into an empty buffer and begins outputting video data to the asynchronous local area network from a filled buffer, upon receiving access to the local area network. Complementary ones of such video network interfaces may be provided on a network so as to permit one-way video streaming (to one or more receiving sites) or two-way video conferencing with network interfaces operating in full-duplex mode.

Claims

1. A digital video network interface for transferring isochronous video data over an asynchronous local area network, comprising:

an isochronous interface for transmitting digital video data isochronously;

a memory comprising first and second buffers for storing the isochronous video data;

a network interface for transmitting video data from either the first or second buffers over the asynchronous local area network; and

a memory buffer manager for controlling the output of the video data over the asynchronous local area network and for controlling the input/output of video data into/from the first or second buffers, wherein, when either the first or second buffers is filled with video data, the memory buffer manager shifts the input of data into an empty buffer and begins outputting video data to the asynchronous local area network from a filled buffer, upon receiving access to the local area network.

2. An interface according to claim 1, wherein the video data is received over the isochronous interface in data packets having a first predetermined size, data packets stored in the first or second buffers of the memory are data packets of video data having a second predetermined size and the video data which is transmitted over the network is a combination of data packets having the second predetermined size, wherein the memory buffer manager modifies the length of data packets of the first predetermined size received from the isochronous interface to produce data packets of the second predetermined size prior to storing the data packets in the first or second buffers in the memory, and combines the data packets of the second predetermined size prior to outputting data packets on the asynchronous local area network.

3. A method for transferring data between an isochronous data source and an asynchronous local area network comprising the steps of:

receiving data packets isochronously from an isochronous data source;

storing data packets from the isochronous data source in a buffer having first and second memory areas;

accessing the asynchronous local area network; and

transferring data packets, over the asynchronous local area network,

wherein data packets are stored in either the first or second memory areas of the buffer, such that when one memory location is filled the other memory location receives data and wherein the transfer of data packets comes from the filled memory location, whereupon the filling of a memory location, network access is requested and, upon receiving access, the data packets from the filled memory location are output over the asynchronous local area network.

4. A digital video network system, comprising:

an asynchronous local area network for transferring data;

a digital video camera for generating and transmitting digital video data isochronously;

a peripheral digital video device for receiving digital video data;

a transmitting digital video network interface for transferring data between the digital video camera and the asynchronous network, the transmitting digital video network interface having a transmitting isochronous interface for receiving data packets from the digital video camera isochronously, a transmit buffer having first and second memory locations for storing data packets, a network interface for transferring the data packets from either the first or second memory locations of the buffer through the asynchronous local area network, and a transmit memory buffer manager for

     1) controlling the transfer of data packets from the isochronous interface to either of the first or second memory locations in the buffer and

     2) controlling the transfer of data packets from either the first or second memory locations of the buffer through the network interface by requesting access of the asynchronous local area network, wherein the transmit memory buffer manager controls the storage of the data packets into either the first or second memory location of the buffer, and wherein, when one memory location has been filled, the transmit memory buffer manager requests access to the network and, upon receiving access, transmits data packets from the filled memory location; and

a receiving digital video network interface for transferring data between the asynchronous local area network and the peripheral digital video device, the receiving digital video network interface having a network interface for receiving video data packets from the asynchronous local area network, a receive buffer having first and second memory locations, a receiving isochronous interface for transmitting video data packets to the peripheral digital video device, and a receive memory buffer manager for

     1) controlling the transfer of data packets from the network interface to the receive buffer and

     2) controlling the transfer of video data packets from the buffer to the receiving isochronous interface, wherein the memory buffer manager controls the storing of data packets into a location pointed to by an input pointer, and wherein the receive memory buffer manager controls the output of video data in an isochronous fashion from a memory location pointed to by an empty pointer through to the receiving isochronous interface.

5. A method for transmitting digital video data, for use in a digital video conferencing system, in which digital video data is transmitted from one isochronous bus to another isochronous bus via an asynchronous bus, the method comprising the steps of:

establishing an isochronous communication and an asynchronous network connection at the receiving side;

establishing an isochronous communication and an asynchronous network connection at the sending side;

negotiating between the sending side and receiving side to open an asynchronous transmission;

converting isochronous digital video data into asynchronous network data at the sending side;

transmitting the asynchronous network data packets to the receiving side;

receiving the asynchronous network data at the receiving side; and

converting the asynchronous network data to isochronous digital video data at the receiving side.

6. The method according to claim 5, wherein there are plural receiving sides, each receiving a multicast or broadcast asynchronous network transmission, and each converting to isochronous digital video data.

7. The method according to claim 5, wherein the receiving side and the sending side perform complementary steps so as to achieve full duplex digital video data transmission and reception.

8. The method according to claim 5, wherein the receiving side maintains a buffer to buffer received asynchronous network data.

9. The method according to claim 8, wherein the size of the buffer is dynamically and adaptively adjusted.

10. The method according to claim 9, wherein the size of the buffer is dynamically and adaptively adjusted based on a real-time monitor of network characteristics.

11. The method according to claim 5, wherein the step of establishing an isochronous communication and asynchronous network connection at the receiving side includes the steps of connecting with a local area network and creating a UDP socket.

12. The method according to claim 11, wherein the step of establishing an isochronous communication and asynchronous network connection at the sending side includes the steps of connecting with a local area network and creating a UDP socket.

13. The method according to claim 5, wherein the step of negotiating includes signalling a network controller to obtain access to the local area network.

14. The method according to claim 13, wherein the step of converting isochronous digital video data includes removing IEEE 1394 header information from the digital video data, adding network header information to the digital video data, repackaging the digital video data with the network header into a network packet which is formatted in accordance with the local area network protocol format and storing the network packet for asynchronous output in the transmitting step.

15. The method according to claim 14, wherein the step of converting asynchronous network data packets includes verifying the network header, removing the network header, unpackaging the digital video data from the local area network protocol, and formatting the digital video data with IEEE 1394 header information.

16. The method according to claim 5, further including the step of transmitting the isochronous digital video data to a digital video device.

17. The method according to claim 5, wherein the receiving step includes the step of executing software steps to 1) intercept incoming network packets so as to bypass network TCP/IP protocol, 2) verify network header information, 3) verify UDP port number, and 4) remove the network header and UDP port number from the network packet wherein, in the case that either the network header information or the UDP port number cannot be verified, the network packet is returned for default processing.

18. A digital video network interface for transferring isochronous video data over an asynchronous local area network, comprising:

an isochronous interface means for transmitting digital video data isochronously;

a memory means comprising first and second buffers for storing the isochronous video data;

a network interface means for transmitting video data from either the first or second buffers over the asynchronous local area network; and

.

a memory buffer manager means for controlling the output of the video data over the asynchronous local area network and for controlling the input/output of video data into/from the first or second buffers, wherein, when either the first or second buffers is filled with video data, the memory buffer manager means shifts the input of data into an empty buffer and begins outputting video data to the asynchronous local area network from a filled buffer, upon receiving access to the local area network.

19. A digital video network system for transmitting digital video data, comprising:

a first 1394 interface connected to a bus for transmitting digital video data;

a first network interface connected to a bus;

an asynchronous network connected to the network interface;

a first memory comprising first and second buffers; and

a network transmitter controlling the input of digital video data from the first 1394 interface, over the bus, into the memory, packaging the digital video data stored in the memory into asynchronous network data packets and transmitting the output of the network packets over the asynchronous network.

20. The system according to claim 19, further comprising:

a second 1394 interface connected to a remote bus for receiving digital video data;

a second network interface connected to the remote bus;

a second memory for storing received digital video data through the remote bus from the second network interface; and

a network receiver for receiving network data packets over the asynchronous network through the network interface, unpackaging the network data packet into digital video data, storing the digital video data into the second memory and controlling the output of digital video data from the second memory over the remote bus to the second 1394 interface.

21. The system according to claim 19, wherein there are plural receiving sides, each receiving a multicast or broadcast asynchronous network transmission, and each converting to isochronous digital video data.

22. The system according to claim 19, wherein the receiving side and the sending side perform complementary steps so as to achieve full duplex digital video data transmission and reception.

23. The system according to claim 19, wherein the receiving side maintains a buffer to buffer received asynchronous network data.

24. The system according to claim 23, wherein the size of the buffer is dynamically and adaptively adjusted.

25. The system according to claim 24, wherein the size of the buffer is dynamically and adaptively adjusted based on a real-time monitor of network characteristics.

26. The system according to claim 20, wherein the network transmitter converts isochronous digital video data received from the first 1394 interface into asynchronous network packets.

27. The system according to claim 20, wherein the network receiver converts asynchronous network packets into isochronous digital video data and outputs the digital video data isochronously through the second 1394 interface.

28. The system according to claim 20, wherein the network transmitter negotiates with the network to obtain access to the network in order to transmit network packets.

29. The system according to claim 20, wherein the network transmitter and network receiver communicates through the network using User Datagram Protocol.

30. The system according to claim 20, wherein the system utilizes an embedded operating system which permits multitasking in real time.

31. The system according to claim 20, wherein the first memory is controlled to store digital video data into the first buffer, and, upon filling the first buffer, storing digital video data in the second buffer and when the second buffer is being filled with digital video data, the first buffer is transmitting digital video data to the network transmitter, upon obtaining access to the network and, when the first buffer is being filled, the second buffer is transmitting digital video data to the network transmitter.

32. The system according to claim 20, further comprising:

a first physical layer connected to the first 1394 interface; and

a first link layer connected to the first physical layer, wherein the link layer receives digital video data transmitted over the bus through the first physical layer, interprets the digital video data and removes 1394 header information from the digital video data before the digital video data is stored in the first memory.

33. The system according to claim 31, wherein in the case that access to the network has not been obtained by the network transmitter after the first buffer has been filled with digital video data and before the second buffer is substantially filled with digital video data, the network transmitter discards the contents of the first buffer.

34. The system according to claim 31, wherein in the case that access to the network has not been obtained by the network transmitter after the second buffer has been filled with digital video data and before the first buffer is substantially filled with digital video data, the network transmitter discards the contents of the second buffer.

35. The system according to claim 20, wherein the second memory includes an input pointer which points to a last memory address of input digital video data in the memory and an empty pointer which points to an memory address of digital video data to be output from the memory.

36. The system according to claim 35, wherein in the case that the input pointer and empty pointer come within a predetermined address range of each other, the remaining data to be output is discarded.

37. A method for dynamically and adaptively adjusting a size of a buffer used to store data received from an asynchronous network, comprising:

monitoring the network in real time so as to obtain an indication of current network characteristics; and

adjusting the size of the buffer based on the indication of current network characteristics,

wherein in said monitoring step, the network is monitored for variability in the degree of access thereto.

38. The method according to claim 37, wherein in said monitoring step, the network is monitored for busyness.

39. The method according to claim 38, wherein said adjusting step adjusts the size of the buffer upwardly in a case where network busyness is high, and downwardly in a case where network busyness is low.

40. The method according to claim 37, further comprising the step of retrieving asynchronously received data from the buffer and converting the retrieved data to isochronous data for transmission to an isochronous interface.

41. The method according to claim 40, further comprising the steps of maintaining an input pointer in correspondence to an address in the buffer where asynchronously received data from the network is stored, and an empty pointer in correspondence to an address in the buffer where data is retrieved for conversion to isochronous data, and where in said monitoring step, the network is monitored for variability in the degree of access thereto based on a real-time difference between the input pointer and the empty pointer.