Streaming video network system

• US 8,401,869 B2
• Filed: 08/24/2006
• Issued: 03/19/2013
• Est. Priority Date: 08/24/2005
• Status: Active Grant

• Current Assignee: Gyrus ACMI, Inc. (Olympus Corporation)
• Original Assignee: Image Stream Medical, Inc. (Olympus Corporation)
• Inventors: Renzi, Peter, Mitchell, Eddie
• Primary Examiner(s): O'Connor, Gerald J.
• Assistant Examiner(s): Ng, Jonathan K
• Application Number:
  US11/510,337
• Publication Number:
  US 20070050828A1
• Time in Patent Office: 2,399 Days
• Field of Search: 709/231, 709/249, 705/2, 705/3, 715/719, 348/142
• US Class Current: 705/2
• CPC Class Codes: A61B 5/0013 Medical image data A61B1/00011, A61B6/56, A61B8/56 take precedence
• CPC Class Codes: H04N 21/2143 located in a single building, e.g. hotel, hospital or museum arrangements specially adapted for plural spots in a confined site in broadcast systems H04H20/63; adaptations for transmission by electric cable for domestic distribution in television systems H04N7/106
• CPC Class Codes: H04N 21/25875 involving end-user authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; arrangements for secret or secure communication including means for verifying the identity or authority of a user of the system H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/266 Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4363 Adapting the video stream to a specific local network, e.g. a Bluetooth® network
• CPC Class Codes: H04N 21/43632 involving a wired protocol, e.g. IEEE 1394 high-speed IEEE 1394 serial bus H04L12/40052
• CPC Class Codes: H04N 21/441 Acquiring end-user identification , e.g. using personal code sent by the remote control or by inserting a card
• CPC Class Codes: H04N 21/44224 Monitoring of user activity on external systems, e.g. Internet browsing
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/647 Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless real-time session protocols H04L65/1101
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/163 by receiver means only
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A distributed, digital, network-based, streaming video solution allows users to view live streaming digital video from multiple video sources in multiple operating rooms at any location connected to a network. One or more video sources in an operating room are connected to a streaming video encoder capable of converting the video to a network packet stream. Once the digital video stream is available on the network, it may be accessed and routed through the use of a streaming video control server. The streaming video control server is responsible for user authentication and authorization and web page access for remote viewing and video source selection by users. The control server also provides audit logging services, operating room selection and overall system resource allocation. The video control server also provides a network-based remote control interface, which enables other systems to communicate on the streaming video network, and allows for remote control of visualization from an integrated operating room control system, and provides the ability for one operating room to look into other operating rooms.

Claims

1. A streaming managed medical video network system for enabling access on a medical network to live video data captured from a plurality of locations, the system comprising:

at least one streaming device associated with at least one medical treatment location of the plurality of locations, wherein the at least one streaming device is configured to receive live video data from at least one of a plurality of sources located in the at least one medical treatment location and convert the data received from the at least one source of the plurality of sources into a network packet stream, wherein the at least one source of the plurality of sources comprises a medical video source that views a procedure, the procedure comprising one of a surgical procedure, a diagnostic procedure, and a therapeutic procedure, performed at the at least one medical treatment location, the at least one medical treatment location having a plurality of medical video sources therein, the plurality of medical video sources being used during the procedure in which medical personnel are present at the medical treatment location;

a network switch in communication with the at least one streaming device; and

a streaming video control server that;

(a) authenticates at least one of a plurality of users to the managed streaming medical video network system;

(b) establishes a communication channel, the communications channel being configured to route each network packet stream from the at least one streaming device, via the network switch, towards the at least one user for enabling access by the at least one user to the network packet stream;

(c) provides the network packet stream to the at least one user such that, once the at least one user has been authenticated to the system, the at least one user can view the live video data contained in the network packet stream; and

(d) tracks a status of the medical treatment location during one of the surgical procedure, the diagnostic procedure and the therapeutic procedure, the status of the medical treatment location comprising one of a room status and a patient status; and

wherein the at least one streaming device captures video simultaneously with state and status metadata information, by collecting patient information from a network-based software service and transmitting patient information, which is overlaid onto the video as it is being viewed by the at least one user at a remote location.

2. The system of claim 1 wherein the streaming server is configured to enable access to privacy control for controlling flow of network packet streams captured from the at least one streaming device configured to receive live video data from by the plurality of sources located in the at least one medical treatment location.

3. The system of claim 1 wherein the streaming server is further configured to

initialize and host at least one remote viewing session for the at least one remote user;

track usage of network resources by the session, including usage of video sources; and

free the resources based on one of a pre-defined timeout or users logging off from the sessions.

4. The system of claim 3 wherein the streaming server is further configured to perform audit logging services by tracking user interaction with the system.

5. The system of claim 1 wherein the communication channel comprises a uni-directional channel that enables view-only services for the at least one user.

6. The system of claim 1 wherein the communication channel comprises a bi-directional channel for communication between the at least one user and the at least one medical treatment location.

7. The system of claim 6 wherein the communication channel is established by an application running on a streaming server.

8. The system of claim 6 wherein the bi-directional channel is established between a first operating room and a second operating room to route network packet streams between the first operating room and the second operating room.

9. The system of claim 1 further comprising a graphical user interface (GUI) that allows a remote user to perform at least one of:

room selection, dynamic room change, video source selection, remote control of a video source, and dynamic change of video sources.

10. The system of claim 1 wherein the network packet received from the source in the at least one medical treatment location contains metadata, the metadata including clinically relevant information corresponding to a state of the at least one medical treatment location.

11. The system of claim 10 wherein the metadata is persisted to a data store.

12. The system of claim 10 wherein the metadata is persisted with a video network packet to a data store.

13. The system of claim 10 wherein the metadata is displayed to the at least one user.

14. The system of claim 10 wherein the metadata is displayed with the network packet stream to the at least one user.

15. The system of claim 10 wherein the clinically relevant information includes at least one of:

a patient status at the at least one medical treatment location, a status of the at least one medical treatment location, a presence of staff at the at least one medical treatment location, an identifier of the medical treatment location and a location of the source.

16. The system of claim 10 wherein the metadata includes one of patient vital signs information, date of birth of patient, patient anesthesia status, patient presence in an operating room, cut skin status and closing.

17. The system of claim 10 wherein the packet stream is stored with the metadata by directly overlaying the metadata into the packet stream.

18. The system of claim 17 wherein the metadata includes one of text and graphics.

19. The system of claim 10 wherein the packet stream is stored with the metadata by closed captioning features of MPEG video encoding standard as implemented by the streaming server.

20. The system of claim 1 further comprising:

a video wall; and

at least one decoder associated with the video wall and in communication with the network switch, the at least one decoder configured to receive and decode network packet streams routed by the streaming video server for display on the video wall, thereby enabling access to live videos captured from the plurality of locations.

21. The system of claim 20 wherein the video wall is configured to display data corresponding to at least one of the plurality of locations, the data comprising one of video, audio and metadata corresponding to the at least one of the locations.

22. The system of claim 20 wherein the network packet streams routed to the video wall comprise at least two different network packet streams, respectively containing data captured from at least two different sources in the at least one medical treatment location.

23. The system of claim 20 wherein the network packet streams routed to the video wall comprise at least one network packet stream containing data captured by at least one streaming device at the at least one medical treatment location and at least a second network packet stream containing data captured by at least a second streaming device at a second location of the plurality of locations.

24. The system of claim 20 wherein the network packet streams are synchronized with metadata including clinically relevant information corresponding to a state of the at least one medical treatment location.

25. The system of claim 1, wherein the communication channel is further configured to provide for a multicast video distribution model such that a single network packet stream from one of the plurality of locations is routed towards a plurality of remote users for contemporaneous display, thereby providing for substantially real-time access by the plurality of remote users to the single network packet stream.

26. The system of claim 1 wherein the at least one streaming device is further configured to receive audio signals and video signals associated with the at least one source and convert the received audio signals together with the received video signals into the network packet stream.

27. The system of claim 1, wherein the plurality of locations comprises at least one of a plurality of operating rooms and wherein, for each of the plurality of operating rooms, the system further comprises:

a video switch in communication with at least one video source located in the operating room and at least one streaming device associated with the operating room; and

a switch controller configured to control the video switch.

28. The system of claim 27, wherein:

the plurality of locations further comprises at least one conference room, the conference room having at least one decoder and at least one streaming device associated therewith;

each of the plurality of operating rooms having at least one decoder in communication with a respective video switch and configured for decoding network packet streams; and

a streaming server that is configured to provide for point-to-point bi-directional video communications between the at least one conference room and the plurality of operating rooms.

29. The system of claim 27, wherein the streaming video server is further configured to provide for point-to-point bi-directional video communications between at least two of the plurality of operating rooms.

30. The system of claim 1 wherein each of the plurality of locations comprise a room in a hospital environment network.

31. The system of claim 1 wherein each of the plurality of locations include one of:

an emergency room (ER), an operating room (OR), a conference room, a pathology lab, and an office.

32. The system of claim 1 wherein all of the plurality of locations are within one room of a hospital environment network.

33. The system of claim 1, wherein the at least one streaming device comprises at least one of:

a standalone video encoder, a standalone video streamer, a video encoding and streaming computer, a digital streaming camera, and a camera processor.

34. The system of claim 1, wherein the streaming video server is further configured to provide a network-based remote control interface that enables operating room control systems associated with the plurality of rooms to create and control connections between at least one of the plurality of video sources, request creation of communications between the plurality of operating rooms, and communicate on the hospital data network.

35. The system of claim 1, wherein the streaming video server is further configured to provide user interface that enables selection between a view-only communications channel and bi-directional communications channel by at least one of:

a remote user and a user of an operating room.

36. The system of claim 1 further comprising a switch controller that determines a state of the at least one medical treatment location and communicates the state of the at least one medical treatment location through the communication channel.

37. The system of claim 1 wherein the streaming video control server determines a state of at least one of the at least one streaming device at the at least one medical treatment location, the source and the at least one medical treatment location based upon input from a remote location to perform system diagnostics.

40. The system of claim 1 wherein the communication channel comprises a bi-directional channel arrangement for communication between the at least one user and the at least one medical treatment location so that live video data is transmitted between the at least one user and the at least one medical treatment location.

41. The system of claim 40 wherein the bi-directional channel arrangement comprises a first one-way communication channel from the at least one user to the at least one medical treatment location and a second one-way communication channel from the at least one medical treatment location to the at least one user.

42. The system of claim 1 further comprising at least another streaming device associated with at least another of the plurality of locations, the at least one streaming device such that a bi-directional communication channel arrangement is established by the streaming video control server between the at least one medical treatment location and the at least another location.

43. The system of claim 1 wherein the streaming video control server monitors the communication channel by controlling user access to the communication channel.

44. The system of claim 1 wherein the streaming video control server controls the communication channel by regulating user access to the communication channel in support of HIPAA compliance.

45. The system of claim 1 wherein the streaming video control server further monitors the communication channel once the communication channel has been established to track access to the communication channel.

46. The system of claim 1 wherein the streaming video control server authenticates the at least one of a plurality of users to the managed streaming medical video network system by one of a log-in page and a username and password.

47. The system of claim 1 wherein the streaming video control server authenticates the at least one of a plurality of users to the managed streaming medical video network system so that the user is granted access to live video data.

49. The system of claim 1 wherein the status of the medical treatment location comprises at least one of:

an operating room status, a privacy status of the medical treatment location, a patient presence in the medical treatment location, a staff presence in the medical treatment location, a patient anesthesia status in the medical treatment location, a cut skin status at the medical treatment location, a status of the at least one streaming device and a presence of the at least one streaming device.

50. The system of claim 1 wherein the status of the medical treatment location comprises a privacy status of the medical treatment location.

51. The system of claim 1 wherein the communication channel comprises a TCP/IP network.

52. The system of claim 1 wherein the streaming video control server additionally tracks an overall state of the medical treatment location.

57. The system of claim 1 wherein the medical treatment location comprises an operating room and the room status comprises an operating room status that is collected from a network based software service.

58. The system of claim 57 wherein the operating room status is synchronized with the network packet and delivered to remote users.

59. The system of claim 1 wherein medical personnel at the medical treatment location control access to the plurality of medical video sources at the medical treatment location that provide security control to assist the medical treatment location in being HIPAA compliant.

60. The system of claim 59 wherein the at least one user is granted access via the communication channel to control the at least one streaming device in the medical treatment location, wherein the at least one streaming device comprises a controllable operating room camera.

61. The system as set forth in claim 28 wherein the operating room video decoder is controlled to show a current state of the medical treatment location.

62. The system as set forth in claim 61 wherein the current state comprises privacy mode enabled.

63. The system as set forth in claim 61 wherein the current state comprises using microscope.

64. The system as set forth in claim 1 wherein the at least one streaming device captures video simultaneously with state and status metadata information, by collecting patient vital signs information from a network-based software service and transmitting patient vital signs information, which is overlaid onto the video as it is being viewed by the at least one user at a remote location.

38. A system for enabling bi-directional video communications among a plurality of operating rooms in a hospital environment connected by a streaming video network, the system comprising:

a streaming control server;

a network switch in communication with the streaming control server; and

for each of the plurality of operating rooms;

at least one video decoder in communication with the network switch and at least one display device; and

at least one streaming device in communication with the network switch and one of a plurality of video sources located in the operating room, wherein the at least one source of the plurality of sources comprises a medical video source that views a procedure, the procedure comprising one of a surgical procedure, a diagnostic procedure, and a therapeutic procedure;

wherein the streaming control server is configured to;

(a) authenticate at least one of a plurality of users to the managed streaming medical video network system;

(b) establish a bi-directional communications channel between a first operating room and a second operating room of the plurality of operating rooms upon receiving a corresponding request by;

transmitting a first message toward a video encoder associated with the first operating room;

configuring the video encoder associated with the first operating room to select and encode a video stream;

transmitting a second message toward a video decoder associated with the second operating room; and

configuring the video decoder associated with the second room to receive and decode a video stream encoded by a video encoder associated with the first operating room; and

(c) provide the network packet stream to the at least one user such that, once the at least one user has been authenticated to the system, the at least one user can view the live video data contained in the network packet stream;

(d) track a status of the first operating room, the status of the first operating room comprising one of a room status and a patient status; and

wherein the at least one streaming device captures video simultaneously with state and status metadata information, by collecting patient information from a network-based software service and transmitting patient information, which is overlaid onto the video as it is being viewed by the at least one user at a remote location.

39. The system of claim 38, wherein the receiving a corresponding request further comprises:

transmitting a third message toward a video encoder associated with the second operating room;

configuring the video encoder associated with the second operating room to select and encode a video stream;

transmitting a fourth message toward a video decoder associated with the first operating room; and

configuring the video decoder associated with the first room to receive and decode a video stream encoded by a video encoder associated with the second operating room.

48. The system of claim 38 wherein the streaming control server is further configured to monitor the communication channel once the communication channel has been established to track access to the communication channel.

53. A streaming managed medical video network system for enabling access on a medical network to live video data captured from a plurality of locations, the system comprising:

means for receiving live video data from at least one source of a plurality of sources located in at least one medical treatment location, wherein the at least one source of the plurality of sources comprises a medical video source that views one of a surgical procedure, a diagnostic procedure, and a therapeutic procedure, performed at the at least one medical treatment location;

means for converting the live video data received from the at least one of the plurality of sources into a network packet stream;

means for authenticating at least one of a plurality of users to the managed streaming medical video network system;

means for directing each network packet stream through a communication network towards the at least one user for enabling access by the at least one user to the network packet stream;

means for tracking a room status of the medical treatment location during one of the surgical procedure, the diagnostic procedure and the therapeutic procedure;

means for providing the network packet stream and the room status of the medical treatment location to the at least one user such that, once the user has been authenticated to the managed streaming medical video network system, the at least one user can view the live video data contained in the network packet stream and the room status of the medical treatment location; and

means for capturing video simultaneously with state and status metadata information, by collecting patient information from a network-based software service and transmitting patient information, which is overlaid onto the video as it is being viewed by the at least one user at a remote location.

54. The system of claim 53 wherein the room status comprises at least one of:

an operating room status, a privacy status of the medical treatment location, a patient presence in the medical treatment location, a staff presence in the medical treatment location, a patient anesthesia status in the medical treatment location, a cut skin status at the medical treatment location, a status of the at least one streaming device and a presence of the at least one streaming device.

55. The system of claim 53 wherein the room status comprises a privacy status of the medical treatment location.

56. The system of claim 53 further comprising means for tracking an overall state of the medical treatment location.