Methods and systems for cataloging text in a recorded session

• US 8,615,159 B2
• Filed: 09/20/2011
• Issued: 12/24/2013
• Est. Priority Date: 09/20/2011
• Status: Active Grant

• Current Assignee: Citrix Systems, Inc. (Cloud Software Group)
• Original Assignee: Citrix Systems, Inc. (Cloud Software Group)
• Inventors: Ryman, Paul, Feijoo, Ricardo Fernando, Nagubadi, Anil
• Primary Examiner(s): CHIO, TAT CHI
• Application Number:
  US13/237,047
• Publication Number:
  US 20130071085A1
• Time in Patent Office: 826 Days
• Field of Search: 386/200, 386/239, 386/244, 386/245, 386/246, 386/248, 386/330
• US Class Current: 386/244
• CPC Class Codes: H04N 21/2393 involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 5/91 Television signal processing therefor

Abstract

Systems and methods described herein disclose searching the content of a recorded presentation layer protocol session including the steps of storing, a plurality of packets sent to a client device, rendering, by a protocol engine, at least one stored packet in the plurality of stored packets to a local video buffer and analyzing the at least one rendered packet with wherein analyzing includes at least scanning the at least one rendered packet with an optical character recognizer executing on the server. The systems and methods described herein also disclose using the optical character recognizer to generate a word associated with the at least one packet, using a post processing component to generate identification data associated with the generated word associated with the at least one packet, and storing the generated word associated with the at least one packet and storing the identification data associated with the generated word.

Claims

1. A method for searching the content of a recorded presentation layer protocol session, the method comprising:

intercepting, by a recorder, a plurality of packets sent from a server device to a client device;

storing the plurality of intercepted packets;

rendering, by a protocol engine, at least one stored packet in the plurality of stored packets to a local video buffer;

analyzing the at least one rendered packet, wherein analyzing includes at least scanning the at least one rendered packet with an optical character recognizer executing on a server;

using the optical character recognizer to generate a word associated with the at least one packet;

using a post processing component to generate identification data associated with the generated word associated with the at least one packet, the identified data indicating a position of the generated word in the plurality of packets; and

storing the generated word associated with the at least one packet and storing the identification data associated with the generated word in a database, to provide an index to the generated word and identified data in the database.

2. The method of claim 1, further comprising identifying, by the protocol engine, the at least one stored packet of the plurality of packets to be rendered to a local video buffer.

3. The method of claim 1, wherein the identification data generated by the post-processing component includes bounding rectangle information for the generated word associated with the at least one stored packet of the plurality of stored packets.

4. The method of claim 3, wherein the position of the generated word includes a time position, and wherein the identification data generated by the post-processing component includes the time position of the word associated with the at least one packet.

5. The method of claim 4, wherein the time position of the word comprises an initial time position of the word as well as a time duration of the word.

6. The method of claim 4, further comprising highlighting, by a video playing device, the generated word using the time position, spatial position, width, and height data associated with the at least one stored packet of the plurality of stored packets.

7. The method of claim 1, further comprising querying the database using a search engine with a target word matching the generated word.

8. The method of claim 7, further comprising marking packets associated with generated words that match the target word.

9. The method of claim 8, further comprising selectively transmitting data contained in the marked packets to a display device by a video playing device.

10. A system for searching the content of a recorded presentation layer protocol session, the system comprising:

a recorder configured to intercept a plurality of packets sent to a client device;

a storage device configured to store the plurality of packets sent to the client device;

a protocol engine, configured to render at least one stored packet in the plurality of stored packets to a local video buffer;

an optical character recognizer executing on a server configured to analyze the at least one rendered packet wherein analyzing includes at least scanning the at least one rendered packet to generate a word associated with the at least one packet;

a post processing component configured to generate identification data associated with the generated word associated with the at least one packet, the identified data indicating a position of the generated word in the plurality of packets; and

a database configured to store the generated word associated with the at least one packet and also configured to store the identification data associated with the generated word, to provide an index to the generated word and identified data in the database.

11. The system of claim 10, further comprising the protocol engine configured to identify the at least one stored packet of the plurality of packets to be rendered to a local video buffer.

12. The system of claim 10, wherein the identification data generated by the post-processing component includes bounding rectangle information for the generated word associated with the at least one stored packet of the plurality of stored packets.

13. The system of claim 12, wherein the position of the generated word includes a time position, and wherein the identification data generated by the post-processing component includes the time position of the word associated with the at least one packet.

14. The system of claim 13, wherein the time position of the word comprises an initial time position of the word as well as a time duration of the word.

15. The system of claim 13, further comprising a video playing device configured to highlight the generated word using the time position, spatial position, width, and height information associated with the at least one packet of the plurality of packets.

16. The system of claim 10, further comprising a search engine configured to query the database with a target word matching the generated word.

17. The system of claim 16, further comprising a protocol engine configured to mark packets associated with generated words that match the target word.

18. The system of claim 17, further comprising a video playing device configured to selectively transmit data contained in the marked packets to a display device.