Method and apparatus for securing computer video and audio subsystems

• US 9,232,176 B2
• Filed: 08/20/2013
• Issued: 01/05/2016
• Est. Priority Date: 03/04/2013
• Status: Active Grant

• Current Assignee: Janus Technologies, Inc.
• Original Assignee: Janus Technologies, Inc.
• Inventors: Porten, Joshua, Raskin, Sofin, Wang, Michael, Chin, Shaoan, Indenbaum, Alexander
• Primary Examiner(s): Zhao, Daquan
• Application Number:
  US13/971,692
• Publication Number:
  US 20140248039A1
• Time in Patent Office: 868 Days
• Field of Search: 348/14.01, 348/14.1, 348/14.08, 348/14.09, 348/14.13, 348/143, 348/169, 348/142, 386/260, 386/259, 386/257
• US Class Current: 1/1
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 2201/0065 Extraction of an embedded watermark; Reliable detection
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/197 Matching; Classification
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04N 2005/91335 the copy protection signal being a watermark
• CPC Class Codes: H04N 21/2347 involving video stream encryption
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4353 involving decryption of additional data arrangements using cryptography for the use of broadcast information or broadcast-related information H04H60/23
• CPC Class Codes: H04N 21/43635 HDMI
• CPC Class Codes: H04N 21/4367 Establishing a secure communication between the client and a peripheral device or smart card
• CPC Class Codes: H04N 5/913 for scrambling ; for copy protection
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 9/8042 involving data reduction
• CPC Class Codes: H04N 9/806 with processing of the sound signal

Abstract

In general, embodiments of the invention include methods and apparatuses for securing otherwise unsecured computer audio and video subsystems. Embodiments of the invention perform watermarking of video and/or audio data streams output by a computer system. Additional security features that are included in embodiments of the invention include fingerprinting, snooping, capturing streams for local or remote analytics or archiving, and mixing of secure system content with local audio and video content.

Claims

1. A computing device comprising:

a host processor subsystem including a CPU and an audio and video subsystem for producing audio and video outputs for playback and display on associated audio and video output devices, wherein the audio and video outputs include first and second different streams produced by an operating system and application software running on the CPU of the host processor subsystem; and

a secure audio and video subsystem that receives the audio and video outputs from the host processor subsystem and controls an actual playback and display of the audio and video outputs on the associated audio and video output devices, wherein the control includes passing the first stream from the host processor to one or both of the audio and video output devices unchanged, and performing processing on the content of the second stream before passing the second stream to one or both of the audio and video output devices; and

wherein the audio and video outputs further include one or both of audio and video data produced by associated audio and video input devices, respectively, and

wherein the associated audio and video input devices include one or more of a microphone, a still camera, a video camera, and an audio Line- In, and

wherein the secure audio and video subsystem performs analytics on one or more of the audio and video outputs from the host processing subsystem, and

wherein the analytics comprise a biometric authentication application, and

wherein the secure audio and video subsystem performs video overlay of one or more video streams not produced by the host processor subsystem in the actual display and playback.

2. A device according to claim 1, wherein the secure audio and video subsystem is implemented by one of a FPGA and ASIC that is separate from the host processor subsystem.

3. A device according to claim 1, further comprising a networking block coupled to the secure audio and video subsystem that receives configuration information that specifies how to control the actual display and playback of the first and second different streams from a remote management system.

4. A device according to claim 1, wherein the one or more video streams is received by the secure video and audio subsystem from a remote management system.

5. A device according to claim 4, wherein the one or more video streams is associated with a video conferencing application.

6. A device according to claim 1, wherein the secure audio and video subsystem adds watermarking to one or both of the audio and video outputs from the host processor subsystem before the actual display and playback.

7. A device according to claim 6, wherein the watermarking is not perceptible to a person viewing and/or listening to the actual display and playback.

8. A device according to claim 6, wherein the watermarking is perceptible to a person viewing and/or listening to the actual display and playback.

9. A device according to claim 1, wherein the analytics include one or more of OCR, application recognition, motion detection, image recognition, image tracking and scene recognition.

10. A device according to claim 1, wherein the secure audio and video subsystem encodes one or more of the audio and video outputs and sends the encoded one or more outputs to a remote system.

11. A device according to claim 10, wherein the encoding includes compression of the one or more audio and video outputs.

12. A device according to claim 11, further including a dedicated chip for performing the compression.

13. A device according to claim 10, wherein the remote system includes one or more of a remote assistance application, a video surveillance application, a desktop sharing application and a desktop recording application.

14. A device according to claim 13, wherein the remote assistance application allows a remote user to take control of input devices of the computing device, including one or both of a keyboard and mouse input device.

15. A device according to claim 13, wherein the video outputs include video from one or more of a camera and a webcam associated with the computing device.

16. A device according to claim 10, further comprising a privacy application that obscures portions of the video outputs before sending the encoded outputs to the remote system.

17. A device according to claim 1, wherein the secure audio and video subsystem performs mixing of one or more audio streams not received from the host processor subsystem in the actual display and playback.

18. A device according to claim 17, wherein the one or more audio streams is received by the secure audio and video subsystem from a remote management system.

19. A device according to claim 18, wherein the one or more audio streams is associated with an audio or video conferencing application.

20. A device according to claim 1, wherein the secure audio and video subsystem performs synchronization between video and audio streams for inclusion in the actual display and playback.

21. A device according to claim 1, wherein the secure audio and video subsystem performs one or both of resizing and repositioning of the video outputs before the actual display.

22. A device according to claim 1, wherein the secure audio and video subsystem performs dynamic resolution changing in accordance with a display resolution of a display associated with the computing device.

23. A device according to claim 1, wherein the secure audio and video subsystem includes a graphics engine to accelerate graphics operations for controlling the actual display.