Method and apparatus for securing computer video and audio subsystems

• US 10,489,657 B2
• Filed: 12/31/2015
• Issued: 11/26/2019
• Est. Priority Date: 03/04/2013
• Status: Active Grant

• Current Assignee: Janus Technologies, Inc.
• Original Assignee: Janus Technologies, Inc.
• Inventors: Porten, Joshua, Raskin, Sofin, Wang, Michael, Chin, Shaoan, Indenbaum, Alexander
• Primary Examiner(s): Zhao, Daquan
• Application Number:
  US14/986,504
• Publication Number:
  US 20160117558A1
• Time in Patent Office: 1,426 Days
• Field of Search: 348 1401, 348 141, 348 1408, 348 1409, 348 1413, 348143, 348169, 348142, 386260, 386259, 386257
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 2201/0065 Extraction of an embedded watermark; Reliable detection
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/197 Matching; Classification
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04N 2005/91335 the copy protection signal being a watermark
• CPC Class Codes: H04N 21/2347 involving video stream encryption
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4353 involving decryption of additional data arrangements using cryptography for the use of broadcast information or broadcast-related information H04H60/23
• CPC Class Codes: H04N 21/43635 HDMI
• CPC Class Codes: H04N 21/4367 Establishing a secure communication between the client and a peripheral device or smart card
• CPC Class Codes: H04N 5/913 for scrambling ; for copy protection
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 9/8042 involving data reduction
• CPC Class Codes: H04N 9/806 with processing of the sound signal

Abstract

In general, embodiments of the invention include methods and apparatuses for securing otherwise unsecured computer audio and video subsystems. Embodiments of the invention perform watermarking of video and/or audio data streams output by a computer system. Additional security features that are included in embodiments of the invention include fingerprinting, snooping, capturing streams for local or remote analytics or archiving, and mixing of secure system content with local audio and video content.

Claims

1. A computing device comprising:

a host processor subsystem including a CPU and a video subsystem for producing a video output for playback and display on an associated video output device, wherein the video output includes first and second different streams produced by an operating system and application software running on the CPU of the host processor subsystem; and

a secure subsystem that receives the video output from the host processor subsystem and controls an actual playback and display of the video output on the associated video output device, wherein the control includes selectively passing the first stream from the host processor to the video output device unchanged, and performing processing on content of the second stream before passing the second stream to the video output device, and

wherein the video output further includes video data produced by an associated video input device, and

wherein the secure subsystem performs analytics on the video data produced by the associated video input device and output from the host processing subsystem, and

wherein the analytics comprise a biometric authentication application that is adapted to determine whether a user of the computing device is authorized to use the computing device based on analysis of the video data, and

wherein the secure subsystem is adapted to prevent use of the computing device by the user if the biometric authentication application determines that the user is not authorized to use the computing device, and

wherein the secure subsystem is adapted to prevent use of the computing device by the unauthorized user by shutting down the computing device, and

wherein the secure subsystem is adapted to shut down the computing device after the user determined by the biometric authentication application to be unauthorized has been present in the video data for a threshold amount of time.

2. A computing device according to claim 1, wherein the associated video input device comprises a video camera.

3. A computing device according to claim 1, wherein the analytics performed by the biometric authentication application comprises performing, using the video data, face recognition of the user.

4. A computing device according to claim 1, wherein the authentication performed by the biometric authentication application comprises performing, using the video data, retina scans of the user.

5. A computing device according to claim 1, wherein the secure subsystem is implemented by one of a FPGA and ASIC that is separate from the host processor subsystem.

6. A method comprising:

producing, by a host processor subsystem including a CPU and an audio and video subsystem, audio and video outputs for playback and display on associated audio and video output devices, wherein the audio and video outputs include first and second different streams produced by an operating system and application software running on the CPU of the host processor subsystem; and

controlling, by a secure audio and video subsystem that receives the audio and video outputs from the host processor subsystem, an actual playback and display of the audio and video outputs on the associated audio and video output devices, wherein controlling includes passing the first stream from the host processor to one or both of the audio and video output devices unchanged, and performing processing on the content of the second stream before passing the second stream to one or both of the audio and video output devices, and

wherein the audio and video outputs further include one or both of audio and video data produced by associated audio and video input devices, respectively, and

wherein the associated audio and video input devices include one or more of a microphone, a still camera, a video camera, and an audio Line In, and

wherein performing processing includes performing analytics on one or more of the audio and video outputs from the host processing subsystem, and

wherein the analytics comprise a biometric authentication application, and

wherein performing processing further includes performing video overlay of one or more video streams not produced by the host processor subsystem in the actual display and playback.

7. A method according to claim 6, further comprising receiving, by a networking block coupled to the secure audio and video subsystem, configuration information that specifies how to control the actual display and playback of the first and second different streams from a remote management system.

8. A method according to claim 6, wherein at least one of the one or more video streams is received by the secure audio and video subsystem from a remote management system.

9. A method according to claim 8, wherein the at least one of the one or more video streams is associated with a video conferencing application.

10. A method according to claim 6, wherein performing processing further includes adding watermarking to one or both of the audio and video outputs from the host processor subsystem before the actual display and playback.

11. A method according to claim 10, wherein the watermarking is not perceptible to a person viewing and/or listening to the actual display and playback.

12. A method according to claim 6, wherein the analytics further include one or more of OCR, application recognition, motion detection, image recognition, image tracking and scene recognition.

13. A method according to claim 6, further comprising, by the secure audio and video subsystem, encoding one or more of the audio and video outputs and sending the encoded one or more outputs to a remote system.

14. A method according to claim 13, wherein the encoding includes compression of the one or more audio and video outputs.

15. A method according to claim 13, wherein the remote system includes one or more of a remote assistance application, a video surveillance application, a desktop sharing application and a desktop recording application.