Identity-based face and voice recognition to regulate content rights and parental controls using consumer profiles

• US 10,178,432 B2
• Filed: 05/18/2017
• Issued: 01/08/2019
• Est. Priority Date: 05/18/2017
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Richman, Steven
• Primary Examiner(s): Smith, Chenea
• Application Number:
  US15/599,193
• Publication Number:
  US 20180338178A1
• Time in Patent Office: 600 Days
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/50 Maintenance of biometric data or enrolment thereof
• CPC Class Codes: G06V 40/67 by interactive indications to the user
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 17/04 Training, enrolment or model building
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4415 using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4627 Rights management associated to the content security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/47805 Electronic banking banking in general G06Q30/02
• CPC Class Codes: H04N 21/47815 Electronic shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12
• CPC Class Codes: H04N 21/4786 e-mailing message switching systems, e.g. electronic mail systems H04L51/00

Abstract

A viewer'"'"'s rights to view content is determined instantly, without exposing any data externally, by capturing both a facial image and speech of the viewer. The data, which can be captured each viewing session, is matched to a secure profile which may have other security information assigned to it, such as service login IDs and passwords, or credit card numbers. If both the facial image and voice match respective templates, the viewer is allowed access to, e.g., cloud-based content (such as email) or is allowed to make a purchases within applications via account level access. Banking transactions may similarly be permitted upon face/voice match without the need to input a code. Personalization of content based on profiles recognized automatically during a viewing session is also facilitated.

Claims

1. A system comprising:

at least one camera on an audio video device (AVD);

at least one microphone; and

circuitry configured to;

receive at least one image from the camera;

compare the image to an image template associated with a first user;

receive a signal from the microphone;

compare the signal to a voice template associated with the first user;

responsive to both the image satisfying a criteria for matching the image template and the signal satisfying a criteria for matching the voice template, grant access to the first user of at least one computer feature of the AVD;

responsive to either the image not satisfying a criteria for matching the image template or the signal not satisfying a criteria for matching the voice template, not grant access to the first user of the at least one computer feature;

the computer feature of the AVD comprising at least one security profile for screening out inappropriate content, commercials, and games from being watched, for determining rights to view specific content, and for personalizing viewing experience to the user, the circuitry being configured for determining the first user'"'"'s rights to view content without exposing any data externally to automate TV viewing, while the first user has full control over the security profile, the security profile further being associated with a service login identification and password, at least one or credit card number to allow for instant access to cloud based content or making purchases within applications, wherein image and voice authentication and secure profile creation facilitates viewing content on the AVD without having to constantly input credentials in the open or logging into an online account every time a payment for an application, piece of content, or service is required.

2. The system of claim 1, wherein the microphone is on an audio video device.

3. The system of claim 1, wherein the microphone is on a remote control (RC).

4. The system of claim 1, wherein the microphone is on a digital voice assistant (DVA).

5. The system of claim 1, wherein the circuitry is configured to:

establish the voice template at least in part by prompting a user to speak into the microphone.

6. The system of claim 1, wherein the circuitry is configured to:

establish the voice template at least in part by prompting a user to speak predetermined words into the microphone.

7. The system of claim 1, wherein the circuitry is configured to:

establish the image template at least in part by prompting a user to look into the camera.

8. The system of claim 1, wherein the at least one computer feature is a user account with a viewing profile associated with the first user.

9. The system of claim 1, wherein the at least one computer feature is a user financial account.

10. An assembly comprising:

at least one processor; and

at least one computer storage with instructions executable by the at least one processor for;

receiving at least one image from a camera;

comparing the image to an image template associated with a first user;

activating voice recognition for receiving a signal from a microphone;

comparing the signal to a voice template associated with the first user;

responsive to both the image matching the image template and the signal matching the voice template, granting access to the first user of at least one computer feature of at least one audio video device (AVD);

responsive to either the image not matching the image template or the signal not matching the voice template, not granting access to the first user of the at least one computer feature, the computer feature of the AVD comprising at least one security profile for screening out inappropriate content, commercials, and games from being watched, for determining rights to view specific content, and for personalizing viewing experience to the user, the instructions being executable for determining the first user'"'"'s rights to view content without exposing any data externally to automate TV viewing, while the first user has full control over the security profile, the security profile further being associated with a service login identification and password, at least one or credit card number to allow for instant access to cloud based content or making purchases within applications, wherein image and voice authentication and secure profile creation facilitates viewing content on the AVD without having to constantly input credentials in the open or logging into an online account every time a payment for an application, piece of content, or service is required.

11. The assembly of claim 10, wherein the camera includes at least one complementary metal-oxide-semiconductor (CMOS) camera with contrast auto-focus to establish a maximal contrast between adjacent pixels.

12. The assembly of claim 10, wherein the at least one computer feature includes access to a user profile for an audio video device (AVD).

13. The assembly of claim 12, wherein the camera is on the AVD.

14. The assembly of claim 12, wherein comparing the image to the image template and comparing the signal to the voice template are executed periodically after the AVD is energized.

15. The assembly of claim 10, wherein the microphone is on a remote control (RC).

16. The assembly of claim 10, wherein the microphone is on a digital voice assistant (DVA).

17. The assembly of claim 10, wherein the instructions are executable for:

establishing the voice template at least in part by prompting a user to speak predetermined words into the microphone.

18. The assembly of claim 10, wherein the at least one computer feature includes access to a user financial account.

19. A method, comprising:

determining, using at least one computer, whether speech matches a voice template associated with a user;

determining, using at least one computer, whether an image of a person matches a facial template associated with the user;

granting the person access to a computer-based account of the user responsive to the speech matching the voice template and the image matching the facial template;

not granting the person access to the account of the user responsive to the speech not matching the voice template or the image matching the facial template; and

the account being associated with an audio video device (AVD) and comprising at least one security profile for screening out inappropriate content, commercials, and games from being watched, for determining rights to view specific content, and for personalizing viewing experience to the user, the method further determining the first user'"'"'s rights to view content without exposing any data externally to automate TV viewing, while the first user has full control over the security profile, the security profile further being associated with a service login identification and password, at least one or credit card number to allow for instant access to cloud based content or making purchases within applications, wherein image and voice authentication and secure profile creation facilitates viewing content on the AVD without having to constantly input credentials in the open or logging into an online account every time a payment for an application, piece of content, or service is required.