Automatic display of user-specific financial information based on audio content recognition

• US 9,191,707 B2
• Filed: 11/08/2012
• Issued: 11/17/2015
• Est. Priority Date: 11/08/2012
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Jones, Alicia C., Perkins, Matthew, Burgess, James E.
• Primary Examiner(s): Jackson, Jakieda
• Application Number:
  US13/672,402
• Publication Number:
  US 20140129232A1
• Time in Patent Office: 1,104 Days
• Field of Search: 704/275
• US Class Current: 1/1
• CPC Class Codes: G06Q 40/12 Accounting
• CPC Class Codes: H04H 60/46 for recognising users' preferences
• CPC Class Codes: H04H 60/58 of audio determination or detection of speech characteristics in general G10L25/00; speech recognition in general G10L15/00
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/251 Learning process for intelligent management, e.g. learning user preferences for recommending movies details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08
• CPC Class Codes: H04N 21/25875 involving end-user authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; arrangements for secret or secure communication including means for verifying the identity or authority of a user of the system H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/42676 for modulating an analogue carrier signal to encode digital information or demodulating it to decode digital information, e.g. ADSL or cable modem
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4415 using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4753 : for user identification, e.g. by entering a PIN or password cryptographic authentication protocols H04L9/32; networks authentication protocols H04L63/08
• CPC Class Codes: H04N 21/47805 : Electronic banking banking in general G06Q30/02
• CPC Class Codes: H04N 21/6581 : Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application

Abstract

Aspects herein describe at least a new method, system, and computer readable storage media for recognizing the content of the audio. A computing device determines whether the content comprises one or more financial products and services offered by a financial institution, correlates the one or more financial products and services with a profile of a person, determines a subset of the one or more financial products and services that are of interest to the person based on the correlation, and transmits data related to the subset to a television for viewing by the person. The subset of the one or more products and services are displayed on a portion of the screen of the television.

Claims

1. A system comprising:

a multimedia viewing device generating audio content including an audio signal, the multimedia viewing device having a display and at least a first processor, at least a first memory for storing computer executable instructions that, when executed by the at least a first processor, cause the multimedia viewing device to;

identify a viewer of the multimedia viewing device based on facial recognition of the viewer,

wherein said multimedia viewing device provides a split screen view on the display of the multimedia viewing device, the split screen view including a first portion and a second portion;

a wireless communication device paired to the multimedia viewing device, the wireless computing device including;

at least a second processor; and

at least a second memory for storing computer executable instructions, that, when executed by the at least a second processor cause the wireless computing device to;

process the audio signal received from the multimedia viewing device having a display, to perform audio content recognition of said audio signal;

determine whether said recognized audio content comprises one or more products or services provided by a financial institution;

correlate said one or more products or services with a financial profile of the identified viewer of the multimedia viewing device, the viewer being associated with the wireless communication device, the financial profile including financial characteristics of the viewer;

determine a subset of said one or more products or services, the subset representing products or services that are provided by the financial institution and are of interest to said viewer based on said correlation exceeding a predetermined threshold; and

transmit data associated with said subset from the wireless communication device to the multimedia viewing device from which the audio content was generated for displaying said subset on the display of the multimedia viewing device from which the audio was generated, the subset being displayed on one of the first portion and the second portion simultaneously with content displayed on the other of the first portion and the second portion, the content displayed on the other of the first portion and the second portion being content from which the audio content was received.

2. The system of claim 1 wherein said audio content recognition is performed at one of:

a) the wireless communication device and b) a server.

3. The system of claim 1 wherein said multimedia viewing device comprises a smart television and wherein said audio signal is generated by said smart television.

4. The system of claim 1 wherein said financial profile includes a list of products and services in which said viewer is interested.

5. The system of claim 1, wherein the financial profile of the viewer includes a type of financial investment the viewer currently has.

6. The system of claim 1, wherein the financial profile of the viewer includes a predetermined interest level of the viewer in one or more products or services offered by an entity.

7. The system of claim 6, wherein the predetermined interest levels are determined based on historical information of the viewer.

8. A method comprising:

identifying, by a multimedia viewing device having a display, a viewer of the display, wherein said multimedia viewing device provides a split screen view on the display of the multimedia viewing device, the split screen view including a first portion and a second portion;

receiving, by a wireless communication device having a least one processor from the multimedia viewing device, audio content generated by the multimedia viewing device, the audio content including an audio signal, the wireless communication device being paired to the multimedia viewing device;

performing, by the wireless communication device, audio content recognition of the audio signal from the audio content generated by the multimedia viewing device;

first determining whether said recognized audio content describes one or more products or services provided by a financial institution;

correlating said one or more products or services with a financial profile of the viewer of the multimedia viewing device, the viewer being associated with the wireless communication device, the financial profile including financial characteristics of the viewer;

second determining a subset of said one or more products or services representing products or services that are provided by the financial institution and are of interest to said viewer based on said correlation exceeding a predetermined threshold; and

transmitting data associated with said subset from the wireless communication device to the multimedia viewing device from which the audio content was generated for displaying said subset on a display of the multimedia viewing device, the subset being displayed on one of the first portion and the second portion simultaneously with content displayed on the other of the first portion and the second portion, the content displayed on the other of the first portion and the second portion being content from which the audio content was received.

9. The method of claim 8 wherein said wherein said audio content recognition is performed at one of:

a) the wireless communication device and b) said server.

10. The method of claim 8 wherein said multimedia viewing device comprises a smart television and wherein said audio signal is generated by said smart television.

11. The method of claim 8 wherein said financial profile includes a list of products and services in which said viewer is interested.

12. A non-transitory computer-readable storage media having stored thereon, a computer program having at least one code section for processing data, said at least one code section being executable by one or more processors of one or more computing devices for causing said one or more computing devices to:

identify, by a multimedia viewing device having a display, a viewer of the multimedia viewing device, wherein said multimedia viewing device provides a split screen view on the display of the multimedia viewing device, the split screen view including a first portion and a second portion;

receive, by a wireless communication device from the multimedia viewing device, audio content generated by the multimedia viewing device, the audio content including an audio signal, the wireless communication device being paired to the multimedia viewing device;

process, by the wireless communication device, the audio signal from the audio content generated by the multimedia viewing device to perform audio content recognition of said audio signal;

determine whether said recognized audio content comprises one or more products or services provided by a financial institution;

correlate said one or more products or services with a financial profile of the viewer of the multimedia viewing device, the viewer being associated with the wireless communication device, the financial profile including financial characteristics of the viewer;

determine a subset of said one or more products or services representing products or services that are provided by the financial institution and are of interest to said viewer based on said correlation exceeding a predetermined threshold; and

transmit data associated with said subset from the wireless communication device to the multimedia viewing device from which the audio content was generated for displaying said subset on a display of the multimedia viewing device, the subset being displayed on one of the first portion and the second portion simultaneously with content displayed on the other of the first portion and the second portion, the content displayed on the other of the first portion and the second portion being content from which the audio content was received.

13. The non-transitory computer-readable storage media of claim 12 wherein said audio content recognition is performed at one of:

a) the wireless communication device and b) a server.

14. The non-transitory computer-readable storage media of claim 12 wherein said multimedia viewing device is a smart television and the audio signal is generated by said smart television.

15. The non-transitory computer-readable storage media of claim 12 wherein said financial profile includes a list of products and services in which said viewer is interested.