SOUNDBAR AUDIO CONTENT CONTROL USING IMAGE ANALYSIS

• US 20160014540A1
• Filed: 07/08/2015
• Published: 01/14/2016
• Est. Priority Date: 07/08/2014
• Status: Abandoned Application

• Current Assignee: Pure International Limited (Imagination Technologies Group Ltd.)
• Original Assignee: Imagination Technologies Limited (Imagination Technologies Group Ltd.)
• Inventors: Kelly, Alan, Yassaie, Hossein
• Application Number:
  US14/794,565
• Publication Number:
  US 20160014540A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: H04R 1/403 loud-speakers
• CPC Class Codes: H04S 7/303 Tracking of listener position or orientation

Abstract

A soundbar is described which includes a camera. The camera can be used to capture images of a listener as speakers of the soundbar output audio content to the listener. The captured images can be analysed to determine at least one characteristic of the listener (e.g. the age or gender of the listener). In one example, when the soundbar has determined a characteristic of the listener, the audio content outputted to the listener may be controlled based on the characteristic. In other examples, the images of the listener captured by the camera may be used to detect a response of the listener to media content which includes the audio content outputted from the soundbar. This response information may be combined with an indication of the characteristic of the listener in order to gather information relating to how different types of listeners respond to particular media content.

Claims

1. A soundbar comprising:

a plurality of speakers configured to output audio content to a listener;

a camera configured to capture images of the listener; and

processing logic configured to;

(i) analyse the captured images to determine at least one characteristic of the listener; and

(ii) control the audio content outputted from the speakers to the listener based on the determined characteristic of the listener.

2. The soundbar of claim 1 wherein the at least one characteristic of the listener comprises at least one of an age group of the listener and a gender of the listener.

3. The soundbar of claim 1 wherein the processing logic is configured to analyse the captured images to determine at least one characteristic of the listener by using facial recognition to recognize the listener as one of a set of predefined listeners.

4. The soundbar of claim 3 wherein each of the set of predefined listeners is associated with a content profile, wherein the processing logic is configured to control the audio content outputted from the speakers to the recognized listener in accordance with the content profile of the recognized listener.

5. The soundbar of claim 4 wherein the content profile of a listener comprises at least one of:

(i) a volume range;

(ii) an audio style;

(iii) a language;

(iv) a video style;

(iv) one or more interests of the listener;

(v) an age;

(vi) a gender; and

(vii) restrictions to be applied to audio content.

6. The soundbar of claim 1 wherein the soundbar is coupled to a display which is configured to output visual content in conjunction with the audio content outputted from the speakers of the soundbar.

7. The soundbar of claim 6 wherein the soundbar is configured to provide the visual content to the display for output therefrom, wherein the processing logic is further configured to control the visual content provided to the display for output to the listener based on the determined at least one characteristic of the listener.

8. The soundbar of claim 7 wherein the processing logic is configured to:

analyse the captured images to detect a gaze direction of the listener and to determine if the listener is looking in the direction of the display; and

control at least one of;

(i) the audio content outputted from the speakers, and (ii) the visual content provided to the display, based on whether the listener is looking at the display.

9. The soundbar of claim 1 wherein the processing logic is configured to analyse the captured images to:

determine that a plurality of listeners are present,

detect at least one characteristic of each of the plurality of listeners, and

control the audio content outputted from the speakers based on the detected at least one characteristic of the plurality of listeners.

10. The soundbar of claim 9 wherein the processing logic is configured to separately control the audio content for different listeners.

11. The soundbar of claim 4 wherein the processing logic is configured to separately control the audio content for different listeners, and wherein the processing logic is configured to:

use facial recognition to recognize the plurality of listeners as listeners of the set of predefined listeners; and

control the audio content outputted from the speakers to each of the plurality of listeners in accordance with their content profiles.

12. A method of operating a soundbar comprising:

outputting audio content to a listener from a plurality of speakers of the soundbar;

capturing images of the listener using a camera;

analysing the captured images to determine at least one characteristic of the listener; and

controlling the audio content outputted from the speakers of the soundbar to the listener based on the determined at least one characteristic of the listener.

13. A soundbar comprising:

a plurality of speakers configured to output audio content to a listener;

a camera configured to capture images of the listener; and

processing logic configured to analyse the captured images to determine at least one characteristic of the listener and to detect a response of the listener to media content which includes audio content outputted from the speakers.

14. The soundbar of claim 13 wherein the processing logic is configured to create a data item comprising:

(i) an indication of the determined at least one characteristic, and (ii) an indication of the detected response of the listener to the media content.

15. The soundbar of claim 14 further comprising a data store configured to store the data item.

16. The soundbar of claim 14 further comprising an interface configured to enable the data item to be transmitted from the soundbar over the internet to a remote data store.

17. The soundbar of claim 13 wherein the processing logic is configured to analyse the captured images to detect a response of the listener to media content which includes audio content outputted from the speakers by detecting a mood of the listener by either:

(i) using facial recognition to identify facial features associated with particular moods, or (ii) analysing body language of the listener to identify body language traits associated with particular moods.

18. The soundbar of claim 13 wherein the media content is associated with:

(i) an advertisement, (ii) a news item, or (iii) an entertainment programme.

19. The soundbar of claim 13 wherein the media content further includes visual content, and wherein the soundbar is coupled to a display which is configured to output the visual content in conjunction with the audio content outputted from the speakers of the soundbar, and wherein the processing logic is configured to detect a response of the listener by analysing the captured images to detect a gaze direction of the listener and to determine if the listener is looking in the direction of the display.

20. The soundbar of claim 13 wherein the processing logic is configured to analyse the captured images to:

determine that a plurality of listeners are present,

detect at least one characteristic of each of the plurality of listeners, and

detect a response of each of the plurality of listeners to the media content which includes the audio content outputted from the speakers.