Hand-held electronic apparatus, audio video broadcasting apparatus and broadcasting method thereof

• US 9,992,532 B1
• Filed: 01/11/2017
• Issued: 06/05/2018
• Est. Priority Date: 01/11/2017
• Status: Active Grant

• Current Assignee: HTC Corporation
• Original Assignee: HTC Corporation
• Inventors: Cheng, Chih-Chiang, Lee, Chun-Min, Tong, Hann-Shi, Chen, Lei, Huang, Chin-Kuo, Yang, Hsiu-Po
• Primary Examiner(s): Flynn, Nathan
• Assistant Examiner(s): Fogg, Cynthia
• Application Number:
  US15/403,191
• Time in Patent Office: 510 Days
• Field of Search: 725116, 725750, 725753, 725756, 725758, 715750, 715753, 715756, 715758
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4396 by muting the audio signal
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/6106 specially adapted to the downstream path of the transmission network
• CPC Class Codes: H04R 2201/40 Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
• CPC Class Codes: H04R 2430/01 Aspects of volume control, not necessarily automatic, in sound systems
• CPC Class Codes: H04R 2499/11 Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
• CPC Class Codes: H04S 2400/13 Aspects of volume control, not necessarily automatic, in stereophonic sound systems
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Abstract

An audio and video broadcasting apparatus includes a plurality of sound signal capturing devices, an image capturing device, a controller, and a speaker. The sound signal capturing devices capture a plurality of sound signals. The image capturing device obtains a display image. The controller is configured to: divide the display image into a plurality of display regions; establish a correspondence between the disposition positions and relative positions of the display regions; receive a playback setting command of a selected region, and set a playing weight of each of the display regions according to the playback setting command; and adjust a volume playback setting corresponding to the sound signals according to the playing weight of each of the display regions and the correspondence, and generate an output sound signal according to the volume playback setting and the sound signals. The speaker performs a sound playing action.

Claims

1. An audio and video broadcasting apparatus, comprising:

a plurality of sound signal capturing devices, disposed at a plurality of disposition positions of the audio and video broadcasting apparatus and configured to respectively capture a plurality of sound signals in an environment;

an image capturing device, which captures an image in the environment to obtain a display image;

a controller, coupled to the sound signal capturing devices and the image capturing device and configured to;

divide the display image into a plurality of display regions;

set a reference plane according to an image capturing direction of the image capturing device, and divide the reference plane into a plurality of sector regions with a sound receiving point on the reference plane as a central point according to different angles based on the central point;

calculate a plurality of projection positions of the sound signal capturing devices on the reference plane according to the disposition positions, and generate a correspondence between the disposition positions and relative positions of the display regions according to each of the sector regions corresponding to each of the projection positions;

receive a playback setting command corresponding to a selected region among the display regions, and set a playing weight of each of the display regions according to the playback setting command; and

adjust a volume playback setting corresponding to the sound signals according to the playing weight of each of the display regions and the correspondence, and generate an output sound signal according to the volume playback setting and the sound signals; and

a speaker, which performs a sound playback action according to the output sound signal.

2. The audio and video broadcasting apparatus according to claim 1, wherein the controller performs a sound signal conversion action directed to the sound signal according to the playing weight and the projection positions and generates the output sound signal of stereo sound.

3. The audio and video broadcasting apparatus according to claim 1, wherein the controller performs the sound signal conversion action according to a head-related transfer function.

4. The audio and video broadcasting apparatus according to claim 1, wherein the controller makes, according to the playback setting command, a playing weight of the selected region improved and playing weights of the display regions that are not the selected region lowered.

5. The audio and video broadcasting apparatus according to claim 1, further comprising:

an image display, configured to display the display image, wherein;

the controller enables, according to the playback setting command, the image display to perform an enlarged display action on the selected region.

6. The audio and video broadcasting apparatus according to claim 5, wherein when the selected region changes from a first display region to a second display region, the image display changes to perform a display action of enlarging a second display region.

7. The audio and video broadcasting apparatus according to claim 5, wherein the image display is further configured to display an operation interface, wherein:

the operation interface is configured to receive the playback setting command.

8. The audio and video broadcasting apparatus according to claim 7, wherein the controller performs a characteristic identification action directed to the display image to generate the operation interface.

9. A hand-held electronic apparatus, comprising:

a body; and

the audio and video broadcasting apparatus according to claim 1, disposed inside the body, wherein;

the disposition positions of the sound signal capturing devices respectively correspond to a plurality of side surfaces of the body.

10. An audio and video broadcasting method, comprising:

capturing a plurality of sound signals in an environment at a plurality of disposition positions of an audio and video broadcasting apparatus;

capturing an image in the environment to obtain a display image;

dividing the display image into a plurality of display regions;

setting a reference plane according to an image capturing direction of the image capturing device, and dividing the reference plane into a plurality of sector regions with a sound receiving point on the reference plane as a central point according to different angles based on the central point;

calculating a plurality of projection positions of the sound signal capturing devices on the reference plane according to the disposition positions, and generating a correspondence between the disposition positions and relative positions of the display regions according to each of the sector regions corresponding to each of the projection positions;

receiving a playback setting command corresponding to a selected region among the display regions, and setting a playing weight of each of the display regions according to the playback setting command;

adjusting a volume playback setting corresponding to the sound signals according to the playing weight of each of the display regions and the correspondence, and generating an output sound signal according to the volume playback setting and the sound signals; and

performing a sound playback action according to the output sound signal.

11. The audio and video broadcasting method according to claim 10, wherein step of adjusting the volume playback setting corresponding to the sound signals according to the playing weight of each of the display regions and the correspondence, and generating an output sound signal according to the volume playback setting and the sound signals comprises:

performing a sound signal conversion action directed to the sound signal according to the playing weight and the projection positions and generating the output sound signal of stereo sound.

12. The audio and video broadcasting method according to claim 11, wherein step of performing the sound signal conversion action directed to the sound signal and generating the output sound signal of stereo sound comprises:

performing the sound signal conversion action according to a head-related transfer function to generate the output sound signal of stereo sound.

13. The audio and video broadcasting method according to claim 10, wherein step of receiving the playback setting command corresponding to the selected region among the display regions, and setting the playing weight of each of the display regions according to the playback setting command comprises:

making, according to the playback setting command, a playing weight of the selected region improved and playing weights of the display regions that are not the selected region lowered.

14. The audio and video broadcasting method according to claim 10, further comprising:

providing an image display, configured to display the display image; and

enabling, according to the playback setting command, the image display to perform an enlarged display action on the selected region.

15. The audio and video broadcasting method according to claim 14, further comprising:

when the selected region changes from a first display region to a second display region, enabling the image display to change to perform a display action of enlarging a second display region.

16. The audio and video broadcasting method according to claim 10, further comprising:

providing the image display to display an operation interface, wherein the operation interface is configured to receive the playback setting command.

17. The audio and video broadcasting method according to claim 16, further comprising:

performing a characteristic identification action directed to the display image to generate the operation interface.