Method for adjusting playback of multimedia content according to detection result of user status and related apparatus thereof

• US 9,367,218 B2
• Filed: 02/12/2015
• Issued: 06/14/2016
• Est. Priority Date: 04/14/2011
• Status: Active Grant

• Current Assignee: Taiwan Semiconductor Manufacturing Company Limited
• Original Assignee: MediaTek, Inc.
• Inventors: Chien, Min-Hung, Fang, Po-Kai
• Primary Examiner(s): ELAHI, SHAN E
• Application Number:
  US14/620,192
• Publication Number:
  US 20150153940A1
• Time in Patent Office: 488 Days
• Field of Search: 715/720, 348/51
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/376 for tracking left-right translational head movements, i.e. lateral movements
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 2213/006 Pseudo-stereoscopic systems, i.e. systems wherein a stereoscopic effect is obtained without sending different images to the viewer's eyes

Abstract

A playback method of a multimedia content includes: receiving the multimedia content; performing playback upon the multimedia content; detecting a user status and accordingly generating a detection result; and automatically adjusting the playback of the multimedia content in response to the detection result. A playback apparatus of a multimedia content includes a receiving block, a playback block, and a detecting block. The receiving block is used for receiving the multimedia content. The playback block is coupled to the receiving block, and used for performing playback upon the multimedia content. The detecting block is coupled to the playback block, and used for detecting a user status and accordingly generating a detection result. The playback block automatically adjusts the playback of the multimedia content in response to the detection result.

Claims

1. A playback method of a multimedia content,

comprising:

receiving the multimedia content, wherein the multimedia content comprises a video bitstream;

performing playback upon the multimedia content, wherein the step of performing playback upon the multimedia content comprises;

performing playback upon at least first frames of the video bitstream in the multimedia content;

detecting a user status and accordingly generating a detection result; and

automatically adjusting the playback of the multimedia content in response to the detection result, wherein the step of automatically adjusting the playback of the multimedia content comprises;

performing playback upon at least second frames of the video bitstream in the multimedia content, wherein at least one of first frame elements of the first frames is different from all of second frame elements of the second frames of the video bitstream.

2. The playback method of claim 1, wherein the step of detecting the user status comprises:

receiving a captured image; and

detecting the user status by performing a face detection upon the captured image.

3. The playback method of claim 1, wherein the user status is user'"'"'s face angle.

4. The playback method of claim 3, wherein the multimedia content includes a plurality of video bitstreams corresponding to different view angles, respectively;

the step of performing the playback upon the multimedia content comprises controlling a display screen to display frames of a first video bitstream corresponding to a first view angle; and

the step of adjusting the playback of the multimedia content comprises;

when the user'"'"'s face angle is changed, controlling the display screen to display frames of a second video bitstream corresponding to a second view angle which is different from the first view angle.

5. The playback method of claim 1, wherein the user status is user'"'"'s location.

6. The playback method of claim 5, wherein the multimedia content includes a plurality of video bitstreams corresponding to different view angles, respectively;

the step of performing the playback upon the multimedia content comprises controlling a display screen to display frames of a first video bitstream corresponding to a first view angle; and

the step of adjusting the playback of the multimedia content comprises;

when the user'"'"'s location is changed, controlling the display screen to display frames of a second video bitstream corresponding to a second view angle which is different from the first view angle.

7. The playback method of claim 5, wherein the step of performing the playback upon the multimedia content comprises driving a display screen according to the at least first frames of the video bitstream and a first video effect setting;

and the step of adjusting the playback of the multimedia content comprises;

when the user'"'"'s location is changed, driving the display screen according to the at least second frames of the video bitstream and a second video effect setting which is different from the first video effect setting.

8. The playback method of claim 7, wherein the step of driving the display screen according to at least the first frames of the video bitstream and the first video effect setting comprises:

generating first processed frames by processing the first frames according to the first video effect setting, and driving the display screen according to the first processed frames; and

the step of driving the display screen according to at least the second frames of the video bitstream and the second video effect setting comprises;

generating second processed frames by processing the second frames according to the second video effect setting, and driving the display screen according to the second processed frames.

9. The playback method of claim 7, wherein the first video effect setting includes a first zooming setting, and the second video effect setting includes a second zooming setting.

10. The playback method of claim 7, wherein the step of driving the display screen according to at least the first frames of the video bitstream and the first video effect setting comprises:

selecting a first partial image within each of the first frames according to a first indication value of the user'"'"'s location;

generating first processed images by processing first partial images of the first frames according to the first video effect setting; and

driving the display screen according to the first processed images; and

the step of driving the display screen according to at least the second frames of the video bitstream and the second video effect setting comprises;

selecting a second partial image within each of the second frames according to a second indication value of the user'"'"'s location, wherein the second indication value is different from the first indication value;

generating second processed images by processing second partial images of the second frames according to the second video effect setting; and

driving the display screen according to the second processed images.

11. The playback method of claim 5, wherein the multimedia content includes an audio data;

the step of performing the playback upon the multimedia content comprises;

when a first audio segment of the audio data is received, driving a speaker system to play the first audio segment according to a first audio effect setting; and

the step of adjusting the playback of the multimedia content comprises;

when the user'"'"'s location is changed and a second audio segment of the audio data is received, driving the speaker system to play the second audio segment according to a second audio effect setting which is different from the first audio effect setting.

12. The playback method of claim 11, wherein the first audio effect setting is a first surrounding audio setting, and the second audio effect setting is a second surrounding audio setting.

13. The playback method of claim 11, wherein the first surrounding audio setting and the second surrounding audio setting correspond to different soundstage depths.

14. The playback method of claim 11, further comprising:

receiving a depth of field parameter associated with playback of a three-dimensional (3D) video data;

wherein the depth of field parameter is referenced for configuring at least one of the first audio effect setting and the second audio effect setting.

15. A playback apparatus of a multimedia content, comprising:

a receiving block, for receiving the multimedia content, wherein the multimedia content comprises a video bitstream;

a playback block, coupled to the receiving block, for performing playback upon the multimedia content, wherein the operation of performing playback upon the multimedia content comprises;

performing playback upon at least first frames of the video bitstream in the multimedia content; and

a detecting block, coupled to the playback block, for detecting a user status and accordingly generating a detection result;

wherein the playback block automatically adjusts the playback of the multimedia content in response to the detection result, wherein the operation of automatically adjusting the playback of the multimedia content comprises;

performing playback upon at least second frames of the video bitstream in the multimedia content, wherein at least one of first frame elements of the first frames is different from all of second frame elements of the second frames of the video bitstream.

16. The playback apparatus of claim 15, wherein the receiving block further receives a captured image, and the detecting block detects the user status by performing a face detection upon the captured image.

17. The playback apparatus of claim 15, wherein the user status is user'"'"'s face angle.

18. The playback apparatus of claim 17, wherein the multimedia content includes a plurality of video bitstreams corresponding to different view angles, respectively;

and the playback block controls a display screen to display frames of a first video bitstream corresponding to a first view angle, and when the user'"'"'s face angle is changed, controls the display screen to display frames of a second video bitstream corresponding to a second view angle which is different from the first view angle.

19. The playback apparatus of claim 15, wherein the user status is user'"'"'s location.

20. The playback apparatus of claim 19, wherein the multimedia content includes a plurality of video bitstreams corresponding to different view angles, respectively;

and the playback block controls a display screen to display frames of a first video bitstream corresponding to a first view angle, and when the user'"'"'s location is changed, controls the display screen to display frames of a second video bitstream corresponding to a second view angle which is different from the first view angle.

21. The playback apparatus of claim 19, wherein the playback block drives a display screen according to the at least first frames of the video bitstream and a first video effect setting;

and when the user'"'"'s location is changed, the playback block drives the display screen according to the at least second frames of the video bitstream and a second video effect setting which is different from the first video effect setting.

22. The playback apparatus of claim 21, wherein the playback block generates first processed frames by processing the first frames according to the first video effect setting, and drives the display screen according to the first processed frames;

and the playback block further generates second processed frames by processing the second frames according to the second video effect setting, and drives the display screen according to the second processed frames.

23. The playback apparatus of claim 21, wherein the first video effect setting includes a first zooming setting, and the second video effect setting includes a second zooming setting.

24. The playback apparatus of claim 21, wherein the playback block selects a first partial image within each of the first frames according to a first indication value of the user'"'"'s location, generates first processed images by processing first partial images of the first frames according to the first video effect setting, and drives the display screen according to the first processed images;

and the playback block further selects a second partial image within each of the second frames according to a second indication value of the user'"'"'s location where the second indication value is different from the first indication value, generates second processed images by processing second partial images of the second frames according to the second video effect setting, and drives the display screen according to the second processed images.

25. The playback apparatus of claim 19, wherein the multimedia content includes an audio data;

when a first audio segment of the audio data is received by the receiving block, the playback block drives a speaker system to play the first audio segment of the audio data according to a first audio effect setting; and

when the user'"'"'s location is changed and a second audio segment of the audio data is received by the receiving block, the playback block drives the speaker system to play the second audio segment according to a second audio effect setting which is different from the first audio effect setting.

26. The playback apparatus of claim 25, wherein the first audio effect setting is a first surrounding audio setting, and the second audio effect setting is a second surrounding audio setting.

27. The playback apparatus of claim 25, wherein the first surrounding audio setting and the second surrounding audio setting correspond to different soundstage depths.

28. The playback apparatus of claim 25, wherein the receiving block further receives a depth of field parameter associated with playback of a three-dimensional (3D) video data, and the depth of field parameter is referenced by the playback module for configuring at least one of the first audio effect setting and the second audio effect setting.