Media reproduction for audio visual entertainment

• US 8,774,592 B2
• Filed: 04/29/2009
• Issued: 07/08/2014
• Est. Priority Date: 05/01/2008
• Status: Active Grant

• Current Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.)
• Inventors: Camp, Philip Ronald
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): Tran, William
• Application Number:
  US12/990,092
• Publication Number:
  US 20110142411A1
• Time in Patent Office: 1,896 Days
• Field of Search: 386/228, 386/248
• US Class Current: 386/228
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/466 Learning process for intelligent management, e.g. learning user preferences for recommending movies services using the results of monitoring in broadcast systems H04H60/61
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 5/775 between a recording apparatus and a television receiver
• CPC Class Codes: H04N 5/781 on disks or drums

Abstract

A media reproducing device comprises a media data output element operable to output media data stored on a storage medium to a media data presentation unit. The media reproducing device further includes a receiver operable to receive a sequence of video images, and a user detector operable to detect, by analysis of the sequence of video images, whether a user is attending to a presentation of the media data by the media data presentation unit. The user detector is operable to detect whether the user is attending to the presentation of the media data and to generate motion vector tracks associated with movement of objects within the sequence of received video images. If it detects that the user is not attending to the presentation of the media data, the detector is operable to store a bookmark indicating that the user is not attending to the presentation of the media data.

Claims

1. A media reproducing device comprising:

a media data output element operable to output media data stored on a storage medium to a media data presentation unit;

a receiver operable to receive a sequence of video images from a video camera via a communications link; and

a user detector operable to detect, by analysis of the sequence of video images received from the video camera via the communications link, whether a user is attending to a presentation of the media data by the media data presentation unit, the user detector being operable to analyze an image monitor area of each received video image so as to detect whether the user is attending to the presentation of the media data by the media data presentation unit, and the image monitor area corresponding to an image region that is smaller than the field of view of the video camera,

in which;

the user detector is operable to;

generate motion vector tracks associated with movement of objects within the sequence of received video images, the motion vector tracks being generated in dependence upon pixel differences between successive video images; and

detect whether the user is attending to the presentation of the media data in dependence upon a relationship between positions of the motion vector tracks and the image monitor area;

wherein;

if the detector detects that the user is not attending to the presentation of the media data, the detector is operable to;

store a bookmark associated with a motion vector track which indicates that the user is not attending to the presentation of the media data, the bookmark being indicative of a point from which presentation of the media data can resume if it is later determined that the user was not attending to the presentation of the media data; and

if more than a predetermined period has elapsed since the detector detected that the user was not attending to the presentation of the media data, and the user has not returned to attending to the presentation of the media data, to pause the media presentation; and

the detector is operable to resume the presentation of the media data in response to a user input, the presentation being resumed from the time indicated with the bookmark; and

the detector is further operable to generate a bookmark when a motion vector track associated with movement of an object within the received video images is generated, each generated motion vector track being associated with a respective bookmark;

wherein, if a motion vector track is detected as remaining within the image monitor area for longer than a second predetermined time period, the detector is operable to delete the bookmark associated with that motion vector track.

2. A media reproducing device according to claim 1, in which:

the detector is operable to detect whether a motion vector track is outside the image monitor area; and

the detector is operable to cause the media data output element to pause the output of the media data to the media data presentation unit if a motion vector track is detected as being outside the image monitor area.

3. A media reproducing device according to claim 1, in which:

the user input comprises a control gesture by the user; and

the detector is operable to detect, by analysis of the sequence of video images received from the video camera via the communications link, the control gesture made by the user.

4. A media reproducing device according to claim 1, in which:

the detector is operable to detect, by analysis of the sequence of video images received from the video camera via the communications link, whether a plurality of users are attending to the presentation of the media data by the media data presentation unit,

the detector is operable to generate a respective bookmark for each user that is detected as not attending to the presentation of the media data;

the detector is operable to detect, by analysis of the sequence of video images received from the video camera via the communications link, if one or more of the users have returned to the presentation of the media data;

the detector is operable to cause the media data output element to resume output of the media data to the media data presentation unit in response to a detection by the detector that one or more of the users have returned to the presentation of the media data, the output of the media data being from an earliest time indicated by the respective bookmarks associated with the plurality of users.

5. An audio-visual entertainment system, comprising:

a media reproducing device including;

a media data output element operable to output media data stored on a storage medium to a media data presentation unit;

a receiver operable to receive a sequence of video images from a video camera via a communications link; and

a user detector operable to detect, by analysis of the sequence of video images received from the video camera via the communications link, whether a user is attending to a presentation of the media data by the media data presentation unit, the user detector being operable to analyse an image monitor area of each received video image so as to detect whether the user is attending to the presentation of the media data by the media data presentation unit, and the image monitor area corresponding to an image region that is smaller than the field of view of the video camera,

in which;

the user detector is operable to;

generate motion vector tracks associated with movement of objects within the sequence of received video images, the motion vector tracks being generated in dependence upon pixel differences between successive video images; and

detect whether the user is attending to the presentation of the media data in dependence upon a relationship between positions of the motion vector tracks and the image monitor area;

wherein;

if the user detector detects that the user is not attending to the presentation of the media data, the user detector is operable to;

store a bookmark associated with a motion vector track which indicates that the user is not attending to the presentation of the media data, the bookmark being indicative of a point from which presentation of the media data can resume if it is later determined that the user was not attending to the presentation of the media data; and

if more than a predetermined period has elapsed since the user detector detected that the user was not attending to the presentation of the media data, and the user has not returned to attending to the presentation of the media data, to pause the media presentation; and

the user detector is operable to resume the presentation of the media data in response to a user input, the presentation being resumed from the time indicated with the bookmark; and

the user detector is further operable to generate a bookmark when a motion vector track associated with movement of an object within the received video images is generated, each generated motion vector track being associated with a respective bookmark; and

a media data presentation unit operable to receive media data from the media reproducing device and to present the received media data to a user;

wherein, if a motion vector track is detected as remaining within the image monitor area for longer than a second predetermined time period, the user detector is operable to delete the bookmark associated with that motion vector track.

6. A method for outputting media data stored on a storage medium to a media data presentation unit, the method comprising:

outputting media data stored on a storage medium to a media data presentation unit;

receiving a sequence of video images from a video camera via a communications link;

detecting, by analysis of the sequence of video images received from the video camera via the communications link, whether a user is attending to a presentation of the media data by the media data presentation unit;

analyzing an image monitor area of each received video image so as to detect whether the user is attending to the presentation of the media data by the media data presentation unit, the image monitor area corresponding to an image region that is smaller than the field of view of the video camera;

generating motion vector tracks associated with movement of objects within the sequence of received video images, the motion vector tracks being generated in dependence upon pixel differences between successive video images;

detecting whether the user is attending to the presentation of the media data in dependence upon a relationship between positions of the motion vector tracks and the image monitor area; and

if it is detected that the user is not attending to the presentation of the media data;

storing a bookmark associated with a motion vector track which indicates that the user is not attending to the presentation of the media data, the bookmark being indicative of a point from which presentation of the media data can resume if it is later determined that the user was not attending to the presentation of the media data; and

if more than a predetermined period has elapsed since the detection that the user was not attending to the presentation of the media data, and the user has not returned to attending to the presentation of the media data, pausing the media presentation;

resuming the presentation of the media data in response to a user input, the presentation being resumed from the time indicated with the bookmark; and

generating a bookmark when a motion vector track associated with movement of an object within the received video images is generated, each generated motion vector track being associated with a respective bookmark;

wherein, if a motion vector track is detected as remaining within the image monitor area for longer than a second predetermined time period, deleting the bookmark associated with that motion vector track.

7. A tangible, non-transitory, computer-readable storage medium on which computer readable instructions of a computer program are stored, the instructions, when executed by a computer, cause the computer to operate as media reproducing device having:

a media data output element operable to output media data stored on a storage medium to a media data presentation unit;

a receiver operable to receive a sequence of video images from a video camera via a communications link; and

a user detector operable to detect, by analysis of the sequence of video images received from the video camera via the communications link, whether a user is attending to a presentation of the media data by the media data presentation unit, the user detector being operable to analyse an image monitor area of each received video image so as to detect whether the user is attending to the presentation of the media data by the media data presentation unit, and the image monitor area corresponding to an image region that is smaller than the field of view of the video camera,

in which;

the user detector is operable to;

generate motion vector tracks associated with movement of objects within the sequence of received video images, the motion vector tracks being generated in dependence upon pixel differences between successive video images; and

detect whether the user is attending to the presentation of the media data in dependence upon a relationship between positions of the motion vector tracks and the image monitor area; and

if the user detector detects that the user is not attending to the presentation of the media data, the user detector is operable to;

store a bookmark associated with a motion vector track which indicates that the user is not attending to the presentation of the media data, the bookmark being indicative of a point from which presentation of the media data can resume if it is later determined that the user was not attending to the presentation of the media data; and

if more than a predetermined period has elapsed since the detector detected that the user was not attending to the presentation of the media data, and the user has not returned to attending to the presentation of the media data, to pause the media presentation; and

the user detector is operable to resume the presentation of the media data in response to a user input, the presentation being resumed from the time indicated with the bookmark; and

the user detector is further operable to generate a bookmark when a motion vector track associated with movement of an object within the received video images is generated, each generated motion vector track being associated with a respective bookmark;

wherein, if a motion vector track is detected as remaining within the image monitor area for longer than a second predetermined time period, the detector is operable to delete the bookmark associated with that motion vector track.

8. A tangible, non-transitory, computer-readable storage medium on which computer readable instructions are stored, the instructions, when executed by a computer, cause the computer to carry out a method for outputting media data stored on a storage medium to a media data presentation unit, the method comprising:

outputting media data stored on a storage medium to a media data presentation unit;

receiving a sequence of video images from a video camera via a communications link;

detecting, by analysis of the sequence of video images received from the video camera via the communications link, whether a user is attending to a presentation of the media data by the media data presentation unit;

analysing an image monitor area of each received video image so as to detect whether the user is attending to the presentation of the media data by the media data presentation unit, the image monitor area corresponding to an image region that is smaller than the field of view of the video camera;

generating motion vector tracks associated with movement of objects within the sequence of received video images, the motion vector tracks being generated in dependence upon pixel differences between successive video images;

detecting whether the user is attending to the presentation of the media data in dependence upon a relationship between positions of the motion vector tracks and the image monitor area; and

if it is detected that the user is not attending to the presentation of the media data;

storing a bookmark associated with a motion vector track which indicates that the user is not attending to the presentation of the media data, the bookmark being indicative of a point from which presentation of the media data can resume if it is later determined that the user was not attending to the presentation of the media data; and

if more than a predetermined period has elapsed since the detection that the user was not attending to the presentation of the media data, and the user has not returned to attending to the presentation of the media data, pausing the media presentation;

resuming the presentation of the media data in response to a user input, the presentation being resumed from the time indicated with the bookmark; and

generating a bookmark when a motion vector track associated with movement of an object within the received video images is generated, each generated motion vector track being associated with a respective bookmark;

wherein, if a motion vector track is detected as remaining within the image monitor area for longer than a second predetermined time period, deleting the bookmark associated with that motion vector track.