TIME SHIFTED VIDEO COMMUNICATIONS

• US 20110063440A1
• Filed: 09/11/2009
• Published: 03/17/2011
• Est. Priority Date: 09/11/2009
• Status: Abandoned Application

• Current Assignee: Eastman Kodak Company
• Original Assignee: Intellectual Ventures Fund 83 LLC (Intellectual Ventures LLC)
• Inventors: Kurtz, Andrew F., Judge, Tejinder K., Neustaedter, Carman G., Fedorovskaya, Elena A.
• Application Number:
  US12/557,709
• Publication Number:
  US 20110063440A1
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

A method for providing video images to a remote viewer using a video communication system, comprising: operating a a video communication client in a local environment connected by a communications network to a remote viewing client in a remote viewing environment; capturing video images of the local environment; analyzing the captured video images with the video analysis component to detect ongoing activity within the local environment; characterizing the detected activity within the video images with respect to attributes indicative of remote viewer interest; determining whether acceptable video images are available; receiving an indication of whether the remote viewing client is engaged or disengaged; and transmitting the acceptable video images of the ongoing activity to the remote viewing client if the remote viewing client is engaged, or alternately, if the remote viewing client is disengaged, recording the acceptable video images into a memory.

Claims

1. A method for providing video images to a remote viewer using a video communication system, comprising:

operating a video communication system, comprising a video communication client in a local environment connected by a communications network to a remote viewing client in a remote viewing environment, wherein the video communication client includes a video capture device, an image display, and a computer having a video analysis component,

capturing video images of the local environment using the video capture device during a communication event;

analyzing the captured video images with the video analysis component to detect ongoing activity within the local environment;

characterizing the detected activity within the video images with respect to attributes indicative of remote viewer interest;

determining whether acceptable video images are available, responsive to the characterized activity and defined local user permissions;

receiving an indication of whether the remote viewing client is engaged or disengaged; and

transmitting the acceptable video images of the ongoing activity to the remote viewing client if the remote viewing client is engaged, or alternately, if the remote viewing client is disengaged, recording the acceptable video images into a memory and transmitting the recorded video images to the remote viewing client at a later time when an indication is received that the remote viewing client is engaged.

2. The method of claim 1, wherein the video images are not transmitted or recorded, and are deleted from memory when the video images are determined to not be acceptable.

3. The method of claim 1, wherein at least one still image captured by the video capture device is transmitted to the remote viewing client during a portion of a communication event when the video images are determined to not be acceptable.

4. The method of claim 1, wherein an indication that the remote viewing client is engaged is received from the remote viewing client when the remote viewing client is on, a remote viewer is present in the remote viewing environment, and the remote viewer is watching the remote viewing client.

5. The method of claim 1, wherein an indication that the remote viewing client is disengaged is received from the remote viewing client when the remote viewing client is off, or a remote viewer is not present in the remote viewing environment, or the remote viewer is not watching the remote viewing client.

6. The method of claim 1, further including receiving a subsequent indication of the status of the remote viewing client as engaged or disengaged, after the prior indication has been received.

7. The method of claim 6, wherein the behavior of the video communication client, relative to video transmission or video recording, is changed in response to a change in the status of the remote viewing client as engaged or disengaged.

8. The method of claim 1, wherein an indication of the characterized activity or the determined acceptability of the captured video images is provided to the remote viewing client.

9. The method of claim 1, wherein the detected activity is characterized based on quantitative metrics derived from motion analysis.

10. The method of claim 1, wherein the detected activity is characterized based upon semantic attributes, including the presence or identity of people, the presence or identity of animals, the type of activity, or the time of day.

11. The method according to claim 1, wherein the acceptability of the video image content is determined using criteria related to the presence of people, animals, or certain activities in the image content.

12. The method of claim 1, wherein the acceptability of the available video image content is characterized by probability values.

13. The method of claim 12, wherein updated probability values are determined while video images are being captured, and wherein the behavior of the video communication client is changed in response to changes in the probability values.

14. The method of claim 13, wherein the behavior of the video communication client is changed by changing whether the captured video images are being transmitted to the remote viewing client, or recorded for later transmission, or deleted from the memory.

15. The method of claim 1, wherein the acceptability of the video images is characterized by acceptability rankings, including those that classify the content of the video images as unacceptable, mundane, or acceptable.

16. The method of claim 1, wherein the defined local user permissions include limits on what types of video image content can be recorded or transmitted, who is allowed view the video images, how many times recorded video images can be viewed, or how long recorded video can be retained at the remote viewing client.

17. The method of claim 1, wherein the video communication client provides an alert to the remote viewing client that either video images of ongoing activity or recorded video images are available for viewing.

18. The method of claim 1, wherein the recorded video images are characterized relative to various criteria, including the presence or identity of people, the presence or identity of animals, the type of activity, the time of day, or the duration of the recorded video.

19. The method according to claim 1, wherein the detect activity analysis or the video image characterization includes image difference analysis, motion analysis, face detection, eye detection, body shape detection, skin color analysis, or combinations thereof.

20. The method of claim 1, wherein the video communication client and the remote viewing client both provide user interfaces by which remote or local users define their video viewing, transmitting, recording, or privacy preferences.

21. The method of claim 20, wherein an activity timeline is determined for the acceptable video images from one or more video communication events, and the activity timeline is provided on a user interface of either the video communication client or the remote viewing client.

22. The method of claim 1, wherein video images of ongoing activity are recorded in a memory associated with the video communication client.

23. The method of claim 1, wherein the recorded video images are recorded in a memory associated with the remote viewing client.

24. The method of claim 1, wherein the video communication client is connected by a communications network to a plurality of remote viewing clients, and wherein either video images of ongoing activities or recorded video images are transmitted to the remote viewing clients responsive to whether a given remote viewing client is engaged or disengaged.

25. The method of claim 24, wherein local user permissions or remote user preferences can be defined for each remote viewing client.

26. The method of claim 1, wherein the video communication client further includes one or more environmental sensors, wherein one of the environmental sensors is a motion detector, a light detector, an infrared sensitive camera, a bio-electric field detection sensor, a proximity sensor, or a microphone.

27. A method for providing video images to a remote viewer using a video communication system, comprising:

operating a video communication system in a local environment, connected by a communications network to a remote viewing system in a remote viewing environment, wherein the video communication system includes a video capture device, an image display, and a computer having a video analysis component;

capturing video images of the local environment using the video capture device;

analyzing the captured video images using the video analysis component to detect ongoing activity within the local environment;

characterizing the detected activity within the video images with respect to attributes indicative of remote viewer interest;

determining whether acceptable video images are available responsive to the characterized activity and defined local user permissions;

receiving an indication of whether a remote viewer is engaged in viewing the remote viewing system; and

providing the acceptable video image content to the remote viewing system if a remote viewer is engaged in viewing the remote viewing system.

28. A method for providing video images to a remote viewer using a video communication system, comprising:

operating a video communication system in a local environment, connected by a communications network to a remote viewing system in a remote viewing environment, wherein the video communication system includes a video capture device, an image display, a computer having a video analysis component;

capturing video images of the local environment using the video capture device;

analyzing the captured video images using the video analysis component to detect activity within the local environment;

characterizing the detected activity within the video images with respect to attributes indicative of remote viewer interest;

determining whether acceptable video images are available responsive to the characterized activity and defined local user permissions;

receiving an indication of whether a viewer is engaged in viewing the remote viewing system; and

recording the acceptable video images if a viewer is not engaged in viewing the remote viewing system.

29. The method of claim 28, further including transmitting the recorded video images to the remote viewing system at a later time when an indication is received that a viewer is engaged in viewing the remote viewing system.

30. The method of claim 28, wherein remote viewer interest is determined using video images of the remote viewer environment and the remote viewers themselves, which are captured and analyzed by the remote viewing client to determine viewer attributes including identity, activity, attentiveness, or emotional response that are indicative of remote viewer interest.

31. The method of claim 28, wherein remote viewer interest is determined using semantic data regarding the viewers, including calendar data, data describing the relationships of the remote viewers to the local users, or historical data describing viewing behavior or viewing preferences.

32. The method of claim 28, wherein remote viewer interest is prioritized by the remote viewing client relative to the available recorded video images, and the available video images are then offered to remote viewers for viewing based upon the determined prioritized viewer interest.

33. A method for providing video images to a remote viewer using a video communication system, comprising:

operating a video communication system, comprising a video communication client in a local environment, connected by a communications network to a remote viewing client in a remote viewing environment, wherein the video communication client includes a video capture device, an image display, and a computer having a video analysis component,

capturing video images of the local environment using the video capture device during a communication event;

analyzing the captured video images with the video analysis component to detect ongoing activity within the local environment;

characterizing the detected activity within the video images with respect to attributes indicative of remote viewer interest;

determining whether acceptable video images are available, responsive to the characterized activity and defined local user permissions;

determining whether a remote viewer is engaged in viewing the remote viewing client; and

transmitting the acceptable video images of the ongoing activity to the fix remote viewing client if the remote viewer is engaged, or alternately, if the remote viewer is disengaged, recording the acceptable video images into a memory at the local video communication client or a memory at the remote viewing client.

34. The method of claim 33, wherein the local user permissions determine whether the recorded video images are recorded into the memory at the local video communication client or the memory at the remote viewing client.

35. The method of claim 33, wherein the determination of the remote viewer status as engaged or disengaged is completed at either the local video communication client or at the remote viewing client.

36. A video communication system, comprising:

a local video communication client including a video capture device adapted to capture video images of a local environment;

a remote viewing client in a remote viewing environment connected to the local video communication client by a communications network,

a computer for controlling the video communication client; and

a memory system operatively linked to the computer and storing instructions configured to;

cause video images of the local environment to be captured using the video capture device;

analyze the captured video images to detect activity within the local environment;

characterize the detected activity within the video images with respect to attributes indicative of remote viewer interest;

determine whether acceptable video images are available responsive to the characterized activity and defined local user permissions;

receive an indication of whether the remote viewing client is engaged or disengaged; and

provide the acceptable video images to the remote viewing client if the remote viewing client is engaged, or alternately, if the remote viewing client is disengaged, record the acceptable video images into a memory and provide the recorded video images to the remote viewing client at a later time when an indication is received that the remote viewing client is engaged.

37. The system of claim 36 wherein the video communication client further includes one or more environmental sensors, wherein one of the environmental sensors is a motion detector, a light detector, an infrared sensitive camera, a bio-electric field detection sensor, a proximity sensor, or a microphone.

38. The system of claim 36, wherein the video capture device has pan, tilt, or zoom capabilities which are controllable to modify a field of view for the captured video images.