Subject segmentation and tracking using 3D sensing technology for video compression in multimedia applications
First Claim
Patent Images
1. A method for enabling segmentation of objects and subjects in an image captured by a camera system capable of obtaining both luminosity and depth information, the method comprising:
- obtaining position information for a plurality of discrete regions on at least one of a head and a body part of a subject and on a background behind said subject;
segmenting the image into at least a first segment corresponding to a first object in the image and into a second segment corresponding to a second object in the image, at least one of the first object and the second object corresponding to at least one of the head and the body part of the subject;
identifying a position and a shape of at least one of the head and the body part of the subject; and
applying a first compression scheme to the first segment of the image, and a second compression scheme to the second segment of the image.
3 Assignments
0 Petitions
Accused Products
Abstract
Three-dimensional position information is used to segment objects in a scene viewed by a three dimensional camera. At one or more instances of an interval, the head location of the user is determined. Object-based compression schemes are applied on the segmented objects and the detected head.
223 Citations
47 Claims
-
1. A method for enabling segmentation of objects and subjects in an image captured by a camera system capable of obtaining both luminosity and depth information, the method comprising:
-
obtaining position information for a plurality of discrete regions on at least one of a head and a body part of a subject and on a background behind said subject;
segmenting the image into at least a first segment corresponding to a first object in the image and into a second segment corresponding to a second object in the image, at least one of the first object and the second object corresponding to at least one of the head and the body part of the subject;
identifying a position and a shape of at least one of the head and the body part of the subject; and
applying a first compression scheme to the first segment of the image, and a second compression scheme to the second segment of the image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36)
-
-
37. A system for enabling segmentation of objects and subjects using images obtained by a three-dimensional sensor and enabling object-based compression of segmented said objects and subjects, the system comprising:
-
a host device including a processor and a memory, the memory storing one or more modules that are executable by the processor;
a camera system capable of obtaining an image with luminosity and depth information;
a communication interface for transmitting the image;
wherein the module is executable by the processor in order to;
segment the image into at least a first segment corresponding to a first object in the image and into a second segment corresponding to a second object in the image, at least one of the first object and the second object corresponding to at least one of the head and the body part of the subject;
identify a position and a shape of at least one of the head and the body part of the subject; and
apply a first compression scheme to the first segment of the image, and a second compression scheme to the second segment of the image. - View Dependent Claims (38, 39, 40)
-
-
41. A system for enhancing the operation of a multimedia personal communication application, the system comprising:
-
a camera system capable of obtaining both luminosity and depth images;
a client device including a processor, a display screen, and a memory, the memory storing at least one module that is executable by the processor in order to segment each image into multiple segments, the at least one module compressing each of the multiple segments with the same or different qualities;
a communication interface for transmitting said compressed segments of the images to a plurality of other multimedia clients over a network, the communication interface cooperating with the client device to transmit one or more segments that are in the foreground more frequently than one or more segments that are in the background;
wherein the system includes at least one multimedia client that is configured to display and update one or more segments received from the client device that are in the foreground substantially in real-time, update one or more segments received from the client device that are in the background with less frequency than updating the segments that are in the foreground. - View Dependent Claims (42, 43, 44, 45, 46, 47)
-
Specification