SYSTEM AND METHOD FOR PROCESSING IMAGE OBJECTS IN VIDEO DATA

• US 20130318551A1
• Filed: 03/04/2013
• Published: 11/28/2013
• Est. Priority Date: 02/20/2009
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Walter, Edward A.
• Granted Patent: US 9,693,116 B2
• Time in Patent Office: Days
• US Class Current: 725/32
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/7335 Graphical querying, e.g. query-by-region, query-by-sketch, query-by-trajectory, GUIs for designating a person/face/object as a query predicate end-user interface involving hot spots associated with the video H04N21/4725; end-user interface for selecting a Region of Interest H04N21/4728
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/44012 involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
• CPC Class Codes: H04N 21/45455 applied to a region of the image
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/83 Generation or processing of protective or descriptive data associated with content; Content structuring
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A system, method and computer program product are disclose for processing an object in a video data stream. The method runs on a processor programmed to execute the method and includes but is not limited to receiving input data at the client device for rendering on the client device display a first functional indicator indicating one of a plurality of functions and surrounding a first region of pixel locations representing a first image object in the video data stream; and performing a function indicated by the first functional indicator on meta data for the first image object in the first region of pixel locations.

Claims

1. A computerized method for processing an object in a video data stream executed on a client device processor, the method comprising:

receiving input data at a client device for rendering on a client device display a first functional indicator indicating one of a plurality of functions and defining a geometric form indicating a first region of pixel locations containing a first image object in the video data stream;

performing a function indicated by the first functional indicator on meta data for the first image object in the first region of pixel locations;

receiving input data for rendering a second functional indicator indicating one of the plurality of functions and defining a second geometric form indicating a second region of pixels representing a second image object; and

performing the function indicated by the first functional indicator on the meta data for first image object and metadata for the second image object.

2. The method of claim 1, wherein the functional indicator indicates a function selected from the group consisting of search, send, store, compare and shop and the meta for the first image object further comprises meta data in one of a plurality of meta data categories associated with one of a plurality of functional indicators, the method further comprising:

rendering a Boolean indicator on a video data frame in the video data stream, the video data frame comprising at least one line on the video frame between the first and second functional indicators to indicate a Boolean logic operation to operate on metadata for the image objects surrounded by the first and second functional indicators.

3. The method of claim 2, the method further comprising:

selecting meta data indicated by a meta category indicator in a meta data category associated with the functional indicator.

4. The method of claim 1, wherein rendering further comprises rendering the first functional indicator using a remote control cursor on the video data frame comprising a closed geometric form.

5. The method of claim 4, wherein the closed geometric form indicates a function wherein a circle geometric form indicates a search function.

6. The method of claim 1, wherein the at least one line further comprises a single line indicating a Boolean AND logic operation.

7. The method of claim 1, wherein the at least one line further comprises two intersecting lines indicating a Boolean OR logic operation.

8. The method of claim 1, wherein the first region of pixel locations contains at least two image objects upon which the function performs.

9. The method of claim 1, further comprising, freezing the video data frame for rendering functional and Boolean indicators on the frame, wherein the Boolean logic operation selected from the group consisting of AND, OR, NOT and EXCLUSIVE OR.

10. The method of claim 1, wherein the first image object is a data item selected from the group consisting of an actor, a location and an article of clothing included in the video data stream.

11. (canceled)

12. (canceled)

13. A computerized method for processing an object in a video data stream, the method executed on a server processor programmed for executing the steps of the method, the method comprising:

receiving data from a client device indicating one of a plurality of functional indicators indicating one of a plurality of functions and meta data in one of a plurality of meta data categories; and

receiving input data for rendering a functional indicator indicating one of the plurality of functions and defining a geometric shape indicating a second region of pixels representing a second image object and performing the function indicated by the first functional indicator on the meta data for first image object and meta data for the second image object.

14. The method of claim 13, wherein the functional indicator indicates a function and the meta further comprises meta data indicator codes indicating one of a plurality of meta data categories and associated with one of a plurality of functional indicators, the method further comprising:

rendering a Boolean indicator on the video data frame comprising at least one line on the video frame between the first and second functional indicators to indicate a Boolean logic operation to operate on meta data for the image objects surrounded by the first and second functional indicators.

15. The method of claim 13, the method further comprising:

performing a function indicated by the functional indicator on meta data in a meta data category; and

sending data indicating a result of the performing the function to the client device.

16. (canceled)

17. (canceled)

18. A system for processing an object in a video data stream, the system comprising:

a processor in data communication with a tangible machine readable medium;

a first processor interface to receive data from a client device indicating a first one of a plurality of functional indicators indicating a first function and meta data in one of a plurality of meta data categories;

a second processor interface to receive input data for rendering a second functional indicator indicating one of the plurality of functions and defining a geometric form indicating a second region of pixels representing a second image object and performing the function indicated by the first functional indicator on the meta data for a first image object and meta data for the second image object; and

a fifth processor interface to render a Boolean indicator on the video data frame comprising at least one line on the video frame between the first and second functional indicators to indicate a Boolean logic operation to operate on meta data for the image objects surrounded by the first and second functional indicators.

19. The system of claim 18, wherein the functional indicator indicates a function selected from the group consisting of search, send, store, compare and shop and the meta further comprises meta data in one of a plurality of meta data categories selected from the group consisting of search, send, store, compare and shop associated with one of a plurality of functional indicators.

20. The system of claim 18, the system further comprising:

a third processor interface to receive data to perform in the processor the function indicated by the functional indicator on the meta data; and

a fourth processor interface to send data indicating a result of the performing the function to the client device.