System and method for processing image objects in video data

• US 9,693,116 B2
• Filed: 03/04/2013
• Issued: 06/27/2017
• Est. Priority Date: 02/20/2009
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Walter, Edward A
• Primary Examiner(s): Bruckart, Benjamin R
• Assistant Examiner(s): THOMAS, JASON M
• Application Number:
  US13/784,315
• Publication Number:
  US 20130318551A1
• Time in Patent Office: 1,576 Days
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/7335 Graphical querying, e.g. query-by-region, query-by-sketch, query-by-trajectory, GUIs for designating a person/face/object as a query predicate end-user interface involving hot spots associated with the video H04N21/4725; end-user interface for selecting a Region of Interest H04N21/4728
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: H04N 21/234318 by decomposing into objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/44012 involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
• CPC Class Codes: H04N 21/45455 applied to a region of the image
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/83 Generation or processing of protective or descriptive data associated with content; Content structuring
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A system, method and computer program product are disclose for processing an object in a video data stream. The method runs on a processor programmed to execute the method and includes but is not limited to receiving input data at the client device for rendering on the client device display a first functional indicator indicating one of a plurality of functions and surrounding a first region of pixel locations representing a first image object in the video data stream; and performing a function indicated by the first functional indicator on meta data for the first image object in the first region of pixel locations.

Claims

1. A computerized method for processing an object in a video data stream executed on a client device processor, the method comprising:

receiving input data at a client device for rendering on a client device display a first functional indicator indicating one of a plurality of functions and defining a first geometric form indicating a first region of pixel locations containing a first image object in the video data stream;

performing a function indicated by the first functional indicator on meta data for the first image object in the first region of pixel locations;

receiving input data for rendering a second functional indicator indicating one of the plurality of functions and defining a second geometric form indicating a second region of pixels representing a second image object; and

performing the function indicated by the first functional indicator on the meta data for first image object and meta data for the second image object

wherein the functional indicator indicates a function of search, send, store, compare and shop and the meta data for the first image object further comprises meta data in one of a plurality of meta data categories associated with one of a plurality of functional indicators, the method further comprising;

rendering a Boolean indicator on a video data frame in the video data stream, the video data frame comprising at least one line on the video frame between the first and second functional indicators to indicate a Boolean logic operation to operate on meta data for image objects surrounded by the first and second functional indicators.

2. The method of claim 1, the method further comprising:

selecting meta data indicated by a meta data category indicator in a meta data category associated with the functional indicator.

3. The method of claim 1, wherein rendering further comprises rendering the first functional indicator using a remote control cursor on the video data frame comprising a closed geometric form.

4. The method of claim 3, wherein the closed geometric form indicates a function wherein a circle geometric form indicates a search function.

5. The method of claim 1, wherein the first functional indicator comprises a single line indicating a Boolean AND logic operation.

6. The method of claim 1, wherein the first functional indicator comprises two intersecting lines indicating a Boolean OR logic operation.

7. The method of claim 1, wherein the first region of pixel locations contains at least two image objects upon which the function performs.

8. The method of claim 1, further comprising, freezing a video data frame for rendering functional and Boolean indicators on the video data frame, wherein a Boolean logic operation is an EXCLUSIVE OR.

9. The method of claim 1, wherein the first image object is an article of clothing included in the video data stream.

10. A computerized method for processing an object in a video data stream, the method executed on a server processor programmed for executing the steps of the method, the method comprising:

receiving data from a client device indicating one of a plurality of functional indicators indicating one of a plurality of functions and meta data in one of a plurality of meta data categories; and

receiving input data for rendering a functional indicator indicating one of the plurality of functions and defining a geometric shape indicating a region of pixels representing an image object and performing the function indicated by the functional indicator on the meta data a first image object and meta data for a second image object,

wherein the functional indicator indicates a function and the meta data further comprises meta data indicator codes indicating one of a plurality of meta data categories and associated with one of a plurality of functional indicators, the method further comprising;

rendering a Boolean indicator on the video data frame comprising at least one line on the video frame between a first and a second functional indicators to indicate a Boolean logic operation to operate on meta data for image objects surrounded by the first and the second functional indicators.

11. The method of claim 10, the method further comprising:

performing a function indicated by a functional indicator on meta data in a meta data category; and

sending data indicating a result of a performing a function to the client device.

12. A system for processing an object in a video data stream, the system comprising:

a processor in data communication with a tangible non-transitory machine readable medium;

a first processor interface to receive input data from a client device indicating a first one of a plurality of functional indicators indicating a first function and meta data in one of a plurality of meta data categories;

a second processor interface to receive input data for rendering a second functional indicator indicating one of the plurality of functions and defining a geometric form indicating a region of pixels representing an image object and performing the function indicated by a first functional indicator on meta data for a first image object and meta data for the second image object; and

a third processor interface to render a Boolean indicator on a video data frame comprising at least one line on the video data frame between a first and a second functional indicator to indicate a Boolean logic operation to operate on meta data for image objects surrounded by the first and second functional indicators,

wherein a functional indicator indicates a function selected from the group consisting of search, send, store, compare and shop and the meta data further comprises meta data in one of a plurality of meta data categories associated with one of a plurality of functional indicators.

13. The system of claim 12, the system further comprising:

a third processor interface to receive data to perform in the processor a function indicated by the functional indicator on meta data; and

a fourth processor interface to send data indicating a result of the performing a function to the client device.