Methods and systems for content processing

• US 9,104,915 B2
• Filed: 12/10/2013
• Issued: 08/11/2015
• Est. Priority Date: 08/19/2008
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Conwell, William Y.
• Primary Examiner(s): BHATNAGAR, ANAND P
• Application Number:
  US14/101,896
• Publication Number:
  US 20140193087A1
• Time in Patent Office: 609 Days
• Field of Search: 382/100, 382/181, 382/182, 382/190, 382/195, 382224-231, 713/176, 707722-757
• US Class Current: 1/1
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/587 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9536 Search customisation based on social or collaborative filtering
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06F 18/40 Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2215/00 Indexing scheme for image rendering
• CPC Class Codes: G06T 3/00 Geometric image transformations in the plane of the image
• CPC Class Codes: G06V 10/24 Aligning, centring, orientation detection or correction of the image
• CPC Class Codes: G06V 10/945 User interactive design; Environments; Toolboxes
• CPC Class Codes: G06V 20/13 Satellite images
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 2201/3278 Transmission
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body

Abstract

Portable devices are equipped with a variety of technologies by which existing functionality can be improved, and new functionality can be provided. One claim recites a method comprising: receiving data representing imagery that depicts an object, the imagery captured by a portable device, the portable device comprising a camera and a microphone; determining one or more descriptors relating to the object in the imagery, the determining including collecting descriptors associated with other imagery or audio; processing the descriptors in discerning whether the imagery depicts an object that is likely of a first class or a second class or a third class, the processing being performed by one or more electronic processors configured to perform such act; and taking an action dependent on whether the imagery depicts an object that is likely of a first class or a second class or a third class. Of course, other claims and combinations are provided as well.

Claims

1. A method comprising:

receiving data representing imagery that depicts an object, the imagery captured by a portable device, the portable device comprising a camera and a microphone;

determining one or more descriptors relating to the object in the imagery, said determining including collecting descriptors associated with other imagery or audio;

processing said descriptors in discerning whether the imagery depicts an object that is likely of a first class or a second class or a third class, said processing being performed by one or more electronic processors configured to perform such act; and

taking an action dependent on whether the imagery depicts an object that is likely of a first class or a second class or a third class.

2. The method of claim 1 that includes processing said collected descriptors by comparing with a glossary of place-related terms.

3. The method of claim 1 that includes processing said collected descriptors by comparing with a glossary of people-related terms.

4. The method of claim 1 further comprising transforming the data representing imagery through digital fingerprinting of the data.

5. The method of claim 1 in which the imagery comprises video.

6. A portable device comprising:

means for capturing audio;

means for capturing imagery depicting an object;

means for determining one or more descriptors relating to the object depicted in the imagery, including collecting descriptors associated with other imagery or audio;

means for processing the descriptors in discerning whether the imagery depicts an object that is likely of a first class or a second class or a third class; and

taking an action dependent on whether the imagery depicts an object that is likely of a first class or a second class or a third class.

7. The portable device of claim 6 in which said means for processing compares collected descriptors with a glossary of place-related terms.

8. The portable device of claim 6 in which said means for processing compares collected descriptors with a glossary of people-related terms.

9. The portable device of claim 6 further comprising means for transforming captured imagery with digital fingerprinting.

10. The portable device of claim 6 in which the imagery comprises video.

11. A method comprising:

receiving data representing audio captured with a portable device microphone, the portable device further comprising a camera;

determining one or more descriptors relating to the audio, said determining including collecting descriptors associated with other audio or imagery;

processing said descriptors in discerning whether the audio is likely of a first class or a second class or a third class, said processing being performed by one or more electronic processors configured to perform such act; and

taking an action dependent on whether the audio is likely of a first class or a second class or a third class.

12. The method of claim 11 that includes processing the collected descriptors by comparing with a glossary of place-related terms.

13. The method of claim 11 that includes processing the collected descriptors by comparing with a glossary of people-related terms.

14. The method of claim 11 further comprising transforming the data representing audio through digital fingerprinting of the data.

15. A portable device comprising:

means for capturing audio;

means for capturing imagery;

means for determining one or more descriptors relating to the audio, the determining including collecting descriptors associated with other audio or imagery;

means for processing the descriptors in discerning whether the audio is likely of a first class or a second class or a third class; and

means for taking an action dependent on whether the audio is likely of a first class or a second class or a third class.

16. The portable device of claim 15 in which said means for processing compares collected descriptors with a glossary of place-related terms.

17. The portable device of claim 15 in which said means for processing compares collected descriptors with a glossary of people-related terms.

18. The portable device of claim 15 further comprising means for transforming captured audio with digital fingerprinting.