Smartphone-based methods and systems

• US 8,762,852 B2
• Filed: 08/11/2011
• Issued: 06/24/2014
• Est. Priority Date: 11/04/2010
• Status: Expired due to Fees

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Davis, Bruce L., Rodriguez, Tony F.
• Primary Examiner(s): LEE, TING ZHOU
• Application Number:
  US13/207,860
• Publication Number:
  US 20120210233A1
• Time in Patent Office: 1,048 Days
• Field of Search: 715/727, 704/231, 704/270, 700/94
• US Class Current: 715/727
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/632 Query formulation
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 3/162 Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 9/44505 Configuring for program initiating, e.g. using registry, configuration files
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G06T 2201/005 Image watermarking
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 15/20 Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04N 21/47 End-user applications

Abstract

Methods and arrangements involving portable devices, such as smartphones and tablet computers, are disclosed. One arrangement enables a creator of content to select software with which that creator'"'"'s content should be rendered—assuring continuity between artistic intention and delivery. Another arrangement utilizes the camera of a smartphone to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some of the detailed technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in connection with shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography. A great variety of other features and arrangements are also detailed.

Claims

1. A system including a processor configured by instructions in a memory, the instructions including operating system software, the operating system software providing an audio identification service that receives input audio data, or a pointer to stored audio data, and publishes metadata corresponding thereto to an audio identification message queue of said operating system software, wherein the published metadata comprises, or is obtained through use of, audio fingerprint data or decoded watermark data identifying the audio data, said memory further including software instructions for first and second application programs, said instructions causing the first application program to hook said audio identification message queue to monitor said queue for metadata indicating a music of a first type, said instructions causing the second application program to hook said audio identification message queue to monitor said queue for metadata indicating music of a second type different than the first type, said instructions causing said first or second application to automatically launch into further activity, without user selection, when metadata indicating that the input audio data is music of the first or second type, respectively, is published to said queue.

2. The system of claim 1 in which the published metadata comprises, or is obtained through use of, audio fingerprint data.

3. The system of claim 2 in which the service also receives parameter input data specifying which of plural fingerprint processes to apply.

4. The system of claim 1 in which the published metadata comprises, or is obtained through use of, decoded audio watermark data.

5. The system of claim 4 in which the service also receives parameter input data specifying which of plural watermark decoding processes should be applied by the audio identification service of said operating system software.

6. The system of claim 4 in which the service checks for apparent validity of the returned audio watermark data.

7. The system of claim 1 in which the published metadata comprises text giving a title of the audio and a name of a performing artist.

8. The system of claim 1 in which said service cooperates with a remote metadata registry to obtain information relating to the audio.

9. The system of claim 1 in which the music of the first type comprises music by the Beatles.

10. The system of claim 1 in which the music of the second type comprises Disney movie soundtracks.

11. A method comprising the acts:

processing input audio data, or a pointer to stored audio data, and publishing resultant metadata corresponding to the input audio data to a message queue of an operating system, said processing being performed by a hardware processor configured to perform such act, wherein the published metadata comprises, or is obtained through use of, audio fingerprint data or decoded watermark data identifying the audio data;

hooking said message queue by a first application program to monitor the input audio data for music of a first type;

hooking said message queue by a second application program to monitor the input audio data for music of a second type; and

automatically launching further activity by said first or second application programs, without user selection, when metadata indicating said first or second type of music is respectively published to said message queue.

12. The method of claim 11 in which the music of the first type comprises music by the Beatles.

13. The method of claim 11 in which the music of the second type comprises Disney movie soundtracks.