Smartphone-based methods and systems

• US 9,330,427 B2
• Filed: 01/16/2014
• Issued: 05/03/2016
• Est. Priority Date: 11/04/2010
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Conwell, William Y.
• Primary Examiner(s): Tran, Dzung
• Application Number:
  US14/157,108
• Publication Number:
  US 20140320021A1
• Time in Patent Office: 838 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/21 Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06K 7/1443 locating of the code in an image
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G06T 1/0064 Geometric transfor invariant watermarking, e.g. affine transform invariant
• CPC Class Codes: G06T 2201/0052 Embedding of the watermark in the frequency domain
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04M 1/0264 for a camera module assembly
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/70 Circuitry for compensating brightness variation in the scene
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04W 4/18 Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals
• CPC Class Codes: H04W 4/50 Service provisioning or reconfiguring
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
• CPC Class Codes: H04W 8/22 Processing or transfer of terminal data, e.g. status or physical capabilities
• CPC Class Codes: H05B 47/11 by determining the brightness or colour temperature of ambient light
• CPC Class Codes: H05B 47/12 by detecting audible sound
• CPC Class Codes: Y02B 20/40 Control techniques providing energy savings, e.g. smart controller or presence detection

Abstract

Arrangements involving portable devices (e.g., smartphones and tablet computers) are disclosed. One arrangement enables a content creator to select software with which that creator'"'"'s content should be rendered—assuring continuity between artistic intention and delivery. Another utilizes a device camera to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in connection with shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography. A great variety of other features and arrangements are also detailed.

Claims

1. In a lighting fixture comprising:

a connection to a power line;

at least one LED light emitter to illuminate an environment; and

a control unit to receive a first signal and vary intensity of light output by the light emitter in response to the first signal;

an improvement wherein;

the first signal is a digital control signal received over the power line, and the fixture also includes;

a content sensor for capturing audio or image information;

a data processing unit coupled to the sensor to generate content identification information based on the captured audio or image information, said content identification information being different than the captured information; and

a modulator to encode light output by the light emitter with a second signal, where the second signal is based on the content identification information;

wherein the fixture is adapted to vary light output by the emitter in accordance with both the first and second signals.

2. The lighting fixture of claim 1 in which the LED light emitter comprises plural differently-colored LED, and the modulator is adapted to produce plural different pulse-width-modulated control signals, for respectively driving said plural differently-colored LED sources.

3. The fixture of claim 1 in which the modulator is adapted to vary chrominance of light emitted by the light emitter in accordance with the second signal, wherein the fixture is adapted to vary both the intensity and chrominance of the light output by the emitter, based on said first and second signals.

4. The fixture of claim 1 in which the content sensor comprises an image sensor.

5. The fixture of claim 4 in which the processing unit comprises a facial recognizing unit operative on data from the image sensor, and the second signal conveys data identifying a person recognized by said facial recognizing unit.

6. The fixture of claim 1 in which the modulator includes a convolutional or trellis encoder, to provide robustness against data errors.

7. A system that includes the lighting fixture of claim 1, and that further includes a camera-equipped smartphone adapted to decode the second signal from light data received by the camera of said smartphone.

8. The lighting fixture of claim 1 in which the data processing unit comprises an audio watermark decoder.

12. The method of claim 1 that includes using said processor to derive second data by detecting audio watermark data from the captured content information.

9. A lighting fixture for coupling to a power line, comprising:

a light emitter, including one or more light sources;

first control means for varying intensity of light output by the light emitter, in response to first data received over the power line;

a sensor for sensing information from an environment of the fixture;

processing means coupled to the sensor, for generating second data based on said information sensed from the environment of the fixture; and

modulator means for encoding the second data in light output by the light emitter;

wherein the fixture is adapted to vary the light output by the light emitter in accordance with both the first and second data.

10. The lighting fixture of claim 9 in which the processing means comprises an audio watermark decoder.

11. A method of operating a lighting fixture that is powered from a power line, comprising the acts:

extracting first digital data from the power line;

varying intensity of light output by the lighting fixture in response to said first data;

capturing audio or image content information;

using a processor configured by software instructions in a memory to derive second data from the captured content information; and

modulating the light output by the lighting fixture with the second data;

wherein the light output from the lighting fixture varies in accordance with both the first and second data.