Smartphone-based methods and systems

• US 9,240,021 B2
• Filed: 11/02/2011
• Issued: 01/19/2016
• Est. Priority Date: 11/04/2010
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Rodriguez, Tony F.
• Primary Examiner(s): SPOONER, LAMONT M
• Application Number:
  US13/287,853
• Publication Number:
  US 20120284012A1
• Time in Patent Office: 1,539 Days
• Field of Search: 704/1, 704/9, 704/10
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: H04L 2463/101 applying security measures for digital rights management
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 2250/04 including near field communication means, e.g. RFID
• CPC Class Codes: H04M 2250/52 including functional features of a camera
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Abstract

Technologies involving portable devices, such as smartphones and tablet computers, are disclosed. One arrangement enables a creator of content to select software with which that creator'"'"'s content should be rendered—assuring Continuity between artistic intention and delivery. Another uses the camera of a smartphone to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography. A great variety of other features and arrangements are also detailed.

Claims

1. A portable device comprising:

a memory and a processing portion;

the memory including a first portion that stores plural semantic triples, where each of said triples includes three elements;

a subject, a predicate, and an object, each of said elements having a code value; and

the memory further including a second portion that stores literal data associating different text literals with different of said element code values;

wherein the processing portion includes a GPU that processes code values in the first portion of the memory, to perform operations on information represented by the text literals in the second portion of the memory; and

wherein the first portion of the memory has a 2D arrangement and is organized with spatial locality, rather than having an arbitrary organization, wherein triples that have the same code value for the subject element are grouped together, stored in adjoining locations in the first portion of the memory, so that the processing portion can better employ GPU functionality that relies on spatial locality.

2. The device of claim 1 wherein said operations include semantic reasoning operations, by which the processing portion infers logical consequences based on facts asserted by the semantic triples in conjunction with the literal data.

3. The device of claim 1 that further includes a display screen, wherein the first portion of the memory comprises a frame buffer having storage dimensions that match pixel dimensions of the display screen, so that frame buffer technology known for use with graphics is applied for use with semantic triples.

4. The device of claim 3 wherein the processing portion is configured to store results of said semantic reasoning in said frame buffer as additional semantic triples.

5. The device of claim 1 wherein triples that have the same code value for the subject element are further organized by order of their predicate or object element code values, to facilitate processing.

6. The device of claim 1 wherein the first portion of the memory includes a first instance of a first code value that is stored as a subject element, and also includes a second instance of the first code value that is stored as an object element, wherein both instances of said first code value are associated with the same text literal by data stored in the second portion of the memory.

7. The device of claim 1 wherein the memory further includes a third portion that stores rule data, and wherein the processing portion is configured to apply said rule data to the semantic triples, to discern information not previously expressed.

8. A portable device comprising:

a memory and a processing portion;

the processing portion being configured by instructions stored in the memory, the processing portion including a GPU;

the memory storing code data representing plural code-based semantic triples, each triple comprising three elements;

a subject code, a predicate code, and an object code, each of said element codes having a value, said memory being organized so that triples having the same value for one of said element codes are grouped together, stored in adjoining locations in one of plural blocks of said memory, so that the processing portion can better employ GPU functionality that relies on spatial locality;

the instructions configuring the processing portion to apply a series of templates to the stored code data, to perform operations based on said triples, each of said templates defining a pattern of code values that is compared against code values found in said blocks to identify blocks having matching patterns of code values.

9. The device of claim 8 in which the instructions configure the processing portion to apply said series of templates to the stored code data, to perform semantic reasoning based on said triples.

10. The device of claim 8 in which said instructions configure the processing portion to establish a new triple when a block is identified having a pattern of code values matching one of said templates, and to store data defining the new triple in said memory.

11. A semantic reasoning method including the acts:

receiving plural semantic triples, each including first, second and third elements, one of said elements being a subject, another of said elements being a predicate, and another of said elements being an object, each of said elements having a code value;

ordering the received triples for storage in a memory, so that triples having the same first element code value are grouped together, and are stored in adjoining locations in the memory; and

performing operations on said stored triples using a GPU having multiple cores;

wherein storage of triples having the same element code value, grouped together in the memory, facilitates GPU functionality that relies on spatial locality.

12. The method of claim 11 wherein said ordering comprises ordering the received triples so that triples having the same subject element code value are grouped together, and are stored in adjoining locations in the memory.

13. The method of claim 11 wherein the memory is organized as three regions of integer storage, a first region storing integer code values representing subject elements, a second region storing integer code values representing predicate elements, and a third region storing integer code values representing object elements, the memory being organized into plural blocks, each block comprising K integer storage locations in each of the three regions, the method including the acts:

in a first of said blocks, storing code values for multiple triples having said same first element code value, with said first element code value occupying multiple storage locations in one of said three memory regions; and

sorting said multiple triples so that second element integer code values thereof are ordered numerically in multiple storage locations of another of said three memory regions in said first block.

14. The method of claim 13 in which the memory is organized as three planes of integer storage, and each block comprises an M×

N memory location portion of one of said planes.

15. The method of claim 13 in which the memory is organized as three planes of integer storage, and each block comprises a 3×

3 memory location portion of one of said planes.

16. The method of claim 13 wherein said sorting act comprises sorting said multiple triples so that predicate element integer code values are ordered numerically in multiple storage locations of the second region of memory.

17. The method of claim 11 in which said triples having the same first element code value are stored in adjoining locations in one of plural blocks of said memory, wherein said act of performing operations comprises applying a series of templates to the triples stored in the memory, each of said templates defining a pattern of element code values that is compared against element code values found in said blocks to identify blocks having matching patterns of code values.

18. The method of claim 17 that further includes establishing a new triple when a block is identified having a pattern of code values matching one of said templates.

19. The method of claim 18 that further includes storing first, second and third elements for said new triple in the memory.