Methods and arrangements for device to device communication

• US 10,210,502 B2
• Filed: 04/11/2016
• Issued: 02/19/2019
• Est. Priority Date: 02/11/2014
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Filler, Tomas
• Primary Examiner(s): Shah, Utpal D
• Application Number:
  US15/096,112
• Publication Number:
  US 20170024723A1
• Time in Patent Office: 1,044 Days
• Field of Search: None
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 20/321 using wearable devices
• CPC Class Codes: G06Q 20/326 Payment applications installed on the mobile devices
• CPC Class Codes: G06Q 20/3274 using a pictured code, e.g. barcode or QR-code, being displayed on the M-device
• CPC Class Codes: G06Q 20/36 using electronic wallets or electronic money safes
• CPC Class Codes: G06Q 20/367 involving electronic purses or money safes
• CPC Class Codes: G06Q 20/382 insuring higher security of transaction
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: H04L 9/00 Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols

Abstract

The disclosure relates, e.g., to image processing technology including device to device communication. One claim recites an apparatus comprising: a camera for capturing imagery; and one or more processors configured for: analyzing a plurality of image frames captured with said camera, the plurality of image frames representing a plurality of graphics displayed on a display screen of a portable device, in which each of the graphics comprises an output from an erasure code generator, in which the erasure code generator produces a plurality of outputs corresponding to a payload; analyzing the plurality of image frames to decode outputs from the plurality of graphics; reconstructing the payload from decoded outputs; and utilizing the payload to carry out an action. A great variety of other features, arrangements and claims are also detailed.

Claims

1. A method for device to device communication using displayed imagery, said method employing a first device comprising a camera and one or more processors, said method comprising:

capturing a plurality of image frames with the camera, the plurality of image frames representing a plurality of graphics displayed on a display screen of a second device, in which display of the plurality of graphics comprises animation, and in which each of the plurality of graphics comprises an output from an erasure code generator, in which the erasure code generator produces a plurality of outputs corresponding to a payload;

using the one or more processors for;

analyzing the plurality of image frames to decode outputs from the plurality of graphics; and

reconstructing the payload from decoded outputs; and

utilizing the payload to carry out an action.

2. The method of claim 1 in which the erasure code generator comprises a fountain code generator.

3. The method of claim 1 in which each of the graphics comprises an output encoded therein with digital watermarking, and wherein said analyzing utilizes digital watermark detection to decode the outputs from the plurality of graphics.

4. The method of claim 1 in which only one output of the plurality of outputs is embedded in any one graphic of the plurality of graphics.

5. The method of claim 1 in which the plurality of outputs comprises a subset of a total number of outputs provided by the erasure code generator.

6. The method of claim 1 in which the first device comprises a smartphone or point of sale system, and the second device comprises a wrist watch or a second smartphone.

7. A system to facilitate device to device communication, comprising:

i. A portable device comprising;

a touch screen display;

an input;

memory comprising a payload; and

one or more electronic processors configured for;

processing the payload with an erasure code generator, in which the erasure code generator produces a plurality of outputs corresponding to the payload;

obtaining a plurality of graphics;

embedding one of the plurality of outputs in one of the plurality of graphics and proceeding with embedding until each of the plurality of outputs is so embedded, respectively, in a graphic of the plurality of graphics; and

causing the touch screen display to display embedded graphics of the plurality of graphics; and

ii. A capture device comprising;

a camera for capturing imagery of said touch screen display;

one or more processors configured for;

analyzing captured imagery representing displayed embedded graphics to decode outputs from the plurality of graphics;

reconstructing the payload from decoded outputs; and

utilizing the payload to carry out an action.

8. The system of claim 7 in which the erasure code generator comprises a fountain code generator.

9. The system of claim 7 in which only one output of the plurality of outputs is embedded in any one graphic of the plurality of graphics.

10. The system of claim 7 in which the plurality of outputs comprises a subset of a total number of outputs provided by the erasure code generator.

11. The system of claim 7 in which the erasure code generator comprises a fountain code generator, in which the fountain code generator produces the plurality of outputs, from which said capture device'"'"'s one or more processors can reassemble the payload by obtaining a subset of the plurality of outputs, the subset being less than the plurality of outputs.

12. The system of claim 7 in which the portable device comprises a wrist watch or smart phone.

13. The system of claim 7 in which display of the embedded graphics comprises animation.

14. The system of claim 7 in which the embedding comprises digital watermarking.

15. The system of claim 7 in which the embedded graphics are displayed so as to create a static image effect.

16. An apparatus comprising:

a camera for capturing imagery; and

one or more processors configured for;

analyzing a plurality of image frames captured with said camera, the plurality of image frames representing a plurality of graphics displayed on a display screen of a portable device, in which the plurality of graphics are displayed on the display screen so as to create a static image effect, and in which each of the graphics comprises an output from an erasure code generator, and in which the erasure code generator produces a plurality of outputs corresponding to a payload;

analyzing the plurality of image frames to decode outputs from the plurality of graphics;

reconstructing the payload from decoded outputs; and

utilizing the payload to carry out an action.

17. The apparatus of claim 16 in which each of the graphics comprises an output carried with digital watermarking, and in which said analyzing the plurality of image frames utilizes digital watermark detection to decode outputs from the plurality of graphics.

18. The apparatus of claim 16 in which said reconstructing the payload reconstructs the payload by obtaining a subset of the plurality of outputs, the subset being less than the plurality of outputs.

19. The apparatus of claim 16 in which the portable device comprises a wrist watch or a smart phone.

20. A non-transitory computer readable medium comprising instructions stored therein that, when executed by one or more processors of a first device, cause the one or more processors to perform acts including:

obtaining a plurality of image frames captured with a camera of the first device, the plurality of image frames representing a plurality of graphics displayed on a display screen of a second device, in which display of the plurality of graphics comprises animation, and in which each of the plurality of graphics comprises an output from an erasure code generator, in which the erasure code generator produces a plurality of outputs corresponding to a payload;

analyzing the plurality of image frames to decode outputs from the plurality of graphics; and

reconstructing the payload from decoded outputs; and

utilizing the payload to carry out an action.

21. The non-transitory computer readable medium of claim 20 in which each of the graphics comprises an output encoded therein with digital watermarking, and wherein said analyzing utilizes digital watermark detection to decode the outputs from the plurality of graphics.

22. The non-transitory computer readable medium of claim 21 in which only one output of the plurality of outputs is embedded in any one graphic of the plurality of graphics.

23. The non-transitory computer readable medium of claim 20 in which the plurality of outputs comprises a subset of a total number of outputs provided by the erasure code generator.

24. The non-transitory computer readable medium of claim 20 in which the first device comprises a smartphone or point of sale system, and the second device comprises a wrist watch or a second smartphone.