Mobile device, system and method

• US 10,176,563 B2
• Filed: 10/05/2016
• Issued: 01/08/2019
• Est. Priority Date: 10/13/2015
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Kemp, Thomas, Cardinaux, Fabien, Hagg, Wilhelm, Bordewieck, Aurel, Uhlich, Stefan
• Primary Examiner(s): Azarian, Seyed
• Application Number:
  US15/285,801
• Publication Number:
  US 20170103514A1
• Time in Patent Office: 825 Days
• Field of Search: 382100, 382103, 382106-107, 382123, 382140, 382155, 382162, 382168, 382173, 382181, 382189, 382191, 382199, 382201, 382214, 382232, 382236, 382254, 382276, 382286, 382291, 382305, 382312, 382321, 382110, 398128, 3405721, 315158, 704 2, 715810
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06Q 50/12 Hotels or restaurants
• CPC Class Codes: G06T 2207/30128 Food products
• CPC Class Codes: G06T 7/0004 Industrial image inspection
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths

Abstract

A mobile device comprises a sensor and a processor. The sensor is configured to wirelessly receive an identification signal including an item identifier code, the identification signal being emitted by a low-rate transmission device associated with an item, wherein the sensor receives the identification signal from a direction of the item. The processor is configured to generate an output signal based on the item identifier code.

Claims

1. A mobile device, comprising:

a sensor configured to wirelessly receive an identification signal including an item identifier code, the identification signal being emitted by a low-rate transmission device associated with an item, wherein the sensor receives the identification signal from a direction of the item; and

a processor configured to

compare the item identifier code to an item identifier code generated by a user of the mobile device, and

generate an output signal based on the comparison of item identifier code and the item identifier code generated by the user; and

a user interface configured to output the output signal, the user interface including a display that is configured to display a virtual object such that the virtual object overlaps the item or an image of the item in a direction perpendicular to a plane of the display or in a viewing direction of a user using the mobile device,

wherein mobile device is a smart watch, an electronic wristband, electronic glasses, an e-book reader, or a smart lens.

2. The mobile device of claim 1, wherein the identification signal is a modulated signal.

3. The mobile device of claim 1, wherein the item identifier code of the identification signal is a bit-vector or a bit-matrix of 50 bit or less.

4. The mobile device of claim 1,

wherein the identification signal is a signal emitted from the low-rate transmission device directly towards the sensor, wherein the low-rate transmission device is arranged at a location in a predetermined area surrounding the item;

or

wherein the identification signal is a signal emitted from the low-rate transmission device towards the item and reflected by the item towards the sensor, wherein the low-rate transmission device is arranged to illuminate the item.

5. The mobile device of claim 1,

wherein the identification signal is an infrared light signal and the sensor is an infrared sensor or an image sensor;

or

wherein the identification signal is a visible light signal and the sensor is an image sensor.

6. The mobile device of claim 1, wherein the processor is configured

to determine on the basis of the item identifier, whether the item has a predetermined property or not;

and

to generate the output signal dependent on whether the item has the predetermined property or not.

7. The mobile device of claim 1, wherein the processor is further configured

to determine an item location information based on a positional relationship of the sensor relative to the item;

and

to generate the output signal further based on the item location information.

8. The mobile device of claim 7, wherein

the sensor is an image sensor configured to capture consecutive images of a scene including the item;

and

the processor is configured to determine the item location information by recognizing an area or a point within a region of the image, the region of the image representing the item or a predetermined area surrounding the item.

9. The mobile device of claim 1, wherein the user interface comprises a display means, an audio interface and/or a tactile interface.

10. A system, comprising:

a low-rate transmission device configured to emit an identification signal comprising an item identifier code, wherein the low-rate transmission device is associated with an item;

and

a mobile device, comprising;

a sensor configured to wirelessly receive the identification signal from a direction of the item;

a processor configured to

compare the item identifier code to an item identifier code generated by a user of the mobile device, and

generate an output signal based on the comparison of item identifier code and the item identifier code generated by the user; and

a user interface configured to output the output signal, the user interface including a display that is configured to display a virtual object such that the virtual object overlaps the item or an image of the item in a direction perpendicular to a plane of the display or in a viewing direction of a user using the mobile device,

wherein mobile device is a smart watch, an electronic wristband, electronic glasses, an e-book reader, or a smart lens.

11. A method for a mobile device, comprising:

wirelessly receiving an identification signal including an item identifier code, the identification signal being emitted by a low-rate transmission device associated with an item, wherein the identification signal is received from a direction of the item;

comparing the item identifier code to an item identifier code generated by a user of the mobile device; and

generating an output signal based on the comparison of item identifier code and the item identifier code generated by the user; and

outputting the output signal, wherein a virtual object is displayed such that the virtual object overlaps the item or an image of the item in a direction perpendicular to a plane of display means or in a viewing direction of a user,

wherein mobile device is a smart watch, an electronic wristband, electronic glasses, an e-book reader, or a smart lens.

12. The method of claim 11, comprising:

determining on the basis of the item identifier, whether the item has a predetermined property or not; and

generating the output signal dependent on whether the item has the predetermined property or not.

13. The method of claim 11, comprising:

determining an item location information based on a positional relationship of a sensor relative to the item; and

generating the output signal further based on the item location information.

14. The method of claim 13, wherein

receiving the identification signal comprises receiving a signal having high directivity with the sensor, the sensor having a small aperture angle;

and wherein

generating the output signal comprises;

determining the item location information on the basis of whether the sensor receives the identification signal or not; and

generating the output signal only when the identification signal is received.

15. The mobile device of claim 11, wherein

receiving the identification signal comprises capturing consecutive images of a scene including the item;

and

determining the item location information comprises recognizing an area or a point within a region of the image, the region of the image representing the item or a predetermined area surrounding the item.