Augmented reality vision barcode scanning system and method

• US 10,108,832 B2
• Filed: 12/16/2015
• Issued: 10/23/2018
• Est. Priority Date: 12/30/2014
• Status: Active Grant

• Current Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Original Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Inventors: Franz, Dwight Linwood
• Primary Examiner(s): Zeender, Florian M
• Assistant Examiner(s): Amsdell, Dana
• Application Number:
  US14/970,702
• Publication Number:
  US 20160188943A1
• Time in Patent Office: 1,042 Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02C 11/10 Electronic devices other than hearing aids
• CPC Class Codes: G02C 7/04 Contact lenses for the eyes disinfection or sterilisation of contact lenses A61L12/00
• CPC Class Codes: G06K 7/10831 Arrangement of optical elements, e.g. lenses, mirrors, prisms optical elements per se G02B
• CPC Class Codes: G06K 7/10841 Particularities of the light-sensitive elements semiconductor devices H01L
• CPC Class Codes: G06Q 20/202 Interconnection or interaction of plural electronic cash registers [ECR] or to host computer, e.g. network details, transfer of information from host to ECR or from ECR to ECR
• CPC Class Codes: G06Q 20/203 Inventory monitoring
• CPC Class Codes: G06Q 20/208 Input by product or record sensing, e.g. weighing or scanner processing
• CPC Class Codes: G06Q 20/321 using wearable devices

Abstract

An exemplary augmented reality vision barcode scanning system for use with a human visual system includes at least one scanning contact lens, wireless enabled companion eyewear, and a remote barcode decoder. A related, exemplary method includes scanning and displaying barcodes with the augmented reality vision barcode scanning system in conjunction with a human visual system.

Claims

1. An augmented reality vision barcode scanning system for use in conjunction with a human visual system, comprising:

(i) at least one contact lens coated with a reflective surface over a portion of the contact lens that corresponds to the outer edges of the pupil of the eye of the human visual system and the iris portion of the eye of the human visual system, the contact lens having a clear aperture for the center portion of the pupil of the human visual system, the reflective surface configured to pass a portion of ambient light and to deflect near-surface images;

(ii) eyewear having at least one semi-transparent, semi-reflective surface viewable to the human visual system, the eyewear having an imager for receiving reflective images from the contact lens, the eyewear being enabled for wireless communication, the eyewear having a micro-projector for projecting images onto the viewable surfaces, the eyewear being provided with an aiming function, the eyewear having means configured to communicatively couple the imager, the wireless communications, the micro-projector, and the aiming function;

(iii) a remote barcode decoder, the barcode decoder being wireless enabled to send and receive information pertaining to barcodes to be decoded and decoded information;

the aiming function configured to identify a barcode image to be scanned;

the contact lens configured to reflect the barcode image viewed by the human visual system via the reflective surface to the imager;

the eyewear configured to transmit the barcode image received by the imager to the barcode decoder via wireless communications;

the barcode decoder configured to decode the barcode received from the eyewear and to send the decoded barcode information to the eyewear;

the eyewear configured to display the decoded barcode information on the viewable surface via the micro-projector; and

the contact lens configured to allow the decoded barcode information on the viewable surface to pass through the clear aperture to the human visual system and to be deflected by the reflective surface so that the decoded barcode information and ambient light are simultaneously viewable by the human visual system.

2. The augmented reality vision barcode scanning system of claim 1, wherein the contact lens is a prescription contact lens.

3. The augmented reality vision barcode scanning system of claim 1, wherein the contact lens is a pair of contact lenses.

4. The augmented reality vision barcode scanning system of claim 1, wherein the eyewear is provided with a reflective surface configured to receive the barcode image from the reflective surface of the contact lens and to reflect the barcode image to the imager.

5. The augmented reality vision barcode scanning system of claim 1, wherein the eyewear is provided with wireless enabled ear buds configured to receive decoded barcode information from the barcode decoder.

6. The augmented reality vision barcode scanning system of claim 1, wherein the viewable surface is a two-section surface corresponding to the two eyes of the human visual system.

7. The augmented reality vision barcode scanning system of claim 1, wherein the viewable surface has a first portion and a second portion, the micro-projector is configured to display the decoded barcode information on the first portion of the viewable surface, and the second portion of the viewable surface is configured to pass ambient light to the human visual system so the human visual system views the decoded barcode information superimposed on ambient light.

8. The augmented reality vision barcode scanning system of claim 1, comprising at least one wireless enabled point-of-sale module and at least one wireless enabled inventory-control module.

9. The augmented reality vision barcode scanning system of claim 8, wherein the barcode decoder is configured to send decoded barcode information to the point-of-sale module and to the inventory-control module.

10. The augmented reality vision barcode scanning system of claim 1, wherein the aiming function includes an LED mounted on the eyewear, and the aiming function is configured to communicate to the imager that the barcode image being illuminated by the LED is the barcode image to be scanned.

11. The augmented reality vision barcode scanning system of claim 1, wherein the scanning system is configured to be initialized by an act of the wearer of the system.

12. The augmented reality vision barcode scanning system of claim 11, wherein:

the eyewear is provided with a microphone and voice recognition software;

the microphone is communicatively coupled to the imager, the wireless communications, the micro-projector, and the aiming function; and

the act to initialize the scanning system is a voice command by the wearer of the augmented reality vision barcode scanning system.

13. The augmented reality vision barcode scanning system of claim 11, wherein the eyewear is provided with a user-activated switch to initialize the scanning system.

14. A method of scanning and displaying barcode information with an augmented reality vision barcode scanning system for use in conjunction with a human visual system, comprising:

i. providing an augmented reality vision barcode system having;

at least one contact lens coated with a reflective surface over a portion of the contact lens that corresponds to the outer edges of the pupil of the eye of the human visual system and the iris portion of the eye of the human visual system, the contact lens having a clear aperture for the center portion of the pupil of the human visual system, the reflective surface configured to pass a portion of ambient light and to deflect near-surface images;

eyewear having at least one semi-transparent, semi-reflective surface viewable to the human visual system, the eyewear having an imager for receiving reflective images from the contact lens, the eyewear being enabled for wireless communication, the eyewear having a micro-projector for projecting images onto the viewable surfaces, the eyewear being provided with an aiming function, the eyewear having means configured to communicatively couple the imager, the wireless communications, the micro-projector and the aiming function;

a remote barcode decoder, the barcode decoder being wireless enabled for sending and receiving information pertaining to barcodes to be decoded and decoded information;

ii. viewing a barcode by the human visual system;

iii. initializing the scanning system;

iv. identifying the barcode to be scanned via the aiming function;

v. reflecting the barcode image by the reflective surface of the contact lens to the imager on the eyewear;

vi. transmitting the barcode image to a barcode decoder via the eyewear wireless communications;

vii. decoding the barcode at the barcode decoder;

viii. sending the decoded barcode information to the eyewear;

ix. displaying the decoded barcode information on the viewable surfaces via the micro-projector;

x. reflecting the displayed decoded barcode information through the clear aperture to the human visual system;

xi. deflecting the displayed decoded barcode information from entering the human visual system at the reflective surface of the contact lens; and

xii. passing ambient light through the reflective surface of the contact lens to the human visual system.

15. The method of claim 14, wherein the eyewear is provided with wireless enabled ear buds, and comprising the further step of receiving audio decoded barcode information from the barcode decoder.

16. The method of claim 14, wherein:

the eyewear is provided with a reflective surface for reflecting images from the reflective surface of the contact lens to the imager; and

the reflecting step comprises receiving the barcode image from the reflective surface of the contact lens on the eyewear reflective surface and reflecting the barcode image from the eyewear reflective surface to the imager.

17. The method of claim 14, wherein the system comprises at least one wireless enabled point-of-sale module and at least one wireless enabled inventory-control module, the method further comprising the step of sending decoded barcode information to the point-of-sale module and to the inventory-control module.

18. The method of claim 14, wherein the system comprises a microphone and voice recognition software, the microphone and voice recognition software being communicatively linked to the system, and wherein the initializing step is accomplished by a user of the system issuing a voice command.