Image and augmented reality based networks using mobile devices and intelligent electronic glasses

• US 9,942,420 B2
• Filed: 06/16/2016
• Issued: 04/10/2018
• Est. Priority Date: 01/30/2004
• Status: Active Grant

• Current Assignee: Airspace Reality, Co.
• Original Assignee: IP Holdings Incorporated (IP Holdings LLC)
• Inventors: Rao, Sunil K., Rao, Rekha K., Rao, Raman K.
• Primary Examiner(s): AYOTUNDE, AYODEJI O
• Application Number:
  US15/184,559
• Publication Number:
  US 20160295038A1
• Time in Patent Office: 663 Days
• Field of Search: 455566
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04L 45/306 Route determination based on the nature of the carried application
• CPC Class Codes: H04N 1/00095 Systems or arrangements for the transmission of the picture signal
• CPC Class Codes: H04N 1/00214 details of transmission
• CPC Class Codes: H04N 1/00244 with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 7/14 Systems for two-way working H04N7/12, H04N7/173 take precedence
• CPC Class Codes: H04W 40/02 Communication route or path selection, e.g. power-based or shortest path routing

Abstract

A mobile communication system based on digital content including images and video that may be acquired, processed, and displayed using a plurality of mobile device, smartphones, tablet computers, stationary computers, intelligent electronic glasses, smart glasses, headsets, watches, smart devices, vehicles, and servers. Content may be acquired continuously by input and output devices and displayed in a social network. Images may have associated additional properties including nature of voice, audio, data and other information. This content may be displayed and acted upon in an augmented reality or virtual reality system. The imaged base network system may have the ability to learn and form intelligent association between aspects, people and other entities; between images and the associated data relating to both animate and inanimate entities for intelligent image based communication in a network. Acquired content may be processed for predictive analytics. Individuals may be imaged for targeted and personalized advertising.

Claims

1. A wearable device comprising:

one or more image acquisition devices configured to capture a set of one or more images of an object entity;

one or more processors configured to assist with identifying the object entity based on the set of one or more captured images of the object entity; and

one or more lenses including one or more displays that are configured to display one or more image entities that are associated with the identified object entity.

2. The wearable device of claim 1, further comprising a wireless transmit unit configured to transmit the set of one or more captured images of the object entity to a remote server to assist with the identification of the object entity.

3. The wearable device of claim 1, further comprising an eye tracker configured to monitor one or more eyes of a user of the wearable device.

4. The wearable device of claim 1, wherein the one or more image entities associated with the identified object entity are updated using a displayed keyboard.

5. The wearable device of claim 1, further comprising an audio input device configured to receive audio commands from a user to access image entities associated with the object entity.

6. The wearable device of claim 1, wherein the one or more image acquisition devices are further configured to track one or more gestures of a user to determine interactions with the image entities associated with the object entity.

7. The wearable device of claim 1, wherein the one or more image acquisition devices is configured to capture set of one or more images including a video.

8. The wearable device of claim 7, wherein the one or more processors are further configured to generate a three-dimensional view of the object entity using the set of images.

9. The wearable device of claim 1, wherein the one or more image acquisition devices is further configured to assist with detecting a user'"'"'s interactions with the object entity.

10. The wearable device of claim 9, wherein the user'"'"'s interactions with the object entity results in historical information being shown on the one or more displays.

11. The wearable device of claim 1, wherein the object entity is a person.

12. A non-transitory computer readable storage medium that stores a set of instructions that are executable by at least one processor of wearable device to cause the wearable device to perform a method comprising:

acquiring a set of one or more captured images of an object entity;

identifying the object entity based on the set of one or more captured images of the object entity; and

providing for display one or more image entities that are associated with the identified object entity.

13. The non-transitory computer-readable storage medium of claim 12, wherein identifying the object entity based on the set of one or more captured images of the object entity includes:

providing for transmission to a remote device the set of one or more captured images of the object entity; and

acquiring the identification of the object entity from the remote device.

14. The non-transitory computer-readable storage medium of claim 12, wherein identifying the object entity based on the set of one or more captured images of the object entity includes:

providing the set of one or more captured images of the object entity to a local storage device of the wearable device; and

acquiring the identification of the object entity from the local storage.

15. The non-transitory computer-readable storage medium of claim 12, wherein the set of instructions that are executable by the at least one processor of wearable device to cause the wearable device to further perform :

acquire information to detect the object entity in a field of view of the wearable device.

16. The non-transitory computer-readable storage medium of claim 15, wherein the providing for display one or more image entities includes providing to a display information regarding the one or more image entities for overlaying the one or more image entities within the vicinity of the detected object entity in the field of view.

17. A method performed by the wearable device having one or more processors image acquisition devices, the method comprising:

capturing a set of one or more images of an object entity;

identifying the object entity based on the set of one or more captured images of the object entity; and

displaying one or more image entities that are associated with the identified object entity.

18. The method of claim 17, wherein identifying the object entity based on the set of one or more captured images of the object entity includes:

transmitting to a remote device the set of one or more captured images of the object entity; and

receiving the identification of the object entity from the remote device.

19. The method of claim 17, wherein identifying the object entity based on the set of one or more captured images of the object entity includes:

providing the set of one or more captured images of the object entity to a local storage device of the wearable device; and

identifying the object entity from the local storage.

20. The method of claim 17, further comprising:

acquiring information to detect the object entity in a field of view of the wearable device.

21. The method of claim 20, wherein displaying one or more image entities includes displaying information regarding the one or more image entities for overlaying the one or more image entities within the vicinity of the detected object entity in the field of view.