System and method for enabling mirror video chat using a wearable display device

• US 10,593,088 B2
• Filed: 01/25/2018
• Issued: 03/17/2020
• Est. Priority Date: 11/04/2013
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Yarosh, Svetlana, Amento, Brian S., Li, Kevin Ansia
• Primary Examiner(s): Johnson, Motilewa Good
• Application Number:
  US15/879,820
• Publication Number:
  US 20180150988A1
• Time in Patent Office: 782 Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0181 Adaptation to the pilot/driver
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G06T 3/60 Rotation of whole images or parts thereof
• CPC Class Codes: G06V 40/197 Matching; Classification
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085

Abstract

A method of exchanging audio-visual communication information between users includes detecting using an image capturing device associated with a wearable communication device, a mirror or image reflecting surface disposed in an environment of a first user, detecting a boundary of the mirror or image reflecting surface in response to the mirror being detected in the environment of the first user, selecting a portion of a first image displayed on the mirror or image reflecting surface within the boundary of the mirror or image reflecting surface, and displaying the portion of the first image as an overlay on a second image to a second user. A corresponding system and computer-readable device are also disclosed.

Claims

1. A method of transferring information between users, the method comprising:

detecting, using an image capturing device associated with a wearable communication device, an image reflecting surface;

detecting, using a processing device, a boundary of the image reflecting surface;

detecting a movement direction of an image of a first user reflected from the image reflecting surface;

providing a tactile signal to the wearable communication device in response to a detection signal associated with the movement direction of the image of the first user reflected from the image reflecting surface;

selecting an area of the image reflecting surface using an image defining gesture, the image defining gesture defining a portion of a first image within the boundary of the image reflecting surface;

generating a control command that crops the portion of the first image in response to the image defining gesture;

displaying, using a display device associated with the wearable communication device, the portion of the first image as an overlay on a second image to a second user; and

removing a bright spot from the first image using a comparison of brightness associated with a region of the first image to an average brightness associated with the first image.

2. The method, as defined by claim 1, wherein the detecting the boundary further comprises defining the image reflecting surface using at least one of gradient color and surface optics associated with the image reflecting surface.

3. The method, as defined by claim 1, wherein the image defining gesture comprises a head motion associated with the first user.

4. The method, as defined by claim 1, further comprising scaling the image of the first user using linear image scaling.

5. The method, as defined by claim 1, further comprising detecting eyes associated with the first user using at least one of a pattern recognition, a support vector machine algorithm, a retinal scanning, or a pupil surface reflection reference point.

6. The method, as defined by claim 5, further comprising:

measuring a distance between the eyes; and

determining a sharing region based on the distance between the eyes, the sharing region being centered around the eyes.

7. The method, as defined by claim 1, further comprising de-warping the first image using principal component analysis.

8. The method, as defined by claim 1, wherein the image capturing device is forward-facing relative to the first user.

9. The method, as defined by claim 1, wherein the tactile signal is a variable intensity tactile signal increasing in intensity as the image of the first user approaches the boundary of the image reflecting surface.

10. A system that transfers information between users, the system comprising:

an image capturing device associated with a wearable communication device;

a processing device;

a memory device storing instructions that, when executed by the processing device, perform operations comprising;

detecting an image reflecting surface;

detecting a boundary of the image reflecting surface;

detecting a movement direction of an image of a first user reflected from the image reflecting surface;

providing a tactile signal to the wearable communication device in response to a detection signal associated with the movement direction of the image of the first user reflected from the image reflecting surface;

selecting an area of the image reflecting surface using an image defining gesture, the image defining gesture defining a portion of a first image within the boundary of the image reflecting surface;

generating a control command that crops the portion of the first image in response to the image defining gesture; and

removing a bright spot from the first image using a comparison of a brightness associated with a region of the first image to an average brightness associated with the first image; and

a display device associated with the wearable communication device, the display device displaying the portion of the first image as an overlay on a second image to a second user.

11. The system, as defined by claim 10, wherein the detecting the boundary further comprises defining the image reflecting surface using at least one of gradient color and surface optics associated with the image reflecting surface.

12. The system, as defined by claim 10, wherein the image defining gesture comprises a head motion associated with the first user.

13. The system, as defined by claim 10, wherein the operations further comprise scaling the image of the first user using linear image scaling.

14. The system, as defined by claim 10, wherein the operations further comprise detecting eyes associated with the first user using at least one of a pattern recognition, a support vector machine algorithm, a retinal scanning, or a pupil surface reflection reference point.

15. The system, as defined by claim 14, wherein the operations further comprise

measuring a distance between the eyes;

and

determining a sharing region based on the distance between the eyes, the sharing region being centered around the eyes.

16. The system, as defined by claim 10, wherein the operations further comprise de-warping the first image using principal component analysis.

17. The system, as defined by claim 10, wherein the image capturing device is forward-facing relative to the first user.

18. The method, as defined by claim 10, wherein the tactile signal is a variable intensity tactile signal increasing in intensity as the image of the first user approaches the boundary of the image reflecting surface.

19. A computer-readable device storing instructions that, when executed by a processing device, perform operations comprising:

detecting an image reflecting surface using an image capturing device, the image capturing device being associated with a wearable communication device;

detecting a boundary of the image reflecting surface;

detecting a movement direction of an image of a first user reflected from the image reflecting surface;

providing a tactile signal to the wearable communication device in response to a sensory detection signal associated with the movement direction of the image of the first user reflected from the image reflecting surface;

selecting an area of the image reflecting surface using an image defining gesture, the image defining gesture defining a portion of a first image within the boundary of the image reflecting surface;

generating a control command that crops the portion of the first image in response to the image defining gesture;

displaying the portion of the first image as an overlay on a second image to a second user; and

removing a bright spot from the first image using a comparison of brightness associated with a region of the first image to an average brightness associated with the first image.

20. The computer-readable device, as defined by claim 19, wherein the image capturing device is forward-facing relative to the first user.