IMAGE PROCESSING APPARATUS AND METHOD USING SMART GLASS

• US 20140146178A1
• Filed: 09/24/2013
• Published: 05/29/2014
• Est. Priority Date: 11/28/2012
• Status: Active Grant

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: KIM, Kwi Hoon, AHN, Sang Woo, KWON, O Hyung, YOU, Woong Shik, BAE, Jae Hwui
• Granted Patent: US 9,460,351 B2
• Time in Patent Office: Days
• US Class Current: 348/159
• CPC Class Codes: G01B 11/022 by means of tv-camera scanning
• CPC Class Codes: G01S 17/86 Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G08B 13/19621 Portable camera
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 7/144 camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

An image processing apparatus using a smart glass is provided, the image processing apparatus including an extractor to extract a first target to be observed by a user from a first image received from the smart glass and generate a second image using the extracted first target, an information collector to collect information related to the first target, and an image generator to reconstruct a third image using at least one of the second image and the information related to the first target, based on user settings.

Claims

1. An image processing apparatus using a smart glass, the apparatus comprising:

an extractor to extract a first target to be observed by a user from a first image received from the smart glass and generate a second image using the extracted first target;

an information collector to collect information related to the first target; and

an image generator to reconstruct a third image using at least one of the second image and the information related to the first target, based on user settings.

2. The apparatus of claim 1, wherein the first target comprises at least one of a time interval, a motion, a sound, an event, an object, and a predetermined person to be observed by the user.

3. The apparatus of claim 1, wherein the first image is captured from a viewpoint corresponding to a gaze of the user.

4. The apparatus of claim 1, wherein the second image in which an image quality with respect to a portion corresponding to the first target is greater than or equal to a first resolution, and an image quality with respect to a remaining portion excluding the first target is less than the first resolution, is generated.

5. The apparatus of claim 1, wherein the extractor comprises:

a motion recognizer to recognize a predetermined motion of the user,

wherein the extractor provides the user with information related to the predetermined motion of the user.

6. The apparatus of claim 1, wherein the image generator comprises:

a comparator to compare a previous image associated with the first target to the third image and provide a result of the comparing.

7. The apparatus of claim 1, wherein the image generator recommends an image for each category of the information related to the first target, based on the information related to the first target.

8. The apparatus of claim 1, wherein the third image comprises additional information provided using at least one of a graphic and a character.

9. The apparatus of claim 1, wherein the smart glass comprises a depth camera or a 360-degree view angle camera, and is connected to the Internet.

10. An image processing method using a smart glass, the method comprising:

receiving a first image from the smart glass, and extracting a first target to be observed by a user from the first image;

generating a second image using the extracted first image;

collecting information related to the first target; and

reconstructing a third image using at least one of the second image and the information related to the first target, based on user settings.

11. The method of claim 10, wherein the first target comprises at least one of a time interval, a motion, a sound, an event, an object, and a predetermined person to be observed by the user.

12. The method of claim 10, wherein the first image is captured from a viewpoint corresponding to a gaze of the user.

13. The method of claim 10, wherein the second image in which an image quality with respect to a portion corresponding to the first target is greater than or equal to a first resolution, and an image quality with respect to a remaining portion excluding the first target is less than the first resolution, is generated.

14. An image processing method using a smart glass, the method comprising:

extracting a first target to be observed by a user from a first image received from the smart glass and generating a second image using the extracted first target;

collecting information related to the first target; and

reconstructing a third image using at least one of the second image and the information related to the first target, based on user settings, and comparing a previous image associated with the first target to the third image and providing a result of the comparing on one side of the third image.

15. An image processing method using a smart glass, the method comprising:

extracting a first target to be observed by a user from a first image received from the smart glass and generating a second image using the extracted first target;

collecting information related to the first target; and

reconstructing a third image using at least one of the second image and the information related to the first target, based on user settings, and providing a recommended image for each category of the information related to the first target on one side of the third image.