Remote image transmission system, display apparatus, and guide displaying method thereof

• US 10,607,340 B2
• Filed: 01/11/2017
• Issued: 03/31/2020
• Est. Priority Date: 02/17/2016
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Min-soeng, Kim, Joo-yoo, Kim, Yong, Kim, Soo-wan, Kim, Eung-sun, Cho, Jae-geol, Hong, Tae-hwa
• Primary Examiner(s): Woldemariam, Aklilu K
• Application Number:
  US15/403,309
• Publication Number:
  US 20170236273A1
• Time in Patent Office: 1,175 Days
• Field of Search: 382128, 382141, 382165
• CPC Class Codes: A61B 5/0002 Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network A61B5/07 takes precedence; transmission systems for measured values G08C; transmission H04B; transmission of digital information H04L; wireless communication networks H04W
• CPC Class Codes: A61B 5/0013 Medical image data A61B1/00011, A61B6/56, A61B8/56 take precedence
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/0064 Body surface scanning
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/1072 measuring distances on the body, e.g. measuring length, height or thickness A61B5/1076 takes precedence
• CPC Class Codes: A61B 5/1079 using optical or photographic means
• CPC Class Codes: A61B 5/444 Evaluating skin marks, e.g. mole, nevi, tumour, scar
• CPC Class Codes: A61B 5/445 Evaluating skin irritation or skin trauma, e.g. rash, eczema, wound, bed sore
• CPC Class Codes: A61B 5/742 using visual displays A61B5/339 takes precedence
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 2207/30088 Skin; Dermal
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06V 10/255 Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
• CPC Class Codes: G06V 10/75 Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
• CPC Class Codes: G06V 2201/07 Target detection
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: H04N 13/239 : using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 23/20 : for generating image signals from infrared radiation only
• CPC Class Codes: H04N 23/45 : for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/56 : provided with illuminating means
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 23/64 : Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/661 : Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/667 : Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/74 : by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/33 : Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

A remote image transmission system, a display apparatus, and a guide displaying method of a display apparatus are provided. The remote image transmission system includes: an image capturing apparatus including a plurality of image pickup devices that are spaced from each other, the image capturing apparatus being configured to transmit, to a display apparatus, a plurality of images which are captured by the plurality of image pickup devices; and a display apparatus configured to generate a guide object indicating physical information of a captured object by using the plurality of received images, and to display the generated guide object and at least one of the plurality of images.

Claims

1. A remote image transmission system comprising:

a display apparatus; and

an image capturing apparatus comprising a plurality of cameras that are spaced from each other, the image capturing apparatus being configured to;

capture a plurality of images, which include an object, at a same time by using the plurality of cameras, and

transmit, to the display apparatus, the plurality of images and specification information indicating a distance between adjacent cameras from among the plurality of cameras and respective focal distances of the plurality of cameras, in conjunction with the plurality of captured images,

wherein the display apparatus is configured to;

receive the plurality of images and the specification information from the image capturing apparatus,

identify size information of the captured object based on the specification information,

obtain a guide object indicating the size information of the captured object by using the plurality of received images and the specification information, and

display the obtained guide object and at least one from among the plurality of images.

2. The remote image transmission system of claim 1, wherein the image capturing apparatus comprises:

a capturer comprising the plurality of cameras;

a communicator configured to communicate with the display apparatus; and

a processor configured to control the communicator to communicate with the display apparatus.

3. The remote image transmission system of claim 2, wherein the image capturing apparatus further comprises a light source configured to project light of an infrared wavelength,

wherein at least one from among the plurality of cameras is configured to receive reflected light from the light of the infrared wavelength projected by the light source.

4. The remote image transmission system of claim 1, wherein the display apparatus comprises:

a communicator configured to communicate with the image capturing apparatus;

a display; and

a processor configured to obtain the guide object indicating the size information of the captured object by using the plurality of received images and the specification information, and to control the display to display the obtained guide object and the at least one image from among the plurality of received images.

5. The remote image transmission system of claim 4, wherein the guide object is obtained in a form of at least one from among a ruler, a grid, and an arrow.

6. The remote image transmission system of claim 4, wherein the processor is further configured to detect an affected area within at least one image from among the plurality of received images, and to obtain a graphic object surrounding the detected affected area.

7. The remote image transmission system of claim 6, wherein the processor is further configured to perform filtering for changing an image characteristic of the detected affected area.

8. The remote image transmission system of claim 6, wherein the processor is further configured to control the display to display the graphic object surrounding the detected affected area, and to control the display to display a previously obtained graphic object which relates to a previously detected affected area within a previously received image.

9. The remote image transmission system of claim 8, wherein the processor is further configured to extract a characteristic point from the received at least one image within which the affected area has been detected, and to match a size of the graphic object surrounding the detected affected area with a size of the previously obtained graphic object based on the extracted characteristic point.

10. The remote image transmission system of claim 4, wherein the display apparatus further comprises an inputter configured to receive a selection of an object, and

wherein the processor is further configured to obtain the guide object displaying the size information of the selected object.

11. The remote image transmission system of claim 4, wherein the processor is further configured to obtain a three-dimensional (3D) model of an object included in the plurality of images by using the plurality of received images.

12. The remote image transmission system of claim 4, wherein the display apparatus further comprises a capturer configured to obtain the plurality of images captured by the plurality of cameras that are spaced from each other, and

wherein the display apparatus is further configured to extract physical information of an object captured by the image capturing apparatus by using the plurality of received images and the specification information, and to extract physical information of a captured space by using the plurality of captured images and the specification information, and to display at least one from among the plurality of received images and at least one from among the plurality of images captured by the display apparatus based on the extracted physical information.

13. A display apparatus comprising:

a communicator configured to communicate with an external device having a plurality of cameras that are spaced apart from each other and configured to capture a plurality of images which include an object;

a display; and

a processor configured to;

receive, through the communicator, the plurality of images and specification information indicating a distance between adjacent cameras from among the plurality of cameras and respective focal distances of the plurality of cameras, in conjunction with the plurality of captured images,

identify size information of the captured object included in the plurality of images based on the specification information,

obtain a guide object indicating the size information of the captured object included in the plurality of images by using the plurality of received images and the specification information, and

control the display to display the obtained guide object and at least one image from among the plurality of received images.

14. A method for displaying a guide of a display apparatus, the method comprising:

receiving, from an external device having a plurality of cameras that are spaced apart from each other and configured to capture a plurality of images which include an object, the plurality of images and specification information indicating a distance between adjacent cameras from among the plurality of cameras and respective focal distances of the plurality of cameras, in conjunction with the plurality of captured images;

identifying size information of the captured object included in the plurality of received images based on the specification information;

obtaining a guide object indicating the size information of the captured object included in the plurality of received images by using the plurality of received images and the specification information; and

displaying the obtained guide object and at least one image from among the plurality of received images.

15. The method of claim 14, further comprising:

detecting an affected area within at least one image from among the plurality of received images;

obtaining a graphic object surrounding the detected affected area; and

displaying the obtained graphic object.

16. The method of claim 15, further comprising matching and displaying a size of a graphic object which relates to a previously detected affected area within a previously received image with respect to a size of the graphic object surrounding the detected affected area within the at least one image from among the plurality of received images.

17. The method of claim 16, wherein the matching and displaying the size comprises:

extracting a characteristic point from the received at least one image within which the affected area has been detected; and

matching the size of the graphic object surrounding the detected affected area with the size of the previously obtained graphic object based on the extracted characteristic point.

18. The method of claim 14, wherein the obtaining the guide object comprises:

receiving a selection of an object included in at least one image from among the received plurality of images; and

obtaining the guide object displaying the size information of the selected object.