SYSTEM AND METHOD FOR IMAGE REGISTRATION OF MULTIPLE VIDEO STREAMS

• US 20130038632A1
• Filed: 08/12/2011
• Published: 02/14/2013
• Est. Priority Date: 08/12/2011
• Status: Active Grant

• Current Assignee: Help Lightning, Inc., UAB Research Foundation (University of Alabama System)
• Original Assignee: Help Lightning, Inc.
• Inventors: Dillavou, Marcus W., Shum, Phillip Corey, Guthrie, Baron L., Shenai, Mahesh B., Deaton, Drew Steven, May, Matthew Benton
• Granted Patent: US 9,886,552 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06F 3/1431 using a single graphics controller
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2370/045 using multiple communication channels, e.g. parallel and serial
• CPC Class Codes: G09G 2380/08 Biomedical applications
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: G09G 5/397 Arrangements specially adapted for transferring the contents of two or more bit-mapped memories to the screen simultaneously, e.g. for mixing or overlay G09G5/02 takes precedence
• CPC Class Codes: G16H 20/00 ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 20/40 relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 50/50 for simulation or modelling of medical disorders
• CPC Class Codes: G16H 80/00 ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/167 Synchronising or controlling image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals

Abstract

Provided herein are methods and systems for image registration from multiple sources. A method for image registration includes rendering a common field of interest that reflects a presence of a plurality of elements, wherein at least one of the elements is a remote element located remotely from another of the elements and updating the common field of interest such that the presence of the at least one of the elements is registered relative to another of the elements.

Claims

1. A method for image registration comprising:

rendering a common field of interest that reflects a presence of a plurality of elements, wherein at least one of the elements is a remote element located remotely from another of the elements; and

updating the common field of interest such that the presence of the at least one of the elements is registered relative to another of the elements.

2. The method of claim 1, further comprising rendering the presence of each of the elements in real time, wherein each of the elements is registered relative to another of the elements.

3. The method of claim 1, further comprising the step of rendering interaction between the elements in the common field of interest.

4. The method of claim 1, further comprising the step of continuously updating the common field of interest such that the presence of the remote element is rendered in real time to a local viewer.

5. The method of claim 1, further comprising the step of continuously updating the common field of interest such that the presence of a local one of the elements is rendered in real time to a remote viewer.

6. The method of claim 1, wherein each of the elements in the common field of interest is rendered to a remote viewer and a local viewer with a substantially similar alignment and orientation.

7. The method of claim 1, further comprising the step of calibrating the common field of interest by aligning a calibration feature of a remote field and a calibration feature of a local field.

8. The method of claim 7, wherein the calibration features of the remote field and the local field are aligned relative to a pre-defined coordinate system.

9. The method of claim 7, wherein the calibration features of the remote field and the local field are aligned relative to a pre-defined fiducial.

11. The method according to claim 7, wherein the registration feature is inserted onto at least one of the first image and the second image.

12. The method according to claim 7, wherein the registration feature is a third image inserted onto at least one of the first image and the second image.

13. The method of claim 7, wherein the registration feature is a virtual image rendered in the common field of interest.

14. The method of claim 7, wherein at least one of the first image and the second image is part of a video stream.

15. The method of claim 7, wherein at least one of the first image and the second image is part of a live video stream.

16. The method of claim 7, further comprising the step of continuously updating the composite image to render the composite image in real time to at least one of a local viewer and a remote viewer.

10. A method for image registration comprising:

generating a first image representing a first element;

generating a second image representing a second element disposed remotely from the first element; and

rendering a composite image including the first image and the second image, wherein at least one of the first image and the second image is registered relative to the other of the first image and the second image based upon a registration feature.

17. A system for image registration comprising:

a display configured for displaying a common field of interest;

a sensor configured for obtaining image data;

a processor in signal communication with the display and the sensor, wherein the processor is configured to perform steps comprising,

rendering a common field of interest that reflects a presence of a plurality of elements based upon the image data, wherein at least one of the elements is a remote element located remotely from another of the elements;

updating the common field of interest such that the presence of the at least one of the elements is registered relative to another of the elements; and

outputting the common field of interest to the display.

18. The system of claim 17, wherein the sensor is at least one of a camera, an infrared sensor, a light sensor, a RADAR device, a SONAR device, and a depth scan sensor.

19. The system of claim 17, wherein the processor is configured to perform the step of continuously updating the common field of interest such that the presence of the remote element is rendered in real time to a local viewer.

20. The system of claim 17, wherein the processor is configured to perform the step of continuously updating the common field of interest such that the presence of a local one of the elements is rendered in real time to a remote viewer.