Image manipulation and processing techniques for remote inspection device

• US 20090196459A1
• Filed: 02/29/2008
• Published: 08/06/2009
• Est. Priority Date: 02/01/2008
• Status: Abandoned Application

• Current Assignee: Perceptron Incorporated (Atlas Copco AB)
• Original Assignee: Perceptron Incorporated (Atlas Copco AB)
• Inventors: Miller, Jeffrey J., Boehnlein, Al, Newman, Tye, Schober, Jeff, Eckhoff, Paul J., Watt, Brandon
• Application Number:
  US12/074,218
• Publication Number:
  US 20090196459A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G09G 2370/04 Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information
• CPC Class Codes: G09G 5/005 Adapting incoming signals to the display format of the display terminal
• CPC Class Codes: G09G 5/006 Details of the interface to the display terminal specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04
• CPC Class Codes: H04N 23/50 Constructional details
• CPC Class Codes: H04N 23/555 for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

A remote inspection apparatus has an imager disposed in an imager head and capturing image data. An active display unit receives the image data in digital form and graphically renders the image data on an active display. Movement tracking sensors track movement of the imager head and/or image display unit. In some aspects, a computer processor located in the active display unit employs information from movement tracking sensors tracking movement of the imager head to generate and display a marker indicating a position of the imager head. In additional aspects, the computer processor employs information from movement tracking sensors tracking movement of the active display unit to control movement of the imager head. In other aspects, the computer processor employs information from movement tracking sensors tracking movement of the active display unit to modify the image data rendered on the active display.

Claims

1. A remote inspection apparatus, comprising:

an imager disposed in an imager head and capturing image data;

an active display unit receiving the image data in digital form and graphically rendering the image data on an active display;

one or more movement tracking sensors tracking movement of the imager head; and

a computer processor located in the active display unit and employing information from the movement tracking sensors to generate and display a marker indicating a position of the imager head.

2. The apparatus of claim 1, wherein the marker includes 3D coordinates of the imager head in a coordinate system having a starting point of the imager head as its origin.

3. The apparatus of claim 1, wherein the marker includes an icon illustrating a position and orientation of the imager head at 3D coordinates of the imager head in a coordinate system having a starting point of the imager head as its origin.

4. The apparatus of claim 1, wherein the marker illustrates a 3D path taken by the imager head from a starting point of the imager head to 3D coordinates of the imager head in a coordinate system having the starting point of the imager head as its origin.

5. The apparatus of claim 1, wherein said computer processor further generates the marker indicating the position of the imager head in response to movement tracking sensors disposed to track movement of said active display unit.

6. The apparatus of claim 5, wherein said active display unit further has an augmented reality display and the marker is rendered by the augmented reality display to overlay a view of a user'"'"'s environmental surroundings.

7. The apparatus of claim 1, wherein the movement tracking sensors are located on the active display unit and track movement of the imager head by extracting motion vectors from video generated by the imager during movement of the imager head.

8. The apparatus of claim 1, wherein the movement tracking sensors are located on the imager head and include at least one of:

an accelerometer, a gyroscope, an optical mouse, sonar technology with triangulation, differential GPS, a gimbal, or an eyeball ballast.

9. The apparatus of claim 1, further comprising a digital image converter receiving the image data and converting the image data to digital form for rendering on the active display, wherein the digital image converter is located on at least one of:

the imager head, a motorized reel at least one of feeding or extracting a flexible cable connecting the imager head to the motorized reel;

a push stick connected to the imager head by a flexible cable;

or said active display unit.

10. The apparatus of claim 1, wherein said movement tracking sensors include a deployment sensor located on a motorized reel at least one of feeding or extracting a flexible cable connecting the imager head to the motorized reel.

11. A remote inspection apparatus, comprising:

an imager disposed in an imager head and capturing image data;

an active display unit receiving the image data in digital form and graphically rendering the image data on an active display;

one or more movement tracking sensors located on the active display unit and tracking movement of said active display unit; and

a computer processor employing input from said movement tracking sensors to control movement of the imager head.

12. The apparatus of claim 11, wherein said computer processor generates an imager head movement control signal and outputs the imager head movement control signal to an imager head movement control mechanism.

13. The apparatus of claim 12, wherein the movement control mechanism includes a motorized reel at least one of feeding or extracting a cable extending the imager head.

14. The apparatus of claim 12, wherein the movement control mechanism includes at least one of:

wires that articulate the imager head and are attached to a section of a cable at least one of feeding or extracting the imager head;

or flex-wire of the section of the cable that articulates the imager head.

15. The apparatus of claim 12, wherein the movement control mechanism includes micro-motors located in the imager head.

16. The apparatus of claim 11, wherein said movement tracking sensors include at least one of:

an accelerometer, a gyroscope, sonar technology with triangulation, differential GPS, a gimbal, or an eyeball ballast.

17. A remote inspection apparatus, comprising:

an imager disposed in an imager head and capturing image data;

an active display unit receiving the image data in digital form and graphically rendering the image data on an active display;

one or more display movement tracking sensors located on said active display unit and tracking movement of said active display unit; and

a computer processor;

(a) employing input from said display movement tracking sensors to modify at least part of the image data; and

(b) rendering the image data thus modified to the active display.

18. The apparatus of claim 17, wherein said computer processor modifies the image data by at least one of zooming, panning, or rotating the image data in response to the input received from said display movement tracking sensors.

19. The apparatus of claim 17, further comprising:

one or more imager head movement tracking sensors tracking movement of the imager head,

wherein said computer processor further;

(a) employs input from said imager head movement tracking sensors to rotate at least part of the image data; and

(b) renders the image data thus rotated to the active display.

20. A method of operation for use with a remote inspection device, comprising:

employing an imager disposed in an imager head to capture image data;

receiving the image data in digital form and graphically rendering the image data on an active display;

employing one or more movement tracking sensors to track movement of the imager head; and

employing a computer processor located in the active display unit to use information from the movement tracking sensors to generate and display a marker indicating a position of the imager head.

21. The method of claim 20, wherein the marker includes 3D coordinates of the imager head in a coordinate system having a starting point of the imager head as its origin.

22. The method of claim 20, wherein the marker includes an icon illustrating a position and orientation of the imager head at 3D coordinates of the imager head in a coordinate system having a starting point of the imager head as its origin.

23. The method of claim 20, wherein the marker illustrates a 3D path taken by the imager head from a starting point of the imager head to 3D coordinates of the imager head in a coordinate system having the starting point of the imager head as its origin.

24. The method of claim 20, wherein the computer processor further generates the marker indicating the position of the imager head in response to movement tracking sensors disposed to track movement of said active display unit.

25. The method of claim 24, wherein the active display unit further has an augmented reality display and the marker is rendered by the augmented reality display to overlay a view of a user'"'"'s environmental surroundings.

26. The method of claim 20, wherein the movement tracking sensors are located on the active display unit and track movement of the imager head by extracting motion vectors from video generated by the imager during movement of the imager head.

27. The method of claim 20, wherein the movement tracking sensors are located on the imager head and include at least one of:

an accelerometer, a gyroscope, an optical mouse, sonar technology with triangulation, differential GPS, a gimbal, or an eyeball ballast.

28. The method of claim 20, further comprising employing digital image converter to receive the image data and convert the image data to digital form for rendering on the active display, wherein the digital image converter is located on at least one of:

the imager head, a motorized reel at least one of feeding or extracting a flexible cable connecting the imager head to the motorized reel;

a push stick connected to the imager head by a flexible cable;

or the active display unit.

29. The method of claim 20, wherein the movement tracking sensors include a deployment sensor located on a motorized reel at least one of feeding or extracting a flexible cable connecting the imager head to the motorized reel.

30. A method of operation for use with a remote inspection apparatus, comprising:

employing an imager disposed in an imager head to capture image data;

employing an active display unit to receive the image data in digital form and graphically render the image data on an active display;

employing one or more movement tracking sensors located on the active display unit to track movement of the active display unit; and

employing a computer processor to use input from the movement tracking sensors to control movement of the imager head.

31. The method of claim 30, wherein the computer processor generates an imager head movement control signal and outputs the imager head movement control signal to an imager head movement control mechanism.

32. The method of claim 31, wherein the movement control mechanism includes a motorized reel at least one of feeding or extracting a cable extending the imager head.

33. The method of claim 31, wherein the movement control mechanism includes at least one of:

wires that articulate the imager head and are attached to a section of a cable at least one of feeding or extracting the imager head;

or flex-wire of the section of the cable that articulates the imager head.

34. The method of claim 31, wherein the movement control mechanism includes micro-motors located in the imager head.

35. The method of claim 30, wherein the movement tracking sensors include at least one of:

an accelerometer, a gyroscope, sonar technology with triangulation, differential GPS, a gimbal, or an eyeball ballast.

36. A method of operation for use with a remote inspection apparatus, comprising:

employing an imager disposed in an imager head to capture image data;

employing an active display unit to receive the image data in digital form and graphically render the image data on an active display;

employing one or more display movement tracking sensors on the active display unit to track movement of the active display unit; and

employing a computer processor;

(a) using input from the display movement tracking sensors to modify at least part of the image data; and

(b) rendering the image data thus modified to the active display.

37. The method of claim 36, wherein the computer processor modifies the image data by at least one of zooming, panning, or rotating the image data in response to the input received from the display movement tracking sensors.

38. The method of claim 36, further comprising:

employing one or more imager head movement tracking sensors to track movement of the imager head,

wherein the computer processor further;

(a) employs input from the imager head movement tracking sensors to rotate at least part of the image data; and

(b) renders the image data thus rotated to the active display.