Method of processing multiple video images

• US 20090316012A1
• Filed: 06/21/2008
• Published: 12/24/2009
• Est. Priority Date: 06/21/2008
• Status: Abandoned Application

• Current Assignee: Jeffrey A. Matos
• Original Assignee: Jeffrey A. Matos
• Inventors: Matos, Jeffrey A.
• Application Number:
  US12/214,663
• Publication Number:
  US 20090316012A1
• Time in Patent Office: Days
• US Class Current: 348/208.140
• CPC Class Codes: H04N 1/00323 with a measuring, monitoring or signaling apparatus, e.g. for transmitting measured information to a central location
• CPC Class Codes: H04N 1/2112 using still video cameras
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/3252 Image capture parameters, e.g. resolution, illumination conditions, orientation of the image capture device H04N2201/3256 and subgroups take precedence
• CPC Class Codes: H04N 2201/3253 Position information, e.g. geographical position at time of capture, GPS data
• CPC Class Codes: H04N 2201/3254 Orientation, e.g. landscape or portrait; Location or order of the image data, e.g. in memory
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules

Abstract

A method of storing and organizing digital images includes the steps of:

a) using a camera, creating a digital image consisting of visual data representing visual content of a scene;

b) storing the visual data along with additional information which indicates a position of the camera and a spatial orientation of the camera at the moment when the digital image is created;

c) moving the camera to another location and repeating steps a) and b);

d) repeating step c) until the desired amount of information is obtained.

The camera can be moved intermittently, or moved continuously, while repeatedly capturing the visual data relating to the scene. Once captured and stored, the digital images can be compared to analyze the content of the scene.

Claims

1. A method of storing digital images, said method comprising the steps of:

a) creating a digital image using a camera, said image consisting of visual data representing visual content of a scene;

b) storing said visual data along with additional information which indicates a position of said camera and a spatial orientation of said camera at the moment when said camera captures said visual data defining said image;

c) moving said camera to another location and repeating steps a) and b);

d) repeating step c) until the desired amount of information is obtained;

thereby to organize and store information about a scene.

2. The method defined in claim 1, wherein said camera moves continuously, while repeatedly capturing said visual data.

3. The method defined in claim 1, wherein said camera position is defined by at least two coordinates in a Cartesian coordinate system.

4. The method defined in claim 1, wherein said camera position is defined by at least two coordinates in a global coordinate system.

5. The method defined in claim 4, wherein said coordinates are determined by a global positioning system.

6. The method defined in claim 1, wherein said camera orientation is defined by at least one coordinate in an angular coordinate system.

7. The method defined in claim 1, wherein said step b) further comprises the storing of information about image magnification, for each image.

8. The method defined in claim 7, wherein said image magnification information is a measure of at least one of (a) optical zoom, and (b) electronic zoom.

9. The method defined in claim 1, wherein said step b) further comprises the storing of information about lighting and shading of a recorded image.

10. The method defined in claim 9, wherein said information about lighting and shading comprises the storing of information concerning at least one of (a) brightness, (b) contrast, (c) white level, and (d) filtering.

11. The method defined in claim 1, wherein said step b) further comprises storing information indicating a moment in time when the camera captures said visual data defining said image.

12. The method defined in claim 1, wherein said scene is at least one of (a) terrain, (b) a landscape, (c) an aerial view, (d) an underwater view, and (e) a view from ground level.

13. The method defined in claim 1, wherein said image is at least one of (a) a face, (b) an interior of a blood vessel of a human body, and (c) an interior of at least one of an esophagus, stomach, intestine, appendix, gall bladder duct, pancreatic duct and hepatic duct;

(d) an interior of at least one of a ureter, bladder, fallopian tube, vagina and urethra; and

(e) at least one of a human hair and a portion of a head of a human body.

14. The method defined in claim 1, wherein said step b) further comprises the storing of information representing the distance between said camera and at least one object included in said scene.

15. The method defined in claim 14, wherein said distance information is obtained by measuring the time between the transmission from the camera of an energy wave and its return to the camera after reflection from an object in said scene.

16. The method defined in claim 14, wherein said distance information is obtained by the further steps of:

(e) identifying a visible point on an object in a scene recorded in a first image of said scene during a first performance of step (a);

(f) determining a spatial location and direction of the camera to the visible point when creating said first image;

(g) moving the camera to another location;

(h) identifying said visible point on said object recorded in a second image of said scene during a subsequent performance of step (a);

(i) determining a spatial location and direction of the camera to the visible point when creating said second image; and

(j) determining at least one of (1) the position of said visible point with respect to the camera, (2) the spatial coordinates of said visible point.

17. The method defined in claim 14, wherein said distance information is obtained by the further steps of:

(e) identifying a visible point on an object in a scene recorded in a first image of said scene during a first performance of step (a);

(f) determining a spatial location and direction of the camera to the visible point when creating said first image;

(g) determining a first position of said visible point within said first image;

(h) moving the camera to another location;

(i) identifying said visible point on said object recorded in a second image of said scene during a subsequent performance of step (a);

(j) determining a spatial location and direction of the camera to the visible point when creating said second image;

(k) determining a second position of said visible point within said second image; and

(l) determining at least one of (1) the position of said visible point with respect to the camera, (2) the spatial coordinates of said visible point, based on

(A) said first position,

(B) said second position, and

(C) said camera position and orientation information determined during the performance of steps (f) and (j).

18. The method defined in claim 14, wherein said distance information is obtained by the further steps of:

(e) identifying a visible point on an object in a scene recorded in a first image of said scene during a first performance of step (a);

(f) determining a spatial location and direction of the camera to the visible point when creating said first image;

(g) determining at least one first angular coordinate of said point, based on a first position of said point within said first image;

(h) moving the camera to another location;

(i) identifying said visible point on said object recorded in a second image of said scene during a subsequent performance of step (a);

(j) determining a spatial location and direction of the camera to the visible point when creating said second image;

(k) determining at least one second angular coordinate of said point, based on a second position of said point within said second image; and

(l) determining at least one of (1) the position of said visible point with respect to the camera, (2) the spatial coordinates of said visible point, based on

(A) said at least one first angular coordinate,

(B) said at least one second angular coordinate, and

(C) said camera position and orientation information determined during the performance of steps (f) and (j).

19. The method defined in claim 1, further comprising the step of displaying said digital images and said additional information.

20. The method defined in claim 19, further comprising the step of changing at least one of (i) a content, and (ii) a format of said displayed visual data and said additional information.

21. The method defined in claim 20, wherein said changing step includes altering at least one of (i) magnification of at least one image, (ii) brightness of said at least one image, and (iii) contrast of said at least one image.

22. The method defined in claim 1, further comprising the step of displaying a sequence of said digital images, wherein said additional information is used to determine said sequence.

23. The method defined in claim 22, wherein said camera position is defined by at least two coordinates in a Cartesian coordinate system, and wherein said displaying step includes displaying a sequence of images whose camera coordinates define at least one of (i) a line, and (ii) a curve in space.

24. The method defined in claim 22, wherein said camera orientation is defined by at least one coordinate in an angular coordinate system, and wherein said displaying step includes displaying a sequence of images showing the effect of altering said camera orientation.

38. The method defined in claim 24, further comprising the step of displaying a sequence of visual images, wherein said additional information is used to determine said sequence.

39. The method defined in claim 38, wherein each said camera position is defined by at least two coordinates in a Cartesian coordinate system, and wherein said displaying step includes displaying a sequence of images whose respective camera coordinates define at least one of (i) a line, and (ii) a curve in space.

40. The method defined in claim 38, wherein each said camera orientation is defined by at least one coordinate in an angular coordinate system, and wherein said displaying step includes displaying a sequence of images showing the effect of altering said orientation.

25. A method of digitally storing images, comprising the steps of:

a) creating two digital images, one from each of two cameras, each respective image consisting of visual data representing visual content of a scene;

b) storing said visual data along with additional information which indicates a position of each camera and a spatial orientation of each camera at the moment when said respective camera captures said visual data defining said image;

c) moving each camera to another location and repeating steps a) and b);

d) repeating step c) until the desired amount of information is obtained;

thereby to organize and store information about an image.

26. The method of claim 25, wherein said two cameras are pointing at the same scene.

27. The method of claim 25, wherein said two cameras are pointing at contiguous regions of the same scene.

28. The method of claim 25, wherein said two cameras create said respective images simultaneously.

29. The method of claim 25, a given parameter is held constant during step (c), said parameter being selected from the group consisting of:

(i) distance between said two cameras;

(ii) difference in angular orientation between said two cameras; and

(iii) a vector extending from one of the two cameras to the other.

30. The method defined in claim 26, wherein said step b) further comprises the step of storing information representing

the distance between said first camera and an object within said scene;

and

the distance between said second camera and said object within said scene.

31. The method defined in claim 30, wherein said distance information is obtained by the further steps of:

(e) identifying a visible point on an object in a first image of said scene, created by a first camera during a first performance of step (a);

(f) determining a first position of said point within said first image;

(g) identifying said visible point on said object in a second image of said scene, created by a second camera, substantially simultaneously with the creation of said first image by said first camera;

(h) determining a second position of said point within said second image;

(i) determining at least one of (1) the position of said visible point with respect to the two cameras, (2) the spatial coordinates of said visible point, based on

(A) said first position,

(B) said second position, and

(C) said camera position and orientation information determined during a first performance of step (b).

32. The method defined in claim 30, wherein said distance information is obtained by the further steps of:

(e) identifying a visible point on an object in a first image of said scene, created by a first camera during a first performance of step (a);

(f) determining at least one first angular coordinate of said point, based on a first position of said point within said first image;

(g) identifying said visible point on said object in a second image of said scene, created by a second camera, substantially simultaneously with the creation of said first image by said first camera;

(h) determining at least one second angular coordinate of said point, based on a second position of said point within said second image;

(i) determining at least one of (1) the position of said visible point with respect to the two cameras, (2) the spatial coordinates of said visible point, based on

(A) said at least one first angular coordinate,

(B) said at least one second angular coordinate, and

(C) said camera position and orientation information determined during a first performance of step (b).

33. The method of claim 31, wherein at least one determining step is made in substantially real time.

34. The method of claim 32, wherein at least one determining step is made in substantially real time.

35. The method defined in claim 25, further comprising the step of displaying said digital images created by each of said two cameras.

36. The method defined in claim 35, wherein said display is in a binocular format, thereby to allow a viewing person to have enhanced depth perception when viewing said scene.

37. The method defined in claim 36, further comprising the step of changing at least one of (i) a content, and (ii) a format of said displayed visual data and said additional information.

41. A method of comparing digitally stored images, comprising the steps of:

a) creating a first digital image using a camera, said image consisting of first visual data representing visual content of a scene;

b) storing said first visual data along with additional information which indicates a position of said camera and a spatial orientation of said camera at the moment when said camera captures said first visual data defining said first digital image;

c) thereafter creating a second digital image using a camera, said image consisting of second visual data representing visual content of substantially the same scene as in step a);

d) storing said second visual data along with additional information which indicates a position of said camera and a spatial orientation of said camera at the moment when said camera captures said second visual data defining said second digital image; and

e) comparing said first digital image with said second digital image;

thereby to determine a change in the content of said scene over a period of time.

42. The method defined in claim 41, wherein said position and spatial orientation of said camera during the creation of said first digital image, is the same as the position and spatial orientation of said camera during the creation of said second digital image.

43. The method defined in claim 41, wherein at least one of:

(i) lighting;

(ii) optical zoom;

(iii) digital zoom;

(iv) white level;

(v) filtering;

(vi) focus;

(vii) choice of lens and

(viii) lens opening,

is the same during the creation of both said first digital image and said second digital image.

44. The method defined in claim 41, further comprising the step of displaying visual data indicating the difference between said first digital image and said second digital image.

45. The method defined in claim 41, further comprising the steps of:

(f) changing at least one of (i) brightness, (ii) contrast, (iii) white level, (iv) digital zoom, (v) magnification, (vi) image position, of at least one of

(1) said first digital image, and

(2) said second digital image; and

(g) displaying visual data indicating the difference between at least one of

(1) said first digital image and a changed version of said second digital image;

(2) said second digital image and a changed version of said first digital image; and

(3) a changed image of said first digital image and a changed version of said second digital image.

46. The method defined in claim 41, wherein the step (e) of comparing said first digital image with said second digital image comprises the steps of:

(1) selecting at least one fiducial point marking a location of a point on an object in the scene shown by said first image;

(2) selecting at least one respective fiducial point marking a location of the same point on the same object selected in step (1), in the scene shown by said second image;

(3) compensating for any differences in at least one of image position and image magnification, between said first image and said second image, based on the position of said fiducial point in said first image and the position of said fiducial point in said second image.