IMAGE DEVICE, INFORMATION PROCESSING DEVICE, AND IMAGE SYSTEM

• US 20170228927A1
• Filed: 02/28/2017
• Published: 08/10/2017
• Est. Priority Date: 09/03/2014
• Status: Active Grant

• Current Assignee: Nikon Corporation
• Original Assignee: Nikon Corporation
• Inventors: SUGIMURA, Takeaki, KAZAMI, Kazuyuki, NAKAGAWA, Yoshihiro
• Granted Patent: US 11,151,783 B2
• Time in Patent Office: Days
• CPC Class Codes: G01B 11/24 for measuring contours or curvatures
• CPC Class Codes: G06T 17/10 Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
• CPC Class Codes: G06T 7/40 Analysis of texture depth or shape recovery from texture G06T7/529
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

An imaging device, including: a main body; a detector including: an imager that images an object; and a distance measurer that detects a distance from each point on a surface of the object; an information calculator that is provided in the main body and uses a detection result of the detector to calculate at least one of shape information or texture information on the object; and a communicator that transmits a calculation result of the information calculator.

Claims

1. An imaging device, comprising:

a main body;

a detector comprising;

an imager that images an object; and

a distance measurer that detects a distance from each point on a surface of the object;

an information calculator that is provided in the main body and uses a detection result of the detector to calculate at least one of shape information or texture information on the object; and

a communicator that transmits a calculation result of the information calculator.

2. The imaging device according to claim 1, wherein the detection result of the detector includes an image taken by the imager.

3. The imaging device according to claim 1, wherein the information calculator calculates, as the shape information, surface information including coordinates of a plurality of points on the surface of the object and link information among the points.

4. The imaging device according to claim 1, wherein

the information calculator generates model information obtained by adding header information to information including at least one of the shape information or the texture information, and

the communicator transmits the model information.

5. The imaging device according to claim 1, wherein the information calculator calculates, as the texture information, light source information on light irradiated to the object.

6. The imaging device according to claim 1, wherein the communicator transmits the calculation result calculated by the information calculator selectively for each item.

7. The imaging device according to claim 1, wherein

the communicator receives, from an external device, an instruction that requests transmission of at least a part of the calculation result calculated by the information calculator, and

the communicator transmits information designated by the instruction.

8. The imaging device according to claim 1, wherein the information calculator calculates a detection direction of the detector that is capable of acquiring shape information on a second part adjacent to a first part represented by the calculated shape information.

9. The imaging device according to claim 1, comprising a position detector that detects position information on the detector, wherein

the position information on the detector includes at least one of a detection direction of the detector or global positioning information.

10. The imaging device according to claim 9, wherein the communicator transmits the calculation result that is associated with position information on the detector.

11. The imaging device according to claim 1, wherein the communicator transmits information on a timing at which the detector detects the object.

12. The imaging device according to claim 1, wherein the communicator transmits the calculation result that is associated with a time at which the detector detects the object.

13. The imaging device according to claim 1, comprising a model integrator that integrates first model information including shape information obtained by detecting the object from a first direction and second model information including shape information obtained by detecting the object from a second direction that is different from the first direction.

14. The imaging device according to claim 13, wherein the model integrator integrates the first model information and the second model information in a manner that a first feature part that is distinguishable from other parts in a shape represented by shape information in the first model information and a second feature part that is distinguishable from other parts in a shape represented by shape information in the second model information are associated with each other.

15. The imaging device according to claim 13, wherein the information calculator calculates the second model information by using an imaging result of the imager and a detection result of the distance measurer.

16. The imaging device according to claim 13, wherein the communicator receives the second model information from an external device.

17. The imaging device according to claim 13, wherein the second model information comprises position information on a detector that detects the object from the second direction.

18. The imaging device according to claim 1, comprising an irradiator that irradiates the object with light, wherein

the distance measurer detects the distance by using a result of detecting light that is radiated from the object through irradiation of the irradiator

19. The imaging device according to claim 1, wherein

the imager comprises a plurality of image sensors, and

the distance measurer uses imaging results of the image sensors to detect the distance.

20. The imaging device according to claim 1, wherein the distance measurer detects the distance by using imaging results of imaging the object from a plurality of directions with the imager.

21. An information processing device that executes rendering processing by using the calculation result transmitted from the communicator in at least one imaging device according to claim 1.

22. An imaging system, comprising:

at least one imaging device according to claim 1; and

an information processing device that executes rendering processing by using the calculation result transmitted from the communicator.

23. The imaging system according to claim 22, wherein

the at least one imaging device transmits third model information, the third model information including shape information obtained by detecting the object in a third direction, and fourth model information, the fourth model information including shape information obtained by detecting the object in a fourth direction that is different from the third direction, to the information processing device, and

the information processing device comprises a model integrator that integrates the third model information and the fourth model information.

24. An imaging system, comprising:

a plurality of the imaging devices according to claim 1; and

an imaging processing device that executes rendering processing by using the calculation result transmitted from the communicator in each of the imaging devices.

25. An imaging system, comprising:

at least one imaging device according to claim 1; and

a model integrator that uses the calculation result transmitted from the communicator to generate integrated model information on the object.

30. The imaging device according to claim 1, wherein the shape information includes information representing a three-dimensional shape.

31. The imaging device according to claim 1, wherein the shape information includes polygon data, vector data, or draw data.

32. The imaging device according to claim 1, wherein the information calculator extracts information that is used for rendering processing and includes the shape information or the texture information.

33. The imaging device according to claim 1, wherein the texture information includes optical characteristics information on the object.

34. The imaging device according to claim 1, wherein the imaging device is a wearable terminal and comprises a mount that is mountable on an object.

35. The imaging device according to claim 1, wherein the object comprises a biological tissue, a defect area, a measurement area, or an object that moves in an area of field of view of the imager.

36. The imaging system according to claim 22, wherein the imaging device comprises a time counter that detects information on a timing of detecting the object.

26. An imaging system, comprising:

a first imaging device comprising;

a first detector including a first imager that images an object and a first distance measurer that detects a distance from each point on a surface of the object; and

a first information calculator that uses a detection result of the first detector to calculate first model information including at least one of shape information or texture information on the object;

a second imaging device comprising;

a second detector including a second imager that images the object and a second distance measurer that detects a distance from each point on the surface of the object; and

a second information calculator that uses a detection result of the second detector to calculate second model information including at least one of shape information or texture information on the object; and

an information processing device comprising a model integrator that integrates the first model information and the second model information to generate integrated model information on the object.

27. An imaging system, comprising:

a first imaging device comprising;

a first detector including a first imager that images an object and a first distance measurer that detects a distance from each point on a surface of the object; and

a first information calculator that uses a detection result of the first detector to calculate first model information including at least one of shape information or texture information on the object, and uses the first model information to generate first feature point data;

a second imaging device comprising;

a second detector including a second imager that images the object and a second distance measurer that detects a distance from each point on a surface of the object;

a second information calculator that uses a detection result of the second detector to calculate second model information including at least one of shape information or texture information on the object, and uses the second model information to calculate second feature point data; and

a model integrator that uses the first feature point data and the second feature point data that are obtained by data communication between the first imaging device and the second imaging device to integrate the first model information and the second model information and generate integrated model information on the object.

28. The imaging system according to claim 27, comprising an information processing device including the model integrator.

29. The imaging system according to claim 27, wherein the first imaging device comprises:

the model integrator; and

a first communicator that transmits the integrated model information.