IMAGING DEVICE SYSTEM WITH EDGE PROCESSING

• US 20190028721A1
• Filed: 10/18/2017
• Published: 01/24/2019
• Est. Priority Date: 11/18/2014
• Status: Abandoned Application

• Current Assignee: The Invention Science Fund II, L.L.C. (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Rutschman, Phillip, Brav, Ehren, Hannigan, Russell, Hyde, Roderick A., Ishikawa, Muriel Y., Johanson, 3ric, Kare, Jordin T., Pan, Tony S., Tegreene, Clarence T., Whitmer, Charles, Wood, JR., Lowell L., Wood, Victoria Y.H., Dorschel, Travis P.
• Application Number:
  US15/787,075
• Publication Number:
  US 20190028721A1
• Time in Patent Office: Days
• CPC Class Codes: G02B 13/02 Telephoto objectives, i.e. systems of the type + - in which the distance from the front vertex to the image plane is less than the equivalent focal length
• CPC Class Codes: G03B 37/04 with cameras or projectors providing touching or overlapping fields of view
• CPC Class Codes: G06T 3/4023 based on decimating pixels or lines of pixels; based on inserting pixels or lines of pixels
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 10/34 Smoothing or thinning of the pattern; Morphological operations; Skeletonisation
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: H04N 19/33 in the spatial domain
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

In one embodiment, a device for providing low latency communication of high resolution imagery includes, but is not limited to, a first imaging unit including at least: a first optical arrangement directed at a first field of view; a first image sensor that is positioned with the first optical arrangement and that is configured to convert detected light into first image data; and a first image processor coupled to the first image sensor and configured to execute operations including at least: receive the first image data; process the first image data to generate first output data that requires less bandwidth for communication than the first image data; and transfer the first output data.

Claims

1. A device for providing low latency communication of high acuity imagery, the device comprising:

a communication interface;

at least one imaging unit, the at least one imaging unit including at least;

an optical arrangement;

an image sensor that is positioned with the optical arrangement and that is configured to convert detected light into an image; and

an image processor coupled to the image sensor and configured to execute operations including at least;

receive the image;

process the image by performing image recognition to identify one or more features within the image;

select a portion of the image that corresponds to the one or more features; and

decimate one or more pixels within the portion of the image that corresponds to the one or more features in an amount that depends on a size of the portion of the image.

2. The device of claim 1, wherein the image processor is further configured to execute an operation comprising:

process the image to generate non-image alphanumeric output data.

3. The device of claim 1, wherein the decimate one or more pixels within the portion of the image that corresponds to the one or more features in an amount that depends on a size of the portion of the image comprises:

decimate one or more pixels within the portion of the image that corresponds to the one or more features in an amount that depends on a size of the portion of the image to maintain a constant acuity.

4. The device of claim 1, further comprising:

a hub processor coupled to the at least one imaging unit and configured to execute operations comprising;

receive an upload of a third party application via the communication interface; and

execute the third party application to process the image.

5. The device of claim 1, further comprising:

a hub processor coupled to the at least one imaging unit and including one or more ports for removably coupling one or more imaging units to expand an overall field of view of the device.

6. The device of claim 1, wherein the communication interface has a bandwidth capability of less than one hundred Mbps.

7. The device of claim 1, further comprising:

a hub processor coupled to the at least one imaging unit and configured to execute an operation comprising;

generate a data request for the image processor based on a request received via the communication interface.

8. The device of claim 1, further comprising:

a hub processor coupled to the at least one imaging unit and configured to execute an operation comprising;

at least one of coordinate, triage, delegate, and/or manage one or more requests.

9. The device of claim 1, further comprising:

a hub processor coupled to the at least one imaging unit and configured to execute an operation comprising;

distribute processing load to the at least one imaging unit based on ability to satisfy a request.

28. The device of claim 1, wherein the image processor is further configured to execute an operation comprising:

decimate one or more pixels other than the portion of the image selected.

29. The device of claim 1, wherein the decimate one or more pixels within the portion of the image that corresponds to the one or more features in an amount that depends on a size of the portion of the image comprises:

decimate one or more pixels within the portion of the image that corresponds to the one or more features in an amount that increases with a size of the portion of the image.

30. The device of claim 1, wherein the image processor is further configured to perform an operation comprising:

transfer the portion of the image without the one or more pixels that have been decimated.

31. The device of claim 1, wherein the decimate one or more pixels within the portion of the image that corresponds to the one or more features in an amount that depends on a size of the portion of the image comprises:

decimate one or more pixels within the portion of the image that corresponds to the one or more features in an amount that depends on a size of the portion of the image, the decimated one or more pixels being unevenly distributed.

32. The device of claim 1, wherein the at least one imaging unit comprises:

an array of imaging units each coupled to a hub processor.

33. The device of claim 1, wherein the decimate one or more pixels within the portion of the image that corresponds to the one or more features in an amount that depends on a size of the portion of the image comprises:

decimate one or more pixels within the portion of the image that corresponds to the one or more features in an amount that is decreases with a size of the portion of the image.

34. The device of claim 1, wherein the decimate one or more pixels within the portion of the image that corresponds to the one or more features in an amount that depends on a size of the portion of the image comprises:

decimate one or more pixels within the portion of the image that corresponds to the one or more features in an amount that depends on a size of the portion of the image to maintain the same visual acuity.

35. The device of claim 1, wherein the image processor is further configured to execute an operation comprising:

decimate pixels other than the portion of the image selected.

36. The device of claim 1, wherein the select a portion of the image that corresponds to the one or more features comprises:

increase zoom to a portion of the image that corresponds to the one or more features.

37. The device of claim 36, wherein the decimate one or more pixels within the portion of the image that corresponds to the one or more features in an amount that depends on a size of the portion of the image comprises:

decimate one or more pixels within the portion of the image that corresponds to the one or more features in an amount that is based on a level of zoom.

10-27. -27. (canceled)