Apparatus, system, and method of use of imaging assembly on mobile terminal

• US 9,721,164 B2
• Filed: 02/25/2016
• Issued: 08/01/2017
• Est. Priority Date: 01/31/2011
• Status: Active Grant

• Current Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Original Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Inventors: Stiles, Jonathan, Wang, Ynjiun Paul, Havens, William H.
• Primary Examiner(s): DOAN, PHUOC HUU
• Application Number:
  US15/052,915
• Publication Number:
  US 20160171307A1
• Time in Patent Office: 523 Days
• Field of Search: 4555754, 4555561, 235440, 396 85, 348344
• CPC Class Codes: G06K 19/06028 using bar codes
• CPC Class Codes: G06Q 10/08 Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A system for collecting data comprising a mobile terminal for capturing a plurality of frames of image data, the mobile terminal having a first imaging assembly and a second imaging assembly, the first imaging assembly for capturing a first frame of image data representing a first object and the second imaging assembly for capturing a second frame of image data representing a second object, wherein the system for use in collecting data is operative for associating first frame information and second frame information, the first frame information including one or more of image data of the first frame of image data and information derived utilizing the image data of the first frame of image data, the second frame information including one or more of image data of the second frame of image data and information derived utilizing the image data of the second frame of image data.

Claims

1. A method, comprising:

capturing a first plurality of frames of image data comprising a first frame of image data, the first plurality of frames of image data representing a scene in a field of view of a first imaging assembly of a terminal;

capturing a second plurality of frames of image data comprising a second frame of image data, the second plurality of frames of image data representing a scene in a field of view of a second imaging assembly of the terminal;

associating first frame information and second frame information, the first frame information including one or more of image data of the first frame of image data and information derived utilizing image data of the first frame of image data, the second frame information including one or more of image data of the second frame of image data and information derived utilizing image data of the second frame of image data; and

storing in the terminal video formatted to include image data of the first plurality of frames of image data and image data of the second plurality of frames of image data;

wherein frame images of the video are formatted to include reserved pixel coordinates for image data of the first plurality of frames of image data and remaining pixel coordinates for image data of the second plurality of frames of image data, the frame images having been cropped utilizing a border recognition algorithm for removal of image data of the first plurality of frames of image data and/or the second plurality of frames of image data.

2. The method of claim 1, wherein frame images of the video are formatted in an image file format including first image data fields having image data of the first plurality of frames of image data and second image data fields having image data of the second plurality of frame of image data.

3. The method of claim 1, wherein:

frame images of the video are formatted to include first pixel coordinates for image data of the first plurality of frames of image data and second pixel coordinates for image data of the second plurality of frames of image data; and

the first pixel coordinates and the second pixel coordinates are variably determined between images of the frame images.

4. The method of claim 1, wherein:

frame images of the video are formatted to include first pixel coordinates for image data of the first plurality of frames of image data and second pixel coordinates for image data of the second plurality of frames of image data; and

the first pixel coordinates and the second pixel coordinates are variably determined between images of the frame images based on a representation of an object between frames of the first plurality of frames of image data.

5. A method, comprising:

capturing a first plurality of frames of image data comprising a first frame of image data, the first plurality of frames of image data representing a scene in a field of view of a first imaging assembly having a first imaging axis;

capturing a second plurality of frames of image data comprising a second frame of image data, the second plurality of frames of image data representing a scene in a field of view of a second imaging assembly of the terminal having a second imaging axis that is non-parallel to the first imaging axis; and

associating first frame information and second frame information, the first frame information including one or more of image data of the first frame of image data and information derived utilizing image data of the first frame of image data, the second frame information including one or more of image data of the second frame of image data and information derived utilizing image data of the second frame of image data;

storing a video comprising frame images formatted to include reserved pixel coordinates for image data of the first plurality of frames of image data and remaining pixel coordinates for image data of the second plurality of frames of image data, the frame images having been cropped utilizing a border recognition algorithm for removal of image data of the first plurality of frames of image data and/or the second plurality of frames of image data.

6. The method of claim 5, wherein the scene in a field of view of the first imaging assembly includes a person and the scene in a field of view of the second imaging assembly includes an article comprising a bar code.

7. The method of claim 5, wherein:

the scene in a field of view of the first imaging assembly includes a person;

the scene in a field of view of the second imaging assembly includes an article comprising a bar code; and

the second frame information includes a decoded message determined by processing the second frame.

8. The method of claim 5, wherein:

the scene in a field of view of the second imaging assembly includes an article comprising a bar code; and

the second frame information includes decoded message determined by processing the second frame.

9. The method of claim 5, wherein:

the first frame of image data includes a representation of a person;

the scene in a field of view of the second imaging assembly includes an article comprising a bar code;

the second frame information includes a decoded message determined by processing the second frame; and

the associating comprises providing a file having both image data of the first frame of image data and the decoded message.

10. The method of claim 5, wherein:

the first frame of image data includes a representation of a person;

the scene in a field of view of the second imaging assembly includes an article comprising a bar code;

the second frame information includes a decoded message determined by processing the second frame; and

the associating comprises providing an image file having both image data of the first frame of image data and an open data field location including the decoded message.

11. The method of claim 5, wherein:

the scene in a field of view of the first imaging assembly includes a health care provider; and

the scene in a field of view of the second imaging assembly includes an article for use in treating a patient.

12. The method of claim 5, wherein:

the scene in a field of view of the first imaging assembly includes a delivery personnel; and

the scene in a field of view of the second imaging assembly includes an article being delivered.

13. The method of claim 5, wherein:

the scene in a field of view of the first imaging assembly includes a delivery personnel;

the scene in a field of view of the second imaging assembly includes an article being delivered having a barcode; and

the second frame information includes a decoded message determined by processing the second frame of image data.

14. The method of claim 5, wherein:

the scene in a field of view of the first imaging assembly includes a person;

the scene in a field of view of the second imaging assembly includes an article;

the first frame information includes a biometric identifier determined by processing the first frame of image data; and

the second frame information includes data determined by processing the second frame of image data.

15. The method of claim 5, comprising transmitting from the terminal streaming video, the streaming video formatted to include image data of the first plurality of frames of image data and image data of the second plurality of frames of image data.

16. The method of claim 15, wherein frame images of the streaming video are formatted to include reserved pixel coordinates for image data of the first plurality of frames of image data and remaining pixel coordinates for image data of the second plurality of frame of image data.

17. The method of claim 15, wherein:

frame images of the streaming video are formatted to include first pixel coordinates for image data of the first plurality of frames of image data and second pixel coordinates for image data of the second plurality of frames of image data; and

the first pixel coordinates and the second pixel coordinates are variably determined between images of the frame images.

18. The method of claim 15, wherein:

frame images of the streaming video are formatted to include first pixel coordinates for image data of the first plurality of frames of image data and second pixel coordinates for image data of the second plurality of frames of image data; and

the first pixel coordinates and the second pixel coordinates are variably determined between images of the frame images based on a representation of an object between frames of the first plurality of frames of image data.

19. A method, comprising:

capturing a first plurality of frames of image data comprising a first frame of image data, the first plurality of frames of image data representing a scene in a field of view of a first imaging assembly having a first imaging axis;

capturing a second plurality of frames of image data comprising a second frame of image data, the second plurality of frames of image data representing a scene in a field of view of a second imaging assembly of the terminal having a second imaging axis that is non-parallel to the first imaging axis;

associating first frame information and second frame information, the first frame information including one or more of image data of the first frame of image data and information derived utilizing image data of the first frame of image data, the second frame information including one or more of image data of the second frame of image data and information derived utilizing image data of the second frame of image data; and

storing in the terminal video formatted to include image data of the first plurality of frames of image data and image data of the second plurality of frames of image data;

wherein frame images of the video are formatted to include reserved pixel coordinates for image data of the first plurality of frames of image data and remaining pixel coordinates for image data of the second plurality of frames of image data, the frame images having been cropped utilizing a border recognition algorithm for removal of image data of the first plurality of frames of image data and/or the second plurality of frames of image data.

20. The method of claim 19, wherein frame images of the video are formatted in an image file format including first image data fields having image data of the first plurality of frames of image data and second image data fields having image data of the second plurality of frame of image data.