Apparatus, system, and method of use of imaging assembly on mobile terminal

• US 9,277,109 B2
• Filed: 08/26/2013
• Issued: 03/01/2016
• Est. Priority Date: 01/31/2011
• Status: Active Grant

• Current Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Original Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Inventors: Havens, William H., Wang, Ynjiun Paul, Stiles, Jonathan
• Primary Examiner(s): Doan, Phuoc H
• Application Number:
  US13/975,845
• Publication Number:
  US 20130342717A1
• Time in Patent Office: 918 Days
• Field of Search: 455/556.1, 455/575.4, 348/344, 396/85, 235/440
• US Class Current: 1/1
• CPC Class Codes: G06K 19/06028 using bar codes
• CPC Class Codes: G06Q 10/08 Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A system for collecting data comprising a mobile terminal for capturing a plurality of frames of image data, the mobile terminal having a first imaging assembly and a second imaging assembly, the first imaging assembly for capturing a first frame of image data representing a first object and the second imaging assembly for capturing a second frame of image data representing a second object, wherein the system for use in collecting data is operative for associating first frame information and second frame information, the first frame information including one or more of image data of the first frame of image data and information derived utilizing the image data of the first frame of image data, the second frame information including one or more of image data of the second frame of image data and information derived utilizing the image data of the second frame of image data.

Claims

1. A method for implementation with use of a mobile terminal having a first imaging assembly and a second imaging assembly and a display, the method comprising:

capturing a first plurality of frames of image data and a second plurality of frames of image data, the first plurality of frames of image data including a first frame of image data, the second plurality of frames of image data including a second frame of image data, the first plurality of frames of image data representing a scene in a field of view of the first imaging assembly, the second plurality of frames of image data representing a scene in a field of view of the second imaging assembly;

associating first frame information and second frame information, the first frame information including one or more of image data of the first frame of image data and information derived utilizing image data of the first frame of image data, the second frame information including one or more of image data of the second frame of image data and information derived utilizing image data of the second frame of image data; and

transmitting from the mobile terminal streaming video, the streaming video formatted to include image data of the first plurality of frames of image data and image data of the second plurality of frames of image data.

2. The method of claim 1, wherein frame images of the streaming video are formatted to include reserved pixel coordinates for image data of the first plurality of frames of image data, and remaining pixel coordinates for image data of the second plurality of frame of image data.

3. The method of claim 1, wherein frame images of the streaming video are formatted to include first pixel coordinates for image data of the first plurality of frames of image data, and second pixel coordinates for image data of the second plurality of frames of image data, wherein the first pixel coordinates and the second pixel coordinates are variably determined between images of the frame images.

4. The method of claim 1, wherein frame images of the streaming video are formatted to include first pixel coordinates for image data of the first plurality of frames of image data, and second pixel coordinates for image data of the second plurality of frames of image data, wherein the first pixel coordinates and the second pixel coordinates are variably determined between images of the frame images based on a representation of an object between frames of the first plurality of frames of image data.

5. A method for implementation with use of a mobile terminal having a first imaging assembly and a second imaging assembly and a display extending in a display plane, the method comprising:

capturing a first plurality of frames of image data and a second plurality of frames of image data, the first plurality of frames of image data including a first frame of image data, the second plurality of frames of image data including a second frame of image data, the first plurality of frames of image data representing a scene in a field of view of the first imaging assembly, the second plurality of frames of image data representing a scene in a field of view of the second imaging assembly, wherein the scene in a field of view of the first imaging assembly includes a first object and wherein the scene in a field of the view of the second imaging assembly includes a second object, the first object and second object being located at first and second opposite sides of the display plane; and

associating first frame information and second frame information, the first frame information including one or more of image data of the first frame of image data and information derived utilizing image data of the first frame of image data, the second frame information including one or more of image data of the second frame of image data and information derived utilizing image data of the second frame of image data.

6. The method of claim 5, wherein the scene in a field of view of the first imaging assembly includes a person and the scene in a field of view of the second imaging assembly includes an article comprising a bar code.

7. The method of claim 5, wherein the scene in a field of view of the first imaging assembly includes a person, wherein the scene in a field of view of the second imaging assembly includes an article comprising a bar code, and wherein the second frame information includes a decoded message determined by processing the second frame.

8. The method of claim 5, wherein the scene in a field of view of the second imaging assembly includes an article comprising a bar code, and wherein the second frame information includes decoded message determined by processing the second frame.

9. The method of claim 5, wherein the first frame of image data includes a representation of a person, wherein the scene in a field of view of the second imaging assembly includes an article comprising a bar code, and wherein the second frame information includes a decoded message determined by processing the second frame, and wherein the associating comprises providing a file having both image data of the first frame of image data and the decoded message.

10. The method of claim 5, wherein the first frame of image data includes a representation of a person, wherein the scene in a field of view of the second imaging assembly includes an article comprising a bar code, and wherein the second frame information includes a decoded message determined by processing the second frame, wherein the associating comprises providing an image file having both image data of the first frame of image data and an open data field location including the decoded message.

11. The method of claim 5, wherein the scene in a field of view of the first imaging assembly includes a health care provider and wherein the scene in a field of view of the second imaging assembly includes an article for use in treating a patient.

12. The method of claim 5, wherein the scene in a field of view of the first imaging assembly includes a delivery personnel and wherein the scene in a field of view of the second imaging assembly includes an article being delivered.

13. The method of claim 5, wherein the scene in a field of view of the first imaging assembly includes a delivery personnel, wherein the scene in a field of view of the second imaging assembly includes an article being delivered having a barcode, wherein the second frame information includes a decoded message determined by processing the second frame of image data.

14. The method of claim 5, wherein the scene in a field of view of the first imaging assembly includes a person, wherein the scene in a field of view of the second imaging assembly includes an article, wherein the first frame information includes a biometric identifier determined by processing the first frame of image data, wherein the second frame information includes data determined by processing the second frame of image data.

15. The method of claim 5, comprising transmitting from the mobile terminal streaming video, the streaming video formatted to include image data of the first plurality of frames of image data and image data of the second plurality of frames of image data.

16. The method of claim 15, wherein frame images of the streaming video are formatted to include reserved pixel coordinates for image data of the first plurality of frames of image data, and remaining pixel coordinates for image data of the second plurality of frame of image data.

17. The method of claim 15, wherein frame images of the streaming video are formatted to include first pixel coordinates for image data of the first plurality of frames of image data, and second pixel coordinates for image data of the second plurality of frames of image data, wherein the first pixel coordinates and the second pixel coordinates are variably determined between images of the frame images.

18. The method of claim 15, wherein frame images of the streaming video are formatted to include first pixel coordinates for image data of the first plurality of frames of image data, and second pixel coordinates for image data of the second plurality of frames of image data, wherein the first pixel coordinates and the second pixel coordinates are variably determined between images of the frame images based on a representation of an object between frames of the first plurality of frames of image data.