APPARATUS, SYSTEM, AND METHOD OF USE OF IMAGING ASSEMBLY ON MOBILE TERMINAL

• US 20120196648A1
• Filed: 01/31/2011
• Published: 08/02/2012
• Est. Priority Date: 01/31/2011
• Status: Active Grant

• Current Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Original Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Inventors: Havens, William H., Wang, Ynjiun P., Stiles, Jonathan
• Granted Patent: US 8,520,080 B2
• Time in Patent Office: Days
• US Class Current: 455/556.1
• CPC Class Codes: G06K 19/06028 using bar codes
• CPC Class Codes: G06Q 10/08 Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A system for collecting data comprising a mobile terminal for capturing a plurality of frames of image data, the mobile terminal having a first imaging assembly and a second imaging assembly, the first imaging assembly for capturing a first frame of image data representing a first object and the second imaging assembly for capturing a second frame of image data representing a second object, wherein the system for use in collecting data is operative for associating first frame information and second frame information, the first frame information including one or more of image data of the first frame of image data and information derived utilizing the image data of the first frame of image data, the second frame information including one or more of image data of the second frame of image data and information derived utilizing the image data of the second frame of image data.

Claims

1. A system for collecting data comprising:

a mobile terminal for capturing a plurality of frames of image data, the mobile terminal having a first imaging assembly, a second imaging assembly, a display, and a hand held housing on which the display is disposed and which houses one or more component of the first imaging assembly and one or more component of the second imaging assembly, wherein the first imaging assembly comprises a first image sensor array and a first imaging lens focusing an image onto the first image sensor array of the first imaging assembly, the first image sensor array having a plurality of pixels arranged in a plurality of rows and columns of pixels, the first imaging assembly for use in capturing a first frame of image data representing a first object,

wherein the second imaging assembly comprises a second image sensor array and a second imaging lens focusing an image onto the second image sensor array of the second imaging assembly, the second image sensor array having a plurality of pixels arranged in a plurality of rows and columns of pixels, the second imaging assembly for use in capturing a second frame of image data representing a second object; and

wherein the system is operative for associating first frame information and second frame information, the first frame information including one or more of image data of the first frame of image data and information derived utilizing image data of the first frame of image data, the second frame information including one or more of image data of the second frame of image data and information derived utilizing image data of the second frame of image data.

2. The system of claim 1, wherein the display extends in a display plane, the first imaging assembly includes a first imaging axis extending upwardly from the display plane and the second imaging assembly includes a second imaging axis extending downwardly from the display plane.

3. The system of claim 1, wherein the first imaging assembly includes a first imaging axis and the second imaging assembly includes a second imaging axis, wherein the display extends in a display plane, the first imaging axis extends upwardly from the display plane, and the second imaging axis extends forwardly from the mobile terminal.

4. The system of claim 1, wherein the first imaging assembly includes a first imaging axis and the second imaging assembly includes a second imaging axis, wherein the first imaging axis and second imaging axis are parallel and spaced apart from each other.

5. The system of claim 1, wherein the first imaging assembly includes a first imaging axis and the second imaging assembly includes a second imaging axis, wherein the first imaging axis and the second imaging axis extend in directions non-parallel relative to one another.

6. The system of claim 1, wherein the first frame and the second frame are contemporaneously captured.

7. The system of claim 1, wherein the mobile terminal includes a trigger, and wherein the system is operative so that responsively to an actuation of the trigger the mobile terminal captures the first frame of image data and the second frame of image data.

9. The system of claim 1, wherein the associating comprises providing a file that includes the first frame information and the second frame information.

10. The system of claim 1, wherein the associating comprises providing a file that includes a reference to the first frame information and a reference to the second frame information.

11. The system of claim 1, wherein the associating comprises providing a file that includes the first frame information and a reference to the second frame information.

14. The system of claim 1, wherein the associating includes providing a processed frame, the processed frame having image data of the first frame and image data of the second frame.

15. The system of claim 1, wherein the associating includes providing a processed frame, the processed frame having image data of the first frame and image data of the second frame, wherein the image data of the first frame, included in the processed frame is cropped utilizing a border recognition algorithm for removal of image data of the first frame, and wherein the processed frame is formatted in an image file format including first image data fields having image data of the first frame and second image data fields having image data of the second frame.

16. The system of claim 1, wherein the associating includes providing a processed frame, the processed frame having image data of the first frame and image data of the second frame, wherein the processed frame is included in a succession of processed frames transmitted by the mobile terminal, the succession of processed frames having image data of the first frame and image data of the second frame.

30. The system of claim 1, wherein the mobile terminal includes a trigger, and wherein the system is operative so that responsively to an actuation of the trigger the mobile terminal captures the first frame of image data and the second frame of image data.

31. The system claim 1, wherein one or more of the first image sensor assembly and the second image sensor assembly includes an image sensor array that is selectively sensitive to light in the infrared wavelength band.

32. The system claim 1, wherein the associating comprises providing an Extensible Markup Language file that includes a reference to one or more of the first frame information and the second frame information.

8. (canceled)

12. (canceled)

13. (canceled)

17. A method for use in collecting data, comprising:

providing a mobile terminal for capturing a plurality of frames of image data, the mobile terminal having a first imaging assembly, a second imaging assembly, a display, and a hand held housing on which the display is disposed and which houses a component of the first imaging assembly and the second imaging assembly, wherein the first imaging assembly comprises a first image sensor array and a first imaging lens focusing an image onto the first image sensor array of the first imaging assembly, the first image sensor array having a plurality of pixels arranged in a plurality of rows and columns of pixels, wherein the second imaging assembly comprises a second image sensor array and a second imaging lens focusing an image onto the second image sensor array of the second imaging assembly, the second image sensor array having a plurality of pixels arranged in a plurality of rows and columns of pixels;

capturing a first frame of image data using the first imaging assembly, the first frame of image data including a representation of a first object;

capturing a second frame of image data representing a second image using the second imaging assembly, the second frame of image data including a representation of a second object; and

associating first frame information and second frame information, the first frame information including one or more of image data of the first frame of image data and information derived utilizing image data of the first frame of image data, the second frame information including one or more of image data of the second frame of image data and information derived utilizing image data of the second frame of image data.

18. The method of claim 17, wherein the capturing the first frame of image data includes capturing the first frame of image data so that the first frame represents of a first object and wherein the capturing the second frame of image data includes capturing the second frame of image data so that the second frame represents a second object, and the first object and the second object are simultaneously present in a target environment.

19. The method of claim 17, wherein the capturing of the first frame of image data and the capturing of the second frame of image data are provided so that the first frame represents a health care provider and the second frame represents a patient.

20. The method of claim 17, wherein the capturing of the second frame of image data is provided so that the second frame of image data includes a representation of a barcode, and the method further includes the step of decoding the barcode representation to determine a decoded message, and further wherein the first second frame information includes the decoded message.

21. The method of claim 17, wherein the capturing of the first frame of image data and the capturing of the second frame of image data are provided so that the first frame of image data includes a representation of an object to be delivered to a location, and the second frame of image data represents the location.

22. The method of claim 17, wherein the capturing of the first frame of image data and the capturing of the second frame of image data are provided so that the first frame of image data represents a security officer and the second frame of image data includes a representation of a barcode that identifies a location of the security officer.

23. The method of claim 17, wherein the capturing of the first frame of image data and the capturing of the second frame of image data are provided so that the first frame of image data includes a representation of an operator, and the second frame of image data represents a scene to which the operator is proximate.

24. The method of claim 17, wherein the first frame information comprises a biometric identifier determined by processing the first frame of image data.

25. The method of claim 17, wherein the associating comprises simultaneously displaying the first frame information and the second frame information.

26. The method of claim 17, wherein the method is performed so that a representation of the second object is not included in the first frame of image data.

27. The method of claim 17, wherein the method includes providing the mobile terminal so that the capturing the first frame of image data and the capturing the second frame of image data and the associating are responsive to a trigger signal activation by an operator, and wherein the method further includes, responsively to an activation of a trigger signal by an operator, capturing the first frame of image data and the second frame of image data so that the first frame of image data includes a representation of the operator, and the second frame of image data includes a representation a scene proximate the operator without including a representation of the operator and further responsively to the activation of the trigger signal, associating the first frame information and the second frame information by providing a processed frame including image data of the first frame and image data of the second frame, the image data of the first frame being cropped image data that is cropped for removal of image data not representing the operator.

34. The method of claim 17, wherein the method includes providing the mobile terminal so that the capturing the first frame of image data and the capturing the second frame of image data are responsive to a trigger signal activation by an operator, wherein the capturing of the second frame of image data is provided so that the second frame of image data includes a representation of a barcode, and wherein the method further includes the step of decoding the barcode representation to determine a decoded message, and further wherein the second frame information includes the decoded message.

35. The method of claim 34, wherein the associating comprises including the decoded message in an open data field location of an image file that includes image data of the first frame of image data.

36. The method of claim 34, wherein the associating comprises providing a file that commonly references an image file having image data of the first frame of image data and the decoded message.

28. A system for collecting data comprising:

a mobile terminal for capturing a plurality of frames of image data, the mobile terminal having a first imaging assembly, a second imaging assembly, a display, and a hand held housing on which the display is disposed and which houses a component of the first imaging assembly and the second imaging assembly, wherein the first imaging assembly comprises a first image sensor array and a first imaging lens focusing an image onto the first image sensor array of the first imaging assembly, the first image sensor array having a plurality of pixels arranged in a plurality of rows and columns of pixels, wherein the second imaging assembly comprises a second image sensor array and a second imaging lens focusing an image onto the second image sensor array of the second imaging assembly, the second image sensor array having a plurality of pixels arranged in a plurality of rows and columns of pixels;

wherein the system is operative in a first user selectable mode of operation and a second user selectable mode of operation;

wherein the system is operative so that with the first user selectable mode of operation active, the mobile terminal is operative so that responsively to an activation of a trigger signal by the operator, a frame of image data is captured utilizing the first imaging assembly without a frame of image data being captured utilizing the second imaging assembly;

wherein the system is operative so that with the second user selectable mode of operation active, the mobile terminal is operative so that responsively to an activation of a trigger signal by the operator, a first frame of image data is captured utilizing the first imaging assembly and a second frame of image data is captured utilizing the second imaging assembly;

wherein the system is operative for associating first frame information and second frame information, the first frame information including one or more of image data of the first frame of image data and information derived utilizing the image data of the first frame of image data, the second frame information including one or more of image data of the second frame of image data and information derived utilizing the image data of the second frame of image data.

33. The system of claim 28, wherein the system is operative so that further responsively to the trigger signal being activated with the second mode of operation active, the associating is performed.

29. (canceled)