SYSTEMS AND METHODS FOR PROVIDING INTERACTIVE PRODUCTION ILLUSTRATION INFORMATION

• US 20150268469A1
• Filed: 12/10/2013
• Published: 09/24/2015
• Est. Priority Date: 12/10/2013
• Status: Abandoned Application

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Marsh, Bobby J., Vanscotter, Kinson D., Bodziony, Leonard S., Vander Wel, Michael M., Richardson, Adam R., Dorsey, Douglas V., Coleman, R.C. Richard M., Martin, Steven L., Hengy, David J., Heckendorf, Donald V., Jasper, Larry C., Wallis, Mark, Duong, Chieu, Huffine, Travis J.
• Application Number:
  US14/102,102
• Publication Number:
  US 20150268469A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B64F 5/10 Manufacturing or assembling aircraft, e.g. jigs therefor
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G05B 19/406 characterised by monitoring or safety G05B19/19 takes precedence
• CPC Class Codes: G05B 19/41805 characterised by assembly
• CPC Class Codes: G05B 19/41875 characterised by quality surveillance of production
• CPC Class Codes: G05B 2219/32014 Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command

Abstract

Systems and methods for providing interactive production illustration information are provided. One system includes a machine vision system configured to attach to a user, wherein the machine vision system when attached to the user is aligned with a line of sight of the user towards a physical location. The machine vision system controllable by the user and configured to acquire an image of an article. The system also includes an interactive production illustration system coupled to the machine vision system, wherein the interactive production illustration system has stored therein interactive production illustration. The interactive production illustration system is configured to select interactive production illustration information for an assembly process for the article at the physical location based at least in part on the acquired image. The interactive production illustration information is further configured to communicate the selected interactive production illustration information to the machine vision system for display.

Claims

1. A system comprising:

a machine vision system configured to attach to a user, the machine vision system when attached to the user aligned with a line of sight of the user towards a physical location, the machine vision system controllable by the user and configured to acquire an image of an article at the physical location based on a physical action of the user; and

an interactive production illustration system commutatively coupled to the machine vision system, the interactive production illustration system storing interactive production illustration information accessible by the machine vision system, the interactive production illustration system configured to select interactive production illustration information for an assembly process for the article at the physical location based at least in part on the acquired image, the interactive production illustration information further configured to communicate the selected interactive production illustration information to the machine vision system for display.

2. The system of claim 1, wherein the interactive production illustration information comprises assembly sequence information for assembling at least a portion of the article.

3. The system of claim 1, wherein the interactive production illustration information is video data showing one of an operation or assembly sequence related to at least a portion of the article.

4. The system of claim 1, wherein the machine vision system comprises a head mounted display for viewing the interactive production illustration information.

5. The system of claim 1, wherein the interactive production illustration system comprises a computing system having a logic subsystem configured to analyze the acquired image from the machine vision system to select interactive production illustration information for display.

6. The system of claim 1, wherein the interactive production illustration system comprises a storage subsystem configured to store the acquired image from the machine vision system.

7. The system of claim 1, wherein the machine vision system is configured to acquire a plurality of images of an assembly sequence performed by the user on the article and the interactive production illustration system comprises a storage subsystem configured to store the plurality of images.

8. The system of claim 1, wherein the interactive production illustration information comprises a plurality of interactive user interface screens displayable by the machine vision system.

9. The system of claim 8, wherein the plurality of interactive user interface screens include interactive selectable elements to access one or more interactive production illustrations.

10. The system of claim 1, wherein the article is an aircraft and the interactive production illustration information comprises assembly sequence information for assembling at least a portion of the aircraft.

11. A method for accessing, by a user, an assembly sequence for an article, the method comprising:

disposing a machine vision system on a portion of the user, the machine vision system aligning with a line of sight of the user;

directing by the user, the line of sight towards a physical location of the article associated with the assembly sequence;

causing, via at least one physical action by the user, the machine vision system to acquire an image and thereby generate image data associated with the physical location;

accessing, based at least in part on the image data, interactive production illustration information, the interactive production illustration information associated with the assembly sequence for the article for the physical location; and

displaying the interactive production illustration information to the user.

12. The method of claim 11, wherein accessing the interactive production illustration information comprises accessing video data showing one of an operation or assembly sequence related to at least a portion of the article.

13. The method of claim 11, wherein disposing the machine vision system on a portion of the user comprises attaching a portion of the machine vision system to a head of the user, the machine vision system including an image recording device and a display for viewing the interactive production illustration information.

14. The method of claim 11, further comprising analyzing the acquired image from the machine vision system to select interactive production illustration information for display.

15. The method of claim 11, further comprising storing the acquired image from the machine vision system.

16. The method of claim 11, further comprising acquiring a plurality of images of an assembly sequence performed by the user on the article and storing the plurality of images.

17. The method of claim 11, wherein the article is an aircraft and accessing the interactive production illustration information comprises accessing user interface screens that include interactive selectable elements to access one or more interactive production illustrations that comprise assembly sequence information for assembling at least a portion of the aircraft.

18. A non-transitory computer readable storage medium for accessing interactive production illustration information using a processor, the non-transitory computer readable storage medium including instructions to command the processor to:

obtain from a machine vision system attached to a user an image of an article at a physical location, wherein the image is acquired based on a physical action of the user and the machine vision system when attached to the user is aligned with a line of sight of the user towards the physical location;

accessing stored interactive production illustration information;

selecting interactive production illustration information for an assembly process for the article at the physical location based at least in part on the acquired image; and

communicating the selected interactive production illustration information to the machine vision system for display.

19. The non-transitory computer readable storage medium of claim 18, wherein the instructions command the processor to analyze the acquired image from the machine vision system to select interactive production illustration information for display.

20. The non-transitory computer readable storage medium of claim 18, wherein the instructions command the processor to store the acquired image from the machine vision system.

21. The non-transitory computer readable storage medium of claim 18, wherein the article is an aircraft and the interactive production illustration information comprises a plurality of interactive user interface screens and the instructions command the processor to communicate for display by the machine vision system one or more of the plurality of interactive user interface screens, the plurality of interactive user interface screens including interactive selectable elements to access one or more interactive production illustrations for an assembly sequence for assembling at least a portion of the aircraft.