Overhead view system for a shovel

• US 9,598,836 B2
• Filed: 03/14/2013
• Issued: 03/21/2017
• Est. Priority Date: 03/29/2012
• Status: Active Grant

• Current Assignee: Joy Global Surface Mining Inc. (Mitsui & Company Limited)
• Original Assignee: Harnischfeger Technologies Inc. (Mitsui & Company Limited)
• Inventors: Hargrave, Brian K. Jr., Reiland, Matthew J., Koxlien, Steven, Munoz, Ryan A., Sisneros, Paul
• Primary Examiner(s): Dager, Jonathan M
• Application Number:
  US13/826,547
• Publication Number:
  US 20130261885A1
• Time in Patent Office: 1,468 Days
• Field of Search: 701/301, 701/50, 340/854, 340/685, 382/104, 345/419, 348/222
• US Class Current: 1/1
• CPC Class Codes: E02F 9/2033 Limiting the movement of frames or implements, e.g. to avoid collision between implements and the cabin sub-groups of E02F3/431 of E02F3/435 take precedence; for turntables E02F9/123
• CPC Class Codes: E02F 9/261 Surveying the work-site to be treated
• CPC Class Codes: E02F 9/262 with follow-up actions to control the work tool, e.g. controller
• CPC Class Codes: E02F 9/265 with follow-up actions (e.g. control signals sent to actuate the work tool)

Abstract

Systems and methods for providing an overview-head view of an industrial machine, such as a shovel. One system includes at least one processor configured to receive data from at least one sensor installed on the shovel relating to the area around the shovel, identify a plurality of planes based on the data, determine if the plurality of planes are positioned in a predetermined configuration associated with a haul truck, and if the plurality of planes are positioned in the predetermined configuration, superimpose the plurality of planes on an overhead-view image of the shovel and the area.

Claims

1. A system for providing an overhead view of an area around a shovel, the system comprising:

at least one processor configured to

receive data from at least one sensor installed on the shovel, the data relating to the area around the shovel,

identify a plurality of planes based on the data,

determine if the plurality of planes are positioned in a predetermined configuration associated with a haul truck, and

if the plurality of planes are positioned in the predetermined configuration, superimpose the plurality of planes on an overhead-view image of the shovel and the area.

2. The system of claim 1, wherein the at least one processor is further configured to set a color of at least one of the superimposed plurality of planes based on a distance between the dipper and the at least one of the plurality of planes.

3. The system of claim 1, wherein the at least one processor is further configured to animate at least one of the superimposed plurality of planes.

4. The system of claim 1, wherein the at least one processor is further configured to modify at least one of the superimposed plurality of planes to alert an operator of the shovel of a possible collision between the dipper and the haul truck.

5. The system of claim 1, wherein the at least one processor is further configured to superimpose an image illustrating an overhead view of the shovel on the overhead-view image.

6. The system of claim 4, wherein the at least one processor is further configured to modify the image illustrating the overhead view of the shovel based on a current position of the dipper.

7. The system of claim 1, wherein the at least one processor is further configured to display the overhead-view image on a user interface included in the shovel.

8. The system of claim 1, wherein the at least one processor is further configured to display the overhead-view image on a user interface remote from the shovel.

9. The system of claim 1, wherein the at least one sensor includes at least one laser scanner.

10. The system of claim 1, wherein the at least one sensor includes at least one stereo camera.

11. The system of claim 1, wherein the at least one sensor includes at least one laser scanner and at least one stereo camera.

12. The system of claim 1, wherein the at least one processor is configured to determine if the plurality of planes are positioned in the predetermined configuration by determining if the plurality of planes includes at least one plane selected from the group consisting of a horizontal header plane, a horizontal truck bed plane, a vertical front plane, two vertical side planes, and a vertical rear plane.

13. A method of providing an overhead view of an area around an industrial machine, the method comprising:

receiving, at at least one processor, data from at least one sensor installed on the industrial machine, the data relating to the area around the industrial machine,

identifying, by the at least one processor, a plurality of planes based on the data,

determining, by the at least one processor, if the plurality of planes are positioned in a predetermined configuration associated with a predetermined physical object,

if the plurality of planes are positioned in the predetermined configuration, superimposing the plurality of planes on an overhead-view image of the industrial machine and the area.

14. The method of claim 13, further comprising setting a color of at least one of the superimposed plurality of planes based on a distance between at least one movable component of the industrial machine and the at least one of the superimposed plurality of planes.

15. The method of claim 13, further comprising animating at least one of the superimposed plurality of planes.

16. The method of claim 13, further comprising modifying at least one of the superimposed plurality of planes to alert an operator of the shovel of a possible collision between at least one movable component of the industrial machine and the physical object.

17. The method of claim 13, further comprising superimposing an image illustrating an overhead view of the industrial machine on the overhead-view image.

18. The method of claim 17, further comprising modifying the image illustrating the overhead view of the industrial machine based on a current position of at least one movable component of the industrial machine.

19. The method of claim 13, further comprising displaying the overhead-view image on a user interface included in the industrial machine.

20. The method of claim 13, further comprising displaying the overhead-view image on a user interface remote from the industrial machine.

21. The method of claim 13, wherein receiving the data from the at least sensor includes receiving the data from at least one of a laser scanner and a stereo camera.

22. The method of claim 13, wherein determining if the plurality of planes are positioned in the predetermined configuration includes determining if the plurality of planes includes at least one plane selected from the group consisting of a horizontal header plane, a horizontal truck bed plane, a vertical front plane, two vertical side planes, and a vertical rear plane.