Processing device having a graphical user interface for industrial vehicle

• US 10,430,073 B2
• Filed: 07/14/2016
• Issued: 10/01/2019
• Est. Priority Date: 07/17/2015
• Status: Active Grant

• Current Assignee: Crown Equipment Corporation
• Original Assignee: Crown Equipment Corporation
• Inventors: Castaneda, Anthony T., Gilland, Jess D., Ochenas, Jonathan C., Pulskamp, Steven R., Ruppert, Adam M., Swift, Philip W., Wellman, Timothy A.
• Primary Examiner(s): Levy, Amy M
• Application Number:
  US15/210,049
• Publication Number:
  US 20170017392A1
• Time in Patent Office: 1,174 Days
• CPC Class Codes: B60K 2360/1438 Touch screens
• CPC Class Codes: B60K 2360/145 Instrument input by combination of touch screen and hardware input devices
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B66F 9/0759 Details of operating station, e.g. seats, levers, operator platforms, cabin suspension
• CPC Class Codes: B66F 9/24 Electrical devices or systems
• CPC Class Codes: G06F 3/02 Input arrangements using manually operated switches, e.g. using keyboards or dials
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A processing device having a graphical user interface includes a housing having a touch screen display that receives touch gesture commands from a vehicle operator. Still further, a set of controls is arranged on a front face of the housing. The set of controls include hardware control equivalents to the gesture commands recognized by the touch screen of the display. This allows industrial vehicle operators to wear gloves or other attire fitting for the task at hand, without undue interference interacting with the graphical user interface. Also, redundant control, e.g., via gesture commands recognized by the touch screen of the display and corresponding controls in the user control section, allow the vehicle operator to use which ever data input option is most convenient for speed, convenience, workflow, etc.

Claims

1. A processing device having a graphical user interface, the processing device provided on an industrial vehicle, comprising:

a housing having a front face, the front face defining a control section and a display section;

a touch screen display within the display section of the front face of the housing;

a set of controls arranged within the control section of the front face of the housing; and

a main component connected to a vehicle network bus of the industrial vehicle and to a transceiver for wireless communication with a remote server computer, the main component having;

a controller communicably connected to the touch screen display and each control of the set of controls, wherein the controller is operatively programmed to detect gesture commands entered by an operator through interaction with the touch screen display, and to detect operator interactions with the set of controls such that each control in the set of controls is mapped to a corresponding gesture command;

wherein the processing device executes computer code that implements a set of widgets, each widget representing live data representing a current state of a select one of a vehicle metric based upon data obtained via communication over the vehicle network bus or an operator-based metric obtained via communication with the remote server, wherein;

the set of widgets are organized to define;

a motion home screen position that displays at least one relevant travel related widget; and

a lift home screen position that displays at least one relevant lift related widget;

when the industrial vehicle is stopped, a vehicle operator can navigate through graphical representations of the set of widgets on the display using any combination of the gesture commands and the set of controls;

when a current operating state of a traction control module indicates that a traction control is engaged, the controller causes the display to snap to the motion home screen position;

when a current operating state of a hydraulic module indicates that forks are engaged in a lift operation on the industrial vehicle, the controller causes the display to snap to the lift home screen position; and

the gesture commands are disabled when the industrial vehicle exceeds a predetermined speed.

2. The processing device of claim 1, wherein:

the set of controls and the touch screen display are implemented on a service component that is field replaceable, and that mates to the main component;

a first swipe gesture command implemented on the touch screen display and operation of a first control in the set of controls designated as an up control both map to a first graphical user interface command;

a second swipe gesture command implemented on the touch screen display and operation of a second control in the set of controls designated as a right control both map to a second graphical user interface command;

a third swipe gesture command implemented on the touch screen display and operation of a third control in the set of controls designated as a left control both map to a third graphical user interface command;

a fourth swipe gesture command implemented on the touch screen display and operation of a fourth control in the set of controls designated as a down control both map to a fourth graphical user interface command;

a select gesture command implemented on the touch screen display and operation of a fifth control in the set of controls designated as a select control both map to a fifth graphical user interface command;

the first control is implemented as a first button assigned to the up control;

the second control is implemented as a second button assigned to the right control;

the third control is implemented as a third button assigned to the left control;

the fourth control is implemented as a fourth button assigned to the down control; and

the fifth control is implemented as a fifth button assigned to the select control.

3. The processing device of claim 1, wherein:

the touch screen display graphically displays;

a widget space for displaying a select one of the set of widgets comprising a visual representation of a current state of an associated component of the industrial vehicle; and

the controller is further operatively programmed to extract the current state of the associated component of the industrial vehicle by communicating with at least one electronic component across the vehicle network bus.

4. The processing device of claim 3, wherein the touch screen display further graphically displays:

a menu selection section; and

a docked status tray that graphically displays at least one icon, each icon representing the current state of a vehicle component;

wherein the controller is further operatively programmed to periodically extract the current state of each vehicle component associated with an icon in the docked status tray by submitting a query across the vehicle network bus to at least one industrial vehicle electronic component.

5. The processing device of claim 3, wherein the widget space displays the current state of at least one of battery charge, vehicle speed, or fork lift height.

6. The processing device of claim 3, wherein the controller is further operatively programmed to receive information from another component of the industrial vehicle, and interact with the touch screen display to cause the widget space to display the current state of at least one of:

environmental state;

a task-based state reflecting the level of completion of the task; and

a count of the frequency and/or duration of correct warehouse operational behavior events in-between incorrect behavior events.

7. The processing device of claim 3, wherein the controller is further operatively programmed to receive information from another component of the industrial vehicle, and interact with the touch screen display to cause the widget space to be temporarily interrupted to display a message across a select one of:

a lower portion of the widget space that is removed after a period of time;

a single widget space that is removed after a period of time;

or

the entirety of all displayed widget spaces for a period of time.

8. The processing device of claim 3, wherein:

the controller is further operatively programmed to receive information from another component of the industrial vehicle, and interact with the touch screen display to cause the widget space to be temporarily interrupted to display a message that is removed after a period of time; and

the controller is operatively programmed to clear the displayed message after any one of;

the vehicle operator presses a designated area of the touch screen, a button in the vehicle operator control area, or a combination thereof;

the message times out;

the message is cleared to display a higher priority message;

the message is cleared to clear the display screen based upon a designated operating characteristic of the vehicle.

9. The processing device of claim 1, wherein:

the set of controls and the touch screen display are implemented on a service component that is field replaceable, and that mates to the main component;

an up swipe gesture command implemented on the touch screen display and operation of a first control in the set of controls both map to a first graphical user interface command;

a right swipe gesture command implemented on the touch screen display and operation of a second control in the set of controls both map to a second graphical user interface command;

a left swipe gesture command implemented on the touch screen display and operation of a third control in the set of controls both map to a third graphical user interface command;

a down swipe gesture command implemented on the touch screen display and operation of a fourth control in the set of controls both map to a fourth graphical user interface command;

a select gesture command implemented on the touch screen display and operation of a fifth control in the set of controls designated as a select control both map to a fifth graphical user interface command.

10. The processing device of claim 9, wherein:

the second control and the third control are implemented as a single encoder control, where the second control is implemented by rotating the encoder in a first direction and the third control is implemented by rotating the encoder in a second direction opposite the first direction.

11. A processing device having a graphical user interface, the processing device provided on an industrial vehicle, comprising:

a housing having a front face, the front face defining a control section and a display section;

a touch screen display within the display section of the front face of the housing;

a set of controls arranged within the control section of the front face of the housing; and

a main component connected to a vehicle network bus of the industrial vehicle and to a transceiver for wireless communication with a remote server computer, the main component having;

a controller communicably connected to the touch screen display and each control of the set of controls, wherein the controller is operatively programmed to detect gesture commands entered by an operator through interaction with the touch screen display, and to detect operator interactions with the set of controls such that each control in the set of controls is mapped to a corresponding gesture command;

wherein the processing device executes computer code that implements a set of widgets, each widget representing live data representing a current state of a select one of a vehicle metric based upon data obtained via communication over the vehicle network bus or an operator-based metric obtained via communication with the remote server, wherein;

the set of widgets are organized to define;

a motion home screen position that displays at least one relevant travel related widget;

when the industrial vehicle is stopped, a vehicle operator can navigate through graphical representations of the set of widgets on the display using any combination of the gesture commands and the set of controls;

when a current operating state of a traction control module indicates that a traction control is engaged, the controller causes the display to snap to the motion home screen position; and

the gesture commands are disabled when the industrial vehicle exceeds a predetermined speed.

12. The processing device of claim 11, wherein:

the touch screen display graphically displays;

a widget space for displaying a select one of the set of widgets comprising a visual representation of at least one of battery charge, vehicle speed, or fork lift height;

a menu selection section; and

a docked status tray that graphically displays at least one icon, each icon representing the current state of a vehicle component;

wherein;

the controller is further operatively programmed to periodically extract the current state of each vehicle component associated with an icon in the docked status tray by submitting a query across the vehicle network bus to at least one industrial vehicle electronic component.

13. The processing device of claim 12, wherein the controller is further operatively programmed to interact with the touch screen display to cause the widget space to display a current state of at least one of:

an environmental state;

a task-based state reflecting the level of completion of the task; and

a count of the frequency and/or duration of correct warehouse operational behavior events in-between incorrect behavior events.

14. The processing device of claim 12, wherein the controller is further operatively programmed to receive information from another component of the industrial vehicle, and interact with the touch screen display to cause the widget space to be temporarily interrupted to display a message across a select one of:

a lower portion of the widget space that is removed after a period of time;

a single widget space that is removed after a period of time;

or

the entirety of all displayed widget spaces for a period of time.

15. The processing device of claim 11, wherein:

the set of controls and the touch screen display are implemented on a service component that is field replaceable, and that mates to the main component;

an up swipe gesture command implemented on the touch screen display and operation of a first control in the set of controls both map to a first graphical user interface command;

a right swipe gesture command implemented on the touch screen display and operation of a second control in the set of controls both map to a second graphical user interface command;

a left swipe gesture command implemented on the touch screen display and operation of a third control in the set of controls both map to a third graphical user interface command;

a down swipe gesture command implemented on the touch screen display and operation of a fourth control in the set of controls both map to a fourth graphical user interface command;

a select gesture command implemented on the touch screen display and operation of a fifth control in the set of controls designated as a select control both map to a fifth graphical user interface command.

16. A processing device having a graphical user interface, the processing device provided on an industrial vehicle, comprising:

a housing having a front face, the front face defining a control section and a display section;

a touch screen display within the display section of the front face of the housing;

a set of controls arranged within the control section of the front face of the housing; and

a main component connected to a vehicle network bus of the industrial vehicle and to a transceiver for wireless communication with a remote server computer, the main component having;

a controller communicably connected to the touch screen display and each control of the set of controls, wherein the controller is operatively programmed to detect gesture commands entered by an operator through interaction with the touch screen display, and to detect operator interactions with the set of controls such that each control in the set of controls is mapped to a corresponding gesture command;

wherein the processing device executes computer code that implements a set of widgets, each widget representing live data representing a current state of a select one of a vehicle metric based upon data obtained via communication over the vehicle network bus or an operator-based metric obtained via communication with the remote server, wherein;

the set of widgets are organized to define;

a lift home screen position that displays at least one relevant lift related widget;

when the industrial vehicle is stopped, a vehicle operator can navigate through graphical representations of the set of widgets on the display using any combination of the gesture commands and the set of controls;

when a current operating state of a hydraulic module indicates that forks are engaged in a lift operation on the industrial vehicle, the controller causes the display to snap to the lift home screen position; and

the gesture commands are disabled when the industrial vehicle exceeds a predetermined speed.

17. The processing device of claim 16, wherein:

the touch screen display graphically displays;

a widget space for displaying a select one of the set of widgets comprising a visual representation of at least one of battery charge, vehicle speed, or fork lift height;

a menu selection section; and

a docked status tray that graphically displays at least one icon, each icon representing the current state of a vehicle component;

wherein;

the controller is further operatively programmed to periodically extract the current state of each vehicle component associated with an icon in the docked status tray by submitting a query across the vehicle network bus to at least one industrial vehicle electronic component.

18. The processing device of claim 17, wherein the controller is further operatively programmed to interact with the touch screen display to cause the widget space to display a current state of at least one of:

an environmental state;

a task-based state reflecting the level of completion of the task; and

a count of the frequency and/or duration of correct warehouse operational behavior events in-between incorrect behavior events.

19. The processing device of claim 17, wherein the controller is further operatively programmed to receive information from another component of the industrial vehicle, and interact with the touch screen display to cause the widget space to be temporarily interrupted to display a message across a select one of:

a lower portion of the widget space that is removed after a period of time;

a single widget space that is removed after a period of time;

or

the entirety of all displayed widget spaces for a period of time.

20. The processing device of claim 16, wherein:

the set of controls and the touch screen display are implemented on a service component that is field replaceable, and that mates to the main component;

an up swipe gesture command implemented on the touch screen display and operation of a first control in the set of controls both map to a first graphical user interface command;

a right swipe gesture command implemented on the touch screen display and operation of a second control in the set of controls both map to a second graphical user interface command;

a left swipe gesture command implemented on the touch screen display and operation of a third control in the set of controls both map to a third graphical user interface command;

a down swipe gesture command implemented on the touch screen display and operation of a fourth control in the set of controls both map to a fourth graphical user interface command;

a select gesture command implemented on the touch screen display and operation of a fifth control in the set of controls designated as a select control both map to a fifth graphical user interface command.