AUGMENTED REALITY METHOD AND APPARATUS FOR ASSISTING AN OPERATOR TO PERFORM A TASK ON A MOVING OBJECT

• US 20160078678A1
• Filed: 09/12/2014
• Published: 03/17/2016
• Est. Priority Date: 09/12/2014
• Status: Abandoned Application

• Current Assignee: Centre de recherche industrielle du Québec
• Original Assignee: Centre de recherche industrielle du Québec
• Inventors: Drolet, Nicholas, Martel, Alain, Gagnon, Richard, Lejeune, Claude, Hotte, Denis
• Application Number:
  US14/485,051
• Publication Number:
  US 20160078678A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B07C 7/005 Computer assisted manual sorting, e.g. for mail
• CPC Class Codes: G06Q 10/06311 Scheduling, planning or task assignment for a person or group

Abstract

Augmented reality-based method, apparatus and system for assisting an operator to perform a task on a moving object according to at least one characteristic of the object, uses projection of light onto the object according to object tracking task instruction data as it moves through the working zone to provide a visual instruction for the operator about the task to perform on the object.

Claims

1. An augmented reality method for assisting an operator to perform a task within a working zone on an object moving along a path intersecting the working zone and according to at least one characteristic of said object, said method being for use with a sensor unit configured to generate data indicative of said object characteristic at a detecting position upstream said working zone, said method comprising the steps of:

i) generating task instruction data according to said characteristic indicative data;

ii) estimating successive positions of said object as it moves toward and through the working zone to generate object position tracking data;

iii) processing said task instruction data and said object position tracking data to generate object tracking task instruction data; and

iv) projecting light according to said object tracking task instruction data onto said object as it moves through the working zone to provide a visual instruction for the operator about the task to perform on the object.

2. The method according to claim 1, wherein said task instruction data are indicative of one of a plurality of object sorting instructions for the operator.

3. The method according to claim 1, wherein said object is moving along a substantially linear path under action of a transport means in a transport direction and wherein said sensor unit is further configured to generate data indicative of a transverse position coordinate of said object relative to the transport direction, said estimating step ii) includes:

a) measuring displacement of said transport means to derive successive object longitudinal position coordinates relative to said transport direction; and

b) combining said successive object longitudinal position coordinates with said object transverse position coordinate to estimate said successive positions.

4. The method according to claim 1, wherein said object tracking task instruction data are in the form of successive bidimensional images of an indication of said operator task instruction.

5. The method according to claim 4, wherein said indication is selected from the group consisting of a light presence/absence indication, a pulsed light indication, a light intensity indication, a light pattern indication, a symbolic indication, a textual indication, a color indication, or any combination thereof.

6. An augmented reality method for assisting an operator to perform a task within a working field on an object moving along a path intersecting the working zone and according to at least one characteristic of said object, said method comprising the steps of:

i) detecting said object characteristic at a detecting position upstream said working zone to generate characteristic indicative data;

ii) generating task instruction data according to said characteristic indicative data;

iii) estimating successive positions of said object as it moves toward and through the working zone to generate object position tracking data;

iv) processing said task instruction data and said object position tracking data to generate object tracking task instruction data; and

v) projecting light according to said object tracking task instruction data onto said object as it moves through the working zone to provide a visual instruction for the operator about the task to perform on the object.

7. The method according to claim 6, wherein said task instruction data are indicative of one of a plurality of object sorting instructions for the operator.

8. The method according to claim 6, wherein said object is moving along a substantially linear path under action of a transport means in a transport direction and wherein said sensor unit is further configured to generate data indicative of a transverse position coordinate of said object relative to the transport direction, said estimating step iii) includes:

a) measuring a transverse position coordinate of said object relative to the transport direction;

b) measuring displacement of said transport means to derive successive object longitudinal position coordinates relative to said transport direction; and

c) combining said successive object longitudinal position coordinates with said object transverse position coordinate to estimate said successive positions.

9. The method according to claim 6, wherein said object tracking task instruction data are in the form of successive bidimensional images of an indication of said operator task instruction.

10. The method according to claim 9, wherein said indication is selected from the group consisting of a light presence/absence indication, a pulsed light indication, a light intensity indication, a light pattern indication, a symbolic indication, a textual indication, a color indication, or any combination thereof.

11. An augmented reality apparatus for assisting an operator to perform a task within a working zone on an object moving along a substantially linear path intersecting the working zone under action of a transport means in a transport direction and according to at least one characteristic of said object, said apparatus being for use with a sensor unit configured to generate data indicative of said object characteristic at a detecting position upstream said working zone, said sensor unit being further configured to generate data indicative of a transverse position coordinate of said object relative to the transport direction, said apparatus comprising:

means for measuring displacement of said transport means to derive successive object longitudinal position coordinates relative to said transport direction;

data processor means programmed for;

generating task instruction data according to said characteristic indicative data;

estimating from said successive object longitudinal position coordinates and said object transverse position coordinate successive positions of said object as it moves toward and through the working zone, to generate object position tracking data; and

processing said task instruction data and said object position tracking data to generate object tracking task instruction data; and

a projector for directing light according to said object tracking task instruction data onto said object as it moves through the working zone to provide a visual instruction for the operator about the task to perform on the object.

12. The apparatus according to claim 11, wherein said task instruction data are indicative of one of a plurality of object sorting instructions for the operator.

13. The apparatus according to claim 11, wherein said object tracking task instruction data are in the form of successive bidimensional images of an indication of said operator task instruction.

14. The method according to claim 13, wherein said indication is selected from the group consisting of a light presence/absence indication, a pulsed light indication, a light intensity indication, a light pattern indication, a symbolic indication, a textual indication, a color indication, or any combination thereof.

15. An augmented reality system for assisting an operator to perform a task within a working zone on an object moving along a substantially linear path intersecting the working zone under action of a transport means in a transport direction and according to at least one characteristic of said object, said system comprising:

a sensor unit configured for detecting said object characteristic at a detecting position upstream said working zone to generate characteristic indicative data, said sensor unit being further configured to generate data indicative of a transverse position coordinate of said object relative to the transport direction;

means for measuring displacement of said transport means to derive successive object longitudinal position coordinates relative to said transport direction;

data processor means programmed for;

generating task instruction data according to said characteristic indicative data;

estimating from said successive object longitudinal position coordinates and said object transverse position coordinate successive positions of said object as it moves toward and through the working zone, to generate object position tracking data; and

processing said task instruction data and said object position tracking data to generate object tracking task instruction data; and

a projector for directing light according to said object tracking task instruction data onto said object as it moves through the working zone to provide a visual instruction for the operator about the task to perform on the object.

16. The system according to claim 15, wherein said task instruction data are indicative of one of a plurality of object sorting instructions for the operator.

17. The system according to claim 15, wherein said object tracking task instruction data are in the form of successive bidimensional images of an indication of said operator task instruction.

18. The system according to claim 17, wherein said indication is selected from the group consisting of a light presence/absence indication, a pulsed light indication, a light intensity indication, a light pattern indication, a symbolic indication, a textual indication, a color indication, or any combination thereof.