Distributed system of autonomously controlled mobile agents

• US 8,747,182 B2
• Filed: 12/06/2012
• Issued: 06/10/2014
• Est. Priority Date: 05/28/2009
• Status: Active Grant

• Current Assignee: Digital Dream Labs, LLC
• Original Assignee: ANKI Incorporated
• Inventors: Sofman, Boris, Tappeiner, Hanns, Palatucci, Mark Matthew
• Primary Examiner(s): HARPER, TRAMAR YONG
• Application Number:
  US13/707,512
• Publication Number:
  US 20130095726A1
• Time in Patent Office: 551 Days
• Field of Search: 446/456
• US Class Current: 446/456
• CPC Class Codes: A63H 17/26 Details; Accessories drive mechanisms A63H29/00
• CPC Class Codes: A63H 17/32 Acoustical or optical signalling devices
• CPC Class Codes: A63H 17/40 Toy vehicles automatically steering or reversing by collision with an obstacle
• CPC Class Codes: A63H 17/44 Toy garages for receiving toy vehicles; Filling stations
• CPC Class Codes: A63H 18/02 Construction or arrangement of the trackway
• CPC Class Codes: A63H 18/12 Electric current supply to toy vehicles through the track
• CPC Class Codes: A63H 18/16 Control of vehicle drives by interaction between vehicle and track; Control of track elements by vehicles
• CPC Class Codes: A63H 30/04 using wireless transmission

Abstract

A system includes a drivable surface that includes location encoding markings. A mobile agent is provided that includes a drive motor, an imaging system for taking images of the markings, a vehicle wireless transceiver, and a microcontroller operatively coupled to the motor, the imaging system, and the vehicle wireless transceiver. A basestation is provided that includes a controller operatively coupled to a basestation wireless transceiver. Via wireless communication between the wireless transceivers of the mobile agent and the basestation, an action to be implemented by the mobile agent can be determined by the basestation and communicated to the mobile agent, whereupon the microcontroller of the mobile agent controls detailed movement of the mobile agent on the drivable surface based on images taken of the markings of the drivable surface by the imaging system to cause the mobile agent to implement the action on the drivable surface.

Claims

1. A system comprising:

a surface having a plurality of machine-readable codes indicating locations on the surface;

one or more mobile agents configured to travel along the surface, each of the one or more mobile agents comprising;

a propulsion mechanism, configured to impart motive force to the mobile agent,

a sensor, configured to detect the machine-readable codes as the mobile agent travels along the surface,

a mobile wireless transceiver, and

a microcontroller operatively coupled to the propulsion mechanism, the sensor, and the mobile wireless transceiver, the microcontroller configured to control movement of the mobile agent on the surface based on detected machine-readable codes;

a basestation comprising a controller and a basestation wireless transceiver operatively coupled to the controller, wherein the controller is configured to;

determine via wireless communication from each mobile wireless transceiver a current location of a corresponding mobile agent with respect to the surface based on machine-readable codes detected by the sensor of the mobile agent;

store a virtual representation of the surface;

determine based on said virtual representation and the current location of at least one mobile agent at least one action to be taken by at least one mobile agent; and

transmit, via wireless communication, one or more signals to at least one mobile wireless transceiver of at least one mobile agent, each of the one or more transmitted signals specifying at least one action to be taken by the mobile agent on the drivable surface; and

a remote control configured to communicate with the basestation, wherein the basestation is configured to be responsive to commands issued by the remote control for controlling at least one of the following via the basestation;

which one of a plurality of mobile agents is responsive to the commands issued by the remote control;

at least one of a velocity and an acceleration of a mobile agent responsive to commands issued by the remote control;

a changing of a mobile agent responsive to commands issued by the remote control from at least one set of machine-readable codes on the surface to at least another set of machine-readable codes on the surface;

a direction a mobile agent takes at an intersection of the surface responsive to at least one command issued by the remote control;

a mobile agent responsive to commands issued by the remote control to perform at least one of leading, following, and passing another mobile agent on the drivable surface; and

at least one of activation and deactivation of at least one of a light and an audio speaker of a mobile agent responsive to at least one command issued by the remote control;

wherein the controller is configured to control, in response to at least one of movement of a remote controlled mobile agent and lack of movement of a remote controlled mobile agent, at least one of the following of at least one mobile agent not under the control of the remote control;

a velocity or acceleration of the mobile agent;

a set of machine-readable codes the mobile agent follows on the surface;

a changing of the mobile agent from at least one set of machine-readable codes on the surface to at least another set of machine-readable codes on the surface;

a direction the mobile agent takes at an intersection of the surface;

the mobile agent performing at least one of leading, following, and passing another mobile agent on the surface; and

at least one of activation and deactivation of at least one of a light and an audio speaker of a mobile agent.

2. The system of claim 1, wherein the surface comprises a plurality of discrete segments operatively coupled together.

3. The system of claim 2, wherein each machine-readable code indicates at least one selected from the group consisting of:

an identifier of a segment of the surface;

an indication of a location on the segment;

an orientation of the segment; and

at least one parameter of the segment.

4. The system of claim 2, wherein the discrete segments are arranged according to a structure, and wherein the virtual representation of the surface stored at the controller comprises a representation of the structure.

5. The system of claim 1, wherein the machine-readable codes comprise optically readable codes.

6. The system of claim 1, wherein the machine-readable codes define at least one path of travel on the surface and encode locations on the surface.

7. The system of claim 1, wherein each of the one or more mobile agents comprises a toy vehicle.

8. The system of claim 1, wherein the propulsion mechanism of each of the one or more mobile agents comprises a motor.

9. The system of claim 1, wherein the sensor of each of the one or more mobile agents comprises an imaging system.

10. The system of claim 1 A wherein the microcontroller of each of the one or more mobile agents is responsive to the action communicated by the controller for controlling the detailed movement of the mobile agent on the surface based on machine-readable codes on the drivable surface detected by the sensor.

11. The system of claim 1, wherein:

the system comprises a plurality of mobile agents; and

the controller configured to control the interaction of the plurality of mobile agents on the surface in a coordinated manner with each other via wireless communication from the basestation wireless transceiver to the mobile wireless transceivers of the plurality of mobile agents.

12. The system of claim 11, wherein the controller configured to control at least one of the following of at least one of the plurality of mobile agents:

a velocity or acceleration of the mobile agent;

a set of machine-readable codes the mobile agent follows on the surface;

a changing of the mobile agent from one set of machine-readable codes on the surface to another set of machine-readable codes on the surface;

a direction the mobile agent takes at an intersection of the surface;

the mobile agent performing at least one of leading, following, and passing another mobile agent on the surface; and

at least one of activation and deactivation of at least one of a light and an audio speaker of the mobile agent.

13. The system of claim 1 wherein the drivable surface comprises one or more multi-state devices responsive to the controller for changing from a one state to another state.

14. The system of claim 13, wherein each of the one or more multi-state devices comprises a representation of at least one selected from the group consisting of:

a traffic light;

a railroad crossing gate;

a draw bridge;

a trap;

and a garage door.

15. The system of claim 1, wherein the sensor comprises:

a light source outputting light toward the machine-readable codes; and

an imaging sensor for detecting light reflected from the machine-readable codes.

16. The system of claim 15, further comprising a layer covering the machine-readable codes of at least one segment, wherein said layer is transparent to light output by the mobile agent'"'"'s imaging system but is opaque at human visible light wavelengths.

17. The system of claim 1, wherein the controller is configured to be responsive to the current location of the mobile agent on the surface and the virtual representation of the surface and to cause a display to display:

a virtual image of the surface; and

a virtual image of at least one mobile agent and at least one of a position and a velocity of the at least one mobile agent on the virtual image of the surface.

18. The system of claim 1 wherein the determined at least one action to be taken by at least one mobile agent comprises a set of detailed steps representing a distributed command hierarchy.

19. The system of claim 1, wherein each of the one or more mobile agents is configured to determine its position on the surface based on detected machine-readable codes.

20. The system of claim 1, wherein at least one mobile agent is user-controllable, and wherein the basestation is configured to adjust the behavior of at least one mobile agent not under control of a user.

21. The system of claim 1, wherein the machine-readable codes encode information, and wherein:

at least a portion of the encoded information is interpreted by at least one mobile agent; and

at least a portion of the encoded information is relayed by the at least one mobile agent to the basestation and interpreted by the basestation.

22. The system of claim 1, wherein each of the one or more mobile agents is configured to move freely on the surface.

23. The system of claim 1, wherein the controller is configured to determine a high-level behavior for at least one mobile agent, and wherein the transmitted signal to the mobile agent comprises a representation of the high-level behavior.

24. The system of claim 23, wherein the controller is configured to determine a high-level behavior for at least one mobile agent using an artificial intelligence algorithm.

25. The system of claim 23, wherein the controller is configured to determine a high-level behavior for at least one mobile agent according to an algorithm that incorporates randomness.

26. The system of claim 23, wherein the controller is configured to determine a high-level behavior for at least one mobile agent according to a global planning algorithm.

27. The system of claim 26, wherein the controller is further configured to determine a lower-level behavior for at least one mobile agent according to a local planning algorithm.

28. The system of claim 26, wherein the controller is further configured to determine a lower-level behavior for at least one mobile agent based at least in part on at least one of a position and behavior of at least one other mobile agent.

29. A method of controlling movement of a plurality of self-propelled mobile agents on a surface having a plurality of machine-readable codes indicating locations on the surface, wherein each of the self-propelled mobile agents includes a sensor configured to detect the machine-readable codes as the mobile agent travels along the surface, the method comprising, for each of the self-propelled mobile agents, performing the steps of:

(a) while traveling on the surface, the mobile agent detecting at least one of the machine-readable codes via the mobile agent'"'"'s sensor;

(b) responsive to detecting the at least one machine-readable code, the mobile agent controlling its movement on the surface;

(c) the mobile agent wirelessly transmitting data regarding the detected code to a basestation;

(d) responsive to the data regarding the detected at least one code, determining a location of the mobile agent and updating a position of the mobile agent in a virtual representation;

(e) the basestation determining for each mobile agent a unique action to be taken by the mobile agent based on the data regarding the detected at least one code; and

(f) the basestation wirelessly transmitting signals communicating to each mobile agent the unique action to be taken by the mobile agent on the surface in a manner whereupon the mobile agents move in a coordinated manner on the surface.

30. The method of claim 29, wherein the surface comprises a plurality of discrete segments operatively coupled together.

31. The method of claim 30, wherein each machine-readable code indicates at least one selected from the group consisting of:

an identifier of a segment of the surface;

an indication of a location on the segment;

an orientation of the segment; and

at least one parameter of the segment.

32. The method of claim 29, wherein the machine-readable codes comprise optically readable codes.

33. The method of claim 29, wherein the machine-readable codes define at least one path of travel on the surface and encode locations on the surface.

34. The method of claim 29, wherein each mobile agent comprises a toy vehicle.

35. The method of claim 29, wherein detecting at least one of the machine-readable codes via the mobile agent'"'"'s sensor comprises detecting at least one of the machine-readable codes via imaging.

36. The method of claim 29, further comprising, at the basestation:

maintaining the virtual representation;

and wherein the steps of determining an action to be taken by the mobile agent and wirelessly transmitting a signal to the mobile agent are performed at the basestation.

37. The method of claim 29, further comprising repeating step (a)-(f) at least one time.

38. The method of claim 37, further comprising the mobile agent further controlling its movement on the surface responsive to the action communicated in (f).

39. The method of claim 38, further comprising, responsive to the action communicated in step (f), the mobile agent changing from traveling on a first path defined by a first set of machine-readable codes to a second travel path defined by a second set of machine-readable codes, whereupon the action communicated in step (f) specifies said second travel path.

40. The method of claim 29, further comprising the mobile agent controlling at least one of its velocity, its acceleration, its steering direction, a state of one or more of its lights, and whether an audio replication device of the vehicle outputs sound, in response to the action communicated in step (f).

41. The method of claim 29, further including the basestation determining the virtual representation of the drivable surface from at least one of the following:

a definition file accessible to the basestation;

exploration of the physical layout of the drivable surface by at least one mobile agent acting under the control of the basestation and communicating information regarding the physical layout of the surface to the basestation; and

a bus system of the surface comprising a plurality of segments, wherein each segment comprises a bus segment and a microcontroller that communicates with the basestation and with the microcontroller of each adjacent connected segment via the bus segment.

42. The method of claim 29, wherein step (a) comprises detecting at least one of the machine-readable codes by acquiring an image of the machine-readable codes via an overlayer that is transparent to the mobile agent'"'"'s sensor but which is opaque at human visible light wavelengths.

43. The method of claim 29, further comprising the basestation receiving a command for the mobile agent from a remote control, wherein step (e) further comprises the basestation determining the action to be taken by the mobile agent on the surface based on the command received from the remote control.

44. The method of claim 29, wherein detecting at least one of the machine-readable codes comprises:

outputting light toward the machine-readable code; and

detecting light reflected from the machine-readable code.

45. The method of claim 29, further comprising, responsive to the current location of the mobile agent on the surface and the virtual representation of the surface, causing a display to display:

a virtual image of the surface; and

a virtual image of at least one mobile agent and at least one of a position and a velocity of the at least one mobile agent on the virtual image of the surface.

46. The method of claim 29, wherein determining an action to be taken by the mobile agent comprises determining a set of detailed steps representing a distributed command hierarchy.

47. The method of claim 29, further comprising each mobile agent determining its position on the surface based on detected machine-readable codes.

48. The method of claim 29, wherein at least one mobile agent is user-controllable, and wherein the method further comprises, at the basestation, adjusting the behavior of at least one mobile agent not under control of a user.

49. The method of claim 29, wherein the machine-readable codes encode information, the method further comprising:

at least one mobile agent interpreting at least a portion of the encoded information; and

at least one mobile agent relaying at least a portion of the encoded information to the basestation;

the basestation interpreting the relayed information.

50. The method of claim 29, wherein determining an action to be taken by the mobile agent comprises determining a high-level behavior for the mobile agent, and wherein wirelessly transmitting a signal to the mobile agent comprises transmitting a representation of the high-level behavior.

51. The method of claim 50, wherein determining a high-level behavior for the mobile agent comprises determining a high-level behavior for the mobile agent using an artificial intelligence algorithm.

52. The method of claim 50, wherein determining a high-level behavior for the mobile agent comprises determining a high-level behavior for the mobile agent according to an algorithm that incorporates randomness.

53. The method of claim 50, wherein determining a high-level behavior for the mobile agent comprises determining a high-level behavior for the mobile agent according to a global planning algorithm.

54. The method of claim 53, wherein determining an action to be taken by the mobile agent further comprises determining a lower-level behavior for the mobile agent according to a local planning algorithm.

55. The method of claim 53, wherein determining an action to be taken by the mobile agent further comprises determining a lower-level behavior for the mobile agent based at least in part on at least one of a position and behavior of at least one other mobile agent.