Automated detection of surface layout

• US 10,188,958 B2
• Filed: 01/28/2016
• Issued: 01/29/2019
• Est. Priority Date: 05/28/2009
• Status: Active Grant

• Current Assignee: Digital Dream Labs, LLC
• Original Assignee: ANKI Incorporated
• Inventors: Liu, Tian Yu Tommy, Sofman, Boris, Tappeiner, Hanns W., Palatucci, Mark
• Primary Examiner(s): Harper, Tramar
• Application Number:
  US15/009,697
• Publication Number:
  US 20160144288A1
• Time in Patent Office: 1,097 Days
• Field of Search: None
• CPC Class Codes: A63H 17/26 Details; Accessories drive mechanisms A63H29/00
• CPC Class Codes: A63H 17/32 Acoustical or optical signalling devices
• CPC Class Codes: A63H 17/395 steered by program
• CPC Class Codes: A63H 17/40 Toy vehicles automatically steering or reversing by collision with an obstacle
• CPC Class Codes: A63H 17/44 Toy garages for receiving toy vehicles; Filling stations
• CPC Class Codes: A63H 18/02 Construction or arrangement of the trackway
• CPC Class Codes: A63H 18/12 Electric current supply to toy vehicles through the track
• CPC Class Codes: A63H 18/16 Control of vehicle drives by interaction between vehicle and track; Control of track elements by vehicles
• CPC Class Codes: A63H 30/04 using wireless transmission

Abstract

A drivable surface includes a plurality of segments that can be arranged according to any desired configuration. One or more mobile agents are configured to automatically explore the drivable surface so as to ascertain the positions, orientations, and/or configurations of the various segments, as well as how they are connected to one another. The information collected during such exploration can be transmitted to a host device or other location, where a virtual representation of the drivable surface can be constructed based on the collected information.

Claims

1. A system comprising:

a surface having a layout, and comprising a plurality of machine-readable codes, each machine-readable code identifying at least one characteristic of a portion of the surface;

a plurality of mobile agents configured to explore the surface contemporaneously with one another, each mobile agent comprising;

a propulsion mechanism, configured to impart motive force to cause the mobile agent to travel along the surface;

a sensor, configured to detect the machine-readable codes as the mobile agent travels along the surface;

a mobile wireless transceiver, configured to transmit at least one signal representing the detected machine-readable codes; and

a microcontroller, operatively coupled to control the operation of the propulsion mechanism, the sensor, and the mobile wireless transceiver; and

a host device, comprising;

a wireless transceiver, configured to receive signals representing detected machine-readable codes from the mobile agents;

a processor, operatively coupled to the wireless transceiver, configured to determine the layout of the surface by merging information from the signals received from at least two of the mobile agents; and

a storage device, operatively coupled to the wireless transceiver, configured to store a virtual representation of the surface based on the determined layout;

wherein the host device is configured to implement an entertainment activity for the plurality of mobile agents based on the virtual representation.

2. The system of claim 1, wherein the layout comprises a loop, and wherein the mobile agents are configured to explore the surface by traversing the loop.

3. The system of claim 2, wherein at least one portion of the surface comprises a branching path having at least two branches, each branch leading to a different loop, and wherein at least one of the mobile agents is configured to explore the surface by traversing the different loops.

4. The system of claim 1, wherein the wireless transceiver of the host device is further configured to transmit a signal to cause the mobile agents to explore the surface.

5. The system of claim 1, wherein:

at least one of the mobile agents is configured to further explore the surface;

the sensor of the at least one mobile agent is configured to detect additional machine-readable codes as the mobile agent travels along the surface;

the mobile wireless transceiver of the at least one mobile agent is configured to transmit at least one additional signal representing the additional detected machine-readable codes;

the wireless transceiver of the host device is configured to receive the at least one additional signal representing the additional detected machine-readable codes from the at least one mobile agent;

the processor is configured to update the determined layout of the surface based on the received at least one at least one additional signal; and

the storage device is configured to update the stored virtual representation of the surface based on the updated layout.

6. The system of claim 5, wherein the layout is changeable, and wherein the detected additional machine-readable codes indicate a change to the layout of the surface.

7. The system of claim 6, wherein at least one portion of the surface comprises a branching path having at least two branches, each branch leading to a different loop, and wherein:

at least one of the mobile agents is configured to explore at least one of the loops; and

at least one other of the mobile agents is configured to explore at least one other of the loops.

8. The system of claim 1, wherein:

at least a subset of the received signals provide conflicting information about the layout of the surface; and

the processor is configured to determine the layout of the surface by reconciling the conflicting information.

9. The system of claim 8, wherein the processor is configured to reconcile the conflicting information by:

determining a plurality of hypotheses representing alternative possible layouts;

generating a relative confidence metric for each hypothesis; and

selecting the hypothesis having the highest confidence metric.

10. The system of claim 1, wherein the processor is configured to determine the layout of the surface by:

determining a plurality of code entries from the received signals, each code entry representing an identified portion of the surface at an identified topological location;

aggregating the determined code entries; and

generating a coherent map from the aggregation of code entries.

11. The system of claim 1, further comprising at least one controller controlled by at least one human user, wherein each controller is configured to control at least one mobile agent.

12. The system of claim 11, wherein each controller comprises at least one selected from the group consisting of:

a mobile computing device;

a smartphone;

a tablet computer;

a desktop computer;

a laptop computer;

a video game console; and

a kiosk;

and wherein the host device comprises at least one selected from the group consisting of;

a mobile computing device;

a smartphone;

a tablet computer;

a desktop computer;

a laptop computer;

a video game console; and

a kiosk.

13. The system of claim 1, further comprising:

an automated computing system, configured to control at least one of the mobile agents in an automated manner.

14. The system of claim 1, wherein the surface comprises a plurality of segments.

15. The system of claim 14, wherein the at least one characteristic of a portion of the surface comprises an identifier for one of the segments.

16. The system of claim 1, wherein each mobile agent comprises a toy vehicle.

17. A method for determining a layout of a surface comprising a plurality of machine-readable codes, each machine-readable code identifying at least one characteristic of a portion of the surface, the method comprising:

detecting, via sensors of a plurality of mobile agents configured to explore the surface contemporaneously with one another, machine readable codes as the mobile agents travel along the surface, each machine-readable code identifying at least one characteristic of a portion of the surface;

at a wireless transceiver of a host device, receiving signals representing detected machine-readable codes from the mobile agents;

at a processor of the host device, determining the layout of the surface by merging information from the signals received from at least two of the mobile agents;

at a storage device, storing a virtual representation of the surface based on the determined layout; and

at the processor of the host device implementing an entertainment activity for the plurality of mobile agents based on the virtual representation.

18. The method of claim 17, wherein the layout comprises a loop, and wherein exploring the surface comprises traversing the loop.

19. The method of claim 18, wherein at least one portion of the surface comprises a branching path having at least two branches, each branch leading to a different loop, and wherein exploring the surface comprises traversing the different loops.

20. The method of claim 17, further comprising transmitting a signal from the wireless transceiver of the host device, to cause the mobile agents to explore the surface.

21. The method of claim 17, further comprising:

causing at least one of the mobile agents to further explore the surface;

detecting, via at least one sensor of at least one mobile agent, additional machine-readable codes as the mobile agent travels along the surface;

at the wireless transceiver of the host device, receiving at least one additional signal from the at least one mobile agent, each received additional signal representing additional detected machine-readable codes;

at the processor of the host device, updating the determined layout of the surface based on the received at least one at least one additional signal; and

at the storage device, updating the stored virtual representation of the surface based on the updated layout.

22. The method of claim 21, wherein the layout is changeable, and wherein the detected additional machine-readable codes indicate a change to the layout of the surface.

23. The method of claim 22, wherein at least one portion of the surface comprises a branching path having at least two branches, each branch leading to a different loop, the method further comprising:

causing at least one of the mobile agents to explore at least one of the loops; and

causing at least one other of the mobile agents to explore at least one other of the loops.

24. The method of claim 17, wherein:

at least a subset of the received signals provide conflicting information about the layout of the surface; and

determining the layout of the surface comprises reconciling the conflicting information.

25. The method of claim 24, wherein reconciling the conflicting information comprises:

determining a plurality of hypotheses representing alternative possible layouts;

generating a relative confidence metric for each hypothesis; and

selecting the hypothesis having the highest confidence metric.

26. The method of claim 17, wherein determining the layout of the surface comprises:

determining a plurality of code entries from the received signals, each code entry representing an identified portion of the surface at an identified topological location;

aggregating the determined code entries; and

generating a coherent map from the aggregation of code entries.

27. The method of claim 17, wherein at least one of the mobile agents is controlled by a controller, the method comprising:

receiving, at the controller, user input from at least one human user; and

transmitting, from the controller to the at least one mobile agent, a signal directing movement of the at least one mobile agent.

28. The method of claim 27, wherein each controller comprises at least one selected from the group consisting of:

a mobile computing device;

a smartphone;

a tablet computer;

a desktop computer;

a laptop computer;

a video game console; and

a kiosk;

and wherein the host device comprises at least one selected from the group consisting of;

a mobile computing device;

a smartphone;

a tablet computer;

a desktop computer;

a laptop computer;

a video game console; and

a kiosk.

29. The method of claim 17, wherein at least one of the mobile agents is controlled by an automated computing system, the method comprising:

transmitting, from the automated computing system to the at least one mobile agent, a signal directing movement of the at least one mobile agent.

30. The method of claim 17, wherein the surface comprises a plurality of segments.

31. The method of claim 30, wherein the at least one characteristic of a portion of the surface comprises an identifier for one of the segments.

32. The method of claim 17, wherein each mobile agent comprises a toy vehicle.

33. A non-transitory computer program product for determining a layout of a surface comprising a plurality of machine-readable codes, each machine-readable code identifying at least one characteristic of a portion of the surface, the non-transitory computer program product comprising instructions stored thereon, that when executed on a processor of a host device, perform the steps of:

receiving signals from a plurality of mobile agents configured to explore the surface contemporaneously with one another and to detect, via at least one sensor, machine readable codes as the mobile agents travel along the surface, each machine-readable code identifying at least one characteristic of a portion of the surface, each received signal representing at least one detected machine-readable code;

determining the layout of the surface by merging information from the signals received from at least two of the mobile agents;

causing a storage device to store a virtual representation of the surface based on the determined layout; and

implementing an entertainment activity for the plurality of mobile agents based on the virtual representation.

34. The non-transitory computer program product of claim 33, wherein the layout comprises a loop, and wherein the mobile agents are configured to explore the surface by traversing the loop.

35. The non-transitory computer program product of claim 34, wherein at least one portion of the surface comprises a branching path having at least two branches, each branch leading to a different loop, and wherein at least one of the mobile agents is configured to explore the surface by traversing the different loops.

36. The non-transitory computer program product of claim 33, wherein the non-transitory computer-readable medium further comprises instructions stored thereon, that when executed on a processor, perform the step of transmitting a signal from the wireless transceiver of the host device, to cause the mobile agents to explore the surface.

37. The non-transitory computer program product of claim 33, wherein the non-transitory computer-readable medium further comprises instructions stored thereon, that when executed on a processor, perform the steps of:

causing at least one of the mobile agents to further explore the surface;

receiving at least one additional signal from the at least one mobile agent, each received additional signal representing additional detected machine-readable codes;

updating the determined layout of the plurality of segments based on the received at least one at least one additional signal; and

causing the storage device to update the stored virtual representation of the surface based on the updated layout.

38. The non-transitory computer program product of claim 37, wherein the layout is changeable, and wherein the detected additional machine-readable codes indicate a change to the layout of the surface.

39. The non-transitory computer program product of claim 38, wherein at least one portion of the surface comprises a branching path having at least two branches, each branch leading to a different loop, and wherein the non-transitory computer-readable medium further comprises instructions stored thereon, that when executed on a processor, perform the steps of:

causing at least one of the mobile agents to explore at least one of the loops; and

causing at least one other of the mobile agents to explore at least one other of the loops.

40. The non-transitory computer program product of claim 33, wherein:

at least a subset of the received signals provide conflicting information about the layout of the surface; and

determining the layout of the surface comprises reconciling the conflicting information.

41. The non-transitory computer program product of claim 40, wherein reconciling the conflicting information comprises:

determining a plurality of hypotheses representing alternative possible layouts;

generating a relative confidence metric for each hypothesis; and

selecting the hypothesis having the highest confidence metric.

42. The non-transitory computer program product of claim 33, wherein determining the layout of the surface comprises:

determining a plurality of code entries from the received signals, each code entry representing an identified portion of the surface at an identified topological location;

aggregating the determined code entries; and

generating a coherent map from the aggregation of code entries.

43. The non-transitory computer program product of claim 33, wherein the surface comprises a plurality of segments.

44. The non-transitory computer program product of claim 43, wherein the at least one characteristic of a portion of the surface comprises an identifier for one of the segments.

45. The non-transitory computer program product of claim 33, wherein each mobile agent comprises a toy vehicle.