Methods and systems for generating a layered display of a device

• US 8,525,853 B1
• Filed: 07/24/2012
• Issued: 09/03/2013
• Est. Priority Date: 01/18/2012
• Status: Active Grant

• Current Assignee: X Development LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Hickman, Ryan
• Primary Examiner(s): Hoang, Phi
• Application Number:
  US13/556,894
• Time in Patent Office: 406 Days
• Field of Search: 345/418, 560/1
• US Class Current: 345/630
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics

Abstract

Methods and systems for generating a screen interface for providing a layered display of a robot is provided. A computing device, such as the cloud may receive information associated with a robot and the received information may indicate components of the robot. The computing device may then generate a layered display of the robot based on the received information and provide the generated layered display on a screen interface. The screen interface may show a number of different views of the robot, including a structural view of the robot and a components view of the robot. The interface may provide information indicating capabilities of the robot or capabilities of the components of the robot. The screen interface may also show different layers of components of the robot, such as a functions layer, and a task group layer. The screen interface may further show modified configurations of the robot.

Claims

1. A method comprising:

receiving a request for a layered image of a remote robotic device having at least one sensor component and one mechanical actuator component;

querying the remote robotic device for device information associated with the remote robotic device, the device information indicating components of the device including the at least one sensor component and one mechanical actuator component, and indicating functions of the components of the remote robotic device;

receiving the device information associated with the remote robotic device;

generating the layered image of the remote robotic device based on the received device information, the layered image illustrating multiple layers, each layer of the layered image providing a representation of the remote robotic device and any components of the remote robotic device at the layer, wherein the layered image comprises an outer layer representing an external illustration of the remote robotic device and components of the remote robotic device, at least one inner layer representing an internal illustration of the remote robotic device and components of the remote robotic device, and a functions layer illustrating components having a similar function;

receiving a request to display a first layer of the remote robotic device, the first layer illustrating information associated with one or more of the at least one sensor component and one mechanical actuator component; and

providing an image of the first layer of the remote robotic device.

2. The method of claim 1, wherein generating the layered image of the remote robotic device comprises generating a three-dimensional image.

3. The method of claim 1, wherein the at least one inner layer representing the internal illustration of the remote robotic device and components of the remote robotic device provides a structural representation of the remote robotic device.

4. The method of claim 1, wherein the at least one inner layer representing the internal illustration of the remote robotic device and components of the remote robotic device illustrates internal components of the remote robotic device and interconnects of the internal components.

5. The method of claim 1, further comprising

receiving information associated with one of the remote robotic device or a given component of the remote robotic device, the information indicating capabilities of the remote robotic device or the given component of the remote robotic device;

and

providing in the layered image of the remote robotic device, the information indicating the capabilities of the remote robotic device or the given component of the remote robotic device.

6. The method of claim 5, wherein the information indicating capabilities of the remote robotic device or the given component of the remote robotic device further provides a maintenance record of the remote robotic device or the given component of the remote robotic device, the maintenance record indicating at least one of installation, usage and maintenance histories of the remote robotic device or given component of the remote robotic device.

7. The method of claim 1, further comprising:

receiving a request to view the functions layer; and

providing in the layered image of the remote robotic device, the functions layer and the information indicating the functions of the components illustrated in the functions layer.

8. The method of claim 1, wherein the functions layer is a cognitive layer, the cognitive layer illustrating data processor components.

9. The method of claim 1, wherein the remote robotic device is configured to perform a task utilizing a group of components of the remote robotic device, and wherein the layered image of the remote robotic device further comprises a task group layer illustrating the group of components utilized to perform the task.

10. The method of claim 9, further comprising:

receiving a request to view the task group layer; and

providing in the layered image of the remote robotic device, the task group layer and information associated with the components illustrated in the task group layer.

11. The method of claim 9, wherein the task is movement and wherein the group of components illustrated in the task group layer comprises at least one of a motorized wheel, an accelerometer, and a control processor.

12. The method of claim 9, wherein the task is video capture and wherein the group of components illustrated in the task group layer comprises at least one of a video camera, a video processor unit and a video storage unit.

13. The method of claim 1, further comprising:

receiving a request to modify a configuration of the device and components of the remote robotic device;

receiving modification information associated with a new configuration of the remote robotic device and components of the remote robotic device; and

modifying the layered image according to the new configuration of the remote robotic device and components of the remote robotic device.

14. The method of claim 13, further comprising:

providing in the layered image of the remote robotic device a super-imposed layered image of the modified layered image of the new configuration of the remote robotic device and components of the remote robotic device and the layered image of the current configuration of the remote robotic device and components of the remote robotic device.

15. The method of claim 1, further comprising displaying the layered image of the remote robotic device on a display.

16. The method of claim 1, further comprising:

a computing device receiving the information associated with the remote robotic device; and

based on the information, the computing device determining the outer layer representing the external illustration of the remote robotic device and components of the remote robotic device and the at least one inner layer representing the internal illustration of the remote robotic device and components of the remote robotic device; and

the computing device generating the layered image of the remote robotic device.

17. The method of claim 1, further comprising:

a computing device receiving the information associated with the remote robotic device;

accessing a server to determine the outer layer representing the external illustration of the device and components of the device and the at least one inner layer representing the internal illustration of the remote robotic device and components of the remote robotic device; and

the computing device generating the layered image of the remote robotic device.

18. A non-transitory computer readable medium having stored thereon instructions executable by a computing device to cause the computing device to perform functions comprising:

receiving a request for a layered image of a robotic device having at least one sensor component and one mechanical actuator component;

querying the robotic device for device information associated with the robotic device;

the device information indicating components of the device including the at least one sensor component and one mechanical actuator component;

receiving device information associated with the robotic device, the device information indicating components of the robotic device;

generating the layered image of the robotic device based on the received device information, the layered image illustrating multiple layers, each layer of the layered image providing a representation of the device and components of the robotic device at the layer, wherein the layered image comprises an outer layer representing an external illustration of the robotic device and components of the robotic device and at least one inner layer representing an internal illustration of the robotic device and components of the robotic device;

receiving information associated with one of the robotic device or a given component of the robotic device, the information indicating capabilities of the robotic device or the given component of the robotic device;

providing in the layered image of the robotic device, the information indicating the capabilities of the robotic device or the given component of the robotic device;

receiving a request to display a sensor layer of the robotic device, the sensor layer illustrating the at least one sensor component; and

providing an image of the sensor layer of the robotic device.

19. A device comprising:

a processor; and

memory including instructions stored therein executable by the processor to perform functions comprising;

receiving a request for a layered image of a robotic device having at least one sensor component and one mechanical actuator component;

querying the robotic device for device information associated with the robotic device;

the device information indicating components of the device including the at least one sensor component and one mechanical actuator component;

receiving device information associated with the robotic device, the device information indicating components of the robotic device;

generating the layered image of the device based on the received device information, the layered image illustrating multiple layers, each layer of the layered image providing a representation of the robotic device and components of the device at the layer, wherein the layered image comprises an outer layer representing an external illustration of the robotic device and components of the robotic device and at least one inner layer representing an internal illustration of the robotic device and components of the robotic device;

receiving a request to display a first layer of the robotic device, the first layer illustrating information associated with one or more of the at least one sensor component and one mechanical actuator component;

providing a display of the first layer of the robotic device;

receiving a request to display a cognitive layer of the robotic device, the cognitive layer illustrating information associated with at least one data processing component of the remote robotic device; and

providing a display of the cognitive layer of the robotic device.

20. The device of claim 19, further comprising instructions stored in the memory executable by the processor to perform functions comprising:

receiving a request to modify a configuration of the robotic device and components of the robotic device;

receiving modification information associated with a new configuration of the robotic device and components of the robotic device; and

modifying the layered image according to the new configuration of the robotic device and components of the robotic device.

21. The device of claim 19, further comprising instructions stored in the memory executable by the processor to perform functions comprising:

receiving information associated with one of the remote robotic device or a given component of the remote robotic device, the information indicating capabilities of the remote robotic device or the given component of the remote robotic device; and

providing in the layered image of the remote robotic device, the information indicating the capabilities of the remote robotic device or the given component of the remote robotic device.

22. The device of claim 19, further comprising a display, wherein instructions stored in the memory executable by the processor to perform functions further comprise displaying the layered image of the remote robotic device on the display.

23. The device of claim 19, further comprising instructions stored in the memory executable by the processor to perform functions comprising:

receiving input data indicating functional instructions for the at least one sensor component and one mechanical actuator component, the functional instructions indicating actions performable by the at least one sensor component and one mechanical actuator;

causing the remote robotic device to execute the functional instructions.

24. The device of claim 19, wherein the device is a mobile device configured to be in wireless communication with the remote robotic device.