Visual programming environment for mobile device applications

• US 8,291,408 B1
• Filed: 09/30/2011
• Issued: 10/16/2012
• Est. Priority Date: 03/10/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Czymontek, Herbert
• Primary Examiner(s): Rutten, James D
• Application Number:
  US13/249,644
• Time in Patent Office: 382 Days
• Field of Search: 717/178
• US Class Current: 717/178
• CPC Class Codes: G06F 8/34 Graphical or visual programming

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for creating mobile device applications using a visual programming integrated development environment (IDE). In one aspect, a method includes receiving, by a visual programming IDE, one or more user inputs entered by a user through a visual programming interface at a first client device, where the one or more user inputs collectively select and arrange components that define an application, and where at least one of the components accesses functionality that is specific to mobile devices, generating, by the visual programming IDE, executable code that implements the application defined by the one or more user inputs, and providing, by the visual programming IDE, the executable code to a second client device.

Claims

1. A system comprising:

one or more computers; and

a computer-readable medium coupled to the one or more computers having instructions stored thereon which, when executed by the one or more computers, cause the one or more computers to perform operations comprising;

receiving, by a visual programming integrated development environment, one or more user inputs entered by a user through a visual programming interface at a first client device, wherein the one or more user inputs collectively select and arrange components that define an application, and wherein at least one of the components accesses functionality that is specific to mobile devices,

generating, by the visual programming integrated development environment, executable code that implements the application defined by the one or more user inputs,

receiving, by the visual programming integrated development environment, a camera image of the components as arranged on the visual programming interface, taken by a second client device, and

providing, by the visual programming integrated development environment, the executable code to the second client device based on receiving the camera image of the components as arranged on the visual programming interface.

2. The system of claim 1, wherein the functionality that is specific to mobile devices further comprises accelerometer functionality that accepts one or more inputs from an accelerometer that is included on the second client device.

3. The system of claim 1, wherein the functionality that is specific to mobile devices further comprises telephone functionality that accepts one or more inputs from a telephony module that is included on the second client device.

4. The system of claim 1, wherein the functionality that is specific to mobile devices further comprises text messaging functionality that accepts one or more inputs from a text message module that is included on the second client device.

5. The system of claim 1, wherein the functionality that is specific to mobile devices further comprises bar code reading functionality that accepts one or more inputs from a bar code reader that is included on the second client device.

6. The system of claim 1, wherein the functionality that is specific to mobile devices further comprises ringer functionality that provides one or more outputs to a ringer module that is included on the second client device.

7. The system of claim 1, wherein the functionality that is specific to mobile devices further comprises position determination functionality that accepts one or more inputs from a navigation module that is included on the second client device.

8. The system of claim 1, wherein the functionality that is specific to mobile devices further comprises embedded module functionality that accepts one or more inputs from or that provides one or more outputs to an embedded module that is included on the second client device.

9. The system of claim 1, wherein the functionality that is specific to mobile devices further comprises functionality that is typically included on a mobile device, but that is not typically included on a non-mobile device.

10. The system of claim 1, wherein the functionality that is specific to mobile devices further comprises proximity sensor functionality that accepts one or more inputs from a proximity sensor that is included on the second client device.

11. The system of claim 1, wherein the functionality that is specific to mobile devices further comprises light detection functionality that accepts one or more inputs from a light sensor that is included on the second client device.

12. The system of claim 1, wherein the functionality that is specific to mobile devices further comprises orientation sensing functionality that accepts one or more inputs from an orientation sensor that is included on the second client device.

13. The system of claim 1, wherein the functionality that is specific to mobile devices further comprises camera functionality that accepts one or more inputs from a camera that is included on the second client device.

14. The system of claim 1, wherein the functionality that is specific to mobile devices further comprises personal information management functionality that accepts one or more inputs from or provides one or more outputs to a personal information manager tool on the second client device.

15. The system of claim 1, wherein at least one of the components implements social networking functionality.

16. The system of claim 1, wherein the visual programming interface is a web-based visual programming interface.

17. The system of claim 1, wherein:

the one or more user inputs collectively select and modify an existing application, and

generating executable code further comprises generating executable code that implements the modified application.

18. The system of claim 1, wherein the one or more user inputs that collectively select and arrange the components that define the application further comprise:

a first user input that selects a particular component, and

a second user input that arranges the particular component with respect to other components.

19. The system of claim 1, further comprising providing, by the visual programming integrated development environment, a preview window on the visual programming interface at the first client device, wherein the preview window displays, at the first client device, a mock-up of the application as the visual programming integrated development environment infers the application will appear on the second client device.

20. The system of claim 1, wherein the visual programming integrated development environment comprises a server-based integrated development environment.

21. The system of claim 1, wherein:

the operations further comprise;

determining one or more characteristics of the first device,

generating a first version of the executable code based on the one or more characteristics of the first device,

providing the first version of the executable code to the first device,

determining one or more characteristics of the second device, and

generating a different, second version of the executable code based on the one or more characteristics of the second device; and

providing the executable code to the second client device further comprises providing the second version of the executable code to the second client device.

22. The system of claim 21, wherein:

determining one or more characteristics of the first device further comprises determining that the application will be executed in a browser environment of a non-mobile device;

generating the first version of the executable code further comprises generating a browser-specific version of the executable code;

determining one or more characteristics of the second device further comprises determining that the application will be executed in a mobile device operating system environment; and

generating the second version of the executable code further comprises generating a mobile device operating system-specific version of the executable code.

23. The system of claim 1, wherein:

the operations further comprise;

identifying the user,

receiving a signal indicating that the executable code is to be generated, and

in response to receiving the signal, determining that the second client device is paired with the user by the visual programming integrated development environment; and

the executable code is provided to the second client device in response to determining that the second client device is registered in association with the user.

24. The system of claim 23, wherein receiving a signal further comprises determining that the user has selected a control on the visual programming interface of the first client device to indicate that the executable code is to be generated.

25. The system of claim 23, wherein receiving a signal further comprises determining that the user has selected a control on the second client device to indicate that the executable code is to be generated.

26. The system of claim 1, wherein the executable code is provided to the second client device by the visual programming integrated development environment without providing the executable code to the first client device.

27. A computer-implemented method comprising:

receiving, by a visual programming integrated development environment, one or more user inputs entered by a user through a visual programming interface at a first client device, wherein the one or more user inputs collectively select and arrange components that define an application, and wherein at least one of the components accesses functionality that is specific to mobile devices,

generating, by the visual programming integrated development environment, executable code that implements the application defined by the one or more user inputs,

receiving, by the visual programming integrated development environment, a camera image of the components as arranged on the visual programming interface, taken by a second client device, and

providing, by the visual programming integrated development environment, the executable code to the second client device based on receiving the camera image of the components as arranged on the visual programming interface.

28. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

receiving, by a visual programming integrated development environment, one or more user inputs entered by a user through a visual programming interface at a first client device, wherein the one or more user inputs collectively select and arrange components that define an application, and wherein at least one of the components accesses functionality that is specific to mobile devices,

generating, by the visual programming integrated development environment, executable code that implements the application defined by the one or more user inputs,

receiving, by the visual programming integrated development environment, a camera image of the components as arranged on the visual programming interface, taken by a second client device, and

providing, by the visual programming integrated development environment, the executable code to the second client device based on receiving the camera image of the components as arranged on the visual programming interface.