Touch-based interactive learning environment

• US 10,430,072 B2
• Filed: 06/03/2016
• Issued: 10/01/2019
• Est. Priority Date: 06/05/2015
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Aghaei, Behzad, Lattner, Christopher A., Firlik, Donald M., Orr, Kenneth S., Patenaude, Matthew M., Drukman, Maxwell O., Ferris, Michael S., Page, Samuel C., Falk, Sonny, Isted, Timothy V., Dudney, William A.
• Primary Examiner(s): Grant, Michael C
• Application Number:
  US15/173,553
• Publication Number:
  US 20160357432A1
• Time in Patent Office: 1,215 Days
• Field of Search: 434118
• CPC Class Codes: A63F 13/2145 the surface being also a display device, e.g. touch screens
• CPC Class Codes: A63F 13/537 using indicators, e.g. showing the condition of a game character on screen
• CPC Class Codes: A63F 13/63 by the player, e.g. authoring using a level editor
• CPC Class Codes: A63F 2300/209 characterized by low level software layer, relating to hardware management, e.g. Operating System, Application Programming Interface
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs
• CPC Class Codes: G06F 8/31 Programming languages or programming paradigms
• CPC Class Codes: G06F 8/33 Intelligent editors
• CPC Class Codes: G06F 8/38 for implementing user interfaces
• CPC Class Codes: G06F 9/445 Program loading or initiating bootstrapping G06F9/4401; security arrangements for program loading or initiating G06F21/57
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G09B 19/0053 Computers, e.g. programming
• CPC Class Codes: G09B 5/02 with visual presentation of the material to be studied, e.g. using film strip

Abstract

In an example method, a user interface is presented by a device on a touch sensitive surface of the device. The user interface includes a first portion for displaying a sequence of code and a second portion for displaying suggested bracketed functions. The device receives a first touch gesture dragging a suggested bracketed function from the second portion to the first portion of the user interface. Responsive to receiving the first touch gesture, the suggested bracketed function is inserted into the sequence of code. The bracketed function encloses at least a portion of the sequence of code. The device receives a second touch gesture dragging an end bracket associated with the inserted bracketed function. Responsive to receiving the second touch gesture, the sequence of code is modified such that the bracketed function encloses an additional portion of the sequence of code.

Claims

1. A non-transitory computer-readable medium including one or more sequences of instructions which, when executed by one or more processors, causes the one or more processors to perform operations comprising:

presenting, by a device, a user interface on a touch sensitive surface of the device, the user interface having a first portion for displaying a sequence of software code, wherein the sequence of software code includes executable sequences of code to be compiled for execution;

receiving, by the device, a first touch input in the user interface, the first touch input corresponding to a command to insert an array of values into the user interface;

responsive to receiving the first touch input, inserting the array of values into the sequence of software code and presenting an array size adjustment element via the user interface;

receiving, by the device, a second touch input dragging the array size adjustment element;

responsive to receiving the second touch input, modifying a size of the array of values; and

compiling the sequence of software code for execution.

2. The non-transitory computer-readable medium as in claim 1, the operations additionally comprising:

receiving, by the device, a third touch input in the user interface, the third touch input corresponding to a command to fill the array of values; and

responsive to receiving the third touch input, inserting a set of values into the array of values.

3. The non-transitory computer-readable medium as in claim 2, wherein inserting a set of values into the array of values includes filling the array of values with random or repeated integers.

4. The non-transitory computer-readable medium as in claim 1, the operations additionally comprising:

presenting, by the device a second portion of the user interface to display suggested bracketed functions for the sequence of software code;

receiving, by the device, a fourth touch input dragging a suggested bracketed function from the second portion to the first portion of the user interface;

responsive to receiving the fourth touch input, inserting the suggested bracketed function into the sequence of software code, wherein the bracketed function encloses at least a portion of the sequence of software code;

receiving, by the device, a fifth touch input dragging an end bracket associated with the inserted bracketed function; and

responsive to receiving the fifth touch input, modifying the sequence of software code such that the bracketed function encloses an additional portion of the sequence of software code.

5. The non-transitory computer-readable medium as in claim 4, wherein the fifth touch input comprises a reverse pinching gesture.

6. The non-transitory computer-readable medium as in claim 4, the operations further comprising displaying, by the device, in the first portion of the user interface, a beginning bracket associated in the inserted bracketed function, the end bracket associated with the inserted bracketed function, and a display element linking the beginning bracket to the end bracket.

7. The non-transitory computer-readable medium as in claim 4, wherein the user interface is presented as a part of a lesson plan and the suggested bracketed functions are determined based on the lesson plan.

8. A system comprising:

a touch sensitive surface;

one or more processors;

a non-transitory computer-readable medium including one or more sequences of instructions which, when executed by the one or more processors, causes the processors to perform one or more operations comprising;

presenting, by a device, a user interface on a touch sensitive surface of the device, the user interface having a first portion for displaying a sequence of software code, wherein the sequence of software code includes executable sequences of code to be compiled for execution;

receiving, by the device, a first touch input in the user interface, the first touch input corresponding to a command to insert an array of values into the user interface;

responsive to receiving the first touch input, inserting the array of values into the sequence of software code and presenting an array size adjustment element via the user interface;

receiving, by the device, a second touch input dragging the array size adjustment element;

responsive to receiving the second touch input, modifying a size of the array of values; and

compiling the sequence of software code for execution.

9. A system as in claim 8, the operations additionally comprising:

receiving, by the device, a third touch input in the user interface, the third touch input corresponding to a command to fill the array of values; and

responsive to receiving the third touch input, inserting a set of values into the array of values.

10. The system as in claim 9, wherein inserting a set of values into the array of values includes filling the array of values with random or repeated integers.

11. The system as in claim 8, additionally comprising:

presenting, by the device a second portion of the user interface to display suggested bracketed functions for the sequence of software code;

receiving, by the device, a fourth touch input dragging a suggested bracketed function from the second portion to the first portion of the user interface;

responsive to receiving the fourth touch input, inserting the suggested bracketed function into the sequence of software code, wherein the bracketed function encloses at least a portion of the sequence of software code;

receiving, by the device, a fifth touch input dragging an end bracket associated with the inserted bracketed function; and

responsive to receiving the fifth touch input, modifying the sequence of software code such that the bracketed function encloses an additional portion of the sequence of software code.

12. The system as in claim 11, wherein the fifth touch input comprises a reverse pinching gesture.

13. The system as in claim 11, further comprising displaying, by the device, in the first portion of the user interface, a beginning bracket associated in the inserted bracketed function, the end bracket associated with the inserted bracketed function, and a display element linking the beginning bracket to the end bracket.

14. The system as in claim 11, wherein the user interface is presented as a part of a lesson plan and the suggested bracketed functions are determined based on the lesson plan.

15. A method comprising:

presenting, by a device, a user interface on a touch sensitive surface of the device, the user interface having a first portion for displaying a sequence of software code, wherein the sequence of software code includes executable sequences of code to be compiled for execution;

receiving, by the device, a first touch input in the user interface, the first touch input corresponding to a command to insert an array of values into the user interface;

responsive to receiving the first touch input, inserting the array of values into the sequence of software code and presenting an array size adjustment element via the user interface;

receiving, by the device, a second touch input dragging the array size adjustment element;

responsive to receiving the second touch input, modifying a size of the array of values; and

compiling the sequence of software code for execution.

16. The method as in claim 15, additionally comprising:

receiving, by the device, a third touch input in the user interface, the third touch input corresponding to a command to fill the array of values; and

responsive to receiving the third touch input, inserting a set of values into the array of values, wherein inserting a set of values into the array of values includes filling the array of values with random or repeated integers.

17. The method as in claim 15, additionally comprising:

presenting, by the device a second portion of the user interface to display suggested bracketed functions for the sequence of software code;

receiving, by the device, a fourth touch input dragging a suggested bracketed function from the second portion to the first portion of the user interface;

responsive to receiving the fourth touch input, inserting the suggested bracketed function into the sequence of software code, wherein the bracketed function encloses at least a portion of the sequence of software code;

receiving, by the device, a fifth touch input dragging an end bracket associated with the inserted bracketed function; and

responsive to receiving the fifth touch input, modifying the sequence of software code such that the bracketed function encloses an additional portion of the sequence of software code.

18. The method as in claim 17, wherein the fifth touch input comprises a reverse pinching gesture.

19. The method as in claim 17, further comprising displaying, by the device, in the first portion of the user interface, a beginning bracket associated in the inserted bracketed function, the end bracket associated with the inserted bracketed function, and a display element linking the beginning bracket to the end bracket.

20. The method as in claim 17, wherein the user interface is presented as a part of a lesson plan and the suggested bracketed functions are determined based on the lesson plan.