System and method for changing the state of user interface element marked on physical objects

• US 9,690,473 B2
• Filed: 02/29/2016
• Issued: 06/27/2017
• Est. Priority Date: 06/13/2014
• Status: Active Grant

• Current Assignee: Xingyi Gong, Zheng Shi
• Original Assignee: Xingyi Gong, Zheng Shi
• Inventors: Shi, Zheng, Gong, Xingyi
• Primary Examiner(s): HAILU, TADESSE
• Application Number:
  US15/057,092
• Publication Number:
  US 20160179333A1
• Time in Patent Office: 484 Days
• CPC Class Codes: G06F 3/0443 using a single layer of sensing electrodes
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The present invention discloses a system and method for changing the state of a user interface (UI) element of a computer program visually marked on a physical object, through a touch action upon the object, among a plurality of objects on the interactive surface, each comprising a capacitance tab and a unique identification code. During runtime execution of the computer program, and in response to a touch action upon an object by an end-user, the interactive surface is configured to detect such touch action upon the object through an embedded capacitance sensor positioned under the object, and direct a sensory accessory to indicate a new state of the UI element marked on an object by exhibiting a new sensory pattern. The present invention offers enhanced interactivity between an end-user and a computer program mediated by physical objects.

Claims

1. A system for changing the state of a user interface (UI) element visually marked on physical objects, comprising:

a plurality of physical objects, each comprising a unique identification code (UID) and each visually marked with a UI element of a computer program;

an interactive surface that has no display screen, and is configured to detect the UID of an object, to derive the location and orientation of the object, and to measure capacitance change caused by the object and subsequently by a touch action upon the object, upon the object being placed on the interactive surface;

a sensory accessory that is operatively controlled by the interactive surface, and indicates the current state of the UI element by exhibiting a sensory pattern;

wherein, during runtime execution of the computer program, and in response to a touch action upon a first object, the interactive surface is configured to detect the touch action and direct the sensory accessory to indicate a new state of the UI element of a second object that is different from the first object by exhibiting a new sensory pattern for the second object.

2. The system of claim 1, wherein the UI element is selected from a group comprising start, stop, save, delete, okay, cancel, play, replay, record, complete, copy, duplicate, export, import, a letter of an alphabet, a word of a language, and an icon representing a musical symbol.

3. The system of claim 1, wherein the state of a UI element is selected from a group comprising active, non-active, in use, not in use, enabled, not enabled, selected, not-selected, not-executing, executing, completed, correct, incorrect, succeeded, and failed.

4. The system of claim 1, wherein the touch action is selected from a group comprising touching an object once, touching an object more than once in rapid succession, touching an object once but for a duration of time, changing the orientation of an object with finger touch, and changing the location of an object with finger touch.

5. The system of claim 1, further comprising a computer system that is operatively linked to the interactive surface and is configured to execute the computer program.

6. The system of claim 5, wherein the computer system stores the current state and a range of valid states of the UI element of the computer program marked on an object, and the relationship between a touch action and a change of the state of the UI element.

7. The system of claim 5, wherein the interactive surface notifies the computer system of the touch action and receives an instruction according to the computer program regarding changing the current state of the UI element marked on an object.

8. The system of claim 1, wherein an object is selected from a group comprising a card, a button, a block, an icon, a sheet, and a figurine.

9. The system of claim 1, wherein the sensory accessory is selected from a group comprising an LED light, an audio device, a video device, and a vibration generator device.

10. A method for changing the state of a user interface (UI) element visually marked on physical objects, comprising:

placing, during runtime execution of a computer program, a plurality of objects on an interactive surface,

wherein each object comprises a unique identification code (UID) and is visually marked with a UI element of the computer program, and

wherein the interactive surface has no display screen, and is configured to detect the UID of the object, derive the location and orientation of the object, and measure capacitance change caused by the object and subsequently by a touch action acted upon the object, upon the object being placed on the interactive surface,

indicating, by exhibiting a sensory pattern, the current state of the UI element marked on a first object, by a sensory accessory that is operatively controlled by the interactive surface,

acting upon the first object by a touch action,

detecting the touch action by the interactive surface,

directing, by the interactive surface, the sensory accessory to indicate a new state of the UI element marked on a second object that is different from the first object by exhibiting a new sensory pattern for the second object.

11. The method of claim 10, wherein the UI element is selected from a group comprising start, stop, save, delete, okay, cancel, play, replay, record, complete, copy, duplicate, export, import, a letter of an alphabet, a word of a language, and an icon representing a musical symbol.

12. The method of claim 10, wherein the state of a UI element is selected from a group comprising active, non-active, in use, not in use, enabled, not enabled, selected, not-selected, not-executing, executing, completed, correct, incorrect, succeeded, failed.

13. The method of claim 10, wherein the touch action is selected from a group comprising touching an object once, touching an object more than once in rapid succession, touching an object once but for a short duration of time, changing the orientation of an object with finger touch, and changing the location of an object with finger touch.

14. The method of claim 10, further comprising executing the computer program by a computer system that is operatively linked to the interactive surface.

15. The method of claim 14, further comprising, storing the current state and a range of valid states of the UI element of the computer program marked on an object, and the relationship between a touch action and a change in the state of the UI element, by the computer system.

16. The method of claim 14, further comprising notifying the computer system of the touch action by the interactive surface and receiving an instruction according to the computer program regarding changing the current state of the UI element marked on an object.

17. The method of claim 10, wherein an object is selected from a group comprising a card, a button, a block, an icon, a sheet, and a figurine.

18. The method of claim 10, wherein the sensory accessory is selected from a group comprising an LED light, an audio device, a video device, and a vibration generator device.

19. A system for changing the state of a user interface (UI) element visually marked on physical objects, comprising:

a plurality of physical objects, each comprising a unique identification code (UID) and each visually marked with a UI element of a computer program;

an interactive surface that has no display screen, and is configured to detect the UID of an object, to derive the location and orientation of the object, and to measure capacitance change caused by the object and subsequently by a touch action upon the object, upon the object being placed on the interactive surface;

a sensory accessory that is operatively controlled by the interactive surface, and indicates the current state of the UI element by exhibiting a sensory pattern;

wherein, during runtime execution of the computer program, and in response to a touch action upon an object, with the touch action selected from a group consisting of touching an object more than once in rapid succession, touching an object once but for a duration of time, changing the orientation of an object with finger touch, and changing the location of an object with finger touch, the interactive surface is configured to detect the touch action and direct the sensory accessory to indicate a new state of the UI element of the object by exhibiting a new sensory pattern for the object.