Multi-touch display and input for vision testing and training

• US 9,055,904 B2
• Filed: 08/03/2009
• Issued: 06/16/2015
• Est. Priority Date: 08/03/2009
• Status: Active Grant

• Current Assignee: Senaptec Inc.
• Original Assignee: Nike, Inc.
• Inventors: Yoo, Herb, Fortune, Thomas R. Jr., Pedley, Douglas, Reichow, Alan W., Hilla, Matthew Genar, Rezinas, Rick M.
• Primary Examiner(s): MANDEVILLE, JASON M
• Application Number:
  US12/534,605
• Publication Number:
  US 20110025611A1
• Time in Patent Office: 2,143 Days
• Field of Search: 345 7- 9, 351/203, 351/209, 351/200, 351/218, 351/222, 351/223, 715/700
• US Class Current: 1/1
• CPC Class Codes: A61B 3/0016 Operational features thereof
• CPC Class Codes: A61B 3/0033 characterised by user input arrangements
• CPC Class Codes: A61B 3/0041 characterised by display arrangements
• CPC Class Codes: A61B 3/024 for determining the visual field, e.g. perimeter types
• CPC Class Codes: A61B 3/028 for testing visual acuity; for determination of refraction, e.g. phoropters
• CPC Class Codes: A61B 3/032 Devices for presenting test symbols or characters, e.g. test chart projectors A61B3/036 takes precedence
• CPC Class Codes: A61B 5/1124 Determining motor skills
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/4023 Evaluating sense of balance
• CPC Class Codes: A61H 2201/5046 Touch screens
• CPC Class Codes: A61H 5/00 Exercisers for the eyes
• CPC Class Codes: G16H 40/63 for local operation

Abstract

The present invention provides systems and methods for receiving an input to a sensory test or training activity by way of a touch-screen device. The touch-screen device receives instructions by way of a wireless communication protocol from a sensory testing and training device. The instructions may be comprised of a command to display a graphical element on the touch-screen device. As a result, the touch-screen device displays the graphical element on a display surface of the touch-screen device. Further, an input may be received from a subject in the form of a physical contact between the subject and the display surface of the touch-screen device. The input may be in response to a sensory test or a sensory training activity. Additionally, the touch-screen device communicates the input to the sensory training device utilizing a wireless communication protocol. In an additional embodiment, the touch-screen device provides feedback to a user.

Claims

1. A method for receiving an input to a vision sensory activity by way of a hand-held touch-screen device having memory and a processor, the method comprising:

displaying a first graphical element of the vision sensory activity at a first display on a sensory testing and training device, wherein the sensory testing and training device is a physically separate device from the touch-screen device, and wherein the first display is at a first distance from a user;

receiving instructions from the sensory testing and training device at the touch-screen device by way of a wireless communication protocol, wherein the instructions are comprised of a command to display a second graphical element of the vision sensory activity on the touch-screen device, wherein the touch screen device is at a second distance from the user, and the second graphical element is displayed on a display surface of the touch-screen device to aid the user in providing input,

wherein the display surface of the touch-screen device is functional to receive the input from the user in the form of a directional drag such that the display surface of the touch-screen device comprises an origin and one or more null input portions disposed between directional input portions to provide confidence that a sensed input has a particular intent, and wherein the directional input portions are associated with the directional drag and the null input portions are not associated with the directional drag;

receiving an input from the user that is engaged in a vision sensory test or a vision sensory training activity corresponding to the vision sensory activity, the input being in the form of a physical contact between the user and the display surface of the touch screen-device, wherein the input is in response to the vision sensory activity that involves at least the first graphical element displayed to the subject on the first display at the sensory testing and training device;

identifying the input as a directional drag based on a touch input that is maintained from a point of initial contact by the user to a subsequent point of contact by the user along an orthogonal axis corresponding to at least one of the directional input portions, wherein the point of initial contact by the user comprises the origin and a predefined radius extending from the initial point of contact in which no one portion is defined as being exclusive to an area inside the predefined radius; and

communicating the input to the sensory testing and training device utilizing the wireless communication protocol.

2. The method of claim 1 further comprises determining an intent associated with the input.

3. The method of claim 2, wherein the intent comprises one from the following:

an up indication,

a down indication,

a left indication, and

a right indication.

4. The method of claim 3, wherein the intent is determined based on the reception of the input within a predefined number of degrees from an intent direction.

5. The method of claim 3, wherein the intent is determined based on the reception of the input within about 7.5 degrees from an intent direction.

6. The method of claim 1, wherein the wireless communication protocol utilizes an Internet Protocol (IP) compatible protocol.

7. The method of claim 6, wherein the IP compatible protocol is compatible with a User Datagram Protocol (UDP).

8. The method of claim 1, wherein the input in response to the vision sensory activity visually presented by the sensory testing and training device, further comprises input from an accelerometer provided in the touch-screen device.

9. The method of claim 1, wherein the input is in response to a vision sensory activity visually presented by a combination of the touch-screen device and the sensory testing and training device.

10. A sensory testing and training system comprising:

a sensory testing and training device located at a first distance from a subject, the sensory testing and training device having a processor, a first display for displaying one or more graphical elements associated with a vision sensory activity, and memory for facilitating the vision sensory activity, wherein the sensory testing and training device is comprised of a wireless communication component for communicating with a physically separate hand-held touch-screen device;

the touch-screen device located at a second distance from the subject, wherein the second distance is less than the first distance, the touch-screen device having a processor and memory for receiving an input from the subject in response to the vision sensory activity involving at least the one or more graphical elements displayed to the subject on the first display, wherein the touch-screen device comprises a second display separate from the first display, and wherein the touch-screen device receives instructions from the sensory testing and training device by way of the wireless communication component to display another graphical element of the vision sensory activity on the second display, wherein the another graphical element is displayed on the second display to aid the subject in providing input;

wherein the second display is functional to receive the input from the subject in the form of a physical contact between the subject and the second display in response to the vision sensory activity, wherein the input is in the form of a directional drag such that the second display comprises an origin and one or more null input portions disposed between directional input portions to provide confidence that a sensed input has a particular intent, and wherein the directional input portions are associated with the directional drag and the null input portions are not associated with the directional drag; and

wherein the touch-screen device identifies the input as a directional drag based on a touch input that is maintained from a point of initial contact by the subject to a subsequent point of contact by the subject along an orthogonal axis corresponding to at least one of the directional input portions, wherein the point of initial contact by the subject comprises the origin and a predefined radius extending from the initial point of contact in which no one portion is defined as being exclusive to an area inside the predefined radius.

11. The system of claim 10, wherein the touch-screen device is functional to receive a multitouch input from the subject.

12. The system of claim 10, wherein the second display of the touch-screen device is a capacitive touch screen, wherein the capacitive touch screen is functional for receiving the input and displaying the another graphical element.

13. The system of claim 10, wherein the touch-screen device and the sensory testing and training device communicate utilizing a protocol compatible with Internet Protocol (IP).

14. The system of claim 10, wherein the touch-screen device and the sensory testing and training device communicate utilizing a User Datagram Protocol (UDP).

15. The system of claim 10, wherein the touch-screen device and the sensory testing and training device are separated by at least three feet.

16. The system of claim 10, wherein the sensory testing and training device is further comprised of:

a third display for displaying one or more graphical elements associated with the vision sensory activity, wherein the third display is moveably mounted to the sensory testing and training device; and

wherein either the first display or the third display present a graphical element to the subject as part of the vision sensory activity to which the subject provides an input by way of the touch-screen device.

17. One or more non-transitory computer-readable media having computer-executable instructions embodied thereon for wirelessly receiving an input in response to a vision sensory activity via a wireless communication protocol, the vision sensory activity involving at least a graphical element displayed to a subject on a sensory testing and training device and the input from the subject on a hand-held touch-screen device, the method comprising:

on a first display moveably mounted to the sensory testing and training device, physically separated from the touch-screen device and at a first distance from the subject, displaying to the subject the graphical element used in the vision sensory activity;

receiving instructions from the sensory testing and training device at the touch-screen device by way of the wireless communication protocol to display a second graphical element of the vision sensory activity on a second display of the touch-screen device, the second graphical element being displayed to aid the subject in providing input;

receiving the input from the subject at the touch-screen device, the touch-screen device at a second distance from the subject that is less than the first distance, wherein the second display is functional to receive the input from the subject in the form of a directional drag such that the second display comprises an origin and one or more null input portions disposed between directional input portions to provide confidence that a sensed input has a particular intent, and wherein the directional input portions are associated with the directional drag and the null input portions are not associated with the directional drag, wherein the input is a physical contact between the subject and the second display and the input is in response to the vision sensory activity that involves at least the first graphical element displayed to the subject on the first display at the sensory testing and training device, and wherein the input is identified as a directional drag based on a touch input that is maintained from a point of initial contact by the subject to a subsequent point of contact by the subject along an orthogonal axis corresponding to at least one of the directional input portions, wherein the point of initial contact comprises the origin and a predefined radius extending from the initial point of contact in which no one portion is defined as being exclusive to an area inside the predefined radius;

determining a command based on the input;

processing the command;

communicating a feedback to the touch-screen device, wherein the feedback is processed by the touch-screen device to provide visual, audible, or tactile feedback to the subject in response to the input; and

receiving a subsequent input from the subject, wherein the subsequent input is responsive to a displayed subsequent graphical element used in the vision sensory activity.

18. The media of claim 17, wherein the particular intent comprises one from the following:

an up indication,

a down indication,

a left indication, and

a right indication.

19. The media of claim 17, wherein the wireless communication protocol utilizes an Internet Protocol (IP) compatible protocol.