Method and system for spatial accessing of time-based information

• US 5,461,711 A
• Filed: 12/22/1993
• Issued: 10/24/1995
• Est. Priority Date: 12/22/1993
• Status: Expired due to Term

• Current Assignee: Vulcan Patents LLC
• Original Assignee: Interval Research Corporation
• Inventors: Wang, Weijia, White, Sean M.
• Primary Examiner(s): Bayerl, Raymond J.
• Application Number:
  US08/172,637
• Time in Patent Office: 671 Days
• Field of Search: 395/155, 395/154, 395/161, 395/152, 395/119, 395/160, 395/159, 345/173, 345/156, 345/179, 345/180
• US Class Current: 715/720
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: Y10S 715/97 Instrumentation and component modelling, e.g. interactive control panel

Abstract

A method and system for accessing time-based information based on spatial coordinate information obtained from a user. Time-based information is mapped into a spatial representation by mapping and transforming the timing of time-based information segments to spatial coordinates. Such spatial coordinates could be either one, two, or three dimensional. With this mapping, segments of time-based information can be associated with different parts of a spatial object, a spatial representation, or different position of a spatial movement. These segments can be accessed by the user by physical inputs in such a fashion that the kinesthetic or touching memory of the user can be relied upon to re-access information and to create a sense of the whole in the information.

Claims

1. A method for permitting a user to spatially access and play back time-based information having a plurality of segments, the method comprising the steps of:

(a) mapping each of the plurality of segments of the time-based information to a corresponding one of a plurality of mapped spatial coordinates;

(b) determining an input spatial coordinate corresponding to a first physical input of the user generated by a movement of a portion of the user'"'"'s body to a first position;

(c) accessing a first segment of the time-based information whose mapped spatial coordinate corresponds to the input spatial coordinate; and

(d) playing-back the accessed first segment of time-based information;

wherein steps (b), (c), and (d) are repeated so that a speed of playback of the time-based information is governed by a speed of the movement of the portion of the user'"'"'s body, and wherein, after the portion of the user'"'"'s body has moved to a second position, a human spatial memory of the user can be used to return the portion of the body to the first position to re-access and play back the first segment of time-based information by repeating steps (b), (c), and (d).

2. The method of claim 1 wherein the step of mapping includes assigning a sequence of corresponding timing marks to the time-based information which denote the passage of time in the time-based information, forming the plurality of segments based on the sequence of timing marks, and mapping each of the sequence of timing marks into a corresponding one of the plurality of mapped spatial coordinates.

3. The method of claim 2 wherein the step of accessing a first segment of time-based information includes comparing the input spatial coordinate to one or more of the plurality of mapped spatial coordinates to identify a mapped spatial coordinate which corresponds to the input spatial coordinate.

4. The method of claim 3 wherein the step of accessing a first segment of time-based information further includes identifying the first segment from the plurality of segments of time-based information by identifying the segment which corresponds to the matched mapped spatial coordinate based on the timing mark mapped to the corresponding mapped spatial coordinate.

5. The method of claim 2 wherein the time-based information includes visual information.

6. The method of claim 2 wherein the time-based information includes audio information.

7. The method of claim 6 wherein the audio information includes speech.

8. The method of claim 7 wherein the sequence of timing marks is determined based upon the structure of the speech.

9. The method of claim 7 wherein the sequence of timing marks is equally spaced in time.

10. The method of claim 2 wherein the mapped spatial coordinates are expressed in a Cartesian coordinate system.

11. The method of claim 2 wherein the mapped spatial coordinates are expressed in a non-Cartesian coordinate system.

12. The method of claim 2 wherein the mapped spatial coordinates are in a two-dimensional space.

13. The method of claim 12 wherein the mapping of the sequence of timing marks into a plurality of two-dimensional mapped spatial coordinates includes grouping a sequential subset of the sequence of timing marks into adjacent spatial coordinates.

14. The method of claim 13 wherein the step of playing-back the accessed first segment of time-based information further includes sensory output of the first segment in a manner which differs in form from the original form of the time-based information.

15. The method of claim 14 wherein the sensory output is in the form of a tactile output for sensing by the portion of the user'"'"'s body.

16. The method of claim 2 wherein the mapped spatial coordinates are in three-dimensional space.

17. The method of claim 1 wherein the step of determining a spatial input coordinate includes determining the orientation of the portion the user'"'"'s body.

18. The method of claim 1 wherein the step of determining an input spatial coordinate includes sensing the coordinates of a tactile pressure generated by the portion of the user'"'"'s body on a surface.

19. The method of claim 1 wherein the step of determining an input spatial coordinate includes sensing a velocity of the portion of the user'"'"'s body, wherein the input spatial coordinate is based upon the velocity.

20. The method of claim 1 wherein the step of determining an input spatial coordinate includes sensing an acceleration of the portion of the user'"'"'s body, wherein the input spatial coordinate is based upon the acceleration.

21. The method of claim 1 wherein the step of determining an input spatial coordinate includes sensing the coordinates of a temperature increase generated by the portion of the user'"'"'s body on a surface.

22. The method of claim 1 wherein the step of playing-back the accessed first segment of time-based information includes sensory output of the first segment in a manner which emulates the form of the original form of the time-based information.

43. The system of claim 22 wherein the playback device further includes means for playing-back sensory output of the first segment in a manner which differs in form from the original form of the time-based information.

44. The system of claim 43 wherein the sensory output is in the form of a tactile output for sensing by the portion of the user'"'"'s body.

23. A system for permitting a user to spatially access and play back time-based information having a plurality of segments, the system comprising:

a timing-to-spatial converter for mapping each of the plurality of segments of the time-based information to a corresponding one of a plurality of mapped spatial coordinates;

a user interface device operatively associated with the user so as to determine a input spatial coordinate corresponding to a first physical input generated by a movement of a portion of the user'"'"'s body to a first position;

a spatial access device, in communication with the user interface device, for accessing a first segment of the time-based information whose mapped spatial coordinate corresponds to the input spatial coordinate; and

a playback device, in communication with the spatial access device for playing-back the accessed first segment of time-based information, wherein a speed of playback of the time-based information is governed by a speed of the movement of the portion of the user'"'"'s body;

wherein, after the portion of the user'"'"'s body has moved to a second position, a human spatial memory of the user can be used to return the portion of the user'"'"'s body to the first position to re-access the first segment of time-based information.

24. The system of claim 23 wherein the timing-to-spatial converter includes means for assigning a sequence of corresponding timing marks to the time-based information which denote the passage of time in the time-based information, forming the plurality of segments based on the timing marks, and means for mapping each of the sequence of timing marks into a corresponding one of a plurality of mapped spatial coordinates.

25. The system of claim 24 wherein the spatial access device includes comparing means for comparing the input spatial coordinate to one or more of the plurality of mapped spatial coordinates to identify a mapped spatial coordinate which corresponds to the input spatial coordinate.

26. The system of claim 25 wherein the spatial access device further includes identifying means for identifying the first segment from the plurality of segments of time-based information by identifying the segment which corresponds to the matched mapped spatial coordinate based on the timing mark mapped to the corresponding mapped spatial coordinate.

27. The system of claim 25 wherein the time-based information includes visual information.

28. The system of claim 25 wherein the time-based information includes audio information.

29. The system of claim 28 wherein the audio information includes speech.

30. The system of claim 29 wherein the sequence of timing marks is determined based upon the structure of the speech.

31. The system of claim 29 wherein the sequence of timing marks is equally spaced in time.

32. The system of claim 25 wherein the mapped spatial coordinates are expressed in a non-Cartesian coordinate system.

33. The system of claim 25 wherein the mapped spatial coordinates are expressed in a Cartesian coordinate system.

34. The system of claim 25 wherein the mapped spatial coordinates are in a two-dimensional space.

35. The system of claim 33 wherein the mapping of the sequence of timing marks into a plurality of two-dimensional mapped spatial coordinates includes grouping a sequential subset of the sequence of timing marks into adjacent mapped spatial coordinates.

36. The system of claim 35 wherein the user interface device includes determination means for determining the orientation of the portion of the user'"'"'s body.

37. The system of claim 25 wherein the mapped spatial coordinates are in a three-dimensional space.

38. The system of claim 23 wherein the user interface device includes means for sensing the coordinates of a tactile pressure generated by the portion of the user'"'"'s body on a surface.

39. The system of claim 23 wherein the user interface device includes means for sensing a velocity of the portion of the user'"'"'s body.

40. The system of claim 23 wherein the user interface device includes means for sensing an acceleration of the portion of the user'"'"'s body.

41. The system of claim 23 wherein the user interface device includes means for sensing the coordinates of a temperature increase generated by the portion of the user'"'"'s body on a surface.

42. The system of claim 23 wherein the playback device includes means for playing-back sensory output of the first segment in a manner which emulates the form of the original form of the time-based information.