Synchronized transmission of recorded writing data with audio

• US 20020054026A1
• Filed: 04/17/2001
• Published: 05/09/2002
• Est. Priority Date: 04/17/2000
• Status: Abandoned Application

• Current Assignee: Ashley Woodsom, Bradley Stevenson, Dan Winkler, Travell Perkins
• Original Assignee: Ashley Woodsom, Bradley Stevenson, Dan Winkler, Travell Perkins
• Inventors: Woodsom, Ashley, Perkins, Travell, Stevenson, Bradley, Winkler, Dan
• Application Number:
  US09/836,877
• Publication Number:
  US 20020054026A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L

Abstract

A method is provided for recording writing and audio from a writing session in a manner such that a depiction of the writing can be replayed in a synchronized fashion with the audio, the method comprising: recording movement of a writing element relative to a writing surface during a writing session using a writing capture device which produces writing data corresponding to positions of the writing element relative to the writing surface at sampled points in time; recording audio present during the writing session using an audio capture device to form audio data; associating time stamps with the writing and audio data; forming stroke vector data from the writing data by grouping the writing data into groups of temporally proximate writing data points based on the time stamps associated with the writing data, each group of temporally proximate writing data points defining a stroke vector that reflects a direction and magnitude of movement of the writing element relative to the writing surface over a period of time spanned by the writing data points in the group; and storing the time stamped stroke vector data and time stamped audio data to memory.

Claims

1. A method for recording writing and audio from a writing session in a manner such that a depiction of the writing can be replayed in a synchronized fashion with the audio, the method comprising:

recording movement of a writing element relative to a writing surface during a writing session using a writing capture device which produces writing data corresponding to positions of the writing element relative to the writing surface at sampled points in time;

recording audio present during the writing session using an audio capture device to form audio data;

associating time stamps with the writing and audio data;

forming stroke vector data from the writing data by grouping the writing data into groups of temporally proximate writing data points based on the time stamps associated with the writing data, each group of temporally proximate writing data points defining a stroke vector that reflects a direction and magnitude of movement of the writing element relative to the writing surface over a period of time spanned by the writing data points in the group; and

storing the time stamped stroke vector data and time stamped audio data to memory.

2. A method according to claim 1 wherein the stroke vector data is stored in a compressed format.

3. A method according to claim 1 wherein the stroke vector data is stored in a compressed loss less format.

4. A method according to claim 1 wherein each stroke vector comprises temporally proximate writing data points spanning a time period of less than 5000 ms.

5. A method according to claim 1 wherein each stroke vector comprises temporally proximate writing data points spanning a time period of less than 2500 ms.

6. A method according to claim 1 wherein each stroke vector comprises temporally proximate writing data points spanning a time period of less than 1000 ms.

7. A method according to claim 1 wherein each stroke vector comprises temporally proximate writing data points spanning a time period of less than 500 ms.

8. A method according to claim 1 further comprising storing information regarding the writing session selected from the group consisting of writing attributes, writing speed, writing surface size, and pen pressure.

9. A method according to claim 1 wherein a same time source is used to time stamp the writing and audio data.

10. A method according to claim 1 wherein the writing data is sampled at a rate of at least 40 points per/second.

11. A method according to claim 1 wherein the writing data is sampled at a rate of at least 60 points per/second.

12. A method according to claim 1 wherein the writing data is sampled at a rate of at least 80 points per/second.

14. A method according to claim 13 wherein each stroke vector comprises temporally proximate writing data points spanning a time period of less than 5000 ms.

15. A method according to claim 1 wherein each stroke vector comprises temporally proximate writing data points spanning a time period of less than 2500 ms.

16. A method according to claim 13 wherein each stroke vector comprises temporally proximate writing data points spanning a time period of less than 1000 ms.

17. A method according to claim 13 wherein each stroke vector comprises temporally proximate writing data points spanning a time period of less than 500 ms.

18. A method according to claim 13 further comprising displaying the depiction of writing on the writing surface based on information regarding the writing session selected from the group consisting of writing attributes, writing speed, writing surface size, and pen pressure.

19. A method according to claim 13 wherein a same time source is used to time stamp the writing and audio data.

20. A method according to claim 13 wherein the writing data is sampled at a rate of at least 40 points per/second.

21. A method according to claim 13 wherein the writing data is sampled at a rate of at least 60 points per/second.

22. A method according to claim 13 wherein the writing data is sampled at a rate of at least 80 points per/second.

24. A method according to claim 23 wherein the stroke vector data is transmitted in a compressed format.

25. A method according to claim 23 wherein the stroke vector data is transmitted in a compressed loss less format.

26. A method according to claim 23 wherein each stroke vector comprises temporally proximate writing data points spanning a time period of less than 5000 ms.

27. A method according to claim 23 wherein each stroke vector comprises temporally proximate writing data points spanning a time period of less than 2500 ms.

28. A method according to claim 23 wherein each stroke vector comprises temporally proximate writing data points spanning a time period of less than 1000 ms.

29. A method according to claim 23 wherein each stroke vector comprises temporally proximate writing data points spanning a time period of less than 500 ms.

30. A method according to claim 23 further comprising displaying the depiction of writing on the writing surface based on information regarding the writing session selected from the group consisting of writing attributes, writing speed, writing surface size, and pen pressure.

31. A method according to claim 23 wherein a same time source is used to time stamp the writing and audio data.

32. A method according to claim 23 wherein the writing data is sampled at a rate of at least 40 points per/second.

33. A method according to claim 23 wherein the writing data is sampled at a rate of at least 60 points per/second.

34. A method according to claim 23 wherein the writing data is sampled at a rate of at least 80 points per/second.

35. A method according to claim 23 wherein the depiction of writing is displayed at the remote location in combination with the audio in real time relative to the writing.

36. A method according to claim 23 wherein a same time source is used to time stamp the writing and audio data.

37. A method according to claim 23 wherein the stroke data and audio data are transmitted as two separate data streams.

38. A method according to claim 23 wherein the stroke data and audio data are transmitted as a single data stream.

39. A method according to claim 23 wherein the stroke data and audio data are transmitted over a network.

13. A method for recording writing and audio from a writing session in a manner such that a depiction of the writing can be replayed in a synchronized fashion with the audio, the method comprising:

recording movement of a writing element relative to a writing surface during a writing session using a writing capture device which produces writing data corresponding to positions of the writing element relative to the writing surface at sampled points in time;

recording audio present during the writing session using an audio capture device to form audio data;

associating time stamps with the writing and audio data;

forming stroke vector data from the writing data by grouping the writing data into groups of temporally proximate writing data points based on the time stamps associated with the writing data, each group of temporally proximate writing data points defining a stroke vector that reflects a direction and magnitude of movement of the writing element relative to the writing surface over a period of time spanned by the writing data points in the group; and

displaying a depiction of writing on the writing surface over time based on the stroke data in combination with producing audio from the audio data where the time stamps associated with the writing and audio data are used to synchronize the displayed depiction of writing on the writing surface with the produced audio.

23. A method for recording writing and audio from a writing session in a manner such that a depiction of the writing can be replayed in a synchronized fashion with the audio, the method comprising:

recording movement of a writing element relative to a writing surface during a writing session using a writing capture device which produces writing data corresponding to positions of the writing element relative to the writing surface at sampled points in time;

recording audio present during the writing session using an audio capture device to form audio data;

associating time stamps with the writing and audio data;

forming stroke vector data from the writing data by grouping the writing data into groups of temporally proximate writing data points based on the time stamps associated with the writing data, each group of temporally proximate writing data points defining a stroke vector that reflects a direction and magnitude of movement of the writing element relative to the writing surface over a period of time spanned by the writing data points in the group;

transmitting the stroke vector data and the audio data to a location remote relative to the writing session; and

displaying at the remote location a depiction of writing on the writing surface over time based on the stroke data in combination with producing audio from the audio data where the time stamps associated with the writing and audio data are used to synchronize the displayed depiction of writing on the writing surface with the produced audio.