Method of associating audio with a position on a surface

• US 7,533,816 B2
• Filed: 10/02/2007
• Issued: 05/19/2009
• Est. Priority Date: 11/25/2000
• Status: Expired due to Fees

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Lapstun, Paul, Silverbrook, Kia
• Primary Examiner(s): Hess, Daniel A
• Application Number:
  US11/866,313
• Publication Number:
  US 20080017713A1
• Time in Patent Office: 595 Days
• Field of Search: 235/454, 235/494, 386/69
• US Class Current: 235/454
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1656 Details related to functional adaptations of the enclosure, e.g. to provide protection against EMI, shock, water, or to host detachable peripherals like a mouse or removable expansions units like PCMCIA cards, or to provide access to internal components for maintenance or to removable storage supports like CDs or DVDs, or to mechanically mount accessories mounting of accessories to a computer display G06F1/1607; display hoods G06F1/1603; cooling arrangements for portable computers G06F1/203
• CPC Class Codes: G06F 1/166 related to integrated arrangements for adjusting the position of the main body with respect to the supporting surface, e.g. legs for adjusting the tilt angle
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/1688 the I/O peripheral being integrated loudspeakers
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

A method of enabling recorded video to be associated with a location on a surface is provided. The surface has coded data printed thereon, which is indicative of a plurality of locations on the surface. The method comprises the steps of: interacting with the surface using an optical sensing device comprising a video camera; recording video using the video camera; reading some of the coded data during the interaction; determining a position of the sensing device using the read coded data; and communicating, to a computer system, position data indicative of the position of the sensing device and video data corresponding to the recorded video, thereby enabling the computer system to associate the video data with the position.

Claims

1. A method of enabling recorded video to be associated with a position on a surface, said surface having coded data printed thereon, said coded data being indicative of a plurality of locations on the surface, said method comprising the steps of:

interacting with the surface using a handheld video player incorporating an optical sensor for reading the coded data and a video camera for recording video;

reading at least some of the coded data;

initiating recording of video by actuating a button on the handheld video player;

determining a position of the handheld video player using the read coded data; and

communicating, to a computer system, position data indicative of the position of the handheld video player and video data corresponding to said recorded video, thereby enabling said computer system to associate said video data with said position.

2. The method of claim 1, wherein said computer system is remote from said handheld video player.

3. The method of claim 1, wherein said position data and said video data are transmitted to said computer system via wireless communication.

4. The method of claim 1, wherein said handheld video player is an optically imaging pen.

5. The method of claim 1, wherein said handheld video player comprises a marking nib.

6. The method of claim 5, wherein said interaction is with a zone of said surface, and said method further comprises the step of:

marking said zone using said marking nib during interaction with said zone.

7. The method of claim 6, wherein said marking identifies said recorded video.

8. The method of claim 1, wherein said handheld video player comprises a display for video playback.

9. The method of claim 8, further comprising the step of:

playing back said recorded video.

10. The method of claim 9, wherein playing back said recorded video comprises the steps of:

interacting with said surface using said optical handheld video player;

reading at least some of the coded data;

determining a position of the handheld video player using the read coded data;

communicating position data to the computer system;

receiving video data associated with said position from said computer system; and

playing the video data.

11. The method of claim 10, wherein the interaction is with a zone of the surface, said zone comprising a user-written mark identifying said recorded video.

12. The method of claim 1, wherein the computer system stores in a memory the association between the position and the video data.

13. The method of claim 1, wherein said coded data is indicative of an identity of the surface, and said method comprises the step of:

communicating, to the computer system, identity data indicative of the identity of the surface.

14. The method as claimed in claim 1, wherein said coded data is printed as a plurality of tags, each tag identifying the identity of the surface and the location of the tag on the surface.

15. A system for enabling recorded video to be associated with a position on a surface, said system comprising:

a surface having coded data printed thereon, said coded data being indicative of a plurality of locations on the surface; and

an optical sensing device for interacting with the surface, said sensing device comprising;

a video camera for recording video;

an image sensor for reading at least some of the coded data during interaction with the surface

a processor for determining a position of the sensing device using the read coded data; and

means for communicating, to a computer system, position data indicative of the position of the sensing device and video data corresponding to said recorded video, thereby enabling said computer system to associate said video data with said position.

16. The system of claim 15, further comprising the computer system, wherein the computer system is configured for:

receiving the position data and the video data from the sensing device; and

storing, in a memory, an association between the video data and the position.

17. An optical sensing device for interacting with a surface and enabling recorded video to be associated with a position on the surface, said surface having coded data printed thereon, said coded data being indicative of a plurality of locations on the surface, said sensing device comprising:

a video camera for recording video;

an image sensor for reading at least some of the coded data during interaction with the surface;

a processor for determining a position of the sensing device using the read coded data; and

means for communicating, to a computer system, position data indicative of the position of the sensing device and video data corresponding to said recorded video, thereby enabling said computer system to associate said video data with said position.

18. The sensing device of claim 17, wherein said sensing device is a pen comprising a marking nib.

19. The sensing device of claim 18, further comprising a display for video playback.