Method and system for conferencing using processing sensor

• US 7,293,240 B2
• Filed: 11/12/2002
• Issued: 11/06/2007
• Est. Priority Date: 06/30/1999
• Status: Expired due to Fees

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Lapstun, Paul, Silverbrook, Kia, Lapstun, Jacqueline Anne
• Primary Examiner(s): Cabeca, John
• Assistant Examiner(s): BASOM, BLAINE T
• Application Number:
  US10/291,510
• Publication Number:
  US 20030105817A1
• Time in Patent Office: 1,820 Days
• Field of Search: 715/751, 715/753, 715/511, 382/314, 382/317, 382/313, 382/312, 345/179, 709/204, 709/205, 709/206, 709/207, 235/454, 235/462.15, 235/375, 358/402, 178/18.01
• US Class Current: 715/753
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 20/3674 involving authentication
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 2209/56 Financial cryptography, e.g. electronic payment or e-cash
• CPC Class Codes: H04L 2209/608 Watermarking
• CPC Class Codes: H04L 2209/805 Lightweight hardware, e.g. radio-frequency identification [RFID] or sensor
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 9/3231 Biological data, e.g. fingerprint, voice or retina network architectures or network communication protocols for supporting authentication of entities using biometrical features in a packet data network H04L63/0861
• CPC Class Codes: H04M 3/567 Multimedia conference systems
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: Y10S 118/15 Roller structure

Abstract

The invention concerns a system and method for enabling remote conferencing between conference participants. Employing the invention involves the use of one or more forms which support interaction with a computer system or network. Each form is printed on sheet material such as paper and includes coded data which allows it to be used to interact with the computer system via a sensing device operated by a user.

Specifically, the method includes the steps of providing a participant with at least one conferencing form containing information relating to a remote conferencing session and including coded data indicative of an identity of the conferencing form and of at least one reference point of the conferencing form, receiving, in a computer system, indicating data from a sensing device operated by said conference participant involved in the conference session, said indicating data regarding the identity of the conferencing form and a position of the sensing device relative to the conferencing form, the sensing device, when placed in an operative position relative to the conferencing form, sensing the indicating data using at least some of the coded data, identifying in the computer system and from the indicating data, at least one parameter relating to the conferencing session, and providing at least one other conference participant remote from said conference participant with at least one conferencing form containing information representative of the at least one parameter.

The invention can be employed by geographically distributed participants to communicate graphical ideas via a shared ‘whiteboard’ using interactive surface media while engaged in a telephone conference. Every time a participant adds a modification or a new diagram to the whiteboard, the other participants can be provided with a printed copy of the updated page.

Claims

1. A method of enabling remote conferencing between conference participants, the method including the steps of:

providing a participant with at least one conferencing form containing information relating to a remote conferencing session and including coded data indicative of an identity of the conferencing form and of at least one reference point of the conferencing form;

receiving, in a computer system, indicating data from a sensing device operated by said conference participant involved in the conference session, said indicating data regarding the identity of the conferencing form and at least one of a position and a movement of the sensing device relative to the conferencing form;

identifying in the computer system and from the indicating data, at least one parameter relating to the conferencing session; and

providing at least one other conference participant remote from said conference participant with at least one recipient conferencing form containing information representative of the at least one parameter and including coded data indicative of an identity of the recipient conferencing form, the identity of the recipient conferencing form being different from the identity of the conferencing form,

wherein the sensing device comprises;

(a) an image sensor adapted to capture images of at least some of the coded data when the sensing device is placed in an operative position relative to the form; and

(b) a processor adapted to;

(i) identify at least some of the coded data from one or more of the captured images;

(ii) determine an orientation, within the captured images, of at least some of the coded data;

(iii) decode at least some of the coded data; and

(iv) generate the indicating data using at least some of the decoded coded data.

2. The method of claim 1 in which said at least one parameter relating to the conferencing session is associated with at least one zone of the conferencing form, and in which the method includes identifying, in the computer system and from the zone relative to which the sensing device is positioned or moved, said at least one parameter.

3. The method of claim 1, in which the parameter is an action parameter of the remote conferencing session, the method including effecting, in the computer system, an operation in respect of the action parameter.

4. The method of claim 3, in which the action parameter of the remote conferencing session is selected from the group comprising:

sending an invitation to a conference session;

starting a conference session;

ending a conference session;

viewing the history of a conference session;

sending a message to a participant during a conference session;

viewing messages sent during a conference session;

ordering the printing of a palette of available line styles and colors;

ordering the printing of a whiteboard page;

updating a whiteboard page; and

ordering the reprinting of a new whiteboard page.

5. A method of claim 1, wherein the processor is housed within the sensing device.

6. The method of claim 1, wherein the processor is adapted to operate at processing speeds ranging from 1 instruction per second to 1×

10¹² instructions per second.

7. The method of claim 6 wherein the processor is adapted to operate at processing speeds ranging from 10 instructions per second to 1×

10⁶ instructions per second.

8. The method of claim 1, wherein the image sensor is housed within the sensing device.

9. The method of claim 1, wherein the image sensor is adapted to capture images at rates ranging from 1 image per second to 1,000 images per second.

10. The method of claim 9 wherein the image sensor is adapted to capture images at rates ranging from 10 images per second to 200 images per second.

11. The method of claim 1, wherein the coded data comprises non-barcode coded data.

12. The method of claim 1 in which the parameter is an option parameter of the remote conferencing session, the method including identifying, in the computer system, that the participant has entered a hand-drawn mark by means of a sensing device and effecting, in the computer system, an operation associated with the option parameter.

13. The method of claim 12 in which the option parameter is associated with at least one of:

an access level;

a message recipient;

a line style; and

a line color.

14. The method of claim 1 in which the parameter is a text parameter of the remote conferencing session, the method including identifying, in the computer system, that the participant has entered handwritten text data by means of the sensing device and effecting, in the computer system, an operation associated with the text parameter.

15. The method of claim 14 which includes converting, in the computer system, the handwritten text data to computer text.

16. The method of claim 15 which includes converting, in the computer system, the handwritten text data to computer text using an online handwriting recognition program.

17. The method of claim 14 in which the text parameter is associated with at least one of:

a session description;

a conference start date;

a start time;

an end time;

a participant identification;

a conference session purpose;

a message subject description; and

a message text.

18. The method of claim 1 in which the parameter is an authorization parameter of the remote conferencing session, the method including identifying, in the computer system, that the participant has entered a handwritten signature by means of the sensing device and effecting, in the computer system, an operation associated with the authorization parameter.

19. The method of claim 18 which includes verifying, in the computer system, that the signature is that of the participant.

20. The method of claim 19 in which the authorization parameter is associated with updating a whiteboard page.

21. The method of claim 1 in which the parameter is a graphical parameter of the remote conferencing session, the method including identifying, in the computer system, that the participant has entered hand-drawn graphical information by means of the sensing device and effecting, in the computer system, an operation associated with the graphical parameter.

22. The method of claim 21 in which the graphical parameter is associated with a markup to a whiteboard page.

23. The method of claim 1 in which at least one of the one or more conferencing forms contains information relating to at least one of:

booking a conference session;

cancelling a conference session;

controlling a conference session;

selecting invitees to a conference session;

inviting participants to a conference session;

composing messages in a conference session;

sending messages in a conference session;

viewing messages in a conference session;

printing a palette of available line styles and colors in a conference session;

selecting a line style and color in a conference session;

viewing the history of a conference session;

printing whiteboard pages;

updating whiteboard pages;

reprinting whiteboard pages;

pasting content to whiteboard pages; and

ending a conference session.

24. The method of claim 1 in which the conference participants are provided with a telephone communicator for simultaneous use during the remote conferencing session.

25. A system for enabling remote conferencing between conference participants, the system including:

at least one conferencing form containing information relating to a remote conferencing session and including coded data indicative of an identity of the conferencing form and of at least one reference point of the conferencing form;

a computer system for receiving indicating data from a sensing device operated by a conference participant involved in the conference session, said indicating data regarding the identity of the conferencing form and at least one of a position and a movement of the sensing device relative to the conferencing form, said computer system including means for identifying, from the indicating data, at least one parameter relating to the conferencing session; and

a provider for providing at least one other conference participant remote from said conference participant with at least one recipient conferencing form, containing information representative of the at least one parameter and including coded data indicative of an identity of the recipient conferencing form, the identity of the recipient conferencing form being different from the identity of the conferencing form,

wherein the sensing device comprises;

(a) an image sensor adapted to capture images of at least some of the coded data when the sensing device is placed in an operative position relative to the form; and

(b) a processor adapted to;

(i) identify at least some of the coded data from one or more of the captured images;

(ii) determine an orientation, within the captured images, of at least some of the coded data;

(iii) decode at least some of the coded data; and

(iv) generate the indicating data using at least some of the decoded coded data.

26. The system of claim 25 in which said at least one parameter relating to the conferencing session is associated with at least one zone of the conferencing form.

27. The system of claim 26, wherein the image sensor is housed within the sensing device.

28. The system of claim 26, wherein the image sensor is adapted to capture images at rates ranging from 1 image per second to 1,000 images per second.

29. The system of claim 28 wherein the image sensor is adapted to capture images at rates ranging from 10 images per second to 200 images per second.

30. The system of claim 26, wherein the coded data comprises non-barcode coded data.

31. The system of claim 25 including the sensing device, the sensing device sensing at least one of the movement and the position of the sensing device relative to the conferencing form, using at least some of the coded data.

32. A system of claim 25, wherein the processor is housed within the sensing device.

33. The system of claim 25, wherein the processor is adapted to operate at processing speeds ranging from 1 instruction per second to 1×

10¹² instructions per second.

34. The system of claim 33 wherein the processor is adapted to operate at processing speeds ranging from 10 instructions per second to 1×

10₆ instructions per second.

35. The system of claim 25 including the sensing device.

36. The system of claim 25 in which said at least one parameter of the conference session is selected from the group comprising an action parameter of the conference session, an option parameter of the conference session, a text parameter of the conference session, an authorization parameter of the conference session, and a graphical parameter of the conference session.

37. The system of claim 36 in which the action parameter of the conference session is selected from the group comprising:

sending an invitation to a conference session;

starting a conference session;

ending a conference session;

viewing the history of a conference session;

sending a message to a participant during a conference session;

viewing messages sent during a conference session;

ordering the printing of a palette of available line styles and colors;

ordering the printing of a new whiteboard page;

updating a whiteboard page; and

ordering the reprinting of a whiteboard page.

38. The system of claim 36 in which the option parameter is associated with at least one of:

an access level;

a message recipient;

a line style; and

a line color.

39. The system of claim 36 in which the text parameter is associated with at least one of:

a session description;

a conference start date;

a start time;

an end time;

a participant identification;

a conference session purpose;

a message subject description; and

a message text.

40. The system of claim 36 in which the authorization parameter is associated with updating a whiteboard page.

41. The system of claim 36 in which the graphical parameter is associated with a markup to a whiteboard page.

42. The system of claim 25, including a telephone communicator for simultaneous use during the remote conferencing session.