Video conferencing with shared drawing

• US 8,698,873 B2
• Filed: 03/07/2011
• Issued: 04/15/2014
• Est. Priority Date: 03/07/2011
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Barrus, John
• Primary Examiner(s): Gauthier, Gerald
• Application Number:
  US13/041,838
• Publication Number:
  US 20120229590A1
• Time in Patent Office: 1,135 Days
• Field of Search: 250/221, 345/156, 345/158, 345/173, 345/179, 345/433, 345/582, 345/629, 348/14.01, 348/14.08, 348/333.02, 348/148, 348/207.1, 709/204, 713/182, 713/300, 713/163, 347/109, 375/240.16, 380/279, 382/154, 382/241, 434/408, 701/209, 701/431, 715/230, 715/733, 715/735, 715/751
• US Class Current: 348/14.08
• CPC Class Codes: G06Q 10/101 Collaborative creation, e.g. joint development of products or services
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Techniques for enabling video conferencing with interactive sharing of drawings and/or other information. In one set of embodiments, a system is provided that includes a drawing surface, a video camera embedded or integrated into the drawing surface, and a front projector. The drawing surface can capture drawings made on the surface by a user, and the video camera can capture a video stream of the user. The system can send digital information representing the captured drawings and the video stream to a remote system. The system can also receive digital information representing drawings made by a remote user and a video stream of the remote user from the remote system. The front projector can project a video signal onto the drawing surface that incorporates the captured drawings, the drawings made by the remote user, and the video stream of the remote user.

Claims

1. A collaborative system comprising:

a drawing surface configured to capture drawings made on the drawing surface by a first user;

a video camera embedded in the drawing surface, the video camera configured to capture a first video stream of the first user;

a controller configured to;

generate, based on information received from the drawing surface, first digital information representing the captured drawings;

transmit, to a remote collaborative system, the first digital information and the first video stream; and

receive, from the remote collaborative system, a second video stream of a second user; and

a projector positioned in front of the drawing surface, the projector configured to project onto the drawing surface a video signal including the captured drawings and the second video stream.

2. The collaborative system of claim 1 wherein the projector has a throw ratio of less than 0.4.

3. The collaborative system of claim 1 wherein the projector is positioned within 60 inches of the drawing surface.

4. The collaborative system of claim 1 wherein the video camera is inset from a front plane of the drawing surface by less than 0.5 inches.

5. The collaborative system of claim 4 wherein, when projecting images onto to the drawing surface, the projector does not cast a substantial amount of light into the lens of the video camera.

6. The collaborative system of claim 1 wherein the controller is further configured to generate the video signal projected onto the drawing surface based on the first digital information and the first video stream.

7. The collaborative system of claim 6 wherein the controller is further configured to receive, from the remote collaborative system, second digital information representing drawings captured by the remote collaborative system.

8. The collaborative system of claim 7 wherein the controller is further configured to generate an updated video signal for projection onto the drawing surface based on the first digital information, the second video stream, and the second digital information, such that the updated video signal includes the drawings captured by the drawing surface, the second video stream, and the drawings captured by the remote collaborative system.

9. The collaborative system of claim 1 wherein, in the video signal, the captured drawings are laid over the second video stream.

10. The collaborative system of claim 1 wherein the second video stream is mirrored prior to being included in the video signal.

11. The collaborative system of claim 1 wherein the drawing surface is greater than 36 inches in width and greater than 24 inches in height.

12. The collaborative system of claim 1 wherein the drawing surface is less than 6 inches in depth.

13. The collaborative system of claim 1 wherein the drawing surface is configured to capture the drawings using one or more pressure or touch sensors.

14. The collaborative system of claim 1 further comprising a microphone configured to capture an audio stream within a vicinity of the collaborative system.

15. The collaborative system of claim 14 wherein the microphone is embedded in the drawing surface.

16. The collaborative system of claim 14 wherein the controller is further configured to transmit the audio stream to the remote collaborative system.

17. A method comprising:

receiving, by a computer system, information captured in response to drawings made by a first user on a drawing surface;

generating, by the computer system based on the received information, first digital information representing the drawings made by the first user;

receiving, by the computer system, a first video stream captured by a video camera embedded in the drawing surface;

transmitting, by the computer system, the first video stream and the first digital information to a remote system;

receiving, by the computer system from the remote system, a second video stream captured by the remote; and

generating, by the computer system, a video signal based on the first digital information and the second video stream, such that the video signal includes the drawings made by the first user and the second video stream,

wherein the video signal is projected onto the drawing surface using a front projector.

18. The method of claim 17 further comprising:

receiving, by the computer system from the remote system, second digital information representing drawings made by a second user of the remote system; and

generating, by the computer system, an updated video signal based on the first digital information, the second video stream, and the second digital information, such that the updated video signal includes the drawings made by the first user, the second video stream, and the drawings made by the second user,

wherein the updated video signal is projected onto the drawing surface using the front projector.

19. A non-transitory computer-readable storage medium having stored thereon program code executable by a processor, the program code comprising:

code that causes the processor to receive information captured in response to drawings made by a first user on a drawing surface;

code that causes the processor to generate, based on the received information, first digital information representing the drawings made by the first user;

code that causes the processor to receive a first video stream captured by a video camera embedded in the drawing surface;

code that causes the processor to transmit the first video stream and the first digital information to a remote system;

code that causes the processor to receive, from the remote system, a second video stream captured by the remote; and

code that causes the processor to generate a video signal based on the first electronic information and the second video stream, such that the video signal includes the drawings made by the first user and the second video stream,

wherein the video signal is projected onto the drawing surface using a front projector.

20. The non-transitory computer-readable storage medium of claim 19 wherein the program code further comprises:

code that causes the processor to receive, from the remote system, second digital information representing drawings made by a second user of the remote system; and

code that causes the processor to generate an updated video signal based on the first digital information, the second video stream, and the second digital information, such that the updated video signal includes the drawings made by the first user, the second video stream, and the drawings made by the second user,

wherein the updated video signal is projected onto the drawing surface using the front projector.