Automated wireless three-dimensional (3D) video conferencing via a tunerless television device

• US 20110109715A1
• Filed: 03/16/2010
• Published: 05/12/2011
• Est. Priority Date: 11/06/2009
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Nguyen, Andy, Asam, Aravind, Yu, Yang, Liu, Aixin, Nguyen, Djung, Patil, Abhishek, Jing, Xiangpeng, Saha, Dipendu, Hong, Seungwook
• Granted Patent: US 8,570,358 B2
• Time in Patent Office: Days
• US Class Current: 348/14.08
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

Automated wireless three-dimensional (3D) video conferencing is provided using a tunerless television device. A 3D video conference is automatically established with a wireless device capable of 3D video conferencing using a wireless communication interface of the tunerless television device. A first and a second two-dimensional (2D) video stream are received, using a camera interface module, from a first and a second video camera associated with the tunerless television device. A merged 3D video stream is created from the first 2D video stream and the second 2D video stream using a 3D video offload processing module operatively coupled to the camera interface module. The merged 3D video stream is sent to the wireless device using the wireless communication interface. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.

Claims

1. A method of automated wireless three-dimensional (3D) video conferencing via a tunerless television device, comprising:

automatically establishing, via a wireless communication interface of the tunerless television device, a 3D video conference with a wireless device capable of 3D video conferencing;

receiving, via a camera interface module, a first and a second two-dimensional (2D) video stream from a first and a second video camera associated with the tunerless television device;

creating, via a 3D video offload processing module operatively coupled to the camera interface module, a merged 3D video stream from the first 2D video stream and the second 2D video stream; and

sending the merged 3D video stream to the wireless device via the wireless communication interface.

2. The method according to claim 1, further comprising:

receiving a 3D video stream from the wireless device;

processing the received 3D video stream; and

rendering the processed 3D video stream via a display associated with the tunerless television device.

3. The method according to claim 1, where the automatically established 3D video conference comprises a 3D video conference established over a wireless mesh network connection between the tunerless television device and the wireless device.

4. The method according to claim 1, where automatically establishing, via the wireless communication interface of the tunerless television device, the 3D video conference with the wireless device capable of 3D video conferencing comprises:

detecting, via a wireless connection associated with the wireless communication interface, the wireless device;

initiating 3D video conferencing initiation signaling with the wireless device; and

receiving 3D video conferencing confirmation signaling from the wireless device.

5. The method according to claim 1, where automatically establishing, via the wireless communication interface of the tunerless television device, the 3D video conference with the wireless device capable of 3D video conferencing comprises:

detecting a request to initiate the 3D video conference via a user remote control device comprising a selected contact from a contact list that is associated with the wireless device; and

automatically establishing the 3D video conference with the wireless device in response to the request to initiate the 3D video conference via the user remote control.

6. The method according to claim 1, where automatically establishing, via the wireless communication interface of the tunerless television device, the 3D video conference with the wireless device capable of 3D video conferencing comprises:

receiving a request to initiate an automated 3D video conference from the wireless device;

determining whether the wireless device is authorized for automated 3D video conferencing; and

automatically establishing the 3D video conference in response to determining that the wireless device is authorized for automated 3D video conferencing.

7. The method according to claim 1, where automatically establishing, via the wireless communication interface of the tunerless television device, the 3D video conference with the wireless device capable of 3D video conferencing comprises:

receiving a text message from the wireless device;

determining whether the text message is from a user within a contact list associated with the tunerless television device that is authorized for automated 3D video conferencing; and

automatically establishing the 3D video conference in response to determining that the text message is from the user within the contact list associated with the tunerless television device that is authorized for automated 3D video conferencing.

8. The method according to claim 1, where automatically establishing, via the wireless communication interface of the tunerless television device, the 3D video conference with the wireless device capable of 3D video conferencing comprises:

detecting a contact name selection from a contact list of 3D video conferencing contacts and text input associated with a text message from a wireless text input device associated with the tunerless television device;

determining that the wireless device is associated with the selected contact name;

automatically determining a wireless connection status of the wireless device;

sending an automated 3D conference request text message to the wireless device in response to determining the wireless device is active; and

automatically establishing the 3D video conference in response to receipt of a confirmation text message from the wireless device.

9. The method according to claim 8, where the wireless text input device comprises one of a wireless keyboard and a mobile phone configured to communicate with the tunerless television device via the wireless communication interface.

10. The method according to claim 1, where automatically establishing, via the wireless communication interface of the tunerless television device, the 3D video conference with the wireless device capable of 3D video conferencing comprises:

searching for wireless devices via a wireless connection associated with the wireless communication interface that are authorized for automated 3D video conferencing;

determining that the wireless device is active and is authorized for automated 3D video conferencing; and

automatically establishing the 3D video conference.

11. The method according to claim 1, further comprising providing a default display screen via a display of the tunerless television device, where the default display screen comprises an option for 3D video conferencing.

12. The method according to claim 11, further comprising:

receiving a request to customize the default display screen with an Internet address for default access to content available via the Internet address; and

adding the Internet address to the default display screen.

13. The method according to claim 1, further comprising sending an indication of at least one service available via the tunerless television device via the wireless interface to the wireless device.

14. The method according to claim 13, further comprising:

receiving a request from the wireless device to use one of the at least one of the service available via the tunerless television device; and

allowing the wireless device to use the one of the at least one of the service available via the tunerless television device.

15. The method according to claim 1, further comprising:

receiving an indication from a telephone answering device via the wireless communication interface that a telephone voice mail is available for a user of the tunerless television device;

retrieving the telephone voice mail from the telephone answering device via the wireless communication interface; and

generating an audio output signal of the telephone voice mail via an audio output device associated with the tunerless television device.

16. The method according to claim 1, further comprising:

receiving, during the 3D video conference, text message content from the wireless device associated with the 3D video conference; and

displaying the text message content via a display associated with the tunerless television device.

17. The method according to claim 16, further comprising:

detecting an indication to reply to the text message content received from the wireless device associated with the 3D video conference;

detecting text input from a wireless text input device associated with the tunerless television device; and

sending the text input as a text message to the wireless device associated with the 3D video conference.

18. The method according to claim 1, further comprising:

detecting, during the 3D video conference, a selection of a contact from a contact list;

detecting text input from a wireless text input device associated with the tunerless television device; and

sending the text input as a text message to a wireless device associated with the selected contact during the 3D video conference.

19. The method according to claim 1, further comprising:

receiving, during the 3D video conference, text message content from a wireless device other than the wireless device associated with the 3D video conference; and

displaying the text message content via a display associated with the tunerless television device.

20. The method according to claim 19, further comprising:

detecting an indication to reply to the text message content received from the wireless device other than the wireless device associated with the 3D video conference;

detecting text input from a wireless text input device associated with the tunerless television device; and

sending the text input as a text message to the wireless device other than the wireless device associated with the 3D video conference.

21. The method according to claim 1, further comprising:

receiving audio input via an audio input device associated with the tunerless television device;

processing the received audio input using noise cancellation; and

sending the processed audio input to the wireless device.

22. The method according to claim 1, further comprising detecting a request via a user remote control to switch from a 3D video conference mode to a 2D video conference mode, and switching the tunerless television device from the 3D video conference mode to the 2D video conference mode.

23. The method according to claim 1, where the merged 3D video stream comprises one of frame sequential 3D video content and polarized 3D video content.

24. The method according to claim 1, where the wireless communication interface comprises one of a cellular wireless communication interface and a Bluetooth wireless communication interface.

25. A computer readable storage medium storing instructions which, when executed on one or more programmed processors, carry out a method according to claim 1.

26. An apparatus for automated wireless three-dimensional (3D) video conferencing comprising:

a wireless communication interface;

a camera interface module;

a first and a second video camera;

a 3D video offload processing module operatively coupled to the camera interface module; and

a processor programmed to;

automatically establish, via the wireless communication interface, a 3D video conference with a wireless device capable of 3D video conferencing;

receive, via the camera interface module, a first and a second two-dimensional (2D) video stream from the first and the second video camera;

create, via the 3D video offload processing module, a merged 3D video stream from the first 2D video stream and the second 2D video stream; and

send the merged 3D video stream to the wireless device via the wireless communication interface.

27. The apparatus according to claim 26, further comprising:

a display; and

where the processor is further programmed to;

receive a 3D video stream from the wireless device;

process the received 3D video stream; and

render the processed 3D video stream via the display.

28. The apparatus according to claim 26, where, in being programmed to automatically establish, via the wireless communication interface, the 3D video conference with the wireless device capable of 3D video conferencing, the processor is programmed to automatically establish, via the wireless communication interface, the 3D video conference with the wireless device capable of 3D video conferencing over a wireless mesh network connection.

29. The apparatus according to claim 26, where, in being programmed to automatically establish, via the wireless communication interface, the 3D video conference with the wireless device capable of 3D video conferencing, the processor is programmed to:

detect, via a wireless connection associated with the wireless communication interface, the wireless device;

initiate 3D video conferencing initiation signaling with the wireless device; and

receive 3D video conferencing confirmation signaling from the wireless device.

30. The apparatus according to claim 26, where, in being programmed to automatically establish, via the wireless communication interface, the 3D video conference with the wireless device capable of 3D video conferencing, the processor is programmed to:

detect a request to initiate the 3D video conference via a user remote control device comprising a selected contact from a contact list that is associated with the wireless device; and

automatically establish the 3D video conference with the wireless device in response to the request to initiate the 3D video conference via the user remote control.

31. The apparatus according to claim 26, where, in being programmed to automatically establish, via the wireless communication interface, the 3D video conference with the wireless device capable of 3D video conferencing, the processor is programmed to:

receive a request to initiate an automated 3D video conference from the wireless device;

determine whether the wireless device is authorized for automated 3D video conferencing; and

automatically establish the 3D video conference in response to determining that the wireless device is authorized for automated 3D video conferencing.

32. The apparatus according to claim 26, where, in being programmed to automatically establish, via the wireless communication interface, the 3D video conference with the wireless device capable of 3D video conferencing, the processor is programmed to:

receive a text message from the wireless device;

determine whether the text message is from a user within a contact list that is authorized for automated 3D video conferencing; and

automatically establish the 3D video conference in response to determining that the text message is from the user within the contact list that is authorized for automated 3D video conferencing.

33. The apparatus according to claim 26, where, in being programmed to automatically establish, via the wireless communication interface, the 3D video conference with the wireless device capable of 3D video conferencing, the processor is programmed to:

detect a contact name selection from a contact list of 3D video conferencing contacts and text input associated with a text message from a wireless text input device;

determine that the wireless device is associated with the selected contact name;

automatically determine a wireless connection status of the wireless device;

send an automated 3D conference request text message to the wireless device in response to determining the wireless device is active; and

automatically establish the 3D video conference in response to receipt of a confirmation text message from the wireless device.

34. The apparatus according to claim 33, where the wireless text input device comprises one of a wireless keyboard and a mobile phone configured to communicate via the wireless communication interface.

35. The apparatus according to claim 26, where, in being programmed to automatically establish, via the wireless communication interface, the 3D video conference with the wireless device capable of 3D video conferencing, the processor is programmed to:

search for wireless devices, via a wireless connection associated with the wireless communication interface, that are authorized for automated 3D video conferencing;

determine that the wireless device is active and is authorized for automated 3D video conferencing; and

automatically establish the 3D video conference.

36. The apparatus according to claim 26, further comprising:

a display; and

where the processor is further programmed to provide a default display screen via the display, where the default display screen comprises an option for 3D video conferencing.

37. The apparatus according to claim 36, where the processor is further programmed to:

receive a request to customize the default display screen with an Internet address for default access to content available via the Internet address; and

add the Internet address to the default display screen.

38. The apparatus according to claim 26, where the processor is further programmed to send an indication of at least one service available via the wireless communication interface to the wireless device.

39. The apparatus according to claim 38, where the processor is further programmed to:

receive a request from the wireless device to use one of the at least one of the service available via the wireless communication interface; and

allow the wireless device to use the one of the at least one of the service available via the wireless communication interface.

40. The apparatus according to claim 26, further comprising:

an audio output device; and

where the processor is further programmed to;

receive an indication from a telephone answering device via the wireless communication interface that a telephone voice mail is available for a user;

retrieve the telephone voice mail from the telephone answering device via the wireless communication interface; and

generate an audio output signal of the telephone voice mail via the audio output device.

41. The apparatus according to claim 26, further comprising:

a display; and

where the processor is further programmed to;

receive, during the 3D video conference, text message content from the wireless device associated with the 3D video conference; and

display the text message content via the display.

42. The apparatus according to claim 41, where the processor is further programmed to:

detect an indication to reply to the text message content received from the wireless device associated with the 3D video conference;

detect text input from a wireless text input device; and

send the text input as a text message to the wireless device associated with the 3D video conference.

43. The apparatus according to claim 26, where the processor is further programmed to:

detect, during the 3D video conference, a selection of a contact from a contact list;

detect text input from a wireless text input device; and

send the text input as a text message to a wireless device associated with the selected contact during the 3D video conference.

44. The apparatus according to claim 26, further comprising:

a display; and

where the processor is further programmed to;

receive, during the 3D video conference, text message content from a wireless device other than the wireless device associated with the 3D video conference; and

display the text message content via the display.

45. The apparatus according to claim 44, where the processor is further programmed to:

detect an indication to reply to the text message content received from the wireless device other than the wireless device associated with the 3D video conference;

detect text input from a wireless text input device; and

send the text input as a text message to the wireless device other than the wireless device associated with the 3D video conference.

46. The apparatus according to claim 26, further comprising:

an audio input device comprising noise cancellation circuitry; and

where the processor is further programmed to;

receive audio input via the audio input device;

process the received audio input using the noise cancellation circuitry; and

send the processed audio input to the wireless device.

47. The apparatus according to claim 26, where the processor is further programmed to:

detect a request via a user remote control to switch from a 3D video conference mode to a 2D video conference mode; and

switch from the 3D video conference mode to the 2D video conference mode.

48. The apparatus according to claim 26, where the merged 3D video stream comprises one of frame sequential 3D video content and polarized 3D video content.

49. The apparatus according to claim 26, where the wireless communication interface comprises one of a cellular wireless communication interface and a Bluetooth wireless communication interface.