Computing device, storage medium, and method for controlling manipulation of the computing device

• US 8,902,276 B2
• Filed: 08/31/2012
• Issued: 12/02/2014
• Est. Priority Date: 10/31/2011
• Status: Expired due to Fees

• Current Assignee: Hon Hai Precision Industry Co., Ltd.
• Original Assignee: Hon Hai Precision Industry Co., Ltd.
• Inventors: Tsai, Hsueh-Tsen, Chiu, Hsiao-Ping
• Primary Examiner(s): Nguyen, Joseph J
• Application Number:
  US13/600,223
• Publication Number:
  US 20130106981A1
• Time in Patent Office: 823 Days
• Field of Search: 348/14.03, 348/14.08, 348/14.09, 348/14.1, 348/16.16, 348/207.99, 345/156
• US Class Current: 348/14.03
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04M 2201/50 Telephonic communication in combination with video communication
• CPC Class Codes: H04M 2250/62 user interface aspects of conference calls
• CPC Class Codes: H04M 3/567 Multimedia conference systems
• CPC Class Codes: H04M 3/569 using the instant speaker's algorithm speech detection per se G10L25/78
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

A method controls manipulation of a computing device. The method turns on a camera device to capture images and gestures of a manipulation owner, analyzes the gestures to get operations to control the computing device using a recognition unit of the computing device, and determines whether an additional participant gets the manipulation control of the computing device. If the additional participant gets the manipulation control of the computing device, the method stops to capture the images of the manipulation owner, and captures the images of the additional participant. If the additional participant does not get the manipulation control of the computing device, the method still captures the images of the manipulation owner.

Claims

1. A computer-implemented method of a computing device for controlling manipulation of the computing device, the method comprising:

(a) detecting whether a microphone receives voice signals when the computing device and a remote device are connected via a remote meeting mode;

(b) triggering a camera device corresponding to the microphone to capture images and gestures of a manipulation owner of the microphone;

(c) receiving the gestures of the manipulation owner captured by the camera device, and analyzing the gestures to get an operation on the computing device using a recognition unit of the computing device;

(d) determining whether an additional microphone and the capturing camera device are in a same meeting room when the additional microphone receives the voice signals;

(e) triggering a camera device corresponding to the additional microphone to capture images of the manipulation owner, if the additional microphone and the capturing camera device are in the same meeting room;

(f) turning off the camera device that captures the images, and turning on the camera device corresponding to the additional microphone, if the additional microphone and the capturing camera device are not in the same meeting room, wherein a participant who uses the additional microphone is the manipulation owner; and

(g) repeating the step (c) to the step (f) until the remote meeting mode ends.

2. The method as claimed in claim 1, wherein the remote meeting mode includes a main meeting room and one or more remote meeting rooms.

3. The method as claimed in claim 2, wherein the main meeting room and each of the remote meeting rooms are equipped with one or more camera devices and microphones.

4. The method as claimed in claim 3, wherein each of the camera devices is a fixed camera or a mobile camera, each of the fixed cameras corresponds to a microphone if the camera device is the fixed camera, and each of the mobile cameras corresponds to one or more microphones if the camera device is the mobile camera.

5. The method as claimed in claim 4, wherein the step (b) further comprises:

locating a position of the microphone according to a position relation if the camera device is the mobile camera, wherein the position relation is a relation distance and angle between the microphone and the mobile camera; and

turning off the fixed camera that captures the images and turning on the fixed camera corresponding to the microphone, if the camera device is the fixed camera.

6. The method as claimed in claim 4, wherein the step (f) further comprises:

locating a position of the additional microphone according to the position relation if the camera device is the mobile camera.

7. A non-transitory computer readable storage medium storing a set of instructions, when executed by at least one processor of a computing device, cause the at least one processor to perform a method for controlling manipulation of the computing device, the method comprising:

(a) detecting whether a microphone receives voice signals when the computing device and a remote device are connected via a remote meeting mode;

(b) triggering a camera device corresponding to the microphone to capture images and gestures of a manipulation owner of the microphone;

(c) receiving the gestures of the manipulation owner captured by the camera device, and analyzing the gestures to get an operation on the computing device using a recognition unit of the computing device;

(d) determining whether an additional microphone and the capturing camera device are in a same meeting room when the additional microphone receives the voice signals;

(e) triggering a camera device corresponding to the additional microphone to capture images of the manipulation owner, if additional microphone and the capturing camera device are in the same meeting room;

(f) turning off the camera device that captures the images, and turning on the camera device corresponding to the additional microphone, if the additional microphone and the capturing camera device are not in the same meeting room, wherein a participant who uses the additional microphone is the manipulation owner; and

(g) repeating the step (c) to the step (f) until the remote meeting mode ends.

8. The storage medium as claimed in claim 7, wherein the remote meeting mode includes a main meeting room and one or more remote meeting rooms.

9. The storage medium as claimed in claim 8, wherein the main meeting room and each of the remote meeting rooms are equipped with one or more camera devices and microphones.

10. The storage medium as claimed in claim 9, wherein each of the camera devices is a fixed camera or a mobile camera, each of the fixed cameras corresponds to a microphone if the camera device is the fixed camera, and each of the mobile cameras corresponds to one or more microphones if the camera device is the mobile camera.

11. The storage medium as claimed in claim 10, wherein the step (b) further comprises:

locating a position of the microphone according to a position relation if the camera device is the mobile camera, wherein the position relation is a relation distance and angle between the microphone and the mobile camera; and

turning off the fixed camera that captures the images and turning on the fixed camera corresponding to the microphone, if the camera device is the fixed camera.

12. The storage medium as claimed in claim 10, wherein the step (f) further comprises:

locating the position of the additional microphone according to the position relation if the camera device is the mobile camera.

13. A computing device, comprising:

a storage device;

at least one processor; and

one or more programs that are stored in the storage device and executed by the at least one processor, the one or more programs comprising;

a detecting module that detects whether a microphone receives voice signals when the computing device and a remote device are connected via a remote meeting mode;

a locating module that triggers a camera device corresponding to the microphone to capture images and gestures of a manipulation owner of the microphone;

an identifying module that receives the gestures of the manipulation owner captured by the camera device, and analyzes the gestures to get an operation on the computing device using a recognition unit of the computing device;

a determining module that determines whether an additional microphone and the capturing camera device are in a same meeting room when the additional microphone receives the voice signals; and

a switching module that turns off the camera device that captures the images, and turns on the camera device corresponding to the additional microphone, if the additional microphone and the capturing camera device are not in the same meeting room, wherein a participant who uses the additional microphone is the manipulation owner.

14. The computing device as claimed in claim 13, wherein the remote meeting mode includes a main meeting room and one or more remote meeting rooms.

15. The computing device as claimed in claim 14, wherein the main meeting room and each of the remote meeting rooms are equipped with one or more camera devices and microphones.

16. The computing device as claimed in claim 15, wherein each of the camera devices is a fixed camera or a mobile camera, each of the fixed cameras corresponds to a microphone if the camera device is the fixed camera, and each of the mobile cameras corresponds to one or more microphones if the camera device is the mobile camera.

17. The computing device as claimed in claim 16, wherein the locating module further locates a position of the microphone according to a position relation if the camera device is the mobile camera, wherein the position relation is a relation distance and angle between the microphone and the mobile camera.

18. The computing device as claimed in claim 16, wherein the switching module further turns off the fixed camera that captures the images and turns on the fixed camera corresponding to the microphone, if the additional microphone and the capturing camera device are in the same meeting room and the camera device is the fixed camera.