Methods and systems for contactlessly controlling electronic devices according to signals from a digital camera and a sensor module

• US 8,896,536 B2
• Filed: 10/29/2013
• Issued: 11/25/2014
• Est. Priority Date: 06/10/2008
• Status: Active Grant

• Current Assignee: Taiwan Semiconductor Manufacturing Company Limited
• Original Assignee: MediaTek, Inc.
• Inventors: Chen, Cheng-Che, Shih, Hsin-Te, Tsai, Tsung Ju
• Primary Examiner(s): Pervan, Michael
• Application Number:
  US14/065,465
• Publication Number:
  US 20140049466A1
• Time in Patent Office: 392 Days
• Field of Search: 345/158, 345/169, 715/863
• US Class Current: 345/158
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/00381 Input by recognition or interpretation of visible user gestures manual input means, e.g. digitisers, writing tablets H04N1/00392; gesture input to computers G06F3/017; recognition algorithms G06V40/20
• CPC Class Codes: H04N 9/3176 wherein the projection device is incorporated in a camera details of cameras adapted for combination with a projector not peculiar to the presence of an electronic spatial light modulator G03B17/54

Abstract

An embodiment of a method for contactlessly controlling an electronic apparatus, performed by a processor of the electronic apparatus. A camera module of the electronic apparatus is turned on to capture a series of images upon detecting that an object is in close proximity to the electronic apparatus. A contactless control procedure is performed while the camera module thereof is in use. The control operation comprises determining a control operation according to the captured images; performing the control operation to an electronic device of the electronic apparatus upon obtaining an instruction based on analyzing the captured images; and turning off the camera module responsive to not obtaining an instruction within a predetermined time period.

Claims

1. A method for contactlessly controlling an electronic apparatus, performed by a processor of the electronic apparatus, comprising:

detecting whether an object is in close proximity to the electronic apparatus;

turning on a camera module of the electronic apparatus to capture a series of images containing the object upon detecting that the object is in close proximity to the electronic apparatus and performing a contactless control procedure while the camera module of the electronic apparatus is in use and,

wherein the contactless control procedure further comprises;

determining a control operation according to the captured images containing the object;

performing the control operation to an electronic device of the electronic apparatus; and

turning off the camera module responsive to not obtaining the control operation within a predetermined time period.

2. The method as claimed in claim 1, wherein the existence of an object in close proximity to the electronic apparatus is detected by a light sensor comprising a transmitter and a receiver, the transmitter emits infrared signals, the receiver receives the infrared signals reflected by the object, and the light sensor determines the existence of an object in close proximity to the electronic apparatus when detecting a certain amount of the reflected infrared signals.

3. The method as claimed in claim 1, wherein the existence of an object in close proximity to the electronic apparatus is detected by a capacitive sensor, and the capacitive sensor determines the existence of an object in close proximity to the electronic apparatus when detecting changes in an electric field satisfy a predefined criteria.

4. The method as claimed in claim 1 further comprising:

providing a base image related to the control operation,

wherein the step of determination of the control operation further comprises;

comparing each captured image with the base image using a similarity comparison algorithm to calculate an extent of the similarity between the base image and the captured image; and

determining the control operation when one of the calculated extents is greater than a predefined threshold.

5. The method as claimed in claim 1 further comprising:

providing a discrimination function related to the control operation,

wherein the step of determination of the control operation further comprises;

calculating a feature vector for each captured image using a predefined feature extraction procedure;

carrying each feature vector in the discrimination function to calculate a similarity extent of the feature vector; and

determining the control operation when one of the calculated extents is greater than a predefined threshold.

6. The method as claimed in claim 1 further comprising:

providing a predefined direction of movement related to the control operation,

wherein the step of determination of the control operation further comprises;

analyzing a plurality of motion vectors for the captured image using a video encoder;

determining the control operation when the calculated motion vectors indicates the predefined direction of movement.

7. The method as claimed in claim 6 wherein the step of determination of the control operation further comprises:

calculating an overall motion vector (X_o,Y_o) by formulae

8. The method as claimed in claim 6 wherein the step of determination of the control operation further comprises:

classifying each motion vector into a plurality of directions of movement, wherein the classified directions comprises the provided direction of movement;

counting each movement of direction according to the classification results; and

determining the control operation when the count of the provided direction of movement is higher than the others and satisfies a predetermined criteria.

9. The method as claimed in claim 1 further comprising:

providing a predefined gestured motion related to the control operation,

wherein the step of determination of the control operation further comprises;

determining the control operation when the captured images indicates the predefined gestured motion.

10. The method as claimed in claim 9 wherein the gestured motion comprises a start gesture and an end gesture, and the step of determination of the control operation further comprises:

determining the control operation when the captured images indicates both the start and end gestures.

11. The method as claimed in claim 1 wherein the control operation comprises controlling a telecommunication module of the electronic apparatus to make an mobile-originated call request to a remote electronic apparatus with the last dialed number or a default number via a camped-on cell.

12. The method as claimed in claim 1 wherein the control operation comprises acquiring still images from a non-volatile memory or a storage device of the electronic apparatus, and outputting the acquired still images to a projector module of the electronic apparatus in a higher or a lower rate for slide show.

13. The method as claimed in claim 1 wherein the control operation comprises directing a digital TV receiving module to acquire a video or audio stream of the prior TV program or the next TV program.

14. The method as claimed in claim 1, further comprising directing a projector module of the electronic apparatus to project multimedia data on a flat surface, wherein the step of detecting further comprises periodically detecting whether an object is in close proximity to the electronic apparatus when the electronic apparatus is in a fixed position to project the multimedia data.

15. An electronic apparatus comprising:

a processor, coupled to a camera module, and a sensor module of the electronic apparatus, turning on the camera module to capture a series of images containing an object when the sensor module detects existence of the object in close proximity to the electronic apparatus, and performing a contactless control procedure while the camera module is in use, wherein the contactless control procedure further comprises;

receiving the captured images containing the object from the camera module,

determining a control operation according to the captured images containing the object, and

performing the control operation to an electronic device, and

turning off the camera module responsive to not obtaining the control operation within a predetermined time period.

16. The electronic apparatus as claimed in claim 15 further comprising a display unit, wherein the processor directs the display unit of the electronic apparatus to display a prompt screen to instruct a user to control the electronic apparatus by hand gesture when the sensor module detects existence of an object in close proximity to the electronic apparatus.

17. The electronic apparatus as claimed in claim 15, wherein the processor is coupled to a projector module of the electronic apparatus, directs the projector module to project multimedia data on a flat surface, and receives signals from the sensor module while projecting the multimedia data on a flat surface.

18. The electronic apparatus as claimed in claim 15, wherein the control operation comprises outputting a plurality of still images to the projector module in a higher or a lower rate for slide show.

19. The electronic apparatus as claimed in claim 15, wherein the control operation comprises directing a digital TV receiving module of the electronic apparatus to acquire a video or audio stream of the prior TV program or the next TV program and outputting the acquired video or audio stream to the projector module.