METHOD FOR OUTPUTTING COMMAND BY DETECTING OBJECT MOVEMENT AND SYSTEM THEREOF

• US 20150248172A1
• Filed: 05/18/2015
• Published: 09/03/2015
• Est. Priority Date: 04/30/2012
• Status: Active Grant

• Current Assignee: PixArt Imaging Incorporated
• Original Assignee: PixArt Imaging Incorporated
• Inventors: Huang, Yu-Hao, Lee, Yi-Fang, Kao, Ming-Tsan, Chen, Nien-Tse
• Granted Patent: US 10,599,224 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

The present invention discloses a method for outputting a command by detecting a movement of an object, which includes the following steps. First, an image capturing device captures images generated by the movement of the object at different timings by. Next, a motion trajectory is calculated according to the plurality of images. Further next, a corresponding command is outputted according to the motion trajectory. The present invention also provides a system which employs the above-mentioned method.

Claims

1. A method for outputting a command by detecting a movement of an object, the method comprising:

capturing a plurality of images at different timings by an image capturing device, wherein the plurality of images includes the object;

calculating a motion trajectory according to the plurality of images; and

outputting the command according to the motion trajectory.

19. The method of claim 1, wherein the step of calculating the motion trajectory according to the plurality of images comprises:

subtracting a centroid of the object in each of the images by a centroid of the object in a previous image so as to obtain a motion vector corresponding to each image; and

calculating the motion trajectory according to the motion vectors.

20. The method of claim 19, wherein the step of calculating the motion trajectory according to the motion vectors comprises:

generating object rotation information according to the motion vectors, wherein the object rotation information comprises one or more of a rotation plane normal vector, rotation angle, angular velocity, speed, rotation radius and trajectory length; and

outputting the command to execute a software application program of an electrical device according to the object rotation information.

21. The method of claim 20, wherein the step of outputting the command according to the object rotation information comprises:

outputting the command to control a rotation of one or more predetermined angle units according to the rotation plane normal vector and the rotation angle.

22. The method of claim 21, wherein the predetermined angle unit is adaptively adjusted according to a trajectory velocity or an angular velocity.

23. The method of claim 21, wherein when the object stops rotating, the rotation of one or more predetermined angle units is decelerated according to an average speed or average angular velocity of the object rotation information in a time period before the object stops rotating.

24. The method of claim 1, further comprising:

illuminating the object with an invisible light source, wherein the image capturing device is for detecting light emitted from the invisible light source.

25. The method of claim 1, wherein the step of calculating a motion trajectory according to the plurality of images comprises:

detecting a change of shape, size, light intensity or position of the object in the images to determine whether the motion trajectory is a horizontal motion trajectory or a vertical motion trajectory.

26. The method of claim 1, wherein the object includes a part of a hand of a user.

2-18. -18. (canceled)

27. A system for outputting a command by detecting a movement of an object, the system comprising:

an image capturing device for capturing a plurality of images at different timings, wherein the plurality of images includes the object; and

a processing unit for receiving the plurality of images and calculating a motion trajectory according to the plurality of images and outputting the command according to the motion trajectory.

28. The system of claim 27, further comprising:

an invisible light source for illuminating the object, wherein the image capturing device is for detecting light emitted from the invisible light source.

29. The system of claim 27, wherein the step performed by the processing unit for calculating the motion trajectory according to the plurality of images comprises:

subtracting a centroid of the object in each of the images by a centroid of the object in a previous image so as to obtain a motion vector corresponding to each image; and

calculating the motion trajectory according to the motion vectors.

30. The system of claim 29, wherein the step of calculating the motion trajectory according to the motion vectors comprises:

generating object rotation information according to the motion vectors, wherein the object rotation information comprises one or more of a rotation plane normal vector, rotation angle, angular velocity, speed, rotation radius and trajectory length; and

outputting the command to execute a software application program of an electrical device according to the object rotation information.

31. The system of claim 30, wherein the step of outputting the command according to the object rotation information further comprises:

outputting the command to control a rotation of one or more predetermined angle units according to the rotation plane normal vector and the rotation angle.

32. The system of claim 31, wherein the predetermined angle unit is adaptively adjusted according to a trajectory velocity or an angular velocity.

33. The system of claim 31, wherein when the object stops rotating, the rotation of one or more predetermined angle units is decelerated according to an average speed or average angular velocity of the object rotation information in a time period before the object stops rotating.

34. The system of claim 27, wherein the step performed by the processing unit for calculating a motion trajectory according to the plurality of images comprises:

detecting a change of shape, size, light intensity or position of the object in the images to determine whether the motion trajectory is a horizontal motion trajectory or a vertical motion trajectory.

35. The system of claim 27, wherein the object includes a part of a hand of a user.