Instruction device and communicating method

• US 8,451,221 B2
• Filed: 08/10/2009
• Issued: 05/28/2013
• Est. Priority Date: 08/11/2008
• Status: Active Grant

• Current Assignee: IMU Solutions, Inc.
• Original Assignee: IMU Solutions, Inc.
• Inventors: Hwang, Deng-Huei
• Primary Examiner(s): NGUYEN, KIMNHUNG T
• Application Number:
  US12/538,371
• Publication Number:
  US 20100149095A1
• Time in Patent Office: 1,387 Days
• Field of Search: 345156-158, 345/163, 345/169, 345/173
• US Class Current: 345/157
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence

Abstract

An instruction device is provided for communicating an instruction and an icon in an image area, and includes a motion sensing unit and a processing unit. The motion sensing unit senses a first motion to generate a corresponding first signal. The processing unit generates a first trajectory to determine a first region in the image area in response to the corresponding first signal for a decision whether the icon shall be or has been selected according to a relationship between the first region and a second region where the icon is displayed in the image area.

Claims

1. An instruction device for communicating an instruction and a first reaction medium, comprising:

a sensing unit sensing a first instruction medium to generate a corresponding first signal; and

a responding unit generating a geometric reference in response to the corresponding first signal for a decision whether a communication between the instruction and the first reaction medium shall be conducted according to a relationship between the geometric reference and the first reaction medium.

2. An instruction device according to claim 1, wherein the communication is transmitting the instruction to the first reaction medium.

3. An instruction device according to claim 1 wherein the communication is conducted by causing the first reaction medium to be operated.

4. An instruction device according to claim 1 wherein the communication is transmitting a feedback signal by the first reaction medium to the sensing unit.

5. An instruction device according to claim 1 wherein the first reaction medium is disposed in a specific area.

6. An instruction device according to claim 5 wherein:

the geometric reference includes a first trajectory;

the responding unit further determines a first region in the specific area according to the first trajectory; and

the relationship is a first relationship between the first region and a second region in the specific area where the first reaction medium is located.

7. An instruction device according to claim 6 wherein:

the specific area is an image area;

the specific area is disposed on one selected from a group consisting of a screen, a monitor, and a display,

the first reaction medium is an icon;

the first instruction medium is a first motion;

the second region further comprises a second reaction medium near the first reaction medium;

the sensing unit is a motion sensing unit and the responding unit is a processing unit;

the communication is conducted to decide whether the icon either is to be selected or has been selected;

the instruction is a selection instruction;

the processing unit further transforms the corresponding first signal into the first trajectory;

the first trajectory includes at least one selected from a group consisting of a first arc having an arc angle, a combination of a second arc and a first line segment, and plural second line segments, wherein the arc angle of the first arc is in a degree being one selected from a group consisting of 180°

, and beyond 180°

when the first trajectory is the first arc;

the first region includes a closed region;

the first motion is generated by at least one selected from a group consisting of a hand, an arm, a foot, a leg, a head, a neck, a shoulder and a waist;

the processing unit causes the first reaction medium to be selected when the first relationship is an intersection relationship; and

the intersection relationship is in a specific condition, wherein the specific condition is one selected from a group consisting of;

a first condition that the first region partially overlaps the second region,

a second condition that the first region entirely overlaps the second region,

a third condition that the first region entirely covers the second region,

a fourth condition that a centroid of the first region is located within the second region,

a fifth condition that the first trajectory passes through the second region, and

a sixth condition that the first trajectory touches the second region.

8. An instruction device according to claim 7, further configured to have a second motion, transforming the second motion into a feature being one of a second signal and a second trajectory, and determining whether a preset function of the icon is performed according to the feature after the processing unit conforms a selected status of the icon, wherein the second trajectory is one selected from a group consisting of a check mark, a letter “

X” and

a circle-shaped mark.

9. An instruction device according to claim 7, further configured to have a second motion, analyzing an acceleration-deceleration distribution of the second motion, and determining whether a preset function of the icon is performed after the processing unit conforms a selected status of the icon, wherein the second motion is one selected from a group consisting of movements of drawing a check mark, a letter “

X”

, a wavy line, a triangle, an arc and a circle.

10. An instruction device according to claim 5 wherein:

the first instruction medium is a first motion;

the geometric reference includes a first trajectory;

the responding unit further determines a first region in the specific area according to the first trajectory;

the specific area further comprises a specific region where at least a second reaction medium near the first reaction medium is disposed;

the relationship is a first relationship between the first region and a second region in the specific area where at least two reaction mediums consisting of the first and at least the second reaction mediums are together located; and

the communication is conducted to decide whether the first reaction medium is to be selected.

11. An instruction device according to claim 10, wherein:

the first trajectory includes at least one selected from a group consisting of a first arc having an arc angle, a combination of a second arc and a first line segment, and plural second line segments;

the arc angle of the first arc is in a degree being one selected from a group consisting of 360°

, near 360°

, and beyond 360°

when the first trajectory is the first arc;

the responding unit causes the at least two reaction mediums to be selected when the first relationship is an intersection relationship; and

the at least two reaction mediums have inverse videos sequentially displayed thereon through a pushbutton for selecting the first reaction medium.

12. An instruction device according to claim 11, further configured to have a selection instruction medium to result in a specific state, wherein:

the selection instruction medium is a selection motion being one selected from a group consisting of a yaw motion, a pitch motion and a roll motion; and

the specific state is one selected from a group consisting of;

a first state that the at least two reaction mediums have inverse videos sequentially displayed thereon, and

a second state that the first trajectory is scaled down into a second trajectory sequentially displayed on the at least two reaction mediums.

13. An instruction device according to claim 5 wherein:

the geometric reference includes at least three reference positions; and

the responding unit further determines a first region in the specific area according to the at least three reference positions; and

the relationship is a first relationship between the first region and a second region in the specific area where the first reaction medium is located.

14. An instruction device according to claim 13, wherein:

the first instruction medium is a physical effect being one selected from a group consisting of an acoustic wave, a light wave, a non-contact force, a contact force and a mechanical force, wherein the non-contact force is one selected from a group consisting of an electromagnetic wave, an electric force, a magnetic force and an inertia force, and the mechanical force is one selected from a group consisting of a pressure, a friction force and an elastic force;

the responding unit is a processor;

the first reaction medium is frequently displayed in the specific area;

the at least three reference positions is used to form a specific trajectory;

the specific trajectory is a geometric pattern trajectory being one of a closed trajectory and a non-closed trajectory, wherein the closed trajectory is one selected from a group consisting of a circle, an ellipse, a polygon, a heart-shape line and a rose-shape line, the polygon is one selected from a group consisting of a triangle, a square and a pentagon, and the non-closed trajectory is one selected from a group consisting of an arc, a curve and a cycloid;

the first region is enclosed by the specific trajectory;

the second region is associated with the first reaction medium;

the first relationship is an intersection relationship; and

the intersection relationship is in a specific condition, wherein the specific condition is one selected from a group consisting of;

a first condition that the first region entirely covers the second region,

a second condition that the first region partially covers the second region,

a third condition that the first region entirely overlaps the second region, and

a fourth condition that the first region partially overlap the second region.

15. An instruction device according to claim 5 wherein:

the specific area further comprises a specific region where at least a second reaction medium near the first reaction medium is disposed;

the geometric reference includes at least three reference positions;

the responding unit further determines a first region in the specific area according to the at least three reference positions; and

the relationship is a first relationship between the first region and a second region in the specific area where at least two reaction mediums consisting of the first and at least the second reaction mediums are together located.

16. An instruction device according to claim 5 wherein:

the geometric reference includes at least two reference positions; and

the relationship is a first relationship between the at least two reference positions and the first reaction medium.

17. An instruction device according to claim 16 wherein:

the at least two reference positions are used to form one of a geometric pattern and a geometric region; and

the communication is a specific operation being one selected from a group consisting of;

a first operation of communicating the instruction to the first reaction medium, and

a second operation of transmitting a feedback signal by the first reaction medium to the responding unit.

18. An instruction device according to claim 5 wherein:

the geometric reference includes two reference positions;

the responding unit further determines a geometric line according to the two reference positions; and

the relationship is a first relationship between the geometric line and the first reaction medium.

19. An instruction device according to claim 18, wherein:

the first relationship is a position relationship between the geometric line and a first region in the specific area where the first reaction medium is located;

the geometric line is a straight line;

the position relationship is whether an intersection relationship between the geometric line and the first region exists; and

the intersection relationship is one selected from a group consisting of;

a second relationship that the geometric line passes through the first region; and

a third relationship that the geometric line touches a boundary of the first region.

20. An instruction device for communicating an instruction and a first reaction medium, comprising an instructing unit configured to send an instruction medium to determine a geometry reference for a decision whether a communication between the instruction and the first reaction medium shall be conducted according to a relationship between the geometry reference and the first reaction medium.

21. An instruction device according to claim 20 wherein the geometry reference includes at least two reference positions, and the relationship is a first relationship between the at least two reference positions and the first reaction medium.

22. An instruction device according to claim 20 wherein:

the first reaction medium is disposed in a specific area;

the instructing unit further transforms the instruction medium into the geometry reference including a first trajectory, and determines a first region according to the first trajectory;

the relationship is a first relationship between the first region and a second region in the specific area where the first reaction medium is located;

the first reaction medium is an icon, the specific area is an image area, and the instruction medium is a first motion of the instructing unit;

the instructing unit comprises;

a motion sensing unit transforming the first motion into a first signal; and

a processing unit transforming the first signal into the first trajectory, determining the first region according to the first trajectory for the decision whether the communication between the instruction and the icon shall be conducted according to the first region and the second region.

23. An instruction device according to claim 22, wherein:

the first motion is formed by a hand driving the selection unit;

the first motion includes at least one of a three-dimensional motion and a two-dimensional motion;

the first trajectory includes at least one selected from a group consisting of a first arc having an arc angle, a combination of a second arc and a first line segment, and plural second line segments, wherein the arc angle of the first arc is in a degree being one selected from a group consisting of 360°

, near 360°

, and beyond 360°

when the first trajectory is the first arc;

the first region includes a closed area;

the instructing unit communicates the instruction to the icon when the first relationship is an intersection relationship;

the icon is selected after the instruction unit conforms the instruction is communicated to the icon.

24. An instruction device according to claim 23, wherein:

the motion sensing unit comprises a gyroscope sensing the first motion for producing the first signal; and

the processing unit includes one selected from a group consisting of a microcontroller, a microprocessor, a digital signal processor and a central processing unit;

the instruction unit is further configured to have a second motion, transforms the second motion into a second trajectory, and determine whether a preset function of the icon is performed according to the second trajectory after the instruction unit conforms a selected status of the icon; and

the second trajectory is one selected from a group consisting of a check mark, a letter “

X” and

a circle-shaped mark.

25. An instruction device according to claim 23, wherein:

the motion sensing unit comprises;

a gyroscope having at least two sensing degrees of freedom and sensing the first motion for producing a first portion of the first signal; and

an accelerometer having at least two sensing degrees of freedom and sensing the first motion for producing a second portion of the first signal;

the instruction unit is further configured to have a second motion, analyze an acceleration-deceleration distribution of the second motion, and determine whether a preset function of the icon is performed after the instruction unit conforms a selected status of the icon; and

the second motion is one selected from a group consisting of movements of drawing a check mark, a letter “

X”

, a wavy line, a triangle, an arc and a circle.

26. An instruction communicating method for communicating an instruction and a first reaction medium, comprising:

providing a geometry reference in response to an instruction medium; and

deciding whether a communication between the instruction and the first reaction medium shall be conducted according to a relationship between the geometry reference and the first reaction medium.

27. An instruction communicating method according to claim 26, wherein the geometry reference includes at least two reference positions, and the relationship is a first relationship between the at least two reference positions and the first reaction medium.

28. An instruction communicating method according to claim 26, further comprising a step of:

providing a specific area to display therein the first reaction medium, wherein the instruction medium is a motion.

29. An instruction communicating method according to claim 28, wherein the geometry reference includes two reference positions, and the instruction communicating method further comprising a step of:

forming a geometrical line by the two positional references, wherein the relationship is a positional relationship between the geometrical line and the first reaction medium in the specific area, wherein the geometric line is a straight line.

30. An instruction communicating method according to claim 28, wherein the geometry reference includes at least three reference positions, and the instruction communicating method further comprising a step of:

forming a first region by the at least three reference positions wherein the relationship is a first relationship between the first region and a second region in the specific area where the first reaction medium is located.

31. An instruction communicating method according to claim 28, wherein the geometry reference includes a trajectory, and the instruction communicating method further comprising a step of:

determining a first region according to the trajectory, wherein the relationship is a first relationship between the first region and a second region in the specific area where the first reaction medium is located.

32. An instruction device for communicating an instruction and a first reaction medium, comprising:

a sensing unit sensing an instruction medium to generate a corresponding signal; and

a responding unit temporarily generating a reference feature being one selected from a group consisting of a reference parameter, a positional reference and a reference signal in response to the corresponding signal for a decision whether a communication between the instruction and the first reaction medium shall be conducted according to a relationship between the first reaction medium and the selected one of a reference parameter, a positional reference and a reference signal.

33. An instruction device according to claim 32, wherein the reference feature is the positional reference being a reference position, and the relationship is a first relationship between the reference position and the first reaction medium.

34. An instruction device according to claim 33, wherein:

the first reaction medium is located in the specific area;

the reference position is located in the specific area;

the first relationship is a position relationship between the reference position and the first reaction medium in the specific area;

the reference position is generated for a period between 0.1 seconds and 3 seconds;

the first reaction medium occupies a first region in the specific area;

the responding unit further generates a geometric pattern on the reference position in response to the corresponding signal, wherein the geometric pattern is one selected from a group consisting of a circle, an ellipse and a polygon, and the polygon is one selected from a group consisting of a triangle, a square and a pentagon;

the responding unit further makes a decision whether the instruction is communicated to the first reaction medium according to the position relationship;

the position relationship is one whether an intersection relationship between the geometric pattern and the first region exists;

the intersection relationship is in a specific condition, wherein the specific condition is one selected from a group consisting of;

a first condition that the geometric pattern covers the first region,

a second condition that the geometric pattern overlaps the first region, and

a third condition that the geometric pattern intersects the first region;

whether the instruction is communicated to the first reaction medium is decided according to whether the reference position is located in the first region;

the instruction includes a command message for selecting the first reaction medium and changing a specific presentation of the selected reaction medium; and

the specific presentation is one selected from a group consisting of;

a first presentation of displaying an inverse video of the selected reaction medium,

a second presentation of changing a color of the selected reaction medium,

a third presentation of displaying by scaling up the selected reaction medium with a same-length-width ratio,

a fourth presentation of displaying by scaling up the selected reaction medium with a different-length-width ratio,

a fifth presentation of displaying by flicking the selected reaction medium,

a sixth presentation of displaying by interchanging colors of the selected reaction medium, and

a seventh presentation of generating a sound.

35. An instruction device according to claim 32, wherein the reference feature is the reference signal, and the relationship is a first relationship between the reference signal and the first reaction medium.

36. An instruction device according to claim 35, wherein:

the reference signal is a first geometric feature being one of a first position and a first region;

the first reaction medium is located in a second geometric feature being one of a second position and a second region;

the first relationship is whether an intersection relationship exists;

the intersection relationship is in a specific condition, wherein the specific condition is one selected from a group consisting of;

a first condition that the first and the second geometric features mutually covers,

a second condition that the first and the second geometric features mutually overlaps, and

a third condition that the first and the second geometric features mutually intersects; and

the responding unit generates an instruction signal according to whether the first relationship is satisfied, and the instruction signal causes the instruction device to generate a different sound wave, a different light wave or a different vibration wave.

37. An instruction device according to claim 32, wherein the reference feature is the reference parameter, and the relationship is a first relationship between the reference parameter and the first reaction medium.

38. An instruction device according to claim 37, wherein:

the reference parameter is one selected from a group consisting of a reference position, a reference geometric pattern, a geometric region and a reference signal; and

the communication is a specific operation being one selected from a group consisting of;

a first operation of communicating the instruction to the first reaction medium, and

a second operation of transmitting a feedback signal by the first reaction medium to the responding unit.

39. An instruction device for communicating an instruction and a first reaction medium, comprising an instructing unit configured to:

send out an instruction medium to temporarily generate a reference feature being one selected from a group consisting of a reference parameter, a positional reference and a reference signal; and

decide whether a communication between the instruction and the first reaction medium shall be conducted according to a relationship between the first reaction medium and the selected one of the reference parameter, the positional reference and the reference signal.

40. An instruction device according to claim 39, wherein:

the reference signal is one of a position and a region having a geometric feature being one of a geometric shape and a geometric profile;

the instructing unit further generates a geometric pattern similar to the geometric feature in response to the geometric feature of the region; and

the geometric pattern is one selected from a group consisting of a circle, an ellipse, a square, a triangle and a polygon.

41. An instruction communicating method for communicating an instruction and a first reaction medium, comprising steps of:

temporarily providing one selected from a group consisting of a reference parameter, a positional reference and a reference signal in response to an instruction medium; and

deciding whether a communication between the instruction and the first reaction medium shall be conducted based on a relationship between the first reaction medium and the selected one of the reference parameter, the positional reference and the reference signal.

42. An instruction communicating method according to claim 41, wherein the reference feature is the reference parameter, and the relationship is a first relationship between the reference parameter and the first reaction medium.

43. An instruction communicating method according to claim 41, wherein:

the reference feature is the positional reference being a reference position, and the relationship is a first relationship between the reference position and the first reaction medium;

the first reaction medium is located in a specific area;

the reference position is located in the specific area and is used to form a first region; and

the first reaction medium is located in the specific area and is used to form a second region.

44. An instruction communicating method according to claim 41, wherein:

the reference feature is the reference signal, and the relationship is a first relationship between the reference signal and the first reaction medium;

the instruction medium is a first motion;

the reference signal is a first position signal;

the reference signal is temporarily provided for a period between 0.1 seconds and 3 seconds;

the first reaction medium is located in a specific area;

the first position signal is located in the specific area and is used to form a first region;

the first reaction medium is located in the specific area and is used to form a second region; and

the instruction is communicated to the first reaction medium to cause the first reaction medium is in a function prepared status.

45. An instruction communicating method according to claim 44, further comprising steps of:

transforming the first motion into the first position signal;

transforming the first position signal into a first trajectory having a reference point;

communicating the instruction to the first reaction medium when the relationship between the first region and the second area is in a specific condition, wherein the specific condition is one selected from a group consisting of;

a first condition that the first region partially overlaps the second region,

a second condition that the first region entirely overlaps the second region,

a third condition that the first region entirely covers the second region, and

a fourth condition that a centroid of the first region is located within the second region;

transforming a second motion into a second trajectory; and

deciding whether a preset function of the first reaction medium is to be performed according to the second trajectory.

46. An instruction communicating method according to claim 45, further comprising steps of:

starting the first motion having a posture;

initializing the reference point of the first trajectory; and

correlating with the posture of the first motion for performing a calibration and a compensation for the reference point.

47. An instruction device for communicating an instruction and a first reaction medium, comprising:

a first responding unit generating a signal in response to an instruction medium; and

a second responding unit generating at least two positional references in response to the signal for a decision whether a communication between the instruction and the first reaction medium shall be conducted according to a relationship between the first reaction medium and the at least two positional references.

48. An instruction device for communicating an instruction and a first reaction medium, comprising an instructing unit configured to send an instruction medium to generate at least two reference signals for a decision whether a communication between the instruction and the first reaction medium shall be conducted according to a relationship between the at least two reference signals and the first reaction medium.

49. An instruction device for communicating an instruction and a first reaction medium, comprising:

a first responding unit generating a signal in response to an instruction medium; and

a second responding unit temporarily generating one selected from a group consisting of a reference parameter, a positional reference and a reference signal in response to the signal for a decision whether a communication between the instruction and the first reaction medium shall be conducted according to a relationship between the first reaction medium and the selected one of the reference parameter, the positional reference and the reference signal.

50. An instruction device for communicating an instruction and a first reaction medium, comprising:

a notifying unit causing generated a corresponding signal in response to an instruction medium; and

a responding unit generating one selected from a group consisting of a reference parameter, a positional reference and a reference signal in response to the corresponding signal for a decision whether a communication between the instruction and the first reaction medium shall be conducted according to a relationship between the first reaction medium and the selected one of a reference parameter, a positional reference and a reference signal.