ELECTRONIC SYSTEMS WITH TOUCH FREE INPUT DEVICES AND ASSOCIATED METHODS

• US 20120262366A1
• Filed: 01/03/2012
• Published: 10/18/2012
• Est. Priority Date: 04/15/2011
• Status: Abandoned Application

• Current Assignee: Ingeonix Corporation
• Original Assignee: Ingeonix Corporation
• Inventors: Zhu, Yanning, Fadeev, Aleksey
• Application Number:
  US13/342,554
• Publication Number:
  US 20120262366A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/0331 Finger worn pointing device
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0308 comprising a plurality of distinctive and separately oriented light emitters or reflectors associated to the pointing device, e.g. remote cursor controller with distinct and separately oriented LEDs at the tip whose radiations are captured by a photo-detector associated to the screen
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G09G 2320/106 Determination of movement vectors or equivalent parameters within the image
• CPC Class Codes: G09G 5/08 Cursor circuits
• CPC Class Codes: G09G 5/363 Graphics controllers

Abstract

Embodiments of electronic systems, devices, and associated methods of operation are described herein. In one embodiment, a computing system includes an input module configured to acquire images of an input device from a camera, the input device having a plurality of markers. The computing system also includes a sensing module configured to identify segments in the individual acquired images corresponding to the markers. The computing system further includes a calculation module configured to form a temporal trajectory of the input device based on the identified segments and an analysis module configured to correlate the formed temporal trajectory with a computing command.

Claims

1. A computer-implemented method, comprising:

acquiring images of an input device with a camera, the input device being on a finger of a user and having a plurality of markers;

identifying segments in the individual acquired images, the identified segments corresponding to the markers;

forming a temporal trajectory of the input device based on the identified segments in the individual acquired images;

correlating the formed temporal trajectory with a computing command; and

executing the computing command by a processor.

2. The method of claim 1 wherein acquiring images of the input device includes acquiring a plurality of frames of the input device with a camera coupled to the processor.

3. The method of claim 1 wherein identifying segments includes:

comparing an intensity value of a pixel of the individual acquired images to a preset threshold; and

if the intensity value of the pixel is greater than the preset threshold, indicating the pixel corresponds to one of the markers.

4. The method of claim 1 wherein identifying segments includes:

comparing a shape and/or a size range of segmented pixels in the individual acquired images to a preset shape and/or size range, respectively; and

if the shape and/or size range of the segmented pixels generally matches the preset shape and/or size range, respectively, indicating the pixels corresponds to the markers.

5. The method of claim 1, further comprising, for each of the acquired images, analyzing the identified segments to determine an orientation of the input device based on a dimension of the input device and an arrangement of the markers on the input device.

6. The method of claim 1, further comprising, for each of the acquired images:

calculating a pairwise distance for individual pairs of markers in the acquired image;

performing a comparison of the calculated pairwise distance with predetermined pairwise distances based on a dimension of the input device, an arrangement of the markers on the input device, and possible orientations of the input device relative to the camera; and

determining an orientation of the input device relative to the camera based on the comparison.

7. The method of claim 6, further comprising calculating a distance of the input device from the camera based on the determined orientation of the input device.

8. The method of claim 1, further comprising:

identifying a number of visible markers in acquired images based on the identified segments in the acquired image; and

calculating the pairwise distance includes calculating a pairwise distance for individual pairs of visible markers in the acquired image based on the identified number of visible markers.

9. The method of claim 1, wherein forming the temporal trajectory includes identifying an orientation and position of the input device over time, and the method further includes identifying a user action based on characteristics of the temporal trajectory.

10. The method of claim 1, wherein forming the temporal trajectory includes identifying an orientation and position of the input device over time, and the method further includes identifying a user action based on characteristics of the temporal trajectory, the characteristics including at least one of a travel distance, travel direction, velocity, speed, and direction reversal.

11. The method of claim 1 wherein:

the input device is a first input device on a first finger of the user;

the identified segments are first identified segments;

the formed temporal trajectory is a first temporal trajectory;

acquiring images includes;

acquiring images of the first input device and a second input device with the camera, the second input device being on a second finger of the user, the second finger being different than the first finger;

the method further includes;

identifying second segments in the individual images, the identified segments corresponding to the markers of the second input device;

forming a second temporal trajectory based on the second identified segments; and

correlating the formed temporal trajectory includes correlating a combination of the first and second temporal trajectories to the computing command.

12. An electronic system, comprising:

a detector configured to detect an input device having a plurality of markers individually configured to emit a signal to form a signal pattern; and

a controller operatively coupled to the detector, the controller having a computer-readable storage medium containing instructions for performing a method comprising;

receiving input data from the detector, the input data indicating the detected signal pattern from the markers;

analyzing the signal pattern to identify at least one of an orientation and position of the input device relative to the detector based on a dimension of the input device and an arrangement of the markers;

identifying a computing command based at least in part on at least one of the identified orientation and position of the input device relative to the detector; and

executing the computing command with the processor.

13. The electronic system of claim 12, further comprising the input device having the plurality of markers.

14. The electronic system of claim 12 wherein the signal pattern includes a plurality of discrete signals, and wherein analyzing the signal pattern includes identifying a number of visible markers in the received input data based on a number of discrete signals.

15. The electronic system of claim 12 wherein:

the signal pattern includes a plurality of discrete signals;

analyzing the signal pattern includes;

identifying a number of visible markers in the received input data based on a number of discrete signals; and

calculating a pairwise distance for individual pairs of visible markers in the acquired image.

16. The electronic system of claim 15 wherein analyzing the signal pattern also includes:

performing a comparison of the calculated pairwise distance with predetermined pairwise distances based on a dimension of the input device, an arrangement of the markers on the input device, and possible orientations of the input device relative to the detector; and

determining an orientation of the input device relative to the detector based on the comparison.

17. The electronic system of claim 12 wherein identifying the computing command further includes:

repeating the receiving and analyzing operations to obtain at least one of an orientation and position of the input device relative to the detector as a function of time; and

correlating the at least one of an orientation and position of the input device relative to the detector as a function of time with the computing command.

18. The electronic system of claim 12 wherein identifying the computing command further includes:

repeating the receiving and analyzing operations to obtain at least one of an orientation and position of the input device relative to the detector as a function of time;

determining at least one of a travel distance, travel direction, velocity, speed, and direction reversal of the input device based on the at least one of an orientation and position of the input device relative to the detector as a function of time; and

correlating the determined at least one of a travel distance, travel direction, velocity, speed, and direction reversal with the computing command.

19. A computing system, comprising:

an input module configured to acquire images of an input device from a camera, the input device having a plurality of markers;

a sensing module configured to identify segments in the individual acquired images, the identified segments corresponding to the markers;

a calculation module configured to form a temporal trajectory of the input device based on the identified segments in the individual acquired images; and

an analysis module configured to correlate the formed temporal trajectory with a computing command.

20. The computing system of claim 19 wherein the sensing module is configured to:

compare an intensity value of a pixel of the individual acquired images to a preset threshold; and

if the intensity value of the pixel is greater than the preset threshold, indicate the pixel corresponds to one of the markers.

21. The computing system of claim 19 wherein the sensing module is configured to:

compare a shape of pixels in the individual acquired images to a preset shape; and

if the shape of the pixels generally matches the preset shape, indicate the pixels corresponds to the markers.

22. The computing system of claim 19 wherein the calculation module is also configured to determine an orientation of the input device based on a dimension of the input device and an arrangement of the markers on the input device.

23. The computing system of claim 19 wherein the calculation module is also configured to:

calculate a pairwise distance for individual pairs of markers in the acquired image;

perform a comparison of the calculated pairwise distance with predetermined pairwise distances based on a dimension of the input device, an arrangement of the markers on the input device, and possible orientations of the input device relative to the camera; and

determine an orientation of the input device relative to the camera based on the comparison.

24. The computing system of claim 23 wherein the calculation module is also configured to calculate a distance of the input device from the camera based on the determined orientation of the input device.

25. The computing system of claim 19 wherein the calculation module is also configured to:

identify a number of visible markers in acquired images based on the identified segments in the acquired image; and

calculate a pairwise distance for individual pairs of visible markers in the acquired image based on the identified number of visible markers.

26. The computing system of claim 19 wherein the calculation module is also configured to identify temporal trajectory of the input device, and wherein the analysis module is also configured to identify a user action based on characteristics of the temporal trajectory, the characteristics including at least one of a travel distance, travel direction, velocity, speed, and direction reversal.

27. A kit, comprising:

a ring having a plurality of light emitting diodes (LEDs) individually configured to emit a light to form a pattern; and

a computer-readable storage medium containing instructions, when executed by a processor, causing the processor to perform a method comprising;

receiving images of the ring from a camera coupled to the processor;

identifying segments in the individual images, the identified segments corresponding to the LEDs;

analyzing the identified segments to identify at least one of an orientation and position of the ring relative to the camera based on a dimension of the ring and an arrangement of the LEDs;

forming a temporal trajectory of the ring based on the identified segments in the individual acquired images;

correlating the temporal trajectory with a control command; and

supplying the correlated control command to an operating system of the processor.

28. The kit of claim 27 wherein the ring includes an internal chamber and a battery in the internal chamber, and wherein the battery is electrically coupled to the LEDs.

29. The kit of claim 27 wherein:

the ring includes a first side, a second side, and an aperture extending between the first and second sides;

the first side is generally parallel to the second side; and

the LEDs are located proximate the first side.

30. The kit of claim 27 wherein:

the ring includes a first side, a second side, and an aperture extending between the first and second sides;

the first side is generally parallel to the second side;

the ring also includes a beveled surface between the first and second sides; and

at least one of the LEDs is located on the beveled surface.