Activating Features on an Imaging Device Based on Manipulations

• US 20110199387A1
• Filed: 11/23/2010
• Published: 08/18/2011
• Est. Priority Date: 11/24/2009
• Status: Abandoned Application

• Current Assignee: Next Holdings Ltd. (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Next Holdings Ltd. (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Newton, John David
• Application Number:
  US12/952,580
• Publication Number:
  US 20110199387A1
• Time in Patent Office: Days
• US Class Current: 345/619
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Certain aspects and embodiments of the present invention relate to manipulating elements to control an imaging device. According to some embodiments, the imaging device includes a memory, a processor, and a photographic assembly. The photographic assembly includes sensors that can detect and image an object in a viewing area of the imaging device. One or more computer programs can be stored in the memory to determine whether identifiable elements used in the manipulation exist. Manipulations of these elements are compared to stored manipulations to locate a match. In response to locating a match, one or more functions that correspond to the manipulation can be activated on the imaging device. Examples of such functions include the zoom and focus features typically found in cameras, as well as features that are represented as “clickable” icons or other images that are superimposed on the screen of the imaging device.

Claims

1. A device comprising:

a memory;

a processor;

a photographic assembly comprising one or more sensors for detecting an image displayed in a viewing area; and

computer-executable instructions in the memory that configure the device to;

determine whether the image comprises one or more elements;

determine, from the image, a manipulation of the one or more elements;

compare a manipulation of the one or more elements to stored manipulations in memory to identify a manipulation that matches the manipulation of the one or more elements; and

in response to a match, perform a function on the imaging device that corresponds to the manipulation of the stored manipulations.

2. The device of claim 1 wherein determining the manipulation comprises identifying a virtual touch of an object displayed in the viewing area by the one or more elements.

3. The device of claim 2 wherein the object is a key on a keypad comprising a plurality of keys.

4. The device of claim 1 wherein the instructions further configure the device to store the stored manipulations in the memory, wherein storing comprises:

capturing the manipulation and one or more attributes associated with the manipulation;

assigning one or more functions to the manipulation; and

storing the manipulation, the function, and the one or more attributes in the memory.

5. The device of claim 1 wherein the manipulation of the one or more elements causes the processor to execute instructions to activate a zoom operation of the imaging device, wherein the manipulation comprises:

moving the one or more elements in a pinching motion;

or

moving an element of the one or more elements toward a screen of the imaging device then away from the screen of the imaging device;

or

moving the one or more elements in a rotation motion;

wherein a distance of the zoom operation is determined by one or more attributes of the manipulation, the one or more attributes comprising a speed of the moving the element.

6. The device of claim 1 wherein the manipulation of the one or more elements comprises rotating at least two elements in a circular motion, wherein the rotating activates the focus operation of the imaging device.

7. The device of claim 1 wherein the movement of the one or more elements comprises a swipe motion, wherein the swipe motion causes the processor to execute instructions to display a second image in place of a first image on a screen of the imaging device.

8. The device of claim 1 wherein the movement of the one or more elements comprise positioning an element of the one or more elements in a location that corresponds to an object on a screen of the imaging device, wherein the positioning causes the selection of the object displayed on the screen.

9. The device of claim 8 wherein the object is an icon.

10. The device of claim 1 wherein the match comprises prompting a user to confirm that the manipulation of the stored manipulations is a function intended to be performed by the manipulation of the one or more elements.

11. The device of claim 1 wherein the function that is performed is based on the type of the one or more elements.

12. The device of claim 1 wherein the manipulation of the one or more elements is located at a distance away from a surface of a screen of the imaging device.

13. The device of claim 1 wherein the device is a digital camera.

14. The device of claim 1 wherein the device comprises a mobile device.

15. The device of claim 1, wherein the instructions further configure the processor to determine the command based on actuation of one or more hardware keys or buttons of the device.

16. A computer-implemented method, comprising:

obtaining image data representing a viewing area of a device;

based on the image data, recognizing at least one element in the viewing area;

identifying, from the image data, a manipulation of the at least one element;

searching a set of stored manipulations for a matching manipulation that is the same as or substantially the same as the identified manipulation; and

carrying out a command that corresponds to the matching manipulation, if a matching manipulation is found.

17. The method of claim 16, further comprising storing a manipulation of the set of stored manipulations in the memory, wherein the storing comprises:

capturing the identified manipulation and one or more attributes associated with the identified manipulation;

assigning one or more functions to the identified manipulation; and

storing the identified manipulation, the one or more functions, and the one or more attributes in the memory.

18. A computer readable storage medium embodying computer programming logic that when executed on a processor performs the operations comprising:

determining whether an image comprises one or more elements;

determining, from the image, a manipulation of the one or more elements;

comparing a manipulation of the one or more elements to stored manipulations in memory to identify a manipulation that matches the manipulation of the one or more elements; and

in response to a match, performing a function on the imaging device that corresponds to the manipulation of the stored manipulation.

19. The computer readable storage medium of claim 18 wherein an object displayed in the viewing area receives a virtual touch from the one or more elements, wherein the touch is received at a location on the object that corresponds to a component within an image displayed on a screen of the imaging device, wherein the image is superimposed over the object, wherein the virtual touch causes selection of the component.

20. The computer readable storage medium of claim 18 further comprising storing manipulations in the memory, wherein the storing comprises:

capturing the manipulation of the one or more elements and one or more attributes associated with the manipulation;

assigning one or more functions to the manipulation; and

storing the manipulation, the function, and the one or more attributes in the memory.

21. The computer readable storage medium of claim 18 wherein the manipulation of the one or more elements activates a zoom operation of the imaging device, wherein the manipulation comprises:

moving the one or more elements in a pinching motion;

or

moving an element of the one or more elements toward a screen of the imaging device then away from the screen;

wherein a distance of the zoom operation is determined by one or more attributes of the manipulation, the one or more attributes comprising a speed of the moving the element.