Device and method for performing a functionality

• US 9,791,896 B2
• Filed: 11/26/2012
• Issued: 10/17/2017
• Est. Priority Date: 07/13/2012
• Status: Active Grant

• Current Assignee: Symbol Technologies, LLC (Zebra Technologies Corporation)
• Original Assignee: Symbol Technologies, LLC (Zebra Technologies Corporation)
• Inventors: Martin, Richard M., Choi, Jaeho, Jenkins, Ian R., Karnas, Adam J., MacGregor, Shane E., Spiro, Alexander R., Tsiopanos, Konstantinos D.
• Primary Examiner(s): EARLES, BRYAN E
• Application Number:
  US13/684,658
• Publication Number:
  US 20140145925A1
• Time in Patent Office: 1,786 Days
• Field of Search: 345156
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus

Abstract

A device and method performs a predefined functionality. The method includes generating a first view including selectable elements corresponding to a predefined functionality with first position data and first orientation data shown on a display device. The method includes determining a movement of the display device relative to a user. The method includes generating a second view including at least one of the selectable elements with second position data and second orientation data based on the first image data and the movement data, the second position and orientation data being the same as the first position and orientation data, respectively, relative to the user. The method includes selecting one of the at least one of the selectable elements of the second view as a function of the second position data and the second orientation data and executing the predefined functionality corresponding to the selected one of the selectable elements.

Claims

1. A method, comprising:

generating first image data indicative of a first view shown on a display device of a mobile unit (MU), the first view including a plurality of selectable elements, each selectable element configured to execute a predefined functionality, the first image data including first position data and first orientation data for each of the selectable elements;

determining movement data indicative of a movement of the display device relative to an external physical feature viewed by an image sensor of the MU;

generating second image data indicative of a second view shown on the display device as a function of the first image data and the movement data, the second view including at least one of the selectable elements, the second image data including second position data and second orientation data for each of the at least one of the selectable elements, the second position data and the second orientation data remaining the same as the first position data and the first orientation data, respectively, relative to the external physical feature viewed by the image sensor of the MU as the display device is moved;

selecting one of the at least one of the selectable elements of the second view as a function of the second position data, the second orientation data, and the movement data indicative of the movement of the display device; and

executing the predefined functionality corresponding to the selected one of the selectable elements,

wherein,

in response to a translational movement of the MU, the second position data is maintained the same as the first position data relative to the external physical feature viewed by the image sensor of the MU by determining at least one of a portion of the first view, including a first subset of the plurality of selectable elements, to be removed from the second view and a further view, including a second subset of the plurality of selectable elements, to be added to the first view as part of the second view.

2. The method of claim 1, wherein the movement is one of the translational movement, a rotational movement, and a combination thereof, wherein the translational movement is one of an upward movement, a downward movement, a leftward movement, a rightward movement, and a combination thereof.

3. The method of claim 1, wherein the external physical feature is the user as viewed from a front facing camera the MU.

4. The method of claim 2, wherein the rotational movement includes a yaw movement, and wherein the determining step further includes determining a pitch movement, a roll movement, and a combination thereof, whereupon the generating step includes changing a selection indication of a selectable element.

5. The method of claim 4, wherein, when the pitch or roll movement cause a sizing change of an image displayed on the display device.

6. The method of claim 1, wherein the second image data is generated continuously throughout the movement of the display device.

7. The method of claim 1, further comprising:

generating selection image data for the selected one of the at least one of the selectable elements, the selection image data including at least one visual feature, wherein when the visual feature continuously selects an element for a predetermined amount of time, the predefined functionality of that selected element is executed automatically.

8. The method of claim 7, wherein the at least visual feature includes an increase in size, a change in color, a highlight around the selected selectable element, and a combination thereof.

9. The method of claim 7, further comprising:

generating deselection image data for a previously selected one of the at least one of the selectable elements, the deselection image data removing the at least one visual feature.

10. The method of claim 1, wherein the functionality is executed one of automatically and manually.

11. A mobile unit (MU), comprising:

a display device configured to show first image data indicative of a first view shown thereon, the first view including a plurality of selectable elements, each selectable element configured to execute a predefined functionality, the first image data including first position data and first orientation data for each of the selectable elements;

a processor configured to generate the first image data, the processor further configured to execute the predefined functionality;

a memory storing the first image data; and

an image sensor configured to generate movement data indicative of a movement of the display device relative to an external physical feature viewed by the image sensor of the MU, wherein the processor is configured to generate second image data indicative of a second view shown on the display device as a function of the first image data and the movement data, the second view including at least one of the selectable elements, the second image data including second position data and second orientation data for each of the at least one of the selectable elements, the second position data and the second orientation data remaining the same as the first position data and the first orientation data, respectively, relative to the external physical feature viewed by the image sensor of the MU as the display device is moved, wherein the processor is configured to select one of the at least one of the selectable elements of the second view as a function of the second position data, the second orientation data, and the movement data indicative of the movement of the display device, and wherein the processor is configured to execute the predefined functionality corresponding to the selected one of the selectable elements,

wherein,

in response to a translational movement of the MU, the second position data is maintained the same as the first position data relative to the external physical feature viewed by the image sensor of the MU by determining at least one of a portion of the first view, including a first subset of the plurality of selectable elements, to be removed from the second view and a further view, including a second subset of the plurality of selectable elements, to be added to the first view as part of the second view.

12. The MU of claim 11, wherein the movement is one of the translational movement, a rotational movement, and a combination thereof, and wherein the translational movement is one of an upward movement, a downward movement, a leftward movement, a rightward movement, and a combination thereof.

13. The MU of claim 11, wherein the external physical feature is the user as viewed from a front facing camera the MU.

14. The MU of claim 11, wherein the rotational movement is defined as a yaw movement, and wherein the determining step further includes determining a further a pitch movement, a roll movement, and a combination thereof, whereupon the generating step includes changing a selection indication of a selectable element.

15. The MU of claim 14, wherein, when the pitch or roll movement cause a sizing change of an image displayed on the display device.

16. The MU of claim 11, wherein the processor is configured to continuously generate the second image data throughout the movement of the display device.

17. The MU of claim 11, wherein the processor is configured to generate selection image data for the selected one of the at least one of the selectable elements, the selection image data including at least one visual feature, wherein when the visual feature continuously selects an element for a predetermined amount of time, the predefined functionality of that selected element is executed automatically.

18. The MU of claim 17, wherein the at least visual feature includes an increase in size, a change in color, a highlight around the selected selectable element, and a combination thereof.

19. The MU of claim 17, wherein the processor is configured to generate deselection image date for a previously selected one of the at least one of the selectable elements, the deselection image data removing the at least one visual feature.