ELECTRONIC DEVICE AND A METHOD FOR CONTROLLING THE FUNCTIONS OF THE ELECTRONIC DEVICE AS WELL AS PROGRAM PRODUCT FOR IMPLEMENTING THE METHOD

• US 20150138090A1
• Filed: 01/22/2015
• Published: 05/21/2015
• Est. Priority Date: 08/17/2004
• Status: Active Grant

• Current Assignee: Conversant Wireless Licensing S.à.r.l. (f/k/a Core Wireless Licensing S.a.r.l.) (MOSAID Technologies Inc. (f/k/a Conversant Intellectual Property Management))
• Original Assignee: Core Wiresless Licensing SARL (MOSAID Technologies Inc. (f/k/a Conversant Intellectual Property Management))
• Inventors: Laine, Tommi, Onkalo, Miia, BLOMQVIST, Mikko
• Granted Patent: US 10,126,834 B2
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations

Abstract

The invention relates to an electronic device, which includes a display component, in which at least one controllable element is arranged to be visualized in its entirety, the control of which element is arranged to be based on determining a change (M) relating to the attitude or position of the device and camera means arranged to form image frames (IMAGE1, IMAGE2), and in which, in order to control the functions of the device, such as, for example, to control the element, the change is arranged to be determined, using optical data-flow algorithms, from the image frames formed by the camera means, which image frames are arranged to be compared to each other in a set manner, and on the basis of which comparison the said change is arranged to be determined. The image frames are arranged to be segmented in a selected manner, from which at least one movement vector (S_R, S_L, S_Up, S_Down) determining the said change is arranged to be determined from at least some of the segments (SEGMENT1, SEGMENT2).

Claims

1. A portable apparatus comprising:

a display configured to show a visual controllable element;

a camera unit configured to capture a plurality of consecutive images;

memory including program code;

a processor; and

the memory and the program code being configured with the processor to cause the portable apparatus, in one of a plurality of operating situations, wherein one of the plurality of operating situation is defined based on a movement speed of the portable apparatus, to perform;

dividing a first image of the plurality of consecutive images into a plurality of segments;

selecting a fixed point from the first image;

determining a location coordinate of the selected fixed point;

dividing a second image of the plurality of consecutive images into a plurality of segments, the second image being the next image following the first image of the plurality of consecutive images;

determining a location coordinate of the selected fixed point from the second image;

calculating a movement vector of the selected fixed point between the determined location coordinate of the first image and the determined location coordinate of the second image;

determining a three-dimensional change relative to at least the movement vector; and

controlling the visual controllable element on the display based on the three-dimensional change; and

adjusting an image frequency of the camera unit to at least the portable apparatus movement speed.