Mobile device with wide-angle optics and a radiation sensor

• US 20090297062A1
• Filed: 05/19/2009
• Published: 12/03/2009
• Est. Priority Date: 03/04/2005
• Status: Abandoned Application

• Current Assignee: Motionip LLC
• Original Assignee: Motionip LLC
• Inventors: Pylkko, Heikki, Carsanaro, Joseph A., Molne, Anders L.
• Application Number:
  US12/454,562
• Publication Number:
  US 20090297062A1
• Time in Patent Office: Days
• US Class Current: 382/289
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: H04M 1/2747 Scrolling on a display
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion
• CPC Class Codes: H04M 2250/52 including functional features of a camera

Abstract

A method and device for displaying content using an integral or remote controller for navigating the content based on dynamic image analysis of the motion of the controller, for example, by tilting. The controller is equipped with wide-angle optics and with a radiation sensor detecting either visible light or infrared radiation. The wide-angle optics may be directed towards the user, whereupon the radiation sensor receives useful images through the wide-angle optics. The images include contrast or thermal differences which it make possible to determine in which way the user has moved the controller. In more detail, a tilt angle or a corresponding change can be calculated and then, on the basis of the change, the content shown on a display is altered. The content is, for example, a menu, game scene or a web page.

Claims

1. A method for using a handheld device for controlling content displayed on an electronic display, comprising the steps of:

acquiring a first image at a digital imager integral to said handheld device through a wide-angle lens and storing said first image in a memory;

acquiring a second image at said digital imager through said wide-angle lens and storing said second image in said memory;

analyzing said first image to resolve an image feature contained in said first image;

analyzing said second image to resolve said image feature also contained in said second image;

calculating an offset distance between said image feature in said first image to said image feature in said second image;

altering content displayed on said electronic display in accordance with said calculated offset distance.

2. The method for using a handheld device according to claim 1, wherein said offset distance represents a tilt angle of said handheld device.

3. The method for using a handheld device according to claim 1, wherein said offset distance represents linear movement of said handheld device.

4. The method for using a handheld device according to claim 1, wherein said offset distance represents a combination of tilt angle and linear movement of said handheld device.

5. The method for using a handheld device according to claim 1, wherein said content displayed on said electronic display comprises a menu tree of a plurality of selection options and said step of altering said content displayed on said electronic display comprises scrolling through said plurality of selection options in accordance with said calculated offset distance.

6. The method for using a handheld device according to claim 1, wherein said content displayed on said electronic display comprises a cursor and said step of altering said content displayed on said electronic display comprises moving said cursor in accordance with said calculated offset distance.

7. The method for using a handheld device according to claim 1, wherein said content displayed on said electronic display comprises a background scene and said step of altering said content displayed on said electronic display comprises moving said background scene in accordance with said calculated offset distance.

8. The method for using a handheld device according to claim 1, wherein said content displayed on said electronic display comprises an icon against a background environment and said step of altering said content displayed on said electronic display comprises moving said icon through said background environment in accordance with said calculated offset distance.

18. The method for using a handheld device according to claim 1, wherein said content displayed on said electronic display comprises an icon against a background environment and said step of altering said content displayed on said electronic display comprises moving said icon through said background environment in accordance with said calculated offset distance.

9. A method for using a handheld device for controlling content displayed on an electronic display, comprising the steps of:

acquiring a first image at a digital imager integral to said handheld device through a wide-angle lens and storing said first image in a memory;

acquiring a second image at said digital imager through said wide-angle lens and storing said second image in said memory;

acquiring a third image at said digital imager through said wide-angle lens and storing said second image in said memory;

analyzing said first image to resolve an image feature contained in said first image;

analyzing said second image to resolve said image feature also contained in said second image;

analyzing said third image to resolve said image feature also contained in said third image;

calculating a first offset distance and a first offset direction between said image feature in said first image to said image feature in said second image;

calculating a second offset distance and a second offset direction between said image feature in said second image to said image feature in said third image;

altering content displayed on said electronic display in accordance with said calculated first and second offset distances and first and second offset directions.

10. The method for using a handheld device according to claim 9, further comprising a step analyzing said first offset distance and first offset direction and said second offset distance and second offset direction to determine a tilt angle of said handheld device.

11. The method for using a handheld device according to claim 9, further comprising a step analyzing said first offset distance and first offset direction and said second offset distance and second offset direction to determine linear translation of said handheld device.

12. The method for using a handheld device according to claim 9, further comprising a step analyzing said first offset distance and first offset direction and said second offset distance and second offset direction to determine both tilt angle and linear translation of said handheld device.

13. The method for using a handheld device according to claim 9, wherein said steps of acquiring said first image, acquiring said second image, and acquiring said third image at said digital imager all further comprise acquiring sequential frame video images.

14. The method for using a handheld device according to claim 13, wherein said sequential frame video images are stored in a standard PCM-based video format.

15. The method for using a handheld device according to claim 9, wherein said content displayed on said electronic display comprises a menu tree of a plurality of selection options and said step of altering said content displayed on said electronic display comprises scrolling through said plurality of selection options in accordance with said calculated offset distance.

16. The method for using a handheld device according to claim 9, wherein said content displayed on said electronic display comprises a cursor and said step of altering said content displayed on said electronic display comprises moving said cursor in accordance with said calculated offset distance.

17. The method for using a handheld device according to claim 9, wherein said content displayed on said electronic display comprises a background scene and said step of altering said content displayed on said electronic display comprises moving said background scene in accordance with said calculated offset distance.

19. In a handheld device comprising a processor, memory, and an electronic display for showing content, a content navigation system for altering content displayed on said electronic display in accordance with motion of said handheld device, said content navigation system further comprising:

a digital imager including wide-angle optics and a pixel-array imager for acquiring a plurality of sequential images and storing said images in said memory; and

software resident in said memory for instructing said processor to analyze said plurality of acquired images to detect an image feature common to said plurality of acquired images, for calculating an offset distance between said image feature on said plurality of acquired images, and for altering content displayed on said electronic display in accordance with said calculated offset distance.

20. The handheld device according to claim 19, wherein said pixel-array imager comprises any one from among the group consisting of a CCD imager, CMOS imager.

21. The handheld device according to claim 19, wherein said pixel-array imager comprises a radiation sensor.

22. The handheld device according to claim 20, wherein said wide-angle optics comprises a wide field lens.

23. The handheld device according to claim 21, wherein said wide-angle optics comprises a slot.

24. The handheld device according to claim 21, wherein said software resident in said memory detects a pixel pattern common to said plurality of acquired images.

25. The handheld device according to claim 21, wherein said software resident in said memory detects a pixel pattern common to said plurality of acquired images by a best-fit pixel comparison.

26. In a device comprising a processor, memory, a handheld controller in communication with said processor, and an electronic display for showing content, a content navigation system for altering content displayed on said electronic display in accordance with motion of said handheld device, said content navigation system further comprising:

a digital imager integral to said controller and including wide-angle optics and a pixel-array imager for acquiring a plurality of sequential widefield images and communicating and storing said images in said memory; and

software resident in said memory for instructing said processor to analyze said plurality of acquired images to detect an image feature common to said plurality of acquired images, for calculating an offset distance between said image feature on said plurality of acquired images, and for altering content displayed on said electronic display in accordance with said calculated offset distance.

27. The device according to claim 26, wherein said pixel-array imager comprises a CCD imager.

28. The device according to claim 26, wherein said pixel-array imager comprises a radiation sensor.

29. The device according to claim 27, wherein said wide-angle optics comprises a wide field lens.

30. The device according to claim 28, wherein said wide-angle optics comprises a slot.

31. The device according to claim 26, wherein said software resident in said memory detects a pixel pattern common to said plurality of acquired images.

32. The device according to claim 26, wherein said software resident in said memory detects a pixel pattern common to said plurality of acquired images by a best-fit pixel comparison.