Portable hand-held device for manipulating images

• US 9,060,128 B2
• Filed: 09/15/2012
• Issued: 06/16/2015
• Est. Priority Date: 07/15/1997
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Silverbrook, Kia, Lapstun, Paul
• Primary Examiner(s): NGUYEN, LUONG TRUNG
• Application Number:
  US13/620,891
• Publication Number:
  US 20130016241A1
• Time in Patent Office: 1,004 Days
• US Class Current: 1/1
• CPC Class Codes: G03B 29/00 Combinations of cameras, projectors or photographic printing apparatus with non-photographic non-optical apparatus, e.g. clocks or weapons; Cameras having the shape of other objects combinations with flash apparatus G03B15/03
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/682 Vibration or motion blur correction

Abstract

A portable hand-held apparatus is provided having a memory for storing images, a motion sensor for detecting motion of the device, and a processor for receiving image manipulation instructions via encoded media. The processor processes the stored images based on the detected device motion and the received image manipulation instructions to produce output images.

Claims

1. A portable handheld device, comprising:

a memory that stores images including a first stored image;

a motion sensor that generates motion data based on detecting motion of the portable handheld device relative to an external environment in at least two dimensions, the motion data corresponding to a time when the first stored image was captured;

a processor; and

a light source that illuminates an image representative of a manipulation to the first stored image, wherein the image representative of a manipulation is converted to an electrical signal communicated to the processor;

wherein the processor;

estimates an angular velocity of the portable handheld device at the time when the first stored image was captured, the angular velocity being estimated using the motion data generated by the motion sensor,

receives the electrical signal, and

processes the first stored image to produce an output image based on the angular velocity of the portable handheld device at the time when the first stored image was captured and based on the electrical signal.

2. The portable handheld device according to claim 1, wherein the motion sensor detects motion in two dimensions.

3. The portable handheld device according to claim 2, wherein the motion sensor is an accelerometer.

4. The portable handheld device according to claim 1, wherein the image representative of the manipulation is received via encoded media.

5. The portable handheld device according to claim 3, wherein the accelerometer comprises a micro-electro mechanical device.

6. The portable handheld device according to claim 1, further comprising:

an image sensor adapted to capture a still, blurred image comprising at least one blurred pixel.

7. The portable handheld device according to claim 1, wherein the electrical signal comprises instructions for manipulation of blurred images.

8. A method, comprising:

storing an image of a scene including a first stored image;

generating motion data based on detecting motion of a portable handheld device relative to an external environment in at least two dimensions by at least one motion sensor, the motion data corresponding to a time when the first stored image was captured;

estimating an angular velocity of the portable handheld device at the time corresponding to when the when the first stored image was captured, the angular velocity being estimated using the motion data generated by the at least one motion sensor;

illuminating an image representative of a manipulation to the first stored image;

converting the image representative of the manipulation to an electrical signal; and

processing the first stored image to remove blur in the first stored image based on the angular velocity of the portable handheld device at the time when the first stored image was captured and the electrical signal.

9. The method according to claim 8, wherein the at least one motion sensor detects motion in two dimensions.

10. The method according to claim 8, wherein the at least one motion sensor is an accelerometer.

11. The method according to claim 10, wherein the accelerometer comprises a micro-electro mechanical device.

12. The method according to claim 8, wherein the image representative of the manipulation is encoded on encoded media.

13. The method according to claim 8, wherein an image sensor is adapted to capture the first stored image, which comprises a still, blurred image that includes at least one blurred pixel.

14. The method according to claim 8, wherein the electrical signal comprises instructions for manipulation of blurred images.

15. An apparatus comprising:

a memory; and

a processor that;

receives image data of a scene from the memory;

receives motion data that is based on detecting motion of the apparatus relative to an external environment in at least two dimensions, the motion data generated by at least one motion sensor;

estimates an angular velocity of the apparatus at a time when the image data was captured, the angular velocity being estimated using the motion data generated by the at least one motion sensor;

illuminates an image representative of a manipulation to the image data;

converts the image representative of the manipulation to an electrical signal; and

processes the image data to remove blur in the image data based on the angular velocity of the apparatus at the time when the image data was captured and based on the electrical signal.

16. The apparatus according to claim 15, wherein the at least one motion sensor comprises an accelerometer.