Real-time perspective correction

• US 9,294,679 B1
• Filed: 11/26/2014
• Issued: 03/22/2016
• Est. Priority Date: 11/26/2014
• Status: Active Grant

• Current Assignee: Visual Supply Company
• Original Assignee: Visual Supply Company
• Inventors: Hodges, Zachary Daniel, Newport, Robert A.
• Primary Examiner(s): Spinks, Antoinette
• Application Number:
  US14/555,200
• Time in Patent Office: 482 Days
• Field of Search: 348/333.12
• US Class Current: 1/1
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming

Abstract

A system and method for correcting the perspective of visual data in real-time is disclosed. A electronic device accesses live visual data through a camera associated with an electronic device. The electronic device displays the live visual data on a display associated with the electronic device. The electronic device detects tilt data from a sensor associated with the electronic device, wherein tilt data indicates that the electronic device has tilted from an original angle to a current angle. In response to detecting tilt data from the sensor associated with the electronic device, the electronic devices alters the displayed live visual data to correct a live perspective of a live video feed.

Claims

1. A method comprising:

accessing one or more predetermined static variables associated with visual data alteration;

accessing live visual data through a camera associated with an electronic device;

displaying the live visual data on a display associated with the electronic device;

detecting tilt data from a motion sensor associated with the electronic device, wherein tilt data indicates that the electronic device has tilted from an original angle to a current angle;

selecting one or more predetermined static variables from the received one or more predetermined static variables based on the detected tilt data and the live visual data; and

in response to detecting tilt data from the motion sensor associated with the electronic device, automatically altering the incoming live visual data by expanding one or more first portions of the displayed live visual data and reducing one or more second portions of the displayed live visual data such that the altered live visual data appears to have a different perspective than the original live visual data, wherein altering the incoming live visual data includes using the selected predetermined static values in a transform matrix to alter the live visual data.

2. The method of claim 1, further comprising:

displaying the altered live visual data on the display associated with the electronic device.

3. The method of claim 1, wherein altering the incoming live visual data is performed in real time and the displayed visual data is updated in real-time.

4. The method of claim 1, further including, detecting further tilt data and continually altering the incoming visual data in accordance with the detected further tilt data.

5. The method of claim 1, wherein the motion sensor is an accelerometer.

6. The method of claim 1, wherein the motion sensor is a gyroscope.

7. The method of claim 1, wherein altering the incoming live visual data includes applying a transform matrix to each (x,y) coordinate position of each pixel of the live visual feed.

8. The method of claim 1, wherein the predetermined static variables include at least one of one or more perspective exaggerator values, one or more perspective multiplier values, and a perspective optimizer.

9. A system comprising:

one or more processors configured to include;

a data accessing module to access one or more predetermined static variables associated with visual data alteration;

an accessing module to access live visual data through a camera associated with an electronic device;

a display module to display the live visual data on a display associated with the electronic device;

a detection module to detect tilt data from a motion sensor associated with the electronic device, wherein tilt data indicates that the electronic device has tilted from an original angle to a current angle;

a selection module to select one or more predetermined static variables from the received one or more predetermined static variables based on the detected tilt data and the live visual data; and

an alteration module to, in response to detecting tilt data from the motion sensor associated with the electronic device, automatically alter the incoming live visual data by expanding one or more first portions of the displayed live visual data and reducing one or more second portions of the incoming live visual data such that the altered live visual data appears to have a different perspective than the original live visual data, wherein altering the incoming live visual data includes using the selected predetermined static values in a transform matrix to alter the live visual data.

10. The system of claim 9, further including:

an altered display module to display the altered live visual data on the display associated with the electronic device.

11. The system of claim 9, wherein altering the incoming live visual data is performed in real time and the displayed visual data is updated in real-time.

12. The system of claim 9, further including:

a detection module to detect further tilt data and continually altering the incoming visual data in accordance with the detected further tilt data.

13. The system of claim 9, wherein altering the displayed live visual data includes applying a transform matrix to each (x,y) coordinate position of each pixel of the live visual feed.

14. The system of claim 9, wherein the predetermined static variables include at least one of one or more perspective exaggerator values, one or more perspective multiplier values, and a perspective optimizer.

15. A non-transitory computer-readable storage medium storing instructions that, when executed by the one or more processors of a machine, cause the machine to perform operations comprising:

accessing one or more predetermined static variables associated with visual data alteration;

accessing live visual data through a camera associated with an electronic device;

displaying the live visual data on a display associated with the electronic device;

detecting tilt data from a motion sensor associated with the electronic device, wherein tilt data indicates that the electronic device has tilted from an original angle to a current angle;

selecting one or more predetermined static variables from the received one or more predetermined static variables based on the detected tilt data and the live visual data; and

in response to detecting tilt data from the motion sensor associated with the electronic device, automatically altering the incoming live visual data by expanding one or more first portions of the displayed live visual data and reducing one or more second portions of the displayed live visual data such that the altered live visual data appears to have a different perspective than the original live visual data, wherein altering the incoming live visual data includes using the selected predetermined static values in a transform matrix to alter the live visual data.

16. The non-transitory computer-readable storage medium of claim 15, further comprising:

displaying the altered live visual data on the display associated with the electronic device.

17. The non-transitory computer-readable storage medium of claim 15, wherein altering the incoming live visual data is performed in real time and the displayed visual data is updated in real-time.

18. The non-transitory computer-readable storage medium of claim 15, further including, detecting further tilt data and continually altering the incoming visual data in accordance with the detected further tilt data.