Real-time perspective correction

• US 9,674,452 B2
• Filed: 02/25/2016
• Issued: 06/06/2017
• Est. Priority Date: 11/26/2014
• Status: Active Grant

• Current Assignee: Visual Supply Company
• Original Assignee: Visual Supply Company
• Inventors: Hodges, Zachary Daniel, Newport, Robert A.
• Primary Examiner(s): SPINKS, ANTOINETTE T
• Application Number:
  US15/053,776
• Publication Number:
  US 20160182831A1
• Time in Patent Office: 467 Days
• Field of Search: 34833312
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming

Abstract

A system and method for correcting the perspective of visual data in real-time is disclosed. A electronic device accesses live visual data through a camera associated with an electronic device. The electronic device displays the live visual data on a display associated with the electronic device. The electronic device detects tilt data from a sensor associated with the electronic device, wherein tilt data indicates that the electronic device has tilted from an original angle to a current angle. In response to detecting tilt data from the sensor associated with the electronic device, the electronic devices alters the displayed live visual data to correct a live perspective of a live video feed.

Claims

1. A method comprising:

accessing one or more predetermined static variables associated with visual data alteration;

accessing live visual data;

detecting tilt data from a motion sensor associated with an electronic device;

in response to detecting tilt data from the motion sensor associated with the electronic device, automatically altering the incoming live visual data using the accessed predetermined static values in a transform matrix to alter the live visual data based on the detected tilt data; and

displaying the altered live visual data on the electronic device.

2. The method of claim 1, wherein altering the incoming live visual data is performed in real time and the displayed visual data is updated in real-time.

3. The method of claim 1, further including, detecting further tilt data and continually altering the incoming visual data in accordance with the detected further tilt data.

4. The method of claim 1, wherein the motion sensor is an accelerometer.

5. The method of claim 1, wherein the motion sensor is a gyroscope.

6. The method of claim 1, wherein altering the incoming Jive visual data includes applying a transform matrix to each (x,y) coordinate position of each pixel of the live visual feed.

7. The method of claim 1, wherein automatically altering the incoming live visual data comprises expanding one or more first portions of the incoming live visual data and reducing one or more second portions of the incoming live visual data.

8. A system comprising:

one or more processors;

memory; and

one or more programs stored in the memory, the one or more programs comprising instructions for;

accessing one or more predetermined static variables associated with visual data alteration;

accessing live visual data;

detecting tilt data from a motion sensor associated with an electronic device;

in response to detecting tilt data from the motion sensor associated with the electronic device, automatically altering the incoming live visual data using the accessed predetermined static values in a transform matrix to alter the live visual data based on the detected tilt data; and

displaying the altered live visual data on the electronic device.

9. The system of claim 8, wherein altering the incoming live visual data is performed in real time and the displayed visual data is updated in real-time.

10. The system of claim 8, further comprising instructions for detecting further tilt data and continually altering the incoming visual data in accordance with the detected further tilt data.

11. The system of claim 8, wherein the motion sensor is an accelerometer.

12. The system of claim 8, wherein the motion sensor is a gyroscope.

13. The system of claim 8, wherein altering the incoming live visual data includes applying a transform matrix to each (x,y) coordinate position of each pixel of the live visual feed.

14. The system of claim 8, wherein automatically altering the incoming live visual data comprises expanding one or more first portions of the incoming live visual data and reducing one or more second portions of the incoming live visual data.

15. A non-transitory computer readable storage medium storing one or more programs for execution by one or more processors, the one or more programs comprising instructions for:

accessing one or more predetermined static variables associated with visual data alteration;

accessing live visual data;

detecting tilt data from a motion sensor associated with an electronic device;

in response to detecting tilt data from the motion sensor associated with the electronic device, automatically altering the incoming live visual data using the accessed predetermined static values in a transform matrix to alter the live visual data based on the detected tilt data; and

displaying the altered live visual data on the electronic device.

16. The non-transitory computer readable storage medium of claim 15, wherein altering the incoming live visual data is performed in real time and the displayed visual data is updated in real-time.

17. The non-transitory computer readable storage medium of claim 15, further comprising instructions for detecting further tilt data and continually altering the incoming visual data in accordance with the detected further tilt data.