METHOD AND APPARATUS FOR DIGITAL VIDEO LATENCY REDUCTION BY REAL-TIME WARPING
First Claim
1. A method for digital video latency reduction of a received digital video frame captured by a remote camera, the method comprising:
- adjusting an image model of the received digital video frame according to an approximate field of view from the remote camera at a time the digital video frame is received to form an adjusted image model;
overlaying the adjusted image model onto the image model of the received digital video frame to capture a warped image; and
re-projecting the warped image according to the adjusted image model to form a re-projected image that approximates a real-time field of view from the remote camera used to capture the received digital video frame.
1 Assignment
0 Petitions
Accused Products
Abstract
In one aspect, video latency reduction by real-time warping is described. In one aspect, an original geometric image model of a digital video frame is adjusted according to a video frame latency, to form an adjusted geometric image model. A geometric image model may represent a field of view from a remote camera used to capture the digital video frame. The adjusted geometric image model may be overlaid onto the original geometric image model to capture a warped image. In one aspect the warped image is re-projected according to the adjusted geometric image model to form a re-projected image. The re-projected image may then be displayed to approximate a real-time field of view from a camera used to capture the digital video frame. In one aspect, an attitude and runway alignment of an unmanned aerial vehicle may be controlled using a displayed, re-projected image. Other aspects are described and claimed.
-
Citations
20 Claims
-
1. A method for digital video latency reduction of a received digital video frame captured by a remote camera, the method comprising:
-
adjusting an image model of the received digital video frame according to an approximate field of view from the remote camera at a time the digital video frame is received to form an adjusted image model; overlaying the adjusted image model onto the image model of the received digital video frame to capture a warped image; and re-projecting the warped image according to the adjusted image model to form a re-projected image that approximates a real-time field of view from the remote camera used to capture the received digital video frame. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A non-transitory computer readable medium having processor-executable software instruction to perform a method digital video latency reduction of a received digital video frame captured by a remote camera, comprising:
-
re-mapping the digital video frame to determine an original geometric image model corresponding to a field of view from the remote camera used to capture the digital video frame at a digital video frame capture time; modifying the original geometric image model according to an approximate field of view from the remote camera at a digital video frame receive time to form an adjusted geometric image model; overlaying the adjusted geometric image model onto the original geometric image model to capture a warped image; and reducing a field of view of the warped video frame image to eliminate one or more edges of the warped video frame image to form a re-projected image; and displaying the re-projected image to approximate a real-time field of view from the camera at the video frame receive time. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A system for digital video latency reduction of a received digital video frame captured by a remote camera, comprising:
-
a transceiver configured to receive the digital video frame and a camera geometry at a digital video frame capture time; a memory operable to store the received digital video frame and the camera geometry; a graphics processing unit operable to determine an original geometric image model corresponding to a field of view from the remote camera used to capture the digital video frame, at the digital video frame capture time, to overlay an adjusted geometric image model onto the original geometric image model to capture a warped image, the adjusted geometric image model corresponding to an approximate field of view from the remote camera at a digital video frame receive time, and to reduce a field of view of the warped video frame to eliminate one or more edges of the warped image to form a re-projected image; a display operable to display the re-projected image to approximate a field of view from the camera used to capture the video frame according to a location of the camera at the video frame receive time; and a controller operable to control a vehicle, including the remote camera, according to a re-projected image. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification