Augmented reality navigation system
First Claim
Patent Images
1. An augmented reality navigation system coupled to a navigable vehicle, having a camera adapted to capture a plurality of image frames of an observable scene in accordance with said camera orientation, a display, and a base orientation sensor, the system further comprises:
- a computer operable to;
obtain an initial orientation from a said base orientation sensor;
analyze a first image captured from said camera, and select a plurality of reference image components (RIC'"'"'s) therein;
identify said RIC'"'"'s in a subsequently captured image and calculate a displacement for said RIC'"'"'s between frames;
compute a current orientation from said initial orientation and displacement, or a recently obtained orientation and said displacement;
generate an overlay comprising representation of objects, at least some of said objects selected using said current orientation;
periodically update said current orientation, using information received from said base sensor, received after at least one of said computations of current orientation using said displacement; and
,wherein said display is adapted to display said scene observable by said camera, and said overlay in registration.
1 Assignment
0 Petitions
Accused Products
Abstract
A navigation system utilizing augmented reality is provided which utilizes captured images to generate orientation information, wherein the pitch, yaw and roll are periodically derived from an inexpensive sensor, and in-between the periodical update, the pitch, roll, and yaw information are derived by capturing and image of the observed scene, identifying reference image components (RIC'"'"'s) in a images and comparing those RIC'"'"'s with subsequently captured images, to derive orientation information.
49 Citations
20 Claims
-
1. An augmented reality navigation system coupled to a navigable vehicle, having a camera adapted to capture a plurality of image frames of an observable scene in accordance with said camera orientation, a display, and a base orientation sensor, the system further comprises:
-
a computer operable to; obtain an initial orientation from a said base orientation sensor; analyze a first image captured from said camera, and select a plurality of reference image components (RIC'"'"'s) therein; identify said RIC'"'"'s in a subsequently captured image and calculate a displacement for said RIC'"'"'s between frames; compute a current orientation from said initial orientation and displacement, or a recently obtained orientation and said displacement; generate an overlay comprising representation of objects, at least some of said objects selected using said current orientation; periodically update said current orientation, using information received from said base sensor, received after at least one of said computations of current orientation using said displacement; and
,wherein said display is adapted to display said scene observable by said camera, and said overlay in registration. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method for marine navigation comprising the steps of:
-
sensing a first set of orientation information from a base orientation sensor; capturing a video comprising a plurality of images of an observable scene, from ship mounted camera at a known orientation to said base sensor; identifying at least two reference image components (RIC'"'"'s) in a first image from said video; computing a displacement of said reference image components between said first image and a subsequent image from said video; updating current camera orientation information utilizing said displacement; receiving a subsequent set of orientation information from said sensor, and utilizing said subsequent set of orientation information to current or replace said current orientation parameters after it was updated at least once by said step of updating; generating an overlay utilizing said current orientation to select objects or object representation to be placed in said overlay; and
,displaying said video and overlay in close registration on a display. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17)
-
-
18. An augmented reality navigation system coupled to a navigable vehicle, having a camera adapted to capture a plurality of image frames of an observable scene in accordance with said camera orientation, a display, and a base orientation sensor, the system further comprises:
-
circuitry operable to; analyze a first image captured from said camera, and select a plurality of reference image components (RIC'"'"'s) therein; identify said RIC'"'"'s in a subsequently captured image and calculate a displacement for said RIC'"'"'s between frames; and
,a computer operable to; obtain an initial orientation from a said base orientation sensor; compute a current orientation from said initial orientation and displacement, or a recently obtained orientation and said displacement; generate an overlay comprising representation of objects, at least some of said objects selected using said current orientation; periodically update said current orientation using information received from said base sensor, received after at least one of said computations of current orientation using said displacement; and
,wherein said display is adapted to display said scene observable by said camera and said overlay in registration. - View Dependent Claims (19, 20)
-
Specification
-
- Resources
Litigation Campaign Assessment
Thank you for your request. You will receive a custom alert email when the Litigation Campaign Assessment is available.
×
-
Current AssigneeCBIP, LLC
-
Original AssigneeCharles Benton
-
InventorsBenton, Charles
-
Primary Examiner(s)Tran; Thai
-
Assistant Examiner(s)JONES, HEATHER RAE
-
Application NumberUS10/453,767Publication NumberTime in Patent Office2,128 DaysField of SearchNoneUS Class Current348/208.14CPC Class CodesG01C 21/20 Instruments for performing ...
