Three-dimensional annotation system and method

• US 9,547,937 B2
• Filed: 11/30/2012
• Issued: 01/17/2017
• Est. Priority Date: 11/30/2012
• Status: Expired due to Fees

• Current Assignee: Legend3D, Inc.
• Original Assignee: Legend3D, Inc.
• Inventors: Sandrew, Jared, Hunt, Jill
• Primary Examiner(s): ZALALEE, SULTANA MARCIA
• Application Number:
  US13/691,509
• Publication Number:
  US 20140152648A1
• Time in Patent Office: 1,509 Days
• Field of Search: 382/284, 382/276, 455/556.1
• US Class Current: 1/1
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2219/004 Annotating, labelling
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 13/261 with monoscopic-to-stereoscopic image conversion

Abstract

Embodiments enable a three-dimensional annotation system and method that accepts desired depths for regions of input images and annotates two-dimensional/three-dimensional images with three-dimensional annotations for viewing at the desired depth(s) in any three-dimensional manner. Enables rapid and intuitive specification of desired depth and application of depth to regions in the two-dimensional images, or when editing three-dimensional images, as annotated by the three-dimensional annotations having at least one depth associated with the annotation. Enables rapid and intuitive depth augmentation or editing of an input image.

Claims

1. A three-dimensional annotation method comprising:

obtaining a source image that is two-dimensional or three-dimensional;

displaying said source image on a screen associated with a first computer;

accepting an annotation associated with a desired depth of a region within said source image via an input device coupled with said first computer;

obtaining at least one depth associated with said annotation;

wherein said at least one depth corresponds with said desired depth of said region; and

,

annotating said source image with said annotation at said at least one depth in a three-dimensional image;

generating an annotated stereoscopic image that comprises left and right eye views that differ from each other having said annotation at said at least one depth that differs from a depth of said region; and

,

generating an output stereoscopic image with said region at said same depth as said at least one depth of said annotation.

2. The method of claim 1 wherein said input device comprises a graphics tablet, a mouse, or a keyboard and wherein said accepting said annotation comprises accepting input from said graphics tablet, said mouse or said keyboard respectively.

3. The method of claim 1 wherein said input device comprises a microphone and wherein said accepting said annotation comprises accepting input from said microphone.

4. The method of claim 1 wherein said obtaining said at least one depth comprises analyzing said annotation with text recognition software to determine said at least one depth.

5. The method of claim 1 wherein said obtaining said at least one depth comprises analyzing motion of a mouse to determine said at least one depth.

6. The method of claim 1 wherein said obtaining said at least one depth comprises parsing alphanumeric data from a keyboard to determine said at least one depth.

7. The method of claim 1 wherein said obtaining said at least one depth comprises asserting voice recognition software.

8. The method of claim 1 wherein said generating said annotated stereoscopic image comprises generating a pair of images comprising a left image to view with a left eye and a right eye image to view with a right eye respectively wherein said pair of images includes said annotation and said source image.

9. The method of claim 1 wherein said generating said annotated stereoscopic image comprises generating an anaglyph image comprising a left eye colored image and a right eye colored image that are combined and that includes said annotation and said source image.

10. The method of claim 1 wherein said generating said annotated stereoscopic image comprises generating a polarized image comprising a left eye image polarized in a first axis and a right eye image polarized in a second axis orthogonal to said first axis that are combined and that includes said annotation and said source image.

11. The method of claim 1 wherein said generating said annotated stereoscopic image comprises generating a single image capable of displaying left and right eye viewpoints to a left eye and right eye respectively with differing depths that includes said annotation and said source image.

12. The method of claim 1 further comprising:

accepting at least one mask associated with said region of said source image.

13. The method of claim 1 further comprising:

displacing at least a portion of said region in said source image left and right based on said at least one depth to create said three-dimensional image.

14. The method of claim 1 further comprising:

displacing at least a portion of said region in said source image left and right based on said at least one depth to create an output three-dimensional image without said annotation.

15. The method of claim 1 wherein said annotating said source image with said annotation at said at least one depth occurs before moving at least a portion of said region in said source image left and right to alter depth within the source image.

16. The method of claim 1 wherein said annotating said source image with said annotation at said at least one depth comprises annotating said source image with a plurality of annotations that each comprise a different depth.

17. A three-dimensional annotation method comprising:

obtaining a source image that is two-dimensional or three-dimensional;

displaying said source image on a screen associated with a first computer;

accepting an annotation associated with a desired depth of a region within said source image via an input device coupled with said first computer wherein said input device comprises any combination of graphics tablet, mouse, keyboard or microphone;

obtaining a at least one depth associated with said annotation by analyzing said annotation with text recognition software or by analyzing motion of a mouse or by parsing alphanumeric data from said keyboard or by asserting voice recognition software or any combination thereof;

wherein said at least one depth corresponds with said desired depth of said region;

and, annotating said source image with said annotation at said at least one depth in a three-dimensional image wherein said annotating said source image with said annotation at said at least one depth occurs before moving at least a portion of said region in said source image left and right to alter depth within the source image; and

,

generating an output stereoscopic image with said region at said same depth as said at least one depth of said annotation.

18. The method of claim 17 further comprising:

accepting at least one mask associated with said region of said source image.

19. The method of claim 17 further comprising:

displacing at least a portion of said region in said source image left and right based on said at least one depth to create said three-dimensional image.

20. The method of claim 17 further comprising:

displacing at least a portion of said region in said source image left and right based on said at least one depth to create an output three-dimensional image without said annotation.

21. The method of claim 17 wherein said annotating said source image with said annotation at said at least one depth comprises annotating said source image with a plurality of annotations that each comprise a different depth.