METHOD AND ARRANGEMENT FOR 3-DIMENSIONAL IMAGE MODEL ADAPTATION

• US 20140212031A1
• Filed: 06/04/2012
• Published: 07/31/2014
• Est. Priority Date: 06/20/2011
• Status: Active Grant

• Current Assignee: Alcatel-Lucent SA (Nokia Corporation)
• Original Assignee: Alcatel-Lucent SA (Nokia Corporation)
• Inventors: Tytgat, Donny, Lievens, Sammy, Aerts, Maarten
• Granted Patent: US 9,269,194 B2
• Time in Patent Office: Days
• US Class Current: 382/154
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20121 Active appearance model [AAM]
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/251 involving models

Abstract

Method for adapting a 3D model (m) of an object, said method comprising the steps of

• • performing at least one projection of said 3D model to obtain at least one 2D image model projection (p1) with associated depth information (d1),
  • performing at least one state extraction operation on said at least one 2D image model projection (p1), thereby obtaining at least one state (s1)
  • adapting said at least one 2D image model projection (p1) and said associated depth information (d1) in accordance with said at least one state (s1) and with a target state (s), thereby obtaining at least one adapted 2D image model (p1′) and an associated adapted depth (d1′)
  • back-projecting said at least one adapted 2D image model (p1′) to 3D, based on said associated adapted depth (d1′) for thereby obtaining an adapted 3D model (m′).

Claims

1-10. -10. (canceled)

11. A method for adapting a 3D model of an object, comprising the steps of:

performing at least one projection of the 3D model to obtain at least one 2D image model

projection with associated depth information;

performing at least one state extraction operation on the at least one 2D image model projection to obtain at least one state comprising a configuration of object features;

determining a target state using the at least one state and external state information;

adapting the at least one 2D image model projection and the associated depth information using the at least one state and the target state to obtain at least one adapted 2D image model and an associated adapted depth; and

back-projecting the at least one adapted 2D image model to 3D based on the associated adapted depth to obtain an adapted 3D model.

12. The method of claim 11, wherein the adapted 3D model is further determined based on 3D model information.

13. The method of claim 12, wherein the external state information comprises high level semantic information with respect to the object features.

14. The method of claim 12, wherein the external state information is a state of an external image input.

15. The method of claim 14, wherein the step of adapting comprises determining a new location for at least one object feature of the at least one state based on a corresponding object feature of the state of the external image input.

16. The method of claim 14, wherein at least one of the 2D projections of the 3D model is performed based on a virtual camera deduced from the external image input.

17. The method of claim 16, wherein the step of adapting comprises determining a new location for at least one object feature of the at least one state based on a corresponding object feature of the state of the external image input.

18. The method of claim 11, wherein the external state information comprises high level semantic information with respect to the object features.

19. The method of claim 11, wherein the external state information is a state of an external image input.

20. The method of claim 19, wherein the step of adapting comprises determining a new location for at least one object feature of the at least one state based on a corresponding object feature of the state of the external image input.

21. The method of claim 19, wherein at least one of the 2D projections of the 3D model is performed based on a virtual camera deduced from the external image input.

22. The method of claim 21, wherein the step of adapting comprises determining a new location for at least one object feature of the at least one state based on a corresponding object feature of the state of the external image input.

23. An apparatus configured to perform a method comprising the steps of:

performing at least one projection of the 3D model to obtain at least one 2D image model projection with associated depth information;

performing at least one state extraction operation on the at least one 2D image model projection to obtain at least one state comprising a configuration of object features;

determining a target state using the at least one state and external state information;

adapting the at least one 2D image model projection and the associated depth information using the at least one state and the target state to obtain at least one adapted 2D image model and an associated adapted depth; and

back-projecting the at least one adapted 2D image model to 3D based on the associated adapted depth to obtain an adapted 3D model.

24. The apparatus of claim 23, wherein the adapted 3D model is further determined based on 3D model information.

25. The apparatus of claim 23, wherein the external state information comprises high level semantic information with respect to the object features.

26. The apparatus of claim 23, wherein the external state information is a state of an external image input.

27. The apparatus of claim 26, wherein the step of adapting comprises determining a new location for at least one object feature of the at least one state based on a corresponding object feature of the state of the external image input.

28. A digital data storage medium encoding a machine-executable program of instructions to perform a method, the method comprising the steps of:

performing at least one projection of the 3D model to obtain at least one 2D image model projection with associated depth information;

performing at least one state extraction operation on the at least one 2D image model projection to obtain at least one state comprising a configuration of object features;

determining a target state using the at least one state and external state information;

adapting the at least one 2D image model projection and the associated depth information using the at least one state and the target state to obtain at least one adapted 2D image model and an associated adapted depth; and

back-projecting the at least one adapted 2D image model to 3D based on the associated adapted depth to obtain an adapted 3D model.

29. The digital data storage medium of claim 28, wherein the external state information is a state of an external image input.

30. The digital data storage medium of claim 29, wherein the step of adapting comprises determining a new location for at least one object feature of the at least one state based on a corresponding object feature of the state of the external image input.