IMAGE TO ITEM MAPPING

• US 20170309075A1
• Filed: 11/12/2015
• Published: 10/26/2017
• Est. Priority Date: 11/12/2014
• Status: Active Grant

• Current Assignee: Unmade Limited
• Original Assignee: Knyttan Limited
• Inventors: WATTS, Hal, ALUN-JONES, Benjamin, EMERY, Kirsty, BAKKER, Greg
• Granted Patent: US 11,030,807 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/006 Inverse problem, transformation from projection-space into object-space, e.g. transform methods, back-projection, algebraic methods
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2210/16 Cloth

Abstract

There is disclosed a technique for displaying a digital image on a representation of an object, comprising: defining reference point positions on digital image template of a reference item; fitting the reference item to an object; capturing an image of the reference item fitted to the object; mapping positions on a digital image template of a non-reference item to the location positions of the reference points of the captured image to generate a manipulated non-reference digital image; and displaying the manipulated digital image on the reference item fitted to the object.

Claims

1. A method of displaying a digital image on a representation of an object, comprising:

defining reference point positions on digital image template of a reference item;

fitting the reference item to an object;

capturing an image of the reference item fitted to the object;

mapping positions on a digital image template of a non-reference item to the location positions of the reference points of the captured image to generate a manipulated non-reference digital image; and

displaying the manipulated digital image on the reference item fitted to the object.

2. The method of claim 1 wherein the representation of the object is the captured image of the object, and the manipulated non-reference digital image is displayed on the captured image.

3. The method of claim 1 wherein the representation of the object is the object, and the manipulated non-reference digital image is projected on to the object.

4. The method of claim 1 wherein the mapping step comprises detecting the reference point positions on the captured image and mapping the positions to location points, wherein corresponding points on the digital image template of a catalogue item are mapped to the associated location points to manipulate the non-reference image for display on the representation of the object.

5. The method of any preceding claim wherein the step of displaying the manipulated digital image on the reference item fitted to the object further comprises combining the manipulated digital image with the captured image of the reference item fitted to the object.

6. The method of claim 5 wherein when the manipulated digital image and the captured image are co ined by digitally merging them, the combined image is displayed in a virtual reality mirror.

7. The method of claim 5 wherein when the manipulated digital image and the captured image are combined by digitally merging them, the combined image is displayed on a computer display.

8. The method of claim 1 wherein the step of displaying the manipulated digital image on the reference item fitted to the object further comprises projecting the manipulated digital image onto the reference item fitted to the object.

9. The method of any one of claims 1 to 8 wherein capturing the image includes capturing information about the reference item.

10. The method of claim 9 wherein manipulating the digital image includes manipulating the digital image in dependence on the captured information about the reference item.

11. The method of claim 9 or claim 10 in which the reference item is an item of clothing, and the captured information comprises the texture of the item of clothing.

12. The method of any one of claims 1 to 11 wherein capturing the image includes capturing information about the fitting of the reference item to the object.

13. The method of claim 12 wherein manipulating the digital image includes manipulating the digital image in dependence on the captured information about the fitting of the reference item to the object.

14. The method of claim 12 or claim 13 wherein the information includes lighting information.

15. The method of claim 14 wherein the information includes information of the lighting of the reference item fitted to the object.

16. The method of claim 15 wherein the reference item is an item of clothing the information comprising lighting information of the illumination of the clothing on the object.

17. The method of any one of claims 1 to 16 wherein capturing the image includes capturing information about the context of the reference item.

18. The method of claim 17 wherein manipulating the digital image includes manipulating the digital image in dependence on the captured information about the context of the reference item to the object.

19. The method of claim 17 or claim 18 wherein the information includes luminance information.

20. The method of claim 19 wherein when the representation of the digital image is displayed the manipulated image is lit appropriately.

21. The method of any one of claims 1 to 20 comprising capturing a static image of the reference item fitted to the object.

22. The method of claim 21 wherein the object is static.

23. The method of claim 21 or claim 22 wherein displaying the manipulated digital image on the reference item fitted to the object comprises displaying the manipulated data image on a static captured image.

24. The method of any one of claims 1 to 23 comprising capturing a moving image of the reference item fitted to the object.

25. The method of claim 24 wherein the object is moving.

26. The method of claim 25 wherein the image is adapted in real-time in accordance with the movement of the object.

27. The method of claim 25 or claim 26 wherein displaying the manipulated digital image on the reference item fitted to the object comprises dynamically displaying a dynamically manipulated data image on a moving captured image.

28. The method of any one of claims 1 to 27 comprising storing a captured image.

29. The method of claim 28 wherein displaying the manipulated digital image on the reference item fitted to the object comprises retrieving a stored captured image and displaying the manipulated captured image on the retrieved stored captured image.

30. The method of any one of claims 1 to 29 wherein the object is a person.

31. The method of any one of claims 1 to 30 wherein the reference item is an item of clothing.

32. A system for displaying a digital image on a representation of an object, the system configured to:

define reference point positions on digital image template of a reference item;

fit the reference item to an object;

capture an image of the reference item fitted to the object;

map positions on a digital image template of a non-reference item to the location positions of the reference points of the captured image to generate a manipulated non-reference digital image; and

display the manipulated digital image on the reference item fitted to the object.

33. The system of claim 32 further configured such that the representation of the object is the captured image of the object, and the manipulated non-reference digital image is displayed on the captured image.

34. The system of claim 32 further configured such that the representation of the object is the object, and the manipulated non-reference digital image is projected on to the object.

35. The system of claim 32 further configured such that the mapping step comprises detecting the reference point positions on the captured image and mapping the positions to location points, wherein corresponding points on the digital image template of a catalogue item are mapped to the associated location points to manipulate the non-reference image for display on the representation of the object.

36. A method substantially as herein described, or as shown in any one of the figures.

37. A system as herein described, of as shown in any one of the figures.