SYSTEM AND METHOD FOR BODY SCANNING AND AVATAR CREATION

• US 20120086783A1
• Filed: 06/13/2011
• Published: 04/12/2012
• Est. Priority Date: 06/08/2010
• Status: Active Grant

• Current Assignee: Raj Sareen
• Original Assignee: Raj Sareen
• Inventors: Sareen, Raj
• Granted Patent: US 10,628,729 B2
• Time in Patent Office: Days
• US Class Current: 348/47
• CPC Class Codes: G06N 3/006 based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2210/16 Cloth
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition

Abstract

A method and apparatus is disclosed for scanning a body. The system comprises a processor and a range camera capable of capturing at least a first set of depth images of the body rotated to 0 degrees and at least a second set of depth images of the body rotated to x degrees, wherein x is >0 degrees, and x<360 degrees. A first set of computer instructions executable on the processor is capable of calculating a first set of three dimensional points from the first set of depth images and a second set of three dimensional points from the second set of depth images. A second set of computer instructions executable on the processor is capable of rotating and translating the first and second set of three dimensional points into a final set of three dimensional points. A third set of computer instructions executable on the processor is capable of creating a three dimensional mesh from the final set of three dimensional points.

Claims

1. A system for scanning a body, comprising:

a processor;

a range camera capable of capturing at least a first set of depth images of the body rotated to 0 degrees, and at least a second set of depth images of the body rotated to x degrees, wherein x is >

0 degrees, and x<

360 degrees;

a first set of computer instructions executable on the processor capable of calculating a first set of three dimensional points from the first set of depth images and a second set of three dimensional points from the second set of depth images; and

a second set of computer instructions executable on the processor capable of rotating and translating the first and second set of three dimensional points into a final set of three dimensional points; and

a third set of computer instructions executable on the processor capable of creating a three dimensional mesh from the final set of three dimensional points.

2. The system of claim 1, comprising a fourth set of computer instructions executable on a processor capable of extracting body measurements from the final set of three dimensional points.

3. The system of claim 1, comprising avatar processing software capable of creating an avatar from the three dimensional mesh.

4. The system of claim 3, wherein the avatar is capable of use in a virtual fitting room.

5. The system of claim 4, wherein the virtual fitting room comprises one or more garments that are capable of being draped on the avatar.

6. The system of claim 5, further comprising a display capable of displaying the avatar with one or more of said garments draped on the avatar.

7. The system of claim 3, wherein the avatar is configured to be drawn on a display and synchronized with movements of a user moving in front of the range camera.

8. The system of claim 1, wherein the system is configured for operation in one or more locations selected from the group consisting of:

a home, a commercial kiosk, an retrofitted store fitting room, a gaming machine establishment, and a karaoke room.

16. The method of claim 1, wherein each step is performed in one or more locations selected from the group consisting of:

a home, a commercial kiosk, a retrofitted store fitting room, a gaming machine establishment, and a karaoke room.

9. A method for scanning a body, comprising:

capturing, using a range camera, at least a first set of depth images of the body rotated to 0 degrees, and at least a second set of depth images of the body rotated to x degrees, wherein x is >

0 degrees, and x<

360 degrees;

calculating a first set of three dimensional points from the first set of depth images and a second set of three dimensional points from the second set of depth images; and

rotating and translating the first and second set of three dimensional points into a final set of three dimensional points;

creating a three dimensional mesh from the final set of three dimensional points.

10. The method of claim 9, comprising extracting body measurements from the final set of three dimensional points.

11. The method of claim 9, comprising creating an avatar from the three dimensional mesh.

12. The method of claim 11, comprising providing the avatar to virtual fitting room.

13. The method of claim 12, comprising draping one or more virtual garments in the virtual fitting room on the avatar.

14. The method of claim 13, further comprising displaying the avatar with the one or more virtual garments draped on the avatar.

15. The system of claim 11, comprising drawing the avatar on a display and synchronizing the avatar with movements of a user moving in front of the range camera.

17. A system for scanning a body, comprising:

a processor;

a range camera capable of capturing a plurality of sets of depth images of the body, a first set of depth images comprising depth images of the body rotated at 0 degrees, each subsequent set of depth images comprising captured depth images of the body rotated to at relatively equal intervals of degrees of rotation, wherein each interval is >

0 degrees <

180 degrees;

a first set of computer instructions executable on the processor capable of calculating a set of three dimensional points for each set of depth images; and

a second set of computer instructions executable on the processor capable of rotating and translating all sets of three dimensional points into one final set of three dimensional points;

a third set of computer instructions executable on the processor capable of creating a three dimensional mesh from the final set of three dimensional points.

18. A method for scanning a body, comprising:

using a range camera to capture a plurality of sets of depth images of the body, a first set of depth images comprising depth images of the body rotated at 0 degrees, each subsequent set of depth images comprising depth images of the body rotated to at relatively equal intervals of degrees of rotation, wherein each interval is >

0 degrees <

180 degrees;

calculating a set of three dimensional points for each set of depth images; and

rotating and translating all sets of three dimensional points into one final set of three dimensional points;

creating a three dimensional mesh from the final set of three dimensional points.

19. A system for scanning a body, comprising:

a processor;

two or more range cameras capable of capturing a plurality of sets of depth images of the body, each range camera positioned at a different angle with respect to the body;

a first set of computer instructions executable on the processor capable of calculating a set of three dimensional points for each set of depth images; and

a second set of computer instructions executable on the processor capable of rotating and translating all sets of three dimensional points into one final set of three dimensional points;

a third set of computer instructions executable on the processor capable of creating a three dimensional mesh from the final set of three dimensional points.

20. A method for scanning a body, comprising:

capturing a plurality of sets of depth images of the body with two or more range cameras, each range camera positioned at a different angle with respect to the body;

calculating a set of three dimensional points for each set of depth images; and

rotating and translating all sets of three dimensional points into one final set of three dimensional points;

creating a three dimensional mesh from the final set of three dimensional points.

21. A method for displaying a virtual garment on a body, comprising:

draping one or more virtual garments on an avatar representing a person;

capturing images of a person in real time using a camera; and

pose tracking the person to thereby synchronize movements of the avatar with movements of the person;

hiding the avatar; and

re-draping the virtual garment in real time on the avatar as the person moves, thereby moving the virtual garment consistent with movement of the person whereby the virtual garment appears to be draped on the person.

22. The method of claim 21, wherein the steps of draping and re-draping are each performed using graphical processing unit cloth simulation.

23. The method of claim 21, comprising displaying the person with the draped and re-draped virtual garment on a display.

24. The method of claim 21, wherein each step is performed in one or more locations selected from the group consisting of:

a home, a commercial kiosk, an retrofitted store fitting room, a gaming machine establishment, and a karaoke room.