Method and system for display of facial features on nonplanar surfaces

• US 7,705,877 B2
• Filed: 01/28/2004
• Issued: 04/27/2010
• Est. Priority Date: 01/28/2004
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Jackson, Warren Bruce
• Primary Examiner(s): Philippe, Gims S
• Application Number:
  US10/767,386
• Publication Number:
  US 20050162511A1
• Time in Patent Office: 2,281 Days
• Field of Search: 348/61, 348/91, 348/128, 348/169, 348/207.99, 348/14.1, 345/32, 345/85, 345/419, 347/427, 382/118
• US Class Current: 348/61
• CPC Class Codes: G06T 15/02 Non-photorealistic rendering
• CPC Class Codes: H04N 7/144 camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact

Abstract

A method for displaying facial features includes generating an image with facial features on a nonplanar surface and positioning the image on the nonplanar surface to indicate a direction of gaze and enhance nonverbal communication associated with the facial features. The apparatus for displaying facial features includes a nonplanar surface, an image generation device that creates an image with facial features on the nonplanar surface and a positioning system that positions the image on the nonplanar surface to indicate a direction of gaze and enhance nonverbal communication associated with the facial features.

Claims

1. An apparatus for displaying facial features of a remote person comprising:

a nonplanar surface;

an image generation device that creates an image with facial features of the remote person on the nonplanar surface, wherein the image is communicated by an image collection device configured to track a direction of gaze of the remote person; and

a positioning system that moves the image on the nonplanar surface to indicate changes in the direction of gaze and enhance nonverbal communication associated with the facial features of the remote person.

2. The apparatus of claim 1, wherein the nonplanar surface has substantially the shape of a head.

3. The apparatus of claim 1, wherein the substantially head shaped nonplanar surface is selected from a set of head shapes including:

a sphere, a spheroid, or an oblong closed surface.

4. The apparatus of claim 1, wherein the nonplanar surface has substantially the shape of a face.

5. The apparatus of claim 4, wherein the substantially face shaped nonplanar surface is selected from a set of face shapes including:

a portion of a sphere, an oblong open nonplanar surface, or an oblong nonplanar closed surface with one flat side.

6. The apparatus of claim 1, wherein the image generation device comprises one or more projection devices projecting light from outside the nonplanar surface.

7. The apparatus of claim 1, wherein the image generation device comprises one or more projection devices projecting light from within the nonplanar surface.

8. The apparatus of claim 1, wherein the image generation device comprises a flexible display substantially coincident with the nonplanar surface.

9. The apparatus of claim 1, wherein the image generation device is implemented using a flexible display technology selected from a set including:

a flexible LCD display, a flexible organic light emitting diode display, a flexible inorganic electroluminescent display, and a flexible light-emitting polymer display.

10. The apparatus of claim 1, wherein the facial features being projected onto the nonplanar surface is created from a live transmission of images from the image collection device.

11. The apparatus of claim 1, wherein the facial features are selected from a set including those of:

a fantasy face, a cartoon face, an animal face, and a human face.

12. The apparatus of claim 1, wherein the positioning system moves the image and eyes contained in the image from one part of the nonplanar surface to another in conjunction with movement of the facial features gathered with the image collection device.

13. The apparatus of claim 1, further comprising one or more video collection devices for collecting video images of facial features from a perspective substantially on or near the nonplanar surface.

14. The apparatus of claim 1, wherein the one or more video collection devices includes a camera device, and the perspective substantially on or near the nonplanar surface includes mounting the camera device substantially near a set of eyes appearing on the nonplanar surface.

15. The apparatus of claim 1, wherein the one or more video collection devices includes a camera device and the perspective substantially on or near the nonplanar surface includes mounting the camera device substantially at the location of one eye appearing on the nonplanar surface.

16. The apparatus of claim 1, wherein one or more video collection devices includes a camera device and the perspective substantially on or near the nonplanar surface includes mounting the camera device substantially at the location of each eye appearing on the nonplanar surface.

17. The apparatus of claim 1, further comprising a speaker to transmit voice and other sounds from the perspective of the nonplanar surface.

18. The apparatus of claim 1, wherein the speaker is located substantially at the location of a mouth associated with the facial features appearing on the nonplanar surface.

19. The apparatus of claim 1, further comprising one or more microphones to gather sounds audible from the perspective of the nonplanar surface.

20. The apparatus of claim 1, wherein each of the one or more microphones is located substantially at the location of an ear of the image appearing on the nonplanar surface.

21. A method for displaying facial features of a remote person comprising:

receiving communications from an image collection device, said communications including information pertaining to a direction of gaze of the remote person;

generating an image with facial features of the remote person on a nonplanar surface; and

moving the image on the nonplanar surface to indicate changes in the direction of gaze and enhance nonverbal communication associated with the facial features of the remote person.

22. The method of claim 21, wherein the generating is done by a video projection device projecting from outside the nonplanar surface.

23. The method of claim 21, wherein the generating is done by a video projection device projecting from inside the nonplanar surface.

24. The method of claim 21, wherein the generating is done by a curved display substantially coincident with the nonplanar surface.

25. The method of claim 21, comprising the additional step of collecting one or more live video images from a perspective on or near the nonplanar surface.

26. The method of claim 21, further comprising the step of transmitting the live video images to a remote user.

27. The method of claim 21, wherein the collecting step comprises the collection of images from a perspective in the region of the eyes of the facial features on the nonplanar surface.

28. The method of claim 21, comprising the additional step of collecting one or more live audio feeds to gather sounds audible from the perspective of the nonplanar surface.

29. The method of claim 21, comprising the additional step of transmitting the live video feeds to a remote user.

30. An apparatus for displaying facial features of a remote person comprising:

means for receiving communications from an image collection device, said communications including information pertaining to a direction of gaze of the remote person;

means for displaying an image on a nonplanar surface;

means for generating facial features of the remote person in the image on the nonplanar surface; and

means for moving the image to indicate changes in the direction of gaze and enhance nonverbal communication associated with the facial features of the remote person.