METHOD AND APPARATUS FOR RENDERING A PAPER REPRESENTATION ON AN ELECTRONIC DISPLAY

• US 20120293528A1
• Filed: 05/18/2011
• Published: 11/22/2012
• Est. Priority Date: 05/18/2011
• Status: Abandoned Application

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: LARSEN, Eric J.
• Application Number:
  US13/110,475
• Publication Number:
  US 20120293528A1
• Time in Patent Office: Days
• US Class Current: 345/589
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: G09G 2360/144 the light being ambient light
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters

Abstract

A display apparatus having a surface that displays image data. A processing device processes and provides image data to the display. A camera device is associated with the display and the processing device. The camera device dynamically detects a user'"'"'s head position relative to the surface of the display and determines the incident light surrounding the display. The detected head position and the incident light are then processed by the processing device for rendering the image data on the display to resemble a representation of an actual paper medium.

Claims

1. An apparatus comprising:

a display having a surface that displays image data;

a processing device for processing and providing image data to the display; and

a camera device associated with the display and operatively coupled to the processing device, the camera device dynamically detecting a user'"'"'s head position relative to the surface of the display and determine incident light surrounding the display,

wherein the detected head position and the incident light are processed by the processing device for rendering the image data on the display to resemble a representation of an actual paper medium.

2. The apparatus according to claim 1, wherein the representation of an actual paper medium includes simulated lighting corresponding to a passively lit room.

3. The apparatus according to claim 1, wherein the representation of an actual paper medium includes at least one material property of an actual paper medium.

4. The apparatus according to claim 1, wherein the detected head position includes an angle between the user'"'"'s head position and the surface of the display.

5. The apparatus according to claim 1, wherein the processing device comprises a graphics shader unit for rendering the image data on the display to resemble the representation of an actual paper medium.

6. The apparatus according to claim 1, wherein the processing device comprises a display compensation unit for compensating for display dimming that occurs with an increase in viewing angle between the user'"'"'s head position relative to the surface of the display.

7. The apparatus according to claim 1, wherein the representation of an actual paper medium comprises at least one property of ink applied to an actual paper product.

8. The apparatus according to claim 1, wherein the display comprises a matte display surface for substantially matching a diffuse appearance associated with the actual printed paper.

9. The apparatus according to claim 1, wherein the camera device comprises an image recognition unit that is operable to detect the user'"'"'s head position.

10. The apparatus according to claim 1, wherein the camera device comprises:

a first image recognition unit for detecting the user'"'"'s head position; and

a second image recognition unit for tracking the user'"'"'s eye position,

wherein based on the tracking of the user'"'"'s eye position, the processing device provides enhanced lighting to a region of the display where the user is predicted to be observing.

11. The apparatus according to claim 1, wherein the camera device comprises:

a first image recognition unit for detecting the user'"'"'s head position; and

a second image recognition unit for tracking the user'"'"'s eye position, wherein based on the tracking of the user'"'"'s eye position, the processing device provides;

shading to a first region of the display, wherein the first region is predicted to be unobserved by the user, and

modified lighting to a second region of the display where the user is predicted to be observing.

12. The apparatus according to claim 10, wherein the second image recognition unit comprises a timing unit operable to calculate a time period corresponding to an interval between the user changing page content associated with the display and advancing to a next page of content, the time period utilized in conjunction with the tracking of the user'"'"'s eye position for increasing the accuracy of the region of the display where the user is predicted to be observing.

13. The apparatus according to claim 11, wherein the second image recognition unit comprises a timing unit operable to calculate a time period corresponding to an interval between the user changing page content associated with the display and advancing to a next page of content, the time period utilized in conjunction with the tracking of the user'"'"'s eye position for increasing the accuracy of the region of the display where the user is predicted to be observing.

14. The apparatus according to claim 1, further comprising:

displaying one or more icons that are associated with additional data.

15. The apparatus according to claim 1, further comprising:

one or more audio links that when activated provide audio content.

16. The apparatus according to claim 15 wherein the audio content is associated with particular displayed text.

34. The apparatus according to claim 1, wherein the processing device generates an environment map as a function of sensed light such that the map is used when the camera device is inoperative.

17. A method of controlling the appearance on a display having a surface that displays image data, the method comprising:

determining incident light levels surrounding the display;

determining a user'"'"'s head position relative to the surface of the display; and

processing the incident light levels and the user'"'"'s head position for rendering image data on the display that resembles a representation of an actual paper medium.

18. The method according to claim 17, wherein the rendering of the image data on the display comprises generating images that resemble the representation of an actual paper medium based on a genre of text displayed with the images.

19. The method according to claim 17, wherein the rendering of image data on the display that resemble the representation of an actual paper medium reduces the use'"'"'s eye strain relative to the when the user reads content directly from a display that does not provide the rendering of image data for resembling the representation of an actual paper medium.

20. The method according to claim 17, wherein the determining of incident light levels comprises simulating lighting that corresponds to a passively lit room.

21. The method according to claim 17, wherein the determining of the user'"'"'s head position comprises determining an angle between the user'"'"'s head position and the surface of the display.

22. The method according to claim 17, further comprising:

compensating for display dimming based an increase in viewing angle between the user'"'"'s head position relative to the surface of the display.

23. The method according to claim 17, further comprising:

determining the user'"'"'s eye position; and

providing, based on the user'"'"'s determined eye position, enhanced lighting to a first region of the display where the user is predicted to be observing.

24. The method according to claim 23, further comprising:

providing, based on the user'"'"'s determined eye position, shading to a second region of the display where the user is predicted to not be observing.

25. The method according to claim 24, further comprising:

calculating a time period corresponding to an interval between the user changing page content associated with the display and advancing to a next page of content; and

predicting the region of the display where the user is observing based on the calculated time period and the user'"'"'s determined eye position.

26. The method according to claim 25, further comprising:

providing a book genre; and

providing simulated effects based on the provided book genre.

27. The method according to claim 26, wherein the simulated effects include media data that is reproduced based on the user observing a particular one or more locations on the display that are determined by the predicting of the region of the display where the user is observing.

28. The method according to claim 25, further comprising:

saving the calculated time period with user-login information associated with the user; and

accessing the calculated time period upon the user entering the user-login information, wherein the accessed time period and a further eye position determination are utilized to predict the region of the display where the user is observing.

29. The method according to claim 17, further comprising:

providing a book genre; and

processing the book genre such that the rendered image data on the display resembles the representation of an actual paper medium corresponding to the provided book genre.

30. The method according to claim 17, wherein the processing further comprises:

graphically displayed a binding at approximately a middle location of the representation of an actual paper medium, wherein content data associated with the image data is enlarged in the proximity of the graphically displayed middle binding.

31. A non-transitory computer-readable recording medium for storing thereon a computer program for controlling the appearance on a display having a surface that displays image data, wherein the program comprises:

determining incident light levels surrounding the display;

determining a user'"'"'s head position relative to the surface of the display; and

processing the incident light levels and the user'"'"'s head position for rendering image data on the display that resembles a representation of an actual paper medium.

32. An apparatus comprising:

a display having a surface that displays image data;

a processing device for processing and providing image data to the display; and

a camera device associated with the display and communicatively coupled to the processing device, the camera device dynamically detecting changes in a user'"'"'s head position and changes in movement of at least one of the user'"'"'s eyes,

wherein the detected changes in the user'"'"'s head position and the changes in the movement of at least one of the user'"'"'s eyes are processed by the processing device and operable to provide a dynamic bookmark.

33. The apparatus according to claim 32, wherein the dynamic bookmark comprises a highlighted portion of displayed text that is determined based on the processing of the detected changes in the user'"'"'s head position and the changes in the movement of at least one of the user'"'"'s eyes.