Intelligent privacy system, apparatus, and method thereof

• US 10,475,418 B2
• Filed: 10/25/2016
• Issued: 11/12/2019
• Est. Priority Date: 10/26/2015
• Status: Active Grant

• Current Assignee: Reald Spark, LLC
• Original Assignee: Reald Spark, LLC
• Inventors: Sommerlade, Eric, Woodgate, Graham J., Flynn, Helen
• Primary Examiner(s): Thompson, James A
• Application Number:
  US15/334,023
• Publication Number:
  US 20170236494A1
• Time in Patent Office: 1,113 Days
• Field of Search: None
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/554 involving event detection and direct action
• CPC Class Codes: G06F 21/6245 Protecting personal data, e.g. for financial or medical purposes
• CPC Class Codes: G06F 21/84 output devices, e.g. displays or monitors
• CPC Class Codes: G06F 2221/032 Protect output to user by software means
• CPC Class Codes: G06F 2221/2111 Location-sensitive, e.g. geographical location, GPS
• CPC Class Codes: G06F 2221/2149 Restricted operating environment
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2358/00 Arrangements for display data security
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: G09G 5/38 with means for controlling the display position
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04L 63/107 wherein the security policies are location-dependent, e.g. entities privileges depend on current location or allowing specific operations only from locally connected terminals
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 2013/40 Privacy aspects, i.e. devices showing different images to different viewers, the images not being viewpoints of the same scene
• CPC Class Codes: H04W 12/06 Authentication
• CPC Class Codes: H04W 12/47 using near field communication [NFC] or radio frequency identification [RFID] modules

Abstract

A directional display apparatus including a directional display device that is capable of directing a displayed image into a viewing window of variable width is provided with a privacy control function. A control system detects the presence of one or more secondary viewers in addition to a primary viewer, and decides whether the one or more secondary viewers is permitted to view the displayed image. The control system directs a displayed image into a viewing window which is adjusted, for example by decreasing the width, in dependence on that detection. In addition, the control system detects relative movement between the primary viewer and the display device, and the width of the viewing window is increased in response to detection of said relative movement.

Claims

1. A privacy control method of controlling a directional display device that is capable of directing a displayed image into a viewing window that is adjustable, the method comprising:

directing the displayed image into a viewing window;

detecting the presence of one or more secondary viewers in addition to a primary viewer;

in the event of detecting the presence of the one or more secondary viewers, deciding whether the one or more secondary viewers is permitted to view the displayed image; and

adjusting the viewing window in response to detecting the presence of one or more secondary viewers and deciding that the one or more secondary viewers is not permitted to view the displayed image,

wherein the deciding of whether the one or more secondary viewers is permitted to view the displayed image comprises;

determining information about the location of the display device,

determining location-specific viewer permission information of the one or more secondary viewers, and

deciding whether the one or more secondary viewers is permitted to view the displayed image based at least in part on the determined location information of the display device and the location-specific viewer permission information of the one or more secondary viewers.

2. A privacy control method according to claim 1, wherein the method further comprises capturing a viewing region image, the step of detecting the presence of one or more secondary viewers in addition to the primary viewer comprises analyzing the viewing region image to detect the one or more secondary viewers in the viewing region image.

3. A privacy control method according to claim 2, wherein the step of deciding whether the one or more secondary viewers is permitted to view the displayed image comprises deriving image information of the one or more secondary viewers detected in the in the viewing region image, and deciding whether the one or more secondary viewers is permitted to view the displayed image in dependence on a comparison of derived image information with a database that associates image information of viewers with viewer permission information.

4. A privacy control method according to claim 1, wherein the step of detecting the presence of one or more secondary viewers in addition to the primary viewer comprises detecting an electromagnetic tag carried by the one or more secondary viewers.

5. A privacy control method according to claim 4, wherein the step of deciding whether the one or more secondary viewers is permitted to view the displayed image comprises determining the identity of the one or more secondary viewers from the electromagnetic tag and deciding whether the one or more secondary viewers is permitted to view the displayed image in dependence on comparison of the determined identity of the one or more secondary viewers with a database that associates viewers with viewer permission information.

6. A privacy control method according to claim 1, wherein the determined information comprises the geographical location of the display device.

7. A privacy control method according to claim 1, wherein the method further comprises capturing a viewing region image, and the determined information is derived from the viewing region image.

8. A privacy control method according to claim 1, wherein the step of deciding whether the one or more secondary viewers is permitted to view the displayed image is performed in dependence on what system processes are being performed.

9. A privacy control method according to claim 1, wherein

the directional display device is capable of directing the displayed image into a viewing window of variable width, and

said adjusting of the viewing window comprises decreasing the width of the viewing window.

10. A privacy control method according to claim 9, wherein

the directional display device is capable of directing the displayed image into a viewing window of variable position and width,

the method further comprises capturing a viewing region image, analyzing the viewing region image to determine the position of the primary viewer, and

in said step of directing a displayed image into a viewing window, at least when the width of the viewing window is decreased, the viewing window has a position that tracks the determined position of the primary viewer.

11. A privacy control method according to claim 1, wherein

the directional display device is capable of directing the displayed image into a viewing window of variable position, and

said adjusting of the viewing window comprises shifting the position of the viewing window away from the secondary viewer.

12. A privacy control method according to claim 11, wherein

the method further comprises capturing a viewing region image, analyzing the viewing region image to determine the position of the primary viewer and the secondary viewer, and

in said step of directing a displayed image into a viewing window, the viewing window has a position that tracks the determined position of the primary viewer.

13. A privacy control method according to claim 1, wherein the directing of the displayed image comprises directing light from a directional backlight through a transmissive spatial light modulator and into a viewing window, the modulator being capable of displaying the displayed image.

14. A privacy control method according to claim 13, wherein the directing of the displayed image further comprises directing light emitted by an array of light sources of the directional backlight to a waveguide arranged to direct light from the light sources into respective optical windows, said viewing window comprising at least one optical window.

15. A directional display apparatus having a privacy control function, the apparatus comprising:

a directional display device that is capable of directing a displayed image into a viewing window that is adjustable; and

a control system for controlling the directional display device, wherein the control system is arranged to detect the presence of one or more secondary viewers in addition to a primary viewer, and, in the event of detecting the presence of the one or more secondary viewers, to decide whether the one or more secondary viewers is permitted to view the displayed image; and

the control system is arranged to control the directional display device to direct a displayed image into a viewing window that is adjusted in dependence on detection of the presence of the one or more secondary viewers,

wherein the control system is arranged to decide whether the one or more secondary viewers is permitted to view the displayed image by deriving information about the location of the display device, determining location-specific viewer permission information of the one or more secondary viewers, and deciding whether the one or more secondary viewers is permitted to view the displayed image based at least in part on the determined location information of the display device and the location-specific viewer permission information of the one or more secondary viewers.

16. A directional display apparatus according to claim 15, wherein

the directional display apparatus further comprises a camera system arranged to capture a viewing region image, and

the control system is arranged to detect the presence of one or more secondary viewers in addition to the primary viewer by analyzing the viewing region image to detect the one or more secondary viewers in the viewing region image.

17. A directional display apparatus according to claim 16, wherein the control system is arranged to derive image information of the one or more secondary viewers detected in the in the viewing region image, and to decide whether the one or more secondary viewers is permitted to view the displayed image in dependence on a comparison of derived image information with a database that associates image information of viewers with viewer permission information.

18. A directional display apparatus according to claim 15, wherein

the directional display apparatus further comprises a tag sensor arranged to detect electromagnetic tags, and

the control system is arranged to detect the presence of one or more secondary viewers in addition to the primary viewer on the basis of the output of the tag sensor.

19. A directional display apparatus according to claim 18, wherein the control system is arranged to determine the identity of the one or more secondary viewers from the output of the tag sensor, and to decide whether the one or more secondary viewers is permitted to view the displayed image in dependence on comparison of the determined identity of the one or more secondary viewers with a database that associates viewers with viewer permission information.

20. A directional display apparatus according to claim 15, wherein

the directional display apparatus further comprises a location sensor arranged to determine the geographical location of the display device, and

the control system is arranged to derive the information about the location of the display device from the output of the location sensor.

21. A directional display apparatus according to claim 15, wherein

the directional display apparatus further comprises a camera system arranged to capture a viewing region image, and

the control system is arranged to derive the information about the location of the display device from the viewing region image.

22. A directional display apparatus according to claim 15, wherein the control system is arranged to decide whether the one or more secondary viewers is permitted to view the displayed image in dependence on what system processes are being performed by the control system.

23. A directional display apparatus according to claim 15, wherein

the directional display device is capable of directing the displayed image into a viewing window of variable width, and

the control system is arranged to control the directional display device to adjust the viewing window by decreasing the width of the viewing window.

24. A directional display apparatus according to claim 23, wherein

the directional display device is capable of directing the displayed image into a viewing window of variable position and width,

the directional display apparatus further comprises a camera system arranged to capture a viewing region image,

the control system is arranged to analyze the viewing region image to determine the position of the primary viewer, and

the control system is arranged to control the directional display device to direct a displayed image into a viewing window whose width is decreased in dependence on detection of the presence of the one or more secondary viewers, and whose position, at least when the width of the viewing window is decreased, tracks the determined position of the primary viewer.

25. A directional display apparatus according to claim 15, wherein

the directional display device is capable of directing the displayed image into a viewing window of variable position, and

the control system is arranged to control the directional display device to adjust the viewing window by shifting the position of the viewing window away from the secondary viewer.

26. A directional display apparatus according to claim 25, wherein

the control system is arranged to analyze the viewing region image to determine the position of the primary viewer and the secondary viewer, and

the control system is arranged to control the directional display device to direct a displayed image into a viewing window whose position tracks the determined position of the primary viewer, while shifting the position of the viewing window away from the secondary viewer.

27. A directional display apparatus according to claim 15, further comprising:

a transmissive spatial light modulator capable of displaying a displayed image; and

a directional backlight capable of directing light through the spatial light modulator into said viewing window.

28. A directional display apparatus according to claim 27, wherein the directional backlight comprises:

an array of light sources; and

a waveguide arranged to direct light from the light sources into respective optical windows, said viewing window comprising at least one optical window.

29. A method of controlling a directional display device that is capable of directing a displayed image into a viewing window that is adjustable, the method comprising:

directing a displayed image into a viewing window;

detecting the presence of one or more secondary viewers in addition to a primary viewer;

in the event of detecting the presence of the one or more secondary viewers, deciding whether the one or more secondary viewers is permitted to view the displayed image; and

adjusting the viewing window in response to detecting the presence of one or more secondary viewers and deciding that the one or more secondary viewers is not permitted to view the displayed image;

and

wherein deciding whether the one or more secondary viewers is permitted to view the displayed image comprises;

determining information about the location of the display device,

capturing a viewing region image, the determined information of the display device being derived from the viewing region image, and

deciding whether the one or more secondary viewers is permitted to view the displayed image based at least in part on the determined location information of the display device.

30. A method according claim 29, wherein the method further comprises detecting relative movement between a viewer and the directional display device and wherein the movement which is detected includes linear motion of the viewer relative to the display device laterally of the viewing window.

31. A method according to claim 29, wherein the method further comprises detecting relative movement between a viewer and the directional display device and wherein the movement which is detected includes vibratory movement of the display device relative to the viewer.

32. A method according to claim 29, wherein the method further comprises detecting relative movement between a viewer and the directional display device and wherein the step of detecting relative movement is performed using a motion sensor mounted in the display device.

33. A method according to claim 29, the method further comprising detecting relative movement between a viewer and the directional display device, and analyzing the viewing region image to determine the position of the viewer, and the step of detecting relative movement comprises detecting movement of the determined position of the viewer.

34. A method according to claim 29, wherein

the directional display device is capable of directing a displayed image into a viewing window of variable position and width,

the method further comprises detecting relative movement between a viewer and the directional display device, analyzing the viewing region image to determine the position of the viewer, and

in said step of directing a displayed image into a viewing window, the viewing window has a position that tracks the determined position of the viewer.

35. A method according to claim 29, wherein the directing of the displayed image comprises directing light from a directional backlight through a transmissive spatial light modulator and into a viewing window, the modulator being capable of displaying the displayed image.

36. A method according to claim 35, wherein the directing of the displayed image further comprises directing light emitted by an array of light sources of the directional backlight to a waveguide arranged to direct light from the light sources into respective optical windows, said viewing window comprising at least one optical window.

37. A directional display apparatus comprising:

a directional display device that is capable of directing a displayed image into a viewing window that is adjustable; and

a control system, wherein

the control system is arranged to control the directional display device to direct a displayed image into a viewing window, and

the control system is arranged to;

detect the presence of one or more secondary viewers in addition to a primary viewer,

in the event of detecting the presence of the one or more secondary viewers, decide whether one or more secondary viewers is permitted to view the displayed image, and

adjust the viewing window in response to detecting the presence of one or more secondary viewers and deciding that the one or more secondary viewers is not permitted to view the displayed image,

wherein deciding of whether the one or more secondary viewers is permitted to view the displayed image comprises;

determining information about the location of the directional display device,

capturing a viewing region image, the determined information of the display device being derived from the viewing region image, and

deciding whether the one or more secondary viewers is permitted to view the displayed image based at least in part on the determined location information of the display device.

38. A directional display apparatus according claim 37, wherein the control system is arranged to detect relative movement between a viewer and the directional display device and wherein the movement which the control system is arranged to detect includes linear motion of the viewer relative to the display device laterally of the viewing window.

39. A directional display apparatus according to claim 37, wherein the control system is arranged to detect relative movement between a viewer and the directional display device and wherein the movement which the control system is arranged to detect is vibratory movement of the display device relative to the viewer.

40. A directional display apparatus according to claim 37, wherein the control system is arranged to detect relative movement between a viewer and the directional display device and wherein:

the display device comprises a motion sensor arranged to detect motion of the display device, and

the control system is arranged to detect relative movement on the basis of the output of the motion sensor.

41. A directional display apparatus according to claim 37, wherein

the directional display apparatus further comprises a camera system arranged to capture the viewing region image.

42. A directional display apparatus according to claim 37, wherein

the directional display device is capable of directing a displayed image into a viewing window of variable position and width,

the control system is arranged to detect relative movement between the primary viewer and the directional display device,

the directional display apparatus further comprises a camera system arranged to capture the viewing region image,

the control system is arranged to analyze the viewing region image to determine the position of the primary viewer, and

the control system is arranged to control the directional display device to direct a displayed image into a viewing window whose width is increased in response to detection of said relative movement, and whose position tracks the determined position of the primary viewer.

43. A directional display apparatus according to claim 37, wherein the directional display device comprises:

a transmissive spatial light modulator capable of displaying a displayed image; and

a directional backlight capable of directing light through the spatial light modulator into said viewing window.

44. A directional display apparatus according to claim 43, wherein the directional backlight comprises:

an array of light sources; and

a waveguide arranged to direct light from the light sources into respective optical windows, said viewing window comprising at least one optical window.