TRANSPARENT DISPLAY DEVICE AND CONTROL METHOD USING THE SAME

• US 20190050071A1
• Filed: 06/05/2018
• Published: 02/14/2019
• Est. Priority Date: 08/14/2017
• Status: Active Grant

• Current Assignee: Industrial Technology Research Institute, Intellectual Property Innovation Corporation
• Original Assignee: Industrial Technology Research Institute, Intellectual Property Innovation Corporation
• Inventors: Liu, Te-Chih, Chang, Chih-Chia, Lin, Yu-Hsin, Lu, Yi-Chuan
• Granted Patent: US 10,928,930 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2360/144 the light being ambient light
• CPC Class Codes: G09G 2380/00 Specific applications
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
• CPC Class Codes: G09G 3/2092 Details of a display terminals using a flat panel, the details relating to the control arrangement of the display terminal and to the interfaces thereto suitable for both CRT and flat panel G09G5/003; specific for a CRT G09G1/165
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

A transparent display device and a control method using the same are provided. The transparent display device includes a transparent display, a plurality of identification sensors, a scene sensor, and a controller. The identification sensors are configured to sense a user located at a first side of the transparent display to generate a plurality of identification data. The scene sensor is configured to sense scene information located at a second side. The controller obtains a user distance between the user and the transparent display, selects corresponding identification data generated by at least one of or multiple of the identification sensors according to the user distance, determines a location and a gaze direction of the user and a target object in the scene information according to the selected corresponding identification data, and presents target object information corresponding to the target object in the transparent display.

Claims

1. A transparent display device, comprising:

a transparent display, comprising a first side and a second side opposite to the first side, a display screen of the transparent display is visually penetrative;

a plurality of identification sensors, configure to sense at least one user located at the first side to respectively generate a plurality of identification data, wherein the identification sensors respectively have different identifying distances;

a scene sensor, configure to sense scene information located at the second side; and

a controller, coupled to the identification sensors, the scene sensor, and the transparent display, the controller obtains a user distance between the at least one user and the transparent display by controlling one of the identification sensors, selects the corresponding identification data generated by at least one of or multiple of the identification sensors according to the user distance, determines a location and a gaze direction of the at least one user and a target object in the scene information according to the selected corresponding identification data, and presents target object information corresponding to the target object in the transparent display.

2. The transparent display device as claimed in claim 1, wherein the controller selects the corresponding identification data generated by the identification sensors which the identifying distance thereof is greater than or equal to the user distance, and determines the location and the gaze direction of the users and the target object in the scene information according to the selected corresponding identification data.

3. The transparent display device as claimed in claim 1, wherein the controller determines a number of the at least one user by controlling a specific identification sensor having a greatest identifying distance among the identification sensors and obtains the user distance corresponding to the at least one user between the at least one user and the transparent display.

4. The transparent display device as claimed in claim 1, wherein the identification sensors at least comprise a depth sensor, a face sensor, and a touch sensor,

wherein an identifying distance of the depth sensor is greater than an identifying distance of the face sensor, and the identifying distance of the face sensor is greater than an identifying distance of the touch sensor.

5. The transparent display device as claimed in claim 4, wherein the controller selects the corresponding identification data generated by the at least one of or multiple of the identification sensors according to the user distance, a distance between the transparent display and the target object, and a touch sensing result of the touch sensor.

6. The transparent display device as claimed in claim 1, wherein the controller selects one of a plurality of sensing modes according to the user distance, wherein each of the sensing modes corresponds to at least one of or multiple of the identification sensors, and the controller obtains the corresponding identification data selected by controlling the corresponding at least one of or multiple of the identification sensors according to the selected sensing mode.

7. The transparent display device as claimed in claim 6, wherein the controller calculates a first angle of a connection line connecting a first gaze point formed on the transparent display by the gaze direction and the target object and calculates a difference value between the first angle and a second angle of the gaze direction of the at least one user according to the identification data generated in at least one of or multiple of the identification sensors corresponding to each of the sensing modes, and

the controller selects one of the sensing modes according to the difference value corresponding to each of the sensing modes,

wherein the controller selects and adopts the sensing mode corresponding to the difference value close to zero when the difference value is close to zero.

8. The transparent display device as claimed in claim 7, wherein each of the sensing modes respectively corresponds to different algorithms, and the algorithms are configured to calculate the location and the gaze direction of the at least one user and the target object in the scene information through execution of the controller.

9. The transparent display device as claimed in claim 1, further comprising:

an identifying database, coupled to the controller, the controller searches the target object information corresponding to the target object according to the identifying database.

10. The transparent display device as claimed in claim 1, further comprising:

a global positioning system device, coupled to the controller, wherein the controller positions the at least one user and the target object according to the global positioning system device; and

a geographic information database, coupled to the controller, wherein the controller searches the geographic information database to obtain the target object information corresponding to the target object according to the at least one user and a positioning result of the target object.

11. A control method using a transparent display device, the transparent display device comprising a transparent display, a plurality of identification sensors, and a scene sensor, wherein the control method comprising:

obtaining a user distance between a user and the transparent display through one of the identification sensors;

selecting corresponding identification data generated by at least one of or multiple of the identification sensors according to the user distance;

determining a location and a gaze direction of the user and a target object in a scene information sensed by the scene sensor according to the selected corresponding identification data; and

presenting target object information corresponding to the target object in the transparent display.

12. The control method as claimed in claim 11, wherein the step of selecting the corresponding identification data generated by the at least one of or multiple of the identification sensors according to the user distance comprising:

selecting the corresponding identification data generated by the identification sensors which an identifying distance thereof is greater than or equal to the user distance.

13. The control method as claimed in claim 11, wherein the step of obtaining the user distance between the user and the transparent display through one of the identification sensors comprising:

determining a number of the user through a specific identification sensor with the greatest identifying distance among the sensors; and

obtaining the user distance corresponding to the user between the user and the transparent display device.

14. The control method as claimed in claim 11, wherein the identification sensors at least comprise a depth sensor, a face sensor, and a touch sensor,

wherein an identifying distance of the depth sensor is greater than an identifying distance of the face sensor, and the identifying distance of the face sensor is greater than the identifying distance of the touch sensor.

15. The control method as claimed in claim 14, wherein the step of selecting the corresponding identification data generated by the at least one of or multiple of the identification sensors according to the user distance comprising:

selecting the corresponding identification data generated by the at least one of or multiple of the identification sensors according to the user distance, a distance between the transparent display device and the target object, and a touch sensing result of the touch sensor.

16. The control method as claimed in claim 11, wherein the step of selecting the corresponding identification data generated by at least one of or multiple of the identification sensors according to the user distance comprising:

selecting one of a plurality of sensing modes according to the user distance, wherein each of the sensing modes corresponds to at least one of or multiple of the identification sensors; and

obtaining the corresponding identification data selected by controlling the corresponding at least one of or multiple of the identification sensors according to the selected sensing mode.

17. The control method as claimed in claim 16, wherein the step of selecting the corresponding identification data generated by at least one of or multiple of the identification sensors according to the user distance further comprising:

calculating a first angle of a connection line connecting a first gaze point formed on the transparent display by the gaze direction and the target object and calculating a difference value between the first angle and a second angle of the gaze direction of the at least one user according to the identification data generated in at least one of or multiple of the identification sensors corresponding to each of the sensing modes; and

selecting one of the sensing modes according to the difference value corresponding to each of the sensing modes, wherein the sensing mode corresponding to the difference value close to zero is selected and adopted when the difference value is close to zero.

18. The control method as claimed in claim 17, wherein each of the sensing modes respectively corresponds to different algorithms, and the algorithms are configured to calculate the location and the gaze direction of the user and the target object in the scene information through execution of the controller.

19. The control method as claimed in claim 11, further comprising:

searching the target object information corresponding to the target object according to the identifying database.

20. The control method as claimed in claim 11, further comprising:

searching a geographic information database to obtain the target object information corresponding to the target object according to the user and a positioning result of the target object.