Audio visual presentation with three-dimensional display devices

• US 9,208,765 B1
• Filed: 09/18/2013
• Issued: 12/08/2015
• Est. Priority Date: 09/18/2013
• Status: Expired due to Fees

• Current Assignee: AmZetta Technologies, LLC (American Megatrends International, LLC)
• Original Assignee: American Megatrends Incorporated
• Inventors: Sivertsen, Clas Gerhard
• Primary Examiner(s): Sheng, Tom
• Application Number:
  US14/029,937
• Time in Patent Office: 811 Days
• Field of Search: 345/32, 345/156, 345/173, 348/42, 348/51
• US Class Current: 1/1
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 2210/125 Medley, i.e. linking parts of different musical pieces in one single piece, e.g. sound collage, DJ mix
• CPC Class Codes: G10H 2210/241 Scratch effects, i.e. emulating playback velocity or pitch manipulation effects normally obtained by a disc-jockey manually rotating a LP record forward and backward
• CPC Class Codes: G10H 2220/401 3D sensing, i.e. three-dimensional (x, y, z) position or movement sensing. movement pattern or gesture sensing G10H2220/201; geolocation sensing G10H2220/355, 3D sensing with accelerometer G10H2220/395

Abstract

Certain aspects of the present disclosure relate to an audio visual display device, which includes a transparent display module, a sensing module, and a controller. The sensing module generates sensing signals in response to detecting an object at a disc jockey side of the transparent display module. The controller includes stores computer executable codes which, when executed at a processor, are configured to: generate display signals for the transparent display module to control its pixels to display an image corresponding to the display signals; receive the sensing signals from the sensing module, and generate an object coordinate according to the sensing signals; in response to an audio visual display instruction, generate the display signals corresponding to a virtual disc jockey equipment; and in response to the object coordinate matching coordinates of the virtual disc jockey equipment, generate an audio effect command for the virtual disc jockey equipment.

Claims

1. An audio visual display device, comprising:

a transparent display module defining a plurality of pixels in a pixel matrix;

a sensing module configured to receive a plurality of first scan signals, detect an object at a disc jockey (DJ) side of the transparent display module in response to receiving the first scan signals, and to generate a plurality of sensing signals in response to detecting the object; and

a controller electrically connected to the transparent display module and the sensing module, the controller comprising a processor and a non-volatile memory storing computer executable codes, wherein the codes, when executed at the processor, are configured to

generate the first scan signals for the sensing module, and send the first scan signals to the sensing module;

generate display signals, and send the display signals to the transparent display module to control the pixels to display an image corresponding to the display signals;

receive the sensing signals from the sensing module, and generate an object coordinate according to the sensing signals;

in response to an audio visual display instruction, generate the display signals corresponding to a virtual disc jockey equipment; and

in response to the object coordinate matching coordinates of the virtual disc jockey equipment, generate an audio effect command for the virtual disc jockey equipment.

2. The audio visual display device as claimed in claim 1, further comprising:

a barrier module disposed at the DJ side of the transparent display module, wherein for a DJ at the DJ side, the barrier module is configured to allow light emitted from a first set of the pixels to be viewable only by a left eye of the DJ, and allow light emitted from a second set of the pixels to be viewable only by a right eye of the DJ, such that the DJ perceives the light emitted from the first set of the pixels as a left-eye view and the light emitted from the second set of the pixels as a right-eye view, and perceives the left-eye view and the right view to form a three-dimensional virtual image between the DJ and the transparent display module.

3. The audio visual display device as claimed in claim 2, wherein the barrier module is a parallax barrier layer, comprising a plurality of transparent units and a plurality of opaque units alternatively positioned.

4. The audio visual display device as claimed in claim 2, being switchable between a two-dimensional display mode and a three-dimensional display mode.

5. The audio visual display device as claimed in claim 1, wherein the codes comprise:

a pixel control module configured to generate the display signals in response to a plurality of image signals, and send the display signals respectively to the display module to control the pixels;

an image processing module configured to generate the image signals from the image; and

a sensing control module configured to generate the first scan signals for the sensing module, receive the sensing signals from the sensing module, and generate the object coordinate by comparing the sensing signals.

6. The audio visual display device as claimed in claim 5, wherein the sensing module comprises a plurality of capacitive sensing units in a capacitive matrix, wherein each of the capacitive sensing units is configured to receive one of the first scan signals generated by the sensing control module, to generate the sensing signals in response to the first scan signal, and to send the sensing signals to the sensing control module.

7. The audio visual display device as claimed in claim 6, wherein the capacitive sensing units are capacitive sensor electrodes, and wherein each of the capacitive sensor electrodes is configured to induce a capacitance change when the object exists within a predetermined range of the capacitive sensor electrode.

8. The audio visual display device as claimed in claim 6, wherein the capacitive sensing units are capacitive micromachined ultrasonic transducer (CMUT) arrays, and each of the CMUT arrays comprises a plurality of CMUT units, wherein each of the CMUT arrays is configured to transmit ultrasonic waves and to receive refracted ultrasonic waves by the objects.

9. The audio visual display device as claimed in claim 1, wherein the display signals comprise a plurality of second scan signals and a plurality of data signals.

10. The audio visual display device as claimed in claim 9, wherein the transparent display module comprises:

a scan driver electrically connected to the controller, configured to receive the second scan signals from the controller;

a data driver electrically connected to the controller, configured to receive the data signals from the controller;

a plurality of scan lines electrically connected to the scan driver, each scan line configured to receive one of the second scan signals from the scan driver; and

a plurality of data lines electrically connected to the data driver, each data line configured to receive one of the data signals from the data driver;

wherein the scan lines and the data lines cross over to define the plurality of pixels.

11. A controller, comprising:

a processor; and

a non-volatile memory storing computer executable codes, wherein the codes, when executed at the processor, are configured to

generate first scan signals for a sensing module, and send the first scan signals to the sensing module;

generate display signals for a transparent display module defining a plurality of pixels in a pixel matrix, and send the display signals to the transparent display module to control the pixels to display an image corresponding to the display signals;

receive sensing signals from the sensing module, and generate an object coordinate according to the sensing signals, wherein the sensing module is configured to detect an object at a disc jockey (DJ) side of the transparent display module in response to receiving the first scan signals, and to generate the sensing signals in response to detecting the object;

in response to an audio visual display instruction, generate the display signals corresponding to a virtual disc jockey equipment; and

in response to the object coordinate matching coordinates of the virtual disc jockey equipment, generate an audio effect command for the virtual disc jockey equipment.

12. The controller as claimed in claim 11, wherein a barrier module is disposed at the DJ side of the transparent display module, wherein for a DJ at the DJ side, the barrier module is configured to allow light emitted from a first set of the pixels to be viewable only by a left eye of the DJ, and allow light emitted from a second set of the pixels to be viewable only by a right eye of the DJ, such that the DJ perceives the light emitted from the first set of the pixels as a left-eye view and the light emitted from the second set of the pixels as a right-eye view, and perceives the left-eye view and the right view to form a three-dimensional virtual image between the DJ and the transparent display module.

13. The controller as claimed in claim 12, wherein the barrier module is a parallax barrier layer, comprising a plurality of transparent units and a plurality of opaque units alternatively positioned.

14. The controller as claimed in claim 12, wherein the transparent display module is switchable between a two-dimensional display mode and a three-dimensional display mode.

15. The controller as claimed in claim 11, wherein the codes comprise:

a pixel control module configured to generate the display signals in response to a plurality of image signals, and send the display signals respectively to the display module to control the pixels;

an image processing module configured to generate the image signals from the image; and

a sensing control module configured to generate the first scan signals for the sensing module, receive the sensing signals from the sensing module, and generate the object coordinate by comparing the sensing signals.

16. The controller as claimed in claim 15, wherein the sensing module comprises a plurality of capacitive sensing units in a capacitive matrix, wherein each of the capacitive sensing units is configured to receive one of the first scan signals generated by the sensing control module, to generate the sensing signals in response to the first scan signal, and to send the sensing signals to the sensing control module.

17. The controller as claimed in claim 16, wherein the capacitive sensing units are capacitive sensor electrodes, and wherein each of the capacitive sensor electrodes is configured to induce a capacitance change when the object exists within a predetermined range of the capacitive sensor electrode.

18. The controller as claimed in claim 16, wherein the capacitive sensing units are capacitive micromachined ultrasonic transducer (CMUT) arrays, and each of the CMUT arrays comprises a plurality of CMUT units, wherein each of the CMUT arrays is configured to transmit ultrasonic waves and to receive refracted ultrasonic waves by the objects.

19. A non-transitory computer readable medium storing computer executable codes, wherein the codes, when executed at a processor, are configured to

generate first scan signals for a sensing module, and send the first scan signals to the sensing module;

generate display signals for a transparent display module defining a plurality of pixels in a pixel matrix, and send the display signals to the transparent display module to control the pixels to display an image corresponding to the display signals;

receive sensing signals from the sensing module, and generate an object coordinate according to the sensing signals, wherein the sensing module is configured to detect an object at a disc jockey (DJ) side of the transparent display module in response to receiving the first scan signals, and to generate the sensing signals in response to detecting the object;

in response to an audio visual display instruction, generate the display signals corresponding to a virtual disc jockey equipment; and

in response to the object coordinate matching coordinates of the virtual disc jockey equipment, generate an audio effect command for the virtual disc jockey equipment.

20. The non-transitory computer readable medium as claimed in claim 19, wherein a barrier module is disposed at the DJ side of the transparent display module, wherein for a DJ at the DJ side, the barrier module is configured to allow light emitted from a first set of the pixels to be viewable only by a left eye of the DJ, and allow light emitted from a second set of the pixels to be viewable only by a right eye of the DJ, such that the DJ perceives the light emitted from the first set of the pixels as a left-eye view and the light emitted from the second set of the pixels as a right-eye view, and perceives the left-eye view and the right view to form a three-dimensional virtual image between the DJ and the transparent display module.

21. The non-transitory computer readable medium as claimed in claim 20, wherein the transparent display module is switchable between a two-dimensional display mode and a three-dimensional display mode.

22. The non-transitory computer readable medium as claimed in claim 19, wherein the codes comprise:

a pixel control module configured to generate the display signals in response to a plurality of image signals, and send the display signals respectively to the display module to control the pixels;

an image processing module configured to generate the image signals from the image; and

a sensing control module configured to generate the first scan signals for the sensing module, receive the sensing signals from the sensing module, and generate the object coordinate by comparing the sensing signals.

23. The non-transitory computer readable medium as claimed in claim 22, wherein the sensing module comprises a plurality of capacitive sensing units in a capacitive matrix, wherein each of the capacitive sensing units is configured to receive one of the first scan signals generated by the sensing control module, to generate the sensing signals in response to the first scan signal, and to send the sensing signals to the sensing control module.

24. The non-transitory computer readable medium as claimed in claim 23, wherein the capacitive sensing units are capacitive sensor electrodes, and wherein each of the capacitive sensor electrodes is configured to induce a capacitance change when the object exists within a predetermined range of the capacitive sensor electrode.

25. The non-transitory computer readable medium as claimed in claim 23, wherein the capacitive sensing units are capacitive micromachined ultrasonic transducer (CMUT) arrays, and each of the CMUT arrays comprises a plurality of CMUT units, wherein each of the CMUT arrays is configured to transmit ultrasonic waves and to receive refracted ultrasonic waves by the objects.