MULTI-CHANNEL AUDIO VIBRATORY ENTERTAINMENT SYSTEM
1. An entertainment system comprises:
- a portable media device configured and operable to simultaneously produce a audible output signal, and a plurality of individual vibratory output signals based on individual recorded tracks of a musical piece; and
a plurality of actuators positioned at various locations on a user'"'"'s body, each actuator configured and operable to receive one of the plurality of individual vibratory signals and to vibrate based on the received vibratory signal.
An entertainment system is provided, the system comprising a portable media device configured to simultaneously produce an audible output signal and a plurality of vibratory output signals, the audible output signal representing a multi-track recording comprising a plurality of individual recorded tracks, each vibratory output signal based on at least one individual recorded track; and a plurality of actuators positioned at various locations on a user'"'"'s body, each actuator configured to receive a respective one of the vibratory signals and to vibrate based on the received signal. A method of mixing a multi-track vibratory recording is also provided, the method comprising utilizing an entertainment system to feel vibrations representing individual recorded tracks on different locations of a user'"'"'s body; and for each actuator, selecting at least one of the tracks based on suitability for driving the actuator, and providing, to the actuator, a vibratory signal derived from the selected track.
- 1. An entertainment system comprises:
a portable media device configured and operable to simultaneously produce a audible output signal, and a plurality of individual vibratory output signals based on individual recorded tracks of a musical piece; and a plurality of actuators positioned at various locations on a user'"'"'s body, each actuator configured and operable to receive one of the plurality of individual vibratory signals and to vibrate based on the received vibratory signal.
- View Dependent Claims (2, 3, 4, 5, 6, 7)
- 8. An entertainment system comprises:
a portable media device configured and operable to produce at least an audible output signal of a musical piece; and a plurality of actuator modules positioned at various locations on a user'"'"'s body, each actuator module configured and operable to vibrate.
- View Dependent Claims (9, 10, 11, 12, 13, 14, 15, 16, 18, 19, 20)
- 17. A method of mixing a musical piece comprises:
utilizing an entertainment system including a plurality of actuators that are configured and operable to vibrate based on vibratory signals derived from individual tracks of the musical piece to feel vibrations on the body of the user of a plurality of tracks in the musical piece; and selecting individual tracks of the musical piece to maximize separation of vibration.
This application is a continuation of U.S. Non-Provisional patent application Ser. No. 16/042,852, filed Jul. 23, 2018 and entitled “Multi-Channel Audio Vibratory Entertainment System,” to be issued as U.S. Pat. No. 10,524,054, which is a continuation of U.S. Non-Provisional patent application Ser. No. 15/219,109, filed Jul. 25, 2016 and entitled “Multi-Channel Audio Vibratory Entertainment System,” issued as U.S. Pat. No. 10,034,091 on Jul. 24, 2018, which is continuation of U.S. Non-Provisional patent application Ser. No. 12/705,097, filed Feb. 12, 2010 and entitled “Multi-Channel Audio Vibratory Entertainment System,” issued as U.S. Pat. No. 9,402,133 on Jul. 26, 2016, which claims priority from U.S. Provisional Patent Application Ser. No. 61/207,442, filed Feb. 12, 2009 and entitled “Multi-Channel Entertainment Media Player System with Audio Activated Vibrating Apparel & Footwear,” the entire contents of each application being incorporated by reference herein.
Field of the Disclosure
The present disclosure relates to an entertainment system including a media player that provides a stereo audio output signal and a plurality of individual vibratory output signals based on individual tracks of the stereo audio media and synchronized therewith, and a plurality of actuators, each of which receives an individual vibratory output signal of the plurality of vibratory output signals and is operable to vibrate based on the received vibratory signals on the body of the user.
Present entertainment systems for listening to audio focus mainly on the user enjoying music which has been mixed down to stereo, for speakers or headphones. Thus, the full audio spectrum of the musical piece is being sent directly to the user'"'"'s ears. While some systems introduce additional elements, like sub woofers, this does little to enhance the experience of the vibratory force feedback of the separate instruments in an arrangement. Tactile transducers mounted on theater seats, walls and flooring, for example, also do little to enhance the separate parts that make up the stereo experience for users.
The ears alone cannot separate rhythmic vibrations. The brain has to decipher the separate rhythmic instrumentation based on the incoming audio, via the eardrums. Thus, present entertainment systems do not allow users to fully experience the individual vibratory rhythms of audio entertainment.
All present listening devices, including headphones, speakers, subwoofers, tactile transducers, etc., concentrate on the bass frequency being fixed to one central vibratory response. The user is not able to feel the rhythmic, tactile sensation, generated by the other individual parts of a musical arrangement.
Accordingly, it would be beneficial to provide an entertainment system that overcomes these and other obstacles.
It is an object of the present application to provide an entertainment system including a media player that provides an audio signal and a plurality of vibratory output signals based on individual tracks of a musical piece, and a plurality of actuators that receive respective vibratory output signals and vibrate to stimulate nerve receptors in the user'"'"'s body to enhance the entertainment experience.
An entertainment system in accordance with an embodiment of the present application includes a portable media device configured and operable to simultaneously produce a audible output signal, and a plurality of individual vibratory output signals based on individual recorded tracks of a musical piece and a plurality of actuators positioned at various locations on a user'"'"'s body, each actuator configured and operable to receive one of the plurality of individual vibratory signals and to vibrate based on the received vibratory signal.
An entertainment system in accordance with another embodiment of the present application includes a portable media device configured and operable to produce at least an audible output signal of a musical piece, and a plurality of actuator modules positioned at various locations on a user'"'"'s body, each actuator module configured and operable to vibrate.
A method of mixing a musical piece in accordance with an embodiment of the present application includes utilizing an entertainment system including a plurality of actuators that are configured and operable to vibrate based on vibratory signals derived from individual tracks of the musical piece to feel vibrations on the body of the user of a plurality of tracks in the musical piece and selecting individual tracks of the musical piece to maximize separation of vibration.
Other features and advantages of the present invention will become apparent from the following description of the invention which refers to the accompanying drawings.
The entertainment system of the present disclosure preferably provides a media player which is capable of providing a stereo output signal for the audio production and multiple, individual outputs for the purpose of generating tactile sensation to a user via tactile transducers, or actuators, affixed on or within worn materials of the user. The tactile sensation produces a much more enjoyable listening experience when compared to an audio signal alone. Using the entertainment system of the present disclosure, the user is able to feel the tactile sensations produced by the actuators, positioned on the user'"'"'s body. Since each actuator is preferably driven by a vibratory signal related to separate tracks, or instruments, in the music, the user is able to feel the separate instruments, arranged in the music, in separate areas of the body, while listening to the mixed audible signal image of the music through the ears. This creates a true virtual representation of a musical arrangement that can be felt by nerve receptors on different surface areas of the human body. This stimulus based on the separation of musical elements accurately transforms the body'"'"'s nerve receptors to work in unison with the audible track in the human brain to greatly improve the musical experience, heightening the awareness of the arrangement and rhythmic timing of a musical recording and/or sound effects. The entertainment system of the present disclosure is preferably delivered via a portable media entertainment system.
The entertainment system generates tactile sensation based on sound, such as music, to the whole body. As a result, the user is immersed in tactile sensation based on distinct parts of a musical piece. That is, separate parts of a musical piece are felt in the various areas of the human body, bringing music to life in a way that'"'"'s never before been done.
Tactile sensation is preferably generated from individual vibratory outputs provided to actuators at various areas of the body. In a preferred embodiment, a portable media device provides multi track playback, and houses a digital to analog circuit capable of providing each of a plurality of separate vibratory output signals, preferably to individual mini amplifiers, housed on the user'"'"'s belt, or pocket etc. The portable media player also provides a normal audio output mix for conventional headphones or speakers so the user can hear the mixed musical piece.
Tactile transducers create vibration based on a preferably amplified input signal. When normal speakers vibrate, they move a diaphragm, which in turn moves air to send sound toward the listener'"'"'s ears. When the tactile transducers of the present application vibrate, they do so with less audible sound, passing the vibration energy to whatever they are mounted on. In the entertainment system of the present application, the tactile transducers are affixed on, or within the material that the user is wearing to pass vibrations to the user'"'"'s nerve receptors throughout the body of the human organism.
The clothing or apparel is preferably integral with the tactile transducers and may be designed to fit any part of the body, such as a shirts, jackets, pants, gloves, footwear, belts, belt buckles, backpacks, hats, suspenders etc, or by creating an ergonomic exoskeleton harness apparatus for the body which positions the actuators and holds them in place. The actuators are preferable light weight, but produce effective vibratory response and are preferably housed in a water proof enclosure with the proper safety compliant design for a wearable experience. This system may be designed for wired or wireless transmission of the vibratory signals to the actuators. Thus, the entertainment system provides the user a more enjoyable, entertaining experience by producing vibrations from the music, and passing the vibrations into the user'"'"'s body, in a completely new way. Further, when a piece of music is produced on a digital multi track recording system, the engineers would have the ability, in a creative way, to select which tracks will be sent to the individual tactile transducers or actuators, while they are wearing the device in real time. In this case, the engineer feels the separate instruments via tactile sensation. These separate tracks that are chosen, are synchronized with the stereo mix of the content. Thus, engineers and producers would no longer be mixing just for stereo or surround sound, but mixing the music for the purpose of mapping tactile sensation throughout the body of a user which has been synchronized to the normal audible stereo mix. Both the engineer and producer preferably utilize the system, that is, wear the device with the actuators embedded therein while they are producing the musical piece. They may also use audio engineering techniques to enhance the vibration output of the chosen audio tracks used to provide the vibratory force feedback. These techniques get the most out of the flexibility of the digital recording process. One such technique would be to use pitch shifting on the particular tracks chosen. By pitch shifting down the chosen tracks, the engineer and producer will augment the signals to achieve the desired vibratory response keeping the timing synchronized to the audible signal. For instance, to be able to feel sound via the actuators that was originally recorded in higher frequency registers, like a woman'"'"'s voice or cymbals, these pitches may be shifted down to create more vibratory response at the actuators. The chosen tracks can also be grouped together, or combined in certain situations to provide the engineer and producer the flexibility to achieve an artistically felt production, as well as an audio production that works synergistically in the sensory cortex of the brain to provide a new way for users to enjoy audio entertainment. This individually chosen and modified digital material becomes new media data for the device, not meant for audio to the ears, but for the synchronizing force feedback vibration of individual tracks that were chosen for the experience. This vibratory digital data may be sold, and downloaded to the multi-track media player for operation. Thus, the entertainment system of the present application gives the engineer and producer new possibilities, with a whole new way of producing music to be sold.
In one example, a music connoisseur, wearing a shirt with an actuator mounted to the middle, upper back area would feel the rhythm vibrations generated by the bass guitar track. At the same time, the output vibratory signal for the guitars could be sent to actuators on the front of the shirt, one actuator on each shoulder. The right shoulder would be rhythm guitar and the left shoulder would be lead guitar, for example, thus generating a vibration response based on the guitar tracks. Actuators may be mounted on user'"'"'s footwear to receive the drum track. The entertainment system of the present application uses the power of touch to communicate the separate tracks of the whole musical piece. While the user is feeling the arrangement of the separate instruments, by the various tactile sensations through his or her body, the user would also be listening to a stereo mix of the musical piece with headphones or speakers.
The docking station 11 preferably connects the five individual vibratory output signals from the media player 10 to five mini amplifiers 12 included therein. Additional or fewer mini amplifiers 12 may also be used as desired, however, it is preferable to have at least one mini amplifier for each of the output vibratory signals from the player 10. In a preferred embodiment, a power source 20 (See
The entertainment systems portable media player 10 preferably offers volume controls to adjust the volume level from the audio content for the user'"'"'s ears and for the vibration intensity of all actuators. This is achieved via the multi track software running on the portable media player. However, a micro headphone volume control potentiometer jack can be implemented to adjust the audio level to the ears. Also, a potentiometer that incorporates an on and off switch can be interfaced to each of the mini amplifiers 12 to control the intensity and on and off controls of each powered actuator. Once all connections to the docking station 11 are made, after confirming connections to all the actuators 13, 14, IS, 16, the user 9 may put on the headphones 17 and turn on the device 10. The user can then adjust the desired level of the audio content via headphones 17, with the force feedback vibratory stimulus produced by the actuators.
In one embodiment, the media device 10 integrates multi track playback software technology with the portable media player'"'"'s operating software. The device 10 preferably also includes an output circuit for multi track digital to analog conversion based on the device'"'"'s programming and operating system capabilities. Thus, the amplified vibratory output signals provided to the actuators are preferably analog signals. The method or arrangement of wiring or connecting the above electronic components in the device 10 will be well known to those with good skill in audio electronics. In a preferred embodiment, the actuators 13, 14, 15, 16 are mounted on or within any worn material of clothing, apparel, footwear or wearable accessories by affixing the actuators to the wearable material to hold them in place on the body. The actuators are preferably positioned where the actuator is applying the most vibration to the user'"'"'s nerve receptors. There are many different ways to affix the actuators 13, 14, 15, 16. For instance, each actuator may be mounted in the material of the apparel. The actuators 13, 14, 15, 16 could be embedded in the material, for example, by slitting the material, creating a pocket and then inserting the actuators into the pocket. Another way to affix the actuators 13, 14, 15, 16 is to simply mount them to the apparel or footwear by means of straps, clips, tie wraps, Velcro. Also, the connections to the actuators 13, 14, 15 and 16 can be affixed or clipped on the worn materials of user from the media players docking station 11. Another way of applying the devise to the body of the user is by creating an ergonomic exoskeleton harness apparatus for the body that mounts the actuators and necessary electronics to complete the experience, or any other mounting method. The most important thing is to mount the actuators 13, 14, 15, 16 in such a way that the vibration penetrates into the user'"'"'s body.
The vibratory signals from the handheld media device 10 can be sent via a wireless transmitter to a receiver and mini amps, affixed to the apparel, for example, to allow for wire free operation and may be Bluetooth compliant, for example.
In another embodiment, the entertainment system may be streamlined to include multi-channel digital synchronization of separate micro digital media players.
In this embodiment, there are no restrictions on the portable media player18, other than providing a mini volume potentiometer jack to control the audible signal to the ears via headphones 17 or any other suitable audio speaker. There is no limit to how many actuator modules can be affixed to the body since each individual module has its own output and vibration capabilities. There is also no wireless or hardwired transmission of vibratory signals from one device to the other. If desired, a hardwired connection may be used to synchronize all devices 110 via the USB port Ill.
As mentioned above, the engineer and producer may decide what individual musical tracks are best suited for the overall experience. The musical data of an individual instrument'"'"'s track may be enhanced or augmented by the musical engineer, to get the desired force of vibration out of the actuators, if need be. In a preferred embodiment the engineer and producer would use the system 1, 2, that is wearing the device while mixing the music while interfaced with their recording equipment'"'"'s outputs. Once the desired track is chosen, it may be enhanced for maximum vibratory response by the producer or engineer as mentioned above. Further, while the individual vibratory output signals are typically based on an individual track, they may include elements of other tracks, as desired, to enhance the experience. Indeed, the individual vibratory tracks may be a combination of various tracks and may be designed such that a user will experience the vibrations of a single track seemingly moving from one actuator to another, through the body of the user. Thus, to the user, it will feel for example the rhythm guitar and bass guitar have switched places on their body.
This new art form offers limitless ways of mixing audio to produce vibration to the body. As noted above, any audio chosen need not be produced to stay on one module actuator on one area of the body, meaning the audio data can be edited or routed in a way to interchange from module to module in any chosen area of the body to produce the effect of the audio vibration moving through the body of the user. Also each individual actuator module need not only have one instrument applied to its vibratory signal. The producer and engineer might decide at any given time in the produced song to edit in any configuration of any of the digital recorded audio tracks to achieve the desired stimulation effect. The chosen tracks can then be downloaded to individual micro media players 110 of the modules 19, 20, 21, and 22. All modules share the same hardware and operation commands via remote control so that they are synchronized and tuned in to receive remote control commands in unison. The individual musical parts at each module is cued to operate in unison with all others just as if one were controlling one audio playback device with a remote control. The identical control of separate multi track vibratory data signals synchronized to the audible stereo mix produces a more immersive experience. The modules are housed with a micro digital media player 110, power supply 120, micro amplifier 112, actuator 130, and remote control receiver 113, to receive control commands 23 from a remote control transmitter 24, as well as a USB port for downloading content to the devices and for interfacing accessory options.
Also the individual tracks chosen by the producer and engineer can be transferred onto flash memory cards, or any other desired media and sold to be inserted into the media player housed with the actuator module. One may prefer an augmented mix of the complete audio mix to insert into the media player housed with actuator. This unique feature also allows for not only a wire-free operation from device to device, but also avoids the need for wireless transmission of audio signals from one device to another. It'"'"'s a clean system, in that the synchronization of unified digital entertainment data is controlled by remote control commands, just as you would on a home stereo. This system offers virtually limitless options to cue sound to vibration, for music, video games, movies, and virtual reality. Support could be provided for accessories, for instance, different options could exist, such as wireless communications to the device modules 19, 20, 21, 22 from outside sources, these accessories would include transfer of video game audio and movie audio interface devices.
The exemplary system is shown in
The user would then be able to aim his remote-control device 23, or his handheld media player with remote control commands interfaced to it, toward his body to transmit control signals 24 to initiate play on all digital media devices 110 and enjoy not only hearing but also feeling the different force vibrations, from the individual vibratory signals, via the individual digital micro media devices housed in the actuator modules that provide the vibratory information, along with the electronics necessary to initiate vibration of the module actuator. This simultaneous effect immerses the user so he or she can hear and feel the separate musical parts chosen by the producer and engineer of a musical embodiment in unison.
The portable media player 18 may include a control surface with a remote control circuit to send remote control commands 24 to all remote control receivers 113 to initiate control commands for all individual housed micro digital players 110 of the modules 19,20,21,22, thus, bypassing the need for an external remote control 23. While the modules 19, 20, 21, 22 are shown in
The media players 10 and 18 for sending the stereo audio signal to the ears may also include an actuator and the necessary electronics to initiate vibration of the stereo mix to the body, if desired. A case for protecting the portable media player 10, 18 may include an actuator and the necessary electronics to initiate vibration of the stereo mix to the body, which can be attached to the pocket, belt or any apparel. The actuator modules may include light emitting diodes (LEDs) that mimic the vibratory response of the actuators with light on all variations of actuator designs. Also, the actuator module housed with mini digital player itself can provide the stereo audible signal to the user'"'"'s ears via headphones, simultaneously producing the force feedback vibration to the user'"'"'s body of the stereo mix, this feature could house a microprocessor to convert the signal for more vibratory response, if need be.
In a preferred embodiment, the actuators are mounted to already existing apparel with all electronics necessary to initiate vibration of the actuators. Alternatively, actuators may be mounted on an ergonomic exoskeleton harness which positions the actuators and holds them in place applying the vibration to the user'"'"'s body to produce the desired multi channel experience.
In another embodiment, a standard computer with a digital to analog converter with multiple outputs may be used in place of the players 10, 18. Various music software programs exist for recording and playing back separate audio tracks, which could allow the user to route the outputs of the soundcard to the various micro amps to initiate vibration to actuators. All of the digital processing and hardware needed to achieve this is easily accessible with a large variety of software options.
In another embodiment, the system could interface with an already existing surround sound entertainment system, in the user'"'"'s home.
Another way the system could be achieved is through a digital sampler with multiple outputs. A musical piece including different tracks could be broken down into separate output signals, and then sent to the tactile transducers allowing the occupant to feel the arrangement via the separate rhythmical vibrations throughout the body.
The device may allow for recharging batteries that serve as the power source 120, for example, to power the wireless receiver 113 and amplifiers 112. In a preferred embodiment, they may be recharged via the USB port Ill, as noted above.
The tactile transducers, or actuators, may be fitted to the user'"'"'s already existing apparel or any worn material with a strap or fastener, and can be housed as a single mounting device just clip it to the user'"'"'s apparel, and plug it into one of the media player'"'"'s outputs. The housing for the tactile transducers clips on facing toward the skin of the user. The outer part of the housing, clipped to the apparel, will preferably store the batteries, amps, and all connections and controls necessary for operation.
A toy version could be designed for a child to enjoy the separate rhythmical vibrations of any given musical production throughout the body.
This technology creates a live experience whether it is from the user'"'"'s favorite music, video game music and sound effects, or movie soundtracks and sound effects. In a preferred embodiment, the content is produced for use with the entertainment system to create force feedback vibrations queued to various audio signals from the entertainment content throughout the user'"'"'s body, immersing the entertainment enthusiast to the state of overdriven sensory perception.
Another application for the device would be geared toward entertainers such as musicians and dancers. For instance, an industry exists around in-ear monitors for entertainers. This allows the entertainer to get close and personal with what he or she is hearing while performing, by way of headphones that are usually inserted in the ears. Often times, by using in-ear monitors, the performer feels cut-off from live vibrations and feels isolated from the rest of the band members. U sing in the ear monitors alone limits the hearing only to the stereo image through the headphones blocking out the natural vibrations of live music. The entertainment system greatly improves the way to monitor music for live entertainers. This system for not only hearing but feeling the music would allow the user to customize his or her own vibration mix, tuning into their desired performing partners and increasing the entertainer'"'"'s ability to connect with the musical material. The device would give the entertainer better timing skills by allowing the user to tune into different force vibrations of rhythm produced by various musical instruments in real time, shifting the sensory channels into overdrive. The dancer would have better ability to connect with the choreography wearing the device also. All sports enthusiasts could use the device to motivate themselves through heightened sensory perception of what he or she is listening to, to reach deeper for his or her goals.
The system will also be used by music engineers and producers wearing the system for production of music as noted above. In doing so, this would heighten the engineering production options to create a new art form for humans to enjoy. Also the engineer, producer, or writer would have limitless possibilities to explore due to the fact that this technology opens up a new dimension of how an engineer, producer or writer constructs a musical embodiment, now that the sound vibration is alive and running through the body of the user.
One of the other ways to use this system n would be to teach students the mechanics and rhythm of a musical embodiment, by allowing a teacher to break down a musical arrangement, so that the student can feel the different force feedback, generated by the individual parts of the musical embodiment. This would be achieved by the students wearing the system 1, 2.
Another great way to use this invention would be for sports, such as use in skiing, snowboarding and skateboarding apparel, including ski and snowboard boots, to give the user a more entertaining experience. The system could also be used to orchestrate football players and other sports team players where rhythm and timing is a key factor in the game, due to the multi-channel aspect of the different rhythmic patterns of audio vibrations. This can act as a tactile sensation training program from sports to video games and virtual reality.
One of the other ways to use this system IS to teach students the mechanics and rhythm of a musical embodiment by allowing a teacher to break down a musical arrangement so that the student can feel the tactile sensation generated by the individual parts of the music.
This system would greatly improve the sale of music from record companies because it would give their audience a new format and technology to enjoy and experience. This innovation would allow the sale of separate tracks outside the stereo mix, drawing more revenue from the art form of recorded audio. This new media designed for vibratory feedback on a portable platform, can be marketed and sold in every facet of audio production, not just for audio alone, but also for visual vibratory feedback from movies and video games. This advisement in multi-channel vibration synchronized to sound effects and sound tracks allows a new market for all the individual tracks that go into any audio production product. This new media format can be sold for downloading and sold as media, such as on flash memory cards. New device formats in movie audio and video gaming audio to synchronize the vibratory information to this new entertainment experience is highly likely. Radio broadcast stations of the future may send a plurality of radio frequencies, one for the stereo audible music and a plurality of individual frequencies for the vibration information to users of the device.
Although the present invention has been described in relation to particular embodiments thereof, many other variations and modifications and other uses will become apparent to those skilled in the art.