SYSTEM AND METHOD FOR REAL-TIME SYNTHESIS AND PERFORMANCE ENHANCEMENT OF AUDIO/VIDEO DATA, NOISE CANCELLATION, AND GESTURE BASED USER INTERFACES IN A VEHICULAR ENVIRONMENT

• US 20140303807A1
• Filed: 04/02/2014
• Published: 10/09/2014
• Est. Priority Date: 01/14/2011
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Addepalli, Sateesh K., Dai, Lillian Lei, Sudhaakar, Raghuram S., Bonomi, Flavio, Zhu, Xiaoqing, Natarajan, Preethi, Subramanian, Vijaynarayanan, Pan, Rong, Somers, Robert Edward
• Granted Patent: US 9,860,709 B2
• Time in Patent Office: Days
• US Class Current: 701/1
• CPC Class Codes: B60R 16/023 for transmission of signals between vehicle parts or subsystems
• CPC Class Codes: B60W 50/10 Interpretation of driver requests or demands
• CPC Class Codes: G06F 21/45 Structures or tools for the administration of authentication
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: H04L 1/008 where the control data relates to payload of a different packet
• CPC Class Codes: H04L 43/0811 by checking connectivity
• CPC Class Codes: H04L 43/0858 One way delays
• CPC Class Codes: H04L 43/0876 Network utilisation, e.g. volume of load or congestion level
• CPC Class Codes: H04L 45/12 Shortest path evaluation
• CPC Class Codes: H04L 51/02 using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
• CPC Class Codes: H04L 61/2592 using tunnelling or encapsulation
• CPC Class Codes: H04L 63/0227 Filtering policies mail message filtering H04L51/212
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/60 Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources admission control or resource allocation H04L47/70
• CPC Class Codes: H04L 69/18 Multiprotocol handlers, e.g. single devices capable of handling multiple protocols
• CPC Class Codes: H04Q 9/00 Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
• CPC Class Codes: H04W 12/03 Protecting confidentiality, e.g. by encryption
• CPC Class Codes: H04W 28/0215 based on user or device properties, e.g. MTC-capable devices services for machine-to-machine communication [M2M] or machine type communication [MTC] H04W4/70; wireless resource selection or allocation plan definition based on terminal or device properties H04W72/51
• CPC Class Codes: H04W 28/06 : Optimizing the usage of the radio link, e.g. header compression, information sizing , discarding information system modifying transmission characteristic according to link quality by modifying frame length H04L1/0007; dynamic adaptation of the packet size for flow control or congestion control H04L47/365
• CPC Class Codes: H04W 36/0009 : for a plurality of users or terminals, e.g. group communication or moving wireless networks user group management H04W4/08; processing of subscriber group data H04W8/186
• CPC Class Codes: H04W 36/08 : Reselecting an access point
• CPC Class Codes: H04W 4/00 : Services specially adapted for wireless communication networks; Facilities therefor
• CPC Class Codes: H04W 4/10 : Push-to-Talk [PTT] or Push-On-Call services
• CPC Class Codes: H04W 4/40 : for vehicles, e.g. vehicle-to-pedestrians [V2P]
• CPC Class Codes: H04W 40/02 : Communication route or path selection, e.g. power-based or shortest path routing
• CPC Class Codes: H04W 40/20 : based on geographic position or location
• CPC Class Codes: H04W 48/02 : Access restriction performed under specific conditions
• CPC Class Codes: H04W 48/06 : based on traffic conditions
• CPC Class Codes: H04W 48/16 : Discovering, processing access restriction or access information
• CPC Class Codes: H04W 48/18 : Selecting a network or a communication service
• CPC Class Codes: H04W 52/0206 : in access points, e.g. base stations access point devices per se H04W88/08
• CPC Class Codes: H04W 52/0219 : where the power saving management affects multiple terminals
• CPC Class Codes: H04W 52/0264 : by selectively disabling software applications
• CPC Class Codes: H04W 52/12 : Outer and inner loops
• CPC Class Codes: H04W 52/143 : Downlink power control
• CPC Class Codes: H04W 52/225 : Calculation of statistics, e.g. average, variance
• CPC Class Codes: H04W 52/241 : taking into account channel quality metrics, e.g. SIR, SNR, CIR, Eb/lo
• CPC Class Codes: H04W 52/346 : distributing total power among users or channels
• CPC Class Codes: H04W 72/20 : Control channels or signalling for resource management
• CPC Class Codes: H04W 72/23 : in the downlink direction of a wireless link, i.e. towards a terminal
• CPC Class Codes: H04W 72/53 : based on regulatory allocation policies
• CPC Class Codes: H04W 76/45 : for Push-to-Talk [PTT] or Push-to-Talk over cellular [PoC] services
• CPC Class Codes: H04W 8/06 : Registration at serving network Location Register, VLR or user mobility server
• CPC Class Codes: H04W 8/08 : Mobility data transfer
• CPC Class Codes: H04W 8/26 : Network addressing or numbering for mobility support
• CPC Class Codes: H04W 80/02 : Data link layer protocols
• CPC Class Codes: H04W 84/005 : Moving wireless networks
• CPC Class Codes: H04W 84/12 : WLAN [Wireless Local Area Networks]
• CPC Class Codes: H04W 92/18 : between terminal devices
• CPC Class Codes: Y02A 30/60 : Planning or developing urban green infrastructure
• CPC Class Codes: Y02D 30/70 : in wireless communication networks

Abstract

A method includes establishing communication channels between an on-board unit (OBU) of a vehicle and a plurality of nodes, tagging each of a plurality of data from the plurality of nodes with a priority level, storing the plurality of data in a priority queue according to respective priority levels, selecting a medium to present a first data of the plurality of data to a user, and presenting the first data to the user via the medium. In the method, the plurality of nodes includes a remote node and an in-vehicle device. Another method includes receiving a data from a remote node, generating a plurality of data streams from the data and transmitting the plurality of data streams across a plurality of wireless interfaces. Another method includes enhancing audio signals from a plurality of microphones and speakers. Yet another method includes various gesture based user interfaces coupled to the OBU.

Claims

1-29. -29. (canceled)

30. An apparatus, comprising:

a memory element configured to store instructions;

a plurality of wireless interfaces; and

a computing processor operable to execute the instructions, wherein the plurality of wireless interfaces, the computing processor, and the memory element cooperate such that the apparatus is configured to;

establish a communication channel between the apparatus and a sender;

receive an incoming stream of data from the sender;

calculate a connectivity of each wireless interface in the plurality of wireless interfaces;

generate a plurality of data streams from the data based, at least in part, on the connectivity of each wireless interface; and

transmit the plurality of data streams across the plurality of wireless interfaces.

31. The apparatus of claim 30, wherein calculating the connectivity of each wireless interface comprises:

measuring a loss rate of each wireless interface;

measuring a received signal strength indication (RSSI) of each wireless interface;

extracting a threshold loss rate of each wireless interface;

extracting a threshold RSSI for of wireless interface;

comparing the loss rate with the threshold loss rate of each wireless interface; and

comparing the RSSI with the threshold RSSI of each wireless interface.

32. The apparatus of claim 30, wherein generating the plurality of data streams across the plurality of wireless interfaces includes:

measuring a bandwidth across each wireless interface in the plurality of wireless interfaces; and

matching a data transfer rate of at least one data stream in the plurality of data streams across each path with the corresponding bandwidth.

33. The apparatus of claim 32, wherein the apparatus is further configured to:

calculate the data transfer rate of the at least one data stream based on at least one media characteristic of the at least one data stream.

34. The apparatus of claim 30, wherein the apparatus is further configured to:

extract meta information of the data;

determine a data packet was lost during the transmission of the plurality of data streams;

calculate a retransmission level based on a criterion in the meta information; and

retransmit the data packet across one of the wireless interfaces in the plurality of wireless interfaces according to the retransmission level.

35. The apparatus of claim 34, wherein:

the criterion is a priority level of the data packet; and

a data packet with a higher priority level has a first retransmission level and a data packet with a lower priority level has a second retransmission level, wherein the first retransmission level is greater than the second retransmission level.

36. The apparatus of claim 30, wherein generating the plurality of data streams comprises duplicating a crucial data packet across at least two wireless interfaces of the plurality of wireless interfaces.

37. The apparatus of claim 30, wherein generating the plurality of data streams comprises:

generating a channel coded stream from the data; and

dispersing the channel coded stream across at least two wireless interfaces in the plurality of wireless interfaces.

38. The apparatus of claim 30, wherein encoding the plurality of data streams comprises tuning a redundancy level of at least one data stream.

39. The apparatus of claim 30, wherein the data comprises audio/video data.

40. The apparatus of claim 30, wherein the apparatus is a network controller.

41. The apparatus of claim 30, wherein the apparatus is an on-board unit (OBU) inside a vehicle.

42. A method, comprising:

establishing a communication channel between a node and a sender, wherein the node is coupled to a plurality of wireless interfaces;

receiving, at the node, an incoming stream of data from the sender;

calculating a connectivity of each wireless interface in the plurality of wireless interfaces;

generating a plurality of data streams from the data based, at least in part, on the connectivity of each wireless interface; and

transmitting the plurality of data streams across the plurality of wireless interfaces.

43. The method of claim 42, wherein calculating the connectivity of each wireless interface comprises:

measuring a loss rate of each wireless interface;

measuring a received signal strength indication (RSSI) of each wireless interface;

extracting a threshold loss rate of each wireless interface;

extracting a threshold RSSI for of wireless interface;

comparing the loss rate with the threshold loss rate of each wireless interface; and

comparing the RSSI with the threshold RSSI of each wireless interface.

44. The method of claim 42, wherein generating the plurality of data streams across the plurality of wireless interfaces includes:

measuring a bandwidth across each wireless interface in the plurality of wireless interfaces; and

matching a data transfer rate of at least one data stream in the plurality of data streams across each path with the corresponding bandwidth.

45. The method of claim 44, further comprising:

calculating the data transfer rate of the at least one data stream based on at least one media characteristic of the at least one data stream.

46. The method of claim 42, further comprising:

extracting meta information of the data;

determining a data packet was lost during the transmission of the plurality of data streams;

calculating a retransmission level based on a criterion in the meta information; and

retransmitting the data packet across one of the wireless interfaces in the plurality of wireless interfaces according to the retransmission level.

47. The method of claim 46, wherein:

the criterion is a priority level of the data packet; and

a data packet with a higher priority level has a first retransmission level and a data packet with a lower priority level has a second retransmission level, wherein the first retransmission level is greater than the second retransmission level.

48. The method of claim 42, wherein generating the plurality of data streams comprises duplicating a crucial data packet across at least two wireless interfaces in the plurality of wireless interfaces.

49. An on-board unit (OBU) inside a vehicle, the OBU comprising:

a memory element configured to store instructions;

a user interface; and

a processor operable to execute the instructions, wherein the user interface, the processor, and the memory element cooperate such that the OBU is configured to;

receive on a first microphone a first audio signal corresponding to a sound from a user;

receive on a second microphone a second audio signal corresponding to the sound, wherein the first microphone is located closer to the user than the second microphone, wherein the first and second microphones and at least two speakers are located inside the vehicle and are adapted to communicate with the OBU;

determine a source of the sound from the first audio signal and the second audio signal;

enhance the first audio signal;

sense a gesture by a user on a user interface inside a vehicle;

interpret the gesture to correspond to a command for the OBU;

send controlling signals to an application associated with the user interface;

establish communication channels between the OBU and a plurality of nodes;

receive a plurality of data from the plurality of nodes;

tag each of the plurality of data with a respective priority level;

store the plurality of data in a priority queue according to the respective priority levels, wherein at least one of the priority levels is associated with emergency alert data that preempts at least some of the other plurality of data;

select a medium to present a first data of the plurality of data to a user; and

present the first data to the user via the medium, wherein the plurality of nodes includes a remote node and an in-vehicle device.