Digital glass enhanced media system

• US 9,581,816 B2
• Filed: 11/05/2013
• Issued: 02/28/2017
• Est. Priority Date: 11/05/2013
• Status: Active Grant

• Current Assignee: Mutualink, Inc.
• Original Assignee: Mutualink, Inc.
• Inventors: Wengrovitz, Michael S., Mazzarella, Joseph R.
• Primary Examiner(s): HSU, ALPUS
• Application Number:
  US14/072,379
• Publication Number:
  US 20150123876A1
• Time in Patent Office: 1,211 Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: H04L 65/1073 Registration or de-registration
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04N 21/2396 characterized by admission policies admission control, resource allocation in open networks H04L12/5692; arrangements for network security using user profiles for access control H04L63/102; access security in wireless networks H04W12/08
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6175 involving transmission via Internet broadcast-related systems characterised by the transmission system being the Internet H04H60/82
• CPC Class Codes: H04N 7/173 with two-way working, e.g. subscriber sending a programme selection signal

Abstract

A digital glass enhanced media system (DGEMS) is provided that is capable of performing routing and processing of audio and video inputs received from a plurality of digital glass devices, as well as a plurality of agencies, in order to provide enhanced and coordinated information distribution among the digital glass devices. Such routing may include distributing information received from the devices to relevant agencies providing assistance to the wearers of those devices, as well as to other team member devices. Control is also provided, such that a user of such a digital glass device car select how or what information is received. In this manner, coordinated information distribution can be provided so as to allow users to optimize the coordination of their teamwork.

Claims

1. A digital glass-enhanced media system, the system comprising:

a control module configured to determine a source of a received data stream, and to generate a control signal dictating routing of the data stream;

a distribution module configured to route the received data stream to a corresponding destination based on the control signal;

a digital glass transceiver configured to communicate with a plurality of digital glass devices; and

an agency transceiver configured to communicate with a plurality of agencies,

wherein the control module includes a registration module configured to store relationships between the plurality of digital glass devices and the plurality of agencies, and

wherein the relationships define at least one Field Group of digital glass devices that are cooperatively operating in a common task, and at least one Agency Group of agencies that are cooperatively assisting with the common task.

2. The system of claim 1, wherein the control module is configured to generate the control signal based on the stored relationships.

3. The system of claim 2, wherein the relationships define which of the plurality of digital glass devices and which of the plurality of agencies are to receive data generated by a specific digital glass device or a specific agency.

4. The system of claim 2, wherein the registration module is configured to store an identification of a leader among the plurality of digital glass devices,

wherein the control module includes a control input for receiving external control instructions from the leader.

5. The system of claim 4, wherein the control module is configured to modify the relationships stored in the registration module based on the control instructions received from the leader.

6. The system of claim 5, wherein the modifying of the relationships includes at least one of adding a first digital glass device to a first Field Group, removing the first digital glass device from the first Field Group, and reassigning the first digital glass device from the first Field Group to a second Field Group.

7. The system of claim 6, wherein the control module is configured to generate the control signal so as to cause the distribution module to route data streams received from the first digital glass device to all agencies associated with a first Agency Group that is identified as being in relationship with the first digital glass device, and to cause the distribution module to route data streams received from any of the agencies associated with the first Agency Group to the first digital glass device.

8. The system of claim 1, wherein the control module is configured to modify the relationships stored in the registration module based on control instructions received from a leader, and

wherein the modifying of the relationships includes at least one of adding a first digital glass device to a first Field Group, removing the first digital glass device from the first Field Group, and reassigning the first digital glass device from the first Field Group to a second Field Group.

9. A digital glass-enhanced media system for facilitating communications between a digital glass device and an agency, comprising:

a transceiver configured to receive a data stream;

a control module that includes a registration module configured to store a relationship between the digital glass device and the agency, the control module being configured to determine whether the received data stream originates from the digital glass device or the agency, and to generate a control signal dictating how the received data stream is to be routed based on the stored relationship; and

a distribution module configured to route information from the digital glass device to the agency, or to route information from the agency to the digital glass device based on the control signal generated by the control module,

wherein the relationship defines at least one Field Group, the at least one Field Group defining a group of digital glass devices that includes the digital glass device as carrying out a task, and at least one Agency Group the at least one Agency Group defining a group of agencies that includes the agency as cooperatively assisting with the task.

10. The system of claim 9, wherein the digital glass device is a digitally-enhanced wearable eyeglass device having at least data inputs of a camera and a microphone, and at least data outputs of a display and a speaker.

11. The system of claim 9, wherein the distribution module includes a processing module configured to perform processing of the received data stream,

wherein the processing includes at least one of filtering, combining, down-converting, up-converting, visual balancing, sound balancing, equalizing, normalizing, and synchronizing.

12. The system of claim 11, wherein the received data stream includes a first data stream and a second data stream.

13. The system of claim 12, wherein the processing module is configured to combine the first data stream and the second data stream into a single data stream.

14. The system of claim 12, wherein the processing module is configured to output the first data stream and the second data stream sequentially.

15. A digital glass-enhanced media system in communication with a plurality of digital glass devices and a plurality of agencies, the system comprising:

a transceiver configured to receive data streams;

a control module configured to control routing of the received data streams, the control module including;

a registration module configured to register the plurality of digital glass devices and to store relationships between the plurality of digital glass devices and the plurality of agencies, the relationships defining at least one Field Group of digital glass devices that are cooperatively operating in a common task and at least one Agency Group of agencies that are cooperatively assisting with the common task; and

a source/destination determination module configured to determine a source of a received data stream; and

a destination of the received data stream;

based on the stored relationships; and

a distribution module configured to route the received data streams according to the routing control performed by the control module.

16. The system of claim 15, wherein the distribution nodule includes a processing module configured to process the received data streams, and a switching module configured to direct data streams to their respective destinations according to the routing control.

17. The system of claim 16, wherein the registration module registers a first digital glass device upon a user inputting a unique II) associated with the first digital glass device, and

wherein the registering of the first digital glass device includes storing the unique ID in association with a Field Group from among the at least one field Group of other digital glass devices, an Agency Group from among the at least one Agency Group of assisting agencies, and a leader tag indicating whether the first digital glass device is a group leader.

18. The system of claim 16, wherein the source/destination determination module identifies a plurality of data streams that are all to be routed to a same destination digital glass device, and

wherein the control module controls the processing module to combine the plurality of data streams.

19. The system of claim 18, wherein the combining includes overlaying the data included within the plurality of data streams.

20. The system of claim 15, wherein the control module is configured to cause the distribution module to transmit stored context-specific information to at least one digital glass device,

wherein the context specific-information is digitally-stored information relevant to a particular location or event associated with the at least one digital glass device.

21. The system of claim 20, wherein the control module is configured to receive sensor readings from a first digital glass device from among the plurality of digital glass devices, to detect the occurrence of an event by analyzing the received sensor readings, and to cause the distribution module to transmit stored context-specific information based on the detected event.

22. A digital glass-enhanced media system, the system comprising:

a control module configured to determine a source of a received data stream, and to generate a control signal dictating routing of the data stream;

a distribution module configured to route the received data stream to a corresponding destination based on the control signal;

a digital glass transceiver configured to communicate with a plurality of digital glass devices; and

an agency transceiver configured to communicate with a plurality of agencies,

wherein the control module includes a registration module configured to store relationships between the plurality of digital glass devices and the plurality of agencies, and

wherein the control module is configured to generate the control signal based on the stored relationships,

wherein the relationships define which of the plurality of digital glass devices and which of the plurality of agencies are to receive data generated by a specific digital glass device or a specific agency,

wherein the registration module is configured to store an identification of a leader among the plurality of digital glass devices,

wherein the control module includes a control input for receiving external control instructions from the leader,

wherein the control module is configured to modify the relationships stored in the registration module based on the control instructions received from the leader,

wherein the relationships define at least one Field Group of digital glass devices that are cooperatively operating in a common task, and at least one Agency Group of agencies that are cooperatively assisting with the common task, and

wherein the modifying of the relationships includes at least one of adding a first digital glass device to a first Field Group, removing the first digital glass device from the first Field Group, and reassigning the first digital glass device from the first Field Group to a second Field Group.

23. A digital glass-enhanced media system in communication with a plurality of digital glass devices and a plurality of agencies, the system comprising:

a transceiver configured to receive data streams;

a control module configured to control routing of the received data streams, the control module including;

a registration module configured to register the plurality of digital glass devices; and

a source/destination determination module configured to determine a source of a received data stream, and a destination of the received data stream; and

a distribution module configured to route the received data streams according to the routing control performed by the control module, the distribution module including;

a processing module configured to process the received data streams; and

a switching module configured to direct the received data streams to their respective destinations according to the routing control,

wherein the registration module registers a first digital glass device upon a user inputting a unique ID associated with the first digital glass device, the registering of the first digital glass device including storing the unique ID in association with a Field Group of other digital glass devices, an Agency Group of assisting agencies, and a leader tag indicating whether the first digital glass device is a group leader.