SENSOR INPUT TRANSMISSION AND ASSOCIATED PROCESSES

• US 20160308917A1
• Filed: 09/25/2015
• Published: 10/20/2016
• Est. Priority Date: 04/20/2015
• Status: Abandoned Application

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Veeramani, Karthik, Hunt, Preston J.
• Application Number:
  US14/865,585
• Publication Number:
  US 20160308917A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 69/24 Negotiation of communication capabilities
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04W 4/38 for collecting sensor information

Abstract

This disclosure describes methods, apparatus, and systems related to sensor input transmission and associated processes. In some embodiments, a source device may establish a wireless connection with a sink device. A video content stream corresponding to content presented on a source device display may be generated. The video content stream may be transmitted to the sink device. A data packet received from the sink device may be identified, the data packet comprising sensor data. An updated video content stream using the sensor data may be generated. The updated video content stream may be transmitted to the sink device.

Claims

1. A computer-readable non-transitory storage medium that contains instructions, which when executed by one or more processors result in performing operations comprising:

establishing a wireless connection with a sink device;

generating a video content stream corresponding to content presented on a source device display;

causing to transmit the video content stream to the sink device;

identifying a data packet received from the sink device, the data packet comprising sensor data;

generating an updated video content stream using the sensor data; and

causing to transmit the updated video content stream to the sink device.

2. The computer-readable non-transitory storage medium of claim 1, wherein the operations further comprise:

processing the sensor data; and

injecting the sensor data into an input system of a corresponding sensor of the source device.

3. The computer-readable non-transitory storage medium of claim 1, wherein the operations further comprise:

initiating a Transmission Control Protocol (TCP) connection with the sink device; and

wherein identifying the data packet comprising the sensor data captured by the sink device comprising identifying the data packet using a User Input Back Channel (UIBC) protocol via the TCP connection.

4. The computer-readable non-transitory storage medium of claim 1, wherein the operations further comprise:

querying the sink device to determine that the sink device supports a User Input Back Channel (UIBC) protocol;

identifying a list of supported input types received from the sink device; and

causing to transmit a request to the sink device to send inputs for a subset of the supported input types;

wherein the sensor data is associated with a supported input type from the list of supported input types.

5. The computer-readable non-transitory storage medium of claim 4, wherein the list of supported input types comprises at least one of gyroscope, accelerometer, ambient temperature, gravity, light, magnetic field, orientation, pressure, proximity, relative humidity, or vendor-specific.

6. The computer-readable non-transitory storage medium of claim 1, wherein the operations further comprise:

disabling at least one sensor corresponding to a sensor of the sink device capturing sensor data.

7. The computer-readable non-transitory storage medium of claim 1, wherein the operations further comprise:

causing to transmit the video content stream to a second sink device;

identifying a second data packet received from the second sink device, the second data packet comprising a second sensor data;

determining the second sensor data from the second data packet;

generating a second updated video content stream using the second sensor data; and

causing to transmit the second updated video content stream to the sink device and the second sink device.

8. A system comprising:

at least one sensor;

at least one memory storing computer-executable instructions; and

at least one processor, wherein the at least one processor is configured to access the at least one memory and to execute the computer-executable instructions to;

establish a wireless connection with a sink device;

generate a video content stream corresponding to content presented on a source device display;

cause to transmit of the video content stream to the sink device;

identify a data packet received from the sink device, the data packet comprising sensor data;

generate an updated video content stream using the sensor data; and

cause to transmit the updated video content stream to the sink device.

9. The system of claim 8, wherein the at least one processor is configured to access the at least one memory and to execute the computer-executable instructions to:

process the sensor data; and

inject the sensor data into an input system of a corresponding sensor of the source device.

10. The system of claim 8, wherein the at least one processor is configured to access the at least one memory and to execute the computer-executable instructions to:

initiate a Transmission Control Protocol (TCP) connection with the sink device; and

wherein, to identify the data packet comprising the sensor data captured by the sink device further comprises identifying the data packet using a User Input Back Channel (UIBC) protocol via the TCP connection.

11. The system of claim 8, wherein the at least one processor is configured to access the at least one memory and to execute the computer-executable instructions to:

query the sink device to determine that the sink device supports a User Input Back Channel (UIBC) protocol;

identify a list of supported input types received from the sink device; and

cause to transmit a request to the sink device to send inputs for a subset of the supported input types;

wherein the sensor data is associated with a supported input type from the list of supported input types.

12. The system of claim 11, wherein the list of supported input types comprises at least one of gyroscope, accelerometer, ambient temperature, gravity, light, magnetic field, orientation, pressure, proximity, relative humidity, or vendor-specific.

13. The system of claim 8, wherein the at least one processor is configured to access the at least one memory and to execute the computer-executable instructions to:

disable at least one sensor corresponding to a sensor of the sink device capturing sensor data.

14. The system of claim 8, wherein the at least one processor is configured to access the at least one memory and to execute the computer-executable instructions to:

cause to transmit the video content stream to a second sink device;

identify a second data packet received from the second sink device, the second data packet comprising a second sensor data;

determine the second sensor data from the second data packet;

generate a second updated video content stream using the second sensor data; and

cause to transmit the second updated video content stream to the sink device and the second sink device.

15. A method comprising:

establishing a wireless connection with a sink device;

generating a video content stream corresponding to content presented on a source device display;

causing to transmit the video content stream to the sink device;

identifying a data packet received from the sink device, the data packet comprising sensor data;

generating an updated video content stream using the sensor data; and

causing to transmit the updated video content stream to the sink device.

16. The method of claim 15, further comprising:

processing the sensor data; and

injecting the sensor data into an input system of a corresponding sensor of the source device.

17. The method of claim 15, further comprising:

initiating a Transmission Control Protocol (TCP) connection with the sink device; and

wherein identifying the data packet comprising the sensor data captured by the sink device comprising identifying the data packet using a User Input Back Channel (UIBC) protocol via the TCP connection.

18. The method of claim 15, further comprising:

querying the sink device to determine that the sink device supports a User Input Back Channel (UIBC) protocol;

identifying a list of supported input types received from the sink device; and

causing to transmit a request to the sink device to send inputs for a subset of the supported input types;

wherein the sensor data is associated with a supported input type from the list of supported input types.

19. An apparatus comprising:

at least one sensor;

at least one memory storing computer-executable instructions; and

at least one processor, wherein the at least one processor is configured to access the at least one memory and to execute the computer-executable instructions to;

establish a wireless connection with a source device;

receive a video content stream corresponding to content presented on a source device display;

capture sensor data using the at least one sensor;

generate a data packet comprising the sensor data;

cause to transmit the data packet to the source device; and

receive an updated video content stream from the source device, wherein the updated video stream was generated using the sensor data.

20. The apparatus of claim 19, wherein the at least one processor is configured to access the at least one memory and to execute the computer-executable instructions to:

receive a query request from the source device requesting information associated with support for User Input Back Channel (UIBC) protocol;

generate a list of supported input types;

cause to transmit the list to the source device;

receive a request to the sink device to send inputs for a subset of the supported input types;

generate the data packet comprising the sensor data, wherein the sensor data is associated with a supported input type from the list of supported input types; and

cause to transmit the data packet to the source device.