DEVICE FOR INTERACTING WITH REAL-TIME STREAMS OF CONTENT

• US 20130086533A1
• Filed: 11/26/2012
• Published: 04/04/2013
• Est. Priority Date: 05/14/2001
• Status: Abandoned Application

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: STIENSTRA, MARCELLE A.
• Application Number:
  US13/684,792
• Publication Number:
  US 20130086533A1
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: A63F 2300/1068 being specially adapted to detect the point of contact of the player on a surface, e.g. floor mat, touch pad
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/8047 Music games
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 2220/201 for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument
• CPC Class Codes: G10H 2220/341 Floor sensors, e.g. platform or groundsheet with sensors to detect foot position, balance or pressure, steps, stepping rhythm, dancing movements or jumping shoe sensors G10H2220/336
• CPC Class Codes: G10H 2220/411 Light beams key actuation detection using light G10H2220/305
• CPC Class Codes: G10H 2220/415 Infrared beams
• CPC Class Codes: G10H 2220/455 Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015

Abstract

An end-user system (10) for transforming real-time streams of content into an output presentation includes a user interface (30) that allows a user to interact with the streams. The user interface (30) includes sensors (32a-f) that monitor an interaction area (36) to detect movements and/or sounds made by a user. The sensors (32a-f) are distributed among the interaction area (36) such that the user interface (30) can determine a three-dimensional location within the interaction area (36) where the detected movement or sound occurred. Different streams of content can be activated in a presentation based on the type of movement or sound detected, as well as the determined location. The present invention allows a user to interact with and adapt the output presentation according to his/her own preferences, instead of merely being a spectator.

Claims

1. A user interface (30) for interacting with a device that receives and transforms streams of content into a presentation to be output, comprising:

at least one sensor (32) for detecting a movement made by a user positioned in an interaction area (36) proximate to a location at which the presentation is output, wherein said sensor (32) is arranged to be aimed towards said interaction area;

wherein a type of movement corresponding to said detected movement is determined by analyzing a detection signal from said at least one sensor (32);

wherein the type of movement is different facial expressions or hand gestures made by the user, a gesture that imitates the use of a device or a tool, or an amount of force or speed with which the user makes a gesture; and

wherein the presentation is controlled by manipulating one or more streams of content based on said determined type of movement and a received stream of content is activated or deactivated in the presentation based on the determined type of movement.

4. The user interface (30) according to claim 1, wherein said at least one sensor (32) includes a plurality of sensors, and

wherein detection signals from said plurality of sensors are analyzed to determine a location within said interaction area (36) in which said detected movement occurs.

5. The user interface (30) according to claim 4, wherein a received stream of content is activated or deactivated in the presentation based on said determined location.

8. The user interface (30) according to claim 1, wherein said presentation includes a narrative.

2-3. -3. (canceled)

6-7. -7. (canceled)

9. A process in a system for transforming streams of content into a presentation to be output, comprising:

Detecting by means of at least one sensor a movement made by a user which is positioned in an interaction area (36) proximate to a location at which the presentation is output, wherein said sensor (32) is arranged to be aimed towards said interaction area (36);

wherein a type of movement corresponding to said detected movement is determined by analyzing a detection signal;

wherein the type of movement is different facial expressions or hand gestures made by the user, a gesture that imitates the use of a device or a tool, or an amount of force or speed with which the user makes the gesture;

wherein the presentation is controlled by manipulating one or more streams of content based on said determined movement, and a received stream of content is activated or deactivated in the presentation based on the determined type of movement.

10. A system comprising:

an end-user device (10) for receiving and transforming streams of content into a presentation;

an output device (15) for outputting said presentation;

a user interface (30) including at least one sensor (32) for detecting a movement made by a user which is positioned in an interaction area (36) proximate to the output device (15), wherein said sensor (32) is arranged to be aimed towards said interaction area;

wherein a type of movement corresponding to said detected movement is determined by analyzing a detection signal from said sensor (32);

wherein the type of movement is different facial expressions or had gestures made by the user, a gesture that imitates the use of a device or a tool, or an amount of force or speed with which the user makes a gesture; and

wherein said end-user device (10) manipulates said transformed streams of content based on said determined type of movement, thereby controlling said presentation, and a received stream of content is activated or deactivated in the presentation based on the determined type of movement.

11. The system according to claim 10, wherein each stream of content includes control data that links the stream to a particular gesture.

12. The system according to claim 10, wherein said manipulated streams of content correspond to parts of a narrative.