Device for interacting with real-time streams of content

• US 20040174431A1
• Filed: 11/12/2003
• Published: 09/09/2004
• Est. Priority Date: 05/14/2001
• Status: Abandoned Application

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Stienstra, Marcelle Andrea
• Application Number:
  US10/477,492
• Publication Number:
  US 20040174431A1
• Time in Patent Office: Days
• US Class Current: 348/155
• CPC Class Codes: A63F 2300/1068 being specially adapted to detect the point of contact of the player on a surface, e.g. floor mat, touch pad
• CPC Class Codes: A63F 2300/1087 comprising photodetecting means, e.g. a camera
• CPC Class Codes: A63F 2300/8047 Music games
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 2220/201 for movement interpretation, i.e. capturing and recognizing a gesture or a specific kind of movement, e.g. to control a musical instrument
• CPC Class Codes: G10H 2220/341 Floor sensors, e.g. platform or groundsheet with sensors to detect foot position, balance or pressure, steps, stepping rhythm, dancing movements or jumping shoe sensors G10H2220/336
• CPC Class Codes: G10H 2220/411 Light beams key actuation detection using light G10H2220/305
• CPC Class Codes: G10H 2220/415 Infrared beams
• CPC Class Codes: G10H 2220/455 Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015

Abstract

An end-user system (10) for transforming real-time streams of content into an output presentation includes a user interface (30) that allows a user to interact with the streams. The user interface (30) includes sensors (32a-f) that monitor an interaction area (36) to detect movements and/or sounds made by a user. The sensors (32a-f) are distributed among the interaction area (36) such that the user interface (30) can determine a three-dimensional location within the interaction area (36) where the detected movement or sound occurred. Different streams of content can be activated in a presentation based on the type of movement or sound detected, as well as the determined location. The present invention allows a user to interact with and adapt the output presentation according to his/her own preferences, instead of merely being a spectator.

Claims

1. A user interface (30) for interacting with a device that receives and transforms streams of content into a presentation to be output, comprising:

an interaction area (36);

at least one sensor (32) for detecting a movement or sound made by a user within said interaction area (36),

wherein one or more streams of content are manipulated based on said detected movement or sound, and

wherein the presentation is controlled based on said manipulated streams of content.

2. The user interface (30) according to claim 1, wherein said at least one sensor (32) detects a movement made by the user,

and wherein a type of movement or sound corresponding to said detected movement or sound is determined by analyzing a detection signal from said at least one sensor (32).

3. The user interface (30) according to claim 2, wherein a received stream of content is activated or deactivated in the presentation based on the determined type of movement or sound.

4. The user interface (30) according to claim 1, wherein said at least one sensor (32) includes a plurality of sensors, and

wherein detection signals from said plurality of sensors are analyzed to determine a location within said interaction area (36) in which said detected movement or sound occurs.

5. The user interface (30) according to claim 4, wherein a received stream of content is activated or deactivated in the presentation based on said determined location.

6. The user interface (30) according to claim 1, wherein said at least one sensor (32) includes a sound-detecting sensor (33) connected to a speech recognition system, and

wherein a received stream of content is detected based on a particular word being recognized by said speech recognition system.

7. The user interface (30) according to claim 1, wherein each of said at least one sensor (32) includes a motion sensor (34) and a sound-detecting sensor (33).

8. The user interface (30) according to claim 1, wherein said presentation 10 includes a narrative.

9. A process in a system for transforming streams of content into a presentation to be output, comprising:

detecting a movement or sound occurring within an interaction area (36);

manipulating one or more streams of content based on said detected movement or sound;

controlling said presentation based on the manipulated streams of content.

10. A system comprising:

an end-user device (10) for receiving and transforming streams of content into a presentation;

a user interface (30) including sensors (32) for detecting a movement or sound made by a user within an interaction area (36);

an output device (15) for outputting said presentation,

wherein said end-user device (10) manipulates said transformed streams of content based on said detected movement or sound, thereby controlling said presentation.