INTERACTIVE EMBODIED ROBOT VIDEOGAME THROUGH THE USE OF SENSORS AND PHYSICAL OBJECTS

• US 20140302931A1
• Filed: 11/09/2012
• Published: 10/09/2014
• Est. Priority Date: 11/09/2011
• Status: Active Grant

• Current Assignee: Marta Isabel Santos Paiva Ferraz Conceicao
• Original Assignee: Marta Isabel Santos Paiva Ferraz Conceicao
• Inventors: Conceicao, Marta Isabel santos Paiva Ferraz
• Granted Patent: US 9,480,910 B2
• Time in Patent Office: Days
• US Class Current: 463/31
• CPC Class Codes: A63F 13/20 Input arrangements for video game devices
• CPC Class Codes: A63F 13/803 Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
• CPC Class Codes: A63F 2300/69 Involving elements of the real world in the game world, e.g. measurement in live races, real video
• CPC Class Codes: A63H 17/00 Toy vehicles, e.g. with self-drive; convertible into other toys A63H33/003; Cranes, winches or the like; Accessories therefor traffic games with figures moved by players A63F9/14
• CPC Class Codes: A63H 2200/00 Computerized interactive toys, e.g. dolls
• CPC Class Codes: G05B 2219/40411 Robot assists human in non-industrial environment like home or office

Abstract

The present invention refers to an embodied Robot videogame apparatus that receives input through the (human) user'"'"'s physical actions (full body actions), contact and physiological signals (Bio-signals). The apparatus has as principal components: led/sound sensor eye with a video camera; mechanical lever; rotation sensor; rubber torso; solar battery; sensor leds; heart rate and galvanic skin response sensor; multi-touch computer display, with a I/O board v2.0 Bluetooth wireless connection; multiplayer button; microphone; intensity sensor; feet support; suspensions; rubber pneumatic wheels; accelerometer sensor; plastic leveler sensor; wireless Bluetooth digitizers; Velcro strips; and GPS. The apparatus includes a series of electronic sensor that detects the user'"'"'s input physical actions, contact and physiological signals in real-time. The output result is visualized on a multi-touch computer display. The player'"'"'s real-time actions are translated in virtual actions in the software game scenarios (e.g., running with the physical robot represents the same virtual action in the game avatar). The apparatus establishes a simultaneous connection between physical and virtual realities and can be shared through online connection.

Claims

1. Robot apparatus characterized for incorporating a videogame and comprising:

led/sound sensor eye (2) with video camera;

mechanical lever (1);

rotation sensor (10);

rubber torso (4);

solar battery (3) and their solar panel for recharge the battery;

sensor leds (5);

heart rate and galvanic skin response sensor (11);

multi-touch computer display (13), with a I/O board v2.0 Bluetooth wireless connection (12);

multiplayer button (14);

microphone (15);

intensity sensor (16);

feet Support (8);

three suspensions (7);

three rubber pneumatic wheels (9);

accelerometer sensor (17);

plastic leveler sensor (6);

wireless Bluetooth digitizers (18);

Velcro strips;

GPS.

2. Robot apparatus according to claim 1, characterized for integrating a mechanical lever (1) comprising a light bulb, a dynamo motor generator and a lever.

3. Robot apparatus according to claim 1, characterized for integrating a led/sound sensor eye (2) comprising a video camera and translating the software videogame'"'"'s output into sound waves, and is connected with a multi-touch computer display (13) through a cable to acquire the output signal from the videogame software.

4. Robot apparatus according to claims 1 and 3, characterized for integrating the led/sound sensor eye (2) that is rechargeable trough the multi-touch computer display (13) by a USB connection.

5. Robot apparatus according to claim 1, characterized for integrating a rotation sensor (10) connected to a wireless Bluetooth digitizer (18), that calculates the apparatus intensity and acceleration displacement through the triple-axis earth'"'"'s magnetic field and identifies the apparatus position in the physical spatial coordinates in real-time.

6. Robot apparatus according to claim 1, characterized for integrating a solar battery (3), that recharges the multi-touch computer display (13) through solar empowerment, from 35 to 38 hours under direct contact with sunlight.

7. Robot apparatus according to claim 1, characterized for the sensor leds (5) comprising one wireless Bluetooth digitizer (18) and produces a visible light while pressed and in the pressed area.

8. Robot apparatus according to claim 1, characterized for integrating a rubber torso (4) comprising a solar battery (3), sensor leds (5), a rotation sensor (10), a heart rate and galvanic skin response sensor (11), a multi-touch computer display (13), a multiplayer button (14), a microphone (15), and an intensity sensor (16), which are connected to the rubber torso (4) by a Velcro strips.

9. Robot apparatus according to claims 1 and 8, characterized for integrating a rubber torso (4) that is connected to a triangular base through a plastic leveler sensor (6).

10. Robot apparatus according to claim 1, characterized for integrating a heart rate and galvanic skin response sensor (11) comprising a wireless Bluetooth digitizer (18) and a rectangular pad made of electrical conductive material to measure the skin temperature, heat flux and skin electrical conductivity, by measuring the heart rate player and the galvanic skin response of the user in real-time.

11. Robot apparatus according to claim 1, characterized for integrating a multiplayer button (14) comprising a wireless Bluetooth digitizer (18) that is placed in the rubber torso (4), that when pressed starts the multiplayer function by activating an online connection.

12. Robot apparatus according to claim 1, characterized for integrating a microphone (15) that is placed in the rubber torso (4), and that consists in an acoustic-to-electric transducer that converts sound waves into an electrical signal.

13. Robot apparatus according to claims 1 and 12, characterized for integrating a microphone (15) that is connected to the multi-touch computer display (13) via cable TRS connector input to the soundcard.

14. Robot apparatus according to claim 1, characterized for integrating an intensity sensor (16) comprising a wireless Bluetooth digitizer (18) and a slider bar for the player to control the intensity of the game.

15. Robot apparatus according to claim 1, characterized for integrating a plastic leveler sensor (6) comprising a wireless Bluetooth digitizer (18) and a plastic cylindrical structure with six protrusions that fit internally with the rubber torso (4).

16. Robot apparatus according to claims 1 and 15, characterized for integrating a the plastic leveler sensor (6) activated by the action of pulling or pushing to select the five sprockets levels, each level integrates five sensors, that responds to a pressure from approximately 4 KPa (0.04 Kg/cm², 0.6 PSI) to 981 KPa (10.0 Kg/cm², 142 PSI), or a force of approximately 0.6 N (0.60 Kg) to 98 N (10 Kg) that is evenly applied across its active area, in a 13 mm diameter disk in real time.

17. Robot apparatus according to claim 1, characterized for integrating a plastic leveler sensor (6) that is connected to a triangular base that sustains the rubber torso (4), which is made of steel and wrapped with dense rubber.

18. Robot apparatus according to claims 1 and 17, characterized for integrating a triangular base with three feet supports (8), that support the users weight up to 120 kg.

19. Robot apparatus according to claims 1, 18 and 19, characterized by having three feet support (8) that are screwed to a rubber suspension (7) through a steel base.

20. Robot apparatus according to claims 1 and 18 to 20, characterized by each suspension (7) supporting a rubber pneumatic wheel (9), connected with a steel screwed bilateral system to the wheels circumference center.

21. Robot apparatus according to claim 1, characterized for integrating an accelerometer sensor (17) comprising a wireless Bluetooth digitizer (18), and placed in the rubber pneumatic wheels (9) which in turn are connected with the triangular base.

22. Robot apparatus according to claims 1, 5, 7, 10, 11, 14, 15 and 21, characterized by integrating wireless Bluetooth digitizers (18) comprising a micro plastic box, acquiring a signal to maximum 100 meters distance, and transmitting digital messages to the multi-touch computer display (13) in real-time.

23. Robot apparatus according to claims 1, 5, 7, 10, 11, 14, 15, and 22, characterized by integrating wireless Bluetooth digitizers (18) that are coupled to the wireless electronic sensors via an internal connection with a 3-pin column input cable extremity, which is then connected to an I2C port placed inside the wireless Bluetooth digitizers (18).

24. Robot apparatus according to claims 1, 5, 7, 10, 11, 14, 15, 21, 22 and 23 characterized by integrating wireless Bluetooth digitizer (18) that are recharged by a battery of 9V.

25. Robot apparatus according to claim 1, characterized for integrating a multi-touch computer display (13) placed in the back of the apparatus, and comprising a an anti-shock and anti-vibration system, GPS, and a I/O board v2.0 Bluetooth wireless connection (12).

26. Robot apparatus according to claims 1 and 25, characterized for integrating an I/O board v2.0 Bluetooth wireless connection (12) that establishes a connection with the sensors wirelessly, with a 10 bits resolution, 1020 steps of each 4.9 mV, that can sample up to 5760 Hz milliseconds latency in real-time.

27. Robot apparatus identified on claim 1, characterized for operate by this method:

Activated in real-time, by the user'"'"'s body physical actions, physiological signals, and speech recognition;

The user'"'"'s body physical actions, physiological signals and speech recognition are obtained through the rotation sensor (10), sensor leds (5), plastic leveler sensor (6), heart rate and galvanic skin response sensor (11), multiplayer button (14), intensity sensor (16) and accelerometer sensor (17);

Sensors are connected to wireless Bluetooth digitizers (18), that receive the signal to a maximum of 100 meters distance through wireless communication;

Data results are transmitted for the I/O board v2.0 Bluetooth wireless connection (12) placed in the multi-touch computer display (13);

The I/O board v2.0 Bluetooth wireless connection (12) captures and translates the wireless electronic sensor inputs with high resolution into digitally computer-encoded messages;

The digitally computer-encoded messages are transmitted for the multi-touch computer display (13);

The processed data is translated through a digital output in-real time, sound and image;

The videogame reacts to the user'"'"'s body physical actions (biomechanical actions), physiological signals (bio-signals) and user'"'"'s speech recognition;

The results of this process are visualized in the multi-touch computer display (13) and sounds and lights are also an output from the apparatus;

The results of the videogame are recorded in real time by a video camera;

The performed videogame can be shared in real-time in an online connection, whether in the same or different geographical spatial areas, where the players can share their physical and physiological actions.

28. Interactive videogame incorporated in the robot apparatus identified on claim 1, that comprises a plastic leveler sensor identified on claims 1, 15 and 16, characterized for activating a wireless communication between the wireless Bluetooth digitizer (18) that are connected to the plastic leveler sensor (6) and the I/O board v2.0 Bluetooth wireless connection (12) integrated in the multi-touch computer display (13).