Methods and Devices for Natural Human Interfaces and for Man Machine and Machine to Machine Activities

• US 20150241984A1
• Filed: 02/24/2015
• Published: 08/27/2015
• Est. Priority Date: 02/24/2014
• Status: Abandoned Application

• Current Assignee: Yair Itzhaik
• Original Assignee: Yair Itzhaik
• Inventors: ITZHAIK, Yair
• Application Number:
  US14/629,662
• Publication Number:
  US 20150241984A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The present invention provides a method for activation of functions in a target computer device using a smart mobile device The method comprising the steps of: receiving inputs from the smart mobile device sensors to identify motion or orientation of the device in space and identify touch screen inputs, receive inputs from camera of the target computer device capturing movement and orientation of smart mobile device and/or motion of user'"'"'s body parts, applying algorithms to translate and synchronize data from various sensors of the smart mobile device, by applying cross-match algorithm on data from different multiple sensors, process simultaneous inputs data from the smart mobile device and/or the data from camera of the target device which identifies the movements of the smart device to determine user 3D control commands based on pre-defined rules and translating determined control commands into instructions in the target computer device.

Claims

1. A method of activation functions of application in a target computer device including 3d movements functions, using a smart mobile device, said method comprising the steps of:

receive inputs from the smart mobile device sensors including at least one of;

motion sensor;

tilting/accelerator sensor to identify motion or orientation of the device in space and identify touch screen inputs that follow the fingers movement on the touch screen or the hovering of the fingers over and/or keystrokes;

receive inputs from camera and/or microphone of the target computer device capturing movement and orientation of smart mobile device as moved by the user'"'"'s hands and or motion of user'"'"'s body parts;

applying script language and algorithms enabling to translate and synchronize data from various sensors of the smart mobile device, by applying cross-match algorithm on data from different multiple sensors to map and describe user'"'"'s real world physical motion and orientation parameters such as his 3d position and movements;

processing simultaneous inputs data from the smart mobile device including data of motion of fingers along the touch screen or/and identified motion, a linear movement and/or a rotation movement of the smart mobile device by the user'"'"'s hands, and/or the data from camera of the target device which identifies the movements of the smart device to determine user 3D control commands based on pre-defined rules, using parameters which relates to at least one of;

fingers motion along the touch screen movement in space, tiling movements of body'"'"'s parts or hands grabbing and/or moving the smart phone device in space; and

translating determined control commands into instructions of designated application of the target computer device or the mobile device.

2. The method of claim 1 further comprising the step of:

Translating control commands into objects or coordinate system movements on the screen of target computerized device.

3. The method of claim 1 further comprising the step of sending in real-time feedback to the smart device to activate processes thereof or to the sensors to change sensors configuration based on analyzed sensor data.

4. The method of claim 1 wherein the commands include building 3D objects models by a user based on equivalent 3D objects presented to the user on the target screen.

5. The method of claim 1 wherein the commands include operating 3D game on the target computerized device.

6. The method of claim 1 wherein using given 3D pixel objects models of user'"'"'s organs to identify finger touch in pre-defined locations on the user organ or an object enabling to simulate reduced keyboard for using with smart mobile device, where each predefined location on the organ or object simulate at least one key or function in the smart mobile device.

7. The method of claim 1 wherein the identifying user finger movement along predefined path along the screen, is translated into predefined graphical command including movement of an object in a third dimension or zooming in or out.

8. The method of claim 1 wherein identifying the movement of a first finger of user'"'"'s hand along horizontal and vertical axis along the smart device touch screen and a second hand'"'"'s finger along a predefined path can activate linear movements on the targeted screen in all three (x, y, z) axis in the same time.

9. The method of claim 1 wherein 7 wherein each movement of the finger on the screen is translated into different proportion of movement on the target screen based on pre-defined factor.

10. The method of claim 1 wherein 8, wherein each movement of the finger on the screen is translated into different proportion of movement on the target screen based on pre-defined factor.

11. The method of claim 1 wherein 7 wherein the predefined path is along the edge of the smart device touch screen.

12. The method of claim 1 wherein 8 wherein the predefined path is along the edge of the smart device touch screen.

13. The method of claim 1 wherein the process simultaneous inputs data include integrating data information of 3D movement of the smart phone with finger movement of the smart phone screen for determining specific control commands.

14. A method of activation functions of application in a target computer device including 2d and/or 3d movements functions, using a smart mobile device associated attached with interface device simulating electronic mouse interface capabilities, said method comprising the steps of:

receive inputs from the smart mobile device sensors including at least one of;

motion sensor;

tilting/accelerator sensor to identify motion and orientation of the device in space and identify touch screen inputs and/or keystrokes;

receive inputs from the interface device;

applying script language and algorithms enabling to translate and synchronize data from various sensors of the smart mobile device and input data of the interface device, by applying cross-match algorithm on data from different multiple sensors to map and describe user'"'"'s real world physical motion and orientation parameters such as his 3d position and movements;

process simultaneous or one after another, inputs data from of the smart mobile device and the interface device to determine user 2D or 3D control commands based on motion of fingers along the touch screen movement in space or tiling movements of body'"'"'s parts or hands grabbing and moving the device in 2D or 3D in space; and

translating determined control commands into instructions of designated application of the target computer device.

15. The method of claim 14 wherein the smart mobile device includes reduced keyboard layout which consists of number of adjacent areas, one of them represents a ‘

blank’

key and each one of the others areas contains and presents one or more letters or/and symbols, that can be keystroked by various keystroke types.

16. A method of activation functions of application in a target computer device including 3d movements functions, using a smart mobile device associated with interface device simulating electronic mouse interface capabilities, said method comprising the steps of:

receive inputs from the smart mobile device sensors including at least one of;

motion sensor;

tilting/accelerator sensor to identify motion and orientation of the device in space and identify touch screen inputs and/or keystrokes;

receive inputs from the interface device;

receive inputs from camera and/or microphone of the target computer device capturing movement and orientation of smart phone/pad device and or user body parts;

applying script language and algorithms enabling to translate and synchronize data from various sensors of the smart mobile device and input data of the interface device, by applying cross-match algorithm on data from different multiple sensors to map and describe user'"'"'s real world physical motion and orientation parameters such as his 3d position and movements;

process simultaneous inputs data from of the smart mobile device, the interface device and camera of the target device to determine user 3D control commands based on motion of fingers along the touch screen movement in space or tiling movements of body'"'"'s parts or hands grabbing and moving the device in space; and

translating determined control commands into instructions of designated application of the target computer device.