Information entry method and device

• US 10,192,586 B2
• Filed: 04/21/2017
• Issued: 01/29/2019
• Est. Priority Date: 04/11/2017
• Status: Active Grant

• Current Assignee: Huizhou University
• Original Assignee: Huizhou University
• Inventors: Cai, Zhaoquan, Hu, Song, Hu, Hui, Cai, Yingxue, Chen, Jia
• Primary Examiner(s): Colucci, Michael C
• Application Number:
  US15/493,320
• Publication Number:
  US 20180294012A1
• Time in Patent Office: 648 Days
• Field of Search: 704500, 704243, 709225
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G11B 20/10527 Audio or video recording; Data buffering arrangements G11B20/12 - G11B20/18 take precedence
• CPC Class Codes: G11B 2020/10546 specifically adapted for audio data
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel

Abstract

The present disclosure provides an information entry method and a corresponding device. The method comprises: step a): acquiring in real-time motion data from a user companion device; step b): determining whether the device changes from a first motion status to a second motion status based on the motion data; if so, activating a recording module of the device; step c): recording in real-time the user'"'"'s voice input through the recording module; step d): stopping recording according to a preset voice instruction of stopping recording. The method and device can address a need of information entry in the following scenario: when a user incidentally wants to record some audios during running or trotting, the device may quickly activate its own recording module based on the acquired motion data so as to enter information in an audio manner, without performing a touch operation on the companion device.

Claims

1. An information entry method, comprising:

step a);

acquiring in real-time motion data from a device comprising a sensor, a processor, a recorder and a microphone, wherein the sensor comprises (i) an accelerometer to detect an acceleration of a user, (ii) a velocimeter to sense a speed of the user, (iii) a gyroscope to sense a direction of the user, and (iv) a GPS component to sense a position of the user;

step b);

determining, executed by the processor, whether the device detects a change from a first motion status at a first time interval to a second motion status at a second time interval based on the motion data from the sensor, wherein the change comprises differences in (a) the acceleration of the user, (b) the speed of the user, (c) the direction of the user and (d) the position of the user;

if so, activating, executed by the processor, the recorder of the device when (1) each of the differences is larger than a respective predetermined threshold and (2) the device is shaken regularly, thereby activating the recorder to prepare for recording without performing a touch operation on the device;

wherein the differences include;

(A) acceleration data change when the device changes from a first instantaneous acceleration at a first time t1 to a second instantaneous acceleration at a second time t2;

(B) speed data change when the device changes from a first average speed within the first time interval to a second average speed within the first time interval;

(C) direction data change when the device changes from having direction changes within the second time interval to having no direction changes within the second time interval; and

(D) position data change when the device changes from having position changes within a third time interval to having no position changes within the third time interval;

wherein the acceleration data change, the speed data change, the direction data change and the position data change are acquired in real time; and

wherein shaking of the device corresponds to adding a trigger condition for activating the recording module, and the trigger condition adds an extra interaction for the user, thereby avoiding unnecessary activation to the recorder and reducing unnecessary energy consumption,

step c);

recording in real-time user'"'"'s voice input through the recorder of the device;

step d);

stopping recording according to a preset voice instruction of stopping recording, wherein the preset voice instruction of stopping recording is collected through the microphone of the device;

wherein the first motion state corresponds to a running or trotting status of the user, and the second motion status corresponds to a walking status of the user.

2. The information entry method according to claim 1, wherein the step a) comprises:

step a1);

acquiring acceleration data of the device in real-time; and

/or,

step a2);

acquiring speed data of the device in real-time; and

/or

step a3);

acquiring direction data of the device in real-time; and

/or,

step a4);

acquiring position data of the device in real-time.

3. The information entry method according to claim 1, wherein activating the recorder of the device in step b) comprises:

step b1;

detecting whether the device is shaken regularly;

if so, activating the recorder of the device;

otherwise, activating the recorder of the device according to the preset voice instruction of starting recording.

4. The information entry method according to claim 1, further comprising:

step e);

recognizing a Convert Audio Content instruction in a recording, converting recording content into textual content according to the Convert Audio Content instruction, and synchronizing the textual content to a calendar or notepad.

5. The information entry method according to claim 1, wherein

the change comprises the differences in the acceleration, the speed, the direction and the position;

and

when each of the differences is larger than a first respective predetermined threshold, the recorder of the device is activated, executed by the processor, to prepare for recording without performing the touch operation on the device.

6. The information entry method according to claim 5, wherein the first time interval is identical to the second time interval.

7. A device for information entry, comprising:

a sensor, wherein the sensor comprises (i) an accelerometer to detect an acceleration of a user, (ii) a velocimeter to sense a speed of the user, (iii) a gyroscope to sense a direction of the user, and (iv) a GPS component to sense a position of the user;

a processor, configured to;

acquire in real-time motion data from the device;

determine whether the device detects a change from a first motion status at a first time interval to a second motion status at a second time interval based on the motion data, wherein the change comprises differences in (a) the acceleration of the user, (b) the speed of the user, (c) the direction of the user and (d) the position of the user;

if so, activate a recorder of the device when (1) each of the differences is larger than a respective predetermined threshold and (2) when the device is shaken regularly, thereby activating the recorder to prepare for recording without performing a touch operation on the device;

wherein the differences include;

(A) acceleration data change when the device changes from a first instantaneous acceleration at a first time t1 to a second instantaneous acceleration at a second time t2;

(B) speed data change when the device changes from a first average speed within the first time interval to a second average speed within the first time interval;

(C) direction data change when the device changes from having direction changes within the second time interval to having no direction changes within the second time interval; and

(D) position data change when the device changes from having position changes within a third time interval to having no position changes within the third time interval;

wherein the acceleration data change, the speed data change, the direction data change and the position data change are acquired in real time; and

wherein shaking of the device corresponds to adding a trigger condition for activating the recording module, and the trigger condition adds an extra interaction for the user, thereby avoiding unnecessary activation to the recorder and reducing unnecessary energy consumption,

record in real-time user'"'"'s voice input through the recorder;

stop recording according to a preset voice instruction of stopping recording; and

a microphone, wherein the microphone collects the preset voice instruction of stopping recording;

wherein the first motion state corresponds to a running or trotting status of the user, and the second motion status corresponds to a walking status of the user.

8. The device according to claim 7, wherein the processor is further configured:

acquire acceleration data of the device in real-time; and

/or,

acquire speed data of the device in real-time; and

/or

acquire direction data of the device in real-time; and

/or,

acquire position data of the device in real-time.

9. The device according to claim 8, wherein the processor is further:

configured to detect whether the device is shaken regularly;

if so, activate the recorder of the device;

otherwise, activate the recorder of the device according to a preset voice instruction of starting recording.

10. The device according to claim 8, wherein the processor is further

configured to recognize a Convert Audio Content instruction in a recording, convert recording content into textual content according to the Convert Audio Content instruction, and synchronize the textual content to a calendar or notepad.

11. The device according to claim 7, wherein

the change comprises the differences in the acceleration, the speed, the direction and the position;

and

when each of the differences is larger than a first respective predetermined threshold, the recorder of the device is activated, executed by the processor, to prepare for recording without performing the touch operation on the device.

12. The device according to claim 11, wherein the first time interval is identical to the second time interval.