Systems and methods for displaying a user interface

• US 10,107,887 B2
• Filed: 03/15/2013
• Issued: 10/23/2018
• Est. Priority Date: 04/13/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Kim, Lae-Hoon, Visser, Erik, Ton, Phuong Lam, Toman, Jeremy Patrick, Shaw, Jeffrey Clinton
• Primary Examiner(s): Choi, David
• Application Number:
  US13/835,881
• Publication Number:
  US 20130275872A1
• Time in Patent Office: 2,048 Days
• Field of Search: 715716
• CPC Class Codes: G01B 21/00 Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant
• CPC Class Codes: G01S 15/86 Combinations of sonar systems with lidar systems; Combinations of sonar systems with systems not using wave reflection
• CPC Class Codes: G01S 15/876 Combination of several spaced transmitters or receivers of known location for determining the position of a transponder or a reflector G01S15/872 takes precedence
• CPC Class Codes: G01S 3/80 using ultrasonic, sonic or infrasonic waves
• CPC Class Codes: G01S 3/8006 Multi-channel systems specially adapted for direction-finding, i.e. having a single aerial system capable of giving simultaneous indications of the directions of different signals
• CPC Class Codes: G01S 3/8083 determining direction of source
• CPC Class Codes: G01S 5/18 using ultrasonic, sonic, or infrasonic waves
• CPC Class Codes: G01S 5/186 Determination of attitude using inertial means G01C9/00; control of attitude G05D1/49
• CPC Class Codes: G06F 1/1633 Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 2021/02166 Microphone arrays; Beamforming
• CPC Class Codes: H04R 1/08 Mouthpieces; Microphones; Attachments therefor
• CPC Class Codes: H04R 3/00 Circuits for transducers , loudspeakers or microphones
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04S 7/40 Visual indication of stereophonic sound image

Abstract

A method for displaying a user interface on an electronic device is described. The method includes presenting a user interface. The user interface includes a coordinate system. The coordinate system corresponds to physical coordinates based on sensor data. The method also includes providing a sector selection feature that allows selection of at least one sector of the coordinate system. The method further includes providing a sector editing feature that allows editing the at least one sector.

Claims

1. A method for displaying a user interface on an electronic device, comprising:

presenting a user interface, wherein the user interface comprises a coordinate system, wherein the coordinate system corresponds to physical coordinates based on sensor data;

providing a sector selection feature that allows selection of at least one sector of the coordinate system, wherein the at least one sector corresponds to captured audio from multiple microphones, and wherein a sector selection comprises an audio signal indicator;

providing a sector editing feature that allows adjusting a size of the at least one sector based on a received input providing an adjustment to at least one boundary of the at least one sector of the coordinate system; and

performing an audio operation on the captured audio corresponding to the audio signal indicator based on the sector selection.

2. The method of claim 1, further comprising displaying a directionality of at least one audio signal captured by the multiple microphones.

3. The method of claim 2, wherein the at least one audio signal comprises a voice signal.

4. The method of claim 2, further comprising displaying an icon corresponding to the at least one audio signal.

5. The method of claim 4, wherein displaying an icon further comprises displaying at least one of an icon for a target audio signal and an icon for an interference audio signal.

6. The method of claim 1, further comprising passing audio signals indicated within the at least one sector.

7. The method of claim 1, further comprising attenuating audio signals not indicated within the at least one sector.

8. The method of claim 1, further comprising indicating image data from one or more image sensors.

9. The method of claim 1, further comprising passing image data based on the one or more sectors.

10. The method of claim 1, wherein at least one of the sector selection feature and the sector editing feature operate based on at least one of a group consisting of single-touch input and multi-touch input.

11. The method of claim 1, further comprising:

displaying at least one touch point corresponding to the at least one sector;

receiving a touch input corresponding to the at least one touch point; and

editing the at least one sector based on the touch input.

12. The method of claim 1, further comprising aligning at least a part of the user interface with a reference plane.

13. The method of claim 12, wherein the reference plane is horizontal.

14. The method of claim 12, wherein aligning at least a part of the user interface comprises mapping a two-dimensional polar plot into a three-dimensional display space.

15. The method of claim 1, wherein the physical coordinates are earth coordinates.

16. The method of claim 1, wherein the physical coordinates represent a physical space independent of earth coordinates.

17. The method of claim 1, wherein the coordinate system maintains an orientation independent of electronic device orientation.

18. The method of claim 1, further comprising:

recognizing an audio signature;

looking up the audio signature in a database;

obtaining identification information corresponding to the audio signature; and

displaying the identification information on the user interface.

19. The method of claim 18, wherein the identification information is an image of a person corresponding to the audio signature.

20. The method of claim 1, further comprising providing at least one of a show target control and a show interferer control.

21. The method of claim 1, further comprising padding a selected sector.

22. The method of claim 1, wherein the sector selection feature enables selection of multiple sectors at once.

23. The method of claim 1, wherein the sector editing feature enables adjusting the sector based on single- or multi-touch input.

24. The method of claim 1, wherein the sector selection feature is based on one or more swipe inputs.

25. The method of claim 24, wherein the one or more swipe inputs indicate a circular region.

26. The method of claim 24, wherein the one or more swipe inputs are a single swipe.

67. The method of claim 1, wherein the at least one sector corresponds to an angular range of the captured audio.

69. The method of claim 1, wherein an adjusted size of the at least one sector is expanded relative to the size of the at least one sector of the coordinate system prior to the adjustment.

71. The method of claim 1, wherein an adjusted size of the at least one sector is narrowed relative to the size of the at least one sector of the coordinate system prior to the adjustment.

73. The method of claim 1, further comprising providing an editable mode or both a fixed mode and the editable mode.

27. An electronic device, comprising:

a display, wherein the display is configured to;

present a user interface, wherein the user interface comprises a coordinate system, wherein the coordinate system corresponds to physical coordinates based on sensor data;

present a sector selection feature that allows selection of at least one sector of the coordinate system, wherein the at least one sector corresponds to captured audio from multiple microphones, and wherein a sector selection comprises an audio signal indicator;

present a sector editing feature that allows adjusting a size of the at least one sector based on a received input providing an adjustment to at least one boundary of the at least one sector of the coordinate system; and

operation circuitry coupled to the display, wherein the operation circuitry is configured to perform an audio operation on the captured audio corresponding to the audio signal indicator based on the sector selection.

28. The electronic device of claim 27, further comprising the multiple microphones, wherein the multiple microphones are configured to capture at least one audio signal, and wherein the display is configured to present a directionality of the at least one audio signal captured by the multiple microphones.

29. The electronic device of claim 28, wherein the at least one audio signal comprises a voice signal.

30. The electronic device of claim 28, wherein the display is configured to present an icon corresponding to the at least one audio signal.

31. The electronic device of claim 30, wherein the display is configured to present at least one of an icon for a target audio signal and an icon for an interference audio signal.

32. The electronic device of claim 27, wherein the operation circuitry is configured to pass audio signals indicated within the at least one sector.

33. The electronic device of claim 27, wherein the operation circuitry is configured to attenuate audio signals not indicated within the at least one sector.

34. The electronic device of claim 27, wherein the display is configured to indicate image data from one or more image sensors.

35. The electronic device of claim 27, wherein the operation circuitry is configured to pass image data based on the one or more sectors.

36. The electronic device of claim 27, wherein at least one of the sector selection feature and the sector editing feature operate based on at least one of a group consisting of single-touch input and multi-touch input.

37. The electronic device of claim 27, wherein the display is configured to present at least one touch point corresponding to the at least one sector, and wherein the electronic device further comprises a touch sensor that is configured to receive a touch input corresponding to the at least one touch point, and wherein the user interface is configured to edit the at least one sector based on the touch input.

38. The electronic device of claim 27, wherein the display is configured to present a user interface aligning at least a part of the user interface with a reference plane.

39. The electronic device of claim 38, wherein the reference plane is horizontal.

40. The electronic device of claim 38, wherein the display is configured to present a user interface mapping a two-dimensional polar plot into a three-dimensional display space.

41. The electronic device of claim 27, wherein the physical coordinates are earth coordinates.

42. The electronic device of claim 27, wherein the physical coordinates represent a physical space independent of earth coordinates.

43. The electronic device of claim 27, wherein the display is configured to maintain a coordinate system orientation independent of electronic device orientation.

44. The electronic device of claim 27, further comprising audio signature recognition circuitry that is configured to recognize an audio signature, look up the audio signature in a database, obtain identification information corresponding to the audio signature, and is configured to pass the identification information to the display.

45. The electronic device of claim 44, wherein the identification information is an image of a person corresponding to the audio signature.

46. The electronic device of claim 27, wherein the display is configured to present the user interface providing at least one of a show target control and a show interferer control.

47. The electronic device of claim 27, wherein the display is configured to present the user interface padding a selected sector.

48. The electronic device of claim 27, wherein the display is configured to provide the sector selection feature enabling selection of multiple sectors at once.

49. The electronic device of claim 27, wherein the display is configured to provide the sector editing feature enabling adjusting the sector based on single- or multi-touch input.

50. The electronic device of claim 27, wherein the display is configured to receive one or more swipe inputs indicating the at least one sector.

51. The electronic device of claim 50, wherein the display is configured to receive one or more swipe inputs indicating a circular region.

52. The electronic device of claim 50, wherein the display is configured to receive a single swipe.

68. The electronic device of claim 27, wherein the at least one sector corresponds to an angular range of the captured audio.

70. The electronic device of claim 27, wherein an adjusted size of the at least one sector is expanded relative to the size of the at least one sector of the coordinate system prior to the adjustment.

72. The electronic device of claim 27, wherein an adjusted size of the at least one sector is narrowed relative to the size of the at least one sector of the coordinate system prior to the adjustment.

74. The electronic device of claim 27, wherein the display is configured to present an editable mode or both a fixed mode and the editable mode.

53. A computer-program product for displaying a user interface, comprising a non-transitory tangible computer-readable medium having instructions thereon, the instructions comprising:

code for causing an electronic device to present a user interface, wherein the user interface comprises a coordinate system, wherein the coordinate system corresponds to physical coordinates based on sensor data;

code for causing the electronic device to provide a sector selection feature that allows selection of at least one sector of the coordinate system, wherein the at least one sector corresponds to captured audio from multiple microphones, and wherein a sector selection comprises an audio signal indicator;

code for causing the electronic device to provide a sector editing feature that allows adjusting a size of the at least one sector based on a received input providing an adjustment to at least one boundary of the at least one sector of the coordinate system; and

code for causing the electronic device to perform an audio operation on the captured audio corresponding to the audio signal indicator based on the sector selection.

54. The computer-program product of claim 53, wherein the instructions further comprise code for causing the electronic device to display a directionality of at least one audio signal captured by the multiple microphones.

55. The computer-program product of claim 53, wherein the instructions further comprise code for causing the electronic device to pass audio signals indicated within the at least one sector.

56. The computer-program product of claim 53, wherein the instructions further comprise code for causing the electronic device to attenuate audio signals not indicated within the at least one sector.

57. The computer-program product of claim 53, wherein at least one of the sector selection feature and the sector editing feature operate based on at least one of a group consisting of single-touch input and multi-touch input.

58. The computer-program product of claim 53, wherein the sector selection feature enables selection of multiple sectors at once.

59. The computer-program product of claim 53, wherein the sector selection feature is based on one or more swipe inputs.

60. An apparatus for displaying a user interface, comprising:

means for presenting a user interface, wherein the user interface comprises a coordinate system, wherein the coordinate system corresponds to physical coordinates based on sensor data;

means for providing a sector selection feature that allows selection of at least one sector of the coordinate system, wherein the at least one sector corresponds to captured audio from multiple microphones, and wherein a sector selection comprises an audio signal indicator;

means for providing a sector editing feature that allows adjusting a size of the at least one sector based on a received input providing an adjustment to at least one boundary of the at least one sector of the coordinate system; and

means for performing an audio operation on the captured audio corresponding to the audio signal indicator based on the sector selection.

61. The apparatus of claim 60, further comprising means for displaying a directionality of at least one audio signal captured by the multiple microphones.

62. The apparatus of claim 60, further comprising means for passing audio signals indicated within the at least one sector.

63. The apparatus of claim 60, further comprising means for attenuating audio signals not indicated within the at least one sector.

64. The apparatus of claim 60, wherein at least one of the sector selection feature and the sector editing feature operate based on at least one of a group consisting of single-touch input and multi-touch input.

65. The apparatus of claim 60, wherein the sector selection feature enables selection of multiple sectors at once.

66. The apparatus of claim 60, wherein the sector selection feature is based on one or more swipe inputs.