AUDIO-VIDEO REPRODUCTION DEVICE SETUP USING INTERVIEW-BASED VOICE CONTROL

• US 20200135188A1
• Filed: 10/24/2018
• Published: 04/30/2020
• Est. Priority Date: 10/24/2018
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: BURGUENO, ALLISON, MILLER, LINDSAY, DEMERCHANT, MARVIN, YI, HYEHOON, BARNES, TRACY, YOUNG, David, NISHIKAWA, YUKO
• Granted Patent: US 10,867,603 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 9/4411 Configuring for operating with peripheral devices; Loading of device drivers
• CPC Class Codes: G06F 9/453 Help systems
• CPC Class Codes: G10L 15/005 Language recognition
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/44227 Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network configuring of peripheral devices in general G06F9/4411; monitoring connectivity in data switched networks H04L43/0811
• CPC Class Codes: H04N 21/485 End-user interface for client configuration
• CPC Class Codes: H04N 21/4856 for language selection, e.g. for the menu or subtitles
• CPC Class Codes: H04N 21/4882 for displaying messages, e.g. warnings, reminders arrangements for providing short real-time information to substation in data switching networks H04L12/1895
• CPC Class Codes: H04N 21/6547 comprising parameters, e.g. for client setup

Abstract

An audio-video (AV) reproduction device that comprises at least one audio capturing device, at least one speaker, a memory, and circuitry. The memory stores setup information associated with first-time device setup of the audio-video reproduction device. The first-time device setup is associated with a plurality of configuration settings of the AV reproduction device. The circuitry controls the at least one speaker to output a message in the setup information, and controls the at least one audio capturing device to receive a user input based on the message. The circuitry compares the user input with at least one condition associated with the message. The circuitry configures a configuration setting from the plurality of configuration settings based on the comparison. The circuitry controls at least a function of the AV reproduction device based on the configured configuration setting.

Claims

1. An audio-video (AV) reproduction device, comprising:

at least one audio capturing device;

at least one speaker;

a memory configured to store setup information associated with a first-time device setup of the AV reproduction device, wherein the first-time device setup is associated with a plurality of configuration settings of the AV reproduction device, and

circuitry, coupled to the memory, wherein the circuitry is configured to;

control the at least one speaker to output a message in the setup information;

control the at least one audio capturing device to receive a user input based on the message, wherein the user input is a verbal input;

compare the received user input with at least one condition associated with the message;

configure a configuration setting from the plurality of configuration settings, based on the comparison of the received user input with the at least one condition associated with the message; and

control at least a function of the AV reproduction device based on the configured configuration setting.

2. The AV reproduction device according to claim 1, wherein the plurality of configuration settings of the AV reproduction device comprise at least one of a user language setting, a network setting, a user identification (ID) setting, a display setting, an audio setting, a hardware connection setting, a security and privacy setting, or an accessibility setting.

3. The AV reproduction device according to claim 2, further comprising:

a plurality of ports on a surface of the AV reproduction device,

wherein the hardware connection setting indicates connections between the plurality of ports and a plurality of external devices.

4. The AV reproduction device according to claim 3, wherein the plurality of ports comprise at least one of:

at least one High-Definition Multimedia Interface (HDMI) port, an HDMI-Audio Return Channel (ARC) port, a personal computer input (PC IN) port, at least one Universal Serial Bus (USB) port, a composite audio-video port, a component video port, a component audio port, a radio frequency (RF) port, an Ethernet port, or a power input port.

5. The AV reproduction device according to claim 3, wherein the plurality of external devices include at least one of an Audio-Video (AV) receiver, an audio reproduction device, a sound bar, a set-top box (STB), a mobile phone, an imaging device, or a gaming console.

6. The AV reproduction device according to claim 3,

wherein the memory is further configured to store first device identification information of each of the plurality of external devices corresponding to each of the plurality of ports, and

wherein the circuitry is further configured to:

detect a connection between a first port of the plurality of ports and at least one external device of the plurality of external devices;

receive second device identification information from the at least one external device based on the detection of the connection;

compare the received second device identification information with the stored first device identification information;

control the at least one speaker to output a first user guidance instruction, as the message, based on the comparison of the stored first device identification information and the received second device identification information;

control the at least one audio capturing device to receive the user input based on the output first user guidance instruction; and

configure the hardware connection setting of the AV reproduction device based on the received user input.

7. The AV reproduction device according to claim 6, wherein the first user guidance instruction indicates a request for confirmation of the connection between the first port and the at least one external device, and

wherein the circuitry is further configured to control the at least one audio capturing device to receive the user input as the confirmation of the connection between the first port and the at least one external device from a user.

8. The AV reproduction device according to claim 6, wherein the circuitry is further configured to:

detect that the first port is compatible with the at least one external device; and

control, the at least one speaker, to output a second user guidance instruction based on the detection that the first port is non-compatible with the at least one external device,

wherein the second user guidance instruction indicates a second port, of the plurality of ports, to establish the connection between the second port and the at least one external device, and

wherein the second user guidance instruction further indicates at least one of a position of the second port on the surface of the AV reproduction device, information about the at least one external device, or information about the connection between the second port and the at least one external device.

9. The AV reproduction device according to claim 3,

wherein the circuitry is further configured to receive, from one of the plurality of external devices, the user input related to the message, and

wherein the one of the plurality of external devices receives the user input as the verbal input.

10. The AV reproduction device according to claim 1, wherein the circuitry is further configured to:

convert the verbal input into first text information;

compare the first text information with the at least one condition associated with the message; and

configure the configuration setting based on the comparison of the first text information with the at least one condition associated with the message.

11. The AV reproduction device according to claim 1, wherein the circuitry is further configured to:

control the at least one speaker to output the message in a default language set in the AV reproduction device;

wherein the message in the default language is to set a language preferred by a user;

control the at least one audio capturing device to receive the user input which indicates the language preferred by the user;

configure a user language setting, as the configuration setting, based on the received user input; and

control at least the function of the AV reproduction device based on the configured user language setting.

12. The AV reproduction device according to claim 3, further comprising:

an image capturing device; and

a display screen,

wherein the memory is further configured to store one or more sample images of the plurality of external devices, and

wherein the circuitry is further configured to;

control the image capturing device to capture a first image of at least one external device of the plurality of external devices; and

identify, the at least one external device and at least one of the plurality of ports associated with the identified at least one external device, based on the captured first image and the stored one or more sample images of the plurality of external devices; and

control, one of the at least one speaker or the display screen, to output at least one user guidance instruction based on the identified at least one external device and the identified at least one of the plurality of ports,

wherein the at least one user guidance instruction indicates first information to connect the identified at least one external device to the identified at least one of the plurality of ports.

13. The AV reproduction device according to claim 12, wherein the at least one user guidance instruction further indicates second information of at least one cable to connect the identified at least one external device to the identified at least one of the plurality of ports.

14. The AV reproduction device according to claim 12, the circuitry is further configured to:

control the image capturing device to capture a second image of a user associated with the AV reproduction device;

recognize the user based on the captured second image; and

control, one of the at least one speaker or the display screen, to output the at least one user guidance instruction based on the recognized user.

15. The AV reproduction device according to claim 14, wherein the circuitry is further configured to:

determine past behavior information of the user based on the captured second image of the user; and

update the at least one user guidance instruction based on the determined past behavior information of the user.

16. The AV reproduction device according to claim 15, the circuitry is further configured to:

determine facial characteristics of the user from the captured second image of the user;

determine a behavior state of the user based on the determined facial characteristics of the user; and

control, one of the at least one speaker or the display screen, to output the at least one user guidance instruction based on the determined behavior state.

17. The AV reproduction device according to claim 12,

wherein the memory is further configured to store first manufacture information of the AV reproduction device, and

wherein the circuitry is further configured to:

retrieve the first manufacture information from the memory;

receive second manufacture information of the identified at least one external device from a server;

compare the retrieved first manufacture information and the received second manufacture information; and

transmit the configured configuration setting to the identified at least one external device based on the comparison of the retrieved first manufacture information and the received second manufacture information.

18. The AV reproduction device according to claim 1, wherein the circuitry is further configured to:

control the at least one speaker to output a plurality of messages in the setup information;

control the at least one audio capturing device to receive the user input for each of the output plurality of messages; and

control the AV reproduction device to configure the plurality of configuration settings based on the received user input for each of the output plurality of messages.

19. The AV reproduction device according to claim 18, further comprising a display screen,

wherein the circuitry is further configured to control one of the display screen or the at least one speaker to output an audio tutorial to a user based on the plurality of configuration settings of the AV reproduction device,

wherein the user is a visually impaired user, and

wherein the audio tutorial includes a plurality of audio instructions for the user to control the AV reproduction device.

20. A method, comprising:

in an audio-video (AV) reproduction device which comprises at least one speaker, at least one audio capturing device, and a memory;

storing, in the memory, setup information associated with a first-time device setup of the AV reproduction device, wherein the first-time device setup is associated with a plurality of configuration settings of the AV reproduction device;

outputting, via the at least one speaker, a message in the setup information;

receiving, via the at least one audio capturing device, a user input based on the message, wherein the user input is a verbal input;

comparing the received user input with at least one condition associated with the message;

configure a configuration setting from the plurality of configuration settings, based on the comparison of the received user input with the at least one condition associated with the message; and

controlling at least a function of the AV reproduction device based on the configured configuration setting.

21. A user device, comprising:

at least one audio capturing device;

at least one speaker;

a memory configured to store setup information associated with first-time device setup of an audio-video (AV) reproduction device, wherein the first-time device setup is associated with a plurality of configuration settings of the AV reproduction device; and

circuitry, coupled to the memory, configured to;

control the at least one speaker to output a message in the setup information;

control the at least one audio capturing device to receive a user input based on the message, wherein the user input is a verbal input;

compare the received user input with at least one condition associated with the message; and

transmit, to the AV reproduction device, information associated with a configuration setting from the plurality of configuration settings, based on the comparison of the received user input with the at least one condition associated with the message.

22. The user device according to claim 21, wherein the circuitry is further configured to control the at least one speaker to output a user guidance instruction, and wherein the user guidance instruction is associated with an unboxing operation of the AV reproduction device.