Use LEFT and RIGHT arrow keys to navigate between flashcards;
Use UP and DOWN arrow keys to flip the card;
H to show hint;
A reads text to speech;
15 Cards in this Set
- Front
- Back
What are the tasks of a speech dialog system? |
Maintaining the interaction, distributing the initiative (system-initiative, user-initiative, mixed-initiative) Aggregation of information which is relevant for the task Keeping track of input modalities and respective confidences Provision of the desired information to the user Meta communication: Correction of misunderstandings, feedback (explicit, implicit), etc. Provision of help to the user Resolution of complex dialogue phenamena (ellipses, references, etc.) Link to the application (database, booking protal, etc.) |
|
Name four types of dialog systems and explain what they consist of. |
1. Command systems: one command -> reaction |
|
Explain the two types of speech dialog system architectures. |
1. Sequential system: speech recognition and speech output lines separately, controlled by dialog manager (semantic frame) that accesses the database |
|
Name four basic blocks of speech dialog system. |
1. Speech recognition |
|
What is Wizard-of-Oz-Experiment? When and why is it used? |
Human substitutes missing speech modules in a dialog system, acts like a machine. Used when prototyping, to design the system (define vocabulary etc). People don't like talking to a system, they use different vocabulary, speak slower etc. |
|
Attribute-value pairs (slots) are used to store semantics. Give an example of it. What is the name of the process that fills the slots? |
Destination; München Hbf |
|
Give an example of contextual analysis by a speech dialog system. |
User: Next Sunday. This utterance needs to be converted to a date. |
|
What are the tasks of a dialog manager? |
1. Maintaining the interaction, distributing the initiative (system-initiative, user-initiative, mixed-initiative)
|
|
Explain three ways of implementing dialog systems.
|
1. Dialogue grammars: Top-down approach, e.g. with finite state machines or declarative grammars
2. Plan-based approaches: Modelling individual dialogue goals; assumption is that system and user have common goals 3. Collaborative approaches: Modelling of motivations and methods for reaching the dialogue goals, e.g. via adjustment of reciprocal assumptions and goals |
|
What models does dialog manager use to monitor dialog flow? |
1. Dialogue History: Sequence of propositions from the user and the system
|
|
What is a finite state automaton? |
A machine that is in one state at a time. Some trigger makes the machine go from one state to another. |
|
What are the three conversation model in a speech dialog system? What is the problem of user-initiative? |
1. System-initiative |
|
What is the difference between explicit and implicit feedback in speech dialog system? What are the risks? |
Explicit asks separately, whether information correct. Implicit merges the last information to new questions. Explicit is more reliable but slow. Implicit might make something wrong if the user doesn't notice the merged information. |
|
Things to take into account in speech dialog output. |
Not too much information given by the system. Limited vocabulary, the same vocabulary used by the system is probably used by the user. Parametric or real-recording system? Real-recording hard to update (requires the same speaker). |
|
Specific /Properties Requirements for Multimodal Dialogue Management |
System can change modality in case of errors System needs to handle semantic representations of input and output, in order to resolve cross-modal references System may handle a larger variety of users (with specific modality usage preferences) Timing of user interruptions in different modalities (premature requests, corrections, etc.) Confirmations in alternative modalities (e.g. non-intrusive feedback on a screen) Integrate conflicting information chunks from different modalities using dialogue context information |