Automatic Data Expansion for Customer-care Spoken Language Understanding
Spoken language understanding (SLU) systems are widely used in handling of customer-care calls.A traditional SLU system consists of an acoustic model (AM) and a language model (LM) that areused to decode the utterance and a natural language understanding (NLU) model that predicts theintent. While AM can be shared across different domains, LM and NLU models need to be trainedspecifically for every new task. However, preparing enough data to train these models is prohibitivelyexpensive. In this paper, we introduce an efficient method to expand the limited in-domain data. Theprocess starts with training a preliminary NLU model based on logistic regression on the in-domaindata. Since the features are based onn= 1,2-grams, we can detect the most informative n-gramsfor each intent class. Using these n-grams, we find the samples in the out-of-domain corpus that1) contain the desired n-gram and/or 2) have similar intent label. The ones which meet the firstconstraint are used to train a new LM model and the ones that meet both constraints are used to train anew NLU model. Our results on two divergent experimental setups show that the proposed approachreduces by 30% the absolute classification error rate (CER) comparing to the preliminary modelsand it significantly outperforms the traditional data expansion algorithms such as the ones based onsemi-supervised learning, TF-IDF and embedding vectors.
NurtureToken

Token crowdsale for this paper ends in

Buy Nurture Tokens Now

Authors

Are you an author of this paper? Check the Twitter handle we have for you is correct.

Shahab Jalalvand (edit)
Andrej Ljolje (add twitter)
Srinivas Bangalore (add twitter)
Ask The Authors

Ask the authors of this paper a question or leave a comment.

Read it. Rate it.
#1. Which part of the paper did you read?

#2. The paper contains new data or analyses that is openly accessible?
#3. The conclusion is supported by the data and analyses?
#4. The conclusion is of scientific interest?
#5. The result is likely to lead to future research?

Github
User:
None (add)
Repo:
None (add)
Stargazers:
0
Forks:
0
Open Issues:
0
Network:
0
Subscribers:
0
Language:
None
Youtube
Link:
None (add)
Views:
0
Likes:
0
Dislikes:
0
Favorites:
0
Comments:
0
Other
Sample Sizes (N=):
Inserted:
Words Total:
Words Unique:
Source:
Abstract:
None
10/01/18 06:04PM
5,197
1,634
Tweets
ComputerPapers: Automatic Data Expansion for Customer-care Spoken Language Understanding. https://t.co/FyHW6Ydb6y
arxivml: "Automatic Data Expansion for Customer-care Spoken Language Understanding", Shahab Jalalvand, Andrej Ljolje, Sriniv… https://t.co/kFfJxza74V
arxiv_cscl: Automatic Data Expansion for Customer-care Spoken Language Understanding https://t.co/bT15AgbXIW
arxiv_cscl: Automatic Data Expansion for Customer-care Spoken Language Understanding https://t.co/bT15AgbXIW
arxiv_cscl: Automatic Data Expansion for Customer-care Spoken Language Understanding https://t.co/bT15AgbXIW
Images
Related