发明公开
EP4303754A1 PROMPT AUGMENTED GENERATIVE REPLAY VIA SUPERVISED CONTRASTIVE TRAINING FOR LIFELONG INTENT DETECTION
审中-实审

基本信息:
- 专利标题: PROMPT AUGMENTED GENERATIVE REPLAY VIA SUPERVISED CONTRASTIVE TRAINING FOR LIFELONG INTENT DETECTION
- 申请号:EP23182034.1 申请日:2023-06-28
- 公开(公告)号:EP4303754A1 公开(公告)日:2024-01-10
- 发明人: VARSHNEY, Vaibhav , PATIDAR, Mayur , KUMAR, Rajat , SHROFF, Gautam , VIG, Lovekesh
- 申请人: Tata Consultancy Services Limited
- 申请人地址: IN Mumbai 400021 Maharashtra Nirmal Building, 9th Floor Nariman Point
- 代理机构: Goddar, Heinz J.
- 优先权: IN202221039196 20220707
- 主分类号: G06F40/30
- IPC分类号: G06F40/30 ; G06N3/08 ; G06F40/216 ; G06F40/279 ; G06F40/35
摘要:
Embodiments disclosed herein model lifelong intent detection as a class-incremental learning where a new set of intents/classes are added at each incremental step. To address the issue of catastrophic forgetting during lifelong intent detection (LID), an incremental learner is provided with Prompt Augmented Generative Replay, wherein unlike existing approaches that store real samples in replay memory, only concept words obtained from old intents are stored, which reduces memory consumption and speeds up incremental training still enabling not forgetting the old intents. Joint training of an incremental learner is carried out for LID and a pseudo-labeled utterance generation with objective is to classify a user utterance into one of multiple pre-defined intents by minimizing a total Loss function comprising a LID loss function, a Labeled Utterance Generation loss function, a Supervised Contrastive Training loss function, and a Knowledge Distillation loss function.