专利快速检索-快速检索全球专利，免费商用专利数据库-IPRDB

1. 发明申请

US20230130634A1 Optimizing Inference Performance for Conformer 有权
公开(公告)号：US20230130634A1
公开(公告)日：2023-04-27
申请号：US17936547
申请日：2022-09-29
申请人： Google LLC
发明人： Tara N. Sainath , Rami Botros , Anmol Gulati , Krzysztof Choromanski , Ruoming Pang , Trevor Strohman , Weiran Wang , Jiahui Yu
IPC分类号： G10L15/16 , G10L15/22 , G10L15/06
摘要： A computer-implemented method includes receiving a sequence of acoustic frames as input to an automatic speech recognition (ASR) model. Here, the ASR model includes a causal encoder and a decoder. The method also includes generating, by the causal encoder, a first higher order feature representation for a corresponding acoustic frame in the sequence of acoustic frames. The method also includes generating, by the decoder, a first probability distribution over possible speech recognition hypotheses. Here, the causal encoder includes a stack of causal encoder layers each including a Recurrent Neural Network (RNN) Attention-Performer module that applies linear attention.

2. 发明公开

US20240371363A1 EFFICIENT STREAMING NON-RECURRENT ON-DEVICE END-TO-END MODEL 审中-公开
公开(公告)号：US20240371363A1
公开(公告)日：2024-11-07
申请号：US18772263
申请日：2024-07-15
申请人： Google LLC
发明人： Tara Sainath , Arun Narayanan , Rami Botros , Yanzhang He , Ehsan Variani , Cyril Allauzen , David Rybach , Ruoming Pang , Trevor Strohman
IPC分类号： G10L15/06 , G10L15/02 , G10L15/22 , G10L15/30
CPC分类号： G10L15/063 , G10L15/02 , G10L15/22 , G10L15/30
摘要： An ASR model includes a first encoder configured to receive a sequence of acoustic frames and generate a first higher order feature representation for a corresponding acoustic frame in the sequence of acoustic frames. The ASR model also includes a second encoder configured to receive the first higher order feature representation generated by the first encoder at each of the plurality of output steps and generate a second higher order feature representation for a corresponding first higher order feature frame. The ASR model also includes a decoder configured to receive the second higher order feature representation generated by the second encoder at each of the plurality of output steps and generate a first probability distribution over possible speech recognition hypothesis. The ASR model also includes a language model configured to receive the first probability distribution over possible speech hypothesis and generate a rescored probability distribution.

3. 发明申请

US20220310071A1 Tied and Reduced RNN-T 有权
公开(公告)号：US20220310071A1
公开(公告)日：2022-09-29
申请号：US17330446
申请日：2021-05-26
申请人： Google LLC
发明人： Rami Botros , Tara Sainath
IPC分类号： G10L15/16 , G10L15/08
摘要： A RNN-T model includes a prediction network configured to, at each of a plurality of times steps subsequent to an initial time step, receive a sequence of non-blank symbols. For each non-blank symbol the prediction network is also configured to generate, using a shared embedding matrix, an embedding of the corresponding non-blank symbol, assign a respective position vector to the corresponding non-blank symbol, and weight the embedding proportional to a similarity between the embedding and the respective position vector. The prediction network is also configured to generate a single embedding vector at the corresponding time step. The RNN-T model also includes a joint network configured to, at each of the plurality of time steps subsequent to the initial time step, receive the single embedding vector generated as output from the prediction network at the corresponding time step and generate a probability distribution over possible speech recognition hypotheses.

4. 发明授权

US11727920B2 Tied and reduced RNN-T 有权
公开(公告)号：US11727920B2
公开(公告)日：2023-08-15
申请号：US17330446
申请日：2021-05-26
申请人： Google LLC
发明人： Rami Botros , Tara Sainath
IPC分类号： G10L15/16 , G10L15/08
CPC分类号： G10L15/16 , G10L15/083
摘要： A RNN-T model includes a prediction network configured to, at each of a plurality of times steps subsequent to an initial time step, receive a sequence of non-blank symbols. For each non-blank symbol the prediction network is also configured to generate, using a shared embedding matrix, an embedding of the corresponding non-blank symbol, assign a respective position vector to the corresponding non-blank symbol, and weight the embedding proportional to a similarity between the embedding and the respective position vector. The prediction network is also configured to generate a single embedding vector at the corresponding time step. The RNN-T model also includes a joint network configured to, at each of the plurality of time steps subsequent to the initial time step, receive the single embedding vector generated as output from the prediction network at the corresponding time step and generate a probability distribution over possible speech recognition hypotheses.

5. 发明授权

US11715458B2 Efficient streaming non-recurrent on-device end-to-end model 有权
公开(公告)号：US11715458B2
公开(公告)日：2023-08-01
申请号：US17316198
申请日：2021-05-10
申请人： Google LLC
发明人： Tara Sainath , Arun Narayanan , Rami Botros , Yanzhang He , Ehsan Variani , Cyril Allauzen , David Rybach , Ruoming Pang , Trevor Strohman
IPC分类号： G10L15/00 , G10L15/06 , G10L15/02 , G10L15/22 , G10L15/30
CPC分类号： G10L15/063 , G10L15/02 , G10L15/22 , G10L15/30
摘要： An ASR model includes a first encoder configured to receive a sequence of acoustic frames and generate a first higher order feature representation for a corresponding acoustic frame in the sequence of acoustic frames. The ASR model also includes a second encoder configured to receive the first higher order feature representation generated by the first encoder at each of the plurality of output steps and generate a second higher order feature representation for a corresponding first higher order feature frame. The ASR model also includes a decoder configured to receive the second higher order feature representation generated by the second encoder at each of the plurality of output steps and generate a first probability distribution over possible speech recognition hypothesis. The ASR model also includes a language model configured to receive the first probability distribution over possible speech hypothesis and generate a rescored probability distribution.

6. 发明授权

US12062363B2 Tied and reduced RNN-T 有权
公开(公告)号：US12062363B2
公开(公告)日：2024-08-13
申请号：US18347842
申请日：2023-07-06
申请人： Google LLC
发明人： Rami Botros , Tara Sainath
IPC分类号： G10L15/16 , G10L15/08
CPC分类号： G10L15/16 , G10L15/083
摘要： A recurrent neural network-transducer (RNN-T) model improves speech recognition by processing sequential non-blank symbols at each time step after an initial one. The model's prediction network receives a sequence of symbols from a final Softmax layer and employs a shared embedding matrix to create and map embeddings to each symbol, associating them with unique position vectors. These embeddings are weighted according to their similarity to their matching position vector. Subsequently, a joint network of the RNN-T model uses these weighted embeddings to output a probability distribution for potential speech recognition hypotheses at each time step, enabling more accurate transcriptions of spoken language.

7. 发明公开

US20230343328A1 EFFICIENT STREAMING NON-RECURRENT ON-DEVICE END-TO-END MODEL 审中-公开
公开(公告)号：US20230343328A1
公开(公告)日：2023-10-26
申请号：US18336211
申请日：2023-06-16
申请人： Google LLC
发明人： Tara Sainath , Arun Narayanan , Rami Botros , Yanzhang He , Ehsan Variani , Cyril Allauzen , David Rybach , Ruoming Pang , Trevor Strohman
IPC分类号： G10L15/06 , G10L15/02 , G10L15/22 , G10L15/30
CPC分类号： G10L15/063 , G10L15/02 , G10L15/22 , G10L15/30
摘要： An ASR model includes a first encoder configured to receive a sequence of acoustic frames and generate a first higher order feature representation for a corresponding acoustic frame in the sequence of acoustic frames. The ASR model also includes a second encoder configured to receive the first higher order feature representation generated by the first encoder at each of the plurality of output steps and generate a second higher order feature representation for a corresponding first higher order feature frame. The ASR model also includes a decoder configured to receive the second higher order feature representation generated by the second encoder at each of the plurality of output steps and generate a first probability distribution over possible speech recognition hypothesis. The ASR model also includes a language model configured to receive the first probability distribution over possible speech hypothesis and generate a rescored probability distribution.

8. 发明公开

US20230326461A1 Unified Cascaded Encoder ASR model for Dynamic Model Sizes 审中-公开
公开(公告)号：US20230326461A1
公开(公告)日：2023-10-12
申请号：US18182925
申请日：2023-03-13
申请人： Google LLC
发明人： Shaojin Ding , Yangzhang He , Xin Wang , Weiran Wang , Trevor Strohman , Tara N. Sainath , Rohit Parkash Prabhavalkar , Robert David , Rina Panigrahy , Rami Botros , Qiao Liang , Ian Mcgraw , Ding Zhao , Dongseong Hwang
IPC分类号： G10L15/32 , G10L15/16 , G10L15/22
CPC分类号： G10L15/32 , G10L15/16 , G10L15/22 , G10L2015/223
摘要： An automated speech recognition (ASR) model includes a first encoder, a first encoder, a second encoder, and a second decoder. The first encoder receives, as input, a sequence of acoustic frames, and generates, at each of a plurality of output steps, a first higher order feature representation for a corresponding acoustic frame in the sequence of acoustic frames. The first decoder receives, as input, the first higher order feature representation generated by the first encoder, and generates a first probability distribution over possible speech recognition hypotheses. The second encoder receives, as input, the first higher order feature representation generated by the first encoder, and generates a second higher order feature representation for a corresponding first higher order feature frame. The second decoder receives, as input, the second higher order feature representation generated by the second encoder, and generates a second probability distribution over possible speech recognition hypotheses.

9. 发明公开

US20240379094A1 TIED AND REDUCED RNN-T 审中-公开
公开(公告)号：US20240379094A1
公开(公告)日：2024-11-14
申请号：US18779894
申请日：2024-07-22
申请人： Google LLC
发明人： Rami Botros , Tara Sainath
IPC分类号： G10L15/16 , G10L15/08
CPC分类号： G10L15/16 , G10L15/083
摘要： A RNN-T model includes a prediction network configured to, at each of a plurality of times steps subsequent to an initial time step, receive a sequence of non-blank symbols. For each non-blank symbol the prediction network is also configured to generate, using a shared embedding matrix, an embedding of the corresponding non-blank symbol, assign a respective position vector to the corresponding non-blank symbol, and weight the embedding proportional to a similarity between the embedding and the respective position vector. The prediction network is also configured to generate a single embedding vector at the corresponding time step. The RNN-T model also includes a joint network configured to, at each of the plurality of time steps subsequent to the initial time step, receive the single embedding vector generated as output from the prediction network at the corresponding time step and generate a probability distribution over possible speech recognition hypotheses.

10. 发明授权

US12051404B2 Efficient streaming non-recurrent on-device end-to-end model 有权
公开(公告)号：US12051404B2
公开(公告)日：2024-07-30
申请号：US18336211
申请日：2023-06-16
申请人： Google LLC
发明人： Tara Sainath , Arun Narayanan , Rami Botros , Yanzhang He , Ehsan Variani , Cyril Allauzen , David Rybach , Ruoming Pang , Trevor Strohman
IPC分类号： G10L15/00 , G10L15/02 , G10L15/06 , G10L15/22 , G10L15/30
CPC分类号： G10L15/063 , G10L15/02 , G10L15/22 , G10L15/30
摘要： An ASR model includes a first encoder configured to receive a sequence of acoustic frames and generate a first higher order feature representation for a corresponding acoustic frame in the sequence of acoustic frames. The ASR model also includes a second encoder configured to receive the first higher order feature representation generated by the first encoder at each of the plurality of output steps and generate a second higher order feature representation for a corresponding first higher order feature frame. The ASR model also includes a decoder configured to receive the second higher order feature representation generated by the second encoder at each of the plurality of output steps and generate a first probability distribution over possible speech recognition hypothesis. The ASR model also includes a language model configured to receive the first probability distribution over possible speech hypothesis and generate a rescored probability distribution.

你已经成功收藏专利！

检索式保存成功!

IPRDB

热门服务

关于我们

友情链接

联系方式