18 March 2021 in IEEE Signal Processing Letters
We propose a novel lazy-evaluation token-group decoding algorithm with on-the-fly composition of weighted finite-state transducers (WFSTs) for large vocabulary continuous speech recognition. In the standard on-the-fly composition decoder, a base WFST and one or more incremental WFSTs are composed during decoding, and then token passing algorithm is employed to generate the lattice on the composed search space, resulting in substantial computation overhead. To improve speed, the proposed algorithm adopts 1) a token-group method, which groups tokens with the same state in the base WFST on each frame and limits the capacity of the group and 2) a lazy-evaluation method, which does not expand a token group and its source token groups until it processes a word label during decoding.Experiments show that the proposed decoder works notably up to 3 times faster than the standard on-the-fly composition decoder.
1 January 2025 in Electronics Letters
Neural language models (NLMs) have been shown to outperform n‐gram language models in automatic speech recognition (ASR) tasks. NLMs are usually used in the second‐pass lattice rescoring rather than the first‐pass decoding, since its encoded infinite history virtually cannot be compiled into static decoding graphs. However, the modeling power of NLMs is not fully leveraged due to the constraints imposed by the lattice, leading to accuracy loss. To improve this, on‐the‐fly composition decoders were proposed to utilize NLMs in first‐pass decoding with increased computational cost. In this paper, an asynchronous lazy‐evaluation token‐group decoder with exact lattice generation is proposed to reduce the computational cost of the on‐the‐fly composition decoder, achieving significant decoding speedup. More specifically, having a novel token‐group with a representative element data structure, the proposed decoder performs lazy‐evaluation which expands the tokens until a word boundary is reached. Furthermore, based on the score of the representative element in a token‐group, the decoder prunes unpromising tokens by an A* algorithm. The experiments show that the proposed decoder can accelerate the vanilla on‐the‐fly composition decoder by up to 6.9 times, and get paths with even better average likelihoods than lattice rescoring approaches.