21 April 2025 in IEEE Transactions on Audio, Speech and Language Processing
Speech-to-text (S2T) generation tasks often struggle to achieve satisfactory convergence without relying on auxiliary data or models. We identify the core issue as the modeling granularity, where the fine-grained and lengthy characteristics of audio features pose obstacles in effectively allocating attention weights, particularly during encoder self-attention learning. In this paper, we investigate two well-established methods, Conformer and information aggregation, to mitigate the learning burden of the encoder from the aspects of intra-layer and inter-layer encoding. Conformer directly enhances modeling capability through architecture improvement, while aggregation generates coarser-grained representations, thus shaping text-like structures to fundamentally simplify attention learning. Extensive results demonstrate superior convergence and notable improvement on two representative S2T generation tasks, speech recognition and translation. In particular, we achieve a notable average BLEU score of 26.9 on MuST-C speech translation datasets without auxiliary resources and approaches. Furthermore, our finding suggests that the grown model capacity and sufficient training can effectively facilitate the granularity challenge.
1 November 2016 in China Journal of Chinese Materia Medica
To compare the contents of alkaloids in theroots of cultivated and the wild Sophora flavsecens, 22 cultivated and 17 wild samples were collected. HPLC method was employed to simultaneously determine the contents of six alkaloids (oxymatrine, oxysophocarpine, sophoridine, N-methylcytisine, matrine, and sophocarpine). Independent t-test, hierarchical clustering analysis(HCA)and principal components analysis (PCA) were applied to analyze and evaluate the cultivated and the wild S.flavsecens. With a great wide range of the inter-group, the t-test results showed that the contents difference of N-methylcytisine, matrine, and sophocarpine were statistical significance(matrineandsophocarpine P<0.05, N-methylcytisine P<0.01).However, it was not statistically significant for oxymatrine, oxysophocarpine, and sophoridine.HCA and PCA showed that there were no significant differences in the contents of alkaloids of cultivated and wild S. flavsecens. The results indicated that there were no differences in the contents of alkaloids of cultivated and wild S. flavsecens.