Spectrogram-based representations have grown to dominate the feature space for deep learning audio analysis systems, and are often adopted for speech analysis also. Initially, the primary motivation behind spectrogram-based representations was their ability to present sound as a two-dimensional signal in the time–frequency plane, which not only provides an interpretable physical basis for analysing sound, but also unlocks the use of a range of machine learning techniques such as convolutional neural networks, which had been developed for image processing. A spectrogram is a matrix characterised by the resolution and span of its dimensions, as well as by the representation and scaling of each element. Many possibilities for these three characteristics have been explored by researchers across numerous application areas, with different settings showing affinity for various tasks. This paper reviews the use of spectrogram-based representations and surveys the state-of-the-art to question how front-end feature representation choice allies with back-end classifier architecture for different tasks.
Text-to-image (T2I) generative AI models enable scalable visual content creation but often embed or even amplify societal biases, particularly around gender and object associations. For example, T2I models may reinforce restrictive stereotypes by depicting objects like flowers as feminine or laptops as masculine. Current bias assessment methods often involve multi-step evaluation procedures and typically emphasize aggregate demographic distributions, prompt adherence, or profession-level associations rather than object-level gender–object association analysis. This paper proposes a bias assessment pipeline that combines object detection, perceived-gender identification, object-association scoring, and heatmap visualization to analyse gender–object association bias in T2I-generated images. To support evaluation, we introduce the Object Bias Image Dataset (OBID), designed with a 10,000-image generation target, and evaluate the proposed pipeline on 3,247 retained images that satisfy the requirements for gender–object association analysis. Results reveal stronger class-wise diagonal agreement for neutral objects (0.59) than for male-associated (0.27) and female-associated (0.21) objects, highlighting both the feasibility and current limitations of automated object-association bias assessment.
Existing speech emotion recognition (SER) methods commonly suffer from the lack of high-quality large-scale corpus, partly due to the complex, psychological nature of emotion which makes accurate labeling difficult and time consuming. Recently, transfer learning based methods that exploit the encoders pretrained on large-scale speech corpus (e.g., Wav2Vec2.0 and HuBERT) have shown strong potential for downstream SER tasks. However, task-specific fine-tuning remains necessary for various conversational scenarios of different topics, speakers and languages to achieve satisfactory performance. It generally requires costly encoder retraining for individual SER tasks. To address this issue, we propose to train an adapter with local attributes for efficient transfer learning. Specifically, a weighted average pooling-Transformer (WAP-Transformer) is proposed as a lightweight backbone to enrich the frame-level representation. An adapter with teacher-student branches is exploited for task-agnostic transfer learning, where the student branch is jointly optimized via mask prediction and self-distillation objectives, and the teacher branch is obtained online from the student via exponential moving average (EMA). Meanwhile, local attributes are learned from the teacher branch via unsupervised clustering, which aims to act as a universal model that provides additional semantic-rich supervisions. A statistical attentive pooling (SAP) module is proposed to obtain utterance representation for fine-tuning. To evaluate the effectiveness of the proposed adapter with local attributes, extensive experiments have been conducted on IEMOCAP. Superior performance has been reported, compared to the previous state-of-the-art methods in similar settings.