Core to much of modern deep learning is the notion of representation learning, learning representations of things that are useful for performing some task(s) related to those things. Encoder-only language models, for example, learn representations of language useful for performing language-related tasks, often classification. While fruitful in many applications, inherent is the assumption that only one classification is to be made for a particular input. This poses challenges when multiple classifications are to be made about different portions of a single record, such as emotion recognition in conversation (ERC) where the objective is to classify the emotion in each utterance of a dialog. Existing methods for this task typically either involve redundant computation, non-trivial post-processing outside of the core language model backbone, or both. To address this, we generalize recent work for deriving player-specific embeddings from multi-player sequences of events in sport for domain-agnostic application while also enabling it to leverage inter-entity relationships. Seeing the efficacy of the method in regression and classification tasks, we explore how it can be used to cluster player representations, proposing a novel approach for distribution-aware deep-clustering in the absence of labels. We demonstrate how the proposed methods yield state-of-the-art performance on the disparate tasks of ERC in Natural Language Processing (NLP), long-tail partial-label-learning (LT-PLL) in Computer Vision (CV), and player form clustering in sports analytics.
In the realm of sports analytics, players, teams, and managers have primarily been evaluated through a set of summary counting statistics. Typically, these statistics describe the number of times various events occurred on the field of play, perhaps dividing one quantity by another and/or applying some statistical adjustment. Recent works have proposed viewing the game as a sequence of events towards identifying specific items of interest, such as the players being in a certain formation on the field. However, this sequential, contextual understanding of the game is abandoned once the item of interest is identified. We speculate performance can be gained by leveraging this sequential, contextual understanding of the game. In this work we demonstrate how a rich, event-by-event understanding of a sport, in this case professional baseball, can provide utility in the tasks of player performance projection and clustering. In the process of doing so, we also demonstrate how findings in the domain of sports can translate to state-of-the-art advances in more traditional disciplines of study - specifically, the natural language processing task of emotion recognition in conversation (ERC) and the computer vision task of long-tail partial-label-learning (LT-PLL).