Large language models (LLMs) have significantly advanced artificial intelligence (AI) and natural language processing (NLP) by excelling in tasks like text generation, machine translation, question answering and sentiment analysis, often rivaling human performance. This paper reviews LLMs’ foundations, advancements and applications, beginning with the transformative transformer architecture, which improved on earlier models like recurrent neural networks and convolutional neural networks through self-attention mechanisms that capture long-range dependencies and contextual relationships. Key innovations such as masked language modeling and causal language modeling underpin leading models like Bidirectional encoder representations from transformers (BERT) and the Generative Pre-trained Transformer (GPT) series. The paper highlights scaling laws, model size increases and advanced training techniques that have driven LLMs’ growth. It also explores methodologies to enhance their precision and adaptability, including parameter-efficient fine-tuning and prompt engineering. Challenges like high computational demands, biases and hallucinations are addressed, with solutions such as retrieval-augmented generation to improve factual accuracy. By discussing LLMs’ strengths, limitations and transformative potential, this paper provides researchers, practitioners and students with a comprehensive understanding. It underscores the importance of ongoing research to improve efficiency, manage ethical concerns and shape the future of AI and language technologies.
The article discusses the relationship between contract law and environmental sustainability. Firstly, it questions whether certain values, which the concept of sustainable development incorporates, are compatible with contract law. Could we consider sustainability goals as implied terms of international business contracts in the absence of an express agreement? Secondly, the article notes and analyzes the process of contractualisation of sustainability objectives in international business contracts. It also examines the current limitations of enforcing sustainability contractual clauses. The conclusion is that contract law should accommodate environmental sustainability as a matter of contractual justice.
28 November 2023 in European Review of Contract Law
Thirty years since it entered into force, the Unfair Contract Terms Directive (‘UCTD’) needs updating to address the challenges posed by digital services. This concerns in particular the fundamental research question of identifying new unfair terms of digital service providers (‘DSPs’) so that they can be included in a new blacklist. These challenges are central to the ongoing EC study named ‘Fitness Check of EU Consumer Law’ concerning the evolution of consumer law in the digital age, and promoting a fair and transparent environment for consumers in an ever-changing digital landscape. The article identifies digital-specific unfair terms used by DSPs and organises them into four main themes (i.e., digital services and contents, automation and personalisation, price & free services, and consumers’ data rights). It also discusses the methodological approaches adopted by institutions and researchers in detecting such types of unfair terms in digital environments. Finally, the article examines the possible regulatory options and, particularly, the possibility of establishing a new blacklist of digital-specific unfair terms and/or developing EC guidelines for fairness assessment under the UCTD.