Quality and safety monitoring in the dairy industry is required to ensure products meet a high-standard based on legislation and customer requirements. The need for non-destructive, low-cost and user-friendly process analytical technologies, targeted at operators (as the end-users) for routine product inspections is increasing. In recent years, the development and advances in sensing technologies have led to miniaturisation of near infrared (NIR) spectrometers to a new era. The new generation of miniaturised NIR analysers are designed as compact, small and lightweight devices with a low cost, providing a strong capability for on-site or on-farm product measurements. Applying portable and handheld NIR spectrometers in the dairy sector is increasing; however, little information is currently available on these applications and instrument performance. As a result, this review focuses on recent developments of handheld and portable NIR devices and its latest applications in the field of dairy, including chemical composition, on-site quality detection, and safety assurance (i.e., adulteration) in milk, cheese and dairy powders. Comparison of model performance between handheld and bench-top NIR spectrometers is also given. Lastly, challenges of current handheld/portable devices and future trends on implementing these devices in the dairy sector is discussed.