Persistent self-improvement enables language-model agents to adapt from experience, but its update process competes with inference for limited device memory, energy, and thermal headroom. Existing surveys largely examine self-improvement mechanisms and on-device learning separately, providing limited guidance on how update reliability and device costs should be assessed together. We introduce a unified taxonomy that organizes persistent updates by component, execution locus, feedback, loop closure, timescale, and budget, and distinguishes recursive changes to evaluators or update machinery. Across the included works, we compare updates to memory and skills, prompts and code, weights, and evaluators or acceptance rules, and propose accounting and reporting rules that relate retained gains to device costs, including rejected candidates, verification, and rollback. The examined device studies primarily support memory maintenance or capability recovery, with limited joint validation of sustained capability gains and complete update costs. These gaps motivate controlled studies on edge devices, focusing on verification and acceptance under energy budgets, retention under bounded storage, and persistent safety to establish when self-improvement justifies its resource cost.