Yield calculation is an important link in modern precision agriculture, which is an effective means to improve breeding efficiency, and adjust planting and marketing plans. With the continuous progress of artificial intelligence and sensing technology, yield calculation schemes based on image processing technology have many advantages such as high accuracy, low cost, and non-destructive calculation, and have been favored by a large number of researchers. This article reviews the research progress of crop yield calculation based on remote sensing images and visible light images, describes the technical characteristics and applicable objects of different schemes, and focuses on detailed explanations of data acquisition, independent variable screening, algorithm selection and optimization. Common issues are also discussed and summarized. Finally, solutions are proposed for the main problems that have arisen so far, and future research directions are predicted, with the aim of achieving more progress and wider popularization of yield calculation solutions based on image technology.