The miniaturization of sensors and non-contact measurement techniques is currently at the forefront of smart grid development. This paper proposes a miniature voltage sensor whose size is significantly reduced while maintaining large bandwidth and high linearity. To minimize the impact of environmental factors on measurement accuracy, a differential structure is utilized to optimize the sensor. The sensor is designed with a dual-channel measurement mode for both high-frequency and power-frequency signals, addressing issues of signal refraction and reflection due to impedance mismatch. COMSOL Multiphysics 6.2 is employed to simulate the sensor’s structural design and placement. Moreover, the experimental analysis of key parameters, such as parallel resistance and capacitance, identifies the optimal parameter combination for low-voltage distribution lines and cables of 10 kV and below. Experiments show that the voltage sensor’s bandwidth ranges from 30 Hz–200 kHz when measured through a frequency response analyzer. Finally, through the measurement carried out on the overhead line and cable, we evaluate the linearity of the sensor according to the experimental data. Specifically, the nonlinear errors of the voltage measurement for the overhead line and cable are 0.62% and 0.57%, respectively.