Conventional multispectral photodetectors typically rely on multiple electrical terminals to discriminate different wavelengths, which inevitably increases structural complexity. Here, we break this paradigm by demonstrating a dual-color visible–infrared photodetector based on a simple two-terminal Au/MoS2/Te heterostructure. The device operates through a bias-switching mechanism: reversing the voltage polarity selectively activates either the MoS2/Au Schottky junction for visible-light detection (520 nm) or the Te/MoS2 heterojunction for infrared detection (1550 nm). This bias-controlled wavelength selectivity is unambiguously verified by scanning photocurrent mapping. Beyond dual-color discrimination, an adaptive convolutional neural network is employed to decode the nonlinear current–voltage characteristics and enable precise spectral identification, achieving a reconstruction error of approximately 4.5%. Furthermore, high-fidelity dual-color imaging is demonstrated at room temperature. These results establish a hardware–algorithm co-design strategy based on a minimalist two-terminal architecture, providing a viable route toward compact and intelligent spectral-sensing systems.