Dissimilar metal welded joints (DMWJs) possess significant localized mechanical heterogeneity. Using finite element software ABAQUS with the User-defined Material (UMAT) subroutine, this study proposed a constitutive equation that may be used to express the heterogeneous mechanical properties of the heat-affected and fusion zones at the interfaces in DMWJs. By eliminating sudden stress changes at the material interfaces, the proposed approach provides a more realistic and accurate characterization of the mechanical heterogeneity in the local regions of DMWJs than existing methods. As such, the proposed approach enables the structural integrity of DMWJs to be analyzed in greater detail.