Superconductor-ferromagnet interfaces in two-dimensional heterostructures present a unique opportunity to study the interplay between superconductivity and ferromagnetism. The realization of such nanoscale heterostructures in van der Waals (vdW) crystals remains largely unexplored due to the challenge of making atomically-sharp interfaces from their layered structures. Here, we build a vdW ferromagnetic Josephson junction (JJ) by inserting a few-layer ferromagnetic insulator Cr₂Ge₂Te₆ into two layers of superconductor NbSe₂. The critical current and corresponding junction resistance exhibit a hysteretic and oscillatory behavior against in-plane magnetic fields, manifesting itself as a strong Josephson coupling state. Also, we observe a central minimum of critical current in some JJ devices as well as a nontrivial phase shift in SQUID structures, evidencing the coexistence of 0 and π phase in the junction region. Our study paves the way to exploring sensitive probes of weak magnetism and multifunctional building-blocks for phase-related superconducting circuits using vdW heterostructures.