By close analogy with multiferroic materials with coexisting long-range electric and magnetic orders a “multiglass” scenario of two different glassy states is observed in ceramics. Sr-site substituted ions are at the origin of both a polar and a spin glass with glass temperatures and , respectively. The structural freezing triggers that of the spins, and both glassy systems show individual memory effects. Thanks to strong spin-phonon interaction within the incipient ferroelectric host crystal , large higher order magnetoelectric coupling occurs between both glass systems.