Various solutions for the management of rubber waste from used tires are known. We encounter in particular tests of concrete mixtures and the finished product, in the literature. These tests are describing rheological, mechanical and durability properties, mainly. However, the high toxicity of rubber waste from car tires requires that such concrete be tested in terms of ecotoxicology. The paper presents the results of research on the use of three different SBR granulates as fillers in mortars with a slag or CEM IV cement binder. The focus was on the immobilization of harmful compounds from rubber granules in the binder mass. It was assumed that the construction product using mortar with rubber granules would be in contact with water. The mass share of granulates in mortars was 4.7%. The grain size of the granulates was up to 4 mm, mainly 1–3 mm. A decrease in the strength of mortars with the addition of granulates and no leaching of polycyclic aromatic hydrocarbons from mortars was demonstrated. The metals from the mortars were absorbed by the rubber, most probably. The strength of slag mortars was greater than cement mortars.