Rice is the fourth most important crop in Italy with a growing area under organic management. We conducted a participatory evaluation of 21 rice cultivars (10 old, 10 modern and a mixture) in four organic/biodynamic farms, for two cropping seasons, to assess the extent of varieties × farms and varieties × years within farm interactions and farmers’ preferences. There were significant differences between farms and varieties, as well as large interactions between varieties and farms, particularly in the case of plant height and reactions to Fusarium fujikuroi Nirenberg (bakanae) and Magnaporthe oryzae B Cooke (leaf and neck blast), but also for grain yield. There were also large interactions between varieties and years, which resulted in considerable differences in stability among varieties with one of the old, one modern and the mixture combining high grain yield and stability. Farmers, regardless of gender, were able to visually identify the highest yielding varieties in a consistent way across years, and although accustomed to seeing uniform varieties, they scored the mixture higher than the mean. The results are discussed in the context of a decentralized-participatory breeding program, to serve the target population of heterogenous environments represented by organic and biodynamic farms.