Control charts are widely used to identify changes in a production process. Nonparametric or distribution-free charts can be useful when there is a lack of underlying process distribution. A nonparametric exponentially weighted moving average (EWMA) control chart based on sign test using ranked set sampling (RSS) is proposed to monitor the possible small shifts in the process mean. The performance of the proposed chart is evaluated in terms of average run length, median run length, and standard deviation of the run length distribution. It has been observed that the proposed version of the EWMA sign chart, using RSS shows better detection ability than that version of the EWMA sign chart and the parametric EWMA control chart using simple random sampling scheme. An application with real data-set is also provided to explain the proposal for practical considerations.