The results of the numerical investigation of a layered structure formation in systems of particles with anisotropic pair interaction are presented. A simulation was carried out for extended homogeneous structures consisting of one or several layers of interacting particles over a wide range of parameters which correspond to the conditions usually observed in laboratory dusty plasma experiments. For the first time a detailed analysis of the development of various instabilities in such systems has been undertaken.

We present a theoretical model for the description of the heating mechanism and the redistribution of kinetic energy in a system of particles with nonreciprocal interactions that occur in disperse systems of different nature. To verify the theory, we carried out the numerical simulations of two-particle systems with a nonreciprocal "quasi-dipole–dipole" interaction that is similar to the interaction due to the effect of ion focusing in a laboratory complex plasma under experimental conditions. The proposed model of heating can explain various features of dust dynamics in anisotropic complex plasma.

We analyze the experimental data on the motion of active Brownian micrograins in RF discharge plasmas. In the experiments, two types of microparticles were used: first—plastic grains fully covered with metal, and second—Janus particles with a thin metal cap. We have tracked the trajectories of the separate grains and plotted the pair correlation functions of the observed structures. To examine the motion of the grains, we studied the dependencies of the MFPT dynamic entropy on the coarsening parameter, the fractal dimension of the system on its mean kinetic temperature, and the mean localization area of the grain on its mean kinetic temperature. Based on the obtained results, we conclude that the character of motion of our active Brownian systems changes as the power of an illuminating laser (and, therefore, the mean kinetic temperature of the grains) increases. Janus particles change their trajectories from more chaotic to spiral-like ones; in the case of fully covered particles, we observe the dynamical phase transition from the more ordered structure to the less ordered one.

The conditions for the amplitude instability onset in a two-dimensional Yukawa cluster system consisting of seven particles are investigated for the case of sufficiently large thermal particle displacements. We consider here an analytical approach to derive the criterion for such instability onset, which is based on searching an energetically favorable inflection point of the system potential energy. We show that there is a proportionality between melting curve for an “infinite” two-dimensional system with the hexagonal lattice and analytical curve of critical points for the seven-particle Yukawa cluster. We use numerical simulations to study the structural and dynamical properties of the system near the critical point of the amplitude instability. The obtained results are compared to the criteria for melting of the “infinite” two-dimensional system.

We present the results of our theoretical and numerical studies of the formation of chain structures of cylindrical dust particles. The studies have been carried out for extended and confined systems in a wide range of parameters corresponding to the experimental conditions in a laboratory dusty plasma. We consider the conditions for the formation of various orientational and spatial configurations in a system of uniformly charged cylinders. The criterion defining the disruption of a stable equilibrium in a system initially representing a “quasi-one-dimensional” chain of particles has been tested.