The instability of magnetic states in two-dimensional magnetic materials plays a crucial role in the application of spintronics. However, the instability mechanism and magnetic state diagram of $M\text{P}{X}_3$ ($M=\mathrm{Mn}$ and Ni and $X=\mathrm{S}$ and Se) monolayer with multiple magnetic states remains elusive. In our paper, we investigate the instability of magnetic states using ab initio calculation combined with an effective Heisenberg model. We obtain a series of magnetic state diagrams of $M\text{P}{X}_3$ ($M=\mathrm{Mn}$ and Ni and $X=\mathrm{S}$ and Se) monolayer under the approaches of strain and carrier doping. We clarify the instability mechanism that is mainly determined by the nearest-neighbor exchange interaction between magnetic ions, find a higher Néel temperature in ${\mathrm{NiPSe}}_3$ monolayer, and unveil a considerable increase in hole effective mass along the armchair direction in the ${\mathrm{NiPSe}}_3$ monolayer, which leads to giant anisotropy of carrier mobility. Our results provide a useful guidance to design high-performance spintronics devices based on the $M\text{P}{X}_3$ monolayer.

• Received 7 July 2022
• Revised 15 September 2022
• Accepted 14 November 2022

DOI:https://doi.org/10.1103/PhysRevB.106.195424