In this paper we construct an efficient weighted least squares estimator for the mean and more generally for the regression parameters in certain Gaussian long range dependent regression models, including polynomial regression. The form of the estimator does not depend on the whole dependence structure of the residuals, but only on the local behaviour of the spectral density at zero. By using an estimator of the self-similarity parameter, we give a fully efficient estimator. Furthermore, we construct efficient weighted $M$-estimators.