Abstract
The weighted total least-squares (WTLS) estimate is sensitive to outliers and will be strongly disturbed if there are outliers in the observations and coefficient matrix of the partial errors-in-variables (EIV) model. The L 1 norm minimization method is a robust technique to resist the bad effect of outliers. Therefore, the computational formula of the L 1 norm minimization for the partial EIV model is developed by employing the linear programming theory. However, the closed-form solution cannot be directly obtained since there are some unknown parameters in constrained condition equation of the presented optimization problem. The iterated procedure is recommended and the proper condition for stopping iteration is suggested. At the same time, by treating the partial EIV model as the special case of the non-linear Gauss–Helmert (G–H) model, another iterated method for the L 1 norm minimization problem is also developed. At last, two simulated examples and a real data of 2D affine transformation are conducted. It is illustrated that the results derived by the proposed L 1 norm minimization methods are more accurate than those by the WTLS method while the observations and elements of the coefficient matrix are contaminated with outliers. And the two methods for the L 1 norm minimization problem are identical in the sense of robustness. By comparing with the data-snooping method, the L 1 norm minimization method may be more reliable for detecting multiple outliers due to masking. But it leads to great computation burden.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abatzoglou TJ, Mendel JM, Harada GA (1991) The constrained total least squares technique and its applications to harmonic superresolution. IEEE Trans Signal Proc 39(5):1070–1087
Amiri-Simkooei AR (2003) Formulation of L 1 norm minimization in Gauss-Markov models. J Surv Eng 129(1):37–43
Amiri-Simkooei AR, Jazaeri S (2013) Data-snooping procedure applied to errors-in-variables models. Stud Geophys Geod 57:426–441
Amiri-Simkooei AR, Jazaeri S (2012) Weighted total least squares formulated by standard least squares theory. J Geod Sci 2(2):113–124
Baarda W (1968) A testing procedure for use in geodetic networks. Netherlands Geod Comm Publ Geod 2(5):1–97
Baselga S (2007) Global optimization solution of robust estimation. J Surv Eng 133(3):123–128
Brown M (1982) Robust line estimation with errors in both variables. J Am Stat Assoc 77:71–79
Fang X (2013) Weighted total least squares: necessary and sufficient conditions, fixed and random parameters. J Geod 87:733–749
Gui QM, Liu JS (1999) Generalized shrunken-type robust estimation. J Surv Eng 125(4):177–184
Gui QM, Li GZ, Ou JK (2005) Robust-biased estimation based on quasi-accurate detection. J Surv Eng 131(3):67–72
Gui Q, Gong Y, Li G, Li B (2007) A Bayesian approach to the detection of gross errors based on posterior probability. J Geod 81:651–659
Gui Q, Li X, Gong Y, Li B, Li G (2011) A Bayesian unmasking method for locating multiple gross errors based on posterior probabilities of classification variables. J Geod 85:191–203
Guo JF, Ou JK, Wang HT (2007) Quasi-accurate detection of outliers for correlated observations. J Surv Eng 133(3):129–133
Guo JF, Ou JK, Wang HT (2010) Robust estimation for correlated observations: two local sensitivity-based downweighting strategies. J Geod 84:243–250
Hadi AS, Imon A (2009) Detection of outliers. Wiley Interdiscip Rev Comput Stat 1:57–70
Hekimoglu S (1997) Finite sample breakdown points of outlier detection procedures. J Surv Eng 125(1):15–31
Hekimoglu S (1999) Robustifying conventional outlier detection procedures. J Surv Eng 76:706–713
Jazaeri S, Amiri-Simkooei AR, Sharifi MA (2014) Iterative algorithm for weighted total least squares adjustment. Surv Rev 46(334):19–27
Koch KR (2013) Robust estimation by expectation maximization algorithm. J Geod 87:107–116
Li B, Shen Y, Zhang X, Li C, Lou L (2013) Seamless multivariate affine error-in-variables transformation and its application to map rectification. J GIS 27(8):1572–1592
Lu J, Chen Y, Li BF, Fang X (2014) Robust total least squares with reweighting iteration for three-dimensional similarity transformation. Surv Rev 46(334):28–36
Mahboub V (2012) On weighted total least-squares for geodetic transformations. J Geod 86:359–367
Mahboub V, Amiri-Simkooei AR, Sharifi MA (2013) Iteratively reweighted total least squares: a robust estimation in errors-in-variables models. Surv Rev 45(329):92–99
Marshall J, Bethel J (1996) Basic concept of L 1 norm minimization for surveying applications. J Surv Eng 122(4):168–179
Pope AJ (1976) The statistics of residuals and the detection of outliers. NOAA Technique Report Nos 65 GNS 1, Rockville
Schaffrin B, Uzun S (2011) Errors-in-variables for mobile mapping algorithms in the presence of outliers. Arch Photogr Cartogr Remote Sens 22:337–387
Schaffrin B, Wieser A (2008) On weighted total least-squares adjustment for linear regression. J Geod 82:415–421
Shen YZ, Li BF, Chen Y (2011) An iterative solution of weighted total least-squares adjustment. J Geod 85:229–238
Tao YQ, Gao JX, Yao YF (2014) TLS Algorithm for GPS height fitting based on robust estimation. Surv Rev 46(336):184–188
Vanderbei RJ (2014) Linear programming foundations and extensions, 4th edn. Springer, New York
Watson GA, Yiu KFC (1991) On the solution of the errors invariables problem using the L 1 Norm. BIT 31:697–710
Xu PL (1989) On robust estimation with correlated observation. Bull Geod 63:237–252
Xu PL (1993) Consequences of constant parameters and confidence intervals of robust estimation. Boll Geod Sci Aff 52(3):231–249
Xu PL (2005) Sign-constrained robust least squares, subjective break-down point and the effect of weights of observations on robustness. J Geod 79(1–3):146–159
Xu PL, Liu JN, Shi C (2012) Total least squares adjustment in partial errors-in-variables models: algorithm and statistical analysis. J Geod 86:661–675
Yang YX (1999) Robust estimation of geodetic datum transformation. J Geod 73(5):268–274
Yang YX, Song LJ, Xu TH (2002) Robust estimator for correlated observations based on bifactor equivalent weights. J Geod 76(6–7):353–358
Yang L, Wang JL, Knight NL, Shen YZ (2013) Outlier separability analysis with a multiple alternative hypotheses test. J Geod 87:591–604
Yetkin M, Inal C (2011) L 1 norm minimization in GPS networks. Surv Rev 43(322):523–532
Zamar RH (1989) Robust estimation in the errors-in-variables model. Biometrika 76(1):149–160
Acknowledgments
The authors would like to show the appreciations to the anonymous reviewers for their constructive comments so that the original paper has been substantial improved. The research works are sponsored by the National Natural Science Foundation of China (Project No. 41174005, 41474009).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhao, J., Gui, Q. & Guo, F. L 1 norm minimization in partial errors-in-variables model. Acta Geod Geophys 52, 389–406 (2017). https://doi.org/10.1007/s40328-016-0178-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40328-016-0178-0