Skip to main content
SpringerLink
Log in

Using Deep Learning for Defect Classification on a Small Weld X-ray Image Dataset

  • Published:
Journal of Nondestructive Evaluation Aims and scope Submit manuscript

Abstract

This document provides a comparative evaluation of the performance of a deep learning network for different combinations of parameters and hyper-parameters. Although there are numerous studies that report on performance in deep learning networks for ordinary data sets, their performance on small data sets is much less evaluated. The objective of this work is to demonstrate that such a challenging small data set, such as a welding X-ray image data set, can be trained and evaluated obtaining high precision and that it is possible thanks to data augmentation. In fact, this article shows that data augmentation, also a typical technique in any learning process on a large data set, plus that two image channels, such as channels B (blue) and G (green), both are replaced by the Canny edge map and a binary image provided by an adaptive Gaussian threshold, respectively, gives to the network a 3% increase in accuracy, approximately. In summary, the objective of this work is to present the methodology used and the results obtained to estimate the classification accuracy of three main classes of welding defects obtained on a small set of welding X-ray image data.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. www.umax.org

  2. www.iiwelding.org

References

  1. Bay, H., Tuytelaars, T., Gool, L.V.: Surf: Speeded up robust features. In: In ECCV, pp. 404–417 (2006). http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.85.2512

  2. Calonder, M., Lepetit, V., Strecha, C., Fua, P.: Brief: binary robust independent elementary features. In: Proceedings of the 11th European Conference on Computer vision: Part IV, ECCV’10, pp. 778–792. Springer-Verlag, Berlin, Heidelberg (2010). http://dl.acm.org/citation.cfm?id=1888089.1888148

  3. Carvalho, A., Rebello, J., Sagrilo, L., Camerini, C., Miranda, I.: Mfl signals and artificial neural networks applied to detection and classification of pipe weld defects. Ndt & E Int. 39(8), 661–667 (2006)

    Article  Google Scholar 

  4. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, vol. 1, pp. 886–893 (2005). http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=1467360&url=http%3A%2F%2Fieeexplore.ieee.org%2Fxpls%2Fabs_all.jsp%3Farnumber%3D1467360

  5. Di, L., Yonglun, S., Feng, Y.: Online monitoring of weld defects for short-circuit gas metal arc welding based on the self-organizing feature map neural networks. In: Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium, vol. 5, pp. 239–244 (2000)

  6. Ewert, U., Zscherpel, U., Horkey, M., Kennedy, J., Hutchinson, M.: A new computer based concept for digital radiographic reference images. J. Nondestr. Test. 7(12), 1–13 (2002)

    Google Scholar 

  7. Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016)

    MATH  Google Scholar 

  8. Haralick, R.M., Shanmugam, K.S., Dinstein, I.: Textural features for image classification. IEEE Trans. Syst. Man Cybern. 3(6), 610–621 (1973)

    Article  Google Scholar 

  9. Harris, C., Stephens, M.: A combined corner and edge detector. In: In Proc. of Fourth Alvey Vision Conference, pp. 147–151 (1988). http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.231.1604

  10. Hou, W., Wei, Y., Guo, J., Jin, Y., Zhu, C.: Automatic detection of welding defects using deep neural network. J. Phys. 933, 012006 (2018). https://doi.org/10.1088/1742-6596/933/1/012006

    Article  Google Scholar 

  11. Hu, M.K.: Visual pattern recognition by moment invariants. Inf. Theory IRE Trans. 8(2), 179–187 (1962). https://doi.org/10.1109/TIT.1962.1057692

    Article  MATH  Google Scholar 

  12. Huang, J., Kumar, R., Mitra, M., Zhu, W.J., Zabih, R.: Image indexing using color correlograms. In: CVPR, pp. 762–768. IEEE Computer Society (1997). http://dblp.uni-trier.de/db/conf/cvpr/cvpr1997.html#HuangKMZZ97

  13. Ioffe, S., Szegedy, C.: Batch normalization: Accelerating deep network training by reducing internal covariate shift. CoRR arXiv:abs/1502.03167 (2015). http://dblp.uni-trier.de/db/journals/corr/corr1502.html#IoffeS15

  14. Khotanzad, A., Hong, Y.: Invariant image recognition by zernike moments. IEEE Trans. Pattern Anal. Mach. Intell. 12(5), 489–497 (1990). https://doi.org/10.1109/34.55109

    Article  Google Scholar 

  15. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Pereira, F., Burges, C.J.C., Bottou, L., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems, pp. 1097–1105. Curran Associates Inc., New York (2012)

    Google Scholar 

  16. Laboratories, S.U.S.E., Widrow, B., of Naval Research, U.S.O., Corps, U.S.A.S., Force, U.S.A., Navy, U.S.: Adaptive “adaline” neuron using chemical “memistors.”. (1960). https://books.google.es/books?id=Yc4EAAAAIAAJ

  17. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015). https://doi.org/10.1038/nature14539

    Article  Google Scholar 

  18. Liao, T.W., Tang, K.: Automated extraction of welds from digitized radiographic images based on mlp neural networks. Appl. Artif. Intell. 11(3), 197–218 (1997)

    Article  Google Scholar 

  19. Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 2, pp. 1150–1157 (1999)

  20. Mery, D., Riffo, V., Zscherpel, U., Mondragón, G., Lillo, I., Zuccar, I., Lobel, H., Carrasco, M.: Gdxray: the database of x-ray images for nondestructive testing. J. Nondestr. Eval. 34(4), 42 (2015)

    Article  Google Scholar 

  21. Nacereddine, N., Goumeidane, A.B., Ziou, D.: Unsupervised weld defect classification in radiographic images using multivariate generalized gaussian mixture model with exact computation of mean and shape parameters. Comput. Ind. 108, 132–149 (2019). https://doi.org/10.1016/j.compind.2019.02.010

    Article  Google Scholar 

  22. Nesterov, Y.E.: A method for solving the convex programming problem with convergence rate \(o(1/k^2)\). Dokl. Akad. Nauk SSSR 269, 543–547 (1983)

    MathSciNet  Google Scholar 

  23. Ojala, T., Pietikäinen, M., Mäenpää, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)

    Article  Google Scholar 

  24. Peng, J.J.: A method for recognition of defects in welding lines. In: 2009 International Conference on Artificial Intelligence and Computational Intelligence, vol. 2, pp. 366–369. IEEE (2009)

  25. Qian, N.: On the momentum term in gradient descent learning algorithms. Neural Netw. 12(1), 145–151 (1999). https://doi.org/10.1016/S0893-6080(98)00116-6

    Article  MathSciNet  Google Scholar 

  26. Rosenblatt, F.: The perceptron: a probabilistic model for information storage and organization in the brain. Psych. Rev. 65, 386–407 (1958)

    Article  Google Scholar 

  27. Rosten, E., Drummond, T.: Fusing points and lines for high performance tracking. IEEE Int. Conf. Comput. Vis. 2, 1508–1511 (2005). https://doi.org/10.1109/ICCV.2005.104

    Article  Google Scholar 

  28. Russell, S., Norvig, P.: Artificial Intelligence: A Modern Approach, 3rd edn. Prentice Hall Press, Upper Saddle River (2009)

    MATH  Google Scholar 

  29. Shen, Q., Gao, J., Li, C.: Automatic classification of weld defects in radiographic images. Insight-Non-Destr. Test. Cond. Monit. 52(3), 134–139 (2010)

    Article  Google Scholar 

  30. Shitole, C.N., Zahran, O., Al-Nuaimy, W.: Combining fuzzy logic and neural networks in classification of weld defects using ultrasonic time-of-flight diffraction. Insight-Non-Destr. Test. Cond. Monit. 49(2), 79–82 (2007)

    Article  Google Scholar 

  31. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR abs/1409.1556 (2014). arXiv:1409.1556

  32. Sutcliffe, M., Lewis, J.: Automatic defect recognition of single-v welds using full matrix capture data, computer vision and multi-layer perceptron artificial neural networks. Insight-Non-Destr. Test. Cond. Monit. 58(9), 487–493 (2016). https://doi.org/10.1784/insi.2016.58.9.487

    Article  Google Scholar 

  33. Zapata, J., Vilar, R., Ruiz, R.: Performance evaluation of an automatic inspection system of weld defects in radiographic images based on neuro-classifiers. Expert Syst. Appl. 38(7), 8812–8824 (2011)

    Article  Google Scholar 

  34. Zeiler, M.D., Fergus, R.: Visualizing and understanding convolutional networks. CoRR abs/1311.2901 (2013). http://dblp.uni-trier.de/db/journals/corr/corr1311.html#ZeilerF13

  35. Zscherpel, U., Berlin, B.: Film digitisation systems for dir: standards, requirements, archiving and printing. J. NDT Ultrason. 5, 5 (2000)

    Google Scholar 

Download references

Acknowledgements

The authors wants to acknowledge the work of the rest of the participants in this project, namely: J.A. López-Alcantud, P. Rubio-Ibañez, Universidad Politécnica de Cartagena, J.A. Díaz-Madrid, Centro Universitario de la Defensa - UPCT and T.J. Kazmierski, University of Southampton. This work has been partially funded by Spanish government through project numbered RTI2018-097088-B-C33 (MINECO/FEDER,UE).

Author information

Authors and Affiliations

  1. Dpto. de Electrónica y Tecnología de Computadoras, Universidad Politécnica Cartagena, Cartagena, Spain

    Chiraz Ajmi, Juan Zapata, José Javier Martínez-Álvarez, Ginés Doménech & Ramón Ruiz

Authors
  1. Chiraz Ajmi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Juan Zapata
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. José Javier Martínez-Álvarez
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ginés Doménech
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ramón Ruiz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Juan Zapata.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ajmi, C., Zapata, J., Martínez-Álvarez, J.J. et al. Using Deep Learning for Defect Classification on a Small Weld X-ray Image Dataset. J Nondestruct Eval 39, 68 (2020). https://doi.org/10.1007/s10921-020-00719-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10921-020-00719-9

Keywords

Search

Navigation