skip to main content
10.1145/3436369.3437433acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccprConference Proceedingsconference-collections
research-article

EEG-Based Hand Motion Pattern Recognition Using Deep Learning Network Algorithms

Authors Info & Claims
Published:11 January 2021Publication History

ABSTRACT

EEG signals contain information of limb motion patterns that are difficult to be extracted using conventional methods. The purpose of this study was to determine the feasibility of novel machine learning algorithms in extraction of hand motion intents from EEG. In this paper, 3 hand motion patterns (hand opening, closing, resting) were recognized using the filter bank common spatial pattern (FBCSP) method. The spatial filtering method and the CNN classifier were used to decode and classify the EEG signals. 15 healthy subjects' EEG datasets were used. Results demonstrated that the average correct rate of motion pattern recognition was 83.61%. The performance of these algorithms was validated using off-line computer-controlled robotic hand system, the average accuracy of a subject was 77.32%, and the average time of the system recognition action was 28.4ms. This study demonstrated that hand motion pattern recognition can be extracted from EEG signals and can be utilized by brain computer interface (BCI) to trajectory control a robotic hand motion.

References

  1. H. A. Agashe, A. Y. Paek, Y. Zhang, and J. L. Contreras-Vidal, "Global cortical activity predicts shape of hand during grasping," Front. Neurosci., 2015, doi: 10.3389/fnins.2015.00121.Google ScholarGoogle Scholar
  2. U. Chaudhary, N. Birbaumer, and A. Ramos-Murguialday, "Brain-computer interfaces for communication and rehabilitation," Nature Reviews Neurology. 2016, doi: 10.1038/nrneurol.2016.113.Google ScholarGoogle Scholar
  3. H. Shibasaki and M. Hallett, "What is the Bereitschaftspotential?," Clinical Neurophysiology. 2006, doi: 10.1016/j.clinph.2006.04.025.Google ScholarGoogle Scholar
  4. H. H. Kornhuber and L. Deecke, "Hirnpotentialänderungen bei Willkürbewegungen und passiven Bewegungen des Menschen: Bereitschaftspotential und reafferente Potentiale," Pflugers Arch. Gesamte Physiol. Menschen Tiere, 1965, doi: 10.1007/BF00412364.Google ScholarGoogle Scholar
  5. G. R. Müller-Putz, "Electroencephalography," in Handbook of Clinical Neurology, 2020.Google ScholarGoogle Scholar
  6. K. Liao, R. Xiao, J. Gonzalez, and L. Ding, "Decoding individual finger movements from one hand using human EEG signals," PLoS One, 2014, doi: 10.1371/journal.pone.0085192.Google ScholarGoogle Scholar
  7. T. J. Bradberry, R. J. Gentili, and J. L. Contreras-Vidal, "Reconstructing three-dimensional hand movements from noninvasive electroencephalographic signals," J. Neurosci., 2010, doi: 10.1523/JNEUROSCI.6107-09.2010.Google ScholarGoogle ScholarCross RefCross Ref
  8. J. Meng, S. Zhang, A. Bekyo, J. Olsoe, B. Baxter, and B. He, "Noninvasive Electroencephalogram Based Control of a Robotic Arm for Reach and Grasp Tasks," Sci. Rep., 2016, doi: 10.1038/srep38565.Google ScholarGoogle Scholar
  9. D. Cvetkovic, E. D. Übeyli, and I. Cosic, "Wavelet transform feature extraction from human PPG, ECG, and EEG signal responses to ELF PEMF exposures: A pilot study," Digit. Signal Process. A Rev. J., 2008, doi: 10.1016/j.dsp.2007.05.009.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. B. Blankertz, R. Tomioka, S. Lemm, M. Kawanabe, and K. R. Müller, "Optimizing spatial filters for robust EEG single-trial analysis," IEEE Signal Process. Mag., 2008, doi: 10.1109/MSP.2008.4408441.Google ScholarGoogle Scholar
  11. H. Ramoser, J. Müller-Gerking, and G. Pfurtscheller, "Optimal spatial filtering of single trial EEG during imagined hand movement," IEEE Trans. Rehabil. Eng., 2000, doi: 10.1109/86.895946.Google ScholarGoogle Scholar
  12. F. Lotte et al., "A review of classification algorithms for EEG-based brain-computer interfaces: A 10 year update," Journal of Neural Engineering. 2018, doi: 10.1088/1741-2552/aab2f2.Google ScholarGoogle Scholar
  13. K. K. Ang, Z. Y. Chin, C. Wang, C. Guan, and H. Zhang, "Filter bank common spatial pattern algorithm on BCI competition IV datasets 2a and 2b," Front. Neurosci., 2012, doi: 10.3389/fnins.2012.00039.Google ScholarGoogle Scholar
  14. C.-J. L. Chih-Wei Hsu, Chih-Chung Chang, "A Practical Guide to Support Vector Classification," BJU Int., 2008.Google ScholarGoogle Scholar
  15. L. Peterson, "K-nearest neighbor," Scholarpedia, 2009, doi: 10.4249/scholarpedia.1883.Google ScholarGoogle Scholar
  16. A. M. Martinez and A. C. Kak, "PCA versus LDA," IEEE Trans. Pattern Anal. Mach. Intell., 2001, doi: 10.1109/34.908974.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. C. Szegedy et al., "Going deeper with convolutions," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2015, doi: 10.1109/CVPR.2015.7298594.Google ScholarGoogle Scholar
  18. Y. Lecun, Y. Bengio, and G. Hinton, "Deep learning," Nature. 2015, doi: 10.1038/nature14539.Google ScholarGoogle Scholar
  19. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science (80-.)., 2006, doi: 10.1126/science. 1127647.Google ScholarGoogle Scholar
  20. P. Ofner, A. Schwarz, J. Pereira, and G. R. Müller-Putz, "Upper limb movements can be decoded from the time-domain of low-frequency EEG," PLoS One, 2017, doi: 10.1371/journal.pone.0182578.Google ScholarGoogle Scholar
  21. A. Delorme and S. Makeig, "EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis," J. Neurosci. Methods, 2004, doi: 10.1016/j.jneumeth.2003.10.009.Google ScholarGoogle ScholarCross RefCross Ref
  22. S. Liu and W. Deng, "Very deep convolutional neural network based image classification using small training sample size," in Proceedings - 3rd IAPR Asian Conference on Pattern Recognition, ACPR 2015, 2016, doi: 10.1109/ACPR.2015.7486599.Google ScholarGoogle Scholar
  23. C. Cortes, M. Mohri, and A. Rostamizadeh, "L2 regularization for learning kernels," in Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence, UAI 2009, 2009.Google ScholarGoogle Scholar
  24. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A simple way to prevent neural networks from overfitting," J. Mach. Learn. Res., 2014.Google ScholarGoogle Scholar
  25. S. Ioffe and C. Szegedy, "Batch normalization: Accelerating deep network training by reducing internal covariate shift," in 32nd International Conference on Machine Learning, ICML 2015, 2015.Google ScholarGoogle Scholar
  26. D. P. Kingma and J. L. Ba, "Adam: A method for stochastic optimization," in 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings, 2015.Google ScholarGoogle Scholar
  27. M. Abadi et al., "TensorFlow: A system for large-scale machine learning," in Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2016, 2016.Google ScholarGoogle Scholar
  28. J. Xu, "An extended one-versus-rest support vector machine for multi-label classification," Neurocomputing, 2011, doi: 10.1016/j.neucom.2011.04.024.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. EEG-Based Hand Motion Pattern Recognition Using Deep Learning Network Algorithms

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        ICCPR '20: Proceedings of the 2020 9th International Conference on Computing and Pattern Recognition
        October 2020
        552 pages
        ISBN:9781450387835
        DOI:10.1145/3436369

        Copyright © 2020 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 11 January 2021

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader