EURASIP Journal on Applied Signal Processing 
Volume 2005 (2005), Issue 19, Pages 3156-3164
doi:10.1155/ASP.2005.3156

Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment

E. C. Lalor,1 S. P. Kelly,1,2 C. Finucane,3 R. Burke,4 R. Smith,1 R. B. Reilly,1 and G. McDarby1

 1School of Electrical, Electronic and Mechanical Engineering, University College Dublin, Belfield, Dublin 4, Ireland
2The Cognitive Neurophysiology Laboratory, Nathan S. Kline Institute for Psychiatric Research, Orangeburg 10962, NY, USA
3Medical Physics and Bioengineering, St. James's Hospital, P.O. Box 580, Dublin 8, Ireland
4EOC Operations Center, Microsoft Corporation, Sandyford Industrial Estate, Dublin 18, Ireland
Received 2 February 2004; Revised 19 October 2004

Abstract

This paper presents the application of an effective EEG-based brain-computer interface design for binary control in a visually elaborate immersive 3D game. The BCI uses the steady-state visual evoked potential (SSVEP) generated in response to phase-reversing checkerboard patterns. Two power-spectrum estimation methods were employed for feature extraction in a series of offline classification tests. Both methods were also implemented during real-time game play. The performance of the BCI was found to be robust to distracting visual stimulation in the game and relatively consistent across six subjects, with 41 of 48 games successfully completed. For the best performing feature extraction method, the average real-time control accuracy across subjects was 89%. The feasibility of obtaining reliable control in such a visually rich environment using SSVEPs is thus demonstrated and the impact of this result is discussed.