This is a blog to document the progress of the second year project titled 'Brain To Computer Game Interface' from the Electrical and Electronic Engineering department at the University of Liverpool.
Tuesday, 31 January 2012
Brain-machine interface controls movement of prosthetic limb
Monday, 30 January 2012
Helicopter Game Interface
Hamzah S. AlZu'bi
Hamzah's Thesis
NeuroSky Headset
This device comes with software that enables simplified measurement of brainwaves and can give an output that will allow us to interface with other pieces of software or games. We could therefore link the devices output to Matlab to allow for precise processing of the signals.
We now need to decide on what application we could write to use this that is unique and interesting. Hopefully the headset will arrive this week so that we can start to have a play with it!
Sunday, 15 January 2012
My Consideration and Ideas
Consideration
“Training”
Since to control this device, computer needs a set of basic data before being controlled for different brains, and the user also need a training to control the body in the computer better, we should take best advantage of the requirement of the double “trainings”. Therefore we can focus on the games whose degree of the difficulty is step by step, for example the ability of the role should be growing.
“Mind”
Although the headset could be control through some actual body behaviours, I don’t think it is good to make use of this feature, for the Wii can detect the motion better than the headset.
Therefore there are two ways for us to consider:
1. The Sports games which are impossible for common users to have;
2. Games mainly with some fiction abilities;
“Gaze-tracking”
It’s happy to see the headset could detect where the user’s eyes are looking at. (See the example video: http://www.youtube.com/watch?v=aHcTyrq8U3c&feature=mfu_in_order&list=UL) I think the mouse is controlled by someone’s hand, for it is not mentioned. I don’t know whether it is possible to control the thing which is focused on.
Ideas
1. “Experiencing some difficult sports”
E.g. Turning somersault in gymnastics, trampoline etc.
However, it couldn’t be used in motion with keeping balance, I think, because we need a current feedback to decide the next motion, but there is no way to input a signal by the headset. For instance, using this device to “experience” walking on a wire is boring, isn’t it?
P.S. If it is good enough, don’t you think it is also able to apply to the injured gymnasts for keeping familiar with his set of motion and to the coach for expressing his ideas (because the coach can’t do it himself generally )?
2. “Mining the strategies for some video action games”
Most of the action games need a quickly response, and most of them can be played well for most of players if they discover the skills. Game strategies are quite common for Puzzle Games, but it might be available in these action games. (e.g. http://www.youtube.com/watch?v=xYFTRfYmyWY&context=C3b6f0cbADOEgsToPDskIhAUdWtAGzT6V1u_lxUmdg and my comment below the video)
3. “Harry Potter Games”
Look at this “news” (http://www.bbc.co.uk/news/10352816). It was built in order to let people to experience the scenes in “Harry Potter”. From the novels to the movies even to the Wizarding World of Harry Potter, it gets the readers’ imagination to actualize step by step. I don’t know whether its game has existed with this kind of device. Our capabilities are not enough so far, and the time is limited. However, what we can try to do may be to make the Sorting Hat.
Of course the headset can be used in other RPG magical games, but I don’t think it is possible for us.
4. “Bejeweled Blitz”
If we can control the diamond which we focus on, it could be played without the hand. (Here is the tutorial of the game: http://apps.facebook.com/bejeweledblitz/?kt_type=stream&kt_ut=BCA8836B2BD5E5A0&kt_st1=StarMedal&kt_st2=ReplayAppAction500K&kt_st3=0047&lpt=StarMedal-ReplayAppAction500K-0047)
5. “Others that are nothing about games”
To observe the curves of the EEG graph when listening the brain relax music or brain concentrating music, and to analysis to conclude whether they are useful;
To study human’s motion in their dreams; or the thinking of dying people; or the thinking of people who died in minutes;
Since the device is so convenience, why Professor Stephen Hawking doesn’t use it to communicate? (This video introduces the device he uses to communicate: http://www.youtube.com/watch?v=DbHygyExIIk&feature=g-hist&context=G279bb83AHTuvhFQACAA)
To drive for disabled person;