What is it like to use a gamepad to control (wan) to control (huai) facial expressions?
Press the LB key to blink the left eye, press the RB button to blink the right eye, and you can also walk a set of combos left and right. (The screen is mirrored)
Isn't it a little weird, take another look...
Shaking the right stick, the little brother instantly mastered the stunt of the Crooked Mouth God of War.
Through the left stick, the unilateral eyebrow raising expression that is difficult for ordinary humans can also be taken down in an instant.
But be careful not to press randomly, otherwise...
This is an open source project that has exploded in the past few days, and the author, Handaru, is a graduate student from Japan who claims to be keen on some "useless work".
And his latest "useless" work was passed on the Internet, directly to the netizens to see the stunned, tweet likes have been nearly 70,000.
Netizens who have walked by have said that this wave is a dream of dorae into reality:
Even stranger ideas were born...
On the contrary, as long as you move your facial muscles, you can play the game...?
It just looks a little painful...
Well, the little brother himself said, it will hurt...
△ "It will hurt when you use it"
The principle is very simple, the key is to find the acupuncture points
Such a system that looks a bit "masochistic", the principle is actually very simple, everyone can understand at a glance, that is, rely on electrical stimulation.
We all know that muscles contract after being stimulated by a certain amount of electricity.
Specifically, if the voltage given can cause the initial depolarization of muscle cells to reach the threshold potential, and then produce the action potential, the muscle contracts.
The peak potential duration of the action potential is 2ms, and the maximum can be increased from -80mV to 60mV.
Most muscles contract once in a 20ms cycle when stimulated.
This is very similar to the signal cycle of the servo motor, so the brother uses it to supply power, ensuring that the final output voltage is 150mV.
(At this time, the little brother also "patted the thigh": is it possible that the servo motor is made according to the law of muscle contraction?) ）。
However, the control voltage of the servo motor, that is, the supply voltage to the circuit board is 5V, which needs to be processed by designing a circuit diagram:
It is then printed by fast etching.
The main controller is an Arduino Uno (the latest version of Arduino): with it one end connected to the handle, the other to our muscles.
The brother made a total of 10 contacts, in order to increase the conductivity, the electrodes on each contact were covered with gauze soaked in salt water, and then directly pasted to the skin.
It is also possible to use the following grid substrate + gel conductive patch, but the little brother found that it did not directly let the electrodes contact the skin to achieve a good effect.
The last thing to do is to write the program, here to use a ready-made library Servo of Arduino to control the servo motor, remember to set the ON time of the motor to 2ms on the line.
Servo can easily add channels, followed by more complex controls, more distorted expressions (bushi)...
Then, before connecting the handle to the interface of the Arduino board, use a framework called ROSSerial to set which key corresponds to which contact, and everything is done.
The complete code can be found at the end of the article.
Isn't that simple? Is it time to lose your studies?
The little brother suggested that most of the time it is pasted on the skin, which may not have the expected effect - the key is to find the electric shock acupuncture points, which has to rely on yourself to grope for the human muscle model one by one.
And the adaptation handle In addition to this Logitech in the hands of the little brother, switch, PS4 can also, including keyboards.
Finally, according to the same principle, he also did the whole work of controlling his fingers:
Look at this effect, in theory, the control is precise enough, a small white can also become a pianist, right (manual dog head)?
Netizen: Reverse operation, start the game
As mentioned earlier, the wave of operation of the handaru brother came down, and the thinking of the comment area suddenly unfolded.
For example, reverse operation, face to face the Valkyrie in the old man's ring...
Or this way of playing is not impossible:
Some people also mentioned that this thing is good for the hotel industry, and the service staff will no longer be afraid of not being able to practice a standard smile in the future:)
Of course, there are also many serious discussions, such as a topic that everyone in the comment area is concerned about:
Can this device benefit patients with facial paralysis?
In fact, among the existing treatment options for patients with facial paralysis, there is indeed one type of electrical stimulation therapy.
Mainly in traditional Chinese medicine, according to the functional characteristics of neuromuscular anatomy, the use of electric needles to give specific muscle electrical stimulation to restore the sensitivity of nerve conduction.
Brother's other "useless" inventions
Brother handaru introduced himself in his profile like this:
Mainly doing some useless work.
However, it seems that this time netizens feel that his "masochistic" project is quite promising.
Before that, the little brother really did not have less work, such as this pot that allows you to talk to plants:
With this pot, your plant can tell you its current state through communication software.
Even throwing tantrums...
Finally, before offering the project portal, we still have to remind you that although the brother has open sourced the code, imitation is risky! Imitation is risky! Imitation is risky!
The little brother also noted in the project:
Code is self-collecting, at your own risk.