How to play
Sit 60–100 cm from the camera, with light in front of you and both hands in the frame. The right hand plays in the right half of the screen, the left hand in the left half ("Left-handed" swaps them).
Right hand · the notes
- Raise or lower your hand
- The note goes up or down. The lines on the right, like a staff, show where each note sits.
- Open your fingers
- Each open finger adds a voice: thumb = octave below, index = root note, middle = third, ring = fifth, pinky = octave above. One finger = melody, open hand = chord, fist = silence.
- Move your hand towards the edge
- The timbre goes from soft (near the centre line) to bright and rough (towards the edge).
Left hand · the character
- Raise or lower your hand
- Volume: high is loud, low is quiet. Without a left hand the volume stays at half.
- Bring thumb and index together
- Filter: closed pinch = dark sound, open fingers = bright sound.
- Tilt your hand
- Vibrato: turn your wrist like a door handle, left or right. The more you tilt, the more it wobbles; upright hand = no vibrato.
- Close ring and pinky fingers
- Drone: the notes you are playing are held, and the right hand can play on top. Open them again to release.
- Touch thumb and middle finger
- Loop: 1st tap records, 2nd tap closes the cycle and repeats it; after that each tap overdubs one cycle. Hold the pinch ~1 s to remove the last layer.
Face and gaze
- Open your mouth
- The sound moves towards the vowel "a".
- Smile · pucker
- Towards "i" when smiling, towards "u" when puckering. The Mouth slider sets how much it counts.
- Raise your eyebrows
- Echo.
- Look at a button, then blink
- Switches sound. Look at ↖ ↗ or ↓ until the ring is full, then blink. The sounds on the buttons are chosen in the menus at the bottom. Clicking works too.
- Calibrate
- Step by step; each step starts when you press Space. Redo it if you change seat or lighting.
Knobs next to filter, vibrato, echo, mouth and blink (left panel) set how sensitive each gesture is: drag up or down, or scroll; double-click resets to the centre.
Space calibration step ·
1 2 3 sounds ·
L loop · ⌫ remove layer ·
M mute · C calibrate · H hide bottom bar · ? these instructions