That’s very cool! I’ve also had a play around with Sonic Pi which does something similar. I’ve had an on/off project over the years to try to something like this with JavaScript and web midi