{"id":11421,"date":"2026-07-21T03:49:57","date_gmt":"2026-07-21T03:49:57","guid":{"rendered":"https:\/\/www.mrericsir.com\/blog\/?p=11421"},"modified":"2026-07-21T03:49:59","modified_gmt":"2026-07-21T03:49:59","slug":"resonate_glitch","status":"publish","type":"post","link":"https:\/\/www.mrericsir.com\/blog\/technology\/resonate_glitch\/","title":{"rendered":"resonate_glitch"},"content":{"rendered":"\n
\"\"<\/a><\/figure>\n\n\n\n

Recently I was wandering around with my phone in my hand, as one does, and got to wondering: what if I could use the camera feed and other sensors on the phone to create a procedurally-generated soundtrack?<\/p>\n\n\n\n

And just to make things more interesting: I wanted to do it entirely in HTML5 + JavaScript with no backend server at all. In other words, something you could use without an internet connection, provided you’d already downloaded the page.<\/p>\n\n\n\n

A few late night tinkering sessions later, and I had a working, somewhat well tuned prototype of my new web app: resonate_glitch<\/a>. <\/p>\n\n\n\n

As I’ve explained in the README<\/strong>:<\/p>\n\n\n\n

\n

Generative audio in HTML5. Designed to be run on phones.<\/p>\n\n\n\n

resonate_glitch takes in various inputs: the camera feed, mic input, and accelerometer motion data on your phone. Running these parameters through an algorithm, it produces synthesized electronic “music” with a glitchy camera view.<\/p>\n\n\n\n

The aim of the project is to create a synthetic synchronicity. Does the music have any meaning? Are you able to affect it in any way? It’s up to the user to experiment and find out.<\/p>\n\n\n\n

Note: There is no backend server, everything runs in your web browser. So while the webapp can’t be used for spying, it may cause your phone to overheat.<\/p>\n<\/blockquote>\n\n\n\n

Have a moment to make some messy, glitchy music? Great! It’s free and open source, try it yourself:<\/p>\n\n\n\n