holyjs HolyJS 2020 СПб (22.06.2020 — 26.06.2020)

Exploring the hidden potential of sound data


How to use acoustic activity recognition on JS? Spoiler: you should use web audio API and Tensorflow.js. And Charlie Gerard will tell you all the details of this process.

Even though we don’t think about it, the sound is a very rich source of information.

Leveraging the properties of sound with machine learning, we can gain insights about an environment or an activity performed.

Acoustic activity recognition has the potential to create new interactions and better smart systems, and in this talk, we explore how to experiment with this technology in JavaScript, using the web audio API and Tensorflow.js.