- in Podcast by Bobby Owsinski
Episode 647 – Music Robotics And Music Tech With Gil Weinberg
On this week’s episode, Georgia Tech’s Gil Weinberg joins me to show how robots, prosthetics, and AI can expand what musicians do.
Gil built Shimon, a marimba robot with eight arms capable of 20 hits per second, and a prosthetic drum arm for amputee Jason Barnes that uses ultrasound sensing to give him finger-by-finger piano control.
His Hear Me app blocks text prompts entirely and requires users to play, sing, or sequence into it before any AI generation begins. The throughline across all of it is that the act of playing stays with the musician.
Gil founded the Center for Music Technology at Georgia Tech in 2009, six years after joining the faculty in 2003.
The Center spans music information retrieval, machine learning, spatial audio, robotic musicianship, and new instrument design, with graduates going on to work at Dolby, Bose, Google, and Apple.
It also presents the Guthman Musical Instrument Competition, where musical instrument inventors show their latest ideas, which we cover during the show.
Gil’s clearest design principle is that friction in music creation is a feature, not a problem to eliminate, because the struggle of learning an instrument builds cognitive and social capacities that a generated audio file cannot replicate.
That same refusal to accept the easiest output is exactly what Hear Me enforces: you must play first, and the AI responds to you.
You can hear it at Apple Podcasts, Amazon Music, YouTube Music, Mixcloud, Spotify, Deezer, and TuneIn Radio.
Also, a video version of this podcast is now available on YouTube as well.
Chapters:
00:00:00 – Coming up…
00:01:07 – How Georgia Tech’s Center for Music Technology was founded
00:03:48 – Trends in music technology most people are not aware of
00:07:12 – Why AI music tools are starting to worry a pioneer in the field
00:08:27 – How do you respond to musicians who fear robots will replace them?
00:10:16 – The HearMe app: why music should be played, not prompted
00:15:01 – Music therapy, stroke recovery, and AI prosthetics for amputee musicians
00:20:41 – Who is the target audience for the HearMe app?
00:21:37 – The Guthman Musical Instrument Competition, explained
00:25:39 – Gil Weinberg’s background: from jazz pianist to robotics pioneer
00:28:36 – How AI music generators have become both too successful and too limiting
00:31:01 – When AI actually helps musicians in the studio
00:32:14 – What Gil wishes more people understood about his work
