Finally I took the time to read OpenAI’s post about their GPT-Live Realtime system.
If you’re interested in how to build such low-latency systems, I definitely recommend to check it out. But what I also had in mind while reading the article was the “no one needs programmers anymore in the age of AI” … Oh really? Well I don’t know how many people were involved in the whole project – and I’m pretty sure they used AI in the coding parts. But the whole process to get there, knowing how / where to measure latencies, how to circumvent them, enhancing the WebRTC protocol and designing a new, faster standard, checking geo-location impact, shadow testing, etc … Oh boy, do I see people talking and engineering tasks there.
(more…)