What exactly can GPT-4 see? And does OpenAI have a plan for physical embodiment? Over 12 separate developments announced in the last few days are covered in this video, in which I showcase how improvements in text, speech, 3D, and embodiment are beginning to complement each other.
We'll take an early look at use cases for images in GPT 4, how Nvidia and Adobe are pushing boundaries in Text to 3D, at Sam Altman's Moore's Law For Everything, at the new LeRF model and Assembly AI's latest Speech-to-Text.
We will also see how OpenAI already had a Robotics team but now is invested in 1x, developing humanoid robots. But they are not the first, as Agility Robotics has shown...
Conformer Model: https://www.assemblyai.com/playground/source
Napkin-to-Code: https://twitter.com/rowancheung/status/1635744529587359756
BeMyEyes: https://twitter.com/BeMyEyes/status/1635690254689599488
Tanishq: https://twitter.com/iScienceLuvr
Medical Questions: https://arxiv.org/pdf/2303.13375.pdf
VQA: https://arxiv.org/pdf/1904.08920.pdf
Scale is All You Need: https://twitter.com/markchen90/status/1637903780393160704
Nvidia Text-to-3D: https://twitter.com/chenhsuan_lin/status/1638543416723406849?t=rXEsDcEvsdmMPEsZPPhWmw&s=09
Adobe Firefly: https://www.youtube.com/watch?v=_sJfNfMAQHw
Moore's Law For Everything: https://moores.samaltman.com/#:~:text=Moore%27s%20Law%20for%20Everything.%20Broadly%20speaking%2C%20there%20are,we%20can%20get%20with%20the%20resources%20we%20have.
LeRF 3D: https://arxiv.org/pdf/2303.09553.pdf
Wired: https://www.wired.com/story/fast-forward-for-smarter-robots-just-add-humans/
Conformer Model: https://www.assemblyai.com/playground/source
https://www.assemblyai.com/blog/conformer-1/
Boston Dynamics: https://www.youtube.com/watch?v=-e1_QhJ1EhQ
1X: https://www.1x.tech/
Quadrupedal Agility: https://arxiv.org/pdf/2303.11330.pdf
Rubik's Cube: https://openai.com/research/solving-rubiks-cube
Statues: https://twitter.com/TuurDemeester/status/1639421727548616710
GPT 4 Technical Report: https://arxiv.org/pdf/2303.08774.pdf
Agility Robotics: https://www.youtube.com/watch?v=FhlUI2xDxdE
Sam Altman Lex Fridman: https://www.youtube.com/watch?v=L_Guz73e6fw
https://www.patreon.com/AIExplained