#206 – Ishan Misra: Self-Supervised Deep Learning in Computer Vision

Ishan Misra is a research scientist at FAIR working on self-supervised visual learning. Please support this podcast by checking out our sponsors: – Onnit: https://lexfridman.com/onnit to get up to 10% off – The Information: https://theinformation.com/lex to get 75% off first month – Grammarly: https://grammarly.com/lex to get 20% off premium – Athletic Greens: https://athleticgreens.com/lex and use code LEX to get 1 month of fish oil EPISODE LINKS: Ishan’s twitter: https://twitter.com/imisra_ Ishan’s website: https://imisra.github.io Ishan’s FAIR page: https://ai.facebook.com/people/ishan-misra/ PODCAST INFO: Podcast website: https://lexfridman.com/podcast Apple Podcasts: https://apple.co/2lwqZIr Spotify: https://spoti.fi/2nEwCF8 RSS: https://lexfridman.com/feed/podcast/ YouTube Full Episodes: https://youtube.com/lexfridman YouTube Clips: https://youtube.com/lexclips SUPPORT & CONNECT: – Check out the sponsors above, it’s the best way to support this podcast – Support on Patreon: https://www.patreon.com/lexfridman – Twitter: https://twitter.com/lexfridman – Instagram: https://www.instagram.com/lexfridman – LinkedIn: https://www.linkedin.com/in/lexfridman – Facebook: https://www.facebook.com/lexfridman – Medium: https://medium.com/@lexfridman OUTLINE: Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time. (00:00) – Introduction (07:49) – Self-supervised learning (16:24) – Self-supervised learning is the dark matter of intelligence (20:17) – Categorization (28:50) – Is computer vision still really hard? (32:35) – Understanding Language (42:14) – Harder to solve: vision or language (48:59) – Contrastive learning & energy-based models (52:59) – Data augmentation (57:19) – Fixed audio spike by lowering sound with pen tool (1:05:33) –