Found 32 bookmarks
Custom sorting
THIS is why large language models can understand the world
THIS is why large language models can understand the world
5 years ago, nobody would have guessed that scaling up LLMs would as successful as they are. This belief, in part, was due to the fact that all known statistical learning theory predicted that massively oversized models should overfit, and hence perform worse than smaller models. Yet the undeniable fact is that modern LLMs do possess models of the world that allow them to generalize beyond their training data. Why do larger models generalize better than smaller models? Why does training a model to predict internet text cause it to develop world models? Come deep dive into the inner working of neural network training to understand why scaling LLMs works so damn well. Want to see more videos like this in the future? Support me on Ko-fi https://ko-fi.com/algorithmicsimplicity Papers referenced: Double Descent: https://arxiv.org/abs/1812.11118 The Lottery Ticket Hypothesis: https://arxiv.org/abs/1803.03635 My previous videos on Autoregressive Transformers: Auto-regression (and diffusion): https://youtu.be/zc5NTeJbk-k Transformers: https://youtu.be/kWLed8o5M2Y
·youtube.com·
THIS is why large language models can understand the world
robertjakob/rigorous: A comprehensive suite of tools, built to liberate science by making the creation, evaluation, and dissemination of research more transparent, affordable, and efficient.
robertjakob/rigorous: A comprehensive suite of tools, built to liberate science by making the creation, evaluation, and dissemination of research more transparent, affordable, and efficient.
A comprehensive suite of tools, built to liberate science by making the creation, evaluation, and dissemination of research more transparent, affordable, and efficient. - robertjakob/rigorous
·github.com·
robertjakob/rigorous: A comprehensive suite of tools, built to liberate science by making the creation, evaluation, and dissemination of research more transparent, affordable, and efficient.
David Chalmers Discusses the Hard Problem of Consciousness
David Chalmers Discusses the Hard Problem of Consciousness
What exactly is consciousness, and why is it such a hard problem to solve? Neil deGrasse Tyson and co-hosts Chuck Nice and Gary O’Reilly take you deep into the mysteries of consciousness and objective reality, David Chalmers, a philosopher and cognitive scientist. How do we understand the core of subjective experience? We explore the philosophical and neuroscientific angles of consciousness. Why do some experts believe consciousness arises from the sensory cortex, while others point to the prefrontal cortex? And what does this mean for how we understand animals, AI, or even the very nature of our own minds? We question how consciousness evolved to discussions about the levels of consciousness in animals, babies, and humans under anesthesia. As the conversation turns to AI, the group contemplates the future of artificial consciousness. Could large language models, like today's AI, eventually develop consciousness? If not now, will they in the near future? And if we can simulate human consciousness in machines, are we creating philosophical zombies—entities that behave like us but lack awareness? These questions spiral into debates about reality, VR, and whether we're already living in a simulation. Could there be laws of consciousness waiting to be discovered, like the laws of physics? Or is consciousness simply an illusion, as some scientists propose? What are the core features of consciousness that scientists agree on? Buckle up for a fascinating journey that will leave you questioning not just what consciousness is, but whether any of this is even real. Thanks to our Patrons Jay, Gregory Aronoff, Tom B. Night, Barnsley, Glenn, Hibachi Flamethrower, Crescencio Maximilian joseph Martinez, Micheal Gomez, Matthew Deane, James, Joe Chillemi, Thomas van Cleave, Kelsey Plugge, Jeff Jones, William Hamilton, and Kevin Cosg. for supporting us this week. Check out our second channel, @StarTalkPlus Get the NEW StarTalk book, 'To Infinity and Beyond: A Journey of Cosmic Discovery' on Amazon: https://amzn.to/3PL0NFn Support us on Patreon: https://www.patreon.com/startalkradio FOLLOW or SUBSCRIBE to StarTalk: Twitter: http://twitter.com/startalkradio Facebook: https://www.facebook.com/StarTalk Instagram: https://www.instagram.com/startalk About StarTalk: Science meets pop culture on StarTalk! Astrophysicist & Hayden Planetarium director Neil deGrasse Tyson, his comic co-hosts, guest celebrities & scientists discuss astronomy, physics, and everything else about life in the universe. Keep Looking Up! #StarTalk #neildegrassetyson Timestamps: 00:00 - Introduction: David Chalmers 04:00 - What is Consciousness? 06:50 - Where is the Seat of Consciousness? 14:30 - Are Large Language Models Conscious? 22:47 - The Laws of Consciousness 31:40 - Does Consciousness Really Exist? 34:50 - The Reality of Virtual Reality 42:40 - The Future of Reality
·youtube.com·
David Chalmers Discusses the Hard Problem of Consciousness
GitHub - AspirinCode/papers-for-molecular-design-using-DL: List of molecular design using Generative AI and Deep Learning
GitHub - AspirinCode/papers-for-molecular-design-using-DL: List of molecular design using Generative AI and Deep Learning
List of molecular design using Generative AI and Deep Learning - GitHub - AspirinCode/papers-for-molecular-design-using-DL: List of molecular design using Generative AI and Deep Learning
·github.com·
GitHub - AspirinCode/papers-for-molecular-design-using-DL: List of molecular design using Generative AI and Deep Learning