Data Science at Home

AI Says It Can Compress Better Than FLAC?! Hold My Entropy 🍿 (Ep. 268)

Can AI really out-compress PNG and FLAC? 🤔 Or is it just another overhyped tech myth? In this episode of Data Science at Home, Frag dives deep into the wild claims that Large Language Models (LLMs) like Chinchilla 70B are beating traditional lossless compression algorithms. 🧠💥
But before you toss out your FLAC collection, let's break down Shannon's Source Coding Theorem and why entropy sets the ultimate limit on lossless compression.
We explore: ⚙️ How LLMs leverage probabilistic patterns for compression 📉 Why compression efficiency doesn’t equal general intelligence 🚀 The practical (and ridiculous) challenges of using AI for compression 💡 Can AI actually BREAK Shannon’s limit—or is it just an illusion?
If you love AI, algorithms, or just enjoy some good old myth-busting, this one’s for you. Don't forget to hit subscribe for more no-nonsense takes on AI, and join the conversation on Discord!
Let’s decode the truth together. Join the discussion on the new Discord channel of the podcast https://discord.gg/4UNKGf3
 
Don't forget to subscribe to our new YouTube channel 
https://www.youtube.com/@DataScienceatHome
 
 
References
Have you met Shannon? https://datascienceathome.com/have-you-met-shannon-conversation-with-jimmy-soni-and-rob-goodman-about-one-of-the-greatest-minds-in-history/
 
 

What Big Tech Isn’t Telling You About AI (Ep. 267)

Are AI giants really building trustworthy systems? A groundbreaking transparency report by Stanford, MIT, and Princeton says no. In this episode, we expose the shocking lack of transparency in AI development and how it impacts bias, safety, and trust in the technology. We’ll break down Gary Marcus’s demands for more openness and what consumers should know about the AI products shaping their lives.
 
Check our new YouTube channel https://www.youtube.com/@DataScienceatHome and Subscribe! 
 
Cool links
https://mitpress.mit.edu/9780262551069/taming-silicon-valley/
http://garymarcus.com/index.html

Money, Cryptocurrencies, and AI: Exploring the Future of Finance with Chris Skinner [RB] (Ep. 266)

We're revisiting one of our most popular episodes from last year, where renowned financial expert Chris Skinner explores the future of money. In this fascinating discussion, Skinner dives deep into cryptocurrencies, digital currencies, AI, and even the metaverse. He touches on government regulations, the role of tech in finance, and what these innovations mean for humanity.
Now, one year later, we encourage you to listen again and reflect—how much has changed? Are Chris Skinner's predictions still holding up, or has the financial landscape evolved in unexpected ways? Tune in and find out!

Kaggle Kommando’s Data Disco: Laughing our Way Through AI Trends (Ep. 265) [RB]

In this episode, join me and the Kaggle Grand Master, Konrad Banachewicz, for a hilarious journey into the zany world of data science trends. From algorithm acrobatics to AI, creativity, Hollywood movies, and music, we just can't get enough. It's the typical episode with a dose of nerdy comedy you didn't know you needed. Buckle up, it's a data disco, and we're breaking down the binary!
 
Sponsors
Intrepid AI is an AI assisted all-in-one platform for robotics teams. Build robotics applications in minutes, not months.
Learn what the new year holds for ransomware as a service, Active Directory, artificial intelligence and more when you download the 2024 Arctic Wolf Labs Predictions Report today at arcticwolf.com/datascience
 
🔗 Links Mentioned in the Episode:
Generative AI for time series: TimeGPT Documentation
Lag-llama: GitHub (Note: The benchmark results on this one are pretty horrible)
Open source LLM: Olmo Blog Post
Quantization for LLM: Hugging Face Guide
And finally, don't miss Konrad's Substack for more nerdy goodness! (If you're there already, be there again! 😄)

AI and Video Game Development: Navigating the Future Frontier (Ep. 264) [RB]

In this episode we delve into the dynamic realm of game development and the transformative role of artificial intelligence (AI). Join Frag, Jim and Mike as they explore the current landscape of game development processes, from initial creative ideation to the integration of AI-driven solutions. With Mike's expertise as a software executive and avid game developer, we uncover the potential of AI to revolutionize game design, streamline development cycles, and enhance player experiences. Discover insights into AI's applications in asset creation, code assistance, and even gameplay itself, as we discuss real-world implementations and cutting-edge research.
From the innovative GameGPT framework to the challenges of balancing automation with human creativity, this episode offers valuable perspectives and practical advice for developers looking to harness the power of AI in their game projects. Don't miss out on this insightful exploration at the intersection of technology and entertainment!
 
Sponsors
Intrepid AI (https://intrepid.ai) is an AI assisted all-in-one platform for robotics teams. Build robotics applications in minutes, not months.
 
References
https://mikeyoung44.itch.io/spacefreighter - Itch.io link to play the game
https://discord.gg/yaXgYZ5Ymn - Discord server for the game
https://aimodels.substack.com/ - Mike’s newsletter (links to website too)
 
 

LLMs: Totally Not Making Stuff Up (they promise) (Ep. 263)

In this episode, we dive into the wild world of Large Language Models (LLMs) and their knack for… making things up. Can they really generalize without throwing in some fictional facts? Or is hallucination just part of their charm? Let’s separate the genius from the guesswork in this insightful breakdown of AI’s creativity problem.
TL;DR;
LLM Generalisation without hallucinations. Is that possible?
 
References
https://github.com/lamini-ai/Lamini-Memory-Tuning/blob/main/research-paper.pdf
https://www.lamini.ai/blog/lamini-memory-tuning
 
 

AI: The Bubble That Might Pop—What’s Next? (Ep. 262)

The hype around Generative AI is real, but is the bubble about to burst? Join me as we dissect the recent downturn in AI investments and what it means for the tech giants like OpenAI and Nvidia. Could this be the end of the AI gold rush, or just a bump in the road?
 
References
http://garymarcus.com/index.html
https://garymarcus.substack.com/p/why-the-collapse-of-the-generative?r=8tdk6&utm_source=substack&utm_medium=email
https://www.theinformation.com/articles/openai-makes-a-60-million-hardware-startup-bet?utm_source=substack&utm_medium=email
 
 

Data Guardians: How Enterprises Can Master Privacy with MetaRouter (Ep. 261)

In this insightful episode, we dive deep into the pressing issue of data privacy, where 86% of U.S. consumers express growing concerns and 40% don't trust companies to handle their data ethically. Join us as we chat with the Vice President of Engineering at MetaRouter, a cutting-edge platform enabling enterprises to regain control over their customer data. We explore how MetaRouter empowers businesses to manage data in a 1st-party context, ensuring ethical, compliant handling while navigating the complexities of privacy regulations.
 
Sponsors
Intrepid AI (https://intrepid.ai) is an AI assisted all-in-one platform for robotics teams. Build robotics applications in minutes, not months
 
References
https://www.metarouter.io/post/mastering-data-governance-why-governance-at-the-point-of-collection-is-a-must-have 
https://hubs.ly/Q02HwJly0 
https://www.metarouter.io/post/why-privacy-sandbox-is-a-good-paradigm-shift-for-consumers 

Low-Code Magic: Can It Transform Analytics? (Ep. 260)

Join us as David Marom, Head of Panoply Business, explores the benefits of all-in-one data platforms. Learn how tech stack consolidation boosts efficiency, improves data accuracy, and cuts costs. David shares insights on overcoming common challenges, enhancing data governance, and success stories from organizations thriving with Panoply.
 
Sponsors
Arctic Wolf Learn what the new year holds for ransomware as a service, Active Directory, artificial intelligence and more when you download the 2024 Arctic Wolf Labs Predictions Report today at arcticwolf.com/datascience
Intrepid AI (https://intrepid.ai) is an AI assisted all-in-one platform for robotics teams. Build robotics applications in minutes, not months
 
References
Connect and analyze ALL of your data https://panoply.io/
https://blog.panoply.io/raw-data-to-dashboards-in-just-10-steps
https://blog.panoply.io/understanding-etl-extract-transform-and-load-data-to-boost-your-business-intelligence
Blog: The Transformative Power of an All-in-One Data Platform
Whitepaper: Eradicating Platform Inefficiencies

Do you really know how GPUs work? (Ep. 259)

Join us in this exciting episode of the Data Science at Home podcast. It's all about GPUs. We'll take you on a journey through the inner workings of these powerful processors, explaining how they handle complex computations and drive everything from gaming graphics to scientific simulations. Whether you're a budding programmer or a tech enthusiast, understanding GPUs is key to unlocking new levels of performance and efficiency in your projects. Tune in and get ready to turbocharge your tech knowledge!
 
Sponsors
Intrepid AI (https://intrepid.ai) is an AI assisted all-in-one platform for robotics teams. Build robotics applications in minutes, not months.