Artificial Intelligence

AI Says It Can Compress Better Than FLAC?! Hold My Entropy 🍿 (Ep. 268)

Can AI really out-compress PNG and FLAC? 🤔 Or is it just another overhyped tech myth? In this episode of Data Science at Home, Frag dives deep into the wild claims that Large Language Models (LLMs) like Chinchilla 70B are beating traditional lossless compression algorithms. 🧠💥
But before you toss out your FLAC collection, let's break down Shannon's Source Coding Theorem and why entropy sets the ultimate limit on lossless compression.
We explore: ⚙️ How LLMs leverage probabilistic patterns for compression 📉 Why compression efficiency doesn’t equal general intelligence 🚀 The practical (and ridiculous) challenges of using AI for compression 💡 Can AI actually BREAK Shannon’s limit—or is it just an illusion?
If you love AI, algorithms, or just enjoy some good old myth-busting, this one’s for you. Don't forget to hit subscribe for more no-nonsense takes on AI, and join the conversation on Discord!
Let’s decode the truth together. Join the discussion on the new Discord channel of the podcast https://discord.gg/4UNKGf3
 
Don't forget to subscribe to our new YouTube channel 
https://www.youtube.com/@DataScienceatHome
 
 
References
Have you met Shannon? https://datascienceathome.com/have-you-met-shannon-conversation-with-jimmy-soni-and-rob-goodman-about-one-of-the-greatest-minds-in-history/
 
 

What Big Tech Isn’t Telling You About AI (Ep. 267)

Are AI giants really building trustworthy systems? A groundbreaking transparency report by Stanford, MIT, and Princeton says no. In this episode, we expose the shocking lack of transparency in AI development and how it impacts bias, safety, and trust in the technology. We’ll break down Gary Marcus’s demands for more openness and what consumers should know about the AI products shaping their lives.
 
Check our new YouTube channel https://www.youtube.com/@DataScienceatHome and Subscribe! 
 
Cool links
https://mitpress.mit.edu/9780262551069/taming-silicon-valley/
http://garymarcus.com/index.html

Money, Cryptocurrencies, and AI: Exploring the Future of Finance with Chris Skinner [RB] (Ep. 266)

We're revisiting one of our most popular episodes from last year, where renowned financial expert Chris Skinner explores the future of money. In this fascinating discussion, Skinner dives deep into cryptocurrencies, digital currencies, AI, and even the metaverse. He touches on government regulations, the role of tech in finance, and what these innovations mean for humanity.
Now, one year later, we encourage you to listen again and reflect—how much has changed? Are Chris Skinner's predictions still holding up, or has the financial landscape evolved in unexpected ways? Tune in and find out!

Kaggle Kommando’s Data Disco: Laughing our Way Through AI Trends (Ep. 265) [RB]

In this episode, join me and the Kaggle Grand Master, Konrad Banachewicz, for a hilarious journey into the zany world of data science trends. From algorithm acrobatics to AI, creativity, Hollywood movies, and music, we just can't get enough. It's the typical episode with a dose of nerdy comedy you didn't know you needed. Buckle up, it's a data disco, and we're breaking down the binary!
 
Sponsors
Intrepid AI is an AI assisted all-in-one platform for robotics teams. Build robotics applications in minutes, not months.
Learn what the new year holds for ransomware as a service, Active Directory, artificial intelligence and more when you download the 2024 Arctic Wolf Labs Predictions Report today at arcticwolf.com/datascience
 
🔗 Links Mentioned in the Episode:
Generative AI for time series: TimeGPT Documentation
Lag-llama: GitHub (Note: The benchmark results on this one are pretty horrible)
Open source LLM: Olmo Blog Post
Quantization for LLM: Hugging Face Guide
And finally, don't miss Konrad's Substack for more nerdy goodness! (If you're there already, be there again! 😄)

AI and Video Game Development: Navigating the Future Frontier (Ep. 264) [RB]

In this episode we delve into the dynamic realm of game development and the transformative role of artificial intelligence (AI). Join Frag, Jim and Mike as they explore the current landscape of game development processes, from initial creative ideation to the integration of AI-driven solutions. With Mike's expertise as a software executive and avid game developer, we uncover the potential of AI to revolutionize game design, streamline development cycles, and enhance player experiences. Discover insights into AI's applications in asset creation, code assistance, and even gameplay itself, as we discuss real-world implementations and cutting-edge research.
From the innovative GameGPT framework to the challenges of balancing automation with human creativity, this episode offers valuable perspectives and practical advice for developers looking to harness the power of AI in their game projects. Don't miss out on this insightful exploration at the intersection of technology and entertainment!
 
Sponsors
Intrepid AI (https://intrepid.ai) is an AI assisted all-in-one platform for robotics teams. Build robotics applications in minutes, not months.
 
References
https://mikeyoung44.itch.io/spacefreighter - Itch.io link to play the game
https://discord.gg/yaXgYZ5Ymn - Discord server for the game
https://aimodels.substack.com/ - Mike’s newsletter (links to website too)
 
 

LLMs: Totally Not Making Stuff Up (they promise) (Ep. 263)

In this episode, we dive into the wild world of Large Language Models (LLMs) and their knack for… making things up. Can they really generalize without throwing in some fictional facts? Or is hallucination just part of their charm? Let’s separate the genius from the guesswork in this insightful breakdown of AI’s creativity problem.
TL;DR;
LLM Generalisation without hallucinations. Is that possible?
 
References
https://github.com/lamini-ai/Lamini-Memory-Tuning/blob/main/research-paper.pdf
https://www.lamini.ai/blog/lamini-memory-tuning
 
 

AI: The Bubble That Might Pop—What’s Next? (Ep. 262)

The hype around Generative AI is real, but is the bubble about to burst? Join me as we dissect the recent downturn in AI investments and what it means for the tech giants like OpenAI and Nvidia. Could this be the end of the AI gold rush, or just a bump in the road?
 
References
http://garymarcus.com/index.html
https://garymarcus.substack.com/p/why-the-collapse-of-the-generative?r=8tdk6&utm_source=substack&utm_medium=email
https://www.theinformation.com/articles/openai-makes-a-60-million-hardware-startup-bet?utm_source=substack&utm_medium=email
 
 

Do you really know how GPUs work? (Ep. 259)

Join us in this exciting episode of the Data Science at Home podcast. It's all about GPUs. We'll take you on a journey through the inner workings of these powerful processors, explaining how they handle complex computations and drive everything from gaming graphics to scientific simulations. Whether you're a budding programmer or a tech enthusiast, understanding GPUs is key to unlocking new levels of performance and efficiency in your projects. Tune in and get ready to turbocharge your tech knowledge!
 
Sponsors
Intrepid AI (https://intrepid.ai) is an AI assisted all-in-one platform for robotics teams. Build robotics applications in minutes, not months.

Harnessing AI for Cybersecurity: Expert Tips from QFunction (Ep. 258)

In this episode, we sit down with Ryan Smith, Founder of QFunction LLC, to explore how AI and machine learning are revolutionizing cybersecurity. With over 8 years of experience, including work at NASA's Jet Propulsion Laboratory, Ryan shares insights on the future of threat detection and prevention, the challenges businesses face in maintaining effective cybersecurity, and the ethical considerations of AI implementation. Learn about cost-effective strategies for small businesses, the importance of collaboration in combating cyber threats, and how QFunction tailors its AI solutions to meet diverse industry needs.
 
Sponsors
Arctic Wolf Learn what the new year holds for ransomware as a service, Active Directory, artificial intelligence and more when you download the 2024 Arctic Wolf Labs Predictions Report today at arcticwolf.com/datascience
Intrepid AI (https://intrepid.ai) is an AI assisted all-in-one platform for robotics teams. Build robotics applications in minutes, not months.
QFunction  does cybersecurity differently. By relying on scientific breakthroughs in AI and machine learning, QFunction works within your existing security stack to detect anomalies and threats within your data
 
References
QFunction Blog
Threat Hunting Firewall Logs
Threat Hunting Linux Logs
QFunction GitHub

AI and Video Game Development: Navigating the Future Frontier (Ep. 253)

In this episode we delve into the dynamic realm of game development and the transformative role of artificial intelligence (AI). Join Frag, Jim and Mike as they explore the current landscape of game development processes, from initial creative ideation to the integration of AI-driven solutions. With Mike's expertise as a software executive and avid game developer, we uncover the potential of AI to revolutionize game design, streamline development cycles, and enhance player experiences. Discover insights into AI's applications in asset creation, code assistance, and even gameplay itself, as we discuss real-world implementations and cutting-edge research. From the innovative GameGPT framework to the challenges of balancing automation with human creativity, this episode offers valuable perspectives and practical advice for developers looking to harness the power of AI in their game projects. Don't miss out on this insightful exploration at the intersection of technology and entertainment!
 
Sponsors
Intrepid AI (https://intrepid.ai) is an AI assisted all-in-one platform for robotics teams. Build robotics applications in minutes, not months.
 
References
https://mikeyoung44.itch.io/spacefreighter - Itch.io link to play the game
https://discord.gg/yaXgYZ5Ymn - Discord server for the game
https://aimodels.substack.com/ - Mike’s newsletter (links to website too)