Deep Learning

In this episode of Data Science at Home, host Francesco Gadaleta dives deep into the evolving world of AI-generated content detection with experts Souradip Chakraborty, Ph.D. grad student at the University of Maryland, and Amrit Singh Bedi, CS faculty at the University of Central Florida. 
Together, they explore the growing importance of distinguishing human-written from AI-generated text, discussing real-world examples from social media to news. How reliable are current detection tools like DetectGPT? What are the ethical and technical challenges ahead as AI continues to advance? And is the balance between innovation and regulation tipping in the right direction? 
 
Tune in for insights on the future of AI text detection and the broader implications for media, academia, and policy.
 
Chapters 
 
00:00 - Intro 
00:23 - Guests: Souradip Chakraborty and Amrit Singh Bedi 
01:25 - Distinguish Text Generation By AI 
04:33 - Research on Safety and Alignment of Generative Model 
06:01 - Tools to Detect Generated AI Text  
11:28 - Water Marking
18:27 - Challenges in Detecting Large Documents Generated by AI 
23:34 - Number of Tokens 
26:22 - Adversarial Attack
29:01 - True Positive and False Positive of Detectors 
31:01 - Limit of Technologies 
41:01 - Future of AI Detection Techniques 
46:04 - Closing Thought
 
Subscribe to our new YouTube channel https://www.youtube.com/@DataScienceatHome
 

Can AI really out-compress PNG and FLAC? 🤔 Or is it just another overhyped tech myth? In this episode of Data Science at Home, Frag dives deep into the wild claims that Large Language Models (LLMs) like Chinchilla 70B are beating traditional lossless compression algorithms. 🧠💥
But before you toss out your FLAC collection, let's break down Shannon's Source Coding Theorem and why entropy sets the ultimate limit on lossless compression.
We explore: ⚙️ How LLMs leverage probabilistic patterns for compression 📉 Why compression efficiency doesn’t equal general intelligence 🚀 The practical (and ridiculous) challenges of using AI for compression 💡 Can AI actually BREAK Shannon’s limit—or is it just an illusion?
If you love AI, algorithms, or just enjoy some good old myth-busting, this one’s for you. Don't forget to hit subscribe for more no-nonsense takes on AI, and join the conversation on Discord!
Let’s decode the truth together. Join the discussion on the new Discord channel of the podcast https://discord.gg/4UNKGf3
 
Don't forget to subscribe to our new YouTube channel 
https://www.youtube.com/@DataScienceatHome
 
 
References
Have you met Shannon? https://datascienceathome.com/have-you-met-shannon-conversation-with-jimmy-soni-and-rob-goodman-about-one-of-the-greatest-minds-in-history/
 
 

Are AI giants really building trustworthy systems? A groundbreaking transparency report by Stanford, MIT, and Princeton says no. In this episode, we expose the shocking lack of transparency in AI development and how it impacts bias, safety, and trust in the technology. We’ll break down Gary Marcus’s demands for more openness and what consumers should know about the AI products shaping their lives.
 
Check our new YouTube channel https://www.youtube.com/@DataScienceatHome and Subscribe! 
 
Cool links
https://mitpress.mit.edu/9780262551069/taming-silicon-valley/
http://garymarcus.com/index.html

In this episode, join me and the Kaggle Grand Master, Konrad Banachewicz, for a hilarious journey into the zany world of data science trends. From algorithm acrobatics to AI, creativity, Hollywood movies, and music, we just can't get enough. It's the typical episode with a dose of nerdy comedy you didn't know you needed. Buckle up, it's a data disco, and we're breaking down the binary!
 
Sponsors
Intrepid AI is an AI assisted all-in-one platform for robotics teams. Build robotics applications in minutes, not months.
Learn what the new year holds for ransomware as a service, Active Directory, artificial intelligence and more when you download the 2024 Arctic Wolf Labs Predictions Report today at arcticwolf.com/datascience
 
🔗 Links Mentioned in the Episode:
Generative AI for time series: TimeGPT Documentation
Lag-llama: GitHub (Note: The benchmark results on this one are pretty horrible)
Open source LLM: Olmo Blog Post
Quantization for LLM: Hugging Face Guide
And finally, don't miss Konrad's Substack for more nerdy goodness! (If you're there already, be there again! 😄)

!!WARNING!!
Due to some technical issues the volume is not always constant during the show. I sincerely apologise for any inconvenienceFrancesco
 
 
In this episode, I speak with Richie Cotton, Data Evangelist at DataCamp, as he delves into the dynamic intersection of AI and education. Richie, a seasoned expert in data science and the host of the podcast, brings together a wealth of knowledge and experience to explore the evolving landscape of AI careers, the skills essential for generative AI technologies, and the symbiosis of domain expertise and technical skills in the industry.
 
References
Become a generative AI developer in this FREE code-along series. Learn to build a chatbot using the OpenAI API, the Pinecone API, and LangChain, and learn to build NLP and image applications with Hugging Face. https://www.datacamp.com/ai-code-alongs
Learn to use ChatGPT and the OpenAI API in the OpenAI Fundamentals skill track. https://www.datacamp.com/tracks/openai-fundamentals
Get started with deep learning using PyTorch in the Introduction to Deep Learning with PyTorch course. https://www.datacamp.com/courses/introduction-to-deep-learning-with-pytorch
 
 

In this thought-provoking episode, we sit down with the renowned AI expert, Filip Piekniewski, Phd, who fearlessly challenges the prevailing narratives surrounding artificial general intelligence (AGI) and the singularity. With a no-nonsense approach and a deep understanding of the field, Filip dismantles the hype and exposes some of the misconceptions about AI, LLMs and AGI. Join us as we delve into the real-world implications of AI, separating fact from fiction, and gaining a firm grasp on the tangible possibilities of AI advancement. If you're seeking a refreshingly pragmatic perspective on the future of AI, this episode is an absolute must-listen.
 
Filip Piekniewski Bio
Filip Piekniewski is a distinguished computer vision researcher and engineer, specializing in visual object tracking and perception. He approaches machine learning with a pragmatic mindset, recognizing its current limitations. Filip earned his Ph.D. from Warsaw University, where he explored neuroscience and later joined Brain Corporation in San Diego. His extensive study of neuroscience inspired him to develop innovative, bio-inspired machine learning architectures. Filip's unique blend of scientific curiosity and software engineering expertise allows him to quickly prototype and implement new ideas. He is known for his realistic perspective on AI, debunking AGI hype and focusing on tangible advancements.
 
Sponsors
Finally, a better way to do B2B research. NewtonX The World’s Leading B2B Market Research Company
Explore the Complex World of Regulations. Compliance can be overwhelming. Multiple frameworks. Overlapping requirements. Let Arctic Wolf be your guide.Check it out at https://arcticwolf.com/datascience
Amethix works to create and maximize the impact of the world’s leading corporations and startups, so they can create a better future for everyone they serve. We provide solutions in AI/ML, Fintech, Defense, Robotics and Predictive maintenance.
 
References
https://twitter.com/filippie509
http://blog.piekniewski.info/ (On limits of deep learning and where to go next with AI.)
 
 

Dive into the cool world of AI chips with us! 🚀 We're breaking down how these special computer chips for AI have evolved and what makes them different. Think of them like the superheroes of the tech world!
Don't miss out! 🎙️🔍 #AIChips #TechTalk #SimpleScience

Join me on an enlightening journey through the world of prompt engineering. Explore the multifaceted skills and strategies involved in harnessing the potential of large language models for various applications. From enhancing safety measures to augmenting models with domain knowledge, learn how prompt engineering is shaping the future of AI.
 
References
https://arxiv.org/pdf/2109.01652.pdf
https://arxiv.org/abs/2201.11903
https://arxiv.org/abs/2302.00923
https://www.mihaileric.com/posts/a-complete-introduction-to-prompt-engineering
https://www.axios.com/2023/02/22/chatgpt-prompt-engineers-ai-job

Let's delve into the emerging trend in database design – or is it really a new trend? The realm of vector databases and their revolutionary influence on AI and ML is making headlines. Come along as we investigate how these groundbreaking databases are revolutionizing the landscape of data storage, retrieval, and processing, ultimately unlocking the complete potential of artificial intelligence and machine learning. But are they genuinely as innovative as they seem?
 
References
https://partee.io/2022/08/11/vector-embeddings/
https://blog.det.life/why-you-shouldnt-invest-in-vector-databases-c0cd3f59d23c
https://medium.com/@ryanntk/choosing-the-right-embedding-model-a-guide-for-llm-applications-7a60180d28e3
 
 

In this thought-provoking episode, we sit down with the renowned AI expert, Filip Piekniewski, Phd, who fearlessly challenges the prevailing narratives surrounding artificial general intelligence (AGI) and the singularity. With a no-nonsense approach and a deep understanding of the field, Filip dismantles the hype and exposes some of the misconceptions about AI, LLMs and AGI. Join us as we delve into the real-world implications of AI, separating fact from fiction, and gaining a firm grasp on the tangible possibilities of AI advancement. If you're seeking a refreshingly pragmatic perspective on the future of AI, this episode is an absolute must-listen.
 
Filip Piekniewski Bio
Filip Piekniewski is a distinguished computer vision researcher and engineer, specializing in visual object tracking and perception. He approaches machine learning with a pragmatic mindset, recognizing its current limitations. Filip earned his Ph.D. from Warsaw University, where he explored neuroscience and later joined Brain Corporation in San Diego. His extensive study of neuroscience inspired him to develop innovative, bio-inspired machine learning architectures. Filip's unique blend of scientific curiosity and software engineering expertise allows him to quickly prototype and implement new ideas. He is known for his realistic perspective on AI, debunking AGI hype and focusing on tangible advancements.
 
Sponsors
Finally, a better way to do B2B research. NewtonX The World’s Leading B2B Market Research Company
Explore the Complex World of Regulations. Compliance can be overwhelming. Multiple frameworks. Overlapping requirements. Let Arctic Wolf be your guide.Check it out at https://arcticwolf.com/datascience
Amethix works to create and maximize the impact of the world’s leading corporations and startups, so they can create a better future for everyone they serve. We provide solutions in AI/ML, Fintech, Defense, Robotics and Predictive maintenance.
 
References
https://twitter.com/filippie509
http://blog.piekniewski.info/ (On limits of deep learning and where to go next with AI.)