Podcast
Root Causes 530: Introducing the AI Iceberg


Hosted by
Tim Callan
Chief Compliance Officer
Jason Soroko
Fellow
Original broadcast date
September 29, 2025
We compare AI in 2025 to Internet in 1995 and describe the AI iceberg, including the majority of applications which are below the waterline.
Podcast Transcript
Lightly edited for flow and brevity.
That made me think about, let's go back in time to 1995. So it's 1995. The World Wide Web, all of a sudden moves into the public consciousness and takes the world by storm. And yes, internet and even World Wide Web had been growing for a while, but suddenly Netscape goes public, and common browsers are commonly available, and there's an IP stack in Windows, and just all of a sudden, everybody's using this thing. And I remember at the time, there was this idea of “internet technology” or “internet products”. What I think a lot of people didn't grasp was it's not internet technology or internet products. It's just technology. It's just products. That internet is just part of the fabric of things. The same way that we don't say, hey, this is a nice earth couch I'm sitting on. It is just a couch because, of course, it's an earth couch to the point where earth doesn't need to be said. Hey, Jason, this is a good earth podcast. I like your earth microphone there. Now just take the word earth out. It's all earth. The same was true of internet. And it took a lot of people a long time to get that. Now we do.
We're going to be talking about AI topics on this podcast because it's just, how can you not?
One of the things about how a lot of people are thinking about AI right now and again, this is the same as it was in 1995 with internet, is there's what I call the AI iceberg. So there's this little bit that sticks up above the water that we all know, which is, I go to ChatGPT, and I ask it to give me a picture of a fluffy kitty, and I get a fluffy kitty.
But the stuff that's below the surface is the vast majority of it. I talk to people who aren't really in the tech space, friends of mine, and I say, oh no - - they say, oh, I've never used AI. I say, well, sure you have. Have you searched on a major search engine? Sure. Well, those results are informed by AI. Do you use any kind of digital process? Do you use social media? Well, that's informed by AI? And so most of how AI is going to serve us is not going to be in I'm sitting at a prompt and asking for a thing and getting a result. Most of the way that AI is going to serve us is that a service that we use will be augmented. It'll be faster or more accurate, or superior or better anticipating my needs, or have new capabilities that wouldn't have been possible otherwise and how it's augmented is implementations of AI technology, and that's the part of the iceberg that's below the surface. And that's the majority of it. And that's the most powerful part of it. So that's the AI iceberg, and I think most people don't think about it that way.
Interestingly. Which is not a bad thing, because it means that we all get to use it, and don't have to think about it much at all. It's below the water. Like we don't think about it so much now, the only thing we panic is when we lose connectivity, Wi-Fi, things that connect us to that TCP stack without us thinking about it.
It will happen in ways that unless you're even a developer, you might not realize what's going on underneath the scenes. A lot of what had to be coded procedurally in the past, things where a lot of difficult edge cases in code have to procedurally be coded can be quite costly to code. Those are the ideal use cases where you collapse that code into one AI call and AI makes the edge case decision that feeds back as a function into your software.
A lot of people won't realize that that's happening at all, but it is a place where AI is right now rampant in all new code bases. But Tim, you said something interesting, which is, the top of the pyramid. At top of the iceberg is small. You and I were talking about this last night, I'd like to make the argument that the top of the iceberg is, in fact, going to become really microscopically small for the majority of people, but there's a gigantic however. For those people who want to dive deep into what AI can actually do, the top of the iceberg is actually way larger than most people realize. Here's my argument for that.
Most people are completely unaware of the concept of an embedding model. Like in other words, most of us understand the GPT that we use, the generative transform system that responds back to us in a chat bot. However, there are entire models that I play with that have to do with chunking information into generative systems to be able to train and fine tune LLMs of my own. Both small language models, offline models that I used for very specific purposes for me, and these things have become incredibly powerful. And they're incredibly powerful because there's an entire set of tools that people who are aware of how to use them can make AI sing and dance and do things that none of us could have even imagined not that long ago. So there's an entire class of technology above the water line that I think, Tim, is worth talking about. And in fact, we probably should have some more episodes about this down the road, because it will literally define the haves and the have nots in the future. That's what I believe. It just means that there's a set of tools out there that I think people who are listeners to this podcast should be aware of. It's too easy to become a technical geriatric right now.
I don't mind that my mom only thinks about ChatGPT as that GPT box.
I think that most humans, that's how they're going to - most earth humans, I should say - that's how they're going to benefit from earth AI. What you're talking about, I think, is a relatively small subset of people with the skill set and the predilection to put their hands directly on the levers.
I think with AI, there's the difference. I think there's always going to be a significant amount of stuff above the waterline that I think that people who are listening to this podcast should consider themselves. This is applicable to you. In fact, Tim, we talked about some of the use cases last night. Something as absolutely basic as, how do you connect via an API to an AI system in order to be able to have it generate something differently in a different way. And it could be something as simple as, hey, I want to get the absolute best thumbnails for my YouTube podcast from a model that I can't just get from the chat box. That's like kindergarten level one.
In other words, all of a sudden, and I think I said this to you last night, you can actually start to ask AI, hey, now that I have this environment available to me, and I have a template script, a little bit of Python, whatever it happens to be, all of a sudden, now you have the environment and some of the basic know-how to start asking, AI, hey, I want to do some other things. Write the code for me.
So that's when you realize, wow, this no longer has limits. And I think part of what we were just saying is that the sum total of potential for the future have never been bigger than right now.

