.png?width=100&height=115&name=Big%20Data%20Expo%20Vorm%20F%20(1).png)
.png?width=100&height=115&name=Big%20Data%20Expo%20Vorm%20E%20(1).png)
The World of Web Crawling — And AI’s Groundbreaking Impact
Wednesday 14:15 - 14:45
Lezingenzaal 6
Jorn Wierda
Strategic Account Executive
This talk explores the often-overlooked world of web crawling, how it powers everything from search engines like Google and Bing to AI models like ChatGPT and Claude. We'll look at the scale and complexity of crawling the web, the types of organizations leveraging this data, and several real-world use cases. Since the rise of AI, there's been a global race to collect high-quality data for training large language models. But with the help of an MCP, even companies with structured data can benefit from AI. By going beyond training data, AI systems can now incorporate new information, interact with external systems, and draw insights from existing data.
This talk explores the often-overlooked world of web crawling, how it powers everything from search engines like Google and Bing to AI models like ChatGPT and Claude. We'll look at the scale and complexity of crawling the web, the types of organizations leveraging this data, and several real-world use cases. Since the rise of AI, there's been a global race to collect high-quality data for training large language models. But with the help of an MCP, even companies with structured data can benefit from AI. By going beyond training data, AI systems can now incorporate new information, interact with external systems, and draw insights from existing data.
Back to overview
Visit Data Expo
Interested in this lecture?
Register now for free for Data Expo and experience two days full of inspiration, practical insights, and innovative data applications. Discover what data can do for your organization!
We believe data drives digital transformation
Unlocking the Power of Retrieval-Augmented Generation (RAG)
Digital Transformation for SMEs: 8 Benefits and Challenges
Subscribe for the newsletter
To top