Back to projects
Project
TheAgentic Browser
Open-source multi-agent system for fully automated web navigation and data scraping.
PydanticAILLM OrchestrationDOM ManipulationPython
Overview
TheAgentic Browser is an open-source multi-agent web automation system that enables fully autonomous web navigation, interaction, and data extraction. It replaces brittle scripted scrapers with intelligent agents that understand page context and adapt in real time.
My Role
Architected the core agent framework and LLM orchestration layer. Built context engineering pipelines that feed structured DOM representations to language models, enabling agents to reason about page state and take actions.
Approach
- Designed a multi-agent architecture using PydanticAI for agent coordination and lifecycle management.
- Built a DOM manipulation layer that converts raw HTML into structured, LLM-friendly representations.
- Implemented context engineering pipelines to maintain agent state across multi-step navigation flows.
- Integrated LLM orchestration for real-time decision making — agents choose actions based on page content and task objectives.
- Developed a robust error recovery system so agents can handle unexpected page states gracefully.
Outcome
Shipped as an open-source project. Used internally across multiple client engagements for automated data collection at scale.