Overview
Instead of relying on APIs or brittle scripts, Twin’s embedded Web Agent behaves like a human operator: it opens websites, navigates interfaces, makes decisions, and extracts information as it goes. You explain the objective in plain language, and the agent figures out how to complete it by interacting with the web directly.When to Use the Web Agent
Research Tasks
When you don’t know in advance which page contains the information.E.g. “Find the CEO’s email on this company’s website. Check the About, Team, or Contact sections.”
Dynamic Websites
Websites that change frequently (e.g. LinkedIn, news sites)
Decision-Based Workflows
Exploratory workflows that require decision-making.E.g. “Search for product reviews and summarize the top 5 complaints.”
How the Web Agent Works
Describe the objective
You start by explaining the task in natural language.Example instruction:You don’t need to specify every click — the agent handles navigation and decision-making.
“Go to the company website, find the team or about page, and extract the CEO’s name and email if available.”
Autonomous execution
Once started, the Web Agent:
- Interprets your instructions
- Opens the relevant pages
- Clicks through links and buttons
- Adapts to page structure and content
- Extracts the requested data
Structured results
Results can be returned in a format that fits your workflow:
- Plain text
- Structured data (JSON)
- Formatted summaries (Markdown)
Live Execution View
You can observe the Web Agent as it runs through a live browser view.Monitor Progress
Watch the agent work in real time
Understand Navigation
See how the agent navigates through sites
Validate Results
Confirm the agent found the right data
Debug Issues
Identify and fix unexpected behavior
FAQ
When should I choose the Web Agent instead of other extraction methods?
When should I choose the Web Agent instead of other extraction methods?
Use the Web Agent when:
- The steps aren’t fully predictable
- The site relies heavily on client-side rendering
- Authentication is required
Can I see what the agent is doing?
Can I see what the agent is doing?
Yes. A live browser session shows the agent’s actions step by step, making the process transparent.
What types of sites can it handle?
What types of sites can it handle?
The Web Agent works with most modern websites, including dynamic and authenticated ones. Performance depends on site complexity and access constraints.
Is it safe to use on private or logged-in pages?
Is it safe to use on private or logged-in pages?
Yes. The Web Agent operates within a secure execution environment. Credentials are handled securely and are not shared outside your workspace.
Try the Web Agent
Start automating browser-based workflows