Increase navigation timeout to 90s for parallel browser crawling
Dutchie pages can take 30-40s to load, and when running 3 parallel browsers they compete for resources, causing some to hit the 60s timeout. Increased to 90s to accommodate slow-loading React SPAs. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
@@ -379,9 +379,10 @@ export class Downloader {
|
||||
}
|
||||
|
||||
// Navigate to page - use networkidle2 for SPAs like Dutchie
|
||||
// Increased timeout to 90s - Dutchie pages can take 30-40s to fully load
|
||||
const navigationPromise = page.goto(request.url, {
|
||||
waitUntil: 'networkidle2',
|
||||
timeout: 60000
|
||||
timeout: 90000
|
||||
});
|
||||
|
||||
const response = await navigationPromise;
|
||||
|
||||
Reference in New Issue
Block a user