cac414dafda0706c8e0079bf83b79b3fad3ffa03
Reorder processProducts() to create snapshots BEFORE attempting image downloads. Previously, if image downloads hung or failed, the process would be killed before snapshots were created, resulting in 0 snapshots despite successful product upserts. Changes: - Move Step 3 (snapshot creation) before Step 4 (image downloads) - Ensures core crawl data (products + snapshots) is persisted even if images fail - Adds chunked batch processing for improved memory management Tested locally: 771 snapshots created for dispensary 112 with quantity data populated. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
Description
CannaiQ Scraper
Languages
TypeScript
54.5%
JavaScript
37.5%
PLpgSQL
3.6%
PHP
3.1%
Python
0.5%
Other
0.7%