zlacker

[parent] [thread] 1 comments
1. bobaje+(OP)[view] [source] 2026-02-03 18:19:28
I like the idea of a DSL for scraping but my scrapers do more than extract text. I also download files (+monitor download progress) and intercept images (+ check for partial or failed to load images). So it seems my use case isn't really covered with this.
replies(1): >>zachpe+J7
2. zachpe+J7[view] [source] 2026-02-03 18:46:48
>>bobaje+(OP)
Thanks for the idea actually! It's difficult to cover every use case in the 0.1.0 release. I'll take this into account. Downloading Files/Images could likely be abstracted into just an HTTP source and the data sources could be merged in some way.
[go to top]