A few states let us filter by update date, and i’m in the process of adding a window argument to a few scrapers, so that if you only want bills from the past (X) hours or days you can just scrape the updated bills. This is primarily useful in states like NY that have thousands of bills and take hours to scrape fully.
My question – What should the format look like? The scrapers-us folks use window= but only allow integer days. I’d like to do d/h/m, but thought i’d get feedback.
How about -
pupa update ny bills window=1d
pupa update ny bills window=12h
pupa update ny bills window=30m
Any objections ? @james