Right way to set headers in scrapelib


#1

In MO, we needed to add a header to all the scrapelib / lxmlmixin requests, because the state started requiring a user agent. I hacked one in here; but that code feels kinda weird.

Is there a better way to do that, or is that ok?

@james


#2

I do think that’s the best way for now if it needs to be in every request.


#3

Cool thanks. I’ll merge that code later, once i add some documentation.