CA bills scraper failing during local run


#1

I am trying to run the CA bills scraper locally using docker-compose.

Command -

docker-compose run --rm scrape ca bills --scrape

I get the following error :-
File "/opt/openstates/venv-pupa/lib/python3.6/site-packages/MySQLdb/connections.py", line 164, in __init__ super(Connection, self).__init__(*args, **kwargs2) sqlalchemy.exc.OperationalError: (MySQLdb._exceptions.OperationalError) (2005, "Unknown MySQL server host 'mysql' (-2)") (Background on this error at: http://sqlalche.me/e/e3q8)

Am I doing something wrong ? Should this crawl be run in a specific way ?
All other crawls I tried running are working as intended.


#2

The CA scraper requires a bit of extra work, note the ca-download & mysql docker-compose entries.

Are you trying to run the scraper to contribute to an particular issue?


#3

I am trying to assess ways - (API, crawler) I could leverage the bills data for all jurisdictions. Just in case I go down the crawler route, I plan to contribute in fixing issues - missing actions, dates, etc.


#4

The California scraper is maybe the most unusual scraper - the last one I’d pick as a starting point for getting up to speed on all of them.

See the California readme for special instructions.