Skip to content

Commit

Permalink
[docs] add info about new release
Browse files Browse the repository at this point in the history
  • Loading branch information
pawelmhm committed Mar 4, 2021
1 parent 9d48c83 commit 5483b64
Showing 1 changed file with 22 additions and 0 deletions.
22 changes: 22 additions & 0 deletions docs/source/api.rst
Original file line number Diff line number Diff line change
Expand Up @@ -130,6 +130,16 @@ start_requests
behavior. If this argument is present API will execute start_requests
Spider method.

crawl_args
- type: urlencoded JSON string
- optional

Optional arguments for spider. This is same as you use when running
spider from command line with -a argument, for example if you run
spider like this: "scrapy crawl spider -a zipcode=14100" you can
send crawl_args={"zipcode":"14100"} (urlencoded: crawl_args=%7B%22zipcode%22%3A%2014100%7D)
and spider will get zipcode argument.

If required parameters are missing api will return 400 Bad Request
with hopefully helpful error message.

Expand Down Expand Up @@ -558,6 +568,18 @@ But if you still want to save all stdout to some file - you can create custom
approach described in `Python Logging HOWTO`_ or redirect stdout to a file using
`bash redirection syntax`_, `supervisord logging`_ etc.

Releases
========
ScrapyRT 0.12 (2021-03-08)
--------------------------
- added crawl arguments for API
- removed Python 2 support
- added Python 3.9 support
- docs clean up
- removed superfluous requirements (demjson, six)
- fixed API crash when spider returns bytes in items output
- updated unit tests
- development improvements, moved from Travis to Github Workflows

.. _toscrape-css spider: https://github.com/scrapy/quotesbot/blob/master/quotesbot/spiders/toscrape-css.py
.. _Scrapy educational quotesbot project: https://github.com/scrapy/quotesbot
Expand Down

0 comments on commit 5483b64

Please sign in to comment.