scrapy-kit

A library for scrapy tools, including but not limited to the usual pipelines, middlewares, etc.

install

pip install scrapy-kit

usage

pipelines

ITEM_PIPELINES = {
    "spider_kit.pipelines.mongo.MongoPipeline": 369,
}

development

git clone
cd scrapy-kit
poetry install