# scrapy-examples

**Repository Path**: liumengjun/scrapy-examples

## Basic Information

- **Project Name**: scrapy-examples
- **Description**: hello scrapy and more examples
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2019-05-29
- **Last Updated**: 2023-03-16

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

## Scrapy Example

See more at [doc.scrapy.org](https://doc.scrapy.org/).

> 笔记: [谈爬虫&scrapy框架](note_on_crawler_spider.md)

### run spider:
- scrapy runspider quotes_spider.py
- scrapy runspider quotes_spider.py -o quotes.jl

***interactive model:***
- scrapy shell 'http://quotes.toscrape.com/page/1/'

### startproject:
- scrapy startproject tutorial

***run spider in project:***
- scrapy crawl quotes
- scrapy crawl quotes -o quotes.jl
- scrapy crawl quotes -o quotes-humor.jl -a tag=humor


### Projects
- ``tutorial`` Demo [@doc.scrapy.org](https://doc.scrapy.org/en/latest/intro/tutorial.html)
- ``webpicker`` Scrapy one whole web site and certain html tags, may with authentication. (爬一个网站，抓取特定的html标签，支持用户登录)