# Python-web-scraping

**Repository Path**: ma-yongfan/Python-web-scraping

## Basic Information

- **Project Name**: Python-web-scraping
- **Description**: python爬虫，包含大小项目
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 1
- **Forks**: 0
- **Created**: 2021-11-29
- **Last Updated**: 2024-09-04

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

**python爬虫实战日记**</br>
</br>
本仓库记录零基础学习python爬虫，所有探索与尝试</br>
- [仓库地址](https://github.com/LUCY78765580/Python-web-scraping)</br>
- 相应博客地址：[简书](https://www.jianshu.com/u/e90f938c6279) 
</br>

**一、入门篇**</br>
- [糗事百科](https://github.com/LUCY78765580/Python-web-scraping/blob/master/QSBK.py)</br>
- [百度帖吧](https://github.com/LUCY78765580/Python-web-scraping/blob/master/tieba.py)</br>
- [pixabay图片网站](https://github.com/LUCY78765580/Python-web-scraping/blob/master/pixabay.py)</br>
- [pexels图片网](https://github.com/LUCY78765580/Python-web-scraping/blob/master/pexels.py)</br>
- [info社区](https://github.com/LUCY78765580/Python-web-scraping/blob/master/BoLiBei.py)</br>
- [教务网](https://github.com/LUCY78765580/Python-web-scraping/blob/master/JWCJ.py)</br>
- [拉勾](https://github.com/LUCY78765580/Python-web-scraping/tree/master/LaGou)</br>
- [豆瓣](https://github.com/LUCY78765580/Python-web-scraping/tree/master/DouBan)</br>
</br>

**二、进阶篇**</br>
- [抓取手机App数据](https://github.com/LUCY78765580/Python-web-scraping/tree/master/TouTiao)</br>
- [断点续爬](https://github.com/LUCY78765580/Python-web-scraping/tree/master/ZhiHu1)
</br>
</br>

**三、框架篇（Scrapy)**</br>
- [scrapy爬多级网页及图片（一般方法)](https://github.com/LUCY78765580/Python-web-scraping/tree/master/XiaoHua)</br>
- [scrapy爬多级网页及图片（ImagesPipeline)](https://github.com/LUCY78765580/Python-web-scraping/tree/master/XiaoHua2)</br>
scrapy之存储：</br>
- [App抓取并存入MongoDB](https://github.com/LUCY78765580/Python-web-scraping/tree/master/TouTiao)</br>
- [断点续爬并存入MySQL](https://github.com/LUCY78765580/Python-web-scraping/tree/master/ZhiHu1)</br>

其它待更