# scrapy-51job

**Repository Path**: moris_java/scrapy-51job

## Basic Information

- **Project Name**: scrapy-51job
- **Description**: 51job，猎聘，拉勾，智联，Boss直聘 爬虫
- **Primary Language**: Python
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 9
- **Created**: 2021-01-27
- **Last Updated**: 2021-01-27

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# 招聘爬虫

## 功能

- 此爬虫采用scrapy框架，以redis作为地址缓存，以ES作为内容存储
- 可以单独启用也可以导入[crawlab](https://github.com/crawlab-team/crawlab) 平台

## 爬虫

- 51job
- 猎聘
- 拉勾
- 智联
- Boss直聘：_易被反爬_

## 截图

### 1. 采集结果

![](https://oscimg.oschina.net/oscnet/up-b629086a42b70a9244c5f4ac04139dbd554.png)

![](https://oscimg.oschina.net/oscnet/up-6a181f18a1dcdfea43821a63b5e7c70e4db.png)

### 2. 爬虫管理平台

![](https://oscimg.oschina.net/oscnet/up-fbb17fb19ecfa3da0bbaa106457c183a463.png)

![](https://oscimg.oschina.net/oscnet/up-3a47dea57de50e5f62efb63ef0b378e23a4.png)

![](https://oscimg.oschina.net/oscnet/up-fca9e6a88c240d0875aa126e27a1359dbd3.png)

![](https://oscimg.oschina.net/oscnet/up-923e40a021d6600421d816e96e432d68ed0.png)