# Taier

**Repository Path**: felixhpp/taier

## Basic Information

- **Project Name**: Taier
- **Description**: Taier 名字由来中国古代十大名剑之一 —— 太阿。

Taier 是一个分布式可视化的DAG任务调度系统。旨在降低ETL开发成本、提高大数据平台稳定性，大数据开发人员可以在 Taier 直接进行业务逻辑的开发，而不用关心任务错综复杂的依赖关系与底层的大数据平台的架构实现，将工作的重心更多地聚焦在业务之中。
- **Primary Language**: Java
- **License**: Apache-2.0
- **Default Branch**: master
- **Homepage**: https://dtstack.github.io/Taier/
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 149
- **Created**: 2023-01-16
- **Last Updated**: 2023-01-16

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

<div align="center">
         <a href="https://dtstack.github.io/Taier/" target="_blank" rel="noopener noreferrer">
           <img src="website/static/img/logo.svg" width="20%" height="20%" alt="Taier Logo" />
        </a>
 <h1>Taier</h1>
 <h3>A distributed dispatching system</h3>
</div>

<p align="center">
  <img src="https://img.shields.io/github/release/Dtstack/Taier.svg">
  <img src="https://img.shields.io/github/stars/Dtstack/Taier">
  <img src="https://img.shields.io/github/forks/Dtstack/Taier">
  <a href="https://www.apache.org/licenses/LICENSE-2.0.html">
   <img src="https://img.shields.io/badge/license-Apache%202-4EB1BA.svg">
  </a>
  <p align="center">
    <a href="https://dtstack.github.io/Taier/">Office Website</a> |
    <a href="https://dtstack.github.io/Taier/docs/guides/introduction/">Document</a>
  </p>
</p>

## Introduction

> **Taier** , spelling in chinese is 太阿, is one of the ancient chinese celebrated swords.

**Taier** is distributed dispatching system that focus on different tasks submitted and scheduled. It's aimed at reducing the **ETL**'s cost, making the complex dependencies between tasks clearly and reducing the labor cost about submitting, scheduling and O&M.

It's unnecessary to concern about the complex dependencies between tasks and the underlying architecture about the big data platform at **Taier**, so that you can pay more attention into business.

**Taier** provide an one-stop big data platform for submitting tasks, scheduling tasks, O&M, presentation about indicators.

The core features for Taier are as follows:

- Easy to distributed extend
- Visualization config for DAG
- With an IDE development platform designed for big-data users
- Supports to develop your own plugins
- Multiply task modes including guide mode and script mode
- Supports to the dependencies between upstream/downstream tasks
- Supports batch and stream tasks
- Integrates various different versions of Hadoop
- Easy to integrate Flink Standalone
- Completely safe and non-intrusive to the cluster's environment
- Isolation by tenants and clusters
- Supports kerberos authentication
- Different versions for tasks
- Supports user-defined parameters for task
- Real-time monitoring about cluster's resources
- Real-time presented about data indicators
- Restrict the task's resource

## Architecture

![architecture](/website/static/img/readme/taier-architecture.png)

## Quick start

#### [In Docker](https://dtstack.github.io/Taier/docs/quickstart/deploy/docker#2-%E4%BD%BF%E7%94%A8docker-compose)

```shell
$ wget https://github.com/DTStack/Taier/blob/master/docker-compose.yml
$ docker-compose up -d
```

#### [Online Preview](http://taier.dtstack.cn/)

#### [Develop Tasks](https://dtstack.github.io/Taier/docs/quickstart/start)

![main](/website/static/img/readme/main.png)

## Tasks

|       Tasks       |                                     Documentation                                     |
| :---------------: | :-----------------------------------------------------------------------------------: |
|     Data Sync     |       [Documentation](https://dtstack.github.io/Taier/docs/functions/task/sync)       |
| Data Acquisition  | [Documentation](https://dtstack.github.io/Taier/docs/functions/task/data-acquisition) |
|     Flink SQL     |    [Documentation](https://dtstack.github.io/Taier/docs/functions/task/flink-sql)     |
|       Flink       |      [Documentation](https://dtstack.github.io/Taier/docs/functions/task/flink)       |
|     Spark SQL     |    [Documentation](https://dtstack.github.io/Taier/docs/functions/task/spark-sql)     |
|     Hive SQL      |     [Documentation](https://dtstack.github.io/Taier/docs/functions/task/hive-sql)     |
|   OceanBase SQL   |  [Documentation](https://dtstack.github.io/Taier/docs/functions/task/oceanbase-sql)   |
|  ClickHouse SQL   |  [Documentation](https://dtstack.github.io/Taier/docs/functions/task/clickhouse-sql)  |
|     Doris SQL     |    [Documentation](https://dtstack.github.io/Taier/docs/functions/task/doris-sql)     |
|       Shell       |      [Documentation](https://dtstack.github.io/Taier/docs/functions/task/shell)       |
|      Python       |      [Documentation](https://dtstack.github.io/Taier/docs/functions/task/python)      |
| User-defined Task |           [Documentation](https://dtstack.github.io/Taier/docs/expand/task)           |

## Questions

For questions, bugs and supports please open an [issue](https://github.com/DTStack/Taier/issues/new/choose), we'll reply you in time.

## Stay in touch

- Slack https://join.slack.com/t/slack-p437975/shared_invite/zt-1iw5x1fw7-A6rVolqjP2z8V09~WwFUiA

## Contribution

Please make sure to read the [Contributing Guide](https://dtstack.github.io/Taier/docs/contributing) before making a pull request.

## Contributor

<a href="https://github.com/Dtstack/Taier/graphs/contributors">
  <img src="https://contrib.rocks/image?repo=Dtstack/Taier" />
</a>

## License

**Taier** is under the Apache 2.0 license. See the [LICENSE](http://www.apache.org/licenses/LICENSE-2.0) file for
details.