# pypette
**Repository Path**: mirrors_lepy/pypette
## Basic Information
- **Project Name**: pypette
- **Description**: Ridiculously simple flow controller for building complex pipelines
- **Primary Language**: Unknown
- **License**: MIT
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No
## Statistics
- **Stars**: 0
- **Forks**: 0
- **Created**: 2020-09-25
- **Last Updated**: 2025-07-02
## Categories & Tags
**Categories**: Uncategorized
**Tags**: None
## README
---
pypette (to be read as pipette) is a module which makes building pipelines
ridiculously simple, allowing users to control the flow with minimal
instructions.
## Features
- Simple interface.
- Ability to view pipeline structure within the comfort of a terminal.
## Setup
### Using pip
```bash
pip install pypette
```
### Directly from the repository
```bash
git clone https://github.com/csurfer/pypette.git
python pypette/setup.py install
```
## Structures
### Job
The basic unit of execution, say a python method or a callable.
```python
from pypette import Job
def print_hello():
print("Hello!")
def print_hello_msg(msg):
print("Hello " + msg + "!")
# Job without arguments
j1 = Job(print_hello)
# Job with arguments specified as argument list
j2 = Job(print_hello_msg, args=("pypette is simple",))
# Job with arguments specified as key word arguments
j3 = Job(print_hello_msg, kwargs={"msg":"pypette is simple"})
```
### BashJob
The basic unit of execution, which runs a bash command.
```python
from pypette import BashJob
# Job with bash commands
b1 = BashJob(['ls', '-l'])
b2 = BashJob(['pwd'])
```
### Pipe
Structure to specify the flow in which the jobs need to be executed. The whole
interface consists of only 4 methods.
```python
from pypette import Pipe
# 1. Create a new Pipe
p = Pipe('TestPipe')
# 2. Add jobs to execute. (Assuming job_list is a list of python/bash jobs)
# To run the jobs in job_list in order one after the other where each job waits
# for the job before it to finish.
p.add_jobs(job_list)
# To run the jobs in job_list parallelly and run the next step only after all
# jobs in job list finish.
p.add_jobs(job_list, run_in_parallel=True)
```
### Building complex pipelines
Jobs submitted to pipeline should be callables i.e. structures which can be run.
This means python methods, lambdas etc qualify.
What about Pipe itself?
Of course, it is a callable and you can submit a pipe object to be run along
with regular jobs. This way you can build small pipelines which achieve a
specific task and then combine them to create more complex pipelines.
```python
from pypette import BashJob, Job, Pipe
def welcome():
print("Welcome user!")
def havefun():
print("Have fun!")
def goodbye():
print("Goodbye!")
# Build a simple pipeline
p1 = Pipe('Fun')
p1.add_jobs([
Job(havefun),
])
# Include simple pipeline into a complicated pipeline
p2 = Pipe('Overall')
p2.add_jobs([
Job(welcome),
p1,
Job(goodbye),
BashJob(['ls', '-l']),
BashJob(['pwd'])
])
p2.run() # This first runs welcome, then runs p1 pipeline then runs goodbye.
```
### Example pipeline
An example pipeline and its code are included in
**[examples](https://github.com/csurfer/pypette/tree/master/examples)** folder.
### Visualizing the pipeline using graph()
Pipeline objects have a method called `graph()` which helps visualize the
pipeline within the comfort of your terminal. The graph is recursive in nature
and it visualizes everything that will be run if we call `run()` on the pipe
object.
Visualizing the top-level pipeline in
[examples/basic.py](https://github.com/csurfer/pypette/tree/master/examples/basic.py)
led to the following visualization.
### Running the entire pipeline.
The only thing you need to do at this point to run the entire pipeline is to call
`run()` on your pipeline object.
## Contributing
### Bug Reports and Feature Requests
Please use [issue tracker](https://github.com/csurfer/pypette/issues) for
reporting bugs or feature requests.
### Development
Pull requests are most welcome.
### Buy the developer a cup of coffee!
If you found the utility helpful you can buy me a cup of coffee using
[](https://www.paypal.com/cgi-bin/webscr?cmd=_donations&business=3BSBW7D45C4YN&lc=US¤cy_code=USD&bn=PP%2dDonationsBF%3abtn_donate_SM%2egif%3aNonHosted)