# pulp_regression_tests

**Repository Path**: david6chen/pulp_regression_tests

## Basic Information

- **Project Name**: pulp_regression_tests
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2021-04-06
- **Last Updated**: 2021-04-22

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Regression tests
This repository contains a set of test, implemented in C, that are used as regression tests in our CI flow. Indeed, these tests are performed any time a push is done in the pulp-open's branches and are intended to verify that the basic functionalities of Pulp have not been compromised by the changes. Through time, this repo will be ppulated by more and more specific tests, granted that they work with the current pulp implementation.

## Tests
You can run tests either locally in a manual fashion or use your GitLab CI instance. 

## Running software tests manually
Call the `./update-regression-tests` script in the pulp directory. This will populate this directory with all software tests.

You have two options to run these tests, the first one is to test without the peripheral tests and the second one is to use them. The main difference is just the time the simulation will need: withouth the peripheral tests, there is no need to instantiate the Verification IPs, which are heavy and with tiny time steps (1ps). 

### Option 1
If you chose the first option, please do the following, from the pulp folder:

#### To build Pulp
```
source setup/vsim.sh

./update-ips

./generate-scripts

cd sim

make all

```
#### To run the "Hello world!"
```
cd ..

git clone https://github.com/pulp-platform/pulp-runtime.git

source pulp-runtime/configs/pulp.sh

export PULP_RISCV_GCC_TOOLCHAIN= *path to riscv gcc toolchain*

cd regression_tests/hello

mae clean all run gui=1
```
#### To run all the tests
```
cd ..

git clone https://github.com/pulp-platform/pulp-runtime.git

source pulp-runtime/configs/pulp.sh

export PULP_RISCV_GCC_TOOLCHAIN= *path to riscv gcc toolchain*

make test-fast-regressions
```
### Option 2
If you chose the second option, you will have to download the VIPs in the `pulp/rtl/vip` folder, following the instruction in the relative READMEs. (You will not need the psram). And the you will have to do the following:


#### To build Pulp
```
source setup/vsim.sh

./update-ips

./generate-scripts --rt-dpi --i2c-vip --flash-vip --i2s-vip --hyper-vip --use-vip --verbose

cd sim

make all

```
#### To run the tests
```
cd ..

source pulp-runtime/configs/pulp.sh

export PULP_RISCV_GCC_TOOLCHAIN= *path to riscv gcc toolchain*

make test-local-regressions
```

 
## Adding your own tests
You can add your own tests by putting them in a repository and adding them to
`update-tests` and `update-tests-gitlab` scripts in the top-level folder. Make
sure you define an appropriate `testset.cfg` that lists all the tests in your
repository and for each test provide another `testset.cfg` with instructions on
how to run it. Have a look at the already existing tests for an idea how such
files should look like.