Reproducible research data analysis platform

Flexible

Run many computational workflow engines.

Scalable

Support for remote compute clouds.

Reusable

Containerise once, reuse elsewhere. Cloud-native.

Free

Free Software. MIT licence. Made with at CERN.

Examples
Get started
1

Structure your analysis

inputs:
files:
- code/mycode.py
- inputs/mydata.csv
parameters:
myparameter: myvalue
workflow:
type: cwl
file: workflow/myworkflow.cwl
outputs:
files:
- results/myplot.png
more
2

Select a REANA cluster...

$export REANA_SERVER_URL=https://reana.cern.ch/
$export REANA_ACCESS_TOKEN=XXXXXXX

...or install your own

# install kubectl 1.19+, kind 0.9+ and helm 3.0+
$sudo dpkg -i kubectl*.deb kind*.deb kubernetes-helm*.deb
# create Kubernetes cluster (or use your own!)
$wget https://raw.githubusercontent.com/reanahub/reana/maint-0.9/etc/kind-localhost-30443.yaml
$kind create cluster --config kind-localhost-30443.yaml
$wget https://raw.githubusercontent.com/reanahub/reana/maint-0.9/scripts/prefetch-images.sh
$sh prefetch-images.sh
# deploy REANA using Helm
$helm repo add reanahub https://reanahub.github.io/reana
$helm repo update
$helm install reana reanahub/reana --wait
# create an admin user
$wget https://raw.githubusercontent.com/reanahub/reana/maint-0.9/scripts/create-admin-user.sh
$sh create-admin-user.sh default reana john.doe@example.org mysecretpassword
more
3

Run your analysis

# create new virtual environment
$virtualenv ~/.virtualenvs/myreana
$source ~/.virtualenvs/myreana/bin/activate
# install REANA client
$pip install reana-client
# create new workflow
$reana-client create -n my-analysis
$export REANA_WORKON=my-analysis
# upload input code and data to workspace
$reana-client upload ./code ./data
# start computational workflow
$reana-client start
# check its progress
$reana-client status
# list workspace files
$reana-client ls
# open interactive notebook session
$reana-client open jupyter
# download output results
$reana-client download results/plot.png
more
Documentation

Researchers

Find out how you can use REANA to describe, run, preserve and reuse your analyses.

User Guide

Administrators

Install and manage the REANA reusable analysis platform on your own compute cloud.

Administrator Guide

Developers

Understand REANA source code, adapt it to your needs, contribute changes back.

Developer Guide
Latest news

REANA 0.9.3

March 13th 2024

Upgrades Snakemake to version 7.

Improves job submission performance.

Improves clean up of deleted and failed workflows.

See full release notes

November 24th-29th 2024: REANA runs a reproducible workflow training at the EURO-LABS Advanced Training: Open Science and Data Management in Ebernburg, Germany. [event] [slides]
November 4th-8th 2024: REANA runs a reproducible workflow training at the 1st CERN School of Computing on IT Services in Ferney-Voltaire, France. [event] [slides] [exercises]
October 19th-25th 2024: REANA participates at the Conference on Computing in High Energy and Nuclear Physics (CHEP 2024) in Krakow, Poland. [event] [slides]
October 7th 2024: Jelizaveta presents Improving latency and scalability of the user runtime job log collecting and exposure in REANA at the IRIS-HEP Fellows Final Presentations event. [event] [slides]
October 2nd-3rd 2024: REANA participates at the 4th DPHEP Collaboration Workshop in Geneva, Switzerland. [event] [slides]
August 28th 2024: Andrii presents Analysis Grand Challenge on REANA at the IRIS-HEP Gap Year Final Presentations event. [event] [slides]
June 20th 2024: Presentation of REANA at the Swiss Reproducibility Network comuptational reproducibility seminar. [series] [slides]
June 18th-20th 2024: REANA participates at the Analysis Facilities Workshop in Garching, Germany. [event] [slides]
April 3rd-5th 2024: REANA participates at the Workshop on workflow languages for HEP analysis in Geneva, Switzerland. [event] [slides]
April 2nd 2024: REANA in the Analysis Facilities White Paper. [paper]
February 26th-March 1st 2024: REANA presents at the HSF Training on Analysis Pipelines. [event] [slides]
December 1st 2023: We have published a new paper Facilitating future open data reuse via continuous integration of actionable data analysis examples. [paper]
Roadmap

Current

Workflow sharing amongst users

Introduce role-based authorisation control models allowing to share workflows with colleagues.

Near-term

Support for Dask workflows

Allow users to dynamically create Dask cluster necessary for their workflows.

Future

Go client and stable API

Introduce new command-line client written in Go to improve performance and ease of use. Stabilise the REST API versioning.