Welcome to PyUNICORE

UNICORE (UNiform Interface to COmputing REsources) offers a ready-to-run system including client and server software. It makes distributed computing and data resources available in a seamless and secure way in intranets and the internet.

PyUNICORE is a Python library providing an API for UNICORE’s REST API , making common tasks like file access, job submission and management, workflow submission and management more convenient, and integrating UNICORE features better with typical Python usage.

In addition, this library contains code for using UFTP (UNICORE FTP) for filesystem mounts with FUSE, a UFTP driver for PyFilesystem and a UNICORE implementation of a Dask Cluster

This project has received funding from the European Union’s Horizon 2020 Framework Programme for Research and Innovation under the Specific Grant Agreement Nos. 720270, 785907 and 945539 (Human Brain Project SGA 1, 2 and 3)

PyUNICORE is Open Source under the BSD License, the source code is on GitHub.

Installation

Install from PyPI with

pip install -U pyunicore

Additional extra packages may be required for your use case:

• Using the UFTP fuse driver requires “fusepy”

• Using UFTP with pyfilesystem requires “fs”

• Creating JWT tokens signed with keys requires the “cryptography” package

You can install (one or more) extras with pip:

pip install -U pyunicore[crypto,fs,fuse]

Using PyUNICORE

• Getting started
  • Creating a client for a UNICORE site
  • Running a job and read result files
  • Connect to a Registry and list all registered services
  • More examples
• Authentication
  • Basic authentication options
  • User preferences (advanced feature)
  • Creating an authentication token (advanced feature)
• UFTP
  • Basic UFTP usage
  • Using UFTP for PyFilesystem
  • Mounting remote filesystems via UFTP
• Dask integration
  • Configuration
  • Customizing the scheduler and workers
  • Scaling
  • The dashboard
  • Using an allocation
• Port forwarding / tunneling

Links

• License