Skip to content

Docs CSC now features an automatic Finnish translation. Click here for more information.

Warning!

Puhti and Mahti computing services have been decommissioned and no new jobs are accepted or executed on its compute nodes. Puhti and Mahti login nodes and storage services are planned to remain available until 15 October 2026. Clean up unnecessary files and move any data you need to keep by 31 August 2026. See the Roihu data migration guide for instructions on transferring your data to Roihu.

Python Data

Collection of Python libraries for data analytics and machine learning.

News

31.3.2026 Python-data is now available on Roihu. The default version on Roihu-CPU is python-data/3.12-31.03 and python-data/3.12-20.04 on Roihu-GPU.

Available

Versions are numbered as X.Z-YY.MM, where X.Z is the version of the Python interpreter, and YY.MM is the year and month of the installation. Typically the module will include the newest versions of libraries at installation time, to the extent software dependencies allow.

Current versions in Roihu are:

  • Roihu-CPU: (default version) python-data/3.12-31.03: installed in March 2026, includes for example Scikit-learn 1.8.0, SciPy 1.17.1, Pandas 2.3.3 and JupyterLab 4.5.6.

  • Roihu-GPU: (default version) python-data/3.12-20.04: installed in April 2026, includes for example Cupy 14.0.1 in addition to the Python libraries available in Roihu-CPU python-data.

  • Roihu-GPU: python-data/3.10-17.04: installed in April 2026, includes the Python libraries available in the default Roihu-GPU python-data environment with Python 3.10.

  • Roihu-CPU: python-data/3.10-03.07: installed in July 2026, includes the Python libraries available in the default Roihu-CPU python-data environment with Python 3.10.

Python-data tries to include a comprehensive selection of Python libraries for data analytics and machine learning, for example:

Click to see full list of packages for python-data/3.12-31.03
  • absl-py 2.4.0
  • aiohappyeyeballs 2.6.1
  • aiohttp 3.13.5
  • aiohttp-cors 0.8.1
  • aiosignal 1.4.0
  • alabaster 1.0.0
  • alembic 1.18.4
  • altair 6.0.0
  • annotated-doc 0.0.4
  • annotated-types 0.7.0
  • anyio 4.13.0
  • argon2-cffi 25.1.0
  • argon2-cffi-bindings 25.1.0
  • arrow 1.4.0
  • arviz 1.1.0
  • arviz-base 1.1.0
  • arviz-plots 1.1.0
  • arviz-stats 1.1.0
  • ase 3.29.0
  • astroid 4.0.4
  • asttokens 3.0.1
  • async-lru 2.3.0
  • async-timeout 5.0.1
  • asyncssh 2.22.0
  • attrs 26.1.0
  • autopep8 2.0.4
  • babel 2.18.0
  • backports.tarfile 1.2.0
  • backports.zstd 1.3.0
  • banduppy 1.0.1.dev0
  • bcrypt 5.0.0
  • beautifulsoup4 4.14.3
  • bibtexparser 1.4.4
  • binaryornot 0.6.0
  • black 26.3.1
  • bleach 6.3.0
  • blinker 1.9.0
  • bokeh 3.9.0
  • boto3 1.42.89
  • botocore 1.42.89
  • Brotli 1.2.0
  • cached-property 1.5.2
  • cachetools 6.2.6
  • cattrs 26.1.0
  • certifi 2026.4.22
  • cffi 2.0.0
  • cftime 1.6.5
  • chardet 5.2.0
  • charset-normalizer 3.4.7
  • click 8.3.2
  • cloudpickle 3.1.2
  • colorama 0.4.6
  • colorful 0.5.8
  • comm 0.2.3
  • cons 0.4.7
  • contourpy 1.3.3
  • cookiecutter 2.7.1
  • cryptography 46.0.7
  • cycler 0.12.1
  • Cython 3.2.4
  • cytoolz 1.1.0
  • dash 4.1.0
  • dash-bootstrap-components 2.0.4
  • dash-bootstrap-templates 2.1.0
  • dask 2026.3.0
  • dask-glm 0.3.2
  • dask-jobqueue 0.9.0
  • dask_labextension 7.0.0
  • dask-ml 2025.1.0
  • databricks-sdk 0.102.0
  • debtcollector 3.1.0
  • debugpy 1.8.20
  • decorator 5.2.1
  • defusedxml 0.7.1
  • Deprecated 1.3.1
  • diff-match-patch 20241021
  • dill 0.4.1
  • distlib 0.4.0
  • distributed 2026.3.0
  • dnspython 2.8.0
  • docker 7.1.0
  • docstring-to-markdown 0.17
  • docutils 0.22.4
  • email-validator 2.3.0
  • entrypoints 0.4
  • et_xmlfile 2.0.0
  • etuples 0.3.10
  • exceptiongroup 1.3.1
  • executing 2.2.1
  • fastapi 0.135.3
  • fastapi-cli 0.0.23
  • fastar 0.11.0
  • fastjsonschema 2.21.2
  • fasttext 0.9.2
  • filelock 3.25.2
  • flake8 7.1.2
  • Flask 3.1.3
  • flask-cors 6.0.2
  • fonttools 4.62.0
  • fortio 0.4
  • fqdn 1.5.1
  • frozenlist 1.7.0
  • fsspec 2026.3.0
  • future 1.0.0
  • gensim 4.4.0
  • gitdb 4.0.12
  • GitPython 3.1.46
  • google-api-core 2.30.3
  • google-auth 2.49.2
  • googleapis-common-protos 1.74.0
  • graphene 3.4.3
  • graphql-core 3.2.8
  • graphql-relay 3.2.0
  • greenlet 3.4.0
  • grpcio 1.78.1
  • gssapi 1.11.1
  • gunicorn 23.0.0
  • h11 0.16.0
  • h2 4.3.0
  • h5py 3.16.0
  • hpack 4.1.0
  • httpcore 1.0.9
  • httptools 0.7.1
  • httpx 0.28.1
  • huey 2.6.0
  • hyperframe 6.1.0
  • hyperopt 0.2.7
  • idna 3.11
  • imagecodecs 2026.3.6
  • imageio 2.37.0
  • imagesize 2.0.0
  • imbalanced-learn 0.14.1
  • importlib_metadata 8.7.0
  • importlib_resources 7.1.0
  • inflection 0.5.1
  • iniconfig 2.3.0
  • intervaltree 3.1.0
  • invoke 3.0.3
  • ipdb 0.13.13
  • ipykernel 6.31.0
  • ipython 9.12.0
  • ipython-genutils 0.2.0
  • ipython_pygments_lexers 1.1.1
  • ipywidgets 8.1.8
  • irrep 3.1.1
  • iso8601 2.1.0
  • isodate 0.7.2
  • isoduration 20.11.0
  • isort 8.0.1
  • itsdangerous 2.2.0
  • jaraco.classes 3.4.0
  • jaraco.context 6.1.1
  • jaraco.functools 4.4.0
  • jedi 0.19.2
  • jeepney 0.9.0
  • jellyfish 1.2.1
  • Jinja2 3.1.6
  • jmespath 1.1.0
  • joblib 1.5.3
  • json5 0.14.0
  • jsonpointer 3.1.1
  • jsonschema 4.26.0
  • jsonschema-specifications 2025.9.1
  • jupyter_client 8.8.0
  • jupyter_core 5.9.1
  • jupyter-events 0.12.0
  • jupyter-lsp 2.3.1
  • jupyter-resource-usage 1.2.1
  • jupyter_server 2.17.0
  • jupyter_server_proxy 4.5.0
  • jupyter_server_terminals 0.5.4
  • jupyterlab 4.5.6
  • jupyterlab_git 0.52.0
  • jupyterlab_pygments 0.3.0
  • jupyterlab_server 2.28.0
  • jupyterlab_widgets 3.0.16
  • jupytext 1.19.1
  • kaggle 2.0.1
  • kagglesdk 0.1.17
  • keyring 25.7.0
  • keystoneauth1 5.13.1
  • kiwisolver 1.5.0
  • lark 1.3.1
  • lazy-loader 0.5
  • lightgbm 4.6.0
  • llvmlite 0.47.0
  • lmdb 2.1.1
  • locket 1.0.0
  • logical-unification 0.4.7
  • logzero 1.7.0
  • loro 1.10.3
  • lsprotocol 2025.0.0
  • lxml 6.1.1
  • lz4 4.4.5
  • Mako 1.3.10
  • marimo 0.23.1
  • Markdown 3.10.2
  • markdown-it-py 4.0.0
  • MarkupSafe 3.0.3
  • matplotlib 3.10.8
  • matplotlib-inline 0.2.1
  • mccabe 0.7.0
  • mdit-py-plugins 0.5.0
  • mdurl 0.1.2
  • miniKanren 1.0.5
  • mistune 3.2.0
  • mlflow 3.10.1
  • mlflow-skinny 3.10.1
  • mlflow-tracing 3.10.1
  • monty 2026.7.16
  • more-itertools 11.0.2
  • mpmath 1.3.0
  • msgpack 1.1.2
  • msgspec 0.21.0
  • multidict 6.7.1
  • multipledispatch 0.6.0
  • munkres 1.1.4
  • mypy_extensions 1.1.0
  • narwhals 2.19.0
  • nbclassic 1.3.3
  • nbclient 0.10.4
  • nbconvert 7.17.1
  • nbdime 4.0.4
  • nbformat 5.10.4
  • nest_asyncio 1.6.0
  • netaddr 1.3.0
  • netCDF4 1.7.4
  • networkx 3.6.1
  • nltk 3.9.4
  • notebook 7.5.5
  • notebook_shim 0.2.4
  • numba 0.65.0
  • numexpr 2.14.1
  • numpy 2.4.6
  • numpydoc 1.10.0
  • nvidia-nccl-cu12 2.29.7
  • odfpy 1.4.1
  • opencensus 0.11.3
  • opencensus-context 0.1.3
  • opencv-python 4.13.0
  • opencv-python-headless 4.13.0
  • openpyxl 3.1.5
  • opentelemetry-api 1.41.0
  • opentelemetry-exporter-prometheus 0.62b0
  • opentelemetry-proto 1.41.0
  • opentelemetry-sdk 1.41.0
  • opentelemetry-semantic-conventions 0.62b0
  • orjson 3.11.9
  • os-service-types 1.8.2
  • oslo.config 10.3.0
  • oslo.i18n 6.7.2
  • oslo.serialization 5.9.1
  • oslo.utils 10.0.1
  • overrides 7.7.0
  • packaging 26.0
  • palettable 3.3.3
  • pandas 2.3.3
  • pandocfilters 1.5.0
  • papermill 2.7.0
  • paramiko 4.0.0
  • parso 0.8.6
  • partd 1.4.2
  • pathspec 1.0.4
  • patsy 1.0.2
  • pbr 7.0.3
  • pexpect 4.9.0
  • pickleshare 0.7.5
  • pillow 12.2.0
  • pip 26.0.1
  • platformdirs 4.9.6
  • plotly 6.6.0
  • pluggy 1.6.0
  • ply 3.11
  • polars 1.44.1
  • prettytable 3.17.0
  • prometheus_client 0.25.0
  • prometheus_flask_exporter 0.23.2
  • prompt_toolkit 3.0.52
  • propcache 0.3.1
  • proto-plus 1.27.2
  • protobuf 6.33.5
  • psutil 7.2.2
  • ptyprocess 0.7.0
  • pure_eval 0.2.3
  • py-cpuinfo 9.0.0
  • py4j 0.10.9.9
  • pyarrow 23.0.1
  • pyasn1 0.6.3
  • pyasn1_modules 0.4.2
  • pybind11 3.0.3
  • pybind11-global 3.0.3
  • pycodestyle 2.12.1
  • pyconify 0.2.1
  • pycparser 2.22
  • pydantic 2.13.0
  • pydantic_core 2.46.0
  • pydantic-extra-types 2.11.2
  • pydantic-settings 2.14.0
  • pydeck 0.8.0b4
  • pydocstyle 6.3.0
  • pydot 4.0.1
  • pyflakes 3.2.0
  • PyGithub 2.9.0
  • Pygments 2.20.0
  • pyhdf 0.11.6
  • PyJWT 2.12.1
  • pylint 4.0.5
  • pylint-venv 3.0.4
  • pyls-spyder 0.4.0
  • pymatgen 2026.5.4
  • pymatgen-core 2026.8.13
  • pymc 6.0.1
  • pymdown-extensions 10.21.2
  • PyNaCl 1.6.2
  • pynndescent 0.5.13
  • pyocse 0.1.3
  • pyOpenSSL 26.0.0
  • pyparsing 3.3.2
  • pyproj 3.7.2
  • PyQt5 5.15.11
  • PyQt5_sip 12.17.0
  • PyQtWebEngine 5.15.7
  • PySide6 6.10.2
  • PySocks 1.7.1
  • pytensor 3.0.4
  • pytest 9.0.3
  • python-dateutil 2.9.0.post0
  • python-discovery 1.2.2
  • python-dotenv 1.2.2
  • python-json-logger 2.0.7
  • python-keystoneclient 5.8.0
  • python-lsp-black 2.0.0
  • python-lsp-jsonrpc 1.1.2
  • python-lsp-ruff 2.3.1
  • python-lsp-server 1.14.0
  • python-multipart 0.0.27
  • python-poppler 0.4.1
  • python-slugify 8.0.4
  • python-swiftclient 4.10.0
  • pytokens 0.4.1
  • pytoolconfig 1.2.5
  • pytz 2026.1.post1
  • pyu2f 0.1.5
  • pyuca 1.2
  • pyxdg 0.28
  • pyxtal 1.1.1
  • PyYAML 6.0.3
  • pyzmq 27.1.0
  • QDarkStyle 3.2.3
  • qstylizer 0.2.4
  • QtAwesome 1.4.2
  • qtconsole 5.7.2
  • QtPy 2.4.3
  • querystring_parser 1.2.4
  • ray 2.54.0
  • rdflib 7.6.0
  • redis 7.4.0
  • referencing 0.37.0
  • regex 2026.4.4
  • requests 2.33.1
  • retrying 1.4.2
  • rfc3339_validator 0.1.4
  • rfc3986 2.0.0
  • rfc3986-validator 0.1.1
  • rfc3987-syntax 1.1.0
  • rich 15.0.0
  • rich-toolkit 0.19.7
  • roman-numerals 4.1.0
  • rope 1.14.0
  • rpds-py 0.30.0
  • rsa 4.9.1
  • rtree 1.4.1
  • ruamel.yaml 0.19.1
  • ruff 0.15.10
  • s3cmd 2.4.0
  • s3transfer 0.16.0
  • scikit-image 0.26.0
  • scikit-learn 1.8.0
  • scipy 1.17.1
  • seaborn 0.13.2
  • SecretStorage 3.4.1
  • Send2Trash 2.1.0
  • setproctitle 1.2.2
  • setuptools 81.0.0
  • shellingham 1.5.4
  • shiboken6 6.10.2
  • simpervisor 1.0.0
  • sip 6.10.0
  • six 1.17.0
  • sklearn-compat 0.1.5
  • skops 0.13.0
  • smart_open 7.6.0
  • smmap 5.0.3
  • sniffio 1.3.1
  • snowballstemmer 3.0.1
  • sortedcontainers 2.4.0
  • soupsieve 2.8.3
  • sparse 0.18.0
  • spglib 2.7.0
  • Sphinx 9.1.0
  • sphinxcontrib-applehelp 2.0.0
  • sphinxcontrib-devhelp 2.0.0
  • sphinxcontrib-htmlhelp 2.1.0
  • sphinxcontrib-jsmath 1.0.1
  • sphinxcontrib-qthelp 2.0.0
  • sphinxcontrib-serializinghtml 1.1.10
  • spyder 6.1.4
  • spyder-kernels 3.1.4
  • SQLAlchemy 2.0.49
  • sqlparse 0.5.5
  • stack_data 0.6.3
  • starlette 1.0.0
  • statsmodels 0.14.6
  • stevedore 5.7.0
  • streamlit 1.56.0
  • superqt 0.8.0
  • sympy 1.14.0
  • tables 3.11.1
  • tabulate 0.10.0
  • tblib 3.2.2
  • tenacity 9.1.4
  • tensorboard 2.20.0
  • tensorboard_data_server 0.7.0
  • tensorboardX 2.6.2.2
  • terminado 0.18.1
  • text-unidecode 1.3
  • textdistance 4.6.3
  • threadpoolctl 3.6.0
  • three-merge 0.1.1
  • tifffile 2026.3.3
  • tinycss2 1.4.0
  • toml 0.10.2
  • tomli 2.4.1
  • tomlkit 0.14.0
  • toolz 1.1.0
  • tornado 6.5.5
  • tqdm 4.67.3
  • traitlets 5.14.3
  • typer 0.25.1
  • typing_extensions 4.15.0
  • typing-inspection 0.4.2
  • typing_utils 0.1.0
  • tzdata 2026.1
  • ujson 5.12.0
  • umap-learn 0.5.12
  • uncertainties 3.2.3
  • unicodedata2 17.0.1
  • uri-template 1.3.0
  • urllib3 2.6.3
  • uvicorn 0.44.0
  • uvloop 0.22.1
  • vasprun-xml 1.0.4
  • virtualenv 21.2.1
  • watchdog 6.0.0
  • watchfiles 1.1.1
  • wcwidth 0.6.0
  • webcolors 25.10.0
  • webencodings 0.5.1
  • websocket-client 1.9.0
  • websockets 16.0
  • Werkzeug 3.1.8
  • whatthepatch 1.0.7
  • wheel 0.46.3
  • widgetsnbextension 4.0.15
  • wrapt 2.1.2
  • wurlitzer 3.1.1
  • xarray 2026.4.0
  • xarray-einstats 0.10.0
  • xgboost 3.2.0
  • xlrd 2.0.2
  • xlwt 1.3.0
  • xmltodict 1.0.4
  • xyzservices 2026.3.0
  • yapf 0.43.0
  • yarl 1.23.0
  • zict 3.0.0
  • zipp 3.23.1

If you find that some package is missing, you can often install it yourself with pip install --user. See our Python documentation for more information on how to install packages yourself.

It is also possible to use Python virtual environments. To create a virtual environment use the command python3 -m venv --system-site-packages venv.

If you think that some important package should be included in the module provided by CSC, please contact our servicedesk. Note that some machine learning frameworks have their own specific modules, for example in Roihu: python-pytorch, python-vllm, python-tensorflow, and python-jax.

Note about multi-threading

Loading the python-data module will set the environment variable OMP_NUM_THREADS=1, which essentially disables OpenMP multi-threading support. This is a reasonable setting in most cases, and fixes some issues related to multi-processing runs. If you know that you need to use OpenMP multi-threading, please set this variable manually, for example in your Slurm job script:

export OMP_NUM_THREADS=$SLURM_CPUS_PER_TASK

License

All packages are licensed under various free and open source licenses (FOSS).

Usage

To use this software on Roihu, initialize it with:

module load python-data

to access the default version, or if you wish to have a specific version (see above for available versions):

module load python-data/3.12-31.03

If you just want the most recent version with a specific Python version, you can also run:

module load python-data/3.12

This will show all available versions:

module avail python-data

To check the exact packages and versions included in the loaded module you can run:

list-packages

Warning

Note that login nodes are not intended for heavy computing, please use slurm batch jobs instead. See our instructions on how to use the batch job system.

Please also check CSC's general Python documentation.

Local storage

Roihu nodes have fast local storage which is useful for I/O-intensive applications. See our general instructions on how to use local temporary storage on Roihu.