Skip to content

Python package based on PyTorch and Dask for efficient and parallelized data assimilation of weather model data and observations on GPUs.

License

Notifications You must be signed in to change notification settings

tobifinn/torch-assimilate

Folders and files

NameName
Last commit message
Last commit date

Latest commit

a5ed436 · Feb 18, 2025
Feb 13, 2018
Dec 21, 2020
Feb 18, 2025
Jan 10, 2019
Feb 18, 2025
Feb 10, 2021
Dec 8, 2020
Feb 13, 2018
Aug 31, 2020
Feb 14, 2018
Mar 9, 2018
Dec 11, 2018
Aug 31, 2020
Jan 3, 2021
Aug 12, 2020
Jun 17, 2019
May 26, 2019
Aug 31, 2020

Repository files navigation

torch-assimilate

docs Documentation Status
pipeline Pipeline status
coverage Coverage report
quality quality
package pypi-test pypi conda zenodo

Data assimilation based on PyTorch

torch-assimilate is a python package for data assimilation of meteorological observations into numerical weather model data.

This package is constructed for efficient and parallelized data assimilation in python. The central entity of this package are the data assimilation methods optimized in PyTorch [1]. Furthermore, some algorithms are parallelized with dask [2] and allow a distributed computing with many cores. For data in- and output xarray [3] is used. Originally, this package is designed for offline data assimilation via io-operations.

In the future, different data assimilation methods, like ensemble Kalman filters, particle filters, variational data assimilation and neural assimilation will be added.

This package is developed for a PhD-thesis about nonlinear methods in coupled data assimilation at the "Universität Hamburg", "Universität Bonn" and the Max Planck Institute for Meteorology.

Installation

We highly recommend to create a virtual environment for this package to prevent package collisions. At the moment this package is only available at pypi-test.

This package is programmed in python 3.6 and should be working with all python versions > 3.3. Additional requirements are pytorch and xarray.

PyTorch needs to be additionally installed because of different possible versions. In following CPU-based installation for linux is shown.

via conda (recommended):

git clone [email protected]:tobifinn/torch-assimilate.git
cd torch-assimilate
conda env create -f environment.yml
source activate pytassim
conda install pytorch torchvision cpuonly -c pytorch
pip install .

via pip (latest pypi-test):

pip install --index-url https://test.pypi.org/simple/ torch-assimilate
pip install torch==1.6.0+cpu torchvision==0.7.0+cpu -f https://download.pytorch.org/whl/torch_stable.html

Authors

  • Tobias Finn - Initial creator - tobifinn

License

This project is licensed under the GPL3 License - see the license file for details.

References

[1]PyTorch, https://pytorch.org
[2]Dask, https://dask.org
[3]xarray, http://xarray.pydata.org

About

Python package based on PyTorch and Dask for efficient and parallelized data assimilation of weather model data and observations on GPUs.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published