2018-01-29 21:28:33 +00:00
|
|
|
#!/usr/bin/env python
|
2020-05-29 07:50:55 +00:00
|
|
|
|
|
|
|
# SPDX-FileCopyrightText: : 2017-2020 The PyPSA-Eur Authors
|
|
|
|
#
|
2021-09-14 14:37:41 +00:00
|
|
|
# SPDX-License-Identifier: MIT
|
2020-05-29 07:50:55 +00:00
|
|
|
|
2019-08-08 13:02:28 +00:00
|
|
|
"""
|
2019-08-11 20:34:18 +00:00
|
|
|
Build hydroelectric inflow time-series for each country.
|
2019-08-08 13:02:28 +00:00
|
|
|
|
2019-08-11 09:40:47 +00:00
|
|
|
Relevant Settings
|
|
|
|
-----------------
|
|
|
|
|
2019-08-11 11:17:36 +00:00
|
|
|
.. code:: yaml
|
|
|
|
|
|
|
|
countries:
|
|
|
|
|
|
|
|
renewable:
|
|
|
|
hydro:
|
|
|
|
cutout:
|
|
|
|
clip_min_inflow:
|
|
|
|
|
2019-11-14 16:50:24 +00:00
|
|
|
.. seealso::
|
2019-08-13 08:03:46 +00:00
|
|
|
Documentation of the configuration file ``config.yaml`` at
|
|
|
|
:ref:`toplevel_cf`, :ref:`renewable_cf`
|
|
|
|
|
2019-08-11 09:40:47 +00:00
|
|
|
Inputs
|
|
|
|
------
|
|
|
|
|
2019-08-12 17:01:53 +00:00
|
|
|
- ``data/bundle/EIA_hydro_generation_2000_2014.csv``: Hydroelectricity net generation per country and year (`EIA <https://www.eia.gov/beta/international/data/browser/#/?pa=000000000000000000000000000000g&c=1028i008006gg6168g80a4k000e0ag00gg0004g800ho00g8&ct=0&ug=8&tl_id=2-A&vs=INTL.33-12-ALB-BKWH.A&cy=2014&vo=0&v=H&start=2000&end=2016>`_)
|
|
|
|
|
2019-08-14 13:36:46 +00:00
|
|
|
.. image:: ../img/hydrogeneration.png
|
2019-08-12 17:01:53 +00:00
|
|
|
:scale: 33 %
|
|
|
|
|
2019-08-11 20:34:18 +00:00
|
|
|
- ``resources/country_shapes.geojson``: confer :ref:`shapes`
|
|
|
|
- ``"cutouts/" + config["renewable"]['hydro']['cutout']``: confer :ref:`cutout`
|
|
|
|
|
2019-08-11 09:40:47 +00:00
|
|
|
Outputs
|
|
|
|
-------
|
|
|
|
|
2019-08-11 20:34:18 +00:00
|
|
|
- ``resources/profile_hydro.nc``:
|
|
|
|
|
2019-08-12 21:48:16 +00:00
|
|
|
=================== ================ =========================================================
|
|
|
|
Field Dimensions Description
|
|
|
|
=================== ================ =========================================================
|
|
|
|
inflow countries, time Inflow to the state of charge (in MW),
|
|
|
|
e.g. due to river inflow in hydro reservoir.
|
|
|
|
=================== ================ =========================================================
|
|
|
|
|
2019-08-14 13:36:46 +00:00
|
|
|
.. image:: ../img/inflow-ts.png
|
2019-08-13 13:48:21 +00:00
|
|
|
:scale: 33 %
|
2019-11-14 16:50:24 +00:00
|
|
|
|
2019-08-14 13:36:46 +00:00
|
|
|
.. image:: ../img/inflow-box.png
|
2019-08-13 13:48:21 +00:00
|
|
|
:scale: 33 %
|
|
|
|
|
2019-08-11 09:40:47 +00:00
|
|
|
Description
|
|
|
|
-----------
|
|
|
|
|
|
|
|
.. seealso::
|
2019-08-12 17:01:53 +00:00
|
|
|
:mod:`build_renewable_profiles`
|
2019-08-08 13:02:28 +00:00
|
|
|
"""
|
2018-01-29 21:28:33 +00:00
|
|
|
|
2019-11-28 07:22:52 +00:00
|
|
|
import logging
|
|
|
|
from _helpers import configure_logging
|
|
|
|
|
2018-01-29 21:28:33 +00:00
|
|
|
import atlite
|
2018-08-03 09:53:14 +00:00
|
|
|
import geopandas as gpd
|
|
|
|
from vresutils import hydro as vhydro
|
2018-01-29 21:28:33 +00:00
|
|
|
|
2020-09-11 10:40:53 +00:00
|
|
|
logger = logging.getLogger(__name__)
|
|
|
|
|
2019-08-08 13:02:28 +00:00
|
|
|
if __name__ == "__main__":
|
2019-12-09 20:29:15 +00:00
|
|
|
if 'snakemake' not in globals():
|
|
|
|
from _helpers import mock_snakemake
|
|
|
|
snakemake = mock_snakemake('build_hydro_profile')
|
2019-11-28 07:22:52 +00:00
|
|
|
configure_logging(snakemake)
|
2019-12-09 20:29:15 +00:00
|
|
|
|
2022-01-24 18:48:26 +00:00
|
|
|
config_hydro = snakemake.config['renewable']['hydro']
|
|
|
|
cutout = atlite.Cutout(snakemake.input.cutout)
|
2019-08-08 13:02:28 +00:00
|
|
|
|
|
|
|
countries = snakemake.config['countries']
|
2022-01-24 18:48:26 +00:00
|
|
|
country_shapes = (gpd.read_file(snakemake.input.country_shapes)
|
Atlite availability (#224)
* adjust buil_cutout.py and Snakefile
* try adjusting build_renewable_profiles, currently crashing due to weird pyproj error
* build_renewable_profiles: -remove printing gid
* build_renewable_profiles: use dask for paralellization, use dense functions
* build_renewable_profiles:
- revise imports
- add logging for long calculation
- revise explaining comment
- revise distance calculation
* build profiles: adjust to cutout.grid
* * fix area to square km
* rename potmatrix -> capacity_potential
* rename available to availibility
* config.default update cutout params
build_renewable_potentials: major refactoring and simplification
hydro_profiles: update code
* build profiles: fix weight output dimensions
* build profiles: fix typo, fix selection of buses
* build profiles: reinsert paths variable
* follow up
* build profiles: move to dask calculation only
* CI: set build cutout to true (add CDSAPI)
* build profiles: use pyproj, test with gleas and geokit upstream
* environment.yaml fix atlite version
* build profiles: use dask 'processes' for more than 25 regions
* build profiles: specify dask scheduler according to number of regions
* backpedal a bit, only allow scheduler='processes'
* follow up, code style and fixup
* build profiles: add logger info for underwater fraction calc
* config adjust cutout parameters
Snakefile fixup
* config.default.yaml: adjust resolution
* config: use one cutout in total
build_cutout: automatic detetection of geographical boundaries
* env: add python>=3.8 requirement
build_cutout: fixup for region bound
* config: allow base cutout
* folllow up, fix up
* follow up II
* clean up
* clean up II
* build profiles: move back to multiprocessing due to performance issues
* small code style corrections
* move in pool context
* swqitch to ratsterio
* switch to rasterio for availibility calculation
* tiny fixup
* * build continental raster for offshore distance calculation
* adjust Snakefile to new script build_raster
* rename continental raster to onshore raster
add projected_mask function (not yet tested)
add docstrings, modularize
* Snakefile: remove build_onhore_raster rule, build mask directly from geometry instead
build_natura_raster: adjust code, add function for exporting
build_profiles:
* add buffer to shore distance to init_globals function
* update docstrings
* improve handling of nodata grid codes
* add geometry mask if natura raster not activated
(the 255 value is an 'eligible' value for the corine data base,
do this for excluding data outside the shape)
* build_profiles: adjust docstrings
* update environment
* build profiles: fixup reproject woth padding
* follow up, small fixups
* fix resampling method
checkpoint: reproduces solar profile in tut data
* reintegrate plot map
code style
* config: rename cutout into "base"
* build profiles: adjust to new atlite code
* natura raster: small fixup
* build natura raster: compress tiff file
* config: adjust cutout names
* build profiles: cover case if no or partial overlap between natura raster and cutout
* config-tutorial: adjust cutout params
* buid-profifiles: fixup in gebco filter
* follow up
* update config files
* build profiles: select layoutmatrix != 0
* build profiles: speed up average_distance and underwaterfraction
* build profiles: fix typo
* update release notes
build_cutout: only build needed features
* update envs
* config: add temperature to sarah features
* temporary fix for atlite v0.2.1 and new xarray version release
* env: remove xarray specification
* * remove rule build_country_flh
* build profiles: remove sneaked in line
* doc: update configuration.rst (section atlite) and corresponding csv table
* release notes: fix quotes
* build profiles: use 3035 for area calculation
* Update envs/environment.docs.yaml
* Update scripts/build_cutout.py
* Update doc/release_notes.rst
Co-authored-by: euronion <42553970+euronion@users.noreply.github.com>
* Update doc/configuration.rst
Co-authored-by: euronion <42553970+euronion@users.noreply.github.com>
* Update scripts/build_cutout.py
Co-authored-by: euronion <42553970+euronion@users.noreply.github.com>
* update release notes
* release notes: add deprecation of 'keep_all_available_areas'
build profiles: remove warning for 'keep_all_available_areas'
* build cutout: rearrage code, set buffer correctly
* Rename tutorial cutout to remove name clash with real cutout.
* Update release_notes.rst: Rename tutorial cutout.
* retrieve: update cutouts and downloads (alternative) (#237)
* retrieve: update cutouts and downloads
* retrieve: remove unnecessary import
* use snakemake remote file functionality
* Snakefile: update zenodo link
* update natura remote link (closes #234)
* env: update atlite version to 0.2.2
* env: fix dask version due to memory issues
* test: retrieve cutout instead of build
* test: use tutorial cutout for CI
Co-authored-by: euronion <42553970+euronion@users.noreply.github.com>
Co-authored-by: Fabian Neumann <fabian.neumann@outlook.de>
2021-04-27 15:58:31 +00:00
|
|
|
.set_index('name')['geometry'].reindex(countries))
|
2019-08-08 13:02:28 +00:00
|
|
|
country_shapes.index.name = 'countries'
|
2018-01-29 21:28:33 +00:00
|
|
|
|
2019-08-08 13:02:28 +00:00
|
|
|
eia_stats = vhydro.get_eia_annual_hydro_generation(snakemake.input.eia_hydro_generation).reindex(columns=countries)
|
2020-10-20 11:53:43 +00:00
|
|
|
|
2020-10-27 10:30:25 +00:00
|
|
|
if len(year) > 0 and year not in eia_stats.index:
|
2020-10-20 11:53:43 +00:00
|
|
|
eia_stats.loc[year] = eia_stats.mean()
|
|
|
|
|
2019-08-08 13:02:28 +00:00
|
|
|
inflow = cutout.runoff(shapes=country_shapes,
|
2020-09-11 10:40:53 +00:00
|
|
|
smooth=True,
|
|
|
|
lower_threshold_quantile=True,
|
|
|
|
normalize_using_yearly=eia_stats)
|
2018-01-29 21:28:33 +00:00
|
|
|
|
2022-01-14 10:05:15 +00:00
|
|
|
if 'clip_min_inflow' in config_hydro:
|
|
|
|
inflow = inflow.where(inflow > config_hydro['clip_min_inflow'], 0)
|
2018-12-21 12:44:59 +00:00
|
|
|
|
2019-08-08 13:02:28 +00:00
|
|
|
inflow.to_netcdf(snakemake.output[0])
|