Commit Graph

3058 Commits

Author SHA1 Message Date
Fabian Neumann
9f1950411c ci: revert to 5 regions 2023-03-09 12:12:19 +01:00
Fabian Neumann
0d03cbc84f Merge branch 'sec-subset-countries' into merge-pypsa-eur-sec 2023-03-09 12:02:29 +01:00
Fabian Neumann
47a65f07f3 ci: add --rerun-triggers=mtime to improve caching 2023-03-09 12:01:19 +01:00
Fabian Neumann
db83d5608f
Merge pull request #623 from PyPSA/sec-subset-countries
Run also sector-coupled build part for subset of countries
2023-03-09 11:53:29 +01:00
Fabian Neumann
bfbc9e322a Merge branch 'sec-subset-countries' of github.com:PyPSA/pypsa-eur into sec-subset-countries 2023-03-09 11:52:14 +01:00
Fabian Neumann
15a152d02d keep CI running if one OS fails 2023-03-09 11:52:06 +01:00
pre-commit-ci[bot]
3402908834 [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2023-03-09 10:39:59 +00:00
Fabian Neumann
f5edafd00d speed-up CI, just a week rather than a month, 4 nodes, 40H 2023-03-09 11:37:34 +01:00
Fabian Neumann
8f5775d9cc Merge branch 'merge-pypsa-eur-sec' into sec-subset-countries 2023-03-09 11:28:07 +01:00
Fabian Neumann
89a3570c18 sort countries 2023-03-09 11:24:10 +01:00
Fabian Neumann
22846d7b1b sector-coupled: run on subset of selected countries 2023-03-09 11:04:41 +01:00
Fabian
5e4c6fc544 ci: reset data cache number 2023-03-09 09:57:57 +01:00
Fabian
821f9a18dd ci: update actions/checkout 2023-03-09 09:57:57 +01:00
pre-commit-ci[bot]
f128cc3e3c [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2023-03-09 07:36:43 +00:00
Fabian Neumann
483f3e1b82 eliminate manual country code conversion, adjust mock_snakemake to ll wildcard 2023-03-09 08:36:18 +01:00
Fabian Neumann
fe43246522 upload resources and results as artifacts 2023-03-08 20:06:18 +01:00
Fabian Neumann
d32de1629a Merge branch 'merge-pypsa-eur-sec' of github.com:PyPSA/pypsa-eur into merge-pypsa-eur-sec 2023-03-08 19:28:13 +01:00
Fabian Neumann
a1ba3a2c17 new minimum snakemake version is 7.7 2023-03-08 19:28:00 +01:00
pre-commit-ci[bot]
f717ce9d3d [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2023-03-08 18:26:43 +00:00
Fabian Neumann
7405377fd7 snakefmt to Snakefile 2023-03-08 19:22:29 +01:00
Fabian Neumann
bf895de7cc add logfiles to all rules 2023-03-08 19:22:00 +01:00
Fabian Neumann
67f54b98ed add graphviz to environment 2023-03-08 18:47:45 +01:00
Fabian Neumann
d4d517ffab Snakefile: correct indent 2023-03-08 18:45:32 +01:00
Fabian Neumann
6763dbaacc add message for dag rule 2023-03-08 18:45:11 +01:00
Fabian Neumann
76dcf43993 add rule for dag, use shutil to purge outputs 2023-03-08 18:43:52 +01:00
Fabian Neumann
882b79a9ed add a purge rule 2023-03-08 18:15:49 +01:00
Fabian Neumann
abbf91ff9e retrieval rules get retries directive for added robustness 2023-03-08 18:09:31 +01:00
Fabian Neumann
701d3a141a data/bundle files may be ancient 2023-03-08 18:03:49 +01:00
Fabian Neumann
37a063554d make cutouts protected
https://snakemake.readthedocs.io/en/stable/snakefiles/rules.html\#protected-and-temporary-files
2023-03-08 17:56:50 +01:00
Fabian Neumann
4b3372b53b apply snakefmt to rules/ 2023-03-08 17:46:14 +01:00
Fabian Neumann
2d648dac40 correct paths to scripts in .smk files 2023-03-08 17:45:25 +01:00
Fabian Neumann
8eb37bc263 add conda directive to all rules for use with --use-conda 2023-03-08 17:44:25 +01:00
Fabian Neumann
6bae022d44 modularise Snakefile using rules/*.smk files 2023-03-08 17:29:01 +01:00
Fabian
104fc68fb0 allow to disable progressbar 2023-03-07 20:37:47 +01:00
pre-commit-ci[bot]
d45bee628e [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2023-03-07 17:25:45 +00:00
Fabian
b5e8ee979f reenable snakefmt 2023-03-07 18:24:47 +01:00
Fabian
c8fa61e244 Snakefile: replace else statements by if statement to satisfy snakefmt 2023-03-07 18:22:07 +01:00
Fabian
77291f7d64 snakefile: introduce RESOURCES, RESULTS, BENCHMARKS, LOGS paths 2023-03-07 18:11:59 +01:00
Fabian
5cf2b8174a scripts: apply linting fixes 2023-03-07 17:21:00 +01:00
Fabian
a346c9994b ci overnight/myopic: use glpk 2023-03-07 17:03:15 +01:00
pre-commit-ci[bot]
54f0cde490 [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2023-03-07 11:22:08 +00:00
Fabian
5260e0c71f build industrial demand/production: ensure compat with multiprocesses on win/mac 2023-03-07 12:21:47 +01:00
Fabian
2a5acedfee snakefile: fix benchmark path 2023-03-07 12:21:02 +01:00
pre-commit-ci[bot]
0b57626387 [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2023-03-07 09:36:26 +00:00
Fabian
6761c50782 build industrial production: fix partial function in imap 2023-03-07 10:35:21 +01:00
Fabian
e6d1d43555 ci: reactivate windows and mac 2023-03-07 09:15:29 +01:00
Fabian
ba6e0c2e4a move snakemake object out of imap process functions 2023-03-07 08:59:01 +01:00
Fabian Neumann
4e719b99a1 doc: update landing page 2023-03-06 19:49:01 +01:00
Fabian Neumann
85f73c0e62 snakefmt to Snakefile 2023-03-06 19:44:57 +01:00
Fabian Neumann
a16e600f64 reuse compatibility for pypsa-eur-sec code 2023-03-06 19:35:33 +01:00