• Energy Research

1. Contents Available variables in KNMI-LENTIS request-overview-CMIP-historical-including-EC-EARTH-AOGCM-preferences.txt Where is the data deposited on the ECWMF's tape storage (section 4) LENTIS_on_ECFS.zip Data of all variables for 1 year for 1 ensemble member (section 5) tree_of_files_one_member_all_data.txt {AERmon,Amon,Emon,LImon,Lmon,Ofx,Omon,SImon,fx,Eday,Oday,day,CFday,3hr,6hrPlev,6hrPlevPt}.zip 2. Description of this Zenodo dataset This Zenodo dataset pertains to the full KNMI-LENTIS dataset: a large ensemble of simulations with the Global Climate Model EC-Earth3. The periods are for the present-day period (2000-2009) and a future +2K period (2075-2084 following SSP2-4.5). KNMI-LENTIS has 1600 simulated years for both the two climates. This level of sampled climate variability allows for robust and in-depth research into extreme events. The available variables are listed in the file request-overview-CMIP-historical-including-EC-EARTH-AOGCM-preferences.txt. All variables are cmorised following CMIP6 data format convention. Further details on the variables and their output dimensions is available via the following search tool. The total size of KNMI-LENTIS is 128 TB. KNMI-LENTIS is stored at the high performance storage system of the ECMWF (ECFS). The Global Climate Model that is used for generating this Large Ensemble is EC-Earth3 - VAREX project branch https://svn.ec-earth.org/ecearth3/branches/projects/varex (access restricted to ECMWF members). The goal of this Zenodo dataset is : to provide an accurate description and example of how the KNMI-LENTIS dataset is organised. to describe in which servers the data are deposited and how to gain access to the data for future users to provide links to related git repositories and other content relating to the KNMI-LENTIS production 3. How KNMI-LENTIS is organised KNMI-LENTIS consists of 2 times 160 runs of 10 years. All simulations have a unique ensemble member label that reflects the forcing, and how the initial conditions are generated. The initial conditions have two aspects: the parent simulation from which the run is branched (macro perturbation, there are 16), and the seed relating to a particular micro-perturbation in the initial three-dimensional atmosphere temperature field (there are 10). The ensemble member label thus is a combination of: forcing (h for present-day/historical and s for +2K/SSP2-4.5) parent ID (number between 1 and 16) micro perturbation ID (number between 0 and 9) In this Zenodo dataset we publish 1 year from 1 member to give insight into the type of data and metadata that is representative of the full KNMI-LENTIS dataset. The published data is year 2000 from member h010. See Section 4 Further, all KNMI-LENTIS simulations are labeled per the CMIP6 convention of variant labelling. A variant label is made from four components: the realization index r, the initialization index i, the physics index p and the forcing index f. Further details on CMIP6 variant labelling be found in The CMIP6 Participation Guidance for Modelers. In the KNMI-LENTIS data set, the forcing is reflected in the first digit of the realization index r of the variant label. For the historical simulations, the one thousands (r1000-r1999) have been reserved. For the SSP2-4.5 the five thousands (r5000-r5999) have been reserved. The parent is reflected in the second and third digit of the realization index r of the variant label (r?01?-r?16?). The seed is reflected in the fourth digit of the realization index r: (r???0-r???9). The seed is also reflected in the initialization index i of the variant label (i0-i9), so this is double information. The physics index p5 has been reserved for the ECE3p5 version: all KNMI-LENTIS simulations have the p5 label. The forcing index f of the variant label is kept at 1 for all KNMI-LENTIS simulations. As an example, variant label r5119i9p5f1 refers to: the 2K time slice with parent 11 and randomizing seed number 9. The physics index is 5, meaning the run is done with the ECE3p5 version of EC-Earth3. 4. Where is the data deposited on the ECWMF's tape storage In this Zenodo folder, there are several text files and several netcdf files. The text files provide Data from KNMI-LENTIS is deposited in the ECMWF ECFS tape storage system. Data can be freely downloaded by to those who have access to the ECMWF ECFS. Else, the data can be made available by the authors upon request. The way the dataset is organised is detailed in LENTIS_on_ECFS.zip. This contains details on all available KNMI-LENTIS files, in particular details for how these are filed in ECFS. The files on ECFS are tar zipped per ensemble member & variable: these contain 10 years of ensemble member data (10 separate netcdf files). The location on ECFS of the tar-zipped files that are listed in the various text files in this Zenodo dataset is ec:/nklm/LENTIS/ec-earth/cmorised_by_var/ #!/bin/bash #------------------- # script to write out LENTIS details on ECFS #------------------- for freq in AERmon Amon Emon LImon Lmon Ofx Omon SImon fx Eday Oday day CFday 3hr 6hrPlev 6hrPlevPt; do for scen in hxxx sxxx; do els -l ec:/nklm/LENTIS/ec-earth/cmorised_by_var/${scen}/${freq}/* >> LENTIS_on_ECFS_${scen}_${freq}.txt done done Further, part of the data will be made publicly available from the Earth System Grid Federation (ESGF) data portal. We aim to upload most of the monthly variables for the full ensemble. As search terms use EC-Earth for model and p5 for physical index to locate the KNMI-LENTIS data. 5. Data of all variables for 1 year for 1 ensemble member The netcdf files of the data of 1 year from 1 member h010 are published here to give insight into the type of data and metadata that is representative of the full KNMI-LENTIS dataset. The data are in zipped folders per output frequencies: AERmon, Amon, Emon, LImon, Lmon, Ofx, Omon, SImon, fx, Eday, Oday, day, CFday, 3hr, 6hrPlev, 6hrPlevPt. The text file request-overview-CMIP-historical-including-EC-EARTH-AOGCM-preferences.txt gives an overview of variables available per output frequency. the text files tree_of_files_one_member_all_data.txt gives an overview of the files in the zipped folders. 6. Related links The production of the KNMI-LENTIS ensemble was funded by the KNMI (Royal Dutch Meteorological Institute) multi-year strategic research fund KNMI MSO Climate Variability And Extremes (VAREX) GitHub repository corresponding to this Zenodo dataset: https://github.com/lmuntjewerf/KNMI-LENTIS_dataset_description.git Github repository for KNMI-LENTIS production code: https://github.com/lmuntjewerf/KNMI-LENTIS_production_script_train.git

KNMI-LENTIS production scripts These are the scrips used in the production of the KNMI-LENTIS (Large Ensemble Time Slice) dataset. The dataset is documented in this repository: https://github.com/lmuntjewerf/KNMI-LENTIS_dataset_description The Global Climate Model that is used for generating this Large Ensemble is EC-Earth3 - VAREX project branch https://svn.ec-earth.org/ecearth3/branches/projects/varex The contents of the zip file are listed in `tree.txt`. Sections 1. Preprocessing Preprocessing in preparation for running the ensemble consists of: generating initial condition files and setting up a framework to access them efficiently set up a framework of submit folders for each ensemble member 2. Compiling This folder contains the wrapper to submit the compilation job for EC-Earth3 on ECMWF's HPC cca. 3. Running All ensemble members have an own run directory as generated in [01_preprocessing/02_submit_folders]. The running folder, in operational state, contained softlinks to all these submit directories and a softlink to the EC-Earth3 code base. It further contains the wrapper template to sumbit the simulation (copy this file in the rundir/classic folder). 4. Postprocessing All raw EC-Earth3 output from the ensemble members is cmorized following CMIP6 data format convention. The scripts in this folder detail the cmorization process. 5. Validation Purpose of the validation is to check the cmorization output. If there were any problems with the raw EC-Earth run, it will show up by consequence. Further it performs a checksum and an nctime. Also it rewrites the datestamp on the cmor files to 01/06/2022, such that all have the same name. 6. HPSS KNMI-LENTIS is stored at the high performance storage system of the ECMWF (ECFS). The scripts in this folder detail the storing process. 7. ECtrans ECtrans is unattended file transfer between the ECMWF servers and the member state servers. This is helpfull for transferring large amounts of data from the ECFS tape storage.