ClimaAtmos-CI
PublicCI for ClimaAtmos.jl
Make some diagnostics lazy
Passed in 1h 6m
Triggered from Webhook
Skip CI If we are only modifying md or .github filesshould_skip_buildkite_pipeline_upload.sh
Waited 48s
Ran in 13s
Build will continue even if previous stage fails
Upload pipelineif [ "gb/lazy_diagnostic" == "main" ] || [ $(buildkite-agent step get "outcome" --step "skip_ci") == "passed" ]; then && buildkite-agent pipeline upload .buildkite/pipeline.yml && fi
Waited 38s
Ran in 8s
init 💻echo $JULIA_DEPOT_PATH && echo "--- Check that ClimaAtmos is developed in Manifest" && julia --check-bounds=yes -e 'using TOML; @assert TOML.parsefile(".buildkite/Manifest-v1.11.toml")["deps"]["ClimaAtmos"][1]["path"] == ".."' && echo "--- Instantiate project" && julia --project -e 'using Pkg; Pkg.add(; url="https://github.com/CliMA/ClimaDiagnostics.jl", rev="gb/assign");' && julia --project -e 'using Pkg; Pkg.instantiate(;verbose=true); Pkg.precompile(); Pkg.status()' && echo "--- Instantiate .buildkite" && julia --project=.buildkite -e 'using Pkg; Pkg.add(; url="https://github.com/CliMA/ClimaDiagnostics.jl", rev="gb/assign");' && julia --project=.buildkite -e 'using Pkg; Pkg.instantiate(;verbose=true); Pkg.precompile(;strict=true); using CUDA; CUDA.precompile_runtime(); Pkg.status()'
Waited 58s
Ran in 3m 32s
💻 Test reproducibility infrastructurejulia --color=yes --project=.buildkite test/unit_reproducibility_infra.jl
Waited 28s
Ran in 53s
💻 single column radiative equilibrium grayjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/single_column_radiative_equilibrium_gray.yml --job_id single_column_radiative_equilibrium_gray
Waited 28s
Ran in 5m 8s
💻 single column radiative equilibrium clearskyjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/single_column_radiative_equilibrium_clearsky.yml --job_id single_column_radiative_equilibrium_clearsky
Waited 28s
Ran in 6m 12s
💻 single column radiative equilibrium clearsky prognostic surface temperaturejulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/single_column_radiative_equilibrium_clearsky_prognostic_surface_temp.yml --job_id single_column_radiative_equilibrium_clearsky_prognostic_surface_temp
Waited 30s
Ran in 6m 13s
💻 single column radiative equilibrium allsky idealized clouds varying insolationjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/single_column_radiative_equilibrium_allsky_idealized_clouds.yml --job_id single_column_radiative_equilibrium_allsky_idealized_clouds
Waited 30s
Ran in 7m 1s
☂️ 1-moment precipitation sanity test single columnjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/single_column_precipitation_test.yml --job_id single_column_precipitation_test
Waited 31s
Ran in 7m 14s
💻 non-orographic gravity wave parameterization unit test 3djulia --color=yes --project=.buildkite test/parameterized_tendencies/gravity_wave/non_orographic_gravity_wave/nogw_test_3d.jl
Waited 31s
Ran in 1m 47s
💻 non-orographic gravity wave parameterization test with MiMA outputjulia --color=yes --project=.buildkite test/parameterized_tendencies/gravity_wave/non_orographic_gravity_wave/nogw_test_mima.jl
Waited 30s
Ran in 3m 36s
💻 non-orographic gravity wave parameterization unit test single columnjulia --color=yes --project=.buildkite test/parameterized_tendencies/gravity_wave/non_orographic_gravity_wave/nogw_test_single_column.jl
Waited 30s
Ran in 1m 12s
💻 orographic gravity wave parameterization unit test for base flux calculationjulia --color=yes --project=.buildkite test/parameterized_tendencies/gravity_wave/orographic_gravity_wave/ogwd_baseflux.jl
Waited 31s
Ran in 1m 27s
💻 orographic gravity wave parameterization unit test for 3d calculationjulia --color=yes --project=.buildkite test/parameterized_tendencies/gravity_wave/orographic_gravity_wave/ogwd_3d.jl
Waited 30s
Ran in 2m 33s
💻 single column non-orographic gravity wave parameterizationjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/single_column_nonorographic_gravity_wave.yml --job_id single_column_nonorographic_gravity_wave
Waited 31s
Ran in 4m 34s
💻 single column hydrostatic balance float64julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/single_column_hydrostatic_balance_ft64.yml --job_id single_column_hydrostatic_balance_ft64 && julia --color=yes --project=.buildkite reproducibility_tests/test_mse.jl --job_id single_column_hydrostatic_balance_ft64 --out_dir single_column_hydrostatic_balance_ft64/output_active
Waited 31s
Ran in 5m 23s
💻 Box hydrostatic balancejulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/box_hydrostatic_balance.yml --job_id box_hydrostatic_balance
Waited 30s
Ran in 6m 35s
💻 3D density currentjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/box_density_current_test.yml --job_id box_density_current_test
Waited 30s
Ran in 18m 38s
💻 Box rcemipii with diagnostic edmfjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/rcemipii_box_diagnostic_edmfx.yml --job_id rcemipii_box_diagnostic_edmfx
Waited 30s
Ran in 11m 35s
🧞 LES ISDAC in a boxjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/les_isdac_box.yml --job_id les_isdac_box
Waited 5m 27s
Ran in 2m 53s
💻 Density current experimentjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/plane_density_current_test.yml --job_id plane_density_current_test
Waited 31s
Ran in 7m 10s
GPU: No Topography Test (2D, Float64, Discrete Balance)julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/plane_no_topography_float64_test.yml --job_id gpu_plane_no_topography_float64_test
Waited 5m 27s
Ran in 29m 35s
GPU: Cosine Hills Test (2D, Float64)julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/plane_cosine_hills_float64_test.yml --job_id gpu_plane_cosine_hills_float64_test
Waited 5m 52s
Ran in 26m 50s
GPU: Cosine Hills Test (Extruded 2D, Float64)julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/extruded_plane_cosine_hills_float64_test.yml --job_id gpu_extruded_plane_cosine_hills_float64_test
Waited 6m 10s
Ran in 12m 17s
GPU: Cosine Hills Test (3D, Float64)julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/box_cosine_hills_float64_test.yml --job_id gpu_box_cosine_hills_float64_test
Waited 6m 14s
Ran in 41m 41s
GPU: Agnesi Mountain Test (2D, Float64)julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/plane_agnesi_mountain_float64_test.yml --job_id gpu_plane_agnesi_mountain_float64_test
Waited 6m 33s
Ran in 33m 9s
GPU: Schar Mountain Test (2D, Float64)julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/plane_schar_mountain_float64_test.yml --job_id gpu_plane_schar_mountain_float64_test
Waited 6m 48s
Ran in 29m 55s
GPU: Schar Mountain Test (2D, Float32)julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/plane_schar_mountain_float32_test.yml --job_id gpu_plane_schar_mountain_float32_test
Waited 7m 7s
Ran in 35m 11s
💻 baroclinic wave check conservationjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/baroclinic_wave_conservation.yml --job_id baroclinic_wave_conservation
Waited 30s
Ran in 7m 46s
💻 baroclinic wave moist check conservationjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/baroclinic_wave_equil_conservation.yml --job_id baroclinic_wave_equil_conservation
Waited 30s
Ran in 11m 51s
💻 baroclinic wave moist check conservation float64julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/baroclinic_wave_equil_conservation_ft64.yml --job_id baroclinic_wave_equil_conservation_ft64
Waited 30s
Ran in 13m 15s
💻 baroclinic wave moist check conservation with sourcesjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/baroclinic_wave_equil_conservation_source.yml --job_id baroclinic_wave_equil_conservation_source
Waited 30s
Ran in 26m 52s
💻 hydrostatic balance float64julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/hydrostatic_balance_ft64.yml --job_id hydrostatic_balance_ft64
Waited 31s
Ran in 11m 18s
💻 baroclinic wavejulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/baroclinic_wave.yml --job_id baroclinic_wave
Waited 30s
Ran in 11m 40s
💻 no lim baroclinic wave equilmoistjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/baroclinic_wave_equil.yml --job_id baroclinic_wave_equil && julia --color=yes --project=.buildkite reproducibility_tests/test_mse.jl --job_id baroclinic_wave_equil --out_dir baroclinic_wave_equil/output_active
Waited 30s
Ran in 18m 52s
💻 held suarezjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/held_suarez.yml --job_id held_suarez
Waited 30s
Ran in 22m 28s
💻 no lim held suarez equilmoistjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/held_suarez_equil.yml --job_id held_suarez_equil && julia --color=yes --project=.buildkite reproducibility_tests/test_mse.jl --job_id held_suarez_equil --out_dir held_suarez_equil/output_active
Waited 30s
Ran in 28m 32s
☂️ aquaplanet nonequil allsky monin_obukhov varying insol gravity wave (gfdl_restart) high top 1-momentjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/aquaplanet_nonequil_allsky_gw_res.yml --job_id aquaplanet_nonequil_allsky_gw_res && julia --color=yes --project=.buildkite reproducibility_tests/test_mse.jl --job_id aquaplanet_nonequil_allsky_gw_res --out_dir aquaplanet_nonequil_allsky_gw_res/output_active
Waited 30s
Ran in 30m 16s
💻 aquaplanet equil allsky monin_obukhov varying insol gravity wave (raw_topo) high top zonally asymmetricjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/aquaplanet_equil_allsky_gw_raw_zonalasym.yml --job_id aquaplanet_equil_allsky_gw_raw_zonalasym && julia --color=yes --project=.buildkite reproducibility_tests/test_mse.jl --job_id aquaplanet_equil_allsky_gw_raw_zonalasym --out_dir aquaplanet_equil_allsky_gw_raw_zonalasym/output_active
Waited 30s
Ran in 25m 25s
💻 aquaplanet slabocean equilmoist allsky radiation monin_obukhov varying insolationjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/aquaplanet_equil_clearsky_tvinsol_0M_slabocean.yml --job_id aquaplanet_equil_clearsky_tvinsol_0M_slabocean
Waited 30s
Ran in 23m 2s
💻 aquaplanet slabocean equilmoist allsky radiation monin_obukhov varying insolation float64julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/aquaplanet_equil_clearsky_tvinsol_0M_slabocean_ft64.yml --job_id aquaplanet_equil_clearsky_tvinsol_0M_slabocean_ft64
Waited 30s
Ran in 29m 54s
💻 aquaplanet for couplerjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/aquaplanet_for_coupler.yml --job_id aquaplanet_for_coupler
Waited 30s
Ran in 17m 9s
💻 aquaplanet rcemipii with diagnostic edmfjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/rcemipii_sphere_diagnostic_edmfx.yml --job_id rcemipii_sphere_diagnostic_edmfx
Waited 30s
Ran in 25m 34s
💻 baroclinic wave topography (dcmip)julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/baroclinic_wave_topography_dcmip_rs.yml --job_id baroclinic_wave_topography_dcmip_rs
Waited 30s
Ran in 17m 40s
💻 Diagnostic Earth surface elevation spectrajulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/baroclinic_wave_equil_earth.yml --job_id baroclinic_wave_equil_earth
Waited 30s
Ran in 6m 17s
💻 Baroclinic wave equilmoist (Hughes2023 double mountain config)julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/baroclinic_wave_hughes2023.yml --job_id baroclinic_wave_hughes2023
Waited 30s
Ran in 32m 56s
💻 test restart GPUjulia --color=yes --project=.buildkite test/restart.jl
Waited 7m 19s
Ran in 15m 45s
💻 test restartjulia --color=yes --project=.buildkite test/restart.jl --manytests true
Waited 30s
Ran in 27m 36s
💻 test restart GPUjulia --color=yes --project=.buildkite test/restart.jl --manytests true
Waited 7m 19s
Ran in 31m 17s
💻 test restart MPIsrun julia --color=yes --project=.buildkite test/restart.jl
Timed Out
Waited 30s
Ran in 20m 57s
💻 test restart GPU MPIsrun julia --color=yes --project=.buildkite test/restart.jl
Timed Out
Waited 2m 29s
Ran in 20m 57s
💻 Prep restart for MPIsrun julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/mpi_configs/mpi_make_restart.yml --job_id mpi_make_restart
Waited 30s
Ran in 8m 52s
💻 Test restart for MPI baroclinic wavetar xvf mpi_make_restart/output_active/hdf5_files.tar -C mpi_make_restart/output_active && srun julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/mpi_configs/restart_mpi_baroclinic_wave.yml --job_id restart_mpi_baroclinic_wave
Waited 5s
Ran in 10m 3s
💻 MPI no lim aquaplanet equilmoist clearsky radiationsrun julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/mpi_configs/mpi_aquaplanet_equil_clearsky.yml --job_id mpi_aquaplanet_equil_clearsky
Waited 30s
Ran in 13m 11s
💻 Prep for calling remap pipelinesrun julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/mpi_configs/prep_remap.yml --job_id prep_remap
Waited 30s
Ran in 8m 5s
💻 Exercise remap pipelinetar xvf prep_remap/output_active/hdf5_files.tar -C prep_remap/output_active && julia --color=yes --project=.buildkite post_processing/remap/remap_pipeline.jl --data_dir prep_remap/output_active --out_dir remap_pipeline_output
Waited 53s
Ran in 1m 7s
🕴️ EDOnly EDMFX aquaplanetjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/edonly_edmfx_aquaplanet.yml --job_id edonly_edmfx_aquaplanet
Waited 30s
Ran in 11m 46s
🧞 Diagnostic EDMFX test in a boxjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/diagnostic_edmfx_test_box.yml --job_id diagnostic_edmfx_test_box
Waited 30s
Ran in 11m 7s
🧞 Diagnostic EDMFX GABLS in a boxjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/diagnostic_edmfx_gabls_box.yml --job_id diagnostic_edmfx_gabls_box
Waited 30s
Ran in 13m 16s
🧞 Diagnostic EDMFX Bomex in a boxjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/diagnostic_edmfx_bomex_box.yml --job_id diagnostic_edmfx_bomex_box
Waited 30s
Ran in 15m 21s
🧞 Diagnostic EDMFX Bomex stretched grid in a boxjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/diagnostic_edmfx_bomex_stretched_box.yml --job_id diagnostic_edmfx_bomex_stretched_box
Waited 30s
Ran in 14m 55s
🧞 Diagnostic EDMFX DYCOMS_RF01 in a box (explicit)julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/diagnostic_edmfx_dycoms_rf01_explicit_box.yml --job_id diagnostic_edmfx_dycoms_rf01_explicit_box
Waited 30s
Ran in 15m 11s
🧞 Diagnostic EDMFX DYCOMS_RF01 in a boxjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/diagnostic_edmfx_dycoms_rf01_box.yml --job_id diagnostic_edmfx_dycoms_rf01_box
Waited 30s
Ran in 13m 59s
☂️ Diagnostic EDMFX DYCOMS_RF02 in a boxjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/diagnostic_edmfx_dycoms_rf02_box.yml --job_id diagnostic_edmfx_dycoms_rf02_box
Waited 30s
Ran in 14m 17s
☂️ Diagnostic EDMFX Rico in a boxjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/diagnostic_edmfx_rico_box.yml --job_id diagnostic_edmfx_rico_box
Waited 30s
Ran in 14m 58s
☂️ Diagnostic EDMFX TRMM in a boxjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/diagnostic_edmfx_trmm_box.yml --job_id diagnostic_edmfx_trmm_box
Waited 30s
Ran in 12m 22s
☂️ Diagnostic EDMFX TRMM stretched grid in a boxjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/diagnostic_edmfx_trmm_stretched_box.yml --job_id diagnostic_edmfx_trmm_stretched_box
Waited 30s
Ran in 12m 9s
🧞 Diagnostic EDMFX TRMM 0M in a boxjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/diagnostic_edmfx_trmm_box_0M.yml --job_id diagnostic_edmfx_trmm_box_0M
Waited 32s
Ran in 11m 17s
🧞 Diagnostic EDMFX aquaplanetjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/diagnostic_edmfx_aquaplanet.yml --job_id diagnostic_edmfx_aquaplanet && julia --color=yes --project=.buildkite reproducibility_tests/test_mse.jl --job_id diagnostic_edmfx_aquaplanet --out_dir diagnostic_edmfx_aquaplanet/output_active
Waited 32s
Ran in 18m 16s
🧞 Prognostic EDMFX advection test in a columnjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_adv_test_column.yml --job_id prognostic_edmfx_adv_test_column
Waited 32s
Ran in 9m 11s
🧞 Prognostic EDMFX simple plume test in a columnjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_simpleplume_column.yml --job_id prognostic_edmfx_simpleplume_column
Waited 32s
Ran in 9m 29s
🧞 Prognostic EDMFX Soares in a columnjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_soares_column.yml --job_id prognostic_edmfx_soares_column
Waited 32s
Ran in 11m 57s
🧞 Prognostic EDMFX GABLS in a columnjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_gabls_column.yml --job_id prognostic_edmfx_gabls_column
Waited 32s
Ran in 10m 19s
🧞 Prognostic EDMFX Bomex in a column (pi group)julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_bomex_pigroup_column.yml --job_id prognostic_edmfx_bomex_pigroup_column
Waited 32s
Ran in 11m 11s
🧞 Prognostic EDMFX Bomex with precribed TKE in a columnjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_bomex_fixtke_column.yml --job_id prognostic_edmfx_bomex_fixtke_column
Waited 32s
Ran in 10m 57s
🧞 Prognostic EDMFX Bomex stretched grid in a columnjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_bomex_stretched_column.yml --job_id prognostic_edmfx_bomex_stretched_column
Waited 32s
Ran in 10m 59s
🧞 Prognostic EDMFX Bomex in a columnjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_bomex_column.yml --job_id prognostic_edmfx_bomex_column
Waited 32s
Ran in 11m 53s
🧞 Prognostic EDMFX Bomex in a column (implicit)julia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_bomex_implicit_column.yml --job_id prognostic_edmfx_bomex_column_implicit
Waited 32s
Ran in 11m 9s
🧞 Prognostic EDMFX Dycoms RF01 in a columnjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_dycoms_rf01_column.yml --job_id prognostic_edmfx_dycoms_rf01_column
Waited 32s
Ran in 10m 3s
☂️ Prognostic EDMFX Rico in a columnjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_rico_column.yml --job_id prognostic_edmfx_rico_column
Waited 32s
Ran in 2m 33s
☂️ Prognostic EDMFX TRMM in a columnjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_trmm_column.yml --job_id prognostic_edmfx_trmm_column
Waited 32s
Ran in 3m 7s
🧞 Prognostic EDMFX TRMM with 0-moment in a columnjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_trmm_column_0M.yml --job_id prognostic_edmfx_trmm_column_0M
Waited 32s
Ran in 11m 17s
🧞 Prognostic EDMFX GCM driven in a columnjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_gcmdriven_column.yml --job_id prognostic_edmfx_gcmdriven_column
Waited 32s
Ran in 14m 52s
🧞 Prognostic EDMFX Bomex in a boxjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_bomex_box.yml --job_id prognostic_edmfx_bomex_box
Waited 32s
Ran in 21m 7s
🧞 Prognostic EDMFX aquaplanetjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_aquaplanet.yml --job_id prognostic_edmfx_aquaplanet
Waited 32s
Ran in 23m 25s
GPU: Gravity wavesjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/sphere_nonorographic_gravity_wave.yml --job_id sphere_nonorographic_gravity_wave
Waited 7m 19s
Ran in 7m 5s
GPU: baroclinic wavejulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/baroclinic_wave.yml --job_id baroclinic_wave_gpu
Waited 7m 31s
Ran in 7m 12s
GPU: compare BW with CPUtar xvf baroclinic_wave/output_active/hdf5_files.tar -C baroclinic_wave && tar xvf baroclinic_wave_gpu/output_active/hdf5_files.tar -C baroclinic_wave_gpu && julia --color=yes --project=.buildkite post_processing/compare_outputs.jl --output_folder_1 baroclinic_wave --output_folder_2 baroclinic_wave_gpu --t_end 10days --compare_state false
Waited 52s
Ran in 41s
GPU: baroclinic wave - 2 gpusmkdir -p baroclinic_wave_2gpu && srun --cpu-bind=threads --cpus-per-task=4 julia --threads=3 --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/baroclinic_wave.yml --job_id baroclinic_wave_2gpu
Waited 1m 54s
Ran in 9m 3s
GPU: test DYAMOND interpolated initial conditionsjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/gpu_configs/gpu_aquaplanet_dyamond_summer.yml --job_id gpu_aquaplanet_dyamond_summer
Waited 7m 39s
Ran in 16m 53s
GPU: EDOnly EDMFX aquaplanetjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/edonly_edmfx_aquaplanet.yml --job_id edonly_edmfx_aquaplanet_gpu
Waited 7m 53s
Ran in 10m 6s
GPU: Diagnostic EDMFX aquaplanetjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/diagnostic_edmfx_aquaplanet_gpu.yml --job_id diagnostic_edmfx_aquaplanet_gpu
Waited 8m 13s
Ran in 14m 34s
GPU: Prognostic EDMFX aquaplanetjulia --color=yes --project=.buildkite .buildkite/ci_driver.jl --config_file config/model_configs/prognostic_edmfx_aquaplanet.yml --job_id prognostic_edmfx_aquaplanet_gpu
Waited 8m 14s
Ran in 10m 37s
💻 Benchmark: CPU baroclinic wave moistjulia --color=yes --project=.buildkite perf/benchmark_step.jl --config_file config/perf_configs/bm_baroclinic_wave_moist.yml --job_id bm_baroclinic_wave_moist
Waited 32s
Ran in 6m 30s
💻 Benchmark: GPU baroclinic wave moistjulia --color=yes --project=.buildkite perf/benchmark_step.jl --config_file config/perf_configs/bm_baroclinic_wave_moist.yml --job_id bm_baroclinic_wave_moist_gpu
Waited 8m 21s
Ran in 8m 9s
💻 Benchmark: CPU defaultjulia --color=yes --project=.buildkite perf/benchmark.jl --config_file config/perf_configs/bm_default.yml --job_id bm_default
Waited 32s
Ran in 16m 40s
💻 Benchmark: GPU defaultjulia --color=yes --project=.buildkite perf/benchmark.jl --config_file config/perf_configs/bm_default.yml --job_id bm_default_gpu
Waited 8m 26s
Ran in 17m 29s
💻 Benchmark: GPU diag edmfjulia --color=yes --project=.buildkite perf/benchmark.jl --config_file config/perf_configs/bm_aquaplanet_diagedmf.yml --job_id bm_diag_edmf_gpu
Waited 8m 26s
Ran in 26m 15s
💻 Benchmark: GPU prog edmfjulia --color=yes --project=.buildkite perf/benchmark.jl --config_file config/perf_configs/bm_aquaplanet_progedmf.yml --job_id bm_prog_edmf_gpu
Waited 8m 52s
Ran in 27m 26s
🔥 Flame graph: gpu jobjulia --color=yes --project=.buildkite perf/flame.jl --config_file config/perf_configs/bm_baroclinic_wave_moist.yml --job_id flame_baroclinic_wave_moist_gpu
Waited 8m 59s
Ran in 13m 36s
🔥 Flame graph: perf target julia --color=yes --project=.buildkite perf/flame.jl --config_file config/perf_configs/bm_default.yml --job_id flame_default
Waited 32s
Ran in 16m 11s
🔥 Flame graph: 1 momentjulia --color=yes --project=.buildkite perf/flame.jl --config_file config/perf_configs/bm_default_1m.yml --job_id flame_default_1m
Waited 32s
Ran in 19m 2s
🔥 Flame graph: diagnosticsjulia --color=yes --project=.buildkite perf/flame.jl --config_file config/perf_configs/bm_diagnostics.yml --job_id flame_diagnostics
Waited 32s
Ran in 16m 31s
🔥 Flame graph: diagnostics edmfjulia --color=yes --project=.buildkite perf/flame.jl --config_file config/perf_configs/bm_aquaplanet_diagedmf.yml --job_id flame_aquaplanet_diagedmf
Waited 32s
Ran in 20m 47s
🔥 Flame graph: prognostic edmfjulia --color=yes --project=.buildkite perf/flame.jl --config_file config/perf_configs/bm_aquaplanet_progedmf.yml --job_id flame_aquaplanet_progedmf
Waited 32s
Ran in 28m 47s
🔥 Flame graph: diffusionjulia --color=yes --project=.buildkite perf/flame.jl --config_file config/perf_configs/bm_diffusion.yml --job_id flame_diffusion
Waited 32s
Ran in 15m 36s
🔥 Flame graph: perf target (Callbacks)julia --color=yes --project=.buildkite perf/flame.jl --config_file config/perf_configs/bm_callbacks.yml --job_id flame_callbacks
Waited 32s
Ran in 25m 7s
🔥 Flame graph: gravity wavejulia --color=yes --project=.buildkite perf/flame.jl --config_file config/perf_configs/bm_gravity_wave.yml --job_id flame_gravity_wave
Waited 32s
Ran in 26m 22s
💻 checkboundsjulia --color=yes --check-bounds=yes --project=.buildkite perf/benchmark.jl --config_file config/perf_configs/bm_default.yml --job_id checkbounds
Waited 32s
Ran in 35m 48s
🚀 JET n-failures (inference)julia --color=yes --project=.buildkite perf/jet_test_nfailures.jl --config_file config/perf_configs/bm_default.yml --job_id jet_n_failures
Waited 32s
Ran in 12m 49s
🔍🚀 Invalidationsjulia --color=yes --project=.buildkite perf/invalidations.jl --config_file config/perf_configs/bm_default.yml
Waited 32s
Ran in 10m 47s
Build will continue even if previous stage fails
🤖 Print new mse tablesjulia --color=yes --project=.buildkite reproducibility_tests/mse_summary.jl
Waited 33s
Ran in 4s
🤖 Print new reference counterjulia --color=yes --project=.buildkite reproducibility_tests/print_new_ref_counter.jl
Waited 33s
Ran in 4s
📊 Tabulate performance summaryjulia --color=yes --project=.buildkite perf/tabulate_perf_summary.jl
Waited 33s
Ran in 12s
🤖 Move main resultsjulia --color=yes --project=.buildkite reproducibility_tests/move_output.jl
Waited 48s
Ran in 5s
Total Job Run Time: 1d 3h