Skip to content

Conversation

simone-silvestri
Copy link
Collaborator

let's see if they work now... Otherwise we can fix the links here.

@navidcy
Copy link
Member

navidcy commented May 22, 2025

https://buildkite.com/clima/climaocean-ci/builds/4157#0196f83f-7b7f-4365-a261-529567e11b3b/183-644

  RequestError: Operation too slow. Less than 1 bytes/sec transferred the last 20 seconds while requesting https://esgf-data2.llnl.gov/thredds/fileServer/user_pub_work/input4MIPs/CMIP6/OMIP/MRI/MRI-JRA55-do-1-5-0/atmos/3hrPt/tas/gr/v20200916/tas_input4MIPs_atmosphericState_OMIP_MRI-JRA55-do-1-5-0_gr_195801010000-195812312100.nc

@simone-silvestri
Copy link
Collaborator Author

Uff, at least the link now works. We can figure out here a solution.

@simone-silvestri
Copy link
Collaborator Author

simone-silvestri commented May 22, 2025

The download is extremely slow even if using the wget file downloaded from the website:

(base) simonesilvestri@Simones-MBP Downloads % bash wget_script_2025-5-21_19-14-57.sh
wget_script_2025-5-21_19-14-57.sh: line 1: /Users/simonesilvestri/Downloads/wget_script_2025-5-21_19-14-57.sh#!/bin/bash: No such file or directory
Running wget_script_2025-5-21_19-14-57.sh version: 0.4
Use wget_script_2025-5-21_19-14-57.sh -h for help.

Script created for 63 file(s)
(The count won't match if you manually edit this file!)

huss_input4MIPs_atmosphericState_OMIP_MRI-JRA55-do-1-5-0_gr_198601010000-198612312100.nc ...Downloading
--2025-05-22 19:13:56--  https://esgf-data2.llnl.gov/thredds/fileServer/user_pub_work/input4MIPs/CMIP6/OMIP/MRI/MRI-JRA55-do-1-5-0/atmos/3hrPt/huss/gr/v20200916/huss_input4MIPs_atmosphericState_OMIP_MRI-JRA55-do-1-5-0_gr_198601010000-198612312100.nc
Resolving esgf-data2.llnl.gov (esgf-data2.llnl.gov)... 198.128.245.139
Connecting to esgf-data2.llnl.gov (esgf-data2.llnl.gov)|198.128.245.139|:443... connected.
HTTP request sent, awaiting response... 504 Gateway Timeout
Retrying.

--2025-05-22 19:14:28--  (try: 2)  https://esgf-data2.llnl.gov/thredds/fileServer/user_pub_work/input4MIPs/CMIP6/OMIP/MRI/MRI-JRA55-do-1-5-0/atmos/3hrPt/huss/gr/v20200916/huss_input4MIPs_atmosphericState_OMIP_MRI-JRA55-do-1-5-0_gr_198601010000-198612312100.nc
Reusing existing connection to esgf-data2.llnl.gov:443.
HTTP request sent, awaiting response... 504 Gateway Timeout
Retrying.

--2025-05-22 19:15:01--  (try: 3)  https://esgf-data2.llnl.gov/thredds/fileServer/user_pub_work/input4MIPs/CMIP6/OMIP/MRI/MRI-JRA55-do-1-5-0/atmos/3hrPt/huss/gr/v20200916/huss_input4MIPs_atmosphericState_OMIP_MRI-JRA55-do-1-5-0_gr_198601010000-198612312100.nc
Reusing existing connection to esgf-data2.llnl.gov:443.
HTTP request sent, awaiting response... 504 Gateway Timeout
Retrying.

--2025-05-22 19:15:34--  (try: 4)  https://esgf-data2.llnl.gov/thredds/fileServer/user_pub_work/input4MIPs/CMIP6/OMIP/MRI/MRI-JRA55-do-1-5-0/atmos/3hrPt/huss/gr/v20200916/huss_input4MIPs_atmosphericState_OMIP_MRI-JRA55-do-1-5-0_gr_198601010000-198612312100.nc
Reusing existing connection to esgf-data2.llnl.gov:443.
HTTP request sent, awaiting response... ^C

We probably need to find a way to ignore the time limit of requests in julia until we find a faster server.
Or maybe find a way to use globus programmatically

@navidcy
Copy link
Member

navidcy commented Jul 18, 2025

353cb83 aims to check whether Oceananigans#ss/fix-indexing-bug resolves the resolves the GPU-related errors.

@navidcy navidcy self-requested a review September 4, 2025 09:16
@navidcy
Copy link
Member

navidcy commented Sep 4, 2025

@simone-silvestri
Copy link
Collaborator Author

simone-silvestri commented Sep 4, 2025

Ah not a bit problem, I think it's because the GPU test removes the file before the CPU test can read it. We can just test on one architecture.

Copy link

codecov bot commented Sep 4, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 23.17%. Comparing base (e1e4ef1) to head (0d5c8b3).
⚠️ Report is 2 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #538      +/-   ##
==========================================
+ Coverage   23.06%   23.17%   +0.10%     
==========================================
  Files          47       47              
  Lines        2844     2844              
==========================================
+ Hits          656      659       +3     
+ Misses       2188     2185       -3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@navidcy navidcy merged commit 05b9d45 into main Sep 4, 2025
24 of 26 checks passed
@navidcy navidcy deleted the ss/reinstate-jra55-tests branch September 4, 2025 10:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants