How to parallel write zarr file on dask? #2959
Replies: 2 comments
-
Since you mentioned NetCDF, I'm going to guess you're using Xarray import xarray as xr
ds = xr.open_mfdataset(list_of_netcdf_files)
ds.to_zarr("out.zarr") |
Beta Was this translation helpful? Give feedback.
0 replies
-
Yes, I am using xarray, Thank you very much. It's simple and efficient. I try write these files one by one. So it's complex and difficult. I have succeed by write them once. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I want to writea a lot of netcdf files into one zarr file on dask. But I met something wrong. It seems like the metadata confliction. I try a lots methods. But there are always some problems. What's the best way to write zarr file in parallel on dask? Any suggestion is helpful. Thanks.
Beta Was this translation helpful? Give feedback.
All reactions