You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I expect you're already aware of this @tomwhite , but I wanted to ask whether or not you thought the google-tensorstore project might be useful in cubed. @rabernatsuggested benchmarking its performance against zarr-python + fsspec. Presumably any improvement to the I/O speed would considerably increase the performance of cubed? Stephan recently released an xarray interface to tensorstore but it seems like that's not the right entry point for using it with cubed.
The text was updated successfully, but these errors were encountered:
There were a few challenges due to differences in handling structured arrays, which we use for reductions like mean, but it looks like things would work. We probably will want a way to specify the array storage in the spec so users can select the one they want.
I haven't done any performance testing, but the current branch is sufficiently developed to try that.
I expect you're already aware of this @tomwhite , but I wanted to ask whether or not you thought the google-tensorstore project might be useful in cubed. @rabernat suggested benchmarking its performance against zarr-python + fsspec. Presumably any improvement to the I/O speed would considerably increase the performance of cubed? Stephan recently released an xarray interface to tensorstore but it seems like that's not the right entry point for using it with cubed.
The text was updated successfully, but these errors were encountered: