I rebuilt the Dask scheduler and distributed compute system in Rust. It’s called Frisky. It’s fast, but also very early and could use some adventurous users to hammer on it.
Have fun!
Oh, for xarray it also benefits from being used with dask-array, a reimplementation of dask.array with query optimization and graph generation also in Rust. This is supported by mainline xarray, but only in git main at the moment. Instructions in the example blogpost linked above.
from dask_array.xarray import register
register()
import frisky
client = frisky.hijack(client)
This seems very cool! On getfrisky.dev the menu links to a GitHub repo that seems to be private… are you intending to open source this at some point?
That’s right! My thoughts on this are recorded here: License - Frisky . Frisky is free to use and there aren’t any commercial ambitions around it, but I’m not currently building things in the open, mostly just out of personal perference.