Dask in Rust -- Frisky

[mrocklin]

I rebuilt the Dask scheduler and distributed compute system in Rust. It’s called Frisky. It’s fast, but also very early and could use some adventurous users to hammer on it.

• Here is a general overview: Why - Frisky
• Here is an example with Xarray: Frisky and Xarray Example - Matthew Rocklin
• Here is an introductory video: Frisky and Xarray Introductory Video

Have fun!

[mrocklin]

Oh, for xarray it also benefits from being used with dask-array, a reimplementation of dask.array with query optimization and graph generation also in Rust. This is supported by mainline xarray, but only in git main at the moment. Instructions in the example blogpost linked above.

from dask_array.xarray import register
register()

import frisky
client = frisky.hijack(client)