Cloud Dask Kubernetes Setup Issue
I’ve been a user of Pangeo Cloud and its distributed computing capabilities through Dask. The last time I used it (about a year ago), everything was working perfectly. However, I recently tried setting up a Dask cluster using
dask_kubernetes, and I’ve encountered an issue.
Here’s the snippet of code I’ve been using:
from dask.distributed import Client, progress from dask_kubernetes import KubeCluster cluster = KubeCluster() cluster.adapt(minimum=1, maximum=20) client = Client(cluster) print(client)
When I run the above code, I get the following error:
ModuleNotFoundError: No module named 'dask_kubernetes'
Given that this setup worked in the past, I’m wondering:
- Has there been any significant changes to the Pangeo Cloud in the last year that might affect this?
- Is it possible that dask_kubernetes has been deprecated or replaced with another module within the Pangeo Cloud environment?