Potential for adapting Pythia Foundations for different disciplines (e.g., neuro)

Tom, that sounds like a good plan. I have scratched my head about why dask/xarrays have not caught on more in neuro. One notable exception is the minan package for calcium imaging analysis which was really well designed: GitHub - denisecailab/minian: miniscope analysis pipeline with interactive visualizations

I honestly have considered helping to support that project partly because the main dev who built it, and did a great job, graduated so it seems to not be getting much support currently.

I think what neuro needs is outreach and education and simple tutorials on xarrays because we are just starting to appreciate the needs for out of core computation that the geosciences have been handling forever. A library that I worked on a lot used memmapping but it is basically a relic – memmapping is basically an os-specific black box that nobody understands. xarrays are much more transparent, cloud-friendly, etc (as you know).

Plus, with things like Cubed (which I see you are a contributor to!), we can have bounded computations which is a big issue with some of our ridiculously long movies where we do things like nonnegative matrix factorization.

Building out a proof of concept with Minian, and cubed, with some really large movies, showing how it works from laptop to cloud, would be a pretty amazing use case I think. :slightly_smiling_face:

This is where the field needs to go IMO, I’d definitely be interested in chatting more.

3 Likes