Opening with @neurocy.bsky.social explaining the 'working group' model we're doing for the 3rd PROPL
Post
While there are many digital commons out there for scientific data, the future digital commons must also *compute* using FAIR principles, says @neurocy.bsky.social doi.org/10.1145/3759...
Next up, @deepakcherian.bsky.social presents Icechunk, a storage system that scales with the whole planet!
Deepak's a great example of someone who wouldn't ordinarily attend @sigplan-pldi.bsky.social; he's a 'professional scientist' who has worked on terabyte scale oceanic models, and now maintains important scientific infrastructure like xarray
Each of these massive storage arrays is bespoke, and each consumer repeats huge amounts of computation without any sharing or peer verification. Updates and ingest are also invisible, and so users are exposed to raw filenames and how its partitioned. This is happening with data from NASA, JPL etc!
0 reposts0 likes
No replies yet.