archived
·
since 2024
TorchFS
An efficient distributed file system for PyTorch workloads.
Distributed systems
Storage
PyTorch
TorchFS
A distributed file system designed around the access patterns of PyTorch training workloads — high-throughput sequential reads of shuffled datasets across many workers.