As the number of high-speed processors that can be packed into a server continues to increase, many IT organizations are about to confront some significant I/O challenges. Each of those processors is ...

When it comes to parallel file systems, few people understand the evolution of challenges better than Sven Oehme, who was part of the original team at IBM building GPFS. Following almost a quarter ...

DeepSeek has released the Fire-Flyer File System (3FS), an open source project that is a parallel file system that improves the efficiency of AI training and inference performance. DeepSeek brings ...

Many of the major advances in HPC have been the result of collaboration between academia and the big government labs. This has been the case with PVFS (Parallel Virtual File System) and its latest ...

Journaling is a widely used technique to increase file system robustness against metadata and/or data corruptions. While the overhead of journaling can be masked by the page cache for small-scale, ...

Just about a year ago, I first mentioned TidyFS, a new, small distributed file system under development by Microsoft Research. Later this week at the Usenix '11 conference, Microsoft researchers ...

One of the great benefits of adopting the Lustre* parallel file system in any environment—HPC or enterprise—is that it’s an open source project with a deep and broad user community in front of it and ...

Forget beards and sandals. The leading open-source file systems are enterprise-class big hitters, with advanced features and massive, often parallel, scalability. Sure, many are under development and ...

The rapid and unabated growth of so-called "unstructured" data has led research firm Gartner to establish a new Magic Quadrant for distributed file systems and object storage. Such systems seek to ...

Last month we began discussing typical file systems, starting first with local and shared file systems, then moving into the network file system. The network file system (also known as a proxy file ...