Last week at SC17, ThinkParQ announced immediate availability of the BeeGFS version 7.0 release candidate. While previous versions of BeeGFS are already running on systems of all kinds and sizes around the globe (including burst buffers, hyper-converged setups and of course dedicated high-performance enterprise storage), this new major release introduces several features that were desired by the BeeGFS community.
BeeGFS 7.0 was designed after we noticed that performance of transparent SSD caching mechanisms for HDDs is still far away from the performance of an all-flash system. This is because transparent SSD caches cannot know which file will be accessed next or which of the less recently accessed files should better not be removed from the cache”, comments Sven Breuner, CEO of ThinkParQ. “With BeeGFS 7.0, the users can now make this decision based on their current projects or their most performance-critical data, and thus really get all-flash performance for their important workloads, while still having the cost-effective capacity of the spinning disks.”
The new storage pools feature combines different types of devices (such as SSDs and HDDs) and allows users to control placement of their data. With this new level of control, users can have their current project pinned to the SSD pool to have the full performance of an all-flash system, while the rest of the data resides on spinning disks, where it also can be accessed directly – all within the same namespace and thus completely transparent for applications.
Another new feature is metadata event logging. It enables capturing of information about which files have been newly created, removed or modified. This can be useful to avoid crawling of large file systems in various cases, especially for backups. And the new BeeGFS performance monitoring service (beegfs-mon) adds BeeGFS performance and usage information to a time series database, which makes it easy for a sysadmin or a user to see how the system or the job performed. From the time series database, the collected data can also easily be integrated into other monitoring solutions, such as Grafana.
As always, the new BeeGFS release supports a wide range of Linux distributions and platforms, including x86, ARM, OpenPOWER and more. Upgrades to the new release for existing users are trivially simple, as sysadmins just need to update the BeeGFS packages to the latest version.