We are excited to announce the release of Alluxio 2.4.1-1! This is the first edge release for Alluxio open source with faster release cycles compared to previous quarterly release cadence. This edge release contains a variety of feature enhancements, bug fixes, and performance improvements over the existing Alluxio 2.4 line.
Support JNI-based FUSE integration
Previously, Alluxio integration with FUSE was implemented through a third party library JNR-FUSE, which is no longer maintained. Since 2.4.1-1, Alluxio supports new and native integration without JNR-Fuse, based on native integration using JNI (Java Native Interface). This new JNI-based FUSE integration is more performant, scalable, and able to leverage system buffer cache, contributed by developers from Alluxio, Alibaba, Nanjing University, and Microsoft.
Improve Embedded Journal
This release has a set of critical bug fixes when using embedded journal with catalog service, including:
- Fix crash due to journal entry being too large (6d079972)
- Fix bug in journaling “remove_table” (5b95dcd3)
Integrate with More UFS
A new UFS to connect to ADLS Gen2 and a UFS with new implementation to connect to Tencent COS are added
Other Bug Fixes and Improvement
- Prevent crash due to configuration issue in embedded journal (6d079972)
- Improve the UFS Capacity and used size to human readable (ec878319)
- Fix creating UFS file without a parent directory (81070b98)
- Increase Active Jobs Size for DistributedJobCommands (06f62246)
- Add Grafana Monitoring to metrics docs (37f8005f)
- Remove synchronization on releasing directByteBuffer (75dcd2be)
- Support using IP as connect host (9d0018f8)
- Fix worker pod start failure with changed rpc/data/web ports (2df85815)
Acknowledgment
We would like to thank Yang Che from Alibaba, Chao Wang, Mickey Zhang from Microsoft, and Yili Luo from Nanjing University for the implementation and optimization of the new JNI FUSE integration; Pan Liu, Han Zhang, and Baolong Mao from Tencent for improving Presto related integration and COS integration; and Ce Zhang and Micah Zhao for improving documentation and code style.