S3QL is a file system that stores all its data online. It supports Amazon S3, Google Storage, and OpenStack and effectively provides you with a hard disk of dynamic, infinite capacity that can be accessed from any computer with Internet access. S3QL provides a standard, full featured Unix file system that is conceptually indistinguishable from any local file system. Additional features include compression, encryption, data de-duplication, immutable trees, and snapshotting, which make it especially suitable for online backup and archiving. The design favors simplicity and elegance over performance and feature-creep. Care has been taken to make the source code as readable and serviceable as possible. Solid error detection, error handling, and extensive automated test cases are provided.
Release Notes: Attempts to upgrade a filesystem that is already at the newest revision no longer render the local metadata copy unusable. Google storage bucket names containing dots no longer cause problems with SSL certificate validation. Fixes a crash when statvfs() is called on an almost empty file system. There is a new “swiftks” backend for OpenStack/Swift servers. Eliminates a race condition that could lead to mount.s3ql crashing with a “KeyError in collections/abc.py”. Fixes a crash that could occur when trying to clean up after receiving a connection or server error when uploading an object.
Tags: FUSE, Compression, File system, backup, storage, encrypted backup, encryption, de-duplication
Original news: http://freecode.com/projects/s3ql