thin-provisioning-tools/src/lib.rs

extern crate anyhow;
extern crate byteorder;
extern crate crc32c;
extern crate flate2;
extern crate nom;
extern crate num_cpus;

#[macro_use]
extern crate nix;

#[cfg(test)]
extern crate quickcheck;
#[cfg(test)]
#[macro_use(quickcheck)]
#[cfg(test)]
extern crate quickcheck_macros;

pub mod block_manager;
pub mod check;
pub mod file_utils;
pub mod pack;
pub mod shrink;
pub mod thin;
pub mod version;
[thin_shrink] Write thinp xml format reader and writer. Still need to tidy up the error handling. 2020-06-24 18:02:47 +05:30			`extern crate anyhow;`
[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify) 2020-06-09 13:45:00 +05:30			`extern crate byteorder;`
			`extern crate crc32c;`
			`extern crate flate2;`
			`extern crate nom;`
			`extern crate num_cpus;`

[thin_metadata_{pack/unpack}] Fix get_nr_blocks() It didn't work with block devices. 2020-06-10 19:08:42 +05:30			`#[macro_use]`
			`extern crate nix;`

[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify) 2020-06-09 13:45:00 +05:30			`#[cfg(test)]`
			`extern crate quickcheck;`
			`#[cfg(test)]`
			`#[macro_use(quickcheck)]`
			`#[cfg(test)]`
			`extern crate quickcheck_macros;`

			`pub mod block_manager;`
			`pub mod check;`
[pack/unpack] Get the functional tests working again. There's some hard coded version numbers in the tests, but I'm leaving for now since I'll rewrite in Rust to avoid too much of a proliferation of languages. 2020-06-09 17:33:39 +05:30			`pub mod file_utils;`
[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify) 2020-06-09 13:45:00 +05:30			`pub mod pack;`
[thin_shrink] Write thinp xml format reader and writer. Still need to tidy up the error handling. 2020-06-24 18:02:47 +05:30			`pub mod shrink;`
[thin_shrink] write test harness 2020-06-26 21:14:47 +05:30			`pub mod thin;`
[rust tools] Get the tools version from autoconf 2020-06-09 14:53:52 +05:30			`pub mod version;`