emo/thin-provisioning-tools
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
4a0582bb5d
thin-provisioning-tools/src/lib.rs

26 lines
420 B
Rust
Raw Normal View History

[thin_shrink] Write thinp xml format reader and writer. Still need to tidy up the error handling.
2020-06-24 18:02:47 +05:30
extern crate anyhow;
[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify)
2020-06-09 13:45:00 +05:30
extern crate byteorder;
extern crate crc32c;
extern crate flate2;
extern crate nom;
extern crate num_cpus;
[thin_metadata_{pack/unpack}] Fix get_nr_blocks() It didn't work with block devices.
2020-06-10 19:08:42 +05:30
#[macro_use]
extern crate nix;
[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify)
2020-06-09 13:45:00 +05:30
#[cfg(test)]
extern crate quickcheck;
#[cfg(test)]
#[macro_use(quickcheck)]
#[cfg(test)]
extern crate quickcheck_macros;
pub mod block_manager;
[thin_check (rust)] factor out pdata/btree.rs
2020-08-03 17:07:32 +05:30
pub mod checksum;
[pack/unpack] Get the functional tests working again. There's some hard coded version numbers in the tests, but I'm leaving for now since I'll rewrite in Rust to avoid too much of a proliferation of languages.
2020-06-09 17:33:39 +05:30
pub mod file_utils;
[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify)
2020-06-09 13:45:00 +05:30
pub mod pack;
[thin_check (rust)] factor out pdata/btree.rs
2020-08-03 17:07:32 +05:30
pub mod pdata;
[thin_shrink] Write thinp xml format reader and writer. Still need to tidy up the error handling.
2020-06-24 18:02:47 +05:30
pub mod shrink;
[thin_shrink] write test harness
2020-06-26 21:14:47 +05:30
pub mod thin;
[rust tools] Get the tools version from autoconf
2020-06-09 14:53:52 +05:30
pub mod version;
Reference in New Issue Copy Permalink