emo/thin-provisioning-tools
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
5abb92838c
thin-provisioning-tools/src/lib.rs

31 lines
497 B
Rust
Raw Normal View History

[thin_shrink] Write thinp xml format reader and writer. Still need to tidy up the error handling.
2020-06-24 18:02:47 +05:30
extern crate anyhow;
[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify)
2020-06-09 13:45:00 +05:30
extern crate byteorder;
extern crate crc32c;
extern crate flate2;
extern crate nom;
extern crate num_cpus;
[thin_metadata_{pack/unpack}] Fix get_nr_blocks() It didn't work with block devices.
2020-06-10 19:08:42 +05:30
#[macro_use]
extern crate nix;
[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify)
2020-06-09 13:45:00 +05:30
#[cfg(test)]
extern crate quickcheck;
#[cfg(test)]
#[macro_use(quickcheck)]
#[cfg(test)]
extern crate quickcheck_macros;
[functional-tests] port some of the cache_check tests to Rust
2020-08-07 19:00:00 +05:30
pub mod cache;
[thin_check (rust)] factor out pdata/btree.rs
2020-08-03 17:07:32 +05:30
pub mod checksum;
[pack/unpack] Get the functional tests working again. There's some hard coded version numbers in the tests, but I'm leaving for now since I'll rewrite in Rust to avoid too much of a proliferation of languages.
2020-06-09 17:33:39 +05:30
pub mod file_utils;
[thin_check (rust)] Provide 3 different report types. ProgressBar for interactive use. Simple for when not a tty and quiet for -q
2020-08-17 17:38:29 +05:30
pub mod io_engine;
Lot's of work on thin_restore
2021-03-24 19:50:20 +05:30
pub mod math;
[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify)
2020-06-09 13:45:00 +05:30
pub mod pack;
[thin_check (rust)] factor out pdata/btree.rs
2020-08-03 17:07:32 +05:30
pub mod pdata;
[thin_check (rust)] Provide 3 different report types. ProgressBar for interactive use. Simple for when not a tty and quiet for -q
2020-08-17 17:38:29 +05:30
pub mod report;
[thin_shrink] Write thinp xml format reader and writer. Still need to tidy up the error handling.
2020-06-24 18:02:47 +05:30
pub mod shrink;
[thin_shrink] write test harness
2020-06-26 21:14:47 +05:30
pub mod thin;
[rust tools] Get the tools version from autoconf
2020-06-09 14:53:52 +05:30
pub mod version;
work in progress
2020-11-04 18:08:35 +05:30
pub mod write_batcher;
[cache (rust)] Add visitor traits for cache_restore
2021-05-18 12:50:23 +05:30
pub mod xml;
Reference in New Issue Copy Permalink