[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[RFC 24/24] python: benchmark new backup architecture
From: |
Vladimir Sementsov-Ogievskiy |
Subject: |
[RFC 24/24] python: benchmark new backup architecture |
Date: |
Fri, 15 Nov 2019 17:14:44 +0300 |
Benchmark test for the series. This patch is RFC, it would be strange
to commit it as is.. On the other hand I feel that we should commit
some example to show usage of simplebench and bench_block_job.
May be I should add some simple example to compare backup and mirror..
Any ideas?
Anyway, this patch is here to show, how I produced the table in the
series cover-letter.
Note that all used images are 1000M files filled by ones, including
images exported by two running NBD servers, and NBD servers are running
as:
qemu-nbd --persistent --nocache -p 10810 ones1000M-source
qemu-nbd --persistent --nocache -p 10809 ones1000M-target
Signed-off-by: Vladimir Sementsov-Ogievskiy <address@hidden>
---
python/bench-example.py | 93 +++++++++++++++++++++++++++++++++++++++++
1 file changed, 93 insertions(+)
create mode 100755 python/bench-example.py
diff --git a/python/bench-example.py b/python/bench-example.py
new file mode 100755
index 0000000000..fb4c61c968
--- /dev/null
+++ b/python/bench-example.py
@@ -0,0 +1,93 @@
+#!/usr/bin/env python3
+
+import simplebench
+from qemu.bench_block_job import bench_block_copy, drv_file, drv_nbd
+
+
+def bench_func(env, case):
+ return bench_block_copy(env['qemu_binary'], env['cmd'],
+ case['source'], case['target'])
+
+
+test_cases = [
+ {
+ 'id': 'ssd -> ssd',
+ 'source': drv_file('/ssd/ones1000M-source'),
+ 'target': drv_file('/ssd/ones1000M-target')
+ },
+ {
+ 'id': 'ssd -> hdd',
+ 'source': drv_file('/ssd/ones1000M-source'),
+ 'target': drv_file('/test-a/ones1000M-target')
+ },
+ {
+ 'id': 'hdd -> hdd',
+ 'source': drv_file('/test-a/ones1000M-source'),
+ 'target': drv_file('/test-a/ones1000M-target')
+ }
+]
+
+test_envs = [
+ {
+ 'id': 'backup-old',
+ 'cmd': 'blockdev-backup',
+ 'qemu_binary':
'/work/src/qemu/up-block-copy-block-status--before/x86_64-softmmu/qemu-system-x86_64'
+ },
+ {
+ 'id': 'backup-old(no CR)',
+ 'cmd': 'blockdev-backup',
+ 'qemu_binary':
'/work/src/qemu/up-block-copy-block-status--before--no-copy-range/x86_64-softmmu/qemu-system-x86_64'
+ },
+ {
+ 'id': 'backup-new',
+ 'cmd': 'blockdev-backup',
+ 'qemu_binary':
'/work/src/qemu/up-block-copy-block-status/x86_64-softmmu/qemu-system-x86_64'
+ },
+ {
+ 'id': 'backup-new(no CR)',
+ 'cmd': 'blockdev-backup',
+ 'qemu_binary':
'/work/src/qemu/up-block-copy-block-status--no-copy_range/x86_64-softmmu/qemu-system-x86_64'
+ },
+ {
+ 'id': 'mirror',
+ 'cmd': 'blockdev-mirror',
+ 'qemu_binary':
'/work/src/qemu/up-block-copy-block-status/x86_64-softmmu/qemu-system-x86_64'
+ }
+]
+
+result = simplebench.bench(bench_func, test_envs, test_cases, count=3)
+print(simplebench.ascii(result))
+
+test_cases = [
+ {
+ 'id': 'nbd -> ssd',
+ 'source': drv_nbd('172.16.24.200', '10810'),
+ 'target': drv_file('/ssd/ones1000M-target')
+ },
+ {
+ 'id': 'ssd -> nbd',
+ 'source': drv_file('/ssd/ones1000M-target'),
+ 'target': drv_nbd('172.16.24.200', '10809')
+ },
+]
+
+test_envs = [
+ {
+ 'id': 'backup-old',
+ 'cmd': 'blockdev-backup',
+ 'qemu_binary':
'/work/src/qemu/up-block-copy-block-status--before/x86_64-softmmu/qemu-system-x86_64'
+ },
+ {
+ 'id': 'backup-new',
+ 'cmd': 'blockdev-backup',
+ 'qemu_binary':
'/work/src/qemu/up-block-copy-block-status/x86_64-softmmu/qemu-system-x86_64'
+ },
+ {
+ 'id': 'mirror',
+ 'cmd': 'blockdev-mirror',
+ 'qemu_binary':
'/work/src/qemu/up-block-copy-block-status/x86_64-softmmu/qemu-system-x86_64'
+ }
+]
+
+result = simplebench.bench(bench_func, test_envs, test_cases, count=2)
+print(simplebench.ascii(result))
--
2.21.0
- [RFC 19/24] blockjob: add set_speed to BlockJobDriver, (continued)
- [RFC 19/24] blockjob: add set_speed to BlockJobDriver, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 16/24] block/block-copy: add max_chunk and max_workers paramters, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 09/24] block/block-copy: alloc task on each iteration, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 15/24] block/block-copy: implement block_copy_async, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 23/24] python: add qemu/bench_block_job.py, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 17/24] block/block-copy: add ratelimit to block-copy, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 14/24] block/block-copy: More explicit call_state, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 18/24] block/block-copy: add block_copy_cancel, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 01/24] block/block-copy: specialcase first copy_range request, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 05/24] block/block-copy: rename start to offset in interfaces, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 24/24] python: benchmark new backup architecture,
Vladimir Sementsov-Ogievskiy <=
- [RFC 08/24] block/block-copy: rename in-flight requests to tasks, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 10/24] block/block-copy: add state pointer to BlockCopyTask, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 06/24] block/block-copy: reduce intersecting request lock, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 02/24] block/block-copy: use block_status, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 07/24] block/block-copy: hide structure definitions, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 22/24] python: add simplebench.py, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 11/24] block/block-copy: move task size initial calculation to _task_create, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 04/24] block/block-copy: refactor interfaces to use bytes instead of end, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 13/24] block/block-copy: use aio-task-pool API, Vladimir Sementsov-Ogievskiy, 2019/11/15
- [RFC 21/24] backup: move to block-copy, Vladimir Sementsov-Ogievskiy, 2019/11/15