[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Qemu-block] [PATCH 2/6] tests/qemu-iotests/group: Introduce a new "ci"
From: |
Thomas Huth |
Subject: |
[Qemu-block] [PATCH 2/6] tests/qemu-iotests/group: Introduce a new "ci" group for CI pipelines |
Date: |
Wed, 24 Apr 2019 12:37:43 +0200 |
Tests in this group are supposed to run in every possible QEMU configuration.
That means they should run with every QEMU binary (also non-x86), without
dependencies on an optional features, they must work at least with the qcow2
image format and be able to run on all kind of host filesystems and users
(i.e. also as "nobody" or "root").
The initial list has been created as a subset of the "quick" group, where
I've disabled all tests that are failing with qemu-system-aarch64 or
qemu-system-tricore or in one of our CI pipelines.
Signed-off-by: Thomas Huth <address@hidden>
---
tests/qemu-iotests/group | 194 ++++++++++++++++++++-------------------
1 file changed, 102 insertions(+), 92 deletions(-)
diff --git a/tests/qemu-iotests/group b/tests/qemu-iotests/group
index bae7718380..2ed42dcc14 100644
--- a/tests/qemu-iotests/group
+++ b/tests/qemu-iotests/group
@@ -4,63 +4,73 @@
# - do not start group names with a digit
#
+#
+# Some notes about the groups:
+# - Tests in the "quick" group should finish within some few seconds
+# - Tests in the "ci" group are suitable for running in CI systems. That
+# means they should run with every QEMU binary (also non-x86), with
+# every QEMU configuration (i.e. no dependency on an optional feature),
+# at least with the qcow2 image format and all kind of host filesystems
+# and users (i.e. also as "nobody" or "root").
+#
+
#
# test-group association ... one line per test
#
-001 rw auto quick
-002 rw auto quick
+001 rw auto quick ci
+002 rw auto quick ci
003 rw auto
-004 rw auto quick
-005 img auto quick
+004 rw auto quick ci
+005 img auto quick ci
# 006 was removed, do not reuse
007 snapshot auto
-008 rw auto quick
-009 rw auto quick
-010 rw auto quick
-011 rw auto quick
-012 auto quick
+008 rw auto quick ci
+009 rw auto quick ci
+010 rw auto quick ci
+011 rw auto quick ci
+012 auto quick ci
013 rw auto
014 rw auto
015 rw snapshot auto
# 016 was removed, do not reuse
-017 rw backing auto quick
-018 rw backing auto quick
-019 rw backing auto quick
-020 rw backing auto quick
-021 io auto quick
+017 rw backing auto quick ci
+018 rw backing auto quick ci
+019 rw backing auto quick ci
+020 rw backing auto quick ci
+021 io auto quick ci
022 rw snapshot auto
023 rw auto
-024 rw backing auto quick
-025 rw auto quick
+024 rw backing auto quick ci
+025 rw auto quick ci
026 rw blkdbg auto
-027 rw auto quick
+027 rw auto quick ci
028 rw backing auto quick
-029 rw auto quick
+029 rw auto quick ci
030 rw auto backing
-031 rw auto quick
-032 rw auto quick
-033 rw auto quick
-034 rw auto backing quick
-035 rw auto quick
-036 rw auto quick
-037 rw auto backing quick
-038 rw auto backing quick
-039 rw auto quick
+031 rw auto quick ci
+032 rw auto quick ci
+033 rw auto quick ci
+034 rw auto backing quick ci
+035 rw auto quick ci
+036 rw auto quick ci
+037 rw auto backing quick ci
+038 rw auto backing quick ci
+039 rw auto quick ci
040 rw auto
041 rw auto backing
-042 rw auto quick
+042 rw auto quick ci
043 rw auto backing
044 rw auto
045 rw auto quick
-046 rw auto aio quick
-047 rw auto quick
-048 img auto quick
+046 rw auto aio quick ci
+047 rw auto quick ci
+048 img auto quick ci
049 rw auto
-050 rw auto backing quick
+050 rw auto backing quick ci
051 rw auto
-052 rw auto backing quick
-053 rw auto quick
-054 rw auto quick
+052 rw auto backing quick ci
+053 rw auto quick ci
+054 rw auto quick ci
055 rw auto
056 rw auto backing
057 rw auto
@@ -68,19 +78,19 @@
059 rw auto quick
060 rw auto quick
061 rw auto
-062 rw auto quick
-063 rw auto quick
+062 rw auto quick ci
+063 rw auto quick ci
064 rw auto quick
065 rw auto quick
-066 rw auto quick
+066 rw auto quick ci
067 rw auto quick
068 rw auto quick
-069 rw auto quick
+069 rw auto quick ci
070 rw auto quick
-071 rw auto quick
-072 rw auto quick
-073 rw auto quick
-074 rw auto quick
+071 rw auto quick ci
+072 rw auto quick ci
+073 rw auto quick ci
+074 rw auto quick ci
075 rw auto quick
076 auto
077 rw auto quick
@@ -88,15 +98,15 @@
079 rw auto
080 rw auto
081 rw auto quick
-082 rw auto quick
+082 rw auto quick ci
083 rw auto
084 img auto quick
085 rw auto
-086 rw auto quick
+086 rw auto quick ci
087 rw auto quick
088 rw auto quick
-089 rw auto quick
-090 rw auto quick
+089 rw auto quick ci
+090 rw auto quick ci
091 rw auto migration
092 rw auto quick
093 auto
@@ -104,29 +114,29 @@
095 rw auto quick
096 rw auto quick
097 rw auto backing
-098 rw auto backing quick
-099 rw auto quick
+098 rw auto backing quick ci
+099 rw auto quick ci
# 100 was removed, do not reuse
101 rw auto quick
-102 rw auto quick
-103 rw auto quick
+102 rw auto quick ci
+103 rw auto quick ci
104 rw auto
-105 rw auto quick
+105 rw auto quick ci
106 rw auto quick
-107 rw auto quick
-108 rw auto quick
+107 rw auto quick ci
+108 rw auto quick ci
109 rw auto
-110 rw auto backing quick
-111 rw auto quick
+110 rw auto backing quick ci
+111 rw auto quick ci
112 rw auto
113 rw auto quick
-114 rw auto quick
+114 rw auto quick ci
115 rw auto
116 rw auto quick
117 rw auto
118 rw auto
119 rw auto quick
-120 rw auto quick
+120 rw auto quick ci
121 rw auto
122 rw auto
123 rw auto quick
@@ -136,73 +146,73 @@
127 rw auto backing quick
128 rw auto quick
129 rw auto quick
-130 rw auto quick
+130 rw auto quick ci
131 rw auto quick
132 rw auto quick
-133 auto quick
-134 rw auto quick
+133 auto quick ci
+134 rw auto quick ci
135 rw auto
136 rw auto
137 rw auto
138 rw auto quick
139 rw auto quick
-140 rw auto quick
-141 rw auto quick
+140 rw auto quick ci
+141 rw auto quick ci
142 auto
-143 auto quick
+143 auto quick ci
144 rw auto quick
-145 auto quick
+145 auto quick ci
146 auto quick
147 auto
148 rw auto quick
149 rw auto sudo
-150 rw auto quick
+150 rw auto quick ci
151 rw auto
152 rw auto quick
153 rw auto quick
-154 rw auto backing quick
+154 rw auto backing quick ci
155 rw auto
-156 rw auto quick
+156 rw auto quick ci
157 auto
-158 rw auto quick
-159 rw auto quick
+158 rw auto quick ci
+159 rw auto quick ci
160 rw auto quick
-161 rw auto quick
+161 rw auto quick ci
162 auto quick
163 rw auto
165 rw auto quick
169 rw auto quick migration
-170 rw auto quick
+170 rw auto quick ci
171 rw auto quick
172 auto
173 rw auto
174 auto
175 auto quick
176 rw auto backing
-177 rw auto quick
+177 rw auto quick ci
178 auto
-179 rw auto quick
+179 rw auto quick ci
181 rw auto migration
182 rw auto quick
183 rw auto migration
-184 rw auto quick
+184 rw auto quick ci
185 rw auto
186 rw auto
187 rw auto
188 rw auto quick
189 rw auto
-190 rw auto quick
+190 rw auto quick ci
191 rw auto
192 rw auto quick
194 rw auto migration quick
-195 rw auto quick
+195 rw auto quick ci
196 rw auto quick migration
-197 rw auto quick
+197 rw auto quick ci
198 rw auto
199 rw auto migration
200 rw auto
201 rw auto migration
-202 rw auto quick
+202 rw auto quick ci
203 rw auto migration
204 rw auto quick
205 rw auto quick
@@ -215,25 +225,25 @@
212 rw auto quick
213 rw auto quick
214 rw auto
-215 rw auto quick
-216 rw auto quick
-217 rw auto quick
-218 rw auto quick
+215 rw auto quick ci
+216 rw auto quick ci
+217 rw auto quick ci
+218 rw auto quick ci
219 rw auto
220 rw auto
221 rw auto quick
222 rw auto quick
223 rw auto quick
-224 rw auto quick
+224 rw auto quick ci
225 rw auto quick
-226 auto quick
+226 auto quick ci
227 auto quick
-228 rw auto quick
-229 auto quick
+228 rw auto quick ci
+229 auto quick ci
231 auto quick
232 auto quick
-233 auto quick
-234 auto quick migration
+233 auto quick ci
+234 auto quick ci migration
235 auto quick
236 auto quick
237 rw auto quick
@@ -242,9 +252,9 @@
240 auto quick
241 rw auto quick
242 rw auto quick
-243 rw auto quick
-244 rw auto quick
+243 rw auto quick ci
+244 rw auto quick ci
245 rw auto
246 rw auto quick
-247 rw auto quick
+247 rw auto quick ci
248 rw auto quick
--
2.21.0
[Qemu-block] [PATCH 2/6] tests/qemu-iotests/group: Introduce a new "ci" group for CI pipelines,
Thomas Huth <=
- Re: [Qemu-block] [Qemu-devel] [PATCH 2/6] tests/qemu-iotests/group: Introduce a new "ci" group for CI pipelines, Daniel P . Berrangé, 2019/04/24
- Re: [Qemu-block] [Qemu-devel] [PATCH 2/6] tests/qemu-iotests/group: Introduce a new "ci" group for CI pipelines, Thomas Huth, 2019/04/24
- Re: [Qemu-block] [Qemu-devel] [PATCH 2/6] tests/qemu-iotests/group: Introduce a new "ci" group for CI pipelines, Daniel P . Berrangé, 2019/04/24
- Re: [Qemu-block] [Qemu-devel] [PATCH 2/6] tests/qemu-iotests/group: Introduce a new "ci" group for CI pipelines, Thomas Huth, 2019/04/24
- Re: [Qemu-block] [Qemu-devel] [PATCH 2/6] tests/qemu-iotests/group: Introduce a new "ci" group for CI pipelines, Daniel P . Berrangé, 2019/04/24
- Re: [Qemu-block] [Qemu-devel] [PATCH 2/6] tests/qemu-iotests/group: Introduce a new "ci" group for CI pipelines, Thomas Huth, 2019/04/25
[Qemu-block] [PATCH 5/6] tests: Run the iotests during "make check" again, Thomas Huth, 2019/04/24