blog/Automatic_upgrade_testing_from_Lenny_to_Squeeze.html

   1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
   2           "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
   3 <html xmlns="http://www.w3.org/1999/xhtml" dir="ltr">
   4   <head>
   5     <meta http-equiv="Content-Type" content="text/html;charset=utf-8" />
   6     <title>Petter Reinholdtsen: Automatic upgrade testing from Lenny to Squeeze</title>
   7     <link rel="stylesheet" type="text/css" media="screen" href="http://people.skolelinux.org/pere/blog/style.css" />
   8     <link rel="stylesheet" type="text/css" media="screen" href="http://people.skolelinux.org/pere/blog/vim.css" />
   9
  10
  11   </head>
  12   <body>
  13     <div class="title">
  14  <h1>
  15      <a href="http://people.skolelinux.org/pere/blog/">Petter Reinholdtsen</a>
  16
  17  </h1>
  18
  19 </div>
  20
  21
  22     <div class="entry">
  23       <div class="title">Automatic upgrade testing from Lenny to Squeeze</div>
  24       <div class="date">11th June 2010</div>
  25       <div class="body"><p>The last few days I have done some upgrade testing in Debian, to
  26 see if the upgrade from Lenny to Squeeze will go smoothly.  A few bugs
  27 have been discovered and reported in the process
  28 (<a href="http://bugs.debian.org/585410">#585410</a> in nagios3-cgi,
  29 <a href="http://bugs.debian.org/584879">#584879</a> already fixed in
  30 enscript and <a href="http://bugs.debian.org/584861">#584861</a> in
  31 kdebase-workspace-data), and to get a more regular testing going on, I
  32 am working on a script to automate the test.</p>
  33
  34 <p>The idea is to create a Lenny chroot and use tasksel to install a
  35 Gnome or KDE desktop installation inside the chroot before upgrading
  36 it.  To ensure no services are started in the chroot, a policy-rc.d
  37 script is inserted.  To make sure tasksel believe it is to install a
  38 desktop on a laptop, the tasksel tests are replaced in the chroot
  39 (only acceptable because this is a throw-away chroot).</p>
  40
  41 <p>A naive upgrade from Lenny to Squeeze using aptitude dist-upgrade
  42 currently always fail because udev refuses to upgrade with the kernel
  43 in Lenny, so to avoid that problem the file /etc/udev/kernel-upgrade
  44 is created.  The bug report
  45 <a href="http://bugs.debian.org/566000">#566000</a> make me suspect
  46 this problem do not trigger in a chroot, but I touch the file anyway
  47 to make sure the upgrade go well.  Testing on virtual and real
  48 hardware have failed me because of udev so far, and creating this file
  49 do the trick in such settings anyway.  This is a
  50 <a href="http://www.linuxquestions.org/questions/debian-26/failed-dist-upgrade-due-to-udev-config_sysfs_deprecated-nonsense-804130/">known
  51 issue</a> and the current udev behaviour is intended by the udev
  52 maintainer because he lack the resources to rewrite udev to keep
  53 working with old kernels or something like that.  I really wish the
  54 udev upstream would keep udev backwards compatible, to avoid such
  55 upgrade problem, but given that they fail to do so, I guess
  56 documenting the way out of this mess is the best option we got for
  57 Debian Squeeze.</p>
  58
  59 <p>Anyway, back to the task at hand, testing upgrades.  This test
  60 script, which I call <tt>upgrade-test</tt> for now, is doing the
  61 trick:</p>
  62
  63 <blockquote><pre>
  64 #!/bin/sh
  65 set -ex
  66
  67 if [ "$1" ] ; then
  68     desktop=$1
  69 else
  70     desktop=gnome
  71 fi
  72
  73 from=lenny
  74 to=squeeze
  75
  76 exec &lt; /dev/null
  77 unset LANG
  78 mirror=http://ftp.skolelinux.org/debian
  79 tmpdir=chroot-$from-upgrade-$to-$desktop
  80 fuser -mv .
  81 debootstrap $from $tmpdir $mirror
  82 chroot $tmpdir aptitude update
  83 cat > $tmpdir/usr/sbin/policy-rc.d &lt;&lt;EOF
  84 #!/bin/sh
  85 exit 101
  86 EOF
  87 chmod a+rx $tmpdir/usr/sbin/policy-rc.d
  88 exit_cleanup() {
  89     umount $tmpdir/proc
  90 }
  91 mount -t proc proc $tmpdir/proc
  92 # Make sure proc is unmounted also on failure
  93 trap exit_cleanup EXIT INT
  94
  95 chroot $tmpdir aptitude -y install debconf-utils
  96
  97 # Make sure tasksel autoselection trigger.  It need the test scripts
  98 # to return the correct answers.
  99 echo tasksel tasksel/desktop multiselect $desktop | \
 100     chroot $tmpdir debconf-set-selections
 101
 102 # Include the desktop and laptop task
 103 for test in desktop laptop ; do
 104     echo > $tmpdir/usr/lib/tasksel/tests/$test &lt;&lt;EOF
 105 #!/bin/sh
 106 exit 2
 107 EOF
 108     chmod a+rx $tmpdir/usr/lib/tasksel/tests/$test
 109 done
 110
 111 DEBIAN_FRONTEND=noninteractive
 112 DEBIAN_PRIORITY=critical
 113 export DEBIAN_FRONTEND DEBIAN_PRIORITY
 114 chroot $tmpdir tasksel --new-install
 115
 116 echo deb $mirror $to main > $tmpdir/etc/apt/sources.list
 117 chroot $tmpdir aptitude update
 118 touch $tmpdir/etc/udev/kernel-upgrade
 119 chroot $tmpdir aptitude -y dist-upgrade
 120 fuser -mv
 121 </pre></blockquote>
 122
 123 <p>I suspect it would be useful to test upgrades with both apt-get and
 124 with aptitude, but I have not had time to look at how they behave
 125 differently so far.  I hope to get a cron job running to do the test
 126 regularly and post the result on the web.  The Gnome upgrade currently
 127 work, while the KDE upgrade fail because of the bug in
 128 kdebase-workspace-data</p>
 129
 130 <p>I am not quite sure what kind of extract from the huge upgrade logs
 131 (KDE 167 KiB, Gnome 516 KiB) it make sense to include in this blog
 132 post, so I will refrain from trying.  I can report that for Gnome,
 133 aptitude report 760 packages upgraded, 448 newly installed, 129 to
 134 remove and 1 not upgraded and 1024MB need to be downloaded while for
 135 KDE the same numbers are 702 packages upgraded, 507 newly installed,
 136 193 to remove and 0 not upgraded and 1117MB need to be downloaded</p>
 137
 138 <p>I am very happy to notice that the Gnome desktop + laptop upgrade
 139 is able to migrate to dependency based boot sequencing and parallel
 140 booting without a hitch.  Was unsure if there were still bugs with
 141 packages failing to clean up their obsolete init.d script during
 142 upgrades, and no such problem seem to affect the Gnome desktop+laptop
 143 packages.</p>
 144 </div>
 145
 146       <div class="tags">Tags: <a href="http://people.skolelinux.org/pere/blog/tags/bootsystem">bootsystem</a>, <a href="http://people.skolelinux.org/pere/blog/tags/debian">debian</a>, <a href="http://people.skolelinux.org/pere/blog/tags/debian edu">debian edu</a>, <a href="http://people.skolelinux.org/pere/blog/tags/english">english</a>.</div>
 147
 148
 149     </div>
 150
 151
 152
 153
 154     <div id="sidebar">
 155
 156
 157
 158 <h2>Archive</h2>
 159 <ul>
 160
 161 <li>2013
 162 <ul>
 163
 164 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/01/">January (11)</a></li>
 165
 166 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/02/">February (9)</a></li>
 167
 168 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/03/">March (9)</a></li>
 169
 170 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/04/">April (6)</a></li>
 171
 172 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/05/">May (9)</a></li>
 173
 174 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/06/">June (10)</a></li>
 175
 176 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/07/">July (7)</a></li>
 177
 178 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/08/">August (3)</a></li>
 179
 180 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/09/">September (2)</a></li>
 181
 182 </ul></li>
 183
 184 <li>2012
 185 <ul>
 186
 187 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/01/">January (7)</a></li>
 188
 189 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/02/">February (10)</a></li>
 190
 191 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/03/">March (17)</a></li>
 192
 193 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/04/">April (12)</a></li>
 194
 195 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/05/">May (12)</a></li>
 196
 197 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/06/">June (20)</a></li>
 198
 199 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/07/">July (17)</a></li>
 200
 201 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/08/">August (6)</a></li>
 202
 203 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/09/">September (9)</a></li>
 204
 205 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/10/">October (17)</a></li>
 206
 207 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/11/">November (10)</a></li>
 208
 209 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/12/">December (7)</a></li>
 210
 211 </ul></li>
 212
 213 <li>2011
 214 <ul>
 215
 216 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/01/">January (16)</a></li>
 217
 218 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/02/">February (6)</a></li>
 219
 220 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/03/">March (6)</a></li>
 221
 222 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/04/">April (7)</a></li>
 223
 224 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/05/">May (3)</a></li>
 225
 226 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/06/">June (2)</a></li>
 227
 228 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/07/">July (7)</a></li>
 229
 230 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/08/">August (6)</a></li>
 231
 232 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/09/">September (4)</a></li>
 233
 234 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/10/">October (2)</a></li>
 235
 236 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/11/">November (3)</a></li>
 237
 238 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/12/">December (1)</a></li>
 239
 240 </ul></li>
 241
 242 <li>2010
 243 <ul>
 244
 245 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/01/">January (2)</a></li>
 246
 247 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/02/">February (1)</a></li>
 248
 249 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/03/">March (3)</a></li>
 250
 251 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/04/">April (3)</a></li>
 252
 253 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/05/">May (9)</a></li>
 254
 255 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/06/">June (14)</a></li>
 256
 257 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/07/">July (12)</a></li>
 258
 259 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/08/">August (13)</a></li>
 260
 261 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/09/">September (7)</a></li>
 262
 263 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/10/">October (9)</a></li>
 264
 265 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/11/">November (13)</a></li>
 266
 267 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/12/">December (12)</a></li>
 268
 269 </ul></li>
 270
 271 <li>2009
 272 <ul>
 273
 274 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/01/">January (8)</a></li>
 275
 276 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/02/">February (8)</a></li>
 277
 278 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/03/">March (12)</a></li>
 279
 280 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/04/">April (10)</a></li>
 281
 282 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/05/">May (9)</a></li>
 283
 284 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/06/">June (3)</a></li>
 285
 286 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/07/">July (4)</a></li>
 287
 288 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/08/">August (3)</a></li>
 289
 290 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/09/">September (1)</a></li>
 291
 292 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/10/">October (2)</a></li>
 293
 294 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/11/">November (3)</a></li>
 295
 296 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/12/">December (3)</a></li>
 297
 298 </ul></li>
 299
 300 <li>2008
 301 <ul>
 302
 303 <li><a href="http://people.skolelinux.org/pere/blog/archive/2008/11/">November (5)</a></li>
 304
 305 <li><a href="http://people.skolelinux.org/pere/blog/archive/2008/12/">December (7)</a></li>
 306
 307 </ul></li>
 308
 309 </ul>
 310
 311
 312
 313 <h2>Tags</h2>
 314 <ul>
 315
 316  <li><a href="http://people.skolelinux.org/pere/blog/tags/3d-printer">3d-printer (13)</a></li>
 317
 318  <li><a href="http://people.skolelinux.org/pere/blog/tags/amiga">amiga (1)</a></li>
 319
 320  <li><a href="http://people.skolelinux.org/pere/blog/tags/aros">aros (1)</a></li>
 321
 322  <li><a href="http://people.skolelinux.org/pere/blog/tags/bankid">bankid (4)</a></li>
 323
 324  <li><a href="http://people.skolelinux.org/pere/blog/tags/bitcoin">bitcoin (7)</a></li>
 325
 326  <li><a href="http://people.skolelinux.org/pere/blog/tags/bootsystem">bootsystem (12)</a></li>
 327
 328  <li><a href="http://people.skolelinux.org/pere/blog/tags/bsa">bsa (2)</a></li>
 329
 330  <li><a href="http://people.skolelinux.org/pere/blog/tags/debian">debian (85)</a></li>
 331
 332  <li><a href="http://people.skolelinux.org/pere/blog/tags/debian edu">debian edu (139)</a></li>
 333
 334  <li><a href="http://people.skolelinux.org/pere/blog/tags/digistan">digistan (10)</a></li>
 335
 336  <li><a href="http://people.skolelinux.org/pere/blog/tags/docbook">docbook (10)</a></li>
 337
 338  <li><a href="http://people.skolelinux.org/pere/blog/tags/drivstoffpriser">drivstoffpriser (4)</a></li>
 339
 340  <li><a href="http://people.skolelinux.org/pere/blog/tags/english">english (214)</a></li>
 341
 342  <li><a href="http://people.skolelinux.org/pere/blog/tags/fiksgatami">fiksgatami (21)</a></li>
 343
 344  <li><a href="http://people.skolelinux.org/pere/blog/tags/fildeling">fildeling (12)</a></li>
 345
 346  <li><a href="http://people.skolelinux.org/pere/blog/tags/freeculture">freeculture (12)</a></li>
 347
 348  <li><a href="http://people.skolelinux.org/pere/blog/tags/freedombox">freedombox (1)</a></li>
 349
 350  <li><a href="http://people.skolelinux.org/pere/blog/tags/frikanalen">frikanalen (11)</a></li>
 351
 352  <li><a href="http://people.skolelinux.org/pere/blog/tags/intervju">intervju (37)</a></li>
 353
 354  <li><a href="http://people.skolelinux.org/pere/blog/tags/isenkram">isenkram (7)</a></li>
 355
 356  <li><a href="http://people.skolelinux.org/pere/blog/tags/kart">kart (18)</a></li>
 357
 358  <li><a href="http://people.skolelinux.org/pere/blog/tags/ldap">ldap (8)</a></li>
 359
 360  <li><a href="http://people.skolelinux.org/pere/blog/tags/lenker">lenker (6)</a></li>
 361
 362  <li><a href="http://people.skolelinux.org/pere/blog/tags/ltsp">ltsp (1)</a></li>
 363
 364  <li><a href="http://people.skolelinux.org/pere/blog/tags/multimedia">multimedia (25)</a></li>
 365
 366  <li><a href="http://people.skolelinux.org/pere/blog/tags/norsk">norsk (235)</a></li>
 367
 368  <li><a href="http://people.skolelinux.org/pere/blog/tags/nuug">nuug (153)</a></li>
 369
 370  <li><a href="http://people.skolelinux.org/pere/blog/tags/offentlig innsyn">offentlig innsyn (8)</a></li>
 371
 372  <li><a href="http://people.skolelinux.org/pere/blog/tags/open311">open311 (2)</a></li>
 373
 374  <li><a href="http://people.skolelinux.org/pere/blog/tags/opphavsrett">opphavsrett (44)</a></li>
 375
 376  <li><a href="http://people.skolelinux.org/pere/blog/tags/personvern">personvern (66)</a></li>
 377
 378  <li><a href="http://people.skolelinux.org/pere/blog/tags/raid">raid (1)</a></li>
 379
 380  <li><a href="http://people.skolelinux.org/pere/blog/tags/reprap">reprap (11)</a></li>
 381
 382  <li><a href="http://people.skolelinux.org/pere/blog/tags/rfid">rfid (2)</a></li>
 383
 384  <li><a href="http://people.skolelinux.org/pere/blog/tags/robot">robot (7)</a></li>
 385
 386  <li><a href="http://people.skolelinux.org/pere/blog/tags/rss">rss (1)</a></li>
 387
 388  <li><a href="http://people.skolelinux.org/pere/blog/tags/ruter">ruter (4)</a></li>
 389
 390  <li><a href="http://people.skolelinux.org/pere/blog/tags/scraperwiki">scraperwiki (2)</a></li>
 391
 392  <li><a href="http://people.skolelinux.org/pere/blog/tags/sikkerhet">sikkerhet (30)</a></li>
 393
 394  <li><a href="http://people.skolelinux.org/pere/blog/tags/sitesummary">sitesummary (4)</a></li>
 395
 396  <li><a href="http://people.skolelinux.org/pere/blog/tags/skepsis">skepsis (4)</a></li>
 397
 398  <li><a href="http://people.skolelinux.org/pere/blog/tags/standard">standard (43)</a></li>
 399
 400  <li><a href="http://people.skolelinux.org/pere/blog/tags/stavekontroll">stavekontroll (3)</a></li>
 401
 402  <li><a href="http://people.skolelinux.org/pere/blog/tags/stortinget">stortinget (8)</a></li>
 403
 404  <li><a href="http://people.skolelinux.org/pere/blog/tags/surveillance">surveillance (17)</a></li>
 405
 406  <li><a href="http://people.skolelinux.org/pere/blog/tags/sysadmin">sysadmin (1)</a></li>
 407
 408  <li><a href="http://people.skolelinux.org/pere/blog/tags/valg">valg (8)</a></li>
 409
 410  <li><a href="http://people.skolelinux.org/pere/blog/tags/video">video (38)</a></li>
 411
 412  <li><a href="http://people.skolelinux.org/pere/blog/tags/vitenskap">vitenskap (4)</a></li>
 413
 414  <li><a href="http://people.skolelinux.org/pere/blog/tags/web">web (27)</a></li>
 415
 416 </ul>
 417
 418
 419     </div>
 420     <p style="text-align: right">
 421  Created by <a href="http://steve.org.uk/Software/chronicle">Chronicle v4.6</a>
 422 </p>
 423
 424   </body>
 425 </html>