blog/Automatic_upgrade_testing_from_Lenny_to_Squeeze.html

   1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
   2           "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
   3 <html xmlns="http://www.w3.org/1999/xhtml" dir="ltr">
   4   <head>
   5     <meta http-equiv="Content-Type" content="text/html;charset=utf-8" />
   6     <title>Petter Reinholdtsen: Automatic upgrade testing from Lenny to Squeeze</title>
   7     <link rel="stylesheet" type="text/css" media="screen" href="http://people.skolelinux.org/pere/blog/style.css" />
   8     <link rel="stylesheet" type="text/css" media="screen" href="http://people.skolelinux.org/pere/blog/vim.css" />
   9   </head>
  10   <body>
  11     <div class="title">
  12  <h1>
  13      <a href="http://people.skolelinux.org/pere/blog/">Petter Reinholdtsen</a>
  14
  15  </h1>
  16
  17 </div>
  18
  19
  20     <div class="entry">
  21       <div class="title">Automatic upgrade testing from Lenny to Squeeze</div>
  22       <div class="date">11th June 2010</div>
  23       <div class="body"><p>The last few days I have done some upgrade testing in Debian, to
  24 see if the upgrade from Lenny to Squeeze will go smoothly.  A few bugs
  25 have been discovered and reported in the process
  26 (<a href="http://bugs.debian.org/585410">#585410</a> in nagios3-cgi,
  27 <a href="http://bugs.debian.org/584879">#584879</a> already fixed in
  28 enscript and <a href="http://bugs.debian.org/584861">#584861</a> in
  29 kdebase-workspace-data), and to get a more regular testing going on, I
  30 am working on a script to automate the test.</p>
  31
  32 <p>The idea is to create a Lenny chroot and use tasksel to install a
  33 Gnome or KDE desktop installation inside the chroot before upgrading
  34 it.  To ensure no services are started in the chroot, a policy-rc.d
  35 script is inserted.  To make sure tasksel believe it is to install a
  36 desktop on a laptop, the tasksel tests are replaced in the chroot
  37 (only acceptable because this is a throw-away chroot).</p>
  38
  39 <p>A naive upgrade from Lenny to Squeeze using aptitude dist-upgrade
  40 currently always fail because udev refuses to upgrade with the kernel
  41 in Lenny, so to avoid that problem the file /etc/udev/kernel-upgrade
  42 is created.  The bug report
  43 <a href="http://bugs.debian.org/566000">#566000</a> make me suspect
  44 this problem do not trigger in a chroot, but I touch the file anyway
  45 to make sure the upgrade go well.  Testing on virtual and real
  46 hardware have failed me because of udev so far, and creating this file
  47 do the trick in such settings anyway.  This is a
  48 <a href="http://www.linuxquestions.org/questions/debian-26/failed-dist-upgrade-due-to-udev-config_sysfs_deprecated-nonsense-804130/">known
  49 issue</a> and the current udev behaviour is intended by the udev
  50 maintainer because he lack the resources to rewrite udev to keep
  51 working with old kernels or something like that.  I really wish the
  52 udev upstream would keep udev backwards compatible, to avoid such
  53 upgrade problem, but given that they fail to do so, I guess
  54 documenting the way out of this mess is the best option we got for
  55 Debian Squeeze.</p>
  56
  57 <p>Anyway, back to the task at hand, testing upgrades.  This test
  58 script, which I call <tt>upgrade-test</tt> for now, is doing the
  59 trick:</p>
  60
  61 <blockquote><pre>
  62 #!/bin/sh
  63 set -ex
  64
  65 if [ "$1" ] ; then
  66     desktop=$1
  67 else
  68     desktop=gnome
  69 fi
  70
  71 from=lenny
  72 to=squeeze
  73
  74 exec &lt; /dev/null
  75 unset LANG
  76 mirror=http://ftp.skolelinux.org/debian
  77 tmpdir=chroot-$from-upgrade-$to-$desktop
  78 fuser -mv .
  79 debootstrap $from $tmpdir $mirror
  80 chroot $tmpdir aptitude update
  81 cat > $tmpdir/usr/sbin/policy-rc.d &lt;&lt;EOF
  82 #!/bin/sh
  83 exit 101
  84 EOF
  85 chmod a+rx $tmpdir/usr/sbin/policy-rc.d
  86 exit_cleanup() {
  87     umount $tmpdir/proc
  88 }
  89 mount -t proc proc $tmpdir/proc
  90 # Make sure proc is unmounted also on failure
  91 trap exit_cleanup EXIT INT
  92
  93 chroot $tmpdir aptitude -y install debconf-utils
  94
  95 # Make sure tasksel autoselection trigger.  It need the test scripts
  96 # to return the correct answers.
  97 echo tasksel tasksel/desktop multiselect $desktop | \
  98     chroot $tmpdir debconf-set-selections
  99
 100 # Include the desktop and laptop task
 101 for test in desktop laptop ; do
 102     echo > $tmpdir/usr/lib/tasksel/tests/$test &lt;&lt;EOF
 103 #!/bin/sh
 104 exit 2
 105 EOF
 106     chmod a+rx $tmpdir/usr/lib/tasksel/tests/$test
 107 done
 108
 109 DEBIAN_FRONTEND=noninteractive
 110 DEBIAN_PRIORITY=critical
 111 export DEBIAN_FRONTEND DEBIAN_PRIORITY
 112 chroot $tmpdir tasksel --new-install
 113
 114 echo deb $mirror $to main > $tmpdir/etc/apt/sources.list
 115 chroot $tmpdir aptitude update
 116 touch $tmpdir/etc/udev/kernel-upgrade
 117 chroot $tmpdir aptitude -y dist-upgrade
 118 fuser -mv
 119 </pre></blockquote>
 120
 121 <p>I suspect it would be useful to test upgrades with both apt-get and
 122 with aptitude, but I have not had time to look at how they behave
 123 differently so far.  I hope to get a cron job running to do the test
 124 regularly and post the result on the web.  The Gnome upgrade currently
 125 work, while the KDE upgrade fail because of the bug in
 126 kdebase-workspace-data</p>
 127
 128 <p>I am not quite sure what kind of extract from the huge upgrade logs
 129 (KDE 167 KiB, Gnome 516 KiB) it make sense to include in this blog
 130 post, so I will refrain from trying.  I can report that for Gnome,
 131 aptitude report 760 packages upgraded, 448 newly installed, 129 to
 132 remove and 1 not upgraded and 1024MB need to be downloaded while for
 133 KDE the same numbers are 702 packages upgraded, 507 newly installed,
 134 193 to remove and 0 not upgraded and 1117MB need to be downloaded</p>
 135
 136 <p>I am very happy to notice that the Gnome desktop + laptop upgrade
 137 is able to migrate to dependency based boot sequencing and parallel
 138 booting without a hitch.  Was unsure if there were still bugs with
 139 packages failing to clean up their obsolete init.d script during
 140 upgrades, and no such problem seem to affect the Gnome desktop+laptop
 141 packages.</p>
 142 </div>
 143
 144       <div class="tags">Tags: <a href="http://people.skolelinux.org/pere/blog/tags/bootsystem">bootsystem</a>, <a href="http://people.skolelinux.org/pere/blog/tags/debian">debian</a>, <a href="http://people.skolelinux.org/pere/blog/tags/debian edu">debian edu</a>, <a href="http://people.skolelinux.org/pere/blog/tags/english">english</a>.</div>
 145
 146
 147     </div>
 148
 149
 150
 151
 152     <div id="sidebar">
 153
 154
 155
 156 <h2>Archive</h2>
 157 <ul>
 158
 159 <li>2013
 160 <ul>
 161
 162 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/01/">January (6)</a></li>
 163
 164 </ul></li>
 165
 166 <li>2012
 167 <ul>
 168
 169 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/01/">January (7)</a></li>
 170
 171 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/02/">February (10)</a></li>
 172
 173 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/03/">March (17)</a></li>
 174
 175 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/04/">April (12)</a></li>
 176
 177 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/05/">May (12)</a></li>
 178
 179 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/06/">June (20)</a></li>
 180
 181 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/07/">July (17)</a></li>
 182
 183 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/08/">August (6)</a></li>
 184
 185 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/09/">September (9)</a></li>
 186
 187 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/10/">October (17)</a></li>
 188
 189 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/11/">November (10)</a></li>
 190
 191 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/12/">December (7)</a></li>
 192
 193 </ul></li>
 194
 195 <li>2011
 196 <ul>
 197
 198 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/01/">January (16)</a></li>
 199
 200 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/02/">February (6)</a></li>
 201
 202 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/03/">March (6)</a></li>
 203
 204 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/04/">April (7)</a></li>
 205
 206 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/05/">May (3)</a></li>
 207
 208 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/06/">June (2)</a></li>
 209
 210 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/07/">July (7)</a></li>
 211
 212 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/08/">August (6)</a></li>
 213
 214 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/09/">September (4)</a></li>
 215
 216 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/10/">October (2)</a></li>
 217
 218 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/11/">November (3)</a></li>
 219
 220 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/12/">December (1)</a></li>
 221
 222 </ul></li>
 223
 224 <li>2010
 225 <ul>
 226
 227 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/01/">January (2)</a></li>
 228
 229 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/02/">February (1)</a></li>
 230
 231 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/03/">March (3)</a></li>
 232
 233 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/04/">April (3)</a></li>
 234
 235 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/05/">May (9)</a></li>
 236
 237 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/06/">June (14)</a></li>
 238
 239 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/07/">July (12)</a></li>
 240
 241 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/08/">August (13)</a></li>
 242
 243 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/09/">September (7)</a></li>
 244
 245 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/10/">October (9)</a></li>
 246
 247 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/11/">November (13)</a></li>
 248
 249 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/12/">December (12)</a></li>
 250
 251 </ul></li>
 252
 253 <li>2009
 254 <ul>
 255
 256 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/01/">January (8)</a></li>
 257
 258 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/02/">February (8)</a></li>
 259
 260 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/03/">March (12)</a></li>
 261
 262 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/04/">April (10)</a></li>
 263
 264 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/05/">May (9)</a></li>
 265
 266 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/06/">June (3)</a></li>
 267
 268 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/07/">July (4)</a></li>
 269
 270 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/08/">August (3)</a></li>
 271
 272 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/09/">September (1)</a></li>
 273
 274 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/10/">October (2)</a></li>
 275
 276 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/11/">November (3)</a></li>
 277
 278 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/12/">December (3)</a></li>
 279
 280 </ul></li>
 281
 282 <li>2008
 283 <ul>
 284
 285 <li><a href="http://people.skolelinux.org/pere/blog/archive/2008/11/">November (5)</a></li>
 286
 287 <li><a href="http://people.skolelinux.org/pere/blog/archive/2008/12/">December (7)</a></li>
 288
 289 </ul></li>
 290
 291 </ul>
 292
 293
 294
 295 <h2>Tags</h2>
 296 <ul>
 297
 298  <li><a href="http://people.skolelinux.org/pere/blog/tags/3d-printer">3d-printer (13)</a></li>
 299
 300  <li><a href="http://people.skolelinux.org/pere/blog/tags/amiga">amiga (1)</a></li>
 301
 302  <li><a href="http://people.skolelinux.org/pere/blog/tags/aros">aros (1)</a></li>
 303
 304  <li><a href="http://people.skolelinux.org/pere/blog/tags/bankid">bankid (4)</a></li>
 305
 306  <li><a href="http://people.skolelinux.org/pere/blog/tags/bitcoin">bitcoin (5)</a></li>
 307
 308  <li><a href="http://people.skolelinux.org/pere/blog/tags/bootsystem">bootsystem (12)</a></li>
 309
 310  <li><a href="http://people.skolelinux.org/pere/blog/tags/bsa">bsa (2)</a></li>
 311
 312  <li><a href="http://people.skolelinux.org/pere/blog/tags/debian">debian (64)</a></li>
 313
 314  <li><a href="http://people.skolelinux.org/pere/blog/tags/debian edu">debian edu (118)</a></li>
 315
 316  <li><a href="http://people.skolelinux.org/pere/blog/tags/digistan">digistan (9)</a></li>
 317
 318  <li><a href="http://people.skolelinux.org/pere/blog/tags/docbook">docbook (7)</a></li>
 319
 320  <li><a href="http://people.skolelinux.org/pere/blog/tags/drivstoffpriser">drivstoffpriser (4)</a></li>
 321
 322  <li><a href="http://people.skolelinux.org/pere/blog/tags/english">english (170)</a></li>
 323
 324  <li><a href="http://people.skolelinux.org/pere/blog/tags/fiksgatami">fiksgatami (21)</a></li>
 325
 326  <li><a href="http://people.skolelinux.org/pere/blog/tags/fildeling">fildeling (12)</a></li>
 327
 328  <li><a href="http://people.skolelinux.org/pere/blog/tags/freeculture">freeculture (10)</a></li>
 329
 330  <li><a href="http://people.skolelinux.org/pere/blog/tags/frikanalen">frikanalen (9)</a></li>
 331
 332  <li><a href="http://people.skolelinux.org/pere/blog/tags/intervju">intervju (32)</a></li>
 333
 334  <li><a href="http://people.skolelinux.org/pere/blog/tags/kart">kart (17)</a></li>
 335
 336  <li><a href="http://people.skolelinux.org/pere/blog/tags/ldap">ldap (8)</a></li>
 337
 338  <li><a href="http://people.skolelinux.org/pere/blog/tags/lenker">lenker (6)</a></li>
 339
 340  <li><a href="http://people.skolelinux.org/pere/blog/tags/ltsp">ltsp (1)</a></li>
 341
 342  <li><a href="http://people.skolelinux.org/pere/blog/tags/multimedia">multimedia (25)</a></li>
 343
 344  <li><a href="http://people.skolelinux.org/pere/blog/tags/norsk">norsk (219)</a></li>
 345
 346  <li><a href="http://people.skolelinux.org/pere/blog/tags/nuug">nuug (148)</a></li>
 347
 348  <li><a href="http://people.skolelinux.org/pere/blog/tags/offentlig innsyn">offentlig innsyn (6)</a></li>
 349
 350  <li><a href="http://people.skolelinux.org/pere/blog/tags/open311">open311 (2)</a></li>
 351
 352  <li><a href="http://people.skolelinux.org/pere/blog/tags/opphavsrett">opphavsrett (41)</a></li>
 353
 354  <li><a href="http://people.skolelinux.org/pere/blog/tags/personvern">personvern (61)</a></li>
 355
 356  <li><a href="http://people.skolelinux.org/pere/blog/tags/raid">raid (1)</a></li>
 357
 358  <li><a href="http://people.skolelinux.org/pere/blog/tags/reprap">reprap (11)</a></li>
 359
 360  <li><a href="http://people.skolelinux.org/pere/blog/tags/rfid">rfid (2)</a></li>
 361
 362  <li><a href="http://people.skolelinux.org/pere/blog/tags/robot">robot (6)</a></li>
 363
 364  <li><a href="http://people.skolelinux.org/pere/blog/tags/rss">rss (1)</a></li>
 365
 366  <li><a href="http://people.skolelinux.org/pere/blog/tags/ruter">ruter (4)</a></li>
 367
 368  <li><a href="http://people.skolelinux.org/pere/blog/tags/scraperwiki">scraperwiki (2)</a></li>
 369
 370  <li><a href="http://people.skolelinux.org/pere/blog/tags/sikkerhet">sikkerhet (28)</a></li>
 371
 372  <li><a href="http://people.skolelinux.org/pere/blog/tags/sitesummary">sitesummary (4)</a></li>
 373
 374  <li><a href="http://people.skolelinux.org/pere/blog/tags/skepsis">skepsis (4)</a></li>
 375
 376  <li><a href="http://people.skolelinux.org/pere/blog/tags/standard">standard (39)</a></li>
 377
 378  <li><a href="http://people.skolelinux.org/pere/blog/tags/stavekontroll">stavekontroll (3)</a></li>
 379
 380  <li><a href="http://people.skolelinux.org/pere/blog/tags/stortinget">stortinget (5)</a></li>
 381
 382  <li><a href="http://people.skolelinux.org/pere/blog/tags/surveillance">surveillance (12)</a></li>
 383
 384  <li><a href="http://people.skolelinux.org/pere/blog/tags/sysadmin">sysadmin (1)</a></li>
 385
 386  <li><a href="http://people.skolelinux.org/pere/blog/tags/valg">valg (7)</a></li>
 387
 388  <li><a href="http://people.skolelinux.org/pere/blog/tags/video">video (35)</a></li>
 389
 390  <li><a href="http://people.skolelinux.org/pere/blog/tags/vitenskap">vitenskap (4)</a></li>
 391
 392  <li><a href="http://people.skolelinux.org/pere/blog/tags/web">web (26)</a></li>
 393
 394 </ul>
 395
 396
 397     </div>
 398     <p style="text-align: right">
 399  Created by <a href="http://steve.org.uk/Software/chronicle">Chronicle v4.4</a>
 400 </p>
 401
 402   </body>
 403 </html>