blog/Automatic_upgrade_testing_from_Lenny_to_Squeeze.html

   1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
   2           "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
   3 <html xmlns="http://www.w3.org/1999/xhtml" dir="ltr">
   4   <head>
   5     <meta http-equiv="Content-Type" content="text/html;charset=utf-8" />
   6     <title>Petter Reinholdtsen: Automatic upgrade testing from Lenny to Squeeze</title>
   7     <link rel="stylesheet" type="text/css" media="screen" href="http://people.skolelinux.org/pere/blog/style.css" />
   8     <link rel="stylesheet" type="text/css" media="screen" href="http://people.skolelinux.org/pere/blog/vim.css" />
   9   </head>
  10   <body>
  11     <div class="title">
  12  <h1>
  13      <a href="http://people.skolelinux.org/pere/blog/">Petter Reinholdtsen</a>
  14
  15  </h1>
  16
  17 </div>
  18
  19
  20     <div class="entry">
  21       <div class="title">Automatic upgrade testing from Lenny to Squeeze</div>
  22       <div class="date">11th June 2010</div>
  23       <div class="body"><p>The last few days I have done some upgrade testing in Debian, to
  24 see if the upgrade from Lenny to Squeeze will go smoothly.  A few bugs
  25 have been discovered and reported in the process
  26 (<a href="http://bugs.debian.org/585410">#585410</a> in nagios3-cgi,
  27 <a href="http://bugs.debian.org/584879">#584879</a> already fixed in
  28 enscript and <a href="http://bugs.debian.org/584861">#584861</a> in
  29 kdebase-workspace-data), and to get a more regular testing going on, I
  30 am working on a script to automate the test.</p>
  31
  32 <p>The idea is to create a Lenny chroot and use tasksel to install a
  33 Gnome or KDE desktop installation inside the chroot before upgrading
  34 it.  To ensure no services are started in the chroot, a policy-rc.d
  35 script is inserted.  To make sure tasksel believe it is to install a
  36 desktop on a laptop, the tasksel tests are replaced in the chroot
  37 (only acceptable because this is a throw-away chroot).</p>
  38
  39 <p>A naive upgrade from Lenny to Squeeze using aptitude dist-upgrade
  40 currently always fail because udev refuses to upgrade with the kernel
  41 in Lenny, so to avoid that problem the file /etc/udev/kernel-upgrade
  42 is created.  The bug report
  43 <a href="http://bugs.debian.org/566000">#566000</a> make me suspect
  44 this problem do not trigger in a chroot, but I touch the file anyway
  45 to make sure the upgrade go well.  Testing on virtual and real
  46 hardware have failed me because of udev so far, and creating this file
  47 do the trick in such settings anyway.  This is a
  48 <a href="http://www.linuxquestions.org/questions/debian-26/failed-dist-upgrade-due-to-udev-config_sysfs_deprecated-nonsense-804130/">known
  49 issue</a> and the current udev behaviour is intended by the udev
  50 maintainer because he lack the resources to rewrite udev to keep
  51 working with old kernels or something like that.  I really wish the
  52 udev upstream would keep udev backwards compatible, to avoid such
  53 upgrade problem, but given that they fail to do so, I guess
  54 documenting the way out of this mess is the best option we got for
  55 Debian Squeeze.</p>
  56
  57 <p>Anyway, back to the task at hand, testing upgrades.  This test
  58 script, which I call <tt>upgrade-test</tt> for now, is doing the
  59 trick:</p>
  60
  61 <blockquote><pre>
  62 #!/bin/sh
  63 set -ex
  64
  65 if [ "$1" ] ; then
  66     desktop=$1
  67 else
  68     desktop=gnome
  69 fi
  70
  71 from=lenny
  72 to=squeeze
  73
  74 exec &lt; /dev/null
  75 unset LANG
  76 mirror=http://ftp.skolelinux.org/debian
  77 tmpdir=chroot-$from-upgrade-$to-$desktop
  78 fuser -mv .
  79 debootstrap $from $tmpdir $mirror
  80 chroot $tmpdir aptitude update
  81 cat > $tmpdir/usr/sbin/policy-rc.d &lt;&lt;EOF
  82 #!/bin/sh
  83 exit 101
  84 EOF
  85 chmod a+rx $tmpdir/usr/sbin/policy-rc.d
  86 exit_cleanup() {
  87     umount $tmpdir/proc
  88 }
  89 mount -t proc proc $tmpdir/proc
  90 # Make sure proc is unmounted also on failure
  91 trap exit_cleanup EXIT INT
  92
  93 chroot $tmpdir aptitude -y install debconf-utils
  94
  95 # Make sure tasksel autoselection trigger.  It need the test scripts
  96 # to return the correct answers.
  97 echo tasksel tasksel/desktop multiselect $desktop | \
  98     chroot $tmpdir debconf-set-selections
  99
 100 # Include the desktop and laptop task
 101 for test in desktop laptop ; do
 102     echo > $tmpdir/usr/lib/tasksel/tests/$test &lt;&lt;EOF
 103 #!/bin/sh
 104 exit 2
 105 EOF
 106     chmod a+rx $tmpdir/usr/lib/tasksel/tests/$test
 107 done
 108
 109 DEBIAN_FRONTEND=noninteractive
 110 DEBIAN_PRIORITY=critical
 111 export DEBIAN_FRONTEND DEBIAN_PRIORITY
 112 chroot $tmpdir tasksel --new-install
 113
 114 echo deb $mirror $to main > $tmpdir/etc/apt/sources.list
 115 chroot $tmpdir aptitude update
 116 touch $tmpdir/etc/udev/kernel-upgrade
 117 chroot $tmpdir aptitude -y dist-upgrade
 118 fuser -mv
 119 </pre></blockquote>
 120
 121 <p>I suspect it would be useful to test upgrades with both apt-get and
 122 with aptitude, but I have not had time to look at how they behave
 123 differently so far.  I hope to get a cron job running to do the test
 124 regularly and post the result on the web.  The Gnome upgrade currently
 125 work, while the KDE upgrade fail because of the bug in
 126 kdebase-workspace-data</p>
 127
 128 <p>I am not quite sure what kind of extract from the huge upgrade logs
 129 (KDE 167 KiB, Gnome 516 KiB) it make sense to include in this blog
 130 post, so I will refrain from trying.  I can report that for Gnome,
 131 aptitude report 760 packages upgraded, 448 newly installed, 129 to
 132 remove and 1 not upgraded and 1024MB need to be downloaded while for
 133 KDE the same numbers are 702 packages upgraded, 507 newly installed,
 134 193 to remove and 0 not upgraded and 1117MB need to be downloaded</p>
 135
 136 <p>I am very happy to notice that the Gnome desktop + laptop upgrade
 137 is able to migrate to dependency based boot sequencing and parallel
 138 booting without a hitch.  Was unsure if there were still bugs with
 139 packages failing to clean up their obsolete init.d script during
 140 upgrades, and no such problem seem to affect the Gnome desktop+laptop
 141 packages.</p>
 142 </div>
 143
 144       <div class="tags">Tags: <a href="http://people.skolelinux.org/pere/blog/tags/bootsystem">bootsystem</a>, <a href="http://people.skolelinux.org/pere/blog/tags/debian">debian</a>, <a href="http://people.skolelinux.org/pere/blog/tags/debian edu">debian edu</a>, <a href="http://people.skolelinux.org/pere/blog/tags/english">english</a>.</div>
 145
 146
 147     </div>
 148
 149
 150
 151
 152     <div id="sidebar">
 153
 154
 155
 156 <h2>Archive</h2>
 157 <ul>
 158
 159 <li>2012
 160 <ul>
 161
 162 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/01/">January (7)</a></li>
 163
 164 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/02/">February (10)</a></li>
 165
 166 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/03/">March (17)</a></li>
 167
 168 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/04/">April (12)</a></li>
 169
 170 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/05/">May (12)</a></li>
 171
 172 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/06/">June (20)</a></li>
 173
 174 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/07/">July (12)</a></li>
 175
 176 </ul></li>
 177
 178 <li>2011
 179 <ul>
 180
 181 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/01/">January (16)</a></li>
 182
 183 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/02/">February (6)</a></li>
 184
 185 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/03/">March (6)</a></li>
 186
 187 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/04/">April (7)</a></li>
 188
 189 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/05/">May (3)</a></li>
 190
 191 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/06/">June (2)</a></li>
 192
 193 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/07/">July (7)</a></li>
 194
 195 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/08/">August (6)</a></li>
 196
 197 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/09/">September (4)</a></li>
 198
 199 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/10/">October (2)</a></li>
 200
 201 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/11/">November (3)</a></li>
 202
 203 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/12/">December (1)</a></li>
 204
 205 </ul></li>
 206
 207 <li>2010
 208 <ul>
 209
 210 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/01/">January (2)</a></li>
 211
 212 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/02/">February (1)</a></li>
 213
 214 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/03/">March (3)</a></li>
 215
 216 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/04/">April (3)</a></li>
 217
 218 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/05/">May (9)</a></li>
 219
 220 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/06/">June (14)</a></li>
 221
 222 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/07/">July (12)</a></li>
 223
 224 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/08/">August (13)</a></li>
 225
 226 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/09/">September (7)</a></li>
 227
 228 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/10/">October (9)</a></li>
 229
 230 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/11/">November (13)</a></li>
 231
 232 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/12/">December (12)</a></li>
 233
 234 </ul></li>
 235
 236 <li>2009
 237 <ul>
 238
 239 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/01/">January (8)</a></li>
 240
 241 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/02/">February (8)</a></li>
 242
 243 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/03/">March (12)</a></li>
 244
 245 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/04/">April (10)</a></li>
 246
 247 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/05/">May (9)</a></li>
 248
 249 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/06/">June (3)</a></li>
 250
 251 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/07/">July (4)</a></li>
 252
 253 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/08/">August (3)</a></li>
 254
 255 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/09/">September (1)</a></li>
 256
 257 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/10/">October (2)</a></li>
 258
 259 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/11/">November (3)</a></li>
 260
 261 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/12/">December (3)</a></li>
 262
 263 </ul></li>
 264
 265 <li>2008
 266 <ul>
 267
 268 <li><a href="http://people.skolelinux.org/pere/blog/archive/2008/11/">November (5)</a></li>
 269
 270 <li><a href="http://people.skolelinux.org/pere/blog/archive/2008/12/">December (7)</a></li>
 271
 272 </ul></li>
 273
 274 </ul>
 275
 276
 277
 278 <h2>Tags</h2>
 279 <ul>
 280
 281  <li><a href="http://people.skolelinux.org/pere/blog/tags/3d-printer">3d-printer (13)</a></li>
 282
 283  <li><a href="http://people.skolelinux.org/pere/blog/tags/amiga">amiga (1)</a></li>
 284
 285  <li><a href="http://people.skolelinux.org/pere/blog/tags/aros">aros (1)</a></li>
 286
 287  <li><a href="http://people.skolelinux.org/pere/blog/tags/bitcoin">bitcoin (2)</a></li>
 288
 289  <li><a href="http://people.skolelinux.org/pere/blog/tags/bootsystem">bootsystem (12)</a></li>
 290
 291  <li><a href="http://people.skolelinux.org/pere/blog/tags/bsa">bsa (2)</a></li>
 292
 293  <li><a href="http://people.skolelinux.org/pere/blog/tags/debian">debian (55)</a></li>
 294
 295  <li><a href="http://people.skolelinux.org/pere/blog/tags/debian edu">debian edu (109)</a></li>
 296
 297  <li><a href="http://people.skolelinux.org/pere/blog/tags/digistan">digistan (9)</a></li>
 298
 299  <li><a href="http://people.skolelinux.org/pere/blog/tags/drivstoffpriser">drivstoffpriser (4)</a></li>
 300
 301  <li><a href="http://people.skolelinux.org/pere/blog/tags/english">english (141)</a></li>
 302
 303  <li><a href="http://people.skolelinux.org/pere/blog/tags/fiksgatami">fiksgatami (17)</a></li>
 304
 305  <li><a href="http://people.skolelinux.org/pere/blog/tags/fildeling">fildeling (12)</a></li>
 306
 307  <li><a href="http://people.skolelinux.org/pere/blog/tags/frikanalen">frikanalen (6)</a></li>
 308
 309  <li><a href="http://people.skolelinux.org/pere/blog/tags/intervju">intervju (30)</a></li>
 310
 311  <li><a href="http://people.skolelinux.org/pere/blog/tags/kart">kart (16)</a></li>
 312
 313  <li><a href="http://people.skolelinux.org/pere/blog/tags/ldap">ldap (8)</a></li>
 314
 315  <li><a href="http://people.skolelinux.org/pere/blog/tags/lenker">lenker (4)</a></li>
 316
 317  <li><a href="http://people.skolelinux.org/pere/blog/tags/ltsp">ltsp (1)</a></li>
 318
 319  <li><a href="http://people.skolelinux.org/pere/blog/tags/multimedia">multimedia (22)</a></li>
 320
 321  <li><a href="http://people.skolelinux.org/pere/blog/tags/norsk">norsk (188)</a></li>
 322
 323  <li><a href="http://people.skolelinux.org/pere/blog/tags/nuug">nuug (139)</a></li>
 324
 325  <li><a href="http://people.skolelinux.org/pere/blog/tags/offentlig innsyn">offentlig innsyn (4)</a></li>
 326
 327  <li><a href="http://people.skolelinux.org/pere/blog/tags/open311">open311 (2)</a></li>
 328
 329  <li><a href="http://people.skolelinux.org/pere/blog/tags/opphavsrett">opphavsrett (32)</a></li>
 330
 331  <li><a href="http://people.skolelinux.org/pere/blog/tags/personvern">personvern (48)</a></li>
 332
 333  <li><a href="http://people.skolelinux.org/pere/blog/tags/raid">raid (1)</a></li>
 334
 335  <li><a href="http://people.skolelinux.org/pere/blog/tags/reprap">reprap (11)</a></li>
 336
 337  <li><a href="http://people.skolelinux.org/pere/blog/tags/rfid">rfid (2)</a></li>
 338
 339  <li><a href="http://people.skolelinux.org/pere/blog/tags/robot">robot (4)</a></li>
 340
 341  <li><a href="http://people.skolelinux.org/pere/blog/tags/rss">rss (1)</a></li>
 342
 343  <li><a href="http://people.skolelinux.org/pere/blog/tags/ruter">ruter (4)</a></li>
 344
 345  <li><a href="http://people.skolelinux.org/pere/blog/tags/scraperwiki">scraperwiki (2)</a></li>
 346
 347  <li><a href="http://people.skolelinux.org/pere/blog/tags/sikkerhet">sikkerhet (23)</a></li>
 348
 349  <li><a href="http://people.skolelinux.org/pere/blog/tags/sitesummary">sitesummary (4)</a></li>
 350
 351  <li><a href="http://people.skolelinux.org/pere/blog/tags/skepsis">skepsis (1)</a></li>
 352
 353  <li><a href="http://people.skolelinux.org/pere/blog/tags/standard">standard (35)</a></li>
 354
 355  <li><a href="http://people.skolelinux.org/pere/blog/tags/stavekontroll">stavekontroll (1)</a></li>
 356
 357  <li><a href="http://people.skolelinux.org/pere/blog/tags/stortinget">stortinget (4)</a></li>
 358
 359  <li><a href="http://people.skolelinux.org/pere/blog/tags/surveillance">surveillance (10)</a></li>
 360
 361  <li><a href="http://people.skolelinux.org/pere/blog/tags/valg">valg (6)</a></li>
 362
 363  <li><a href="http://people.skolelinux.org/pere/blog/tags/video">video (32)</a></li>
 364
 365  <li><a href="http://people.skolelinux.org/pere/blog/tags/vitenskap">vitenskap (1)</a></li>
 366
 367  <li><a href="http://people.skolelinux.org/pere/blog/tags/web">web (25)</a></li>
 368
 369 </ul>
 370
 371
 372     </div>
 373     <p style="text-align: right">
 374  Created by <a href="http://steve.org.uk/Software/chronicle">Chronicle v4.4</a>
 375 </p>
 376
 377   </body>
 378 </html>