blog/Speeding_up_the_Debian_installer_using_eatmydata_and_dpkg_divert.html

   1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
   2           "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
   3 <html xmlns="http://www.w3.org/1999/xhtml" dir="ltr">
   4   <head>
   5     <meta http-equiv="Content-Type" content="text/html;charset=utf-8" />
   6     <title>Petter Reinholdtsen: Speeding up the Debian installer using eatmydata and dpkg-divert</title>
   7     <link rel="stylesheet" type="text/css" media="screen" href="http://people.skolelinux.org/pere/blog/style.css" />
   8     <link rel="stylesheet" type="text/css" media="screen" href="http://people.skolelinux.org/pere/blog/vim.css" />
   9
  10
  11   </head>
  12   <body>
  13     <div class="title">
  14  <h1>
  15      <a href="http://people.skolelinux.org/pere/blog/">Petter Reinholdtsen</a>
  16
  17  </h1>
  18
  19 </div>
  20
  21
  22     <div class="entry">
  23       <div class="title">Speeding up the Debian installer using eatmydata and dpkg-divert</div>
  24       <div class="date">16th September 2014</div>
  25       <div class="body"><p>The <a href="https://www.debian.org/">Debian</a> installer could be
  26 a lot quicker.  When we install more than 2000 packages in
  27 <a href="http://www.skolelinux.org/">Skolelinux / Debian Edu</a> using
  28 tasksel in the installer, unpacking the binary packages take forever.
  29 A part of the slow I/O issue was discussed in
  30 <a href="https://bugs.debian.org/613428">bug #613428</a> about too
  31 much file system sync-ing done by dpkg, which is the package
  32 responsible for unpacking the binary packages.  Other parts (like code
  33 executed by postinst scripts) might also sync to disk during
  34 installation.  All this sync-ing to disk do not really make sense to
  35 me.  If the machine crash half-way through, I start over, I do not try
  36 to salvage the half installed system.  So the failure sync-ing is
  37 supposed to protect against, hardware or system crash, is not really
  38 relevant while the installer is running.</p>
  39
  40 <p>A few days ago, I thought of a way to get rid of all the file
  41 system sync()-ing in a fairly non-intrusive way, without the need to
  42 change the code in several packages.  The idea is not new, but I have
  43 not heard anyone propose the approach using dpkg-divert before.  It
  44 depend on the small and clever package
  45 <a href="https://packages.qa.debian.org/eatmydata">eatmydata</a>, which
  46 uses LD_PRELOAD to replace the system functions for syncing data to
  47 disk with functions doing nothing, thus allowing programs to live
  48 dangerous while speeding up disk I/O significantly.  Instead of
  49 modifying the implementation of dpkg, apt and tasksel (which are the
  50 packages responsible for selecting, fetching and installing packages),
  51 it occurred to me that we could just divert the programs away, replace
  52 them with a simple shell wrapper calling
  53 "eatmydata&nbsp;$program&nbsp;$@", to get the same effect.
  54 Two days ago I decided to test the idea, and wrapped up a simple
  55 implementation for the Debian Edu udeb.</p>
  56
  57 <p>The effect was stunning.  In my first test it reduced the running
  58 time of the pkgsel step (installing tasks) from 64 to less than 44
  59 minutes (20 minutes shaved off the installation) on an old Dell
  60 Latitude D505 machine.  I am not quite sure what the optimised time
  61 would have been, as I messed up the testing a bit, causing the debconf
  62 priority to get low enough for two questions to pop up during
  63 installation.  As soon as I saw the questions I moved the installation
  64 along, but do not know how long the question were holding up the
  65 installation.  I did some more measurements using Debian Edu Jessie,
  66 and got these results.  The time measured is the time stamp in
  67 /var/log/syslog between the "pkgsel: starting tasksel" and the
  68 "pkgsel: finishing up" lines, if you want to do the same measurement
  69 yourself.  In Debian Edu, the tasksel dialog do not show up, and the
  70 timing thus do not depend on how quickly the user handle the tasksel
  71 dialog.</p>
  72
  73 <p><table>
  74
  75 <tr>
  76 <th>Machine/setup</th>
  77 <th>Original tasksel</th>
  78 <th>Optimised tasksel</th>
  79 <th>Reduction</th>
  80 </tr>
  81
  82 <tr>
  83 <td>Latitude D505 Main+LTSP LXDE</td>
  84 <td>64 min (07:46-08:50)</td>
  85 <td><44 min (11:27-12:11)</td>
  86 <td>>20 min 18%</td>
  87 </tr>
  88
  89 <tr>
  90 <td>Latitude D505 Roaming LXDE</td>
  91 <td>57 min (08:48-09:45)</td>
  92 <td>34 min (07:43-08:17)</td>
  93 <td>23 min 40%</td>
  94 </tr>
  95
  96 <tr>
  97 <td>Latitude D505 Minimal</td>
  98 <td>22 min (10:37-10:59)</td>
  99 <td>11 min (11:16-11:27)</td>
 100 <td>11 min 50%</td>
 101 </tr>
 102
 103 <tr>
 104 <td>Thinkpad X200 Minimal</td>
 105 <td>6 min (08:19-08:25)</td>
 106 <td>4 min (08:04-08:08)</td>
 107 <td>2 min 33%</td>
 108 </tr>
 109
 110 <tr>
 111 <td>Thinkpad X200 Roaming KDE</td>
 112 <td>19 min (09:21-09:40)</td>
 113 <td>15 min (10:25-10:40)</td>
 114 <td>4 min 21%</td>
 115 </tr>
 116
 117 </table></p>
 118
 119 <p>The test is done using a netinst ISO on a USB stick, so some of the
 120 time is spent downloading packages.  The connection to the Internet
 121 was 100Mbit/s during testing, so downloading should not be a
 122 significant factor in the measurement.  Download typically took a few
 123 seconds to a few minutes, depending on the amount of packages being
 124 installed.</p>
 125
 126 <p>The speedup is implemented by using two hooks in
 127 <a href="https://www.debian.org/devel/debian-installer/">Debian
 128 Installer</a>, the pre-pkgsel.d hook to set up the diverts, and the
 129 finish-install.d hook to remove the divert at the end of the
 130 installation.  I picked the pre-pkgsel.d hook instead of the
 131 post-base-installer.d hook because I test using an ISO without the
 132 eatmydata package included, and the post-base-installer.d hook in
 133 Debian Edu can only operate on packages included in the ISO.  The
 134 negative effect of this is that I am unable to activate this
 135 optimization for the kernel installation step in d-i.  If the code is
 136 moved to the post-base-installer.d hook, the speedup would be larger
 137 for the entire installation.</p>
 138
 139 <p>I've implemented this in the
 140 <a href="https://packages.qa.debian.org/debian-edu-install">debian-edu-install</a>
 141 git repository, and plan to provide the optimization as part of the
 142 Debian Edu installation.  If you want to test this yourself, you can
 143 create two files in the installer (or in an udeb).  One shell script
 144 need do go into /usr/lib/pre-pkgsel.d/, with content like this:</p>
 145
 146 <p><blockquote><pre>
 147 #!/bin/sh
 148 set -e
 149 . /usr/share/debconf/confmodule
 150 info() {
 151     logger -t my-pkgsel "info: $*"
 152 }
 153 error() {
 154     logger -t my-pkgsel "error: $*"
 155 }
 156 override_install() {
 157     apt-install eatmydata || true
 158     if [ -x /target/usr/bin/eatmydata ] ; then
 159         for bin in dpkg apt-get aptitude tasksel ; do
 160             file=/usr/bin/$bin
 161             # Test that the file exist and have not been diverted already.
 162             if [ -f /target$file ] ; then
 163                 info "diverting $file using eatmydata"
 164                 printf "#!/bin/sh\neatmydata $bin.distrib \"\$@\"\n" \
 165                     > /target$file.edu
 166                 chmod 755 /target$file.edu
 167                 in-target dpkg-divert --package debian-edu-config \
 168                     --rename --quiet --add $file
 169                 ln -sf ./$bin.edu /target$file
 170             else
 171                 error "unable to divert $file, as it is missing."
 172             fi
 173         done
 174     else
 175         error "unable to find /usr/bin/eatmydata after installing the eatmydata pacage"
 176     fi
 177 }
 178
 179 override_install
 180 </pre></blockquote></p>
 181
 182 <p>To clean up, another shell script should go into
 183 /usr/lib/finish-install.d/ with code like this:
 184
 185 <p><blockquote><pre>
 186 #! /bin/sh -e
 187 . /usr/share/debconf/confmodule
 188 error() {
 189     logger -t my-finish-install "error: $@"
 190 }
 191 remove_install_override() {
 192     for bin in dpkg apt-get aptitude tasksel ; do
 193         file=/usr/bin/$bin
 194         if [ -x /target$file.edu ] ; then
 195             rm /target$file
 196             in-target dpkg-divert --package debian-edu-config \
 197                 --rename --quiet --remove $file
 198             rm /target$file.edu
 199         else
 200             error "Missing divert for $file."
 201         fi
 202     done
 203     sync # Flush file buffers before continuing
 204 }
 205
 206 remove_install_override
 207 </pre></blockquote></p>
 208
 209 <p>In Debian Edu, I placed both code fragments in a separate script
 210 edu-eatmydata-install and call it from the pre-pkgsel.d and
 211 finish-install.d scripts.</p>
 212
 213 <p>By now you might ask if this change should get into the normal
 214 Debian installer too?  I suspect it should, but am not sure the
 215 current debian-installer coordinators find it useful enough.  It also
 216 depend on the side effects of the change.  I'm not aware of any, but I
 217 guess we will see if the change is safe after some more testing.
 218 Perhaps there is some package in Debian depending on sync() and
 219 fsync() having effect?  Perhaps it should go into its own udeb, to
 220 allow those of us wanting to enable it to do so without affecting
 221 everyone.</p>
 222
 223 <p>Update 2014-09-24: Since a few days ago, enabling this optimization
 224 will break installation of all programs using gnutls because of
 225 <a href="https://bugs.debian.org/702711">bug #702711</a>.  An updated
 226 eatmydata package in Debian will solve it.</p>
 227
 228 <p>Update 2014-10-17: The bug mentioned above is fixed in testing and
 229 the optimization work again.  And I have discovered that the
 230 dpkg-divert trick is not really needed and implemented a slightly
 231 simpler approach as part of the debian-edu-install package.  See
 232 tools/edu-eatmydata-install in the source package.</p>
 233
 234 <p>Update 2014-11-11: Unfortunately, a new
 235 <a href="http://bugs.debian.org/765738">bug #765738</a> in eatmydata only
 236 triggering on i386 made it into testing, and broke this installation
 237 optimization again.  If <a href="http://bugs.debian.org/768893">unblock
 238 request 768893</a> is accepted, it should be working again.</p>
 239 </div>
 240
 241       <div class="tags">Tags: <a href="http://people.skolelinux.org/pere/blog/tags/debian">debian</a>, <a href="http://people.skolelinux.org/pere/blog/tags/debian edu">debian edu</a>, <a href="http://people.skolelinux.org/pere/blog/tags/english">english</a>.</div>
 242
 243
 244     </div>
 245
 246
 247
 248
 249     <div id="sidebar">
 250
 251
 252
 253 <h2>Archive</h2>
 254 <ul>
 255
 256 <li>2022
 257 <ul>
 258
 259 <li><a href="http://people.skolelinux.org/pere/blog/archive/2022/02/">February (1)</a></li>
 260
 261 </ul></li>
 262
 263 <li>2021
 264 <ul>
 265
 266 <li><a href="http://people.skolelinux.org/pere/blog/archive/2021/01/">January (2)</a></li>
 267
 268 <li><a href="http://people.skolelinux.org/pere/blog/archive/2021/02/">February (1)</a></li>
 269
 270 <li><a href="http://people.skolelinux.org/pere/blog/archive/2021/05/">May (1)</a></li>
 271
 272 <li><a href="http://people.skolelinux.org/pere/blog/archive/2021/06/">June (1)</a></li>
 273
 274 <li><a href="http://people.skolelinux.org/pere/blog/archive/2021/07/">July (3)</a></li>
 275
 276 <li><a href="http://people.skolelinux.org/pere/blog/archive/2021/08/">August (1)</a></li>
 277
 278 <li><a href="http://people.skolelinux.org/pere/blog/archive/2021/09/">September (1)</a></li>
 279
 280 <li><a href="http://people.skolelinux.org/pere/blog/archive/2021/10/">October (1)</a></li>
 281
 282 <li><a href="http://people.skolelinux.org/pere/blog/archive/2021/12/">December (1)</a></li>
 283
 284 </ul></li>
 285
 286 <li>2020
 287 <ul>
 288
 289 <li><a href="http://people.skolelinux.org/pere/blog/archive/2020/02/">February (2)</a></li>
 290
 291 <li><a href="http://people.skolelinux.org/pere/blog/archive/2020/03/">March (2)</a></li>
 292
 293 <li><a href="http://people.skolelinux.org/pere/blog/archive/2020/04/">April (2)</a></li>
 294
 295 <li><a href="http://people.skolelinux.org/pere/blog/archive/2020/05/">May (3)</a></li>
 296
 297 <li><a href="http://people.skolelinux.org/pere/blog/archive/2020/06/">June (2)</a></li>
 298
 299 <li><a href="http://people.skolelinux.org/pere/blog/archive/2020/07/">July (1)</a></li>
 300
 301 <li><a href="http://people.skolelinux.org/pere/blog/archive/2020/09/">September (1)</a></li>
 302
 303 <li><a href="http://people.skolelinux.org/pere/blog/archive/2020/10/">October (1)</a></li>
 304
 305 <li><a href="http://people.skolelinux.org/pere/blog/archive/2020/11/">November (1)</a></li>
 306
 307 </ul></li>
 308
 309 <li>2019
 310 <ul>
 311
 312 <li><a href="http://people.skolelinux.org/pere/blog/archive/2019/01/">January (4)</a></li>
 313
 314 <li><a href="http://people.skolelinux.org/pere/blog/archive/2019/02/">February (3)</a></li>
 315
 316 <li><a href="http://people.skolelinux.org/pere/blog/archive/2019/03/">March (3)</a></li>
 317
 318 <li><a href="http://people.skolelinux.org/pere/blog/archive/2019/05/">May (2)</a></li>
 319
 320 <li><a href="http://people.skolelinux.org/pere/blog/archive/2019/06/">June (5)</a></li>
 321
 322 <li><a href="http://people.skolelinux.org/pere/blog/archive/2019/07/">July (2)</a></li>
 323
 324 <li><a href="http://people.skolelinux.org/pere/blog/archive/2019/08/">August (1)</a></li>
 325
 326 <li><a href="http://people.skolelinux.org/pere/blog/archive/2019/09/">September (1)</a></li>
 327
 328 <li><a href="http://people.skolelinux.org/pere/blog/archive/2019/11/">November (1)</a></li>
 329
 330 <li><a href="http://people.skolelinux.org/pere/blog/archive/2019/12/">December (4)</a></li>
 331
 332 </ul></li>
 333
 334 <li>2018
 335 <ul>
 336
 337 <li><a href="http://people.skolelinux.org/pere/blog/archive/2018/01/">January (1)</a></li>
 338
 339 <li><a href="http://people.skolelinux.org/pere/blog/archive/2018/02/">February (5)</a></li>
 340
 341 <li><a href="http://people.skolelinux.org/pere/blog/archive/2018/03/">March (5)</a></li>
 342
 343 <li><a href="http://people.skolelinux.org/pere/blog/archive/2018/04/">April (3)</a></li>
 344
 345 <li><a href="http://people.skolelinux.org/pere/blog/archive/2018/06/">June (2)</a></li>
 346
 347 <li><a href="http://people.skolelinux.org/pere/blog/archive/2018/07/">July (5)</a></li>
 348
 349 <li><a href="http://people.skolelinux.org/pere/blog/archive/2018/08/">August (3)</a></li>
 350
 351 <li><a href="http://people.skolelinux.org/pere/blog/archive/2018/09/">September (3)</a></li>
 352
 353 <li><a href="http://people.skolelinux.org/pere/blog/archive/2018/10/">October (5)</a></li>
 354
 355 <li><a href="http://people.skolelinux.org/pere/blog/archive/2018/11/">November (2)</a></li>
 356
 357 <li><a href="http://people.skolelinux.org/pere/blog/archive/2018/12/">December (4)</a></li>
 358
 359 </ul></li>
 360
 361 <li>2017
 362 <ul>
 363
 364 <li><a href="http://people.skolelinux.org/pere/blog/archive/2017/01/">January (4)</a></li>
 365
 366 <li><a href="http://people.skolelinux.org/pere/blog/archive/2017/02/">February (3)</a></li>
 367
 368 <li><a href="http://people.skolelinux.org/pere/blog/archive/2017/03/">March (5)</a></li>
 369
 370 <li><a href="http://people.skolelinux.org/pere/blog/archive/2017/04/">April (2)</a></li>
 371
 372 <li><a href="http://people.skolelinux.org/pere/blog/archive/2017/06/">June (5)</a></li>
 373
 374 <li><a href="http://people.skolelinux.org/pere/blog/archive/2017/07/">July (1)</a></li>
 375
 376 <li><a href="http://people.skolelinux.org/pere/blog/archive/2017/08/">August (1)</a></li>
 377
 378 <li><a href="http://people.skolelinux.org/pere/blog/archive/2017/09/">September (3)</a></li>
 379
 380 <li><a href="http://people.skolelinux.org/pere/blog/archive/2017/10/">October (5)</a></li>
 381
 382 <li><a href="http://people.skolelinux.org/pere/blog/archive/2017/11/">November (3)</a></li>
 383
 384 <li><a href="http://people.skolelinux.org/pere/blog/archive/2017/12/">December (4)</a></li>
 385
 386 </ul></li>
 387
 388 <li>2016
 389 <ul>
 390
 391 <li><a href="http://people.skolelinux.org/pere/blog/archive/2016/01/">January (3)</a></li>
 392
 393 <li><a href="http://people.skolelinux.org/pere/blog/archive/2016/02/">February (2)</a></li>
 394
 395 <li><a href="http://people.skolelinux.org/pere/blog/archive/2016/03/">March (3)</a></li>
 396
 397 <li><a href="http://people.skolelinux.org/pere/blog/archive/2016/04/">April (8)</a></li>
 398
 399 <li><a href="http://people.skolelinux.org/pere/blog/archive/2016/05/">May (8)</a></li>
 400
 401 <li><a href="http://people.skolelinux.org/pere/blog/archive/2016/06/">June (2)</a></li>
 402
 403 <li><a href="http://people.skolelinux.org/pere/blog/archive/2016/07/">July (2)</a></li>
 404
 405 <li><a href="http://people.skolelinux.org/pere/blog/archive/2016/08/">August (5)</a></li>
 406
 407 <li><a href="http://people.skolelinux.org/pere/blog/archive/2016/09/">September (2)</a></li>
 408
 409 <li><a href="http://people.skolelinux.org/pere/blog/archive/2016/10/">October (3)</a></li>
 410
 411 <li><a href="http://people.skolelinux.org/pere/blog/archive/2016/11/">November (8)</a></li>
 412
 413 <li><a href="http://people.skolelinux.org/pere/blog/archive/2016/12/">December (5)</a></li>
 414
 415 </ul></li>
 416
 417 <li>2015
 418 <ul>
 419
 420 <li><a href="http://people.skolelinux.org/pere/blog/archive/2015/01/">January (7)</a></li>
 421
 422 <li><a href="http://people.skolelinux.org/pere/blog/archive/2015/02/">February (6)</a></li>
 423
 424 <li><a href="http://people.skolelinux.org/pere/blog/archive/2015/03/">March (1)</a></li>
 425
 426 <li><a href="http://people.skolelinux.org/pere/blog/archive/2015/04/">April (4)</a></li>
 427
 428 <li><a href="http://people.skolelinux.org/pere/blog/archive/2015/05/">May (3)</a></li>
 429
 430 <li><a href="http://people.skolelinux.org/pere/blog/archive/2015/06/">June (4)</a></li>
 431
 432 <li><a href="http://people.skolelinux.org/pere/blog/archive/2015/07/">July (6)</a></li>
 433
 434 <li><a href="http://people.skolelinux.org/pere/blog/archive/2015/08/">August (2)</a></li>
 435
 436 <li><a href="http://people.skolelinux.org/pere/blog/archive/2015/09/">September (2)</a></li>
 437
 438 <li><a href="http://people.skolelinux.org/pere/blog/archive/2015/10/">October (9)</a></li>
 439
 440 <li><a href="http://people.skolelinux.org/pere/blog/archive/2015/11/">November (6)</a></li>
 441
 442 <li><a href="http://people.skolelinux.org/pere/blog/archive/2015/12/">December (3)</a></li>
 443
 444 </ul></li>
 445
 446 <li>2014
 447 <ul>
 448
 449 <li><a href="http://people.skolelinux.org/pere/blog/archive/2014/01/">January (2)</a></li>
 450
 451 <li><a href="http://people.skolelinux.org/pere/blog/archive/2014/02/">February (3)</a></li>
 452
 453 <li><a href="http://people.skolelinux.org/pere/blog/archive/2014/03/">March (8)</a></li>
 454
 455 <li><a href="http://people.skolelinux.org/pere/blog/archive/2014/04/">April (7)</a></li>
 456
 457 <li><a href="http://people.skolelinux.org/pere/blog/archive/2014/05/">May (1)</a></li>
 458
 459 <li><a href="http://people.skolelinux.org/pere/blog/archive/2014/06/">June (2)</a></li>
 460
 461 <li><a href="http://people.skolelinux.org/pere/blog/archive/2014/07/">July (2)</a></li>
 462
 463 <li><a href="http://people.skolelinux.org/pere/blog/archive/2014/08/">August (2)</a></li>
 464
 465 <li><a href="http://people.skolelinux.org/pere/blog/archive/2014/09/">September (5)</a></li>
 466
 467 <li><a href="http://people.skolelinux.org/pere/blog/archive/2014/10/">October (6)</a></li>
 468
 469 <li><a href="http://people.skolelinux.org/pere/blog/archive/2014/11/">November (3)</a></li>
 470
 471 <li><a href="http://people.skolelinux.org/pere/blog/archive/2014/12/">December (5)</a></li>
 472
 473 </ul></li>
 474
 475 <li>2013
 476 <ul>
 477
 478 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/01/">January (11)</a></li>
 479
 480 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/02/">February (9)</a></li>
 481
 482 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/03/">March (9)</a></li>
 483
 484 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/04/">April (6)</a></li>
 485
 486 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/05/">May (9)</a></li>
 487
 488 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/06/">June (10)</a></li>
 489
 490 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/07/">July (7)</a></li>
 491
 492 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/08/">August (3)</a></li>
 493
 494 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/09/">September (5)</a></li>
 495
 496 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/10/">October (7)</a></li>
 497
 498 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/11/">November (9)</a></li>
 499
 500 <li><a href="http://people.skolelinux.org/pere/blog/archive/2013/12/">December (3)</a></li>
 501
 502 </ul></li>
 503
 504 <li>2012
 505 <ul>
 506
 507 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/01/">January (7)</a></li>
 508
 509 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/02/">February (10)</a></li>
 510
 511 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/03/">March (17)</a></li>
 512
 513 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/04/">April (12)</a></li>
 514
 515 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/05/">May (12)</a></li>
 516
 517 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/06/">June (20)</a></li>
 518
 519 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/07/">July (17)</a></li>
 520
 521 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/08/">August (6)</a></li>
 522
 523 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/09/">September (9)</a></li>
 524
 525 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/10/">October (17)</a></li>
 526
 527 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/11/">November (10)</a></li>
 528
 529 <li><a href="http://people.skolelinux.org/pere/blog/archive/2012/12/">December (7)</a></li>
 530
 531 </ul></li>
 532
 533 <li>2011
 534 <ul>
 535
 536 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/01/">January (16)</a></li>
 537
 538 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/02/">February (6)</a></li>
 539
 540 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/03/">March (6)</a></li>
 541
 542 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/04/">April (7)</a></li>
 543
 544 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/05/">May (3)</a></li>
 545
 546 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/06/">June (2)</a></li>
 547
 548 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/07/">July (7)</a></li>
 549
 550 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/08/">August (6)</a></li>
 551
 552 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/09/">September (4)</a></li>
 553
 554 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/10/">October (2)</a></li>
 555
 556 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/11/">November (3)</a></li>
 557
 558 <li><a href="http://people.skolelinux.org/pere/blog/archive/2011/12/">December (1)</a></li>
 559
 560 </ul></li>
 561
 562 <li>2010
 563 <ul>
 564
 565 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/01/">January (2)</a></li>
 566
 567 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/02/">February (1)</a></li>
 568
 569 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/03/">March (3)</a></li>
 570
 571 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/04/">April (3)</a></li>
 572
 573 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/05/">May (9)</a></li>
 574
 575 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/06/">June (14)</a></li>
 576
 577 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/07/">July (12)</a></li>
 578
 579 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/08/">August (13)</a></li>
 580
 581 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/09/">September (7)</a></li>
 582
 583 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/10/">October (9)</a></li>
 584
 585 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/11/">November (13)</a></li>
 586
 587 <li><a href="http://people.skolelinux.org/pere/blog/archive/2010/12/">December (12)</a></li>
 588
 589 </ul></li>
 590
 591 <li>2009
 592 <ul>
 593
 594 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/01/">January (8)</a></li>
 595
 596 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/02/">February (8)</a></li>
 597
 598 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/03/">March (12)</a></li>
 599
 600 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/04/">April (10)</a></li>
 601
 602 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/05/">May (9)</a></li>
 603
 604 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/06/">June (3)</a></li>
 605
 606 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/07/">July (4)</a></li>
 607
 608 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/08/">August (3)</a></li>
 609
 610 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/09/">September (1)</a></li>
 611
 612 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/10/">October (2)</a></li>
 613
 614 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/11/">November (3)</a></li>
 615
 616 <li><a href="http://people.skolelinux.org/pere/blog/archive/2009/12/">December (3)</a></li>
 617
 618 </ul></li>
 619
 620 <li>2008
 621 <ul>
 622
 623 <li><a href="http://people.skolelinux.org/pere/blog/archive/2008/11/">November (5)</a></li>
 624
 625 <li><a href="http://people.skolelinux.org/pere/blog/archive/2008/12/">December (7)</a></li>
 626
 627 </ul></li>
 628
 629 </ul>
 630
 631
 632
 633 <h2>Tags</h2>
 634 <ul>
 635
 636  <li><a href="http://people.skolelinux.org/pere/blog/tags/3d-printer">3d-printer (16)</a></li>
 637
 638  <li><a href="http://people.skolelinux.org/pere/blog/tags/amiga">amiga (1)</a></li>
 639
 640  <li><a href="http://people.skolelinux.org/pere/blog/tags/aros">aros (1)</a></li>
 641
 642  <li><a href="http://people.skolelinux.org/pere/blog/tags/bankid">bankid (4)</a></li>
 643
 644  <li><a href="http://people.skolelinux.org/pere/blog/tags/betalkontant">betalkontant (9)</a></li>
 645
 646  <li><a href="http://people.skolelinux.org/pere/blog/tags/bitcoin">bitcoin (12)</a></li>
 647
 648  <li><a href="http://people.skolelinux.org/pere/blog/tags/bootsystem">bootsystem (17)</a></li>
 649
 650  <li><a href="http://people.skolelinux.org/pere/blog/tags/bsa">bsa (2)</a></li>
 651
 652  <li><a href="http://people.skolelinux.org/pere/blog/tags/chrpath">chrpath (2)</a></li>
 653
 654  <li><a href="http://people.skolelinux.org/pere/blog/tags/debian">debian (177)</a></li>
 655
 656  <li><a href="http://people.skolelinux.org/pere/blog/tags/debian edu">debian edu (159)</a></li>
 657
 658  <li><a href="http://people.skolelinux.org/pere/blog/tags/debian-handbook">debian-handbook (8)</a></li>
 659
 660  <li><a href="http://people.skolelinux.org/pere/blog/tags/digistan">digistan (11)</a></li>
 661
 662  <li><a href="http://people.skolelinux.org/pere/blog/tags/dld">dld (18)</a></li>
 663
 664  <li><a href="http://people.skolelinux.org/pere/blog/tags/docbook">docbook (30)</a></li>
 665
 666  <li><a href="http://people.skolelinux.org/pere/blog/tags/drivstoffpriser">drivstoffpriser (4)</a></li>
 667
 668  <li><a href="http://people.skolelinux.org/pere/blog/tags/english">english (430)</a></li>
 669
 670  <li><a href="http://people.skolelinux.org/pere/blog/tags/fiksgatami">fiksgatami (23)</a></li>
 671
 672  <li><a href="http://people.skolelinux.org/pere/blog/tags/fildeling">fildeling (14)</a></li>
 673
 674  <li><a href="http://people.skolelinux.org/pere/blog/tags/freeculture">freeculture (34)</a></li>
 675
 676  <li><a href="http://people.skolelinux.org/pere/blog/tags/freedombox">freedombox (9)</a></li>
 677
 678  <li><a href="http://people.skolelinux.org/pere/blog/tags/frikanalen">frikanalen (20)</a></li>
 679
 680  <li><a href="http://people.skolelinux.org/pere/blog/tags/h264">h264 (20)</a></li>
 681
 682  <li><a href="http://people.skolelinux.org/pere/blog/tags/intervju">intervju (43)</a></li>
 683
 684  <li><a href="http://people.skolelinux.org/pere/blog/tags/isenkram">isenkram (16)</a></li>
 685
 686  <li><a href="http://people.skolelinux.org/pere/blog/tags/kart">kart (23)</a></li>
 687
 688  <li><a href="http://people.skolelinux.org/pere/blog/tags/kodi">kodi (4)</a></li>
 689
 690  <li><a href="http://people.skolelinux.org/pere/blog/tags/ldap">ldap (9)</a></li>
 691
 692  <li><a href="http://people.skolelinux.org/pere/blog/tags/lego">lego (5)</a></li>
 693
 694  <li><a href="http://people.skolelinux.org/pere/blog/tags/lenker">lenker (8)</a></li>
 695
 696  <li><a href="http://people.skolelinux.org/pere/blog/tags/lsdvd">lsdvd (2)</a></li>
 697
 698  <li><a href="http://people.skolelinux.org/pere/blog/tags/ltsp">ltsp (1)</a></li>
 699
 700  <li><a href="http://people.skolelinux.org/pere/blog/tags/madewithcc">madewithcc (3)</a></li>
 701
 702  <li><a href="http://people.skolelinux.org/pere/blog/tags/mesh network">mesh network (8)</a></li>
 703
 704  <li><a href="http://people.skolelinux.org/pere/blog/tags/multimedia">multimedia (42)</a></li>
 705
 706  <li><a href="http://people.skolelinux.org/pere/blog/tags/nice free software">nice free software (13)</a></li>
 707
 708  <li><a href="http://people.skolelinux.org/pere/blog/tags/noark5">noark5 (23)</a></li>
 709
 710  <li><a href="http://people.skolelinux.org/pere/blog/tags/norsk">norsk (319)</a></li>
 711
 712  <li><a href="http://people.skolelinux.org/pere/blog/tags/nuug">nuug (198)</a></li>
 713
 714  <li><a href="http://people.skolelinux.org/pere/blog/tags/offentlig innsyn">offentlig innsyn (40)</a></li>
 715
 716  <li><a href="http://people.skolelinux.org/pere/blog/tags/open311">open311 (2)</a></li>
 717
 718  <li><a href="http://people.skolelinux.org/pere/blog/tags/opphavsrett">opphavsrett (75)</a></li>
 719
 720  <li><a href="http://people.skolelinux.org/pere/blog/tags/personvern">personvern (113)</a></li>
 721
 722  <li><a href="http://people.skolelinux.org/pere/blog/tags/raid">raid (2)</a></li>
 723
 724  <li><a href="http://people.skolelinux.org/pere/blog/tags/reactos">reactos (1)</a></li>
 725
 726  <li><a href="http://people.skolelinux.org/pere/blog/tags/reprap">reprap (11)</a></li>
 727
 728  <li><a href="http://people.skolelinux.org/pere/blog/tags/rfid">rfid (3)</a></li>
 729
 730  <li><a href="http://people.skolelinux.org/pere/blog/tags/robot">robot (13)</a></li>
 731
 732  <li><a href="http://people.skolelinux.org/pere/blog/tags/rss">rss (1)</a></li>
 733
 734  <li><a href="http://people.skolelinux.org/pere/blog/tags/ruter">ruter (7)</a></li>
 735
 736  <li><a href="http://people.skolelinux.org/pere/blog/tags/scraperwiki">scraperwiki (2)</a></li>
 737
 738  <li><a href="http://people.skolelinux.org/pere/blog/tags/sikkerhet">sikkerhet (59)</a></li>
 739
 740  <li><a href="http://people.skolelinux.org/pere/blog/tags/sitesummary">sitesummary (4)</a></li>
 741
 742  <li><a href="http://people.skolelinux.org/pere/blog/tags/skepsis">skepsis (5)</a></li>
 743
 744  <li><a href="http://people.skolelinux.org/pere/blog/tags/standard">standard (71)</a></li>
 745
 746  <li><a href="http://people.skolelinux.org/pere/blog/tags/stavekontroll">stavekontroll (7)</a></li>
 747
 748  <li><a href="http://people.skolelinux.org/pere/blog/tags/stortinget">stortinget (14)</a></li>
 749
 750  <li><a href="http://people.skolelinux.org/pere/blog/tags/surveillance">surveillance (61)</a></li>
 751
 752  <li><a href="http://people.skolelinux.org/pere/blog/tags/sysadmin">sysadmin (5)</a></li>
 753
 754  <li><a href="http://people.skolelinux.org/pere/blog/tags/usenix">usenix (2)</a></li>
 755
 756  <li><a href="http://people.skolelinux.org/pere/blog/tags/valg">valg (9)</a></li>
 757
 758  <li><a href="http://people.skolelinux.org/pere/blog/tags/verkidetfri">verkidetfri (20)</a></li>
 759
 760  <li><a href="http://people.skolelinux.org/pere/blog/tags/video">video (76)</a></li>
 761
 762  <li><a href="http://people.skolelinux.org/pere/blog/tags/vitenskap">vitenskap (4)</a></li>
 763
 764  <li><a href="http://people.skolelinux.org/pere/blog/tags/web">web (42)</a></li>
 765
 766 </ul>
 767
 768
 769     </div>
 770     <p style="text-align: right">
 771  Created by <a href="http://steve.org.uk/Software/chronicle">Chronicle v4.6</a>
 772 </p>
 773
 774   </body>
 775 </html>