blog/Some_notes_on_fault_tolerant_storage_systems.html

   1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
   2           "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
   3 <html xmlns="http://www.w3.org/1999/xhtml" dir="ltr">
   4   <head>
   5     <meta http-equiv="Content-Type" content="text/html;charset=utf-8" />
   6     <title>Petter Reinholdtsen: Some notes on fault tolerant storage systems</title>
   7     <link rel="stylesheet" type="text/css" media="screen" href="https://people.skolelinux.org/pere/blog/style.css" />
   8     <link rel="stylesheet" type="text/css" media="screen" href="https://people.skolelinux.org/pere/blog/vim.css" />
   9
  10
  11   </head>
  12   <body>
  13     <div class="title">
  14  <h1>
  15      <a href="https://people.skolelinux.org/pere/blog/">Petter Reinholdtsen</a>
  16
  17  </h1>
  18
  19 </div>
  20
  21
  22     <div class="entry">
  23       <div class="title">Some notes on fault tolerant storage systems</div>
  24       <div class="date"> 1st November 2017</div>
  25       <div class="body"><p>If you care about how fault tolerant your storage is, you might
  26 find these articles and papers interesting.  They have formed how I
  27 think of when designing a storage system.</p>
  28
  29 <ul>
  30
  31 <li>USENIX :login; <a
  32 href="https://www.usenix.org/publications/login/summer2017/ganesan">Redundancy
  33 Does Not Imply Fault Tolerance.  Analysis of Distributed Storage
  34 Reactions to Single Errors and Corruptions</a> by Aishwarya Ganesan,
  35 Ramnatthan Alagappan, Andrea C. Arpaci-Dusseau, and Remzi
  36 H. Arpaci-Dusseau</li>
  37
  38 <li>ZDNet
  39 <a href="http://www.zdnet.com/article/why-raid-5-stops-working-in-2009/">Why
  40 RAID 5 stops working in 2009</a> by Robin Harris</li>
  41
  42 <li>ZDNet
  43 <a href="http://www.zdnet.com/article/why-raid-6-stops-working-in-2019/">Why
  44 RAID 6 stops working in 2019</a> by Robin Harris</li>
  45
  46 <li>USENIX FAST'07
  47 <a href="http://research.google.com/archive/disk_failures.pdf">Failure
  48 Trends in a Large Disk Drive Population</a> by Eduardo Pinheiro,
  49 Wolf-Dietrich Weber and Luiz André Barroso</li>
  50
  51 <li>USENIX ;login: <a
  52 href="https://www.usenix.org/system/files/login/articles/hughes12-04.pdf">Data
  53 Integrity.  Finding Truth in a World of Guesses and Lies</a> by Doug
  54 Hughes</li>
  55
  56 <li>USENIX FAST'08
  57 <a href="https://www.usenix.org/events/fast08/tech/full_papers/bairavasundaram/bairavasundaram_html/">An
  58 Analysis of Data Corruption in the Storage Stack</a> by
  59 L. N. Bairavasundaram, G. R. Goodson, B. Schroeder, A. C.
  60 Arpaci-Dusseau, and R. H. Arpaci-Dusseau</li>
  61
  62 <li>USENIX FAST'07 <a
  63 href="https://www.usenix.org/legacy/events/fast07/tech/schroeder/schroeder_html/">Disk
  64 failures in the real world: what does an MTTF of 1,000,000 hours mean
  65 to you?</a> by B. Schroeder and G. A. Gibson.</li>
  66
  67 <li>USENIX ;login: <a
  68 href="https://www.usenix.org/events/fast08/tech/full_papers/jiang/jiang_html/">Are
  69 Disks the Dominant Contributor for Storage Failures?  A Comprehensive
  70 Study of Storage Subsystem Failure Characteristics</a> by Weihang
  71 Jiang, Chongfeng Hu, Yuanyuan Zhou, and Arkady Kanevsky</li>
  72
  73 <li>SIGMETRICS 2007
  74 <a href="http://research.cs.wisc.edu/adsl/Publications/latent-sigmetrics07.pdf">An
  75 analysis of latent sector errors in disk drives</a> by
  76 L. N. Bairavasundaram, G. R. Goodson, S. Pasupathy, and J. Schindler</li>
  77
  78 </ul>
  79
  80 <p>Several of these research papers are based on data collected from
  81 hundred thousands or millions of disk, and their findings are eye
  82 opening.  The short story is simply do not implicitly trust RAID or
  83 redundant storage systems.  Details matter.  And unfortunately there
  84 are few options on Linux addressing all the identified issues.  Both
  85 ZFS and Btrfs are doing a fairly good job, but have legal and
  86 practical issues on their own.  I wonder how cluster file systems like
  87 Ceph do in this regard.  After all, there is an old saying, you know
  88 you have a distributed system when the crash of a computer you have
  89 never heard of stops you from getting any work done.  The same holds
  90 true if fault tolerance do not work.</p>
  91
  92 <p>Just remember, in the end, it do not matter how redundant, or how
  93 fault tolerant your storage is, if you do not continuously monitor its
  94 status to detect and replace failed disks.</p>
  95
  96 <p>As usual, if you use Bitcoin and want to show your support of my
  97 activities, please send Bitcoin donations to my address
  98 <b><a href="bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b</a></b>.</p>
  99 </div>
 100
 101       <div class="tags">Tags: <a href="https://people.skolelinux.org/pere/blog/tags/english">english</a>, <a href="https://people.skolelinux.org/pere/blog/tags/raid">raid</a>, <a href="https://people.skolelinux.org/pere/blog/tags/sysadmin">sysadmin</a>.</div>
 102
 103
 104     </div>
 105
 106
 107
 108
 109     <div id="sidebar">
 110
 111
 112
 113 <h2>Archive</h2>
 114 <ul>
 115
 116 <li>2023
 117 <ul>
 118
 119 <li><a href="https://people.skolelinux.org/pere/blog/archive/2023/01/">January (3)</a></li>
 120
 121 <li><a href="https://people.skolelinux.org/pere/blog/archive/2023/02/">February (1)</a></li>
 122
 123 <li><a href="https://people.skolelinux.org/pere/blog/archive/2023/04/">April (2)</a></li>
 124
 125 <li><a href="https://people.skolelinux.org/pere/blog/archive/2023/05/">May (3)</a></li>
 126
 127 <li><a href="https://people.skolelinux.org/pere/blog/archive/2023/06/">June (1)</a></li>
 128
 129 <li><a href="https://people.skolelinux.org/pere/blog/archive/2023/08/">August (1)</a></li>
 130
 131 <li><a href="https://people.skolelinux.org/pere/blog/archive/2023/09/">September (1)</a></li>
 132
 133 <li><a href="https://people.skolelinux.org/pere/blog/archive/2023/10/">October (1)</a></li>
 134
 135 <li><a href="https://people.skolelinux.org/pere/blog/archive/2023/11/">November (4)</a></li>
 136
 137 <li><a href="https://people.skolelinux.org/pere/blog/archive/2023/12/">December (1)</a></li>
 138
 139 </ul></li>
 140
 141 <li>2022
 142 <ul>
 143
 144 <li><a href="https://people.skolelinux.org/pere/blog/archive/2022/02/">February (1)</a></li>
 145
 146 <li><a href="https://people.skolelinux.org/pere/blog/archive/2022/03/">March (3)</a></li>
 147
 148 <li><a href="https://people.skolelinux.org/pere/blog/archive/2022/04/">April (2)</a></li>
 149
 150 <li><a href="https://people.skolelinux.org/pere/blog/archive/2022/06/">June (2)</a></li>
 151
 152 <li><a href="https://people.skolelinux.org/pere/blog/archive/2022/07/">July (1)</a></li>
 153
 154 <li><a href="https://people.skolelinux.org/pere/blog/archive/2022/09/">September (1)</a></li>
 155
 156 <li><a href="https://people.skolelinux.org/pere/blog/archive/2022/10/">October (1)</a></li>
 157
 158 <li><a href="https://people.skolelinux.org/pere/blog/archive/2022/12/">December (1)</a></li>
 159
 160 </ul></li>
 161
 162 <li>2021
 163 <ul>
 164
 165 <li><a href="https://people.skolelinux.org/pere/blog/archive/2021/01/">January (2)</a></li>
 166
 167 <li><a href="https://people.skolelinux.org/pere/blog/archive/2021/02/">February (1)</a></li>
 168
 169 <li><a href="https://people.skolelinux.org/pere/blog/archive/2021/05/">May (1)</a></li>
 170
 171 <li><a href="https://people.skolelinux.org/pere/blog/archive/2021/06/">June (1)</a></li>
 172
 173 <li><a href="https://people.skolelinux.org/pere/blog/archive/2021/07/">July (3)</a></li>
 174
 175 <li><a href="https://people.skolelinux.org/pere/blog/archive/2021/08/">August (1)</a></li>
 176
 177 <li><a href="https://people.skolelinux.org/pere/blog/archive/2021/09/">September (1)</a></li>
 178
 179 <li><a href="https://people.skolelinux.org/pere/blog/archive/2021/10/">October (1)</a></li>
 180
 181 <li><a href="https://people.skolelinux.org/pere/blog/archive/2021/12/">December (1)</a></li>
 182
 183 </ul></li>
 184
 185 <li>2020
 186 <ul>
 187
 188 <li><a href="https://people.skolelinux.org/pere/blog/archive/2020/02/">February (2)</a></li>
 189
 190 <li><a href="https://people.skolelinux.org/pere/blog/archive/2020/03/">March (2)</a></li>
 191
 192 <li><a href="https://people.skolelinux.org/pere/blog/archive/2020/04/">April (2)</a></li>
 193
 194 <li><a href="https://people.skolelinux.org/pere/blog/archive/2020/05/">May (3)</a></li>
 195
 196 <li><a href="https://people.skolelinux.org/pere/blog/archive/2020/06/">June (2)</a></li>
 197
 198 <li><a href="https://people.skolelinux.org/pere/blog/archive/2020/07/">July (1)</a></li>
 199
 200 <li><a href="https://people.skolelinux.org/pere/blog/archive/2020/09/">September (1)</a></li>
 201
 202 <li><a href="https://people.skolelinux.org/pere/blog/archive/2020/10/">October (1)</a></li>
 203
 204 <li><a href="https://people.skolelinux.org/pere/blog/archive/2020/11/">November (1)</a></li>
 205
 206 </ul></li>
 207
 208 <li>2019
 209 <ul>
 210
 211 <li><a href="https://people.skolelinux.org/pere/blog/archive/2019/01/">January (4)</a></li>
 212
 213 <li><a href="https://people.skolelinux.org/pere/blog/archive/2019/02/">February (3)</a></li>
 214
 215 <li><a href="https://people.skolelinux.org/pere/blog/archive/2019/03/">March (3)</a></li>
 216
 217 <li><a href="https://people.skolelinux.org/pere/blog/archive/2019/05/">May (2)</a></li>
 218
 219 <li><a href="https://people.skolelinux.org/pere/blog/archive/2019/06/">June (5)</a></li>
 220
 221 <li><a href="https://people.skolelinux.org/pere/blog/archive/2019/07/">July (2)</a></li>
 222
 223 <li><a href="https://people.skolelinux.org/pere/blog/archive/2019/08/">August (1)</a></li>
 224
 225 <li><a href="https://people.skolelinux.org/pere/blog/archive/2019/09/">September (1)</a></li>
 226
 227 <li><a href="https://people.skolelinux.org/pere/blog/archive/2019/11/">November (1)</a></li>
 228
 229 <li><a href="https://people.skolelinux.org/pere/blog/archive/2019/12/">December (4)</a></li>
 230
 231 </ul></li>
 232
 233 <li>2018
 234 <ul>
 235
 236 <li><a href="https://people.skolelinux.org/pere/blog/archive/2018/01/">January (1)</a></li>
 237
 238 <li><a href="https://people.skolelinux.org/pere/blog/archive/2018/02/">February (5)</a></li>
 239
 240 <li><a href="https://people.skolelinux.org/pere/blog/archive/2018/03/">March (5)</a></li>
 241
 242 <li><a href="https://people.skolelinux.org/pere/blog/archive/2018/04/">April (3)</a></li>
 243
 244 <li><a href="https://people.skolelinux.org/pere/blog/archive/2018/06/">June (2)</a></li>
 245
 246 <li><a href="https://people.skolelinux.org/pere/blog/archive/2018/07/">July (5)</a></li>
 247
 248 <li><a href="https://people.skolelinux.org/pere/blog/archive/2018/08/">August (3)</a></li>
 249
 250 <li><a href="https://people.skolelinux.org/pere/blog/archive/2018/09/">September (3)</a></li>
 251
 252 <li><a href="https://people.skolelinux.org/pere/blog/archive/2018/10/">October (5)</a></li>
 253
 254 <li><a href="https://people.skolelinux.org/pere/blog/archive/2018/11/">November (2)</a></li>
 255
 256 <li><a href="https://people.skolelinux.org/pere/blog/archive/2018/12/">December (4)</a></li>
 257
 258 </ul></li>
 259
 260 <li>2017
 261 <ul>
 262
 263 <li><a href="https://people.skolelinux.org/pere/blog/archive/2017/01/">January (4)</a></li>
 264
 265 <li><a href="https://people.skolelinux.org/pere/blog/archive/2017/02/">February (3)</a></li>
 266
 267 <li><a href="https://people.skolelinux.org/pere/blog/archive/2017/03/">March (5)</a></li>
 268
 269 <li><a href="https://people.skolelinux.org/pere/blog/archive/2017/04/">April (2)</a></li>
 270
 271 <li><a href="https://people.skolelinux.org/pere/blog/archive/2017/06/">June (5)</a></li>
 272
 273 <li><a href="https://people.skolelinux.org/pere/blog/archive/2017/07/">July (1)</a></li>
 274
 275 <li><a href="https://people.skolelinux.org/pere/blog/archive/2017/08/">August (1)</a></li>
 276
 277 <li><a href="https://people.skolelinux.org/pere/blog/archive/2017/09/">September (3)</a></li>
 278
 279 <li><a href="https://people.skolelinux.org/pere/blog/archive/2017/10/">October (5)</a></li>
 280
 281 <li><a href="https://people.skolelinux.org/pere/blog/archive/2017/11/">November (3)</a></li>
 282
 283 <li><a href="https://people.skolelinux.org/pere/blog/archive/2017/12/">December (4)</a></li>
 284
 285 </ul></li>
 286
 287 <li>2016
 288 <ul>
 289
 290 <li><a href="https://people.skolelinux.org/pere/blog/archive/2016/01/">January (3)</a></li>
 291
 292 <li><a href="https://people.skolelinux.org/pere/blog/archive/2016/02/">February (2)</a></li>
 293
 294 <li><a href="https://people.skolelinux.org/pere/blog/archive/2016/03/">March (3)</a></li>
 295
 296 <li><a href="https://people.skolelinux.org/pere/blog/archive/2016/04/">April (8)</a></li>
 297
 298 <li><a href="https://people.skolelinux.org/pere/blog/archive/2016/05/">May (8)</a></li>
 299
 300 <li><a href="https://people.skolelinux.org/pere/blog/archive/2016/06/">June (2)</a></li>
 301
 302 <li><a href="https://people.skolelinux.org/pere/blog/archive/2016/07/">July (2)</a></li>
 303
 304 <li><a href="https://people.skolelinux.org/pere/blog/archive/2016/08/">August (5)</a></li>
 305
 306 <li><a href="https://people.skolelinux.org/pere/blog/archive/2016/09/">September (2)</a></li>
 307
 308 <li><a href="https://people.skolelinux.org/pere/blog/archive/2016/10/">October (3)</a></li>
 309
 310 <li><a href="https://people.skolelinux.org/pere/blog/archive/2016/11/">November (8)</a></li>
 311
 312 <li><a href="https://people.skolelinux.org/pere/blog/archive/2016/12/">December (5)</a></li>
 313
 314 </ul></li>
 315
 316 <li>2015
 317 <ul>
 318
 319 <li><a href="https://people.skolelinux.org/pere/blog/archive/2015/01/">January (7)</a></li>
 320
 321 <li><a href="https://people.skolelinux.org/pere/blog/archive/2015/02/">February (6)</a></li>
 322
 323 <li><a href="https://people.skolelinux.org/pere/blog/archive/2015/03/">March (1)</a></li>
 324
 325 <li><a href="https://people.skolelinux.org/pere/blog/archive/2015/04/">April (4)</a></li>
 326
 327 <li><a href="https://people.skolelinux.org/pere/blog/archive/2015/05/">May (3)</a></li>
 328
 329 <li><a href="https://people.skolelinux.org/pere/blog/archive/2015/06/">June (4)</a></li>
 330
 331 <li><a href="https://people.skolelinux.org/pere/blog/archive/2015/07/">July (6)</a></li>
 332
 333 <li><a href="https://people.skolelinux.org/pere/blog/archive/2015/08/">August (2)</a></li>
 334
 335 <li><a href="https://people.skolelinux.org/pere/blog/archive/2015/09/">September (2)</a></li>
 336
 337 <li><a href="https://people.skolelinux.org/pere/blog/archive/2015/10/">October (9)</a></li>
 338
 339 <li><a href="https://people.skolelinux.org/pere/blog/archive/2015/11/">November (6)</a></li>
 340
 341 <li><a href="https://people.skolelinux.org/pere/blog/archive/2015/12/">December (3)</a></li>
 342
 343 </ul></li>
 344
 345 <li>2014
 346 <ul>
 347
 348 <li><a href="https://people.skolelinux.org/pere/blog/archive/2014/01/">January (2)</a></li>
 349
 350 <li><a href="https://people.skolelinux.org/pere/blog/archive/2014/02/">February (3)</a></li>
 351
 352 <li><a href="https://people.skolelinux.org/pere/blog/archive/2014/03/">March (8)</a></li>
 353
 354 <li><a href="https://people.skolelinux.org/pere/blog/archive/2014/04/">April (7)</a></li>
 355
 356 <li><a href="https://people.skolelinux.org/pere/blog/archive/2014/05/">May (1)</a></li>
 357
 358 <li><a href="https://people.skolelinux.org/pere/blog/archive/2014/06/">June (2)</a></li>
 359
 360 <li><a href="https://people.skolelinux.org/pere/blog/archive/2014/07/">July (2)</a></li>
 361
 362 <li><a href="https://people.skolelinux.org/pere/blog/archive/2014/08/">August (2)</a></li>
 363
 364 <li><a href="https://people.skolelinux.org/pere/blog/archive/2014/09/">September (5)</a></li>
 365
 366 <li><a href="https://people.skolelinux.org/pere/blog/archive/2014/10/">October (6)</a></li>
 367
 368 <li><a href="https://people.skolelinux.org/pere/blog/archive/2014/11/">November (3)</a></li>
 369
 370 <li><a href="https://people.skolelinux.org/pere/blog/archive/2014/12/">December (5)</a></li>
 371
 372 </ul></li>
 373
 374 <li>2013
 375 <ul>
 376
 377 <li><a href="https://people.skolelinux.org/pere/blog/archive/2013/01/">January (11)</a></li>
 378
 379 <li><a href="https://people.skolelinux.org/pere/blog/archive/2013/02/">February (9)</a></li>
 380
 381 <li><a href="https://people.skolelinux.org/pere/blog/archive/2013/03/">March (9)</a></li>
 382
 383 <li><a href="https://people.skolelinux.org/pere/blog/archive/2013/04/">April (6)</a></li>
 384
 385 <li><a href="https://people.skolelinux.org/pere/blog/archive/2013/05/">May (9)</a></li>
 386
 387 <li><a href="https://people.skolelinux.org/pere/blog/archive/2013/06/">June (10)</a></li>
 388
 389 <li><a href="https://people.skolelinux.org/pere/blog/archive/2013/07/">July (7)</a></li>
 390
 391 <li><a href="https://people.skolelinux.org/pere/blog/archive/2013/08/">August (3)</a></li>
 392
 393 <li><a href="https://people.skolelinux.org/pere/blog/archive/2013/09/">September (5)</a></li>
 394
 395 <li><a href="https://people.skolelinux.org/pere/blog/archive/2013/10/">October (7)</a></li>
 396
 397 <li><a href="https://people.skolelinux.org/pere/blog/archive/2013/11/">November (9)</a></li>
 398
 399 <li><a href="https://people.skolelinux.org/pere/blog/archive/2013/12/">December (3)</a></li>
 400
 401 </ul></li>
 402
 403 <li>2012
 404 <ul>
 405
 406 <li><a href="https://people.skolelinux.org/pere/blog/archive/2012/01/">January (7)</a></li>
 407
 408 <li><a href="https://people.skolelinux.org/pere/blog/archive/2012/02/">February (10)</a></li>
 409
 410 <li><a href="https://people.skolelinux.org/pere/blog/archive/2012/03/">March (17)</a></li>
 411
 412 <li><a href="https://people.skolelinux.org/pere/blog/archive/2012/04/">April (12)</a></li>
 413
 414 <li><a href="https://people.skolelinux.org/pere/blog/archive/2012/05/">May (12)</a></li>
 415
 416 <li><a href="https://people.skolelinux.org/pere/blog/archive/2012/06/">June (20)</a></li>
 417
 418 <li><a href="https://people.skolelinux.org/pere/blog/archive/2012/07/">July (17)</a></li>
 419
 420 <li><a href="https://people.skolelinux.org/pere/blog/archive/2012/08/">August (6)</a></li>
 421
 422 <li><a href="https://people.skolelinux.org/pere/blog/archive/2012/09/">September (9)</a></li>
 423
 424 <li><a href="https://people.skolelinux.org/pere/blog/archive/2012/10/">October (17)</a></li>
 425
 426 <li><a href="https://people.skolelinux.org/pere/blog/archive/2012/11/">November (10)</a></li>
 427
 428 <li><a href="https://people.skolelinux.org/pere/blog/archive/2012/12/">December (7)</a></li>
 429
 430 </ul></li>
 431
 432 <li>2011
 433 <ul>
 434
 435 <li><a href="https://people.skolelinux.org/pere/blog/archive/2011/01/">January (16)</a></li>
 436
 437 <li><a href="https://people.skolelinux.org/pere/blog/archive/2011/02/">February (6)</a></li>
 438
 439 <li><a href="https://people.skolelinux.org/pere/blog/archive/2011/03/">March (6)</a></li>
 440
 441 <li><a href="https://people.skolelinux.org/pere/blog/archive/2011/04/">April (7)</a></li>
 442
 443 <li><a href="https://people.skolelinux.org/pere/blog/archive/2011/05/">May (3)</a></li>
 444
 445 <li><a href="https://people.skolelinux.org/pere/blog/archive/2011/06/">June (2)</a></li>
 446
 447 <li><a href="https://people.skolelinux.org/pere/blog/archive/2011/07/">July (7)</a></li>
 448
 449 <li><a href="https://people.skolelinux.org/pere/blog/archive/2011/08/">August (6)</a></li>
 450
 451 <li><a href="https://people.skolelinux.org/pere/blog/archive/2011/09/">September (4)</a></li>
 452
 453 <li><a href="https://people.skolelinux.org/pere/blog/archive/2011/10/">October (2)</a></li>
 454
 455 <li><a href="https://people.skolelinux.org/pere/blog/archive/2011/11/">November (3)</a></li>
 456
 457 <li><a href="https://people.skolelinux.org/pere/blog/archive/2011/12/">December (1)</a></li>
 458
 459 </ul></li>
 460
 461 <li>2010
 462 <ul>
 463
 464 <li><a href="https://people.skolelinux.org/pere/blog/archive/2010/01/">January (2)</a></li>
 465
 466 <li><a href="https://people.skolelinux.org/pere/blog/archive/2010/02/">February (1)</a></li>
 467
 468 <li><a href="https://people.skolelinux.org/pere/blog/archive/2010/03/">March (3)</a></li>
 469
 470 <li><a href="https://people.skolelinux.org/pere/blog/archive/2010/04/">April (3)</a></li>
 471
 472 <li><a href="https://people.skolelinux.org/pere/blog/archive/2010/05/">May (9)</a></li>
 473
 474 <li><a href="https://people.skolelinux.org/pere/blog/archive/2010/06/">June (14)</a></li>
 475
 476 <li><a href="https://people.skolelinux.org/pere/blog/archive/2010/07/">July (12)</a></li>
 477
 478 <li><a href="https://people.skolelinux.org/pere/blog/archive/2010/08/">August (13)</a></li>
 479
 480 <li><a href="https://people.skolelinux.org/pere/blog/archive/2010/09/">September (7)</a></li>
 481
 482 <li><a href="https://people.skolelinux.org/pere/blog/archive/2010/10/">October (9)</a></li>
 483
 484 <li><a href="https://people.skolelinux.org/pere/blog/archive/2010/11/">November (13)</a></li>
 485
 486 <li><a href="https://people.skolelinux.org/pere/blog/archive/2010/12/">December (12)</a></li>
 487
 488 </ul></li>
 489
 490 <li>2009
 491 <ul>
 492
 493 <li><a href="https://people.skolelinux.org/pere/blog/archive/2009/01/">January (8)</a></li>
 494
 495 <li><a href="https://people.skolelinux.org/pere/blog/archive/2009/02/">February (8)</a></li>
 496
 497 <li><a href="https://people.skolelinux.org/pere/blog/archive/2009/03/">March (12)</a></li>
 498
 499 <li><a href="https://people.skolelinux.org/pere/blog/archive/2009/04/">April (10)</a></li>
 500
 501 <li><a href="https://people.skolelinux.org/pere/blog/archive/2009/05/">May (9)</a></li>
 502
 503 <li><a href="https://people.skolelinux.org/pere/blog/archive/2009/06/">June (3)</a></li>
 504
 505 <li><a href="https://people.skolelinux.org/pere/blog/archive/2009/07/">July (4)</a></li>
 506
 507 <li><a href="https://people.skolelinux.org/pere/blog/archive/2009/08/">August (3)</a></li>
 508
 509 <li><a href="https://people.skolelinux.org/pere/blog/archive/2009/09/">September (1)</a></li>
 510
 511 <li><a href="https://people.skolelinux.org/pere/blog/archive/2009/10/">October (2)</a></li>
 512
 513 <li><a href="https://people.skolelinux.org/pere/blog/archive/2009/11/">November (3)</a></li>
 514
 515 <li><a href="https://people.skolelinux.org/pere/blog/archive/2009/12/">December (3)</a></li>
 516
 517 </ul></li>
 518
 519 <li>2008
 520 <ul>
 521
 522 <li><a href="https://people.skolelinux.org/pere/blog/archive/2008/11/">November (5)</a></li>
 523
 524 <li><a href="https://people.skolelinux.org/pere/blog/archive/2008/12/">December (7)</a></li>
 525
 526 </ul></li>
 527
 528 </ul>
 529
 530
 531
 532 <h2>Tags</h2>
 533 <ul>
 534
 535  <li><a href="https://people.skolelinux.org/pere/blog/tags/3d-printer">3d-printer (19)</a></li>
 536
 537  <li><a href="https://people.skolelinux.org/pere/blog/tags/amiga">amiga (1)</a></li>
 538
 539  <li><a href="https://people.skolelinux.org/pere/blog/tags/aros">aros (1)</a></li>
 540
 541  <li><a href="https://people.skolelinux.org/pere/blog/tags/bankid">bankid (4)</a></li>
 542
 543  <li><a href="https://people.skolelinux.org/pere/blog/tags/betalkontant">betalkontant (9)</a></li>
 544
 545  <li><a href="https://people.skolelinux.org/pere/blog/tags/bitcoin">bitcoin (12)</a></li>
 546
 547  <li><a href="https://people.skolelinux.org/pere/blog/tags/bootsystem">bootsystem (17)</a></li>
 548
 549  <li><a href="https://people.skolelinux.org/pere/blog/tags/bsa">bsa (2)</a></li>
 550
 551  <li><a href="https://people.skolelinux.org/pere/blog/tags/chrpath">chrpath (3)</a></li>
 552
 553  <li><a href="https://people.skolelinux.org/pere/blog/tags/debian">debian (197)</a></li>
 554
 555  <li><a href="https://people.skolelinux.org/pere/blog/tags/debian edu">debian edu (159)</a></li>
 556
 557  <li><a href="https://people.skolelinux.org/pere/blog/tags/debian-handbook">debian-handbook (9)</a></li>
 558
 559  <li><a href="https://people.skolelinux.org/pere/blog/tags/digistan">digistan (11)</a></li>
 560
 561  <li><a href="https://people.skolelinux.org/pere/blog/tags/dld">dld (18)</a></li>
 562
 563  <li><a href="https://people.skolelinux.org/pere/blog/tags/docbook">docbook (32)</a></li>
 564
 565  <li><a href="https://people.skolelinux.org/pere/blog/tags/drivstoffpriser">drivstoffpriser (4)</a></li>
 566
 567  <li><a href="https://people.skolelinux.org/pere/blog/tags/english">english (455)</a></li>
 568
 569  <li><a href="https://people.skolelinux.org/pere/blog/tags/fiksgatami">fiksgatami (23)</a></li>
 570
 571  <li><a href="https://people.skolelinux.org/pere/blog/tags/fildeling">fildeling (14)</a></li>
 572
 573  <li><a href="https://people.skolelinux.org/pere/blog/tags/freeculture">freeculture (34)</a></li>
 574
 575  <li><a href="https://people.skolelinux.org/pere/blog/tags/freedombox">freedombox (9)</a></li>
 576
 577  <li><a href="https://people.skolelinux.org/pere/blog/tags/frikanalen">frikanalen (20)</a></li>
 578
 579  <li><a href="https://people.skolelinux.org/pere/blog/tags/h264">h264 (20)</a></li>
 580
 581  <li><a href="https://people.skolelinux.org/pere/blog/tags/intervju">intervju (43)</a></li>
 582
 583  <li><a href="https://people.skolelinux.org/pere/blog/tags/isenkram">isenkram (16)</a></li>
 584
 585  <li><a href="https://people.skolelinux.org/pere/blog/tags/kart">kart (23)</a></li>
 586
 587  <li><a href="https://people.skolelinux.org/pere/blog/tags/kodi">kodi (6)</a></li>
 588
 589  <li><a href="https://people.skolelinux.org/pere/blog/tags/ldap">ldap (9)</a></li>
 590
 591  <li><a href="https://people.skolelinux.org/pere/blog/tags/lego">lego (5)</a></li>
 592
 593  <li><a href="https://people.skolelinux.org/pere/blog/tags/lenker">lenker (8)</a></li>
 594
 595  <li><a href="https://people.skolelinux.org/pere/blog/tags/linuxcnc">linuxcnc (5)</a></li>
 596
 597  <li><a href="https://people.skolelinux.org/pere/blog/tags/lsdvd">lsdvd (2)</a></li>
 598
 599  <li><a href="https://people.skolelinux.org/pere/blog/tags/ltsp">ltsp (1)</a></li>
 600
 601  <li><a href="https://people.skolelinux.org/pere/blog/tags/madewithcc">madewithcc (3)</a></li>
 602
 603  <li><a href="https://people.skolelinux.org/pere/blog/tags/mesh network">mesh network (8)</a></li>
 604
 605  <li><a href="https://people.skolelinux.org/pere/blog/tags/multimedia">multimedia (46)</a></li>
 606
 607  <li><a href="https://people.skolelinux.org/pere/blog/tags/nice free software">nice free software (15)</a></li>
 608
 609  <li><a href="https://people.skolelinux.org/pere/blog/tags/noark5">noark5 (24)</a></li>
 610
 611  <li><a href="https://people.skolelinux.org/pere/blog/tags/norsk">norsk (323)</a></li>
 612
 613  <li><a href="https://people.skolelinux.org/pere/blog/tags/nuug">nuug (198)</a></li>
 614
 615  <li><a href="https://people.skolelinux.org/pere/blog/tags/offentlig innsyn">offentlig innsyn (40)</a></li>
 616
 617  <li><a href="https://people.skolelinux.org/pere/blog/tags/open311">open311 (2)</a></li>
 618
 619  <li><a href="https://people.skolelinux.org/pere/blog/tags/opensnitch">opensnitch (4)</a></li>
 620
 621  <li><a href="https://people.skolelinux.org/pere/blog/tags/opphavsrett">opphavsrett (75)</a></li>
 622
 623  <li><a href="https://people.skolelinux.org/pere/blog/tags/personvern">personvern (114)</a></li>
 624
 625  <li><a href="https://people.skolelinux.org/pere/blog/tags/raid">raid (2)</a></li>
 626
 627  <li><a href="https://people.skolelinux.org/pere/blog/tags/reactos">reactos (1)</a></li>
 628
 629  <li><a href="https://people.skolelinux.org/pere/blog/tags/reprap">reprap (11)</a></li>
 630
 631  <li><a href="https://people.skolelinux.org/pere/blog/tags/rfid">rfid (3)</a></li>
 632
 633  <li><a href="https://people.skolelinux.org/pere/blog/tags/robot">robot (17)</a></li>
 634
 635  <li><a href="https://people.skolelinux.org/pere/blog/tags/rss">rss (1)</a></li>
 636
 637  <li><a href="https://people.skolelinux.org/pere/blog/tags/ruter">ruter (7)</a></li>
 638
 639  <li><a href="https://people.skolelinux.org/pere/blog/tags/scraperwiki">scraperwiki (2)</a></li>
 640
 641  <li><a href="https://people.skolelinux.org/pere/blog/tags/sikkerhet">sikkerhet (60)</a></li>
 642
 643  <li><a href="https://people.skolelinux.org/pere/blog/tags/sitesummary">sitesummary (4)</a></li>
 644
 645  <li><a href="https://people.skolelinux.org/pere/blog/tags/skepsis">skepsis (5)</a></li>
 646
 647  <li><a href="https://people.skolelinux.org/pere/blog/tags/standard">standard (75)</a></li>
 648
 649  <li><a href="https://people.skolelinux.org/pere/blog/tags/stavekontroll">stavekontroll (7)</a></li>
 650
 651  <li><a href="https://people.skolelinux.org/pere/blog/tags/stortinget">stortinget (14)</a></li>
 652
 653  <li><a href="https://people.skolelinux.org/pere/blog/tags/surveillance">surveillance (65)</a></li>
 654
 655  <li><a href="https://people.skolelinux.org/pere/blog/tags/sysadmin">sysadmin (5)</a></li>
 656
 657  <li><a href="https://people.skolelinux.org/pere/blog/tags/usenix">usenix (2)</a></li>
 658
 659  <li><a href="https://people.skolelinux.org/pere/blog/tags/valg">valg (9)</a></li>
 660
 661  <li><a href="https://people.skolelinux.org/pere/blog/tags/verkidetfri">verkidetfri (21)</a></li>
 662
 663  <li><a href="https://people.skolelinux.org/pere/blog/tags/video">video (80)</a></li>
 664
 665  <li><a href="https://people.skolelinux.org/pere/blog/tags/vitenskap">vitenskap (4)</a></li>
 666
 667  <li><a href="https://people.skolelinux.org/pere/blog/tags/web">web (42)</a></li>
 668
 669 </ul>
 670
 671
 672     </div>
 673     <p style="text-align: right">
 674  Created by <a href="http://steve.org.uk/Software/chronicle">Chronicle v4.6</a>
 675 </p>
 676
 677   </body>
 678 </html>