X-Git-Url: http://pere.pagekite.me/gitweb/homepage.git/blobdiff_plain/fa4e14fe2faecdba7833edabf9f9fe20fb3be1c7..53798080ccfe7c0d9ad356a83ded5b219b186c9b:/blog/index.rss diff --git a/blog/index.rss b/blog/index.rss index 4fcf4416e6..0a657f587a 100644 --- a/blog/index.rss +++ b/blog/index.rss @@ -7,1135 +7,664 @@ - Hva henger under skibrua over E16 på Sollihøgda? - http://people.skolelinux.org/pere/blog/Hva_henger_under_skibrua_over_E16_p__Sollih_gda_.html - http://people.skolelinux.org/pere/blog/Hva_henger_under_skibrua_over_E16_p__Sollih_gda_.html - Sun, 21 Sep 2014 09:50:00 +0200 - <p>Rundt omkring i Oslo og Østlandsområdet henger det bokser over -veiene som jeg har lurt på hva gjør. De har ut fra plassering og -vinkling sett ut som bokser som sniffer ut et eller annet fra -forbipasserende trafikk, men det har vært uklart for meg hva det er de -leser av. Her om dagen tok jeg bilde av en slik boks som henger under -<a href="http://www.openstreetmap.no/?zoom=19&mlat=59.96396&mlon=10.34443&layers=B00000">ei -skibru på Sollihøgda</a>:</p> + Detecting NFS hangs on Linux without hanging yourself... + http://people.skolelinux.org/pere/blog/Detecting_NFS_hangs_on_Linux_without_hanging_yourself___.html + http://people.skolelinux.org/pere/blog/Detecting_NFS_hangs_on_Linux_without_hanging_yourself___.html + Thu, 9 Mar 2017 15:20:00 +0100 + <p>Over the years, administrating thousand of NFS mounting linux +computers at the time, I often needed a way to detect if the machine +was experiencing NFS hang. If you try to use <tt>df</tt> or look at a +file or directory affected by the hang, the process (and possibly the +shell) will hang too. So you want to be able to detect this without +risking the detection process getting stuck too. It has not been +obvious how to do this. When the hang has lasted a while, it is +possible to find messages like these in dmesg:</p> -<p align="center"><img width="60%" src="http://people.skolelinux.org/pere/blog/images/2014-09-13-kapsch-sollihogda-crop.jpeg"></p> - -<p>Boksen er tydelig merket «Kapsch >>>», logoen til -<a href="http://www.kapsch.net/">det sveitsiske selskapet Kapsch</a> som -blant annet lager sensorsystemer for veitrafikk. Men de lager mye -forskjellig, og jeg kjente ikke igjen boksen på utseendet etter en -kjapp titt på produktlista til selskapet.</p> - -<p>I og med at boksen henger over veien E16, en riksvei vedlikeholdt -av Statens Vegvesen, så antok jeg at det burde være mulig å bruke -REST-API-et som gir tilgang til vegvesenets database over veier, -skilter og annet veirelatert til å finne ut hva i alle dager dette -kunne være. De har både -<a href="https://www.vegvesen.no/nvdb/api/dokumentasjon/datakatalog">en -datakatalog</a> og -<a href="https://www.vegvesen.no/nvdb/api/dokumentasjon/sok">et -søk</a>, der en kan søke etter ulike typer oppføringer innen for et -gitt geografisk område. Jeg laget et enkelt shell-script for å hente -ut antall av en gitt type innenfor området skibrua dekker, og listet -opp navnet på typene som ble funnet. Orket ikke slå opp hvordan -URL-koding av aktuelle strenger kunne gjøres mer generisk, og brukte -en stygg sed-linje i stedet.</p> - -<blockquote><pre> -#!/bin/sh -urlmap() { - sed \ - -e 's/ / /g' -e 's/{/%7B/g' \ - -e 's/}/%7D/g' -e 's/\[/%5B/g' \ - -e 's/\]/%5D/g' -e 's/ /%20/g' \ - -e 's/,/%2C/g' -e 's/\"/%22/g' \ - -e 's/:/%3A/g' -} - -lookup() { - url="$1" - curl -s -H 'Accept: application/vnd.vegvesen.nvdb-v1+xml' \ - "https://www.vegvesen.no/nvdb/api$url" | xmllint --format - -} - -for id in $(seq 1 874) ; do - search="{ - lokasjon: { - bbox: \"10.34425,59.96386,10.34458,59.96409\", - srid: \"WGS84\" - }, - objektTyper: [{ - id: $id, antall: 10 - }] -}" - - query=/sok?kriterie=$(echo $search | urlmap) - if lookup "$query" | - grep -q '&lt;totaltAntallReturnert>0&lt;' - then - : - else - echo $id - lookup "/datakatalog/objekttyper/$id" |grep '^ &lt;navn>' - fi -done - -exit 0 -</pre></blockquote> - -Aktuelt ID-område 1-874 var riktig i datakatalogen da jeg laget -scriptet. Det vil endre seg over tid. Skriptet listet så opp -aktuelle typer i og rundt skibrua: - -<blockquote><pre> -5 - &lt;navn>Rekkverk&lt;/navn> -14 - &lt;navn>Rekkverksende&lt;/navn> -47 - &lt;navn>Trafikklomme&lt;/navn> -49 - &lt;navn>Trafikkøy&lt;/navn> -60 - &lt;navn>Bru&lt;/navn> -79 - &lt;navn>Stikkrenne/Kulvert&lt;/navn> -80 - &lt;navn>Grøft, åpen&lt;/navn> -86 - &lt;navn>Belysningsstrekning&lt;/navn> -95 - &lt;navn>Skiltpunkt&lt;/navn> -96 - &lt;navn>Skiltplate&lt;/navn> -98 - &lt;navn>Referansestolpe&lt;/navn> -99 - &lt;navn>Vegoppmerking, langsgående&lt;/navn> -105 - &lt;navn>Fartsgrense&lt;/navn> -106 - &lt;navn>Vinterdriftsstrategi&lt;/navn> -172 - &lt;navn>Trafikkdeler&lt;/navn> -241 - &lt;navn>Vegdekke&lt;/navn> -293 - &lt;navn>Breddemåling&lt;/navn> -301 - &lt;navn>Kantklippareal&lt;/navn> -318 - &lt;navn>Snø-/isrydding&lt;/navn> -445 - &lt;navn>Skred&lt;/navn> -446 - &lt;navn>Dokumentasjon&lt;/navn> -452 - &lt;navn>Undergang&lt;/navn> -528 - &lt;navn>Tverrprofil&lt;/navn> -532 - &lt;navn>Vegreferanse&lt;/navn> -534 - &lt;navn>Region&lt;/navn> -535 - &lt;navn>Fylke&lt;/navn> -536 - &lt;navn>Kommune&lt;/navn> -538 - &lt;navn>Gate&lt;/navn> -539 - &lt;navn>Transportlenke&lt;/navn> -540 - &lt;navn>Trafikkmengde&lt;/navn> -570 - &lt;navn>Trafikkulykke&lt;/navn> -571 - &lt;navn>Ulykkesinvolvert enhet&lt;/navn> -572 - &lt;navn>Ulykkesinvolvert person&lt;/navn> -579 - &lt;navn>Politidistrikt&lt;/navn> -583 - &lt;navn>Vegbredde&lt;/navn> -591 - &lt;navn>Høydebegrensning&lt;/navn> -592 - &lt;navn>Nedbøyningsmåling&lt;/navn> -597 - &lt;navn>Støy-luft, Strekningsdata&lt;/navn> -601 - &lt;navn>Oppgravingsdata&lt;/navn> -602 - &lt;navn>Oppgravingslag&lt;/navn> -603 - &lt;navn>PMS-parsell&lt;/navn> -604 - &lt;navn>Vegnormalstrekning&lt;/navn> -605 - &lt;navn>Værrelatert strekning&lt;/navn> -616 - &lt;navn>Feltstrekning&lt;/navn> -617 - &lt;navn>Adressepunkt&lt;/navn> -626 - &lt;navn>Friksjonsmåleserie&lt;/navn> -629 - &lt;navn>Vegdekke, flatelapping&lt;/navn> -639 - &lt;navn>Kurvatur, horisontalelement&lt;/navn> -640 - &lt;navn>Kurvatur, vertikalelement&lt;/navn> -642 - &lt;navn>Kurvatur, vertikalpunkt&lt;/navn> -643 - &lt;navn>Statistikk, trafikkmengde&lt;/navn> -647 - &lt;navn>Statistikk, vegbredde&lt;/navn> -774 - &lt;navn>Nedbøyningsmåleserie&lt;/navn> -775 - &lt;navn>ATK, influensstrekning&lt;/navn> -794 - &lt;navn>Systemobjekt&lt;/navn> -810 - &lt;navn>Vinterdriftsklasse&lt;/navn> -821 - &lt;navn>Funksjonell vegklasse&lt;/navn> -825 - &lt;navn>Kurvatur, stigning&lt;/navn> -838 - &lt;navn>Vegbredde, beregnet&lt;/navn> -862 - &lt;navn>Reisetidsregistreringspunkt&lt;/navn> -871 - &lt;navn>Bruksklasse&lt;/navn> -</pre></blockquote> - -<p>Av disse ser ID 775 og 862 mest relevant ut. ID 775 antar jeg -refererer til fotoboksen som står like ved brua, mens -«Reisetidsregistreringspunkt» kanskje kan være boksen som henger der. -Hvordan finner jeg så ut hva dette kan være for noe. En titt på -<a href="http://labs.vegdata.no/nvdb-datakatalog/862-Reisetidsregistreringspunkt/">datakatalogsiden -for ID 862/Reisetidsregistreringspunkt</a> viser at det er finnes 53 -slike målere i Norge, og hvor de er plassert, men gir ellers få -detaljer. Det er plassert 40 på østlandet og 13 i Trondheimsregionen. -Men siden nevner «AutoPASS», og hvis en slår opp oppføringen på -Sollihøgda nevner den «Ciber AS» som ID for eksternt system. (Kan det -være snakk om -<a href="http://www.proff.no/selskap/ciber-norge-as/oslo/internettdesign-og-programmering/Z0I3KMF4/">Ciber -Norge AS</a>, et selskap eid av Ciber Europe Bv?) Et nettsøk på - «Ciber AS autopass» fører meg til en artikkel fra NRK Trøndelag i - 2013 med tittel -«<a href="http://www.nrk.no/trondelag/sjekk-dette-hvis-du-vil-unnga-ko-1.11327947">Sjekk -dette hvis du vil unngå kø</a>». Artikkelen henviser til vegvesenets -nettside -<a href="http://www.reisetider.no/reisetid/forside.html">reisetider.no</a> -som har en -<a href="http://www.reisetider.no/reisetid/omrade.html?omrade=5">kartside -for Østlandet</a> som viser at det måles mellom Sandvika og Sollihøgda. -Det kan dermed se ut til at jeg har funnet ut hva boksene gjør.</p> - -<p>Hvis det stemmer, så er dette bokser som leser av AutoPASS-ID-en -til alle passerende biler med AutoPASS-brikke, og dermed gjør det mulig -for de som kontrollerer boksene å holde rede på hvor en gitt bil er -når den passerte et slikt målepunkt. NRK-artikkelen forteller at -denne informasjonen i dag kun brukes til å koble to -AutoPASS-brikkepasseringer passeringer sammen for å beregne -reisetiden, og at bruken er godkjent av Datatilsynet. Det er desverre -ikke mulig for en sjåfør som passerer under en slik boks å kontrollere -at AutoPASS-ID-en kun brukes til dette i dag og i fremtiden.</p> - -<p>I tillegg til denne type AutoPASS-sniffere vet jeg at det også -finnes mange automatiske stasjoner som tar betalt pr. passering (aka -bomstasjoner), og der lagres informasjon om tid, sted og bilnummer i -10 år. Finnes det andre slike sniffere plassert ut på veiene?</p> - -<p>Personlig har jeg valgt å ikke bruke AutoPASS-brikke, for å gjøre -det vanskeligere og mer kostbart for de som vil invadere privatsfæren -og holde rede på hvor bilen min beveger seg til enhver tid. Jeg håper -flere vil gjøre det samme, selv om det gir litt høyere private -utgifter (dyrere bompassering). Vern om privatsfæren koster i disse -dager.</p> - -<p>Takk til Jan Kristian Jensen i Statens Vegvesen for tips om -dokumentasjon på vegvesenets REST-API.</p> - - - - - Speeding up the Debian installer using eatmydata and dpkg-divert - http://people.skolelinux.org/pere/blog/Speeding_up_the_Debian_installer_using_eatmydata_and_dpkg_divert.html - http://people.skolelinux.org/pere/blog/Speeding_up_the_Debian_installer_using_eatmydata_and_dpkg_divert.html - Tue, 16 Sep 2014 14:00:00 +0200 - <p>The <a href="https://www.debian.org/">Debian</a> installer could be -a lot quicker. When we install more than 2000 packages in -<a href="http://www.skolelinux.org/">Skolelinux / Debian Edu</a> using -tasksel in the installer, unpacking the binary packages take forever. -A part of the slow I/O issue was discussed in -<a href="https://bugs.debian.org/613428">bug #613428</a> about too -much file system sync-ing done by dpkg, which is the package -responsible for unpacking the binary packages. Other parts (like code -executed by postinst scripts) might also sync to disk during -installation. All this sync-ing to disk do not really make sense to -me. If the machine crash half-way through, I start over, I do not try -to salvage the half installed system. So the failure sync-ing is -supposed to protect against, hardware or system crash, is not really -relevant while the installer is running.</p> - -<p>A few days ago, I thought of a way to get rid of all the file -system sync()-ing in a fairly non-intrusive way, without the need to -change the code in several packages. The idea is not new, but I have -not heard anyone propose the approach using dpkg-divert before. It -depend on the small and clever package -<a href="https://packages.qa.debian.org/eatmydata">eatmydata</a>, which -uses LD_PRELOAD to replace the system functions for syncing data to -disk with functions doing nothing, thus allowing programs to live -dangerous while speeding up disk I/O significantly. Instead of -modifying the implementation of dpkg, apt and tasksel (which are the -packages responsible for selecting, fetching and installing packages), -it occurred to me that we could just divert the programs away, replace -them with a simple shell wrapper calling -"eatmydata&nbsp;$program&nbsp;$@", to get the same effect. -Two days ago I decided to test the idea, and wrapped up a simple -implementation for the Debian Edu udeb.</p> - -<p>The effect was stunning. In my first test it reduced the running -time of the pkgsel step (installing tasks) from 64 to less than 44 -minutes (20 minutes shaved off the installation) on an old Dell -Latitude D505 machine. I am not quite sure what the optimised time -would have been, as I messed up the testing a bit, causing the debconf -priority to get low enough for two questions to pop up during -installation. As soon as I saw the questions I moved the installation -along, but do not know how long the question were holding up the -installation. I did some more measurements using Debian Edu Jessie, -and got these results. The time measured is the time stamp in -/var/log/syslog between the "pkgsel: starting tasksel" and the -"pkgsel: finishing up" lines, if you want to do the same measurement -yourself. In Debian Edu, the tasksel dialog do not show up, and the -timing thus do not depend on how quickly the user handle the tasksel -dialog.</p> - -<p><table> - -<tr> -<th>Machine/setup</th> -<th>Original tasksel</th> -<th>Optimised tasksel</th> -<th>Reduction</th> -</tr> - -<tr> -<td>Latitude D505 Main+LTSP LXDE</td> -<td>64 min (07:46-08:50)</td> -<td><44 min (11:27-12:11)</td> -<td>>20 min 18%</td> -</tr> - -<tr> -<td>Latitude D505 Roaming LXDE</td> -<td>57 min (08:48-09:45)</td> -<td>34 min (07:43-08:17)</td> -<td>23 min 40%</td> -</tr> - -<tr> -<td>Latitude D505 Minimal</td> -<td>22 min (10:37-10:59)</td> -<td>11 min (11:16-11:27)</td> -<td>11 min 50%</td> -</tr> - -<tr> -<td>Thinkpad X200 Minimal</td> -<td>6 min (08:19-08:25)</td> -<td>4 min (08:04-08:08)</td> -<td>2 min 33%</td> -</tr> - -<tr> -<td>Thinkpad X200 Roaming KDE</td> -<td>19 min (09:21-09:40)</td> -<td>15 min (10:25-10:40)</td> -<td>4 min 21%</td> -</tr> - -</table></p> - -<p>The test is done using a netinst ISO on a USB stick, so some of the -time is spent downloading packages. The connection to the Internet -was 100Mbit/s during testing, so downloading should not be a -significant factor in the measurement. Download typically took a few -seconds to a few minutes, depending on the amount of packages being -installed.</p> - -<p>The speedup is implemented by using two hooks in -<a href="https://www.debian.org/devel/debian-installer/">Debian -Installer</a>, the pre-pkgsel.d hook to set up the diverts, and the -finish-install.d hook to remove the divert at the end of the -installation. I picked the pre-pkgsel.d hook instead of the -post-base-installer.d hook because I test using an ISO without the -eatmydata package included, and the post-base-installer.d hook in -Debian Edu can only operate on packages included in the ISO. The -negative effect of this is that I am unable to activate this -optimization for the kernel installation step in d-i. If the code is -moved to the post-base-installer.d hook, the speedup would be larger -for the entire installation.</p> - -<p>I've implemented this in the -<a href="https://packages.qa.debian.org/debian-edu-install">debian-edu-install</a> -git repository, and plan to provide the optimization as part of the -Debian Edu installation. If you want to test this yourself, you can -create two files in the installer (or in an udeb). One shell script -need do go into /usr/lib/pre-pkgsel.d/, with content like this:</p> - -<p><blockquote><pre> -#!/bin/sh -set -e -. /usr/share/debconf/confmodule -info() { - logger -t my-pkgsel "info: $*" -} -error() { - logger -t my-pkgsel "error: $*" -} -override_install() { - apt-install eatmydata || true - if [ -x /target/usr/bin/eatmydata ] ; then - for bin in dpkg apt-get aptitude tasksel ; do - file=/usr/bin/$bin - # Test that the file exist and have not been diverted already. - if [ -f /target$file ] ; then - info "diverting $file using eatmydata" - printf "#!/bin/sh\neatmydata $bin.distrib \"\$@\"\n" \ - > /target$file.edu - chmod 755 /target$file.edu - in-target dpkg-divert --package debian-edu-config \ - --rename --quiet --add $file - ln -sf ./$bin.edu /target$file - else - error "unable to divert $file, as it is missing." - fi - done - else - error "unable to find /usr/bin/eatmydata after installing the eatmydata pacage" - fi -} - -override_install -</pre></blockquote></p> - -<p>To clean up, another shell script should go into -/usr/lib/finish-install.d/ with code like this: +<p><blockquote> +nfs: server nfsserver not responding, still trying +<br>nfs: server nfsserver OK +</blockquote></p> + +<p>It is hard to know if the hang is still going on, and it is hard to +be sure looking in dmesg is going to work. If there are lots of other +messages in dmesg the lines might have rotated out of site before they +are noticed.</p> + +<p>While reading through the nfs client implementation in linux kernel +code, I came across some statistics that seem to give a way to detect +it. The om_timeouts sunrpc value in the kernel will increase every +time the above log entry is inserted into dmesg. And after digging a +bit further, I discovered that this value show up in +/proc/self/mountstats on Linux.</p> + +<p>The mountstats content seem to be shared between files using the +same file system context, so it is enough to check one of the +mountstats files to get the state of the mount point for the machine. +I assume this will not show lazy umounted NFS points, nor NFS mount +points in a different process context (ie with a different filesystem +view), but that does not worry me.</p> + +<p>The content for a NFS mount point look similar to this:</p> <p><blockquote><pre> -#! /bin/sh -e -. /usr/share/debconf/confmodule -error() { - logger -t my-finish-install "error: $@" -} -remove_install_override() { - for bin in dpkg apt-get aptitude tasksel ; do - file=/usr/bin/$bin - if [ -x /target$file.edu ] ; then - rm /target$file - in-target dpkg-divert --package debian-edu-config \ - --rename --quiet --remove $file - rm /target$file.edu - else - error "Missing divert for $file." - fi - done - sync # Flush file buffers before continuing -} - -remove_install_override +[...] +device /dev/mapper/Debian-var mounted on /var with fstype ext3 +device nfsserver:/mnt/nfsserver/home0 mounted on /mnt/nfsserver/home0 with fstype nfs statvers=1.1 + opts: rw,vers=3,rsize=65536,wsize=65536,namlen=255,acregmin=3,acregmax=60,acdirmin=30,acdirmax=60,soft,nolock,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=129.240.3.145,mountvers=3,mountport=4048,mountproto=udp,local_lock=all + age: 7863311 + caps: caps=0x3fe7,wtmult=4096,dtsize=8192,bsize=0,namlen=255 + sec: flavor=1,pseudoflavor=1 + events: 61063112 732346265 1028140 35486205 16220064 8162542 761447191 71714012 37189 3891185 45561809 110486139 4850138 420353 15449177 296502 52736725 13523379 0 52182 9016896 1231 0 0 0 0 0 + bytes: 166253035039 219519120027 0 0 40783504807 185466229638 11677877 45561809 + RPC iostats version: 1.0 p/v: 100003/3 (nfs) + xprt: tcp 925 1 6810 0 0 111505412 111480497 109 2672418560317 0 248 53869103 22481820 + per-op statistics + NULL: 0 0 0 0 0 0 0 0 + GETATTR: 61063106 61063108 0 9621383060 6839064400 453650 77291321 78926132 + SETATTR: 463469 463470 0 92005440 66739536 63787 603235 687943 + LOOKUP: 17021657 17021657 0 3354097764 4013442928 57216 35125459 35566511 + ACCESS: 14281703 14290009 5 2318400592 1713803640 1709282 4865144 7130140 + READLINK: 125 125 0 20472 18620 0 1112 1118 + READ: 4214236 4214237 0 715608524 41328653212 89884 22622768 22806693 + WRITE: 8479010 8494376 22 187695798568 1356087148 178264904 51506907 231671771 + CREATE: 171708 171708 0 38084748 46702272 873 1041833 1050398 + MKDIR: 3680 3680 0 773980 993920 26 23990 24245 + SYMLINK: 903 903 0 233428 245488 6 5865 5917 + MKNOD: 80 80 0 20148 21760 0 299 304 + REMOVE: 429921 429921 0 79796004 61908192 3313 2710416 2741636 + RMDIR: 3367 3367 0 645112 484848 22 5782 6002 + RENAME: 466201 466201 0 130026184 121212260 7075 5935207 5961288 + LINK: 289155 289155 0 72775556 67083960 2199 2565060 2585579 + READDIR: 2933237 2933237 0 516506204 13973833412 10385 3190199 3297917 + READDIRPLUS: 1652839 1652839 0 298640972 6895997744 84735 14307895 14448937 + FSSTAT: 6144 6144 0 1010516 1032192 51 9654 10022 + FSINFO: 2 2 0 232 328 0 1 1 + PATHCONF: 1 1 0 116 140 0 0 0 + COMMIT: 0 0 0 0 0 0 0 0 + +device binfmt_misc mounted on /proc/sys/fs/binfmt_misc with fstype binfmt_misc +[...] </pre></blockquote></p> -<p>In Debian Edu, I placed both code fragments in a separate script -edu-eatmydata-install and call it from the pre-pkgsel.d and -finish-install.d scripts.</p> - -<p>By now you might ask if this change should get into the normal -Debian installer too? I suspect it should, but am not sure the -current debian-installer coordinators find it useful enough. It also -depend on the side effects of the change. I'm not aware of any, but I -guess we will see if the change is safe after some more testing. -Perhaps there is some package in Debian depending on sync() and -fsync() having effect? Perhaps it should go into its own udeb, to -allow those of us wanting to enable it to do so without affecting -everyone.</p> - -<p>Update 2014-09-24: Since a few days ago, enabling this optimization -will break installation of all programs using gnutls because of -<ahref="https://bugs.debian.org/702711">bug #702711. An updated -eatmydata package in Debian will solve it.</p> +<p>The key number to look at is the third number in the per-op list. +It is the number of NFS timeouts experiences per file system +operation. Here 22 write timeouts and 5 access timeouts. If these +numbers are increasing, I believe the machine is experiencing NFS +hang. Unfortunately the timeout value do not start to increase right +away. The NFS operations need to time out first, and this can take a +while. The exact timeout value depend on the setup. For example the +defaults for TCP and UDP mount points are quite different, and the +timeout value is affected by the soft, hard, timeo and retrans NFS +mount options.</p> + +<p>The only way I have been able to get working on Debian and RedHat +Enterprise Linux for getting the timeout count is to peek in /proc/. +But according to +<ahref="http://docs.oracle.com/cd/E19253-01/816-4555/netmonitor-12/index.html">Solaris +10 System Administration Guide: Network Services</a>, the 'nfsstat -c' +command can be used to get these timeout values. But this do not work +on Linux, as far as I can tell. I +<ahref="http://bugs.debian.org/857043">asked Debian about this</a>, +but have not seen any replies yet.</p> + +<p>Is there a better way to figure out if a Linux NFS client is +experiencing NFS hangs? Is there a way to detect which processes are +affected? Is there a way to get the NFS mount going quickly once the +network problem causing the NFS hang has been cleared? I would very +much welcome some clues, as we regularly run into NFS hangs.</p> - Good bye subkeys.pgp.net, welcome pool.sks-keyservers.net - http://people.skolelinux.org/pere/blog/Good_bye_subkeys_pgp_net__welcome_pool_sks_keyservers_net.html - http://people.skolelinux.org/pere/blog/Good_bye_subkeys_pgp_net__welcome_pool_sks_keyservers_net.html - Wed, 10 Sep 2014 13:10:00 +0200 - <p>Yesterday, I had the pleasure of attending a talk with the -<a href="http://www.nuug.no/">Norwegian Unix User Group</a> about -<a href="http://www.nuug.no/aktiviteter/20140909-sks-keyservers/">the -OpenPGP keyserver pool sks-keyservers.net</a>, and was very happy to -learn that there is a large set of publicly available key servers to -use when looking for peoples public key. So far I have used -subkeys.pgp.net, and some times wwwkeys.nl.pgp.net when the former -were misbehaving, but those days are ended. The servers I have used -up until yesterday have been slow and some times unavailable. I hope -those problems are gone now.</p> - -<p>Behind the round robin DNS entry of the -<a href="https://sks-keyservers.net/">sks-keyservers.net</a> service -there is a pool of more than 100 keyservers which are checked every -day to ensure they are well connected and up to date. It must be -better than what I have used so far. :)</p> - -<p>Yesterdays speaker told me that the service is the default -keyserver provided by the default configuration in GnuPG, but this do -not seem to be used in Debian. Perhaps it should?</p> - -<p>Anyway, I've updated my ~/.gnupg/options file to now include this -line:</p> - -<p><blockquote><pre> -keyserver pool.sks-keyservers.net -</pre></blockquote></p> - -<p>With GnuPG version 2 one can also locate the keyserver using SRV -entries in DNS. Just for fun, I did just that at work, so now every -user of GnuPG at the University of Oslo should find a OpenGPG -keyserver automatically should their need it:</p> - -<p><blockquote><pre> -% host -t srv _pgpkey-http._tcp.uio.no -_pgpkey-http._tcp.uio.no has SRV record 0 100 11371 pool.sks-keyservers.net. -% -</pre></blockquote></p> - -<p>Now if only -<a href="http://ietfreport.isoc.org/idref/draft-shaw-openpgp-hkp/">the -HKP lookup protocol</a> supported finding signature paths, I would be -very happy. It can look up a given key or search for a user ID, but I -normally do not want that, but to find a trust path from my key to -another key. Given a user ID or key ID, I would like to find (and -download) the keys representing a signature path from my key to the -key in question, to be able to get a trust path between the two keys. -This is as far as I can tell not possible today. Perhaps something -for a future version of the protocol?</p> + How does it feel to be wiretapped, when you should be doing the wiretapping... + http://people.skolelinux.org/pere/blog/How_does_it_feel_to_be_wiretapped__when_you_should_be_doing_the_wiretapping___.html + http://people.skolelinux.org/pere/blog/How_does_it_feel_to_be_wiretapped__when_you_should_be_doing_the_wiretapping___.html + Wed, 8 Mar 2017 11:50:00 +0100 + <p>So the new president in the United States of America claim to be +surprised to discover that he was wiretapped during the election +before he was elected president. He even claim this must be illegal. +Well, doh, if it is one thing the confirmations from Snowden +documented, it is that the entire population in USA is wiretapped, one +way or another. Of course the president candidates were wiretapped, +alongside the senators, judges and the rest of the people in USA.</p> + +<p>Next, the Federal Bureau of Investigation ask the Department of +Justice to go public rejecting the claims that Donald Trump was +wiretapped illegally. I fail to see the relevance, given that I am +sure the surveillance industry in USA believe they have all the legal +backing they need to conduct mass surveillance on the entire +world.</p> + +<p>There is even the director of the FBI stating that he never saw an +order requesting wiretapping of Donald Trump. That is not very +surprising, given how the FISA court work, with all its activity being +secret. Perhaps he only heard about it?</p> + +<p>What I find most sad in this story is how Norwegian journalists +present it. In a news reports the other day in the radio from the +Norwegian National broadcasting Company (NRK), I heard the journalist +claim that 'the FBI denies any wiretapping', while the reality is that +'the FBI denies any illegal wiretapping'. There is a fundamental and +important difference, and it make me sad that the journalists are +unable to grasp it.</p> + +<p><strong>Update 2017-03-13:</strong> Look like +<a href="https://theintercept.com/2017/03/13/rand-paul-is-right-nsa-routinely-monitors-americans-communications-without-warrants/">The +Intercept report that US Senator Rand Paul confirm what I state above</a>.</p> - Do you need an agreement with MPEG-LA to publish and broadcast H.264 video in Norway? - http://people.skolelinux.org/pere/blog/Do_you_need_an_agreement_with_MPEG_LA_to_publish_and_broadcast_H_264_video_in_Norway_.html - http://people.skolelinux.org/pere/blog/Do_you_need_an_agreement_with_MPEG_LA_to_publish_and_broadcast_H_264_video_in_Norway_.html - Mon, 25 Aug 2014 22:10:00 +0200 - <p>Two years later, I am still not sure if it is legal here in Norway -to use or publish a video in H.264 or MPEG4 format edited by the -commercially licensed video editors, without limiting the use to -create "personal" or "non-commercial" videos or get a license -agreement with <a href="http://www.mpegla.com">MPEG LA</a>. If one -want to publish and broadcast video in a non-personal or commercial -setting, it might be that those tools can not be used, or that video -format can not be used, without breaking their copyright license. I -am not sure. -<a href="http://people.skolelinux.org/pere/blog/Trenger_en_avtale_med_MPEG_LA_for___publisere_og_kringkaste_H_264_video_.html">Back -then</a>, I found that the copyright license terms for Adobe Premiere -and Apple Final Cut Pro both specified that one could not use the -program to produce anything else without a patent license from MPEG -LA. The issue is not limited to those two products, though. Other -much used products like those from Avid and Sorenson Media have terms -of use are similar to those from Adobe and Apple. The complicating -factor making me unsure if those terms have effect in Norway or not is -that the patents in question are not valid in Norway, but copyright -licenses are.</p> - -<p>These are the terms for Avid Artist Suite, according to their -<a href="http://www.avid.com/US/about-avid/legal-notices/legal-enduserlicense2">published -end user</a> -<a href="http://www.avid.com/static/resources/common/documents/corporate/LICENSE.pdf">license -text</a> (converted to lower case text for easier reading):</p> - -<p><blockquote> -<p>18.2. MPEG-4. MPEG-4 technology may be included with the -software. MPEG LA, L.L.C. requires this notice: </p> - -<p>This product is licensed under the MPEG-4 visual patent portfolio -license for the personal and non-commercial use of a consumer for (i) -encoding video in compliance with the MPEG-4 visual standard (“MPEG-4 -video”) and/or (ii) decoding MPEG-4 video that was encoded by a -consumer engaged in a personal and non-commercial activity and/or was -obtained from a video provider licensed by MPEG LA to provide MPEG-4 -video. No license is granted or shall be implied for any other -use. Additional information including that relating to promotional, -internal and commercial uses and licensing may be obtained from MPEG -LA, LLC. See http://www.mpegla.com. This product is licensed under -the MPEG-4 systems patent portfolio license for encoding in compliance -with the MPEG-4 systems standard, except that an additional license -and payment of royalties are necessary for encoding in connection with -(i) data stored or replicated in physical media which is paid for on a -title by title basis and/or (ii) data which is paid for on a title by -title basis and is transmitted to an end user for permanent storage -and/or use, such additional license may be obtained from MPEG LA, -LLC. See http://www.mpegla.com for additional details.</p> - -<p>18.3. H.264/AVC. H.264/AVC technology may be included with the -software. MPEG LA, L.L.C. requires this notice:</p> - -<p>This product is licensed under the AVC patent portfolio license for -the personal use of a consumer or other uses in which it does not -receive remuneration to (i) encode video in compliance with the AVC -standard (“AVC video”) and/or (ii) decode AVC video that was encoded -by a consumer engaged in a personal activity and/or was obtained from -a video provider licensed to provide AVC video. No license is granted -or shall be implied for any other use. Additional information may be -obtained from MPEG LA, L.L.C. See http://www.mpegla.com.</p> -</blockquote></p> - -<p>Note the requirement that the videos created can only be used for -personal or non-commercial purposes.</p> - -<p>The Sorenson Media software have -<a href="http://www.sorensonmedia.com/terms/">similar terms</a>:</p> - -<p><blockquote> - -<p>With respect to a license from Sorenson pertaining to MPEG-4 Video -Decoders and/or Encoders: Any such product is licensed under the -MPEG-4 visual patent portfolio license for the personal and -non-commercial use of a consumer for (i) encoding video in compliance -with the MPEG-4 visual standard (“MPEG-4 video”) and/or (ii) decoding -MPEG-4 video that was encoded by a consumer engaged in a personal and -non-commercial activity and/or was obtained from a video provider -licensed by MPEG LA to provide MPEG-4 video. No license is granted or -shall be implied for any other use. Additional information including -that relating to promotional, internal and commercial uses and -licensing may be obtained from MPEG LA, LLC. See -http://www.mpegla.com.</p> - -<p>With respect to a license from Sorenson pertaining to MPEG-4 -Consumer Recorded Data Encoder, MPEG-4 Systems Internet Data Encoder, -MPEG-4 Mobile Data Encoder, and/or MPEG-4 Unique Use Encoder: Any such -product is licensed under the MPEG-4 systems patent portfolio license -for encoding in compliance with the MPEG-4 systems standard, except -that an additional license and payment of royalties are necessary for -encoding in connection with (i) data stored or replicated in physical -media which is paid for on a title by title basis and/or (ii) data -which is paid for on a title by title basis and is transmitted to an -end user for permanent storage and/or use. Such additional license may -be obtained from MPEG LA, LLC. See http://www.mpegla.com for -additional details.</p> - -</blockquote></p> - -<p>Some free software like -<a href="https://handbrake.fr/">Handbrake</A> and -<a href="http://ffmpeg.org/">FFMPEG</a> uses GPL/LGPL licenses and do -not have any such terms included, so for those, there is no -requirement to limit the use to personal and non-commercial.</p> + Norwegian Bokmål translation of The Debian Administrator's Handbook complete, proofreading in progress + http://people.skolelinux.org/pere/blog/Norwegian_Bokm_l_translation_of_The_Debian_Administrator_s_Handbook_complete__proofreading_in_progress.html + http://people.skolelinux.org/pere/blog/Norwegian_Bokm_l_translation_of_The_Debian_Administrator_s_Handbook_complete__proofreading_in_progress.html + Fri, 3 Mar 2017 14:50:00 +0100 + <p>For almost a year now, we have been working on making a Norwegian +Bokmål edition of <a href="https://debian-handbook.info/">The Debian +Administrator's Handbook</a>. Now, thanks to the tireless effort of +Ole-Erik, Ingrid and Andreas, the initial translation is complete, and +we are working on the proof reading to ensure consistent language and +use of correct computer science terms. The plan is to make the book +available on paper, as well as in electronic form. For that to +happen, the proof reading must be completed and all the figures need +to be translated. If you want to help out, get in touch.</p> + +<p><a href="http://people.skolelinux.org/pere/debian-handbook/debian-handbook-nb-NO.pdf">A + +fresh PDF edition</a> in A4 format (the final book will have smaller +pages) of the book created every morning is available for +proofreading. If you find any errors, please +<a href="https://hosted.weblate.org/projects/debian-handbook/">visit +Weblate and correct the error</a>. The +<a href="http://l.github.io/debian-handbook/stat/nb-NO/index.html">state +of the translation including figures</a> is a useful source for those +provide Norwegian bokmål screen shots and figures.</p> - Lenker for 2014-08-03 - http://people.skolelinux.org/pere/blog/Lenker_for_2014_08_03.html - http://people.skolelinux.org/pere/blog/Lenker_for_2014_08_03.html - Sun, 3 Aug 2014 23:00:00 +0200 - <p>Lenge siden jeg har hatt tid til å publisere lenker til skriverier -jeg har hatt glede og nytte av av å lese. Her er en liten norsk -lenkesamling.</p> - -<p><ul> - -<li><a href="http://www.nrk.no/ytring/sjoslag-om-fiskemilliardene-1.11576109">Sjøslag -om fiskemilliardene</a> (NRK Ytring 2014-03-03) - litt om hvordan de -norske felles matressurser røves fra felleskapet.</li> - -<li><a href="http://www.aftenposten.no/nyheter/Matkrisen-kan-komme-til-Norge-7522341.html">Matkrisen -kan komme til Norge</a> (Aftenposten 2014-4-01) - hvordan miljøendringene vil gjøre matproduksjonen i Norge mer sårbar.</li> + Unlimited randomness with the ChaosKey? + http://people.skolelinux.org/pere/blog/Unlimited_randomness_with_the_ChaosKey_.html + http://people.skolelinux.org/pere/blog/Unlimited_randomness_with_the_ChaosKey_.html + Wed, 1 Mar 2017 20:50:00 +0100 + <p>A few days ago I ordered a small batch of +<a href="http://altusmetrum.org/ChaosKey/">the ChaosKey</a>, a small +USB dongle for generating entropy created by Bdale Garbee and Keith +Packard. Yesterday it arrived, and I am very happy to report that it +work great! According to its designers, to get it to work out of the +box, you need the Linux kernel version 4.1 or later. I tested on a +Debian Stretch machine (kernel version 4.9), and there it worked just +fine, increasing the available entropy very quickly. I wrote a small +test oneliner to test. It first print the current entropy level, +drain /dev/random, and then print the entropy level for five seconds. +Here is the situation without the ChaosKey inserted:</p> -<li><a href="http://www.nrk.no/ytring/norge-trenger-kornlager-1.11726744">Norge -trenger kornlager</a> (NRK Ytring 2014-06-07) Chr. Anton Smedshaug -forteller litt om Norges sårbare matsituasjon etter at Staten solgte -Norges kornlager.</li> - -<li><a href="http://www.nrk.no/norge/pst-vil-overvake-datatastaturer-1.11583286">PST -vil overvåke datatastaturer</a> (NRK 2014-03-04) - PST ønsker retten -til å bryte seg inn på private PC-er og legge inn spionprogrammer. -Hvilket nok vil gjøre Linux mer populært, men gjør at en i enda mindre -grad enn i dag kan stole på datamaskiner - neppe en god ide for -samfunnet totalt sett.</li> - -<li><a href="http://www.osloby.no/nyheter/Ruter-fremstar-som-et-pobelvelde-7490624.html">«Ruter -fremstår som et pøbelvelde»</a> (OsloBy 2014-03-05) - et eksempel på -hvordan kollektivtransportselskapet i Oslo håndterer sine kunder.</li> - -<li><a href="http://www.dagbladet.no/2014/03/05/nyheter/dbtv/reklame/clear_channel/32123808/">Clear -Channel nektet å vise Greenpeace-reklame i Oslo</a> (Dagbladet -2014-03-05) - forteller litt om hvordan hvilke budskap som når ut i -det offentlige rom kontrolleres i Norge.</li> - -<li><a href="http://www.dagbladet.no/2014/03/06/kultur/meninger/debattinnlegg/kronikk/22_juli/32175854/">Svarte -ikke på kritikken</a> (Dagbladet 2014-03-06) - innlegg fra Norsk -presseforbund der de nok en gang tar opp det forkastelige i at -politiet nå har full tilgang til å bedrive telefonkontroll av -advokater.</li> - -<li><a href="http://www.aftenposten.no/nyheter/uriks/Putin-spiller-poker_-ikke-sjakk-I-sjakk-har-man-regler-7495368.html">«Putin -spiller poker, ikke sjakk. I sjakk har man regler.»</a> (Aftenposten -2014-03-08) - sjakklegenden Kasparov forklarer litt om hvordan han ser -at Russlands politikk fungerer, blant annet i lys av started av -Ukraina-krisen.</li> - -<li><a href="http://www.aftenposten.no/meninger/kronikker/I-seng-med-fienden-7492605.html">I -seng med fienden</a> (Aftenposten 2014-03-10) - kronikk fra Eirik -H. Vinje om hvordan menn og kvinner settes opp mot hverandre i det -offentlige ordskiftet, kanskje på sviktende grunnlag.</li> - -<li><a href="http://www.aftenposten.no/amagasinet/Hvor-er-elevene-7501690.html">Fritt -frem for skulk</a> (Aftenposten 2014-03-14) - skildring av hvordan -norske elever i dag ikke lenger har rimelig krav om oppmøte på -skolen.</li> - -<li><a href="http://www.aftenposten.no/digital/Datalagringsdirektiv-avslorte-abort_-sykdom-og-vapenkjop--7503014.html">«Datalagringsdirektiv» -avslørte abort, sykdom og våpenkjøp</a> (Aftenposten 2014-03-14) - om -hvordan forskere har dokumentert hvordan innsamling av metadata om -telefoni og Internett-bruk kan være svært avslørende.</li> - -<li><a href="http://www.dagbladet.no/2014/03/14/kultur/meninger/ideer/lordagskommentaren/agnes_ravatn/32302856/">Konsentrasjonssvikt -på pensum</a> (Dagbladet 2014-03-14) - Kommentar om hvordan (feil) -bruk IKT i skolen kan ødelegge mer enn det bidrar til læring.</li> - -<li><a href="http://doremusnor.wordpress.com/2014/02/09/reservasjonsrettsstaten/">Reservasjonsrettsstaten</a> -(blogg fra Doremus 2014-02-09) - morsom beskrivelse om hvordan -regjeringens forslag til reservasjonsrett for leger kan utvides til å -gjelde alles samvittighet.</li> - -<li><a href="http://www.aftenposten.no/meninger/kronikker/Autoritar-gjokunge-7514915.html">Autoritær -gjøkunge</a> (Aftenposten 2014-03-25) - Kronikk av Bjørn Stærk om -snurpenots-overvåkningen som varsleren Snowden dokumenterte.</li> - -<li><a href="http://blogg.friprog.no/2014/03/leveransekrise-i-offentlig-sektor-mener-mike-bracken-executive-director-of-digital-in-the-cabinet-office/">Leveransekrise -i Offentlig sektor – mener Mike Bracken, Executive Director of Digital -in the Cabinet Office</a> (blogg fra Friprog-senteret 2014-03-26).</li> - -<li><a href="http://www.dagbladet.no/2014/03/26/kultur/meninger/kronikk/etiopia/avlytting/32499687/">Norge -må stanse avlyttingen</a> (Dagbladet 2014-03-26) - leserinnlegg fra -Felix Horne der han ber om at Norge gjør en innsats for å få slutt på -overvåkning av innbyggerne som gjøres i Norge av Etiopiske -myndigheter.</li> - -<li><a href="http://www.aftenposten.no/meninger/kronikker/Demokrati-er-ingen-naturlig-styreform-7521957.html">Demokrati -er ingen naturlig styreform</a> (Aftenposten 2014-04-01) - kronikk av -Stein Ringen om hvordan demokrati som styreform går tapt når -innbyggerne tar det for gitt.</li> - -<li><a href="http://www.nrk.no/ytring/ytringsansvar-ere-enhver-tilladte_-1.11618934">Ytringsansvar -ere Enhver tilladte!</a> (NRK Ytring 2014-04-01) - innspill fra Trygve -Svensson og Helge Svare om at hver enkelt av oss har et ansvar for å -ytre oss i den offentlige debatten.</li> - -<li><a href="http://www.aftenposten.no/meninger/Jeg-er-ingen-god-samfunnsborger-7527128.html">Jeg -er ingen god samfunnsborger</a> (Aftenposten 2014-04-16), kronikk av -Simen Tveitereid om alternative måter å motiveres i samfunnet, uten å -hige etter mer penger og flere ting.</li> - -<li><a href="http://www.aftenposten.no/meninger/debatt/Avgjorelsen-far-umiddelbar-virkning-7531811.html">DLD-dommen: -Avgjørelsen får umiddelbar virkning</a> (Aftenposten 2014-04-10) - -kronikk av Høyres Michael Tetzschner, en partiutbryter i DLD-saken som -stemte nei til DLD i Stortinget i 2011.</li> - -<li><a href="http://www.uhuru.biz/?p=1466">Datalagringsdirektivets -endelikt</a> (blogg fra John Wessel-Aas 2014-04-11) - oppsummering -av hvordan direktivet ble funnet ugyldig i EU-domstolen.</li> - -<li><a href="http://www.vg.no/nyheter/meninger/kronikk-kapitulasjonspresidenten/a/10147713/">Kronikk: -Kapitulasjonspresidenten</a> (VG 2014-04-22) - kronikk av Einar -Kr. Steffenak om hvordan Stortingspresidenten og regjeringen viser sin -prinsippløshet i møte med Kina.</li> - -<li><a href="http://www.aftenposten.no/meninger/kronikker/Innerst-inne-er-alle-nordmenn-7542617.html">Innerst -inne er alle nordmenn</a> (Aftenposten 2014-04-27) - kronikk fra Bjørn -Stærk om hvordan vi i Vesten i stor grad baserer oss på en fantasi om -at alle i verden bærer på en drøm om å bli som oss.</li> - -<li><a href="http://www.aftenposten.no/viten/uviten/Det-italienske-senatet-gav-seg-selv-134-milliarder-euro-i-sluttpakke--7575312.html">Det -italienske senatet gav seg selv 134 milliarder euro i sluttpakke</a> -(Aftenposten 2014-06-19) - forsker Simen Gaure forteller hvordan -løgner og fantasi fra nettkilder i stor grad blir akseptert som -sannhet - antagelig også av deg og meg.</li> - -<li><a href="http://www.dagbladet.no/2014/05/30/kultur/meninger/kronikk/skole/33576392/">Et -forsvar for bråkmakerne</a> (Dagbladet 2014-05-30) - kronikk av Dag -Øystein Nome som beskriver hvordan dagens skole ikke fungerer så godt -for mange elever.</li> - -<li><a href="http://www.osloby.no/nyheter/Betalte-med-slitt-seddel---havnet-i-arresten-7617208.html">Betalte -med slitt seddel - havnet i arresten</a> (Osloby 2014-06-25)) - -dokumentasjon av Oslopolitiets angrep på vår alles rett til å ferdes -uten elektronisk sporing. Jeg bruker kontanter i så stor grad som -mulig da banken ikke har noe med hvor jeg er og hva jeg kjøper. Vi -som gjør dette risikerer som beskrevet overgrep som frihetsberøvelse -og registrering og lagring av fingeravtrykk og bilde i politiets -database over mistenkte.</li> - -<li><a href="http://www.aftenposten.no/meninger/leder/Fredsprisen-til-Snowden-7620422.html">Fredsprisen -til Snowden</a> (Aftenposten 2014-06-28) - leder som forklarer hvorfor -varsleren Snowden bør få fredsprisen.</li> +<blockquote><pre> +% cat /proc/sys/kernel/random/entropy_avail; \ + dd bs=1M if=/dev/random of=/dev/null count=1; \ + for n in $(seq 1 5); do \ + cat /proc/sys/kernel/random/entropy_avail; \ + sleep 1; \ + done +300 +0+1 oppføringer inn +0+1 oppføringer ut +28 byte kopiert, 0,000264565 s, 106 kB/s +4 +8 +12 +17 +21 +% +</pre></blockquote> -<li><a href="http://www.dagbladet.no/2014/08/01/kultur/meninger/dbmener/leder1/34598010/">Strategi -for politistaten</a> (Dagbladet 2014-08-01) - leder som advarer om -sterke krefter som bruker terrortrusselen til å lirke Norge nærmere å -bli en politistat.</li> +<p>The entropy level increases by 3-4 every second. In such case any +application requiring random bits (like a HTTPS enabled web server) +will halt and wait for more entrpy. And here is the situation with +the ChaosKey inserted:</p> -<li><a href="http://www.nrk.no/ytring/vi-ma-tenke-nytt-om-narkotika-1.11859322">Vi -må tenke nytt om narkotika</a> (NRK Ytring 2014-08-03) - Mark Lewis -forklarer hvorfor legalisering og offentlig kontroll av -narkotikamarkedet er mye bedre enn å overlate det til kriminelle.</li> +<blockquote><pre> +% cat /proc/sys/kernel/random/entropy_avail; \ + dd bs=1M if=/dev/random of=/dev/null count=1; \ + for n in $(seq 1 5); do \ + cat /proc/sys/kernel/random/entropy_avail; \ + sleep 1; \ + done +1079 +0+1 oppføringer inn +0+1 oppføringer ut +104 byte kopiert, 0,000487647 s, 213 kB/s +433 +1028 +1031 +1035 +1038 +% +</pre></blockquote> +<p>Quite the difference. :) I bought a few more than I need, in case +someone want to buy one here in Norway. :)</p> -</ul></p> +<p>Update: The dongle was presented at Debconf last year. You might +find <a href="https://debconf16.debconf.org/talks/94/">the talk +recording illuminating</a>. It explains exactly what the source of +randomness is, if you are unable to spot it from the schema drawing +available from the ChaosKey web site linked at the start of this blog +post.</p> - Debian Edu interview: Bernd Zeitzen - http://people.skolelinux.org/pere/blog/Debian_Edu_interview__Bernd_Zeitzen.html - http://people.skolelinux.org/pere/blog/Debian_Edu_interview__Bernd_Zeitzen.html - Thu, 31 Jul 2014 08:30:00 +0200 - <p>The complete and free “out of the box” software solution for -schools, <a href="http://www.skolelinux.org/">Debian Edu / -Skolelinux</a>, is used quite a lot in Germany, and one of the people -involved is Bernd Zeitzen, who show up on the project mailing lists -from time to time with interesting questions and tips on how to adjust -the setup. I managed to interview him this summer.</p> - -<p><strong>Who are you, and how do you spend your days?</strong></p> - -<p>My name is Bernd Zeitzen and I'm married with Hedda, a self -employed physiotherapist. My former profession is tool maker, but I -haven't worked for 30 years in this job. 30 years ago I started to -support my wife and become her officeworker and a few years later the -administrator for a small computer network, today based on Ubuntu -Server (Samba, OpenVPN). For her daily work she has to use Windows -Desktops because the software she needs to organize her business only -works with Windows . :-(</p> - -<p>In 1988 we started with one PC and DOS, then I learned to use -Windows 98, 2000, XP, …, 8, Ubuntu, MacOSX. Today we are running a -Linux server with 6 Windows clients and 10 persons (teacher of -children with special needs, speech therapist, occupational therapist, -psychologist and officeworkers) using our Samba shares via OpenVPN to -work with the documentations of our patients.</p> - -<p><strong>How did you get in contact with the Skolelinux / Debian Edu -project?</strong></p> - -<p>Two years ago a friend of mine asked me, if I want to get a job in -his school (<a href="http://www.gymnasium-harsewinkel.de/">Gymnasium -Harsewinkel</a>). They started with Skolelinux / Debian Edu and they -were looking for people to give support to the teachers using the -software and the network and teaching the pupils increasing their -computer skills in optional lessons. I'm spending 4-6 hours a week -with this job.</p> - -<p><strong>What do you see as the advantages of Skolelinux / Debian -Edu?</strong></p> - -<p>The independence.</p> - -<p>First: Every person is allowed to use, share and develop the -software. Even if you are poor, you are allowed to use the software -included in Skolelinux/Debian Edu and all the other Free Software.</p> - -<p>Second: The software runs on old machines and this gives us the -possibility to recycle computers, weeded out from offices. The -servers and desktops are running for more than two years and they are -working reliable. </p> - -<p>We have two servers (one tjener and one terminal server), 45 -workstations in three classrooms and seven laptops as a mobile -solution for all classrooms. These machines are all booting from the -terminal server. In the moment we are installing 30 laptops as mobile -workstations. Then the pupils have the possibility to work with these -machines in their classrooms. Internet access is realized by a WLAN -router, connected to the schools network. This is all done without a -dedicated system administrator or a computer science teacher.</p> - -<p><strong>What do you see as the disadvantages of Skolelinux / Debian -Edu?</strong></p> - -<p>Teachers and pupils are Windows users. &lt;Irony on&gt; And Linux -isn't cool. It's software for freaks using the command line. &lt;Irony -off&gt; They don't realize the stability of the system. </p> - -<p><strong>Which free software do you use daily?</strong></p> - -<p>Firefox, Thunderbird, LibreOffice, Ubuntu Server 12.04 (Samba, -Apache, MySQL, Joomla!, … and Skolelinux / Debian Edu)</p> - -<p><strong>Which strategy do you believe is the right one to use to -get schools to use free software?</strong></p> - -<p>In Germany we have the situation: every school is free to decide -which software they want to use. This decision is influenced by -teachers who learned to use Windows and MS Office. They buy a PC with -Windows preinstalled and an additional testing version of MS -Office. They don't know about the possibility to use Free Software -instead. Another problem are the publisher of school books. They -develop their software, added to the school books, for Windows.</p> + Detect OOXML files with undefined behaviour? + http://people.skolelinux.org/pere/blog/Detect_OOXML_files_with_undefined_behaviour_.html + http://people.skolelinux.org/pere/blog/Detect_OOXML_files_with_undefined_behaviour_.html + Tue, 21 Feb 2017 00:20:00 +0100 + <p>I just noticed +<a href="http://www.arkivrad.no/aktuelt/riksarkivarens-forskrift-pa-horing">the +new Norwegian proposal for archiving rules in the goverment</a> list +<a href="http://www.ecma-international.org/publications/standards/Ecma-376.htm">ECMA-376</a> +/ ISO/IEC 29500 (aka OOXML) as valid formats to put in long term +storage. Luckily such files will only be accepted based on +pre-approval from the National Archive. Allowing OOXML files to be +used for long term storage might seem like a good idea as long as we +forget that there are plenty of ways for a "valid" OOXML document to +have content with no defined interpretation in the standard, which +lead to a question and an idea.</p> + +<p>Is there any tool to detect if a OOXML document depend on such +undefined behaviour? It would be useful for the National Archive (and +anyone else interested in verifying that a document is well defined) +to have such tool available when considering to approve the use of +OOXML. I'm aware of the +<a href="https://github.com/arlm/officeotron/">officeotron OOXML +validator</a>, but do not know how complete it is nor if it will +report use of undefined behaviour. Are there other similar tools +available? Please send me an email if you know of any such tool.</p> - 98.6 percent done with the Norwegian draft translation of Free Culture - http://people.skolelinux.org/pere/blog/98_6_percent_done_with_the_Norwegian_draft_translation_of_Free_Culture.html - http://people.skolelinux.org/pere/blog/98_6_percent_done_with_the_Norwegian_draft_translation_of_Free_Culture.html - Wed, 23 Jul 2014 22:40:00 +0200 - <p>This summer I finally had time to continue working on the Norwegian -<a href="http://www.docbook.org/">docbook</a> version of the 2004 book -<a href="http://free-culture.cc/">Free Culture</a> by Lawrence Lessig, -to get a Norwegian text explaining the problems with todays copyright -law. Yesterday, I finally completed translated the book text. There -are still some foot/end notes left to translate, the colophon page -need to be rewritten, and a few words and phrases still need to be -translated, but the Norwegian text is ready for the first proof -reading. :) More spell checking is needed, and several illustrations -need to be cleaned up. The work stopped up because I had to give -priority to other projects the last year, and the progress graph of -the translation show this very well:</p> - -<p><img width="80%" align="center" src="https://github.com/petterreinholdtsen/free-culture-lessig/raw/master/progress.png"></p> - -<p>If you want to read the result, check out the -<a href="https://github.com/petterreinholdtsen/free-culture-lessig">github</a> -project pages and the -<a href="https://github.com/petterreinholdtsen/free-culture-lessig/blob/master/archive/freeculture.nb.pdf?raw=true">PDF</a>, -<a href="https://github.com/petterreinholdtsen/free-culture-lessig/blob/master/archive/freeculture.nb.epub?raw=true">EPUB</a> -and HTML version available in the -<a href="https://github.com/petterreinholdtsen/free-culture-lessig/tree/master/archive">archive -directory</a>.</p> - -<p>Please report typos, bugs and improvements to the github project if -you find any.</p> + Ruling ignored our objections to the seizure of popcorn-time.no (#domstolkontroll) + http://people.skolelinux.org/pere/blog/Ruling_ignored_our_objections_to_the_seizure_of_popcorn_time_no___domstolkontroll_.html + http://people.skolelinux.org/pere/blog/Ruling_ignored_our_objections_to_the_seizure_of_popcorn_time_no___domstolkontroll_.html + Mon, 13 Feb 2017 21:30:00 +0100 + <p>A few days ago, we received the ruling from +<a href="http://people.skolelinux.org/pere/blog/A_day_in_court_challenging_seizure_of_popcorn_time_no_for__domstolkontroll.html">my +day in court</a>. The case in question is a challenge of the seizure +of the DNS domain popcorn-time.no. The ruling simply did not mention +most of our arguments, and seemed to take everything ØKOKRIM said at +face value, ignoring our demonstration and explanations. But it is +hard to tell for sure, as we still have not seen most of the documents +in the case and thus were unprepared and unable to contradict several +of the claims made in court by the opposition. We are considering an +appeal, but it is partly a question of funding, as it is costing us +quite a bit to pay for our lawyer. If you want to help, please +<a href="http://www.nuug.no/dns-beslag-donasjon.shtml">donate to the +NUUG defense fund</a>.</p> + +<p>The details of the case, as far as we know it, is available in +Norwegian from +<a href="https://www.nuug.no/news/tags/dns-domenebeslag/">the NUUG +blog</a>. This also include +<a href="https://www.nuug.no/news/Avslag_etter_rettslig_h_ring_om_DNS_beslaget___vurderer_veien_videre.shtml">the +ruling itself</a>.</p> - From English wiki to translated PDF and epub via Docbook - http://people.skolelinux.org/pere/blog/From_English_wiki_to_translated_PDF_and_epub_via_Docbook.html - http://people.skolelinux.org/pere/blog/From_English_wiki_to_translated_PDF_and_epub_via_Docbook.html - Tue, 17 Jun 2014 11:30:00 +0200 - <p>The <a href="http://www.skolelinux.org/">Debian Edu / Skolelinux -project</a> provide an instruction manual for teachers, system -administrators and other users that contain useful tips for setting up -and maintaining a Debian Edu installation. This text is about how the -text processing of this manual is handled in the project.</p> - -<p>One goal of the project is to provide information in the native -language of its users, and for this we need to handle translations. -But we also want to make sure each language contain the same -information, so for this we need a good way to keep the translations -in sync. And we want it to be easy for our users to improve the -documentation, avoiding the need to learn special formats or tools to -contribute, and the obvious way to do this is to make it possible to -edit the documentation using a web browser. We also want it to be -easy for translators to keep the translation up to date, and give them -help in figuring out what need to be translated. Here is the list of -tools and the process we have found trying to reach all these -goals.</p> - -<p>We maintain the authoritative source of our manual in the -<a href="https://wiki.debian.org/DebianEdu/Documentation/Wheezy/">Debian -wiki</a>, as several wiki pages written in English. It consist of one -front page with references to the different chapters, several pages -for each chapter, and finally one "collection page" gluing all the -chapters together into one large web page (aka -<a href="https://wiki.debian.org/DebianEdu/Documentation/Wheezy/AllInOne">the -AllInOne page</a>). The AllInOne page is the one used for further -processing and translations. Thanks to the fact that the -<a href="http://moinmo.in/">MoinMoin</a> installation on -wiki.debian.org support exporting pages in -<a href="http://www.docbook.org/">the Docbook format</a>, we can fetch -the list of pages to export using the raw version of the AllInOne -page, loop over each of them to generate a Docbook XML version of the -manual. This process also download images and transform image -references to use the locally downloaded images. The generated -Docbook XML files are slightly broken, so some post-processing is done -using the <tt>documentation/scripts/get_manual</tt> program, and the -result is a nice Docbook XML file (debian-edu-wheezy-manual.xml) and -a handfull of images. The XML file can now be used to generate PDF, HTML -and epub versions of the English manual. This is the basic step of -our process, making PDF (using dblatex), HTML (using xsltproc) and -epub (using dbtoepub) version from Docbook XML, and the resulting files -are placed in the debian-edu-doc-en binary package.</p> - -<p>But English documentation is not enough for us. We want translated -documentation too, and we want to make it easy for translators to -track the English original. For this we use the -<a href="http://packages.qa.debian.org/p/poxml.html">poxml</a> package, -which allow us to transform the English Docbook XML file into a -translation file (a .pot file), usable with the normal gettext based -translation tools used by those translating free software. The pot -file is used to create and maintain translation files (several .po -files), which the translations update with the native language -translations of all titles, paragraphs and blocks of text in the -original. The next step is combining the original English Docbook XML -and the translation file (say debian-edu-wheezy-manual.nb.po), to -create a translated Docbook XML file (in this case -debian-edu-wheezy-manual.nb.xml). This translated (or partly -translated, if the translation is not complete) Docbook XML file can -then be used like the original to create a PDF, HTML and epub version -of the documentation.</p> - -<p>The translators use different tools to edit the .po files. We -recommend using -<a href="http://www.kde.org/applications/development/lokalize/">lokalize</a>, -while some use emacs and vi, others can use web based editors like -<a href="http://pootle.translatehouse.org/">Poodle</a> or -<a href="https://www.transifex.com/">Transifex</a>. All we care about -is where the .po file end up, in our git repository. Updated -translations can either be committed directly to git, or submitted as -<a href="https://bugs.debian.org/src:debian-edu-doc">bug reports -against the debian-edu-doc package</a>.</p> - -<p>One challenge is images, which both might need to be translated (if -they show translated user applications), and are needed in different -formats when creating PDF and HTML versions (epub is a HTML version in -this regard). For this we transform the original PNG images to the -needed density and format during build, and have a way to provide -translated images by storing translated versions in -images/$LANGUAGECODE/. I am a bit unsure about the details here. The -package maintainers know more.</p> - -<p>If you wonder what the result look like, we provide -<a href="http://maintainer.skolelinux.org/debian-edu-doc/">the content -of the documentation packages on the web</a>. See for example the -<a href="http://maintainer.skolelinux.org/debian-edu-doc/it/debian-edu-wheezy-manual.pdf">Italian -PDF version</a> or the -<a href="http://maintainer.skolelinux.org/debian-edu-doc/de/debian-edu-wheezy-manual.html">German -HTML version</a>. We do not yet build the epub version by default, -but perhaps it will be done in the future.</p> - -<p>To learn more, check out -<a href="http://packages.qa.debian.org/d/debian-edu-doc.html">the -debian-edu-doc package</a>, -<a href="https://wiki.debian.org/DebianEdu/Documentation/Wheezy/">the -manual on the wiki</a> and -<a href="https://wiki.debian.org/DebianEdu/Documentation/Wheezy/Translations">the -translation instructions</a> in the manual.</p> + A day in court challenging seizure of popcorn-time.no for #domstolkontroll + http://people.skolelinux.org/pere/blog/A_day_in_court_challenging_seizure_of_popcorn_time_no_for__domstolkontroll.html + http://people.skolelinux.org/pere/blog/A_day_in_court_challenging_seizure_of_popcorn_time_no_for__domstolkontroll.html + Fri, 3 Feb 2017 11:10:00 +0100 + <p align="center"><img width="70%" src="http://people.skolelinux.org/pere/blog/images/2017-02-01-popcorn-time-in-court.jpeg"></p> + +<p>On Wednesday, I spent the entire day in court in Follo Tingrett +representing <a href="https://www.nuug.no/">the member association +NUUG</a>, alongside <a href="https://www.efn.no/">the member +association EFN</a> and <a href="http://www.imc.no">the DNS registrar +IMC</a>, challenging the seizure of the DNS name popcorn-time.no. It +was interesting to sit in a court of law for the first time in my +life. Our team can be seen in the picture above: attorney Ola +Tellesbø, EFN board member Tom Fredrik Blenning, IMC CEO Morten Emil +Eriksen and NUUG board member Petter Reinholdtsen.</p> + +<p><a href="http://www.domstol.no/no/Enkelt-domstol/follo-tingrett/Nar-gar-rettssaken/Beramming/?cid=AAAA1701301512081262234UJFBVEZZZZZEJBAvtale">The +case at hand</a> is that the Norwegian National Authority for +Investigation and Prosecution of Economic and Environmental Crime (aka +Økokrim) decided on their own, to seize a DNS domain early last +year, without following +<a href="https://www.norid.no/no/regelverk/navnepolitikk/#link12">the +official policy of the Norwegian DNS authority</a> which require a +court decision. The web site in question was a site covering Popcorn +Time. And Popcorn Time is the name of a technology with both legal +and illegal applications. Popcorn Time is a client combining +searching a Bittorrent directory available on the Internet with +downloading/distribute content via Bittorrent and playing the +downloaded content on screen. It can be used illegally if it is used +to distribute content against the will of the right holder, but it can +also be used legally to play a lot of content, for example the +millions of movies +<a href="https://archive.org/details/movies">available from the +Internet Archive</a> or the collection +<a href="http://vodo.net/films/">available from Vodo</a>. We created +<a href="magnet:?xt=urn:btih:86c1802af5a667ca56d3918aecb7d3c0f7173084&dn=PresentasjonFolloTingrett.mov&tr=udp%3A%2F%2Fpublic.popcorn-tracker.org%3A6969%2Fannounce">a +video demonstrating legally use of Popcorn Time</a> and played it in +Court. It can of course be downloaded using Bittorrent.</p> + +<p>I did not quite know what to expect from a day in court. The +government held on to their version of the story and we held on to +ours, and I hope the judge is able to make sense of it all. We will +know in two weeks time. Unfortunately I do not have high hopes, as +the Government have the upper hand here with more knowledge about the +case, better training in handling criminal law and in general higher +standing in the courts than fairly unknown DNS registrar and member +associations. It is expensive to be right also in Norway. So far the +case have cost more than NOK 70 000,-. To help fund the case, NUUG +and EFN have asked for donations, and managed to collect around NOK 25 +000,- so far. Given the presentation from the Government, I expect +the government to appeal if the case go our way. And if the case do +not go our way, I hope we have enough funding to appeal.</p> + +<p>From the other side came two people from Økokrim. On the benches, +appearing to be part of the group from the government were two people +from the Simonsen Vogt Wiik lawyer office, and three others I am not +quite sure who was. Økokrim had proposed to present two witnesses +from The Motion Picture Association, but this was rejected because +they did not speak Norwegian and it was a bit late to bring in a +translator, but perhaps the two from MPA were present anyway. All +seven appeared to know each other. Good to see the case is take +seriously.</p> + +<p>If you, like me, believe the courts should be involved before a DNS +domain is hijacked by the government, or you believe the Popcorn Time +technology have a lot of useful and legal applications, I suggest you +too <a href="http://www.nuug.no/dns-beslag-donasjon.shtml">donate to +the NUUG defense fund</a>. Both Bitcoin and bank transfer are +available. If NUUG get more than we need for the legal action (very +unlikely), the rest will be spend promoting free software, open +standards and unix-like operating systems in Norway, so no matter what +happens the money will be put to good use.</p> + +<p>If you want to lean more about the case, I recommend you check out +<a href="https://www.nuug.no/news/tags/dns-domenebeslag/">the blog +posts from NUUG covering the case</a>. They cover the legal arguments +on both sides.</p> - Hvordan enkelt laste ned filmer fra NRK med den "nye" løsningen - http://people.skolelinux.org/pere/blog/Hvordan_enkelt_laste_ned_filmer_fra_NRK_med_den__nye__l_sningen.html - http://people.skolelinux.org/pere/blog/Hvordan_enkelt_laste_ned_filmer_fra_NRK_med_den__nye__l_sningen.html - Mon, 16 Jun 2014 19:20:00 +0200 - <p>Jeg har fortsatt behov for å kunne laste ned innslag fra NRKs -nettsted av og til for å se senere når jeg ikke er på nett, men -<a href="http://people.skolelinux.org/pere/blog/Hvordan_enkelt_laste_ned_filmer_fra_NRK.html">min -oppskrift fra 2011</a> sluttet å fungere da NRK byttet -avspillermetode. I dag fikk jeg endelig lett etter oppdatert løsning, -og jeg er veldig glad for å fortelle at den enkleste måten å laste ned -innslag er å bruke siste versjon 2014.06.07 av -<a href="http://rg3.github.io/youtube-dl/">youtube-dl</a>. Støtten i -youtube-dl <a href="https://github.com/rg3/youtube-dl/issues/2980">kom -inn for 23 dager siden</a> og -<a href="http://packages.qa.debian.org/y/youtube-dl.html">versjonen i -Debian</a> fungerer fint også som backport til Debian Wheezy. Det er -et lite problem, det håndterer kun URLer med små bokstaver, men hvis -en har en URL med store bokstaver kan en bare gjøre alle store om til -små bokstaver for å få youtube-dl til å laste ned. Rapporterte -nettopp -<a href="https://github.com/rg3/youtube-dl/issues/2980">problemet til -utviklerne</a>, og antar de får fikset det snart.</p> - -<p>Dermed er alt klart til å laste ned dokumentarene om -<a href="http://tv.nrk.no/program/KOID23005014/usas-hemmelige-avlytting">USAs -hemmelige avlytting</a> og -<a href="http://tv.nrk.no/program/KOID23005114/selskapene-bak-usas-avlytting">Selskapene -bak USAs avlytting</a>, i tillegg til -<a href="http://tv.nrk.no/program/KOID20005814/et-moete-med-edward-snowden">intervjuet -med Edward Snowden gjort av den tyske tv-kanalen ARD</a>. Anbefaler -alle å se disse, sammen med -<a href="http://media.ccc.de/browse/congress/2013/30C3_-_5713_-_en_-_saal_2_-_201312301130_-_to_protect_and_infect_part_2_-_jacob.html">foredraget -til Jacob Appelbaum på siste CCC-konferanse</a>, for å forstå mer om -hvordan overvåkningen av borgerne brer om seg.</p> - -<p>Takk til gode venner på foreningen NUUGs IRC-kanal -<a href="irc://irc.freenode.net/%23nuug">#nuug på irc.freenode.net</a> -for tipsene som fikk meg i mål</a>.</p> - -<p><strong>Oppdatering 2014-06-17</strong>: Etter at jeg publiserte -denne, ble jeg tipset om bloggposten -"<a href="http://ingvar.blog.redpill-linpro.com/2012/05/31/downloading-hd-content-from-tv-nrk-no/">Downloading -HD content from tv.nrk.no</a>" av Ingvar Hagelund, som har alternativ -implementasjon og tips for å lage mkv-fil med undertekstene inkludert. -Kanskje den passer bedre for deg? I tillegg ble feilen i youtube-dl -ble fikset litt senere ut på dagen i går, samt at youtube-dl fikk -støtte for å laste ned undertitler. Takk til Anders Einar Hilden for -god innsats og youtube-dl-utviklerne for rask respons.</p> + Nasjonalbiblioteket avslutter sin ulovlige bruk av Google Skjemaer + http://people.skolelinux.org/pere/blog/Nasjonalbiblioteket_avslutter_sin_ulovlige_bruk_av_Google_Skjemaer.html + http://people.skolelinux.org/pere/blog/Nasjonalbiblioteket_avslutter_sin_ulovlige_bruk_av_Google_Skjemaer.html + Thu, 12 Jan 2017 09:40:00 +0100 + <p>I dag fikk jeg en skikkelig gladmelding. Bakgrunnen er at før jul +arrangerte Nasjonalbiblioteket +<a href="http://www.nb.no/Bibliotekutvikling/Kunnskapsorganisering/Nasjonalt-verksregister/Seminar-om-verksregister">et +seminar om sitt knakende gode tiltak «verksregister»</a>. Eneste +måten å melde seg på dette seminaret var å sende personopplysninger +til Google via Google Skjemaer. Dette syntes jeg var tvilsom praksis, +da det bør være mulig å delta på seminarer arrangert av det offentlige +uten å måtte dele sine interesser, posisjon og andre +personopplysninger med Google. Jeg ba derfor om innsyn via +<a href="https://www.mimesbronn.no/">Mimes brønn</a> i +<a href="https://www.mimesbronn.no/request/personopplysninger_til_google_sk">avtaler +og vurderinger Nasjonalbiblioteket hadde rundt dette</a>. +Personopplysningsloven legger klare rammer for hva som må være på +plass før en kan be tredjeparter, spesielt i utlandet, behandle +personopplysninger på sine vegne, så det burde eksistere grundig +dokumentasjon før noe slikt kan bli lovlig. To jurister hos +Nasjonalbiblioteket mente først dette var helt i orden, og at Googles +standardavtale kunne brukes som databehandlingsavtale. Det syntes jeg +var merkelig, men har ikke hatt kapasitet til å følge opp saken før +for to dager siden.</p> + +<p>Gladnyheten i dag, som kom etter at jeg tipset Nasjonalbiblioteket +om at Datatilsynet underkjente Googles standardavtaler som +databehandleravtaler i 2011, er at Nasjonalbiblioteket har bestemt seg +for å avslutte bruken av Googles Skjemaer/Apps og gå i dialog med DIFI +for å finne bedre måter å håndtere påmeldinger i tråd med +personopplysningsloven. Det er fantastisk å se at av og til hjelper +det å spørre hva i alle dager det offentlige holder på med.</p> - Free software car computer solution? - http://people.skolelinux.org/pere/blog/Free_software_car_computer_solution_.html - http://people.skolelinux.org/pere/blog/Free_software_car_computer_solution_.html - Thu, 29 May 2014 18:45:00 +0200 - <p>Dear lazyweb. I'm planning to set up a small Raspberry Pi computer -in my car, connected to -<a href="http://www.dx.com/p/400a-4-0-tft-lcd-digital-monitor-for-vehicle-parking-reverse-camera-1440x272-12v-dc-57776">a -small screen</a> next to the rear mirror. I plan to hook it up with a -GPS and a USB wifi card too. The idea is to get my own -"<a href="http://en.wikipedia.org/wiki/Carputer">Carputer</a>". But I -wonder if someone already created a good free software solution for -such car computer.</p> - -<p>This is my current wish list for such system:</p> - -<ul> - - <li>Work on Raspberry Pi.</li> - - <li>Show current speed limit based on location, and warn if going too - fast (for example using color codes yellow and red on the screen, - or make a sound). This could be done either using either data from - <a href="http://www.openstreetmap.org/">Openstreetmap</a> or OCR - info gathered from a dashboard camera.</li> - - <li>Track automatic toll road passes and their cost, show total spent - and make it possible to calculate toll costs for planned - route.</li> - - <li>Collect GPX tracks for use with OpenStreetMap.</li> + Bryter NAV sin egen personvernerklæring? + http://people.skolelinux.org/pere/blog/Bryter_NAV_sin_egen_personvernerkl_ring_.html + http://people.skolelinux.org/pere/blog/Bryter_NAV_sin_egen_personvernerkl_ring_.html + Wed, 11 Jan 2017 06:50:00 +0100 + <p>Jeg leste med interesse en nyhetssak hos +<a href="http://www.digi.no/artikler/nav-avslorer-trygdemisbruk-ved-a-spore-ip-adresser/367394">digi.no</a> +og +<a href="https://www.nrk.no/buskerud/trygdesvindlere-avslores-av-utenlandske-ip-adresser-1.13313461">NRK</a> +om at det ikke bare er meg, men at også NAV bedriver geolokalisering +av IP-adresser, og at det gjøres analyse av IP-adressene til de som +sendes inn meldekort for å se om meldekortet sendes inn fra +utenlandske IP-adresser. Politiadvokat i Drammen, Hans Lyder Haare, +er sitert i NRK på at «De to er jo blant annet avslørt av +IP-adresser. At man ser at meldekortet kommer fra utlandet.»</p> + +<p>Jeg synes det er fint at det blir bedre kjent at IP-adresser +knyttes til enkeltpersoner og at innsamlet informasjon brukes til å +stedsbestemme personer også av aktører her i Norge. Jeg ser det som +nok et argument for å bruke +<a href="https://www.torproject.org/">Tor</a> så mye som mulig for å +gjøre gjøre IP-lokalisering vanskeligere, slik at en kan beskytte sin +privatsfære og unngå å dele sin fysiske plassering med +uvedkommede.</p> + +<P>Men det er en ting som bekymrer meg rundt denne nyheten. Jeg ble +tipset (takk #nuug) om +<a href="https://www.nav.no/no/NAV+og+samfunn/Kontakt+NAV/Teknisk+brukerstotte/Snarveier/personvernerkl%C3%A6ring-for-arbeids-og-velferdsetaten">NAVs +personvernerklæring</a>, som under punktet «Personvern og statistikk» +lyder:</p> - <li>Automatically detect and use any wireless connection to connect - to home server. Try IP over DNS - (<a href="http://dev.kryo.se/iodine/">iodine</a>) or ICMP - (<a href="http://code.gerade.org/hans/">Hans</a>) if direct - connection do not work.</li> +<p><blockquote> - <li>Set up mesh network to talk to other cars with the same system, - or some standard car mesh protocol.</li> +<p>«Når du besøker nav.no, etterlater du deg elektroniske spor. Sporene +dannes fordi din nettleser automatisk sender en rekke opplysninger til +NAVs tjener (server-maskin) hver gang du ber om å få vist en side. Det +er eksempelvis opplysninger om hvilken nettleser og -versjon du +bruker, og din internettadresse (ip-adresse). For hver side som vises, +lagres følgende opplysninger:</p> - <li>Warn when approaching speed cameras and speed camera ranges - (speed calculated between two cameras).</li> +<ul> +<li>hvilken side du ser på</li> +<li>dato og tid</li> +<li>hvilken nettleser du bruker</li> +<li>din ip-adresse</li> +</ul> - <li>Suport dashboard/front facing camera to discover speed limits and - run OCR to track registration number of passing cars.</li> +<p>Ingen av opplysningene vil bli brukt til å identifisere +enkeltpersoner. NAV bruker disse opplysningene til å generere en +samlet statistikk som blant annet viser hvilke sider som er mest +populære. Statistikken er et redskap til å forbedre våre +tjenester.»</p> -</ul> +</blockquote></p> -<p>If you know of any free software car computer system supporting -some or all of these features, please let me know.</p> +<p>Jeg klarer ikke helt å se hvordan analyse av de besøkendes +IP-adresser for å se hvem som sender inn meldekort via web fra en +IP-adresse i utlandet kan gjøres uten å komme i strid med påstanden om +at «ingen av opplysningene vil bli brukt til å identifisere +enkeltpersoner». Det virker dermed for meg som at NAV bryter sine +egen personvernerklæring, hvilket +<a href="http://people.skolelinux.org/pere/blog/Er_lover_brutt_n_r_personvernpolicy_ikke_stemmer_med_praksis_.html">Datatilsynet +fortalte meg i starten av desember antagelig er brudd på +personopplysningsloven</a>. + +<p>I tillegg er personvernerklæringen ganske misvisende i og med at +NAVs nettsider ikke bare forsyner NAV med personopplysninger, men i +tillegg ber brukernes nettleser kontakte fem andre nettjenere +(script.hotjar.com, static.hotjar.com, vars.hotjar.com, +www.google-analytics.com og www.googletagmanager.com), slik at +personopplysninger blir gjort tilgjengelig for selskapene Hotjar og +Google , og alle som kan lytte på trafikken på veien (som FRA, GCHQ og +NSA). Jeg klarer heller ikke se hvordan slikt spredning av +personopplysninger kan være i tråd med kravene i +personopplysningloven, eller i tråd med NAVs personvernerklæring.</p> + +<p>Kanskje NAV bør ta en nøye titt på sin personvernerklæring? Eller +kanskje Datatilsynet bør gjøre det?</p> + + + + + Where did that package go? &mdash; geolocated IP traceroute + http://people.skolelinux.org/pere/blog/Where_did_that_package_go___mdash__geolocated_IP_traceroute.html + http://people.skolelinux.org/pere/blog/Where_did_that_package_go___mdash__geolocated_IP_traceroute.html + Mon, 9 Jan 2017 12:20:00 +0100 + <p>Did you ever wonder where the web trafic really flow to reach the +web servers, and who own the network equipment it is flowing through? +It is possible to get a glimpse of this from using traceroute, but it +is hard to find all the details. Many years ago, I wrote a system to +map the Norwegian Internet (trying to figure out if our plans for a +network game service would get low enough latency, and who we needed +to talk to about setting up game servers close to the users. Back +then I used traceroute output from many locations (I asked my friends +to run a script and send me their traceroute output) to create the +graph and the map. The output from traceroute typically look like +this: + +<p><pre> +traceroute to www.stortinget.no (85.88.67.10), 30 hops max, 60 byte packets + 1 uio-gw10.uio.no (129.240.202.1) 0.447 ms 0.486 ms 0.621 ms + 2 uio-gw8.uio.no (129.240.24.229) 0.467 ms 0.578 ms 0.675 ms + 3 oslo-gw1.uninett.no (128.39.65.17) 0.385 ms 0.373 ms 0.358 ms + 4 te3-1-2.br1.fn3.as2116.net (193.156.90.3) 1.174 ms 1.172 ms 1.153 ms + 5 he16-1-1.cr1.san110.as2116.net (195.0.244.234) 2.627 ms he16-1-1.cr2.oslosda310.as2116.net (195.0.244.48) 3.172 ms he16-1-1.cr1.san110.as2116.net (195.0.244.234) 2.857 ms + 6 ae1.ar8.oslosda310.as2116.net (195.0.242.39) 0.662 ms 0.637 ms ae0.ar8.oslosda310.as2116.net (195.0.242.23) 0.622 ms + 7 89.191.10.146 (89.191.10.146) 0.931 ms 0.917 ms 0.955 ms + 8 * * * + 9 * * * +[...] +</pre></p> + +<p>This show the DNS names and IP addresses of (at least some of the) +network equipment involved in getting the data traffic from me to the +www.stortinget.no server, and how long it took in milliseconds for a +package to reach the equipment and return to me. Three packages are +sent, and some times the packages do not follow the same path. This +is shown for hop 5, where three different IP addresses replied to the +traceroute request.</p> + +<p>There are many ways to measure trace routes. Other good traceroute +implementations I use are traceroute (using ICMP packages) mtr (can do +both ICMP, UDP and TCP) and scapy (python library with ICMP, UDP, TCP +traceroute and a lot of other capabilities). All of them are easily +available in <a href="https://www.debian.org/">Debian</a>.</p> + +<p>This time around, I wanted to know the geographic location of +different route points, to visualize how visiting a web page spread +information about the visit to a lot of servers around the globe. The +background is that a web site today often will ask the browser to get +from many servers the parts (for example HTML, JSON, fonts, +JavaScript, CSS, video) required to display the content. This will +leak information about the visit to those controlling these servers +and anyone able to peek at the data traffic passing by (like your ISP, +the ISPs backbone provider, FRA, GCHQ, NSA and others).</p> + +<p>Lets pick an example, the Norwegian parliament web site +www.stortinget.no. It is read daily by all members of parliament and +their staff, as well as political journalists, activits and many other +citizens of Norway. A visit to the www.stortinget.no web site will +ask your browser to contact 8 other servers: ajax.googleapis.com, +insights.hotjar.com, script.hotjar.com, static.hotjar.com, +stats.g.doubleclick.net, www.google-analytics.com, +www.googletagmanager.com and www.netigate.se. I extracted this by +asking <a href="http://phantomjs.org/">PhantomJS</a> to visit the +Stortinget web page and tell me all the URLs PhantomJS downloaded to +render the page (in HAR format using +<a href="https://github.com/ariya/phantomjs/blob/master/examples/netsniff.js">their +netsniff example</a>. I am very grateful to Gorm for showing me how +to do this). My goal is to visualize network traces to all IP +addresses behind these DNS names, do show where visitors personal +information is spread when visiting the page.</p> + +<p align="center"><a href="www.stortinget.no-geoip.kml"><img +src="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-geoip-small.png" alt="map of combined traces for URLs used by www.stortinget.no using GeoIP"/></a></p> + +<p>When I had a look around for options, I could not find any good +free software tools to do this, and decided I needed my own traceroute +wrapper outputting KML based on locations looked up using GeoIP. KML +is easy to work with and easy to generate, and understood by several +of the GIS tools I have available. I got good help from by NUUG +colleague Anders Einar with this, and the result can be seen in +<a href="https://github.com/petterreinholdtsen/kmltraceroute">my +kmltraceroute git repository</a>. Unfortunately, the quality of the +free GeoIP databases I could find (and the for-pay databases my +friends had access to) is not up to the task. The IP addresses of +central Internet infrastructure would typically be placed near the +controlling companies main office, and not where the router is really +located, as you can see from <a href="www.stortinget.no-geoip.kml">the +KML file I created</a> using the GeoLite City dataset from MaxMind. + +<p align="center"><a href="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-scapy.svg"><img +src="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-scapy-small.png" alt="scapy traceroute graph for URLs used by www.stortinget.no"/></a></p> + +<p>I also had a look at the visual traceroute graph created by +<a href="http://www.secdev.org/projects/scapy/">the scrapy project</a>, +showing IP network ownership (aka AS owner) for the IP address in +question. +<a href="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-scapy.svg">The +graph display a lot of useful information about the traceroute in SVG +format</a>, and give a good indication on who control the network +equipment involved, but it do not include geolocation. This graph +make it possible to see the information is made available at least for +UNINETT, Catchcom, Stortinget, Nordunet, Google, Amazon, Telia, Level +3 Communications and NetDNA.</p> + +<p align="center"><a href="https://geotraceroute.com/index.php?node=4&host=www.stortinget.no"><img +src="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-geotraceroute-small.png" alt="example geotraceroute view for www.stortinget.no"/></a></p> + +<p>In the process, I came across the +<a href="https://geotraceroute.com/">web service GeoTraceroute</a> by +Salim Gasmi. Its methology of combining guesses based on DNS names, +various location databases and finally use latecy times to rule out +candidate locations seemed to do a very good job of guessing correct +geolocation. But it could only do one trace at the time, did not have +a sensor in Norway and did not make the geolocations easily available +for postprocessing. So I contacted the developer and asked if he +would be willing to share the code (he refused until he had time to +clean it up), but he was interested in providing the geolocations in a +machine readable format, and willing to set up a sensor in Norway. So +since yesterday, it is possible to run traces from Norway in this +service thanks to a sensor node set up by +<a href="https://www.nuug.no/">the NUUG assosiation</a>, and get the +trace in KML format for further processing.</p> + +<p align="center"><a href="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-geotraceroute-kml-join.kml"><img +src="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-geotraceroute-kml-join.png" alt="map of combined traces for URLs used by www.stortinget.no using geotraceroute"/></a></p> + +<p>Here we can see a lot of trafic passes Sweden on its way to +Denmark, Germany, Holland and Ireland. Plenty of places where the +Snowden confirmations verified the traffic is read by various actors +without your best interest as their top priority.</p> + +<p>Combining KML files is trivial using a text editor, so I could loop +over all the hosts behind the urls imported by www.stortinget.no and +ask for the KML file from GeoTraceroute, and create a combined KML +file with all the traces (unfortunately only one of the IP addresses +behind the DNS name is traced this time. To get them all, one would +have to request traces using IP number instead of DNS names from +GeoTraceroute). That might be the next step in this project.</p> + +<p>Armed with these tools, I find it a lot easier to figure out where +the IP traffic moves and who control the boxes involved in moving it. +And every time the link crosses for example the Swedish border, we can +be sure Swedish Signal Intelligence (FRA) is listening, as GCHQ do in +Britain and NSA in USA and cables around the globe. (Hm, what should +we tell them? :) Keep that in mind if you ever send anything +unencrypted over the Internet.</p> + +<p>PS: KML files are drawn using +<a href="http://ivanrublev.me/kml/">the KML viewer from Ivan +Rublev<a/>, as it was less cluttered than the local Linux application +Marble. There are heaps of other options too.</p> + +<p>As usual, if you use Bitcoin and want to show your support of my +activities, please send Bitcoin donations to my address +<b><a href="bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b&label=PetterReinholdtsenBlog">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b</a></b>.</p>