X-Git-Url: http://pere.pagekite.me/gitweb/homepage.git/blobdiff_plain/b4ef080250d688bdc4fbeaf55f50fc89c8c435f2..370ca01630bcc562f24d76ef1cdf4b95d77f9804:/blog/index.html diff --git a/blog/index.html b/blog/index.html index 4375cbd004..3e773a0c13 100644 --- a/blog/index.html +++ b/blog/index.html @@ -20,88 +20,37 @@
-
FreedomBox milestone - all packages now in Debian Sid
-
15th April 2014
-

The Freedombox -project is working on providing the software and hardware to make -it easy for non-technical people to host their data and communication -at home, and being able to communicate with their friends and family -encrypted and away from prying eyes. It is still going strong, and -today a major mile stone was reached.

- -

Today, the last of the packages currently used by the project to -created the system images were accepted into Debian Unstable. It was -the freedombox-setup package, which is used to configure the images -during build and on the first boot. Now all one need to get going is -the build code from the freedom-maker git repository and packages from -Debian. And once the freedombox-setup package enter testing, we can -build everything directly from Debian. :)

- -

Some key packages used by Freedombox are -freedombox-setup, -plinth, -pagekite, -tor, -privoxy, -owncloud and -dnsmasq. There -are plans to integrate more packages into the setup. User -documentation is maintained on the Debian wiki. Please -check out -the manual and help us improve it.

- -

To test for yourself and create boot images with the FreedomBox -setup, run this on a Debian machine using a user with sudo rights to -become root:

- -

-sudo apt-get install git vmdebootstrap mercurial python-docutils \
-  mktorrent extlinux virtualbox qemu-user-static binfmt-support \
-  u-boot-tools
-git clone http://anonscm.debian.org/git/freedombox/freedom-maker.git \
-  freedom-maker
-make -C freedom-maker dreamplug-image raspberry-image virtualbox-image
-

- -

Root access is needed to run debootstrap and mount loopback -devices. See the README in the freedom-maker git repo for more -details on the build. If you do not want all three images, trim the -make line. Note that the virtualbox-image target is not really -virtualbox specific. It create a x86 image usable in kvm, qemu, -vmware and any other x86 virtual machine environment. You might need -the version of vmdebootstrap in Jessie to get the build working, as it -include fixes for a race condition with kpartx.

- -

If you instead want to install using a Debian CD and the preseed -method, boot a Debian Wheezy ISO and use this boot argument to load -the preseed values:

- -

-url=http://www.reinholdtsen.name/freedombox/preseed-jessie.dat
-

- -

I have not tested it myself the last few weeks, so I do not know if -it still work.

- -

If you wonder how to help, one task you could look at is using -systemd as the boot system. It will become the default for Linux in -Jessie, so we need to make sure it is usable on the Freedombox. I did -a simple test a few weeks ago, and noticed dnsmasq failed to start -during boot when using systemd. I suspect there are other problems -too. :) To detect problems, there is a test suite included, which can -be run from the plinth web interface.

- -

Give it a go and let us know how it goes on the mailing list, and help -us get the new release published. :) Please join us on -IRC (#freedombox on -irc.debian.org) and -the -mailing list if you want to help make this vision come true.

+ +
25th September 2014
+

I use the lsdvd tool +to handle my fairly large DVD collection. It is a nice command line +tool to get details about a DVD, like title, tracks, track length, +etc, in XML, Perl or human readable format. But lsdvd have not seen +any new development since 2006 and had a few irritating bugs affecting +its use with some DVDs. Upstream seemed to be dead, and in January I +sent a small probe asking for a version control repository for the +project, without any reply. But I use it regularly and would like to +get an updated version +into Debian. So two weeks ago I tried harder to get in touch with +the project admin, and after getting a reply from him explaining that +he was no longer interested in the project, I asked if I could take +over. And yesterday, I became project admin.

+ +

I've been in touch with a Gentoo developer and the Debian +maintainer interested in joining forces to maintain the upstream +project, and I hope we can get a new release out fairly quickly, +collecting the patches spread around on the internet into on place. +I've added the relevant Debian patches to the freshly created git +repository, and expect the Gentoo patches to make it too. If you got +a DVD collection and care about command line tools, check out +the git source and join +the project mailing +list. :)

@@ -109,88 +58,263 @@ mailing list if you want to help make this vision come true.

- -
11th April 2014
-

For 12 år siden, skrev jeg et lite notat om -bruk av språkkoder -i Norge. Jeg ble nettopp minnet på dette da jeg fikk spørsmål om -notatet fortsatt var aktuelt, og tenkte det var greit å repetere hva -som fortsatt gjelder. Det jeg skrev da er fortsatt like aktuelt.

- -

Når en velger språk i programmer på unix, så velger en blant mange -språkkoder. For språk i Norge anbefales følgende språkkoder (anbefalt -locale i parantes):

- -

-
nb (nb_NO)
Bokmål i Norge
-
nn (nn_NO)
Nynorsk i Norge
-
se (se_NO)
Nordsamisk i Norge
-

- -

Alle programmer som bruker andre koder bør endres.

- -

Språkkoden bør brukes når .po-filer navngis og installeres. Dette -er ikke det samme som locale-koden. For Norsk Bokmål, så bør filene -være navngitt nb.po, mens locale (LANG) bør være nb_NO.

- -

Hvis vi ikke får standardisert de kodene i alle programmene med -norske oversettelser, så er det umulig å gi LANG-variablen ett innhold -som fungerer for alle programmer.

- -

Språkkodene er de offisielle kodene fra ISO 639, og bruken av dem i -forbindelse med POSIX localer er standardisert i RFC 3066 og ISO -15897. Denne anbefalingen er i tråd med de angitte standardene.

- -

Følgende koder er eller har vært i bruk som locale-verdier for -"norske" språk. Disse bør unngås, og erstattes når de oppdages:

- -

- - - - - - - - -
norwegian-> nb_NO
bokmål -> nb_NO
bokmal -> nb_NO
nynorsk -> nn_NO
no -> nb_NO
no_NO -> nb_NO
no_NY -> nn_NO
sme_NO -> se_NO

- -

Merk at når det gjelder de samiske språkene, at se_NO i praksis -henviser til nordsamisk i Norge, mens f.eks. smj_NO henviser til -lulesamisk. Dette notatet er dog ikke ment å gi råd rundt samiske -språkkoder, der gjør -Divvun-prosjektet en bedre -jobb.

- -

Referanser:

- -
    - -
  • RFC 3066 - Tags - for the Identification of Languages (Erstatter RFC 1766)
  • - -
  • ISO - 639 - Codes for the Representation of Names of Languages
  • - -
  • ISO - DTR 14652 - locale-standard Specification method for cultural - conventions
  • - -
  • ISO - 15897: Registration procedures for cultural elements (cultural - registry), - (nytt - draft)
  • - -
  • ISO/IEC - JTC1/SC22/WG20 - Gruppen for i18n-standardisering i ISO
  • - -
      + +
      21st September 2014
      +

      Rundt omkring i Oslo og Østlandsområdet henger det bokser over +veiene som jeg har lurt på hva gjør. De har ut fra plassering og +vinkling sett ut som bokser som sniffer ut et eller annet fra +forbipasserende trafikk, men det har vært uklart for meg hva det er de +leser av. Her om dagen tok jeg bilde av en slik boks som henger under +ei +skibru på Sollihøgda:

      + +

      + +

      Boksen er tydelig merket «Kapsch >>>», logoen til +det sveitsiske selskapet Kapsch som +blant annet lager sensorsystemer for veitrafikk. Men de lager mye +forskjellig, og jeg kjente ikke igjen boksen på utseendet etter en +kjapp titt på produktlista til selskapet.

      + +

      I og med at boksen henger over veien E16, en riksvei vedlikeholdt +av Statens Vegvesen, så antok jeg at det burde være mulig å bruke +REST-API-et som gir tilgang til vegvesenets database over veier, +skilter og annet veirelatert til å finne ut hva i alle dager dette +kunne være. De har både +en +datakatalog og +et +søk, der en kan søke etter ulike typer oppføringer innen for et +gitt geografisk område. Jeg laget et enkelt shell-script for å hente +ut antall av en gitt type innenfor området skibrua dekker, og listet +opp navnet på typene som ble funnet. Orket ikke slå opp hvordan +URL-koding av aktuelle strenger kunne gjøres mer generisk, og brukte +en stygg sed-linje i stedet.

      + +
      +#!/bin/sh
      +urlmap() {
      +    sed \
      +    -e 's/  / /g'   -e 's/{/%7B/g'  \
      +    -e 's/}/%7D/g'  -e 's/\[/%5B/g' \
      +    -e 's/\]/%5D/g' -e 's/ /%20/g'  \
      +    -e 's/,/%2C/g'  -e 's/\"/%22/g' \
      +    -e 's/:/%3A/g'
      +}
      +
      +lookup() {
      +    url="$1"
      +    curl -s -H 'Accept: application/vnd.vegvesen.nvdb-v1+xml' \
      +       "https://www.vegvesen.no/nvdb/api$url" | xmllint --format -
      +}
      +
      +for id in $(seq 1 874) ; do
      +    search="{
      +  lokasjon: {
      +    bbox: \"10.34425,59.96386,10.34458,59.96409\",
      +    srid: \"WGS84\"
      +  },
      +   objektTyper: [{
      +     id: $id, antall: 10
      +   }]
      +}"
      +
      +    query=/sok?kriterie=$(echo $search | urlmap)
      +    if lookup "$query" |
      +    grep -q '<totaltAntallReturnert>0<'
      +    then
      +    :
      +    else
      +    echo $id
      +    lookup "/datakatalog/objekttyper/$id" |grep '^  <navn>'
      +    fi
      +done
      +
      +exit 0
      +
      + +Aktuelt ID-område 1-874 var riktig i datakatalogen da jeg laget +scriptet. Det vil endre seg over tid. Skriptet listet så opp +aktuelle typer i og rundt skibrua: + +
      +5
      +  <navn>Rekkverk</navn>
      +14
      +  <navn>Rekkverksende</navn>
      +47
      +  <navn>Trafikklomme</navn>
      +49
      +  <navn>Trafikkøy</navn>
      +60
      +  <navn>Bru</navn>
      +79
      +  <navn>Stikkrenne/Kulvert</navn>
      +80
      +  <navn>Grøft, åpen</navn>
      +86
      +  <navn>Belysningsstrekning</navn>
      +95
      +  <navn>Skiltpunkt</navn>
      +96
      +  <navn>Skiltplate</navn>
      +98
      +  <navn>Referansestolpe</navn>
      +99
      +  <navn>Vegoppmerking, langsgående</navn>
      +105
      +  <navn>Fartsgrense</navn>
      +106
      +  <navn>Vinterdriftsstrategi</navn>
      +172
      +  <navn>Trafikkdeler</navn>
      +241
      +  <navn>Vegdekke</navn>
      +293
      +  <navn>Breddemåling</navn>
      +301
      +  <navn>Kantklippareal</navn>
      +318
      +  <navn>Snø-/isrydding</navn>
      +445
      +  <navn>Skred</navn>
      +446
      +  <navn>Dokumentasjon</navn>
      +452
      +  <navn>Undergang</navn>
      +528
      +  <navn>Tverrprofil</navn>
      +532
      +  <navn>Vegreferanse</navn>
      +534
      +  <navn>Region</navn>
      +535
      +  <navn>Fylke</navn>
      +536
      +  <navn>Kommune</navn>
      +538
      +  <navn>Gate</navn>
      +539
      +  <navn>Transportlenke</navn>
      +540
      +  <navn>Trafikkmengde</navn>
      +570
      +  <navn>Trafikkulykke</navn>
      +571
      +  <navn>Ulykkesinvolvert enhet</navn>
      +572
      +  <navn>Ulykkesinvolvert person</navn>
      +579
      +  <navn>Politidistrikt</navn>
      +583
      +  <navn>Vegbredde</navn>
      +591
      +  <navn>Høydebegrensning</navn>
      +592
      +  <navn>Nedbøyningsmåling</navn>
      +597
      +  <navn>Støy-luft, Strekningsdata</navn>
      +601
      +  <navn>Oppgravingsdata</navn>
      +602
      +  <navn>Oppgravingslag</navn>
      +603
      +  <navn>PMS-parsell</navn>
      +604
      +  <navn>Vegnormalstrekning</navn>
      +605
      +  <navn>Værrelatert strekning</navn>
      +616
      +  <navn>Feltstrekning</navn>
      +617
      +  <navn>Adressepunkt</navn>
      +626
      +  <navn>Friksjonsmåleserie</navn>
      +629
      +  <navn>Vegdekke, flatelapping</navn>
      +639
      +  <navn>Kurvatur, horisontalelement</navn>
      +640
      +  <navn>Kurvatur, vertikalelement</navn>
      +642
      +  <navn>Kurvatur, vertikalpunkt</navn>
      +643
      +  <navn>Statistikk, trafikkmengde</navn>
      +647
      +  <navn>Statistikk, vegbredde</navn>
      +774
      +  <navn>Nedbøyningsmåleserie</navn>
      +775
      +  <navn>ATK, influensstrekning</navn>
      +794
      +  <navn>Systemobjekt</navn>
      +810
      +  <navn>Vinterdriftsklasse</navn>
      +821
      +  <navn>Funksjonell vegklasse</navn>
      +825
      +  <navn>Kurvatur, stigning</navn>
      +838
      +  <navn>Vegbredde, beregnet</navn>
      +862
      +  <navn>Reisetidsregistreringspunkt</navn>
      +871
      +  <navn>Bruksklasse</navn>
      +
      + +

      Av disse ser ID 775 og 862 mest relevant ut. ID 775 antar jeg +refererer til fotoboksen som står like ved brua, mens +«Reisetidsregistreringspunkt» kanskje kan være boksen som henger der. +Hvordan finner jeg så ut hva dette kan være for noe. En titt på +datakatalogsiden +for ID 862/Reisetidsregistreringspunkt viser at det er finnes 53 +slike målere i Norge, og hvor de er plassert, men gir ellers få +detaljer. Det er plassert 40 på østlandet og 13 i Trondheimsregionen. +Men siden nevner «AutoPASS», og hvis en slår opp oppføringen på +Sollihøgda nevner den «Ciber AS» som ID for eksternt system. (Kan det +være snakk om +Ciber +Norge AS, et selskap eid av Ciber Europe Bv?) Et nettsøk på + «Ciber AS autopass» fører meg til en artikkel fra NRK Trøndelag i + 2013 med tittel +«Sjekk +dette hvis du vil unngå kø». Artikkelen henviser til vegvesenets +nettside +reisetider.no +som har en +kartside +for Østlandet som viser at det måles mellom Sandvika og Sollihøgda. +Det kan dermed se ut til at jeg har funnet ut hva boksene gjør.

      + +

      Hvis det stemmer, så er dette bokser som leser av AutoPASS-ID-en +til alle passerende biler med AutoPASS-brikke, og dermed gjør det mulig +for de som kontrollerer boksene å holde rede på hvor en gitt bil er +når den passerte et slikt målepunkt. NRK-artikkelen forteller at +denne informasjonen i dag kun brukes til å koble to +AutoPASS-brikkepasseringer passeringer sammen for å beregne +reisetiden, og at bruken er godkjent av Datatilsynet. Det er desverre +ikke mulig for en sjåfør som passerer under en slik boks å kontrollere +at AutoPASS-ID-en kun brukes til dette i dag og i fremtiden.

      + +

      I tillegg til denne type AutoPASS-sniffere vet jeg at det også +finnes mange automatiske stasjoner som tar betalt pr. passering (aka +bomstasjoner), og der lagres informasjon om tid, sted og bilnummer i +10 år. Finnes det andre slike sniffere plassert ut på veiene?

      + +

      Personlig har jeg valgt å ikke bruke AutoPASS-brikke, for å gjøre +det vanskeligere og mer kostbart for de som vil invadere privatsfæren +og holde rede på hvor bilen min beveger seg til enhver tid. Jeg håper +flere vil gjøre det samme, selv om det gir litt høyere private +utgifter (dyrere bompassering). Vern om privatsfæren koster i disse +dager.

      + +

      Takk til Jan Kristian Jensen i Statens Vegvesen for tips om +dokumentasjon på vegvesenets REST-API.

      - Tags: norsk. + Tags: kart, norsk, personvern, rfid, surveillance.
      @@ -198,282 +322,273 @@ jobb.

      - -
      9th April 2014
      -

      For a while now, I have been looking for a sensible offsite backup -solution for use at home. My requirements are simple, it must be -cheap and locally encrypted (in other words, I keep the encryption -keys, the storage provider do not have access to my private files). -One idea me and my friends had many years ago, before the cloud -storage providers showed up, was to use Google mail as storage, -writing a Linux block device storing blocks as emails in the mail -service provided by Google, and thus get heaps of free space. On top -of this one can add encryption, RAID and volume management to have -lots of (fairly slow, I admit that) cheap and encrypted storage. But -I never found time to implement such system. But the last few weeks I -have looked at a system called -S3QL, a locally -mounted network backed file system with the features I need.

      - -

      S3QL is a fuse file system with a local cache and cloud storage, -handling several different storage providers, any with Amazon S3, -Google Drive or OpenStack API. There are heaps of such storage -providers. S3QL can also use a local directory as storage, which -combined with sshfs allow for file storage on any ssh server. S3QL -include support for encryption, compression, de-duplication, snapshots -and immutable file systems, allowing me to mount the remote storage as -a local mount point, look at and use the files as if they were local, -while the content is stored in the cloud as well. This allow me to -have a backup that should survive fire. The file system can not be -shared between several machines at the same time, as only one can -mount it at the time, but any machine with the encryption key and -access to the storage service can mount it if it is unmounted.

      - -

      It is simple to use. I'm using it on Debian Wheezy, where the -package is included already. So to get started, run apt-get -install s3ql. Next, pick a storage provider. I ended up picking -Greenqloud, after reading their nice recipe on -how -to use S3QL with their Amazon S3 service, because I trust the laws -in Iceland more than those in USA when it come to keeping my personal -data safe and private, and thus would rather spend money on a company -in Iceland. Another nice recipe is available from the article -S3QL -Filesystem for HPC Storage by Jeff Layton in the HPC section of -Admin magazine. When the provider is picked, figure out how to get -the API key needed to connect to the storage API. With Greencloud, -the key did not show up until I had added payment details to my -account.

      - -

      Armed with the API access details, it is time to create the file -system. First, create a new bucket in the cloud. This bucket is the -file system storage area. I picked a bucket name reflecting the -machine that was going to store data there, but any name will do. -I'll refer to it as bucket-name below. In addition, one need -the API login and password, and a locally created password. Store it -all in ~root/.s3ql/authinfo2 like this: - -

      -[s3c]
      -storage-url: s3c://s.greenqloud.com:443/bucket-name
      -backend-login: API-login
      -backend-password: API-password
      -fs-passphrase: local-password
      -

      + +
      16th September 2014
      +

      The Debian installer could be +a lot quicker. When we install more than 2000 packages in +Skolelinux / Debian Edu using +tasksel in the installer, unpacking the binary packages take forever. +A part of the slow I/O issue was discussed in +bug #613428 about too +much file system sync-ing done by dpkg, which is the package +responsible for unpacking the binary packages. Other parts (like code +executed by postinst scripts) might also sync to disk during +installation. All this sync-ing to disk do not really make sense to +me. If the machine crash half-way through, I start over, I do not try +to salvage the half installed system. So the failure sync-ing is +supposed to protect against, hardware or system crash, is not really +relevant while the installer is running.

      + +

      A few days ago, I thought of a way to get rid of all the file +system sync()-ing in a fairly non-intrusive way, without the need to +change the code in several packages. The idea is not new, but I have +not heard anyone propose the approach using dpkg-divert before. It +depend on the small and clever package +eatmydata, which +uses LD_PRELOAD to replace the system functions for syncing data to +disk with functions doing nothing, thus allowing programs to live +dangerous while speeding up disk I/O significantly. Instead of +modifying the implementation of dpkg, apt and tasksel (which are the +packages responsible for selecting, fetching and installing packages), +it occurred to me that we could just divert the programs away, replace +them with a simple shell wrapper calling +"eatmydata $program $@", to get the same effect. +Two days ago I decided to test the idea, and wrapped up a simple +implementation for the Debian Edu udeb.

      + +

      The effect was stunning. In my first test it reduced the running +time of the pkgsel step (installing tasks) from 64 to less than 44 +minutes (20 minutes shaved off the installation) on an old Dell +Latitude D505 machine. I am not quite sure what the optimised time +would have been, as I messed up the testing a bit, causing the debconf +priority to get low enough for two questions to pop up during +installation. As soon as I saw the questions I moved the installation +along, but do not know how long the question were holding up the +installation. I did some more measurements using Debian Edu Jessie, +and got these results. The time measured is the time stamp in +/var/log/syslog between the "pkgsel: starting tasksel" and the +"pkgsel: finishing up" lines, if you want to do the same measurement +yourself. In Debian Edu, the tasksel dialog do not show up, and the +timing thus do not depend on how quickly the user handle the tasksel +dialog.

      -

      I create my local passphrase using pwget 50 or similar, -but any sensible way to create a fairly random password should do it. -Armed with these details, it is now time to run mkfs, entering the API -details and password to create it:

      - -

      -# mkdir -m 700 /var/lib/s3ql-cache
      -# mkfs.s3ql --cachedir /var/lib/s3ql-cache --authfile /root/.s3ql/authinfo2 \
      -  --ssl s3c://s.greenqloud.com:443/bucket-name
      -Enter backend login: 
      -Enter backend password: 
      -Before using S3QL, make sure to read the user's guide, especially
      -the 'Important Rules to Avoid Loosing Data' section.
      -Enter encryption password: 
      -Confirm encryption password: 
      -Generating random encryption key...
      -Creating metadata tables...
      -Dumping metadata...
      -..objects..
      -..blocks..
      -..inodes..
      -..inode_blocks..
      -..symlink_targets..
      -..names..
      -..contents..
      -..ext_attributes..
      -Compressing and uploading metadata...
      -Wrote 0.00 MB of compressed metadata.
      -# 

      - -

      The next step is mounting the file system to make the storage available. - -

      -# mount.s3ql --cachedir /var/lib/s3ql-cache --authfile /root/.s3ql/authinfo2 \
      -  --ssl --allow-root s3c://s.greenqloud.com:443/bucket-name /s3ql
      -Using 4 upload threads.
      -Downloading and decompressing metadata...
      -Reading metadata...
      -..objects..
      -..blocks..
      -..inodes..
      -..inode_blocks..
      -..symlink_targets..
      -..names..
      -..contents..
      -..ext_attributes..
      -Mounting filesystem...
      -# df -h /s3ql
      -Filesystem                              Size  Used Avail Use% Mounted on
      -s3c://s.greenqloud.com:443/bucket-name  1.0T     0  1.0T   0% /s3ql
      -#
      -

      +

      -

      The file system is now ready for use. I use rsync to store my -backups in it, and as the metadata used by rsync is downloaded at -mount time, no network traffic (and storage cost) is triggered by -running rsync. To unmount, one should not use the normal umount -command, as this will not flush the cache to the cloud storage, but -instead running the umount.s3ql command like this: +

      + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + -

      -# umount.s3ql /s3ql
      -# 
      -

      +
      Machine/setupOriginal taskselOptimised taskselReduction
      Latitude D505 Main+LTSP LXDE64 min (07:46-08:50)<44 min (11:27-12:11)>20 min 18%
      Latitude D505 Roaming LXDE57 min (08:48-09:45)34 min (07:43-08:17)23 min 40%
      Latitude D505 Minimal22 min (10:37-10:59)11 min (11:16-11:27)11 min 50%
      Thinkpad X200 Minimal6 min (08:19-08:25)4 min (08:04-08:08)2 min 33%
      Thinkpad X200 Roaming KDE19 min (09:21-09:40)15 min (10:25-10:40)4 min 21%

      -

      There is a fsck command available to check the file system and -correct any problems detected. This can be used if the local server -crashes while the file system is mounted, to reset the "already -mounted" flag. This is what it look like when processing a working -file system:

      +

      The test is done using a netinst ISO on a USB stick, so some of the +time is spent downloading packages. The connection to the Internet +was 100Mbit/s during testing, so downloading should not be a +significant factor in the measurement. Download typically took a few +seconds to a few minutes, depending on the amount of packages being +installed.

      + +

      The speedup is implemented by using two hooks in +Debian +Installer, the pre-pkgsel.d hook to set up the diverts, and the +finish-install.d hook to remove the divert at the end of the +installation. I picked the pre-pkgsel.d hook instead of the +post-base-installer.d hook because I test using an ISO without the +eatmydata package included, and the post-base-installer.d hook in +Debian Edu can only operate on packages included in the ISO. The +negative effect of this is that I am unable to activate this +optimization for the kernel installation step in d-i. If the code is +moved to the post-base-installer.d hook, the speedup would be larger +for the entire installation.

      + +

      I've implemented this in the +debian-edu-install +git repository, and plan to provide the optimization as part of the +Debian Edu installation. If you want to test this yourself, you can +create two files in the installer (or in an udeb). One shell script +need do go into /usr/lib/pre-pkgsel.d/, with content like this:

      -# fsck.s3ql --force --ssl s3c://s.greenqloud.com:443/bucket-name
      -Using cached metadata.
      -File system seems clean, checking anyway.
      -Checking DB integrity...
      -Creating temporary extra indices...
      -Checking lost+found...
      -Checking cached objects...
      -Checking names (refcounts)...
      -Checking contents (names)...
      -Checking contents (inodes)...
      -Checking contents (parent inodes)...
      -Checking objects (reference counts)...
      -Checking objects (backend)...
      -..processed 5000 objects so far..
      -..processed 10000 objects so far..
      -..processed 15000 objects so far..
      -Checking objects (sizes)...
      -Checking blocks (referenced objects)...
      -Checking blocks (refcounts)...
      -Checking inode-block mapping (blocks)...
      -Checking inode-block mapping (inodes)...
      -Checking inodes (refcounts)...
      -Checking inodes (sizes)...
      -Checking extended attributes (names)...
      -Checking extended attributes (inodes)...
      -Checking symlinks (inodes)...
      -Checking directory reachability...
      -Checking unix conventions...
      -Checking referential integrity...
      -Dropping temporary indices...
      -Backing up old metadata...
      -Dumping metadata...
      -..objects..
      -..blocks..
      -..inodes..
      -..inode_blocks..
      -..symlink_targets..
      -..names..
      -..contents..
      -..ext_attributes..
      -Compressing and uploading metadata...
      -Wrote 0.89 MB of compressed metadata.
      -# 
      +#!/bin/sh
      +set -e
      +. /usr/share/debconf/confmodule
      +info() {
      +    logger -t my-pkgsel "info: $*"
      +}
      +error() {
      +    logger -t my-pkgsel "error: $*"
      +}
      +override_install() {
      +    apt-install eatmydata || true
      +    if [ -x /target/usr/bin/eatmydata ] ; then
      +        for bin in dpkg apt-get aptitude tasksel ; do
      +            file=/usr/bin/$bin
      +            # Test that the file exist and have not been diverted already.
      +            if [ -f /target$file ] ; then
      +                info "diverting $file using eatmydata"
      +                printf "#!/bin/sh\neatmydata $bin.distrib \"\$@\"\n" \
      +                    > /target$file.edu
      +                chmod 755 /target$file.edu
      +                in-target dpkg-divert --package debian-edu-config \
      +                    --rename --quiet --add $file
      +                ln -sf ./$bin.edu /target$file
      +            else
      +                error "unable to divert $file, as it is missing."
      +            fi
      +        done
      +    else
      +        error "unable to find /usr/bin/eatmydata after installing the eatmydata pacage"
      +    fi
      +}
      +
      +override_install
       

      -

      Thanks to the cache, working on files that fit in the cache is very -quick, about the same speed as local file access. Uploading large -amount of data is to me limited by the bandwidth out of and into my -house. Uploading 685 MiB with a 100 MiB cache gave me 305 kiB/s, -which is very close to my upload speed, and downloading the same -Debian installation ISO gave me 610 kiB/s, close to my download speed. -Both were measured using dd. So for me, the bottleneck is my -network, not the file system code. I do not know what a good cache -size would be, but suspect that the cache should e larger than your -working set.

      - -

      I mentioned that only one machine can mount the file system at the -time. If another machine try, it is told that the file system is -busy:

      +

      To clean up, another shell script should go into +/usr/lib/finish-install.d/ with code like this:

      -# mount.s3ql --cachedir /var/lib/s3ql-cache --authfile /root/.s3ql/authinfo2 \
      -  --ssl --allow-root s3c://s.greenqloud.com:443/bucket-name /s3ql
      -Using 8 upload threads.
      -Backend reports that fs is still mounted elsewhere, aborting.
      -#
      +#! /bin/sh -e
      +. /usr/share/debconf/confmodule
      +error() {
      +    logger -t my-finish-install "error: $@"
      +}
      +remove_install_override() {
      +    for bin in dpkg apt-get aptitude tasksel ; do
      +        file=/usr/bin/$bin
      +        if [ -x /target$file.edu ] ; then
      +            rm /target$file
      +            in-target dpkg-divert --package debian-edu-config \
      +                --rename --quiet --remove $file
      +            rm /target$file.edu
      +        else
      +            error "Missing divert for $file."
      +        fi
      +    done
      +    sync # Flush file buffers before continuing
      +}
      +
      +remove_install_override
       

      -

      The file content is uploaded when the cache is full, while the -metadata is uploaded once every 24 hour by default. To ensure the -file system content is flushed to the cloud, one can either umount the -file system, or ask S3QL to flush the cache and metadata using -s3qlctrl: +

      In Debian Edu, I placed both code fragments in a separate script +edu-eatmydata-install and call it from the pre-pkgsel.d and +finish-install.d scripts.

      + +

      By now you might ask if this change should get into the normal +Debian installer too? I suspect it should, but am not sure the +current debian-installer coordinators find it useful enough. It also +depend on the side effects of the change. I'm not aware of any, but I +guess we will see if the change is safe after some more testing. +Perhaps there is some package in Debian depending on sync() and +fsync() having effect? Perhaps it should go into its own udeb, to +allow those of us wanting to enable it to do so without affecting +everyone.

      + +

      Update 2014-09-24: Since a few days ago, enabling this optimization +will break installation of all programs using gnutls because of +bug #702711. An updated +eatmydata package in Debian will solve it.

      +
      + +
      +
      + +
      + +
      10th September 2014
      +

      Yesterday, I had the pleasure of attending a talk with the +Norwegian Unix User Group about +the +OpenPGP keyserver pool sks-keyservers.net, and was very happy to +learn that there is a large set of publicly available key servers to +use when looking for peoples public key. So far I have used +subkeys.pgp.net, and some times wwwkeys.nl.pgp.net when the former +were misbehaving, but those days are ended. The servers I have used +up until yesterday have been slow and some times unavailable. I hope +those problems are gone now.

      + +

      Behind the round robin DNS entry of the +sks-keyservers.net service +there is a pool of more than 100 keyservers which are checked every +day to ensure they are well connected and up to date. It must be +better than what I have used so far. :)

      + +

      Yesterdays speaker told me that the service is the default +keyserver provided by the default configuration in GnuPG, but this do +not seem to be used in Debian. Perhaps it should?

      + +

      Anyway, I've updated my ~/.gnupg/options file to now include this +line:

      -# s3qlctrl upload-meta /s3ql
      -# s3qlctrl flushcache /s3ql
      -# 
      +keyserver pool.sks-keyservers.net
       

      -

      If you are curious about how much space your data uses in the -cloud, and how much compression and deduplication cut down on the -storage usage, you can use s3qlstat on the mounted file system to get -a report:

      +

      With GnuPG version 2 one can also locate the keyserver using SRV +entries in DNS. Just for fun, I did just that at work, so now every +user of GnuPG at the University of Oslo should find a OpenGPG +keyserver automatically should their need it:

      -# s3qlstat /s3ql
      -Directory entries:    9141
      -Inodes:               9143
      -Data blocks:          8851
      -Total data size:      22049.38 MB
      -After de-duplication: 21955.46 MB (99.57% of total)
      -After compression:    21877.28 MB (99.22% of total, 99.64% of de-duplicated)
      -Database size:        2.39 MB (uncompressed)
      -(some values do not take into account not-yet-uploaded dirty blocks in cache)
      -#
      +% host -t srv _pgpkey-http._tcp.uio.no
      +_pgpkey-http._tcp.uio.no has SRV record 0 100 11371 pool.sks-keyservers.net.
      +%
       

      -

      I mentioned earlier that there are several possible suppliers of -storage. I did not try to locate them all, but am aware of at least -Greenqloud, -Google Drive, -Amazon S3 web serivces, -Rackspace and -Crowncloud. The latter even -accept payment in Bitcoin. Pick one that suit your need. Some of -them provide several GiB of free storage, but the prize models are -quite different and you will have to figure out what suits you -best.

      - -

      While researching this blog post, I had a look at research papers -and posters discussing the S3QL file system. There are several, which -told me that the file system is getting a critical check by the -science community and increased my confidence in using it. One nice -poster is titled -"An -Innovative Parallel Cloud Storage System using OpenStack’s SwiftObject -Store and Transformative Parallel I/O Approach" by Hsing-Bung -Chen, Benjamin McClelland, David Sherrill, Alfred Torrez, Parks Fields -and Pamela Smith. Please have a look.

      - -

      Given my problems with different file systems earlier, I decided to -check out the mounted S3QL file system to see if it would be usable as -a home directory (in other word, that it provided POSIX semantics when -it come to locking and umask handling etc). Running -my -test code to check file system semantics, I was happy to discover that -no error was found. So the file system can be used for home -directories, if one chooses to do so.

      - -

      If you do not want a locally file system, and want something that -work without the Linux fuse file system, I would like to mention the -Tarsnap service, which also -provide locally encrypted backup using a command line client. It have -a nicer access control system, where one can split out read and write -access, allowing some systems to write to the backup and others to -only read from it.

      - -

      As usual, if you use Bitcoin and want to show your support of my -activities, please send Bitcoin donations to my address -15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b.

      +

      Now if only +the +HKP lookup protocol supported finding signature paths, I would be +very happy. It can look up a given key or search for a user ID, but I +normally do not want that, but to find a trust path from my key to +another key. Given a user ID or key ID, I would like to find (and +download) the keys representing a signature path from my key to the +key in question, to be able to get a trust path between the two keys. +This is as far as I can tell not possible today. Perhaps something +for a future version of the protocol?

      @@ -486,86 +601,116 @@ activities, please send Bitcoin donations to my address
      - -
      8th April 2014
      -

      I dag kom endelig avgjørelsen fra EU-domstolen om -datalagringsdirektivet, som ikke overraskende ble dømt ulovlig og i -strid med borgernes grunnleggende rettigheter. Hvis du lurer på hva -datalagringsdirektivet er for noe, så er det -en -flott dokumentar tilgjengelig hos NRK som jeg tidligere -har -anbefalt alle å se.

      - -

      Her er et liten knippe nyhetsoppslag om saken, og jeg regner med at -det kommer flere ut over dagen. Flere kan finnes -via -mylder.

      - -

      -

      - -

      Jeg synes det er veldig fint at nok en stemme slår fast at -totalitær overvåkning av befolkningen er uakseptabelt, men det er -fortsatt like viktig å beskytte privatsfæren som før, da de -teknologiske mulighetene fortsatt finnes og utnyttes, og jeg tror -innsats i prosjekter som -Freedombox og -Dugnadsnett er viktigere enn -noen gang.

      - -

      Update 2014-04-08 12:10: Kronerullingen for å -stoppe datalagringsdirektivet i Norge gjøres hos foreningen -Digitalt Personvern, -som har samlet inn 843 215,- så langt men trenger nok mye mer hvis - -ikke Høyre og Arbeiderpartiet bytter mening i saken. Det var -kun -partinene Høyre og Arbeiderpartiet som stemte for -Datalagringsdirektivet, og en av dem må bytte mening for at det skal -bli flertall mot i Stortinget. Se mer om saken -Holder -de ord.

      + +
      25th August 2014
      +

      Two years later, I am still not sure if it is legal here in Norway +to use or publish a video in H.264 or MPEG4 format edited by the +commercially licensed video editors, without limiting the use to +create "personal" or "non-commercial" videos or get a license +agreement with MPEG LA. If one +want to publish and broadcast video in a non-personal or commercial +setting, it might be that those tools can not be used, or that video +format can not be used, without breaking their copyright license. I +am not sure. +Back +then, I found that the copyright license terms for Adobe Premiere +and Apple Final Cut Pro both specified that one could not use the +program to produce anything else without a patent license from MPEG +LA. The issue is not limited to those two products, though. Other +much used products like those from Avid and Sorenson Media have terms +of use are similar to those from Adobe and Apple. The complicating +factor making me unsure if those terms have effect in Norway or not is +that the patents in question are not valid in Norway, but copyright +licenses are.

      + +

      These are the terms for Avid Artist Suite, according to their +published +end user +license +text (converted to lower case text for easier reading):

      + +

      +

      18.2. MPEG-4. MPEG-4 technology may be included with the +software. MPEG LA, L.L.C. requires this notice:

      + +

      This product is licensed under the MPEG-4 visual patent portfolio +license for the personal and non-commercial use of a consumer for (i) +encoding video in compliance with the MPEG-4 visual standard (“MPEG-4 +video”) and/or (ii) decoding MPEG-4 video that was encoded by a +consumer engaged in a personal and non-commercial activity and/or was +obtained from a video provider licensed by MPEG LA to provide MPEG-4 +video. No license is granted or shall be implied for any other +use. Additional information including that relating to promotional, +internal and commercial uses and licensing may be obtained from MPEG +LA, LLC. See http://www.mpegla.com. This product is licensed under +the MPEG-4 systems patent portfolio license for encoding in compliance +with the MPEG-4 systems standard, except that an additional license +and payment of royalties are necessary for encoding in connection with +(i) data stored or replicated in physical media which is paid for on a +title by title basis and/or (ii) data which is paid for on a title by +title basis and is transmitted to an end user for permanent storage +and/or use, such additional license may be obtained from MPEG LA, +LLC. See http://www.mpegla.com for additional details.

      + +

      18.3. H.264/AVC. H.264/AVC technology may be included with the +software. MPEG LA, L.L.C. requires this notice:

      + +

      This product is licensed under the AVC patent portfolio license for +the personal use of a consumer or other uses in which it does not +receive remuneration to (i) encode video in compliance with the AVC +standard (“AVC video”) and/or (ii) decode AVC video that was encoded +by a consumer engaged in a personal activity and/or was obtained from +a video provider licensed to provide AVC video. No license is granted +or shall be implied for any other use. Additional information may be +obtained from MPEG LA, L.L.C. See http://www.mpegla.com.

      +

      + +

      Note the requirement that the videos created can only be used for +personal or non-commercial purposes.

      + +

      The Sorenson Media software have +similar terms:

      + +

      + +

      With respect to a license from Sorenson pertaining to MPEG-4 Video +Decoders and/or Encoders: Any such product is licensed under the +MPEG-4 visual patent portfolio license for the personal and +non-commercial use of a consumer for (i) encoding video in compliance +with the MPEG-4 visual standard (“MPEG-4 video”) and/or (ii) decoding +MPEG-4 video that was encoded by a consumer engaged in a personal and +non-commercial activity and/or was obtained from a video provider +licensed by MPEG LA to provide MPEG-4 video. No license is granted or +shall be implied for any other use. Additional information including +that relating to promotional, internal and commercial uses and +licensing may be obtained from MPEG LA, LLC. See +http://www.mpegla.com.

      + +

      With respect to a license from Sorenson pertaining to MPEG-4 +Consumer Recorded Data Encoder, MPEG-4 Systems Internet Data Encoder, +MPEG-4 Mobile Data Encoder, and/or MPEG-4 Unique Use Encoder: Any such +product is licensed under the MPEG-4 systems patent portfolio license +for encoding in compliance with the MPEG-4 systems standard, except +that an additional license and payment of royalties are necessary for +encoding in connection with (i) data stored or replicated in physical +media which is paid for on a title by title basis and/or (ii) data +which is paid for on a title by title basis and is transmitted to an +end user for permanent storage and/or use. Such additional license may +be obtained from MPEG LA, LLC. See http://www.mpegla.com for +additional details.

      + +

      + +

      Some free software like +Handbrake and +FFMPEG uses GPL/LGPL licenses and do +not have any such terms included, so for those, there is no +requirement to limit the use to personal and non-commercial.

      @@ -573,62 +718,167 @@ de ord.

      - -
      1st April 2014
      -

      Microsoft have announced that Windows XP reaches its end of life -2014-04-08, in 7 days. But there are heaps of machines still running -Windows XP, and depending on Windows XP to run their applications, and -upgrading will be expensive, both when it comes to money and when it -comes to the amount of effort needed to migrate from Windows XP to a -new operating system. Some obvious options (buy new a Windows -machine, buy a MacOSX machine, install Linux on the existing machine) -are already well known and covered elsewhere. Most of them involve -leaving the user applications installed on Windows XP behind and -trying out replacements or updated versions. In this blog post I want -to mention one strange bird that allow people to keep the hardware and -the existing Windows XP applications and run them on a free software -operating system that is Windows XP compatible.

      - -

      ReactOS is a free software -operating system (GNU GPL licensed) working on providing a operating -system that is binary compatible with Windows, able to run windows -programs directly and to use Windows drivers for hardware directly. -The project goal is for Windows user to keep their existing machines, -drivers and software, and gain the advantages from user a operating -system without usage limitations caused by non-free licensing. It is -a Windows clone running directly on the hardware, so quite different -from the approach taken by the Wine -project, which make it possible to run Windows binaries on -Linux.

      - -

      The ReactOS project share code with the Wine project, so most -shared libraries available on Windows are already implemented already. -There is also a software manager like the one we are used to on Linux, -allowing the user to install free software applications with a simple -click directly from the Internet. Check out the -screen shots on the -project web site for an idea what it look like (it looks just like -Windows before metro).

      - -

      I do not use ReactOS myself, preferring Linux and Unix like -operating systems. I've tested it, and it work fine in a virt-manager -virtual machine. The browser, minesweeper, notepad etc is working -fine as far as I can tell. Unfortunately, my main test application -is the software included on a CD with the Lego Mindstorms NXT, which -seem to install just fine from CD but fail to leave any binaries on -the disk after the installation. So no luck with that test software. -No idea why, but hope someone else figure out and fix the problem. -I've tried the ReactOS Live ISO on a physical machine, and it seemed -to work just fine. If you like Windows and want to keep running your -old Windows binaries, check it out by -downloading the -installation CD, the live CD or the preinstalled virtual machine -image.

      + +
      3rd August 2014
      +

      Lenge siden jeg har hatt tid til å publisere lenker til skriverier +jeg har hatt glede og nytte av av å lese. Her er en liten norsk +lenkesamling.

      + +

        + +
      • Sjøslag +om fiskemilliardene (NRK Ytring 2014-03-03) - litt om hvordan de +norske felles matressurser røves fra felleskapet.
      • + +
      • Matkrisen +kan komme til Norge (Aftenposten 2014-4-01) - hvordan miljøendringene vil gjøre matproduksjonen i Norge mer sÃ¥rbar.
      • + +
      • Norge +trenger kornlager (NRK Ytring 2014-06-07) Chr. Anton Smedshaug +forteller litt om Norges sÃ¥rbare matsituasjon etter at Staten solgte +Norges kornlager.
      • + +
      • PST +vil overvÃ¥ke datatastaturer (NRK 2014-03-04) - PST ønsker retten +til Ã¥ bryte seg inn pÃ¥ private PC-er og legge inn spionprogrammer. +Hvilket nok vil gjøre Linux mer populært, men gjør at en i enda mindre +grad enn i dag kan stole pÃ¥ datamaskiner - neppe en god ide for +samfunnet totalt sett.
      • + +
      • «Ruter +fremstÃ¥r som et pøbelvelde» (OsloBy 2014-03-05) - et eksempel pÃ¥ +hvordan kollektivtransportselskapet i Oslo hÃ¥ndterer sine kunder.
      • + +
      • Clear +Channel nektet Ã¥ vise Greenpeace-reklame i Oslo (Dagbladet +2014-03-05) - forteller litt om hvordan hvilke budskap som nÃ¥r ut i +det offentlige rom kontrolleres i Norge.
      • + +
      • Svarte +ikke pÃ¥ kritikken (Dagbladet 2014-03-06) - innlegg fra Norsk +presseforbund der de nok en gang tar opp det forkastelige i at +politiet nÃ¥ har full tilgang til Ã¥ bedrive telefonkontroll av +advokater.
      • + +
      • «Putin +spiller poker, ikke sjakk. I sjakk har man regler.» (Aftenposten +2014-03-08) - sjakklegenden Kasparov forklarer litt om hvordan han ser +at Russlands politikk fungerer, blant annet i lys av started av +Ukraina-krisen.
      • + +
      • I +seng med fienden (Aftenposten 2014-03-10) - kronikk fra Eirik +H. Vinje om hvordan menn og kvinner settes opp mot hverandre i det +offentlige ordskiftet, kanskje pÃ¥ sviktende grunnlag.
      • + +
      • Fritt +frem for skulk (Aftenposten 2014-03-14) - skildring av hvordan +norske elever i dag ikke lenger har rimelig krav om oppmøte pÃ¥ +skolen.
      • + +
      • «Datalagringsdirektiv» +avslørte abort, sykdom og vÃ¥penkjøp (Aftenposten 2014-03-14) - om +hvordan forskere har dokumentert hvordan innsamling av metadata om +telefoni og Internett-bruk kan være svært avslørende.
      • + +
      • Konsentrasjonssvikt +pÃ¥ pensum (Dagbladet 2014-03-14) - Kommentar om hvordan (feil) +bruk IKT i skolen kan ødelegge mer enn det bidrar til læring.
      • + +
      • Reservasjonsrettsstaten +(blogg fra Doremus 2014-02-09) - morsom beskrivelse om hvordan +regjeringens forslag til reservasjonsrett for leger kan utvides til Ã¥ +gjelde alles samvittighet.
      • + +
      • Autoritær +gjøkunge (Aftenposten 2014-03-25) - Kronikk av Bjørn Stærk om +snurpenots-overvÃ¥kningen som varsleren Snowden dokumenterte.
      • + +
      • Leveransekrise +i Offentlig sektor – mener Mike Bracken, Executive Director of Digital +in the Cabinet Office (blogg fra Friprog-senteret 2014-03-26).
      • + +
      • Norge +mÃ¥ stanse avlyttingen (Dagbladet 2014-03-26) - leserinnlegg fra +Felix Horne der han ber om at Norge gjør en innsats for Ã¥ fÃ¥ slutt pÃ¥ +overvÃ¥kning av innbyggerne som gjøres i Norge av Etiopiske +myndigheter.
      • + +
      • Demokrati +er ingen naturlig styreform (Aftenposten 2014-04-01) - kronikk av +Stein Ringen om hvordan demokrati som styreform gÃ¥r tapt nÃ¥r +innbyggerne tar det for gitt.
      • + +
      • Ytringsansvar +ere Enhver tilladte! (NRK Ytring 2014-04-01) - innspill fra Trygve +Svensson og Helge Svare om at hver enkelt av oss har et ansvar for Ã¥ +ytre oss i den offentlige debatten.
      • + +
      • Jeg +er ingen god samfunnsborger (Aftenposten 2014-04-16), kronikk av +Simen Tveitereid om alternative mÃ¥ter Ã¥ motiveres i samfunnet, uten Ã¥ +hige etter mer penger og flere ting.
      • + +
      • DLD-dommen: +Avgjørelsen fÃ¥r umiddelbar virkning (Aftenposten 2014-04-10) - +kronikk av Høyres Michael Tetzschner, en partiutbryter i DLD-saken som +stemte nei til DLD i Stortinget i 2011.
      • + +
      • Datalagringsdirektivets +endelikt (blogg fra John Wessel-Aas 2014-04-11) - oppsummering +av hvordan direktivet ble funnet ugyldig i EU-domstolen.
      • + +
      • Kronikk: +Kapitulasjonspresidenten (VG 2014-04-22) - kronikk av Einar +Kr. Steffenak om hvordan Stortingspresidenten og regjeringen viser sin +prinsippløshet i møte med Kina.
      • + +
      • Innerst +inne er alle nordmenn (Aftenposten 2014-04-27) - kronikk fra Bjørn +Stærk om hvordan vi i Vesten i stor grad baserer oss pÃ¥ en fantasi om +at alle i verden bærer pÃ¥ en drøm om Ã¥ bli som oss.
      • + +
      • Det +italienske senatet gav seg selv 134 milliarder euro i sluttpakke +(Aftenposten 2014-06-19) - forsker Simen Gaure forteller hvordan +løgner og fantasi fra nettkilder i stor grad blir akseptert som +sannhet - antagelig ogsÃ¥ av deg og meg.
      • + +
      • Et +forsvar for brÃ¥kmakerne (Dagbladet 2014-05-30) - kronikk av Dag +Øystein Nome som beskriver hvordan dagens skole ikke fungerer sÃ¥ godt +for mange elever.
      • + +
      • Betalte +med slitt seddel - havnet i arresten (Osloby 2014-06-25)) - +dokumentasjon av Oslopolitiets angrep pÃ¥ vÃ¥r alles rett til Ã¥ ferdes +uten elektronisk sporing. Jeg bruker kontanter i sÃ¥ stor grad som +mulig da banken ikke har noe med hvor jeg er og hva jeg kjøper. Vi +som gjør dette risikerer som beskrevet overgrep som frihetsberøvelse +og registrering og lagring av fingeravtrykk og bilde i politiets +database over mistenkte.
      • + +
      • Fredsprisen +til Snowden (Aftenposten 2014-06-28) - leder som forklarer hvorfor +varsleren Snowden bør fÃ¥ fredsprisen.
      • + +
      • Strategi +for politistaten (Dagbladet 2014-08-01) - leder som advarer om +sterke krefter som bruker terrortrusselen til Ã¥ lirke Norge nærmere Ã¥ +bli en politistat.
      • + +
      • Vi +mÃ¥ tenke nytt om narkotika (NRK Ytring 2014-08-03) - Mark Lewis +forklarer hvorfor legalisering og offentlig kontroll av +narkotikamarkedet er mye bedre enn Ã¥ overlate det til kriminelle.
      • + + +

      @@ -636,87 +886,89 @@ image.

      - -
      30th March 2014
      -

      Debian Edu / Skolelinux -keep gaining new users. Some weeks ago, a person showed up on IRC, -#debian-edu, with a -wish to contribute, and I managed to get a interview with this great -contributor Roger Marsal to learn more about his background.

      + +
      31st July 2014
      +

      The complete and free “out of the box” software solution for +schools, Debian Edu / +Skolelinux, is used quite a lot in Germany, and one of the people +involved is Bernd Zeitzen, who show up on the project mailing lists +from time to time with interesting questions and tips on how to adjust +the setup. I managed to interview him this summer.

      Who are you, and how do you spend your days?

      -

      My name is Roger Marsal, I'm 27 years old (1986 generation) and I -live in Barcelona, Spain. I've got a strong business background and I -work as a patrimony manager and as a real estate agent. Additionally, -I've co-founded a British based tech company that is nowadays on the -last development phase of a new social networking concept.

      - -

      I'm a Linux enthusiast that started its journey with Ubuntu four years -ago and have recently switched to Debian seeking rock solid stability -and as a necessary step to gain expertise.

      - -

      In a nutshell, I spend my days working and learning as much as I -can to face both my job, entrepreneur project and feed my Linux -hunger.

      +

      My name is Bernd Zeitzen and I'm married with Hedda, a self +employed physiotherapist. My former profession is tool maker, but I +haven't worked for 30 years in this job. 30 years ago I started to +support my wife and become her officeworker and a few years later the +administrator for a small computer network, today based on Ubuntu +Server (Samba, OpenVPN). For her daily work she has to use Windows +Desktops because the software she needs to organize her business only +works with Windows . :-(

      + +

      In 1988 we started with one PC and DOS, then I learned to use +Windows 98, 2000, XP, …, 8, Ubuntu, MacOSX. Today we are running a +Linux server with 6 Windows clients and 10 persons (teacher of +children with special needs, speech therapist, occupational therapist, +psychologist and officeworkers) using our Samba shares via OpenVPN to +work with the documentations of our patients.

      How did you get in contact with the Skolelinux / Debian Edu project?

      -

      I discovered the LTSP advantages -with "Ubuntu 12.04 alternate install" and after a year of use I -started looking for an alternative. Even though I highly value and -respect the Ubuntu project, I thought it was necessary for me to -change to a more robust and stable alternative. As far as I was using -Debian on my personal laptop I thought it would be fine to install -Debian and configure an LTSP server myself. Surprised, I discovered -that the Debian project also supported a kind of Edubuntu equivalent, -and after having some pain I obtained a Debian Edu network up and -running. I just loved it.

      +

      Two years ago a friend of mine asked me, if I want to get a job in +his school (Gymnasium +Harsewinkel). They started with Skolelinux / Debian Edu and they +were looking for people to give support to the teachers using the +software and the network and teaching the pupils increasing their +computer skills in optional lessons. I'm spending 4-6 hours a week +with this job.

      What do you see as the advantages of Skolelinux / Debian Edu?

      -

      I found a main advantage in that, once you know "the tips and -tricks", a new installation just works out of the box. It's the most -complete alternative I've found to create an LTSP network. All the -other distributions seems to be made of plastic, Debian Edu seems to -be made of steel.

      +

      The independence.

      -

      What do you see as the disadvantages of Skolelinux / Debian -Edu?

      +

      First: Every person is allowed to use, share and develop the +software. Even if you are poor, you are allowed to use the software +included in Skolelinux/Debian Edu and all the other Free Software.

      -

      I found two main disadvantages.

      +

      Second: The software runs on old machines and this gives us the +possibility to recycle computers, weeded out from offices. The +servers and desktops are running for more than two years and they are +working reliable.

      -

      I'm not an expert but I've got notions and I had to spent a considerable -amount of time trying to bring up a standard network topology. I'm quite -stubborn and I just worked until I did but I'm sure many people with few -resources (not big schools, but academies for example) would have switched -or dropped.

      +

      We have two servers (one tjener and one terminal server), 45 +workstations in three classrooms and seven laptops as a mobile +solution for all classrooms. These machines are all booting from the +terminal server. In the moment we are installing 30 laptops as mobile +workstations. Then the pupils have the possibility to work with these +machines in their classrooms. Internet access is realized by a WLAN +router, connected to the schools network. This is all done without a +dedicated system administrator or a computer science teacher.

      -

      It's amazing how such a complex system like Debian Edu has achieved -this out-of-the-box state. Even though tweaking without breaking gets -more difficult, as more factors have to be considered. This can -discourage many people too.

      +

      What do you see as the disadvantages of Skolelinux / Debian +Edu?

      -

      Which free software do you use daily?

      +

      Teachers and pupils are Windows users. <Irony on> And Linux +isn't cool. It's software for freaks using the command line. <Irony +off> They don't realize the stability of the system.

      -

      I use Debian, Firefox, Okular, Inkscape, LibreOffice and -Virtualbox.

      +

      Which free software do you use daily?

      +

      Firefox, Thunderbird, LibreOffice, Ubuntu Server 12.04 (Samba, +Apache, MySQL, Joomla!, … and Skolelinux / Debian Edu)

      Which strategy do you believe is the right one to use to get schools to use free software?

      -

      I don't think there is a need for a particular strategy. The free -attribute in both "freedom" and "no price" meanings is what will -really bring free software to schools. In my experience I can think of -the "R" statistical language; a -few years a ago was an extremely nerd tool for university people. -Today it's being increasingly used to teach statistics at many -different level of studies. I believe free and open software will -increasingly gain popularity, but I'm sure schools will be one of the -first scenarios where this will happen.

      +

      In Germany we have the situation: every school is free to decide +which software they want to use. This decision is influenced by +teachers who learned to use Windows and MS Office. They buy a PC with +Windows preinstalled and an additional testing version of MS +Office. They don't know about the possibility to use Free Software +instead. Another problem are the publisher of school books. They +develop their software, added to the school books, for Windows.

      @@ -729,39 +981,39 @@ first scenarios where this will happen.

      - -
      26th March 2014
      -

      Foreningen NUUG melder i natt at -NRK nå har bestemt seg for -når -den norske dokumentarfilmen om datalagringsdirektivet skal -sendes (se IMDB -for detaljer om filmen) . Første visning blir på NRK2 mandag -2014-03-31 kl. 19:50, og deretter visninger onsdag 2014-04-02 -kl. 12:30, fredag 2014-04-04 kl. 19:40 og søndag 2014-04-06 kl. 15:10. -Jeg har sett dokumentaren, og jeg anbefaler enhver å se den selv. Som -oppvarming mens vi venter anbefaler jeg Bjørn Stærks kronikk i -Aftenposten fra i går, -Autoritær -gjøkunge, der han gir en grei skisse av hvor ille det står til med -retten til privatliv og beskyttelsen av demokrati i Norge og resten -verden, og helt riktig slår fast at det er vi i databransjen som -sitter med nøkkelen til å gjøre noe med dette. Jeg har involvert meg -i prosjektene dugnadsnett.no -og FreedomBox for å -forsøke å gjøre litt selv for å bedre situasjonen, men det er mye -hardt arbeid fra mange flere enn meg som gjenstår før vi kan sies å ha -gjenopprettet balansen.

      - -

      Jeg regner med at nettutgaven dukker opp på -NRKs -side om filmen om datalagringsdirektivet om fem dager. Hold et -øye med siden, og tips venner og slekt om at de også bør se den.

      + +
      23rd July 2014
      +

      This summer I finally had time to continue working on the Norwegian +docbook version of the 2004 book +Free Culture by Lawrence Lessig, +to get a Norwegian text explaining the problems with todays copyright +law. Yesterday, I finally completed translated the book text. There +are still some foot/end notes left to translate, the colophon page +need to be rewritten, and a few words and phrases still need to be +translated, but the Norwegian text is ready for the first proof +reading. :) More spell checking is needed, and several illustrations +need to be cleaned up. The work stopped up because I had to give +priority to other projects the last year, and the progress graph of +the translation show this very well:

      + +

      + +

      If you want to read the result, check out the +github +project pages and the +PDF, +EPUB +and HTML version available in the +archive +directory.

      + +

      Please report typos, bugs and improvements to the github project if +you find any.

      @@ -769,102 +1021,111 @@ side om filmen om datalagringsdirektivet om fem dager. Hold et
      - -
      25th March 2014
      -

      Did you ever need to store logs or other files in a way that would -allow it to be used as evidence in court, and needed a way to -demonstrate without reasonable doubt that the file had not been -changed since it was created? Or, did you ever need to document that -a given document was received at some point in time, like some -archived document or the answer to an exam, and not changed after it -was received? The problem in these settings is to remove the need to -trust yourself and your computers, while still being able to prove -that a file is the same as it was at some given time in the past.

      - -

      A solution to these problems is to have a trusted third party -"stamp" the document and verify that at some given time the document -looked a given way. Such -notarius service -have been around for thousands of years, and its digital equivalent is -called a -trusted -timestamping service. The Internet -Engineering Task Force standardised how such service could work a -few years ago as RFC -3161. The mechanism is simple. Create a hash of the file in -question, send it to a trusted third party which add a time stamp to -the hash and sign the result with its private key, and send back the -signed hash + timestamp. Both email, FTP and HTTP can be used to -request such signature, depending on what is provided by the service -used. Anyone with the document and the signature can then verify that -the document matches the signature by creating their own hash and -checking the signature using the trusted third party public key. -There are several commercial services around providing such -timestamping. A quick search for -"rfc 3161 -service" pointed me to at least -DigiStamp, -Quo -Vadis, -Global Sign -and Global -Trust Finder. The system work as long as the private key of the -trusted third party is not compromised.

      - -

      But as far as I can tell, there are very few public trusted -timestamp services available for everyone. I've been looking for one -for a while now. But yesterday I found one over at -Deutches -Forschungsnetz mentioned in -a -blog by David Müller. I then found -a -good recipe on how to use the service over at the University of -Greifswald.

      - -

      The OpenSSL library contain -both server and tools to use and set up your own signing service. See -the ts(1SSL), tsget(1SSL) manual pages for more details. The -following shell script demonstrate how to extract a signed timestamp -for any file on the disk in a Debian environment:

      - -

      -#!/bin/sh
      -set -e
      -url="http://zeitstempel.dfn.de"
      -caurl="https://pki.pca.dfn.de/global-services-ca/pub/cacert/chain.txt"
      -reqfile=$(mktemp -t tmp.XXXXXXXXXX.tsq)
      -resfile=$(mktemp -t tmp.XXXXXXXXXX.tsr)
      -cafile=chain.txt
      -if [ ! -f $cafile ] ; then
      -    wget -O $cafile "$caurl"
      -fi
      -openssl ts -query -data "$1" -cert | tee "$reqfile" \
      -    | /usr/lib/ssl/misc/tsget -h "$url" -o "$resfile"
      -openssl ts -reply -in "$resfile" -text 1>&2
      -openssl ts -verify -data "$1" -in "$resfile" -CAfile "$cafile" 1>&2
      -base64 < "$resfile"
      -rm "$reqfile" "$resfile"
      -

      - -

      The argument to the script is the file to timestamp, and the output -is a base64 encoded version of the signature to STDOUT and details -about the signature to STDERR. Note that due to -a bug -in the tsget script, you might need to modify the included script -and remove the last line. Or just write your own HTTP uploader using -curl. :) Now you too can prove and verify that files have not been -changed.

      - -

      But the Internet need more public trusted timestamp services. -Perhaps something for Uninett or -my work place the University of Oslo -to set up?

      + +
      17th June 2014
      +

      The Debian Edu / Skolelinux +project provide an instruction manual for teachers, system +administrators and other users that contain useful tips for setting up +and maintaining a Debian Edu installation. This text is about how the +text processing of this manual is handled in the project.

      + +

      One goal of the project is to provide information in the native +language of its users, and for this we need to handle translations. +But we also want to make sure each language contain the same +information, so for this we need a good way to keep the translations +in sync. And we want it to be easy for our users to improve the +documentation, avoiding the need to learn special formats or tools to +contribute, and the obvious way to do this is to make it possible to +edit the documentation using a web browser. We also want it to be +easy for translators to keep the translation up to date, and give them +help in figuring out what need to be translated. Here is the list of +tools and the process we have found trying to reach all these +goals.

      + +

      We maintain the authoritative source of our manual in the +Debian +wiki, as several wiki pages written in English. It consist of one +front page with references to the different chapters, several pages +for each chapter, and finally one "collection page" gluing all the +chapters together into one large web page (aka +the +AllInOne page). The AllInOne page is the one used for further +processing and translations. Thanks to the fact that the +MoinMoin installation on +wiki.debian.org support exporting pages in +the Docbook format, we can fetch +the list of pages to export using the raw version of the AllInOne +page, loop over each of them to generate a Docbook XML version of the +manual. This process also download images and transform image +references to use the locally downloaded images. The generated +Docbook XML files are slightly broken, so some post-processing is done +using the documentation/scripts/get_manual program, and the +result is a nice Docbook XML file (debian-edu-wheezy-manual.xml) and +a handfull of images. The XML file can now be used to generate PDF, HTML +and epub versions of the English manual. This is the basic step of +our process, making PDF (using dblatex), HTML (using xsltproc) and +epub (using dbtoepub) version from Docbook XML, and the resulting files +are placed in the debian-edu-doc-en binary package.

      + +

      But English documentation is not enough for us. We want translated +documentation too, and we want to make it easy for translators to +track the English original. For this we use the +poxml package, +which allow us to transform the English Docbook XML file into a +translation file (a .pot file), usable with the normal gettext based +translation tools used by those translating free software. The pot +file is used to create and maintain translation files (several .po +files), which the translations update with the native language +translations of all titles, paragraphs and blocks of text in the +original. The next step is combining the original English Docbook XML +and the translation file (say debian-edu-wheezy-manual.nb.po), to +create a translated Docbook XML file (in this case +debian-edu-wheezy-manual.nb.xml). This translated (or partly +translated, if the translation is not complete) Docbook XML file can +then be used like the original to create a PDF, HTML and epub version +of the documentation.

      + +

      The translators use different tools to edit the .po files. We +recommend using +lokalize, +while some use emacs and vi, others can use web based editors like +Poodle or +Transifex. All we care about +is where the .po file end up, in our git repository. Updated +translations can either be committed directly to git, or submitted as +bug reports +against the debian-edu-doc package.

      + +

      One challenge is images, which both might need to be translated (if +they show translated user applications), and are needed in different +formats when creating PDF and HTML versions (epub is a HTML version in +this regard). For this we transform the original PNG images to the +needed density and format during build, and have a way to provide +translated images by storing translated versions in +images/$LANGUAGECODE/. I am a bit unsure about the details here. The +package maintainers know more.

      + +

      If you wonder what the result look like, we provide +the content +of the documentation packages on the web. See for example the +Italian +PDF version or the +German +HTML version. We do not yet build the epub version by default, +but perhaps it will be done in the future.

      + +

      To learn more, check out +the +debian-edu-doc package, +the +manual on the wiki and +the +translation instructions in the manual.

      @@ -872,111 +1133,57 @@ to set up?

      - -
      21st March 2014
      -

      Keeping your DVD collection safe from scratches and curious -children fingers while still having it available when you want to see a -movie is not straight forward. My preferred method at the moment is -to store a full copy of the ISO on a hard drive, and use VLC, Popcorn -Hour or other useful players to view the resulting file. This way the -subtitles and bonus material are still available and using the ISO is -just like inserting the original DVD record in the DVD player.

      - -

      Earlier I used dd for taking security copies, but it do not handle -DVDs giving read errors (which are quite a few of them). I've also -tried using -dvdbackup -and genisoimage, but these days I use the marvellous python library -and program -python-dvdvideo -written by Bastian Blank. It is -in Debian -already and the binary package name is python3-dvdvideo. Instead -of trying to read every block from the DVD, it parses the file -structure and figure out which block on the DVD is actually in used, -and only read those blocks from the DVD. This work surprisingly well, -and I have been able to almost backup my entire DVD collection using -this method.

      - -

      So far, python-dvdvideo have failed on between 10 and -20 DVDs, which is a small fraction of my collection. The most common -problem is -DVDs -using UTF-16 instead of UTF-8 characters, which according to -Bastian is against the DVD specification (and seem to cause some -players to fail too). A rarer problem is what seem to be inconsistent -DVD structures, as the python library -claim -there is a overlap between objects. An equally rare problem claim -some -value is out of range. No idea what is going on there. I wish I -knew enough about the DVD format to fix these, to ensure my movie -collection will stay with me in the future.

      - -

      So, if you need to keep your DVDs safe, back them up using -python-dvdvideo. :)

      + +
      16th June 2014
      +

      Jeg har fortsatt behov for å kunne laste ned innslag fra NRKs +nettsted av og til for å se senere når jeg ikke er på nett, men +min +oppskrift fra 2011 sluttet å fungere da NRK byttet +avspillermetode. I dag fikk jeg endelig lett etter oppdatert løsning, +og jeg er veldig glad for å fortelle at den enkleste måten å laste ned +innslag er å bruke siste versjon 2014.06.07 av +youtube-dl. Støtten i +youtube-dl kom +inn for 23 dager siden og +versjonen i +Debian fungerer fint også som backport til Debian Wheezy. Det er +et lite problem, det håndterer kun URLer med små bokstaver, men hvis +en har en URL med store bokstaver kan en bare gjøre alle store om til +små bokstaver for å få youtube-dl til å laste ned. Rapporterte +nettopp +problemet til +utviklerne, og antar de får fikset det snart.

      + +

      Dermed er alt klart til å laste ned dokumentarene om +USAs +hemmelige avlytting og +Selskapene +bak USAs avlytting, i tillegg til +intervjuet +med Edward Snowden gjort av den tyske tv-kanalen ARD. Anbefaler +alle å se disse, sammen med +foredraget +til Jacob Appelbaum på siste CCC-konferanse, for å forstå mer om +hvordan overvåkningen av borgerne brer om seg.

      + +

      Takk til gode venner på foreningen NUUGs IRC-kanal +#nuug på irc.freenode.net +for tipsene som fikk meg i mål.

      + +

      Oppdatering 2014-06-17: Etter at jeg publiserte +denne, ble jeg tipset om bloggposten +"Downloading +HD content from tv.nrk.no" av Ingvar Hagelund, som har alternativ +implementasjon og tips for å lage mkv-fil med undertekstene inkludert. +Kanskje den passer bedre for deg? I tillegg ble feilen i youtube-dl +ble fikset litt senere ut på dagen i går, samt at youtube-dl fikk +støtte for å laste ned undertitler. Takk til Anders Einar Hilden for +god innsats og youtube-dl-utviklerne for rask respons.

      - Tags: english, multimedia, opphavsrett, video. - - -
      -
      -
      - -
      - -
      16th March 2014
      -

      Det offentlige Norge har mye kunnskap og informasjon. Men hvordan -kan en få tilgang til den på en enkel måte? Takket være et lite -knippe lover og tilhørende forskrifter, blant annet -offentlighetsloven, -miljøinformasjonsloven -og -forvaltningsloven -har en rett til å spørre det offentlige og få svar. Men det finnes -intet offentlig arkiv over hva andre har spurt om, og dermed risikerer en -å måtte forstyrre myndighetene gang på gang for å få tak i samme -informasjonen på nytt. Britiske -mySociety har laget tjenesten -WhatDoTheyKnow som gjør -noe med dette. I Storbritannia blir WhatdoTheyKnow brukt i -ca -15% av alle innsynsforespørsler mot sentraladministrasjonen. -Prosjektet heter Alaveteli, og -er takk i bruk en rekke steder etter at løsningen ble generalisert og -gjort mulig å oversette. Den hjelper borgerne med å be om innsyn, -rådgir ved purringer og klager og lar alle se hvilke henvendelser som -er sendt til det offentlige og hvilke svar som er kommet inn, i et -søkpart arkiv. Her i Norge holder vi i foreningen NUUG på å få opp en -norsk utgave av Alaveteli, og her trenger vi din hjelp med -oversettelsen.

      - -

      Så langt er 76 % av Alaveteli oversatt til norsk bokmål, men vi -skulle gjerne vært oppe i 100 % før lansering. Oversettelsen gjøres -på Transifex, -der enhver som registrerer seg og ber om tilgang til -bokmålsoversettelsen får bidra. Vi har satt opp en test av tjenesten -(som ikke sender epost til det offentlige, kun til oss som holder på å -sette opp tjenesten) på maskinen -alaveteli-dev.nuug.no, der -en kan se hvordan de oversatte meldingen blir seende ut på nettsiden. -Når tjenesten lanseres vil den hete -Mimes brønn, etter -visdomskilden som Odin måtte gi øyet sitt for å få drikke i. Den -nettsiden er er ennå ikke klar til bruk.

      - -

      Hvis noen vil oversette til nynorsk også, så skal vi finne ut -hvordan vi lager en flerspråklig tjeneste. Men i første omgang er -fokus på bokmålsoversettelsen, der vi selv har nok peiling til å ha -fått oversatt 76%, men trenger hjelp for å komme helt i mål. :)

      -
      -
      - - - Tags: norsk, nuug, offentlig innsyn. + Tags: multimedia, norsk, video, web.
      @@ -1000,7 +1207,17 @@ fått oversatt 76%, men trenger hjelp for å komme helt i mål. :)

    • March (8)
    • -
    • April (5)
    • +
    • April (7)
    • + +
    • May (1)
    • + +
    • June (2)
    • + +
    • July (2)
    • + +
    • August (2)
    • + +
    • September (4)
    @@ -1181,47 +1398,47 @@ fått oversatt 76%, men trenger hjelp for å komme helt i mål. :)

  • chrpath (2)
  • -
  • debian (97)
  • +
  • debian (102)
  • -
  • debian edu (146)
  • +
  • debian edu (149)
  • digistan (10)
  • dld (15)
  • -
  • docbook (10)
  • +
  • docbook (12)
  • drivstoffpriser (4)
  • -
  • english (244)
  • +
  • english (254)
  • fiksgatami (21)
  • fildeling (12)
  • -
  • freeculture (12)
  • +
  • freeculture (13)
  • freedombox (8)
  • frikanalen (11)
  • -
  • intervju (40)
  • +
  • intervju (41)
  • -
  • isenkram (7)
  • +
  • isenkram (9)
  • -
  • kart (18)
  • +
  • kart (19)
  • ldap (9)
  • -
  • lenker (7)
  • +
  • lenker (8)
  • ltsp (1)
  • mesh network (8)
  • -
  • multimedia (26)
  • +
  • multimedia (30)
  • -
  • norsk (245)
  • +
  • norsk (248)
  • nuug (162)
  • @@ -1229,9 +1446,9 @@ fÃ¥tt oversatt 76%, men trenger hjelp for Ã¥ komme helt i mÃ¥l. :)

  • open311 (2)
  • -
  • opphavsrett (46)
  • +
  • opphavsrett (48)
  • -
  • personvern (72)
  • +
  • personvern (75)
  • raid (1)
  • @@ -1239,7 +1456,7 @@ fÃ¥tt oversatt 76%, men trenger hjelp for Ã¥ komme helt i mÃ¥l. :)

  • reprap (11)
  • -
  • rfid (2)
  • +
  • rfid (3)
  • robot (9)
  • @@ -1249,29 +1466,29 @@ fÃ¥tt oversatt 76%, men trenger hjelp for Ã¥ komme helt i mÃ¥l. :)

  • scraperwiki (2)
  • -
  • sikkerhet (40)
  • +
  • sikkerhet (41)
  • sitesummary (4)
  • skepsis (4)
  • -
  • standard (44)
  • +
  • standard (45)
  • stavekontroll (3)
  • stortinget (9)
  • -
  • surveillance (25)
  • +
  • surveillance (26)
  • sysadmin (1)
  • valg (8)
  • -
  • video (40)
  • +
  • video (43)
  • vitenskap (4)
  • -
  • web (30)
  • +
  • web (33)