X-Git-Url: http://pere.pagekite.me/gitweb/homepage.git/blobdiff_plain/5387a7d9bb1e4c5a2bd14dd9eedb999a195879ce..53798080ccfe7c0d9ad356a83ded5b219b186c9b:/blog/index.rss?ds=sidebyside diff --git a/blog/index.rss b/blog/index.rss index 236141b245..0a657f587a 100644 --- a/blog/index.rss +++ b/blog/index.rss @@ -7,796 +7,664 @@ - Opphavsretts-status for «Empty Socks» fra 1927? - http://people.skolelinux.org/pere/blog/Opphavsretts_status_for__Empty_Socks__fra_1927_.html - http://people.skolelinux.org/pere/blog/Opphavsretts_status_for__Empty_Socks__fra_1927_.html - Fri, 12 Dec 2014 14:30:00 +0100 - <p>For noen dager siden -<a href="http://www.nb.no/Hva-skjer/Aktuelt/Nyheter/Tapt-filmskatt-fra-Disney-funnet-i-Nasjonalbiblioteket">annonserte -Nasjonalbiblioteket gladnyheten</a> om at de i sine arkiver hadde -funnet et nitratfilm-eksemplar av en 87 år gammel Disney-film ved navn -Empty Socks, en film som tidligere var antatt tapt og der det i følge -nyhetsmeldinger var kun ca. 25 sekunder bevart for ettertiden. -Nasjonalbiblioteket hadde 5 minutter og 30 sekunder av filmen i sitt -magasin. Dette er flott for bevaringen av verdens kulturarv. 5,5 -minutter mindre tapt enn vi trodde av får felles historie.</p> - -<p>Men hvordan kunne filmen gå tapt, når arkivlovene i USA krevde at -publiserte filmer på den tiden ble deponert i bibliotek? Forklaringen -har jeg fra Lawrence Lessig og boken Free Culture, som jeg holder på -<a href="https://github.com/petterreinholdtsen/free-culture-lessig">å -oversette til norsk</a>:</p> + Detecting NFS hangs on Linux without hanging yourself... + http://people.skolelinux.org/pere/blog/Detecting_NFS_hangs_on_Linux_without_hanging_yourself___.html + http://people.skolelinux.org/pere/blog/Detecting_NFS_hangs_on_Linux_without_hanging_yourself___.html + Thu, 9 Mar 2017 15:20:00 +0100 + <p>Over the years, administrating thousand of NFS mounting linux +computers at the time, I often needed a way to detect if the machine +was experiencing NFS hang. If you try to use <tt>df</tt> or look at a +file or directory affected by the hang, the process (and possibly the +shell) will hang too. So you want to be able to detect this without +risking the detection process getting stuck too. It has not been +obvious how to do this. When the hang has lasted a while, it is +possible to find messages like these in dmesg:</p> <p><blockquote> -<p>Dette er delvis på grunn av loven. Opphavsrettseiere var tidlig i - amerikansk opphavsrettslov nødt til å deponere kopier av sine verk i - biblioteker. Disse kopiene skulle både sikre spredning av kunnskap, - og sikre at det fantes en kopi av verket tilgjengelig når vernetiden - utløp, slik at andre kunne få tilgang til og kopiere verket.</p> - -<p>Disse reglene gjaldt også for filmer. Men i 1915 gjorde - kongressbiblioteket et unntak for film. Filmer kunne bli - opphavsrettsbeskyttet så lenge det ble gjort slik deponering. Men - filmskaperne fikk så lov til å låne tilbake de deponerte filmene - - så lenge de ville uten noe kostnad. Bare i 1915 var det mer enn 5475 - filmer deponert og “lånt tilbake”. Dermed var det ikke noe eksemplar - i noe bibliotek når vernetiden til filmen utløp. Eksemplaret - eksisterer - hvis den finnes i det hele tatt - i arkivbiblioteket - til filmselskapet.</p> +nfs: server nfsserver not responding, still trying +<br>nfs: server nfsserver OK </blockquote></p> + +<p>It is hard to know if the hang is still going on, and it is hard to +be sure looking in dmesg is going to work. If there are lots of other +messages in dmesg the lines might have rotated out of site before they +are noticed.</p> + +<p>While reading through the nfs client implementation in linux kernel +code, I came across some statistics that seem to give a way to detect +it. The om_timeouts sunrpc value in the kernel will increase every +time the above log entry is inserted into dmesg. And after digging a +bit further, I discovered that this value show up in +/proc/self/mountstats on Linux.</p> + +<p>The mountstats content seem to be shared between files using the +same file system context, so it is enough to check one of the +mountstats files to get the state of the mount point for the machine. +I assume this will not show lazy umounted NFS points, nor NFS mount +points in a different process context (ie with a different filesystem +view), but that does not worry me.</p> + +<p>The content for a NFS mount point look similar to this:</p> -<p>Nyheten gjorde meg nysgjerrig på om filmen kunne være falt i det -fri. En 87 år gammel film kunne jo tenkes å ha blitt en del av -allemannseiet, slik at vi alle kan bruke den til å bygge videre på vår -felles kultur uten å måtte be om tillatelse - slik Walt Disney gjorde -det i starten av sin karriere. Jeg spurte nasjonalbiblioteket, og de -sa nei. Hvordan kan det ha seg med en så gammel film? En kan finne -informasjon om den norske vernetiden på -<a href="https://lovdata.no/dokument/NL/lov/1961-05-12-2">Lovdata</a> -og </a>Wikipedia</A>. Her er et relevant <a -href="https://no.wikipedia.org/wiki/Opphavsrett#Vernetid">utsnitt fra -siden om opphavsrett i den norske Wikipedia</a>:</p> - -<p><blockquote> - Ifølge åndsverkloven §§ 40-41 utløper vernetiden for et åndsverk 70 - år etter utløpet av opphavspersonens dødsår. [...] For filmverk - gjelder særlige regler: Her kommer ikke alle mulige opphavspersoner - i betraktning, men kun hovedregissøren, manusforfatteren, - dialogforfatteren og komponisten av filmmusikken. Vernetiden - begynner å løpe etter utgangen av dødsåret til den lengstlevende av - disse. [...] Der opphavspersonen er ukjent, utløper opphavsretten 70 - år etter første kjente offentliggjørelse av verket. Det er kun de - økonomiske rettighetene som faller bort i det vernetiden er - utløpt. De ideelle rettighetene må fortsatt respekteres, noe som - blant annet innebærer at man plikter å navngi opphavspersonen ved - tilgjengeliggjøring. -</blockquote></p> - -<p><a href="http://www.disneyshorts.org/shorts.aspx?shortID=75">I følge -nettstedet X</a> er følgende personer gitt æren for denne -kortfilmen:</p> - -<dl> - -<dt>Regissør</dt> -<dd><a href="https://en.wikipedia.org/wiki/Walt_Disney">Walt Disney</a> (1901-12-05 – 1966-12-15) +70 år = 2037</dd> - -<dt>Animasjon -<dd><a href="https://en.wikipedia.org/wiki/Ub_Iwerks">Ub Iwerks</a> (1901-03-24 – 1971-07-07) +70 år = 2042 -<br><a href="https://en.wikipedia.org/wiki/Rollin_Hamilton">Rollin "Ham" Hamilton</a> (1898-10-28 - 1951-06-03) +70 år = 2022 -<br><a href="https://en.wikipedia.org/wiki/Harman_and_Ising">Hugh Harman</a> (1903-08-31 – 1982-11-25) +70 år = 2053</dd> - -<dt>Kamera -<dd>Mike Marcus (?-?)</dd> - -</dl> - -<p>Alle fødsels- og dødsdatoene er fra engelske Wikipedia. Det er -ikke oppgitt navn på manusforfatter, dialogforfatter og komponist, men -jeg mistenker at tegnerne vil få opphavsrettigheter på tegnefilmer her -i Norge, og tar derfor med disse. Kameramannen vil ikke få noen -rettigheter så vidt jeg forstår, og er derfor ignorert her.</p> - -<p>Slik jeg forstår den norske opphavsretten vil dermed dette -filmverket bli allemannseie (også kalt å falle i det fri) i 2053, 126 -år etter at det ble laget. Hvis kun regissørens rettigheter er -relevante, vil det skje i 2037, 110 år etter at det ble utgitt. Etter -det vil enhver kunne dele det med alle de har lyst til, fremføre det -offentlig eller klippe og lime i det for å lage sin egen film basert -på det - helt uten å måtte spørre noen om lov.</p> +<p><blockquote><pre> +[...] +device /dev/mapper/Debian-var mounted on /var with fstype ext3 +device nfsserver:/mnt/nfsserver/home0 mounted on /mnt/nfsserver/home0 with fstype nfs statvers=1.1 + opts: rw,vers=3,rsize=65536,wsize=65536,namlen=255,acregmin=3,acregmax=60,acdirmin=30,acdirmax=60,soft,nolock,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=129.240.3.145,mountvers=3,mountport=4048,mountproto=udp,local_lock=all + age: 7863311 + caps: caps=0x3fe7,wtmult=4096,dtsize=8192,bsize=0,namlen=255 + sec: flavor=1,pseudoflavor=1 + events: 61063112 732346265 1028140 35486205 16220064 8162542 761447191 71714012 37189 3891185 45561809 110486139 4850138 420353 15449177 296502 52736725 13523379 0 52182 9016896 1231 0 0 0 0 0 + bytes: 166253035039 219519120027 0 0 40783504807 185466229638 11677877 45561809 + RPC iostats version: 1.0 p/v: 100003/3 (nfs) + xprt: tcp 925 1 6810 0 0 111505412 111480497 109 2672418560317 0 248 53869103 22481820 + per-op statistics + NULL: 0 0 0 0 0 0 0 0 + GETATTR: 61063106 61063108 0 9621383060 6839064400 453650 77291321 78926132 + SETATTR: 463469 463470 0 92005440 66739536 63787 603235 687943 + LOOKUP: 17021657 17021657 0 3354097764 4013442928 57216 35125459 35566511 + ACCESS: 14281703 14290009 5 2318400592 1713803640 1709282 4865144 7130140 + READLINK: 125 125 0 20472 18620 0 1112 1118 + READ: 4214236 4214237 0 715608524 41328653212 89884 22622768 22806693 + WRITE: 8479010 8494376 22 187695798568 1356087148 178264904 51506907 231671771 + CREATE: 171708 171708 0 38084748 46702272 873 1041833 1050398 + MKDIR: 3680 3680 0 773980 993920 26 23990 24245 + SYMLINK: 903 903 0 233428 245488 6 5865 5917 + MKNOD: 80 80 0 20148 21760 0 299 304 + REMOVE: 429921 429921 0 79796004 61908192 3313 2710416 2741636 + RMDIR: 3367 3367 0 645112 484848 22 5782 6002 + RENAME: 466201 466201 0 130026184 121212260 7075 5935207 5961288 + LINK: 289155 289155 0 72775556 67083960 2199 2565060 2585579 + READDIR: 2933237 2933237 0 516506204 13973833412 10385 3190199 3297917 + READDIRPLUS: 1652839 1652839 0 298640972 6895997744 84735 14307895 14448937 + FSSTAT: 6144 6144 0 1010516 1032192 51 9654 10022 + FSINFO: 2 2 0 232 328 0 1 1 + PATHCONF: 1 1 0 116 140 0 0 0 + COMMIT: 0 0 0 0 0 0 0 0 + +device binfmt_misc mounted on /proc/sys/fs/binfmt_misc with fstype binfmt_misc +[...] +</pre></blockquote></p> -<p>Måtte så Nasjonalbiblioteket spørre om lov før de kunne kopiere -sitt nitrat-eksemplar over på mer varig format? Nei, heldigvis. -Åndsverklovens § 16 sier at arkiv, bibliotek, museer og undervisnings- -og forskningsinstitusjoner har rett til å fremstille eksemplar av verk -for konserverings- og sikringsformål og andre særskilte formål.</p> +<p>The key number to look at is the third number in the per-op list. +It is the number of NFS timeouts experiences per file system +operation. Here 22 write timeouts and 5 access timeouts. If these +numbers are increasing, I believe the machine is experiencing NFS +hang. Unfortunately the timeout value do not start to increase right +away. The NFS operations need to time out first, and this can take a +while. The exact timeout value depend on the setup. For example the +defaults for TCP and UDP mount points are quite different, and the +timeout value is affected by the soft, hard, timeo and retrans NFS +mount options.</p> + +<p>The only way I have been able to get working on Debian and RedHat +Enterprise Linux for getting the timeout count is to peek in /proc/. +But according to +<ahref="http://docs.oracle.com/cd/E19253-01/816-4555/netmonitor-12/index.html">Solaris +10 System Administration Guide: Network Services</a>, the 'nfsstat -c' +command can be used to get these timeout values. But this do not work +on Linux, as far as I can tell. I +<ahref="http://bugs.debian.org/857043">asked Debian about this</a>, +but have not seen any replies yet.</p> + +<p>Is there a better way to figure out if a Linux NFS client is +experiencing NFS hangs? Is there a way to detect which processes are +affected? Is there a way to get the NFS mount going quickly once the +network problem causing the NFS hang has been cleared? I would very +much welcome some clues, as we regularly run into NFS hangs.</p> - How to stay with sysvinit in Debian Jessie - http://people.skolelinux.org/pere/blog/How_to_stay_with_sysvinit_in_Debian_Jessie.html - http://people.skolelinux.org/pere/blog/How_to_stay_with_sysvinit_in_Debian_Jessie.html - Sat, 22 Nov 2014 01:00:00 +0100 - <p>By now, it is well known that Debian Jessie will not be using -sysvinit as its boot system by default. But how can one keep using -sysvinit in Jessie? It is fairly easy, and here are a few recipes, -courtesy of -<a href="http://www.vitavonni.de/blog/201410/2014102101-avoiding-systemd.html">Erich -Schubert</a> and -<a href="http://smcv.pseudorandom.co.uk/2014/still_universal/">Simon -McVittie</a>. - -<p>If you already are using Wheezy and want to upgrade to Jessie and -keep sysvinit as your boot system, create a file -<tt>/etc/apt/preferences.d/use-sysvinit</tt> with this content before -you upgrade:</p> - -<p><blockquote><pre> -Package: systemd-sysv -Pin: release o=Debian -Pin-Priority: -1 -</pre></blockquote><p> - -<p>This file content will tell apt and aptitude to not consider -installing systemd-sysv as part of any installation and upgrade -solution when resolving dependencies, and thus tell it to avoid -systemd as a default boot system. The end result should be that the -upgraded system keep using sysvinit.</p> - -<p>If you are installing Jessie for the first time, there is no way to -get sysvinit installed by default (debootstrap used by -debian-installer have no option for this), but one can tell the -installer to switch to sysvinit before the first boot. Either by -using a kernel argument to the installer, or by adding a line to the -preseed file used. First, the kernel command line argument: - -<p><blockquote><pre> -preseed/late_command="in-target apt-get install --purge -y sysvinit-core" -</pre></blockquote><p> - -<p>Next, the line to use in a preseed file:</p> - -<p><blockquote><pre> -d-i preseed/late_command string in-target apt-get install -y sysvinit-core -</pre></blockquote><p> - -<p>One can of course also do this after the first boot by installing -the sysvinit-core package.</p> - -<p>I recommend only using sysvinit if you really need it, as the -sysvinit boot sequence in Debian have several hardware specific bugs -on Linux caused by the fact that it is unpredictable when hardware -devices show up during boot. But on the other hand, the new default -boot system still have a few rough edges I hope will be fixed before -Jessie is released.</p> - -<p>Update 2014-11-26: Inspired by -<ahref="https://www.mirbsd.org/permalinks/wlog-10-tg_e20141125-tg.htm#e20141125-tg_wlog-10-tg">a -blog post by Torsten Glaser</a>, added --purge to the preseed -line.</p> + How does it feel to be wiretapped, when you should be doing the wiretapping... + http://people.skolelinux.org/pere/blog/How_does_it_feel_to_be_wiretapped__when_you_should_be_doing_the_wiretapping___.html + http://people.skolelinux.org/pere/blog/How_does_it_feel_to_be_wiretapped__when_you_should_be_doing_the_wiretapping___.html + Wed, 8 Mar 2017 11:50:00 +0100 + <p>So the new president in the United States of America claim to be +surprised to discover that he was wiretapped during the election +before he was elected president. He even claim this must be illegal. +Well, doh, if it is one thing the confirmations from Snowden +documented, it is that the entire population in USA is wiretapped, one +way or another. Of course the president candidates were wiretapped, +alongside the senators, judges and the rest of the people in USA.</p> + +<p>Next, the Federal Bureau of Investigation ask the Department of +Justice to go public rejecting the claims that Donald Trump was +wiretapped illegally. I fail to see the relevance, given that I am +sure the surveillance industry in USA believe they have all the legal +backing they need to conduct mass surveillance on the entire +world.</p> + +<p>There is even the director of the FBI stating that he never saw an +order requesting wiretapping of Donald Trump. That is not very +surprising, given how the FISA court work, with all its activity being +secret. Perhaps he only heard about it?</p> + +<p>What I find most sad in this story is how Norwegian journalists +present it. In a news reports the other day in the radio from the +Norwegian National broadcasting Company (NRK), I heard the journalist +claim that 'the FBI denies any wiretapping', while the reality is that +'the FBI denies any illegal wiretapping'. There is a fundamental and +important difference, and it make me sad that the journalists are +unable to grasp it.</p> + +<p><strong>Update 2017-03-13:</strong> Look like +<a href="https://theintercept.com/2017/03/13/rand-paul-is-right-nsa-routinely-monitors-americans-communications-without-warrants/">The +Intercept report that US Senator Rand Paul confirm what I state above</a>.</p> - Hvordan vurderer regjeringen H.264-patentutfordringen? - http://people.skolelinux.org/pere/blog/Hvordan_vurderer_regjeringen_H_264_patentutfordringen_.html - http://people.skolelinux.org/pere/blog/Hvordan_vurderer_regjeringen_H_264_patentutfordringen_.html - Sun, 16 Nov 2014 10:30:00 +0100 - <p>For en stund tilbake spurte jeg Fornyingsdepartementet om hvilke -juridiske vurderinger rundt patentproblemstillingen som var gjort da -H.264 ble tatt inn i <a href="http://standard.difi.no/">statens -referansekatalog over standarder</a>. Stig Hornnes i FAD tipset meg -om følgende som står i oppsumeringen til høringen om -referansekatalogen versjon 2.0, som jeg siden ved hjelp av en -innsynsforespørsel fikk tak i -<a href="http://wiki.nuug.no/uttalelser/200901-standardkatalog-v2?action=AttachFile&do=get&target=kongelig-resolusjon.pdf">PDF-utgaven av</a> -datert 2009-06-03 (saksnummer 200803291, saksbehandler Henrik -Linnestad).</p> - -<p>Der står det følgende om problemstillingen:</p> - -<p><blockquote> -<strong>4.4 Patentproblematikk</strong> - -<p>NUUG og Opera ser det som særlig viktig at forslagene knyttet til -lyd og video baserer seg på de royalty-frie standardene Vorbis, Theora -og FLAC.</p> - -<p>Kommentarene relaterer seg til at enkelte standarder er åpne, men -inneholder tekniske prosedyrer som det i USA (og noen andre land som -Japan) er gitt patentrettigheter til. I vårt tilfelle berører dette -spesielt standardene Mp3 og H.264, selv om Politidirektoratet peker på -at det muligens kan være tilsvarende problematikk også for Theora og -Vorbis. Dette medfører at det i USA kan kreves royalties for bruk av -tekniske løsninger knyttet til standardene, et krav som også -håndheves. Patenter kan imidlertid bare hevdes i de landene hvor -patentet er gitt, så amerikanske patenter gjelder ikke andre steder -enn USA.</p> - -<p>Spesielt for utvikling av fri programvare er patenter -problematisk. GPL, en "grunnleggende" lisens for distribusjon av fri -programvare, avviser at programvare kan distribueres under denne -lisensen hvis det inneholder referanser til patenterte rutiner som -utløser krav om royalties. Det er imidlertid uproblematisk å -distribuere fri programvareløsninger under GPL som benytter de -aktuelle standardene innen eller mellom land som ikke anerkjenner -patentene. Derfor finner vi også flere implementeringer av Mp3 og -H.264 som er fri programvare, lisensiert under GPL.</p> - -<p>I Norge og EU er patentlovgivningen langt mer restriktiv enn i USA, -men det er også her mulig å få patentert metoder for løsning av et -problem som relaterer seg til databehandling. Det er AIF bekjent ikke -relevante patenter i EU eller Norge hva gjelder H.264 og Mp3, men -muligheten for at det finnes patenter uten at det er gjort krav om -royalties eller at det senere vil gis slike patenter kan ikke helt -avvises.</p> - -<p>AIF mener det er et behov for å gi offentlige virksomheter mulighet -til å benytte antatt royaltyfrie åpne standarder som et likeverdig -alternativ eller i tillegg til de markedsledende åpne standardene.</p> - -</blockquote></p> - -<p>Det ser dermed ikke ut til at de har vurdert patentspørsmålet i -sammenheng med opphavsrettsvilkår slik de er formulert for f.eks. -Apple Final Cut Pro, Adobe Premiere Pro, Avid og Sorenson-verktøyene, -der det kreves brukstillatelse for patenter som ikke er gyldige i -Norge for å bruke disse verktøyene til annet en personlig og ikke -kommersiell aktivitet når det gjelder H.264-video. Jeg må nok lete -videre etter svar på det spørsmålet.</p> + Norwegian Bokmål translation of The Debian Administrator's Handbook complete, proofreading in progress + http://people.skolelinux.org/pere/blog/Norwegian_Bokm_l_translation_of_The_Debian_Administrator_s_Handbook_complete__proofreading_in_progress.html + http://people.skolelinux.org/pere/blog/Norwegian_Bokm_l_translation_of_The_Debian_Administrator_s_Handbook_complete__proofreading_in_progress.html + Fri, 3 Mar 2017 14:50:00 +0100 + <p>For almost a year now, we have been working on making a Norwegian +Bokmål edition of <a href="https://debian-handbook.info/">The Debian +Administrator's Handbook</a>. Now, thanks to the tireless effort of +Ole-Erik, Ingrid and Andreas, the initial translation is complete, and +we are working on the proof reading to ensure consistent language and +use of correct computer science terms. The plan is to make the book +available on paper, as well as in electronic form. For that to +happen, the proof reading must be completed and all the figures need +to be translated. If you want to help out, get in touch.</p> + +<p><a href="http://people.skolelinux.org/pere/debian-handbook/debian-handbook-nb-NO.pdf">A + +fresh PDF edition</a> in A4 format (the final book will have smaller +pages) of the book created every morning is available for +proofreading. If you find any errors, please +<a href="https://hosted.weblate.org/projects/debian-handbook/">visit +Weblate and correct the error</a>. The +<a href="http://l.github.io/debian-handbook/stat/nb-NO/index.html">state +of the translation including figures</a> is a useful source for those +provide Norwegian bokmål screen shots and figures.</p> - A Debian package for SMTP via Tor (aka SMTorP) using exim4 - http://people.skolelinux.org/pere/blog/A_Debian_package_for_SMTP_via_Tor__aka_SMTorP__using_exim4.html - http://people.skolelinux.org/pere/blog/A_Debian_package_for_SMTP_via_Tor__aka_SMTorP__using_exim4.html - Mon, 10 Nov 2014 13:40:00 +0100 - <p>The right to communicate with your friends and family in private, -without anyone snooping, is a right every citicen have in a liberal -democracy. But this right is under serious attack these days.</p> - -<p>A while back it occurred to me that one way to make the dragnet -surveillance conducted by NSA, GCHQ, FRA and others (and confirmed by -the whisleblower Snowden) more expensive for Internet email, -is to deliver all email using SMTP via Tor. Such SMTP option would be -a nice addition to the FreedomBox project if we could send email -between FreedomBox machines without leaking metadata about the emails -to the people peeking on the wire. I -<a href="http://lists.alioth.debian.org/pipermail/freedombox-discuss/2014-October/006493.html">proposed -this on the FreedomBox project mailing list in October</a> and got a -lot of useful feedback and suggestions. It also became obvious to me -that this was not a novel idea, as the same idea was tested and -documented by Johannes Berg as early as 2006, and both -<a href="https://github.com/pagekite/Mailpile/wiki/SMTorP">the -Mailpile</a> and <a href="http://dee.su/cables">the Cables</a> systems -propose a similar method / protocol to pass emails between users.</p> - -<p>To implement such system one need to set up a Tor hidden service -providing the SMTP protocol on port 25, and use email addresses -looking like username@hidden-service-name.onion. With such addresses -the connections to port 25 on hidden-service-name.onion using Tor will -go to the correct SMTP server. To do this, one need to configure the -Tor daemon to provide the hidden service and the mail server to accept -emails for this .onion domain. To learn more about Exim configuration -in Debian and test the design provided by Johannes Berg in his FAQ, I -set out yesterday to create a Debian package for making it trivial to -set up such SMTP over Tor service based on Debian. Getting it to work -were fairly easy, and -<a href="https://github.com/petterreinholdtsen/exim4-smtorp">the -source code for the Debian package</a> is available from github. I -plan to move it into Debian if further testing prove this to be a -useful approach.</p> - -<p>If you want to test this, set up a blank Debian machine without any -mail system installed (or run <tt>apt-get purge exim4-config</tt> to -get rid of exim4). Install tor, clone the git repository mentioned -above, build the deb and install it on the machine. Next, run -<tt>/usr/lib/exim4-smtorp/setup-exim-hidden-service</tt> and follow -the instructions to get the service up and running. Restart tor and -exim when it is done, and test mail delivery using swaks like -this:</p> + Unlimited randomness with the ChaosKey? + http://people.skolelinux.org/pere/blog/Unlimited_randomness_with_the_ChaosKey_.html + http://people.skolelinux.org/pere/blog/Unlimited_randomness_with_the_ChaosKey_.html + Wed, 1 Mar 2017 20:50:00 +0100 + <p>A few days ago I ordered a small batch of +<a href="http://altusmetrum.org/ChaosKey/">the ChaosKey</a>, a small +USB dongle for generating entropy created by Bdale Garbee and Keith +Packard. Yesterday it arrived, and I am very happy to report that it +work great! According to its designers, to get it to work out of the +box, you need the Linux kernel version 4.1 or later. I tested on a +Debian Stretch machine (kernel version 4.9), and there it worked just +fine, increasing the available entropy very quickly. I wrote a small +test oneliner to test. It first print the current entropy level, +drain /dev/random, and then print the entropy level for five seconds. +Here is the situation without the ChaosKey inserted:</p> + +<blockquote><pre> +% cat /proc/sys/kernel/random/entropy_avail; \ + dd bs=1M if=/dev/random of=/dev/null count=1; \ + for n in $(seq 1 5); do \ + cat /proc/sys/kernel/random/entropy_avail; \ + sleep 1; \ + done +300 +0+1 oppføringer inn +0+1 oppføringer ut +28 byte kopiert, 0,000264565 s, 106 kB/s +4 +8 +12 +17 +21 +% +</pre></blockquote> + +<p>The entropy level increases by 3-4 every second. In such case any +application requiring random bits (like a HTTPS enabled web server) +will halt and wait for more entrpy. And here is the situation with +the ChaosKey inserted:</p> + +<blockquote><pre> +% cat /proc/sys/kernel/random/entropy_avail; \ + dd bs=1M if=/dev/random of=/dev/null count=1; \ + for n in $(seq 1 5); do \ + cat /proc/sys/kernel/random/entropy_avail; \ + sleep 1; \ + done +1079 +0+1 oppføringer inn +0+1 oppføringer ut +104 byte kopiert, 0,000487647 s, 213 kB/s +433 +1028 +1031 +1035 +1038 +% +</pre></blockquote> -<p><blockquote><pre> -torsocks swaks --server dutlqrrmjhtfa3vp.onion \ - --to fbx@dutlqrrmjhtfa3vp.onion -</pre></blockquote></p> +<p>Quite the difference. :) I bought a few more than I need, in case +someone want to buy one here in Norway. :)</p> -<p>This will test the SMTP delivery using tor. Replace the email -address with your own address to test your server. :)</p> - -<p>The setup procedure is still to complex, and I hope it can be made -easier and more automatic. Especially the tor setup need more work. -Also, the package include a tor-smtp tool written in C, but its task -should probably be rewritten in some script language to make the deb -architecture independent. It would probably also make the code easier -to review. The tor-smtp tool currently need to listen on a socket for -exim to talk to it and is started using xinetd. It would be better if -no daemon and no socket is needed. I suspect it is possible to get -exim to run a command line tool for delivery instead of talking to a -socket, and hope to figure out how in a future version of this -system.</p> - -<p>Until I wipe my test machine, I can be reached using the -<tt>fbx@dutlqrrmjhtfa3vp.onion</tt> mail address, deliverable over -SMTorP. :)</p> +<p>Update: The dongle was presented at Debconf last year. You might +find <a href="https://debconf16.debconf.org/talks/94/">the talk +recording illuminating</a>. It explains exactly what the source of +randomness is, if you are unable to spot it from the schema drawing +available from the ChaosKey web site linked at the start of this blog +post.</p> - First Jessie based Debian Edu released (alpha0) - http://people.skolelinux.org/pere/blog/First_Jessie_based_Debian_Edu_released__alpha0_.html - http://people.skolelinux.org/pere/blog/First_Jessie_based_Debian_Edu_released__alpha0_.html - Mon, 27 Oct 2014 20:40:00 +0100 - <p>I am happy to report that I on behalf of the Debian Edu team just -sent out -<a href="https://lists.debian.org/debian-edu-announce/2014/10/msg00000.html">this -announcement</a>:</p> - -<pre> -The Debian Edu Team is pleased to announce the release of Debian Edu -Jessie 8.0+edu0~alpha0 - -Debian Edu is a complete operating system for schools. Through its -various installation profiles you can install servers, workstations -and laptops which will work together on the school network. With -Debian Edu, the teachers themselves or their technical support can -roll out a complete multi-user multi-machine study environment within -hours or a few days. Debian Edu comes with hundreds of applications -pre-installed, but you can always add more packages from Debian. - -For those who want to give Debian Edu Jessie a try, download and -installation instructions are available, including detailed -instructions in the manual[1] explaining the first steps, such as -setting up a network or adding users. Please note that the password -for the user your prompted for during installation must have a length -of at least 5 characters! - - [1] &lt;URL: <a href="https://wiki.debian.org/DebianEdu/Documentation/Jessie">https://wiki.debian.org/DebianEdu/Documentation/Jessie</a> &gt; - -Would you like to give your school's computer a longer life? Are you -tired of sneaker administration, running from computer to computer -reinstalling the operating system? Would you like to administrate all -the computers in your school using only a couple of hours every week? -Check out Debian Edu Jessie! - -Skolelinux is used by at least two hundred schools all over the world, -mostly in Germany and Norway. - -About Debian Edu and Skolelinux -=============================== - -Debian Edu, also known as Skolelinux[2], is a Linux distribution based -on Debian providing an out-of-the box environment of a completely -configured school network. Immediately after installation a school -server running all services needed for a school network is set up just -waiting for users and machines being added via GOsa², a comfortable -Web-UI. A netbooting environment is prepared using PXE, so after -initial installation of the main server from CD or USB stick all other -machines can be installed via the network. The provided school server -provides LDAP database and Kerberos authentication service, -centralized home directories, DHCP server, web proxy and many other -services. The desktop contains more than 60 educational software -packages[3] and more are available from the Debian archive, and -schools can choose between KDE, Gnome, LXDE, Xfce and MATE desktop -environment. - - [2] &lt;URL: <a href="http://www.skolelinux.org/">http://www.skolelinux.org/</a> &gt; - [3] &lt;URL: <a href="http://people.skolelinux.org/pere/blog/Educational_applications_included_in_Debian_Edu___Skolelinux__the_screenshot_collection____.html">http://people.skolelinux.org/pere/blog/Educational_applications_included_in_Debian_Edu___Skolelinux__the_screenshot_collection____.html</a> &gt; - -Full release notes and manual -============================= - -Below the download URLs there is a list of some of the new features -and bugfixes of Debian Edu 8.0+edu0~alpha0 Codename Jessie. The full -list is part of the manual. (See the feature list in the manual[4] for -the English version.) For some languages manual translations are -available, see the manual translation overview[5]. - - [4] &lt;URL: <a href="https://wiki.debian.org/DebianEdu/Documentation/Jessie/Features">https://wiki.debian.org/DebianEdu/Documentation/Jessie/Features</a> &gt; - [5] &lt;URL: <a href="http://maintainer.skolelinux.org/debian-edu-doc/">http://maintainer.skolelinux.org/debian-edu-doc/</a> &gt; - -Where to get it ---------------- - -To download the multiarch netinstall CD release (624 MiB) you can use - - * <a href="ftp://ftp.skolelinux.org/skolelinux-cd/debian-edu-8.0+edu0~alpha0-CD.iso">ftp://ftp.skolelinux.org/skolelinux-cd/debian-edu-8.0+edu0~alpha0-CD.iso</a> - * <a href="http://ftp.skolelinux.org/skolelinux-cd/debian-edu-8.0+edu0~alpha0-CD.iso">http://ftp.skolelinux.org/skolelinux-cd/debian-edu-8.0+edu0~alpha0-CD.iso</a> - * rsync -avzP ftp.skolelinux.org::skolelinux-cd/debian-edu-8.0+edu0~alpha0-CD.iso . - -The SHA1SUM of this image is: 361188818e036ce67280a572f757de82ebfeb095 - -New features for Debian Edu 8.0+edu0~alpha0 Codename Jessie released 2014-10-27 -=============================================================================== - - -Installation changes --------------------- - - * PXE installation now installs firmware automatically for the hardware present. - -Software updates ----------------- - -Everything which is new in Debian Jessie 8.0, eg: - - * Linux kernel 3.16.x - * Desktop environments KDE "Plasma" 4.11.12, GNOME 3.14, Xfce 4.10, - LXDE 0.5.6 and MATE 1.8 (KDE "Plasma" is installed by default; to - choose one of the others see manual.) - * the browsers Iceweasel 31 ESR and Chromium 38 - * !LibreOffice 4.3.3 - * GOsa 2.7.4 - * LTSP 5.5.4 - * CUPS print system 1.7.5 - * new boot framework: systemd - * Educational toolbox GCompris 14.07 - * Music creator Rosegarden 14.02 - * Image editor Gimp 2.8.14 - * Virtual stargazer Stellarium 0.13.0 - * golearn 0.9 - * tuxpaint 0.9.22 - * New version of debian-installer from Debian Jessie. - * Debian Jessie includes about 42000 packages available for - installation. - * More information about Debian Jessie 8.0 is provided in the release - notes[6] and the installation manual[7]. - - [6] &lt;URL: <a href="http://www.debian.org/releases/jessie/releasenotes">http://www.debian.org/releases/jessie/releasenotes</a> &gt; - [7] &lt;URL: <a href="http://www.debian.org/releases/jessie/installmanual">http://www.debian.org/releases/jessie/installmanual</a> &gt; - -Fixed bugs ----------- - - * Inserting incorrect DNS information in Gosa will no longer break - DNS completely, but instead stop DNS updates until the incorrect - information is corrected (Debian bug #710362) - * and many others. - -Documentation and translation updates -------------------------------------- - - * The Debian Edu Jessie Manual is fully translated to German, French, - Italian, Danish and Dutch. Partly translated versions exist for - Norwegian Bokmal and Spanish. - -Other changes -------------- - - * Due to new Squid settings, powering off or rebooting the main - server takes more time. - * To manage printers localhost:631 has to be used, currently www:631 - doesn't work. - -Regressions / known problems ----------------------------- - - * Installing LTSP chroot fails with a bug related to eatmydata about - exim4-config failing to run its postinst (see Debian bug #765694 - and Debian bug #762103). - * Munin collection is not properly configured on clients (Debian bug - #764594). The fix is available in a newer version of munin-node. - * PXE setup for Main Server and Thin Client Server setup does not - work when installing on a machine without direct Internet access. - Will be fixed when Debian bug #766960 is fixed in Jessie. - -See the status page[8] for the complete list. - - [8] &lt;URL: <a href="https://wiki.debian.org/DebianEdu/Status/Jessie">https://wiki.debian.org/DebianEdu/Status/Jessie</a> &gt; - -How to report bugs ------------------- - -&lt;URL: <a href="http://wiki.debian.org/DebianEdu/HowTo/ReportBugs">http://wiki.debian.org/DebianEdu/HowTo/ReportBugs</a> &gt; - -About Debian -============ - -The Debian Project was founded in 1993 by Ian Murdock to be a truly -free community project. Since then the project has grown to be one of -the largest and most influential open source projects. Thousands of -volunteers from all over the world work together to create and -maintain Debian software. Available in 70 languages, and supporting a -huge range of computer types, Debian calls itself the universal -operating system. - -Contact Information -For further information, please visit the Debian web pages[9] or send -mail to press@debian.org. - - [9] &lt;URL: <a href="http://www.debian.org/">http://www.debian.org/</a> &gt; -</pre> + Detect OOXML files with undefined behaviour? + http://people.skolelinux.org/pere/blog/Detect_OOXML_files_with_undefined_behaviour_.html + http://people.skolelinux.org/pere/blog/Detect_OOXML_files_with_undefined_behaviour_.html + Tue, 21 Feb 2017 00:20:00 +0100 + <p>I just noticed +<a href="http://www.arkivrad.no/aktuelt/riksarkivarens-forskrift-pa-horing">the +new Norwegian proposal for archiving rules in the goverment</a> list +<a href="http://www.ecma-international.org/publications/standards/Ecma-376.htm">ECMA-376</a> +/ ISO/IEC 29500 (aka OOXML) as valid formats to put in long term +storage. Luckily such files will only be accepted based on +pre-approval from the National Archive. Allowing OOXML files to be +used for long term storage might seem like a good idea as long as we +forget that there are plenty of ways for a "valid" OOXML document to +have content with no defined interpretation in the standard, which +lead to a question and an idea.</p> + +<p>Is there any tool to detect if a OOXML document depend on such +undefined behaviour? It would be useful for the National Archive (and +anyone else interested in verifying that a document is well defined) +to have such tool available when considering to approve the use of +OOXML. I'm aware of the +<a href="https://github.com/arlm/officeotron/">officeotron OOXML +validator</a>, but do not know how complete it is nor if it will +report use of undefined behaviour. Are there other similar tools +available? Please send me an email if you know of any such tool.</p> - I spent last weekend recording MakerCon Nordic - http://people.skolelinux.org/pere/blog/I_spent_last_weekend_recording_MakerCon_Nordic.html - http://people.skolelinux.org/pere/blog/I_spent_last_weekend_recording_MakerCon_Nordic.html - Thu, 23 Oct 2014 23:00:00 +0200 - <p>I spent last weekend at <a href="http://www.makercon.no/">Makercon -Nordic</a>, a great conference and workshop for makers in Norway and -the surrounding countries. I had volunteered on behalf of the -Norwegian Unix Users Group (NUUG) to video record the talks, and we -had a great and exhausting time recording the entire day, two days in -a row. There were only two of us, Hans-Petter and me, and we used the -regular video equipment for NUUG, with a -<a href="http://dvswitch.alioth.debian.org/wiki/">dvswitch</a>, a -camera and a VGA to DV convert box, and mixed video and slides -live.</p> - -<p>Hans-Petter did the post-processing, consisting of uploading the -around 180 GiB of raw video to Youtube, and the result is -<a href="https://www.youtube.com/user/MakerConNordic/">now becoming -public</a> on the MakerConNordic account. The videos have the license -NUUG always use on our recordings, which is -<a href="http://creativecommons.org/licenses/by-sa/3.0/no/">Creative -Commons Navngivelse-Del på samme vilkår 3.0 Norge</a>. Many great -talks available. Check it out! :)</p> + Ruling ignored our objections to the seizure of popcorn-time.no (#domstolkontroll) + http://people.skolelinux.org/pere/blog/Ruling_ignored_our_objections_to_the_seizure_of_popcorn_time_no___domstolkontroll_.html + http://people.skolelinux.org/pere/blog/Ruling_ignored_our_objections_to_the_seizure_of_popcorn_time_no___domstolkontroll_.html + Mon, 13 Feb 2017 21:30:00 +0100 + <p>A few days ago, we received the ruling from +<a href="http://people.skolelinux.org/pere/blog/A_day_in_court_challenging_seizure_of_popcorn_time_no_for__domstolkontroll.html">my +day in court</a>. The case in question is a challenge of the seizure +of the DNS domain popcorn-time.no. The ruling simply did not mention +most of our arguments, and seemed to take everything ØKOKRIM said at +face value, ignoring our demonstration and explanations. But it is +hard to tell for sure, as we still have not seen most of the documents +in the case and thus were unprepared and unable to contradict several +of the claims made in court by the opposition. We are considering an +appeal, but it is partly a question of funding, as it is costing us +quite a bit to pay for our lawyer. If you want to help, please +<a href="http://www.nuug.no/dns-beslag-donasjon.shtml">donate to the +NUUG defense fund</a>.</p> + +<p>The details of the case, as far as we know it, is available in +Norwegian from +<a href="https://www.nuug.no/news/tags/dns-domenebeslag/">the NUUG +blog</a>. This also include +<a href="https://www.nuug.no/news/Avslag_etter_rettslig_h_ring_om_DNS_beslaget___vurderer_veien_videre.shtml">the +ruling itself</a>.</p> - listadmin, the quick way to moderate mailman lists - nice free software - http://people.skolelinux.org/pere/blog/listadmin__the_quick_way_to_moderate_mailman_lists___nice_free_software.html - http://people.skolelinux.org/pere/blog/listadmin__the_quick_way_to_moderate_mailman_lists___nice_free_software.html - Wed, 22 Oct 2014 20:00:00 +0200 - <p>If you ever had to moderate a mailman list, like the ones on -alioth.debian.org, you know the web interface is fairly slow to -operate. First you visit one web page, enter the moderation password -and get a new page shown with a list of all the messages to moderate -and various options for each email address. This take a while for -every list you moderate, and you need to do it regularly to do a good -job as a list moderator. But there is a quick alternative, -<a href="http://heim.ifi.uio.no/kjetilho/hacks/#listadmin">the -listadmin program</a>. It allow you to check lists for new messages -to moderate in a fraction of a second. Here is a test run on two -lists I recently took over:</p> - -<p><blockquote><pre> -% time listadmin xiph -fetching data for pkg-xiph-commits@lists.alioth.debian.org ... nothing in queue -fetching data for pkg-xiph-maint@lists.alioth.debian.org ... nothing in queue - -real 0m1.709s -user 0m0.232s -sys 0m0.012s -% -</pre></blockquote></p> - -<p>In 1.7 seconds I had checked two mailing lists and confirmed that -there are no message in the moderation queue. Every morning I -currently moderate 68 mailman lists, and it normally take around two -minutes. When I took over the two pkg-xiph lists above a few days -ago, there were 400 emails waiting in the moderator queue. It took me -less than 15 minutes to process them all using the listadmin -program.</p> - -<p>If you install -<a href="https://tracker.debian.org/pkg/listadmin">the listadmin -package</a> from Debian and create a file <tt>~/.listadmin.ini</tt> -with content like this, the moderation task is a breeze:</p> - -<p><blockquote><pre> -username username@example.org -spamlevel 23 -default discard -discard_if_reason "Posting restricted to members only. Remove us from your mail list." - -password secret -adminurl https://{domain}/mailman/admindb/{list} -mailman-list@lists.example.com - -password hidden -other-list@otherserver.example.org -</pre></blockquote></p> - -<p>There are other options to set as well. Check the manual page to -learn the details.</p> - -<p>If you are forced to moderate lists on a mailman installation where -the SSL certificate is self signed or not properly signed by a -generally accepted signing authority, you can set a environment -variable when calling listadmin to disable SSL verification:</p> - -<p><blockquote><pre> -PERL_LWP_SSL_VERIFY_HOSTNAME=0 listadmin -</pre></blockquote></p> - -<p>If you want to moderate a subset of the lists you take care of, you -can provide an argument to the listadmin script like I do in the -initial screen dump (the xiph argument). Using an argument, only -lists matching the argument string will be processed. This make it -quick to accept messages if you notice the moderation request in your -email.</p> - -<p>Without the listadmin program, I would never be the moderator of 68 -mailing lists, as I simply do not have time to spend on that if the -process was any slower. The listadmin program have saved me hours of -time I could spend elsewhere over the years. It truly is nice free -software.</p> - -<p>As usual, if you use Bitcoin and want to show your support of my -activities, please send Bitcoin donations to my address -<b><a href="bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b&label=PetterReinholdtsenBlog">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b</a></b>.</p> - -<p>Update 2014-10-27: Added missing 'username' statement in -configuration example. Also, I've been told that the -PERL_LWP_SSL_VERIFY_HOSTNAME=0 setting do not work for everyone. Not -sure why.</p> + A day in court challenging seizure of popcorn-time.no for #domstolkontroll + http://people.skolelinux.org/pere/blog/A_day_in_court_challenging_seizure_of_popcorn_time_no_for__domstolkontroll.html + http://people.skolelinux.org/pere/blog/A_day_in_court_challenging_seizure_of_popcorn_time_no_for__domstolkontroll.html + Fri, 3 Feb 2017 11:10:00 +0100 + <p align="center"><img width="70%" src="http://people.skolelinux.org/pere/blog/images/2017-02-01-popcorn-time-in-court.jpeg"></p> + +<p>On Wednesday, I spent the entire day in court in Follo Tingrett +representing <a href="https://www.nuug.no/">the member association +NUUG</a>, alongside <a href="https://www.efn.no/">the member +association EFN</a> and <a href="http://www.imc.no">the DNS registrar +IMC</a>, challenging the seizure of the DNS name popcorn-time.no. It +was interesting to sit in a court of law for the first time in my +life. Our team can be seen in the picture above: attorney Ola +Tellesbø, EFN board member Tom Fredrik Blenning, IMC CEO Morten Emil +Eriksen and NUUG board member Petter Reinholdtsen.</p> + +<p><a href="http://www.domstol.no/no/Enkelt-domstol/follo-tingrett/Nar-gar-rettssaken/Beramming/?cid=AAAA1701301512081262234UJFBVEZZZZZEJBAvtale">The +case at hand</a> is that the Norwegian National Authority for +Investigation and Prosecution of Economic and Environmental Crime (aka +Økokrim) decided on their own, to seize a DNS domain early last +year, without following +<a href="https://www.norid.no/no/regelverk/navnepolitikk/#link12">the +official policy of the Norwegian DNS authority</a> which require a +court decision. The web site in question was a site covering Popcorn +Time. And Popcorn Time is the name of a technology with both legal +and illegal applications. Popcorn Time is a client combining +searching a Bittorrent directory available on the Internet with +downloading/distribute content via Bittorrent and playing the +downloaded content on screen. It can be used illegally if it is used +to distribute content against the will of the right holder, but it can +also be used legally to play a lot of content, for example the +millions of movies +<a href="https://archive.org/details/movies">available from the +Internet Archive</a> or the collection +<a href="http://vodo.net/films/">available from Vodo</a>. We created +<a href="magnet:?xt=urn:btih:86c1802af5a667ca56d3918aecb7d3c0f7173084&dn=PresentasjonFolloTingrett.mov&tr=udp%3A%2F%2Fpublic.popcorn-tracker.org%3A6969%2Fannounce">a +video demonstrating legally use of Popcorn Time</a> and played it in +Court. It can of course be downloaded using Bittorrent.</p> + +<p>I did not quite know what to expect from a day in court. The +government held on to their version of the story and we held on to +ours, and I hope the judge is able to make sense of it all. We will +know in two weeks time. Unfortunately I do not have high hopes, as +the Government have the upper hand here with more knowledge about the +case, better training in handling criminal law and in general higher +standing in the courts than fairly unknown DNS registrar and member +associations. It is expensive to be right also in Norway. So far the +case have cost more than NOK 70 000,-. To help fund the case, NUUG +and EFN have asked for donations, and managed to collect around NOK 25 +000,- so far. Given the presentation from the Government, I expect +the government to appeal if the case go our way. And if the case do +not go our way, I hope we have enough funding to appeal.</p> + +<p>From the other side came two people from Økokrim. On the benches, +appearing to be part of the group from the government were two people +from the Simonsen Vogt Wiik lawyer office, and three others I am not +quite sure who was. Økokrim had proposed to present two witnesses +from The Motion Picture Association, but this was rejected because +they did not speak Norwegian and it was a bit late to bring in a +translator, but perhaps the two from MPA were present anyway. All +seven appeared to know each other. Good to see the case is take +seriously.</p> + +<p>If you, like me, believe the courts should be involved before a DNS +domain is hijacked by the government, or you believe the Popcorn Time +technology have a lot of useful and legal applications, I suggest you +too <a href="http://www.nuug.no/dns-beslag-donasjon.shtml">donate to +the NUUG defense fund</a>. Both Bitcoin and bank transfer are +available. If NUUG get more than we need for the legal action (very +unlikely), the rest will be spend promoting free software, open +standards and unix-like operating systems in Norway, so no matter what +happens the money will be put to good use.</p> + +<p>If you want to lean more about the case, I recommend you check out +<a href="https://www.nuug.no/news/tags/dns-domenebeslag/">the blog +posts from NUUG covering the case</a>. They cover the legal arguments +on both sides.</p> - Debian Jessie, PXE and automatic firmware installation - http://people.skolelinux.org/pere/blog/Debian_Jessie__PXE_and_automatic_firmware_installation.html - http://people.skolelinux.org/pere/blog/Debian_Jessie__PXE_and_automatic_firmware_installation.html - Fri, 17 Oct 2014 14:10:00 +0200 - <p>When PXE installing laptops with Debian, I often run into the -problem that the WiFi card require some firmware to work properly. -And it has been a pain to fix this using preseeding in Debian. -Normally something more is needed. But thanks to -<a href="https://packages.qa.debian.org/i/isenkram.html">my isenkram -package</a> and its recent tasksel extension, it has now become easy -to do this using simple preseeding.</p> - -<p>The isenkram-cli package provide tasksel tasks which will install -firmware for the hardware found in the machine (actually, requested by -the kernel modules for the hardware). (It can also install user space -programs supporting the hardware detected, but that is not the focus -of this story.)</p> - -<p>To get this working in the default installation, two preeseding -values are needed. First, the isenkram-cli package must be installed -into the target chroot (aka the hard drive) before tasksel is executed -in the pkgsel step of the debian-installer system. This is done by -preseeding the base-installer/includes debconf value to include the -isenkram-cli package. The package name is next passed to debootstrap -for installation. With the isenkram-cli package in place, tasksel -will automatically use the isenkram tasks to detect hardware specific -packages for the machine being installed and install them, because -isenkram-cli contain tasksel tasks.</p> - -<p>Second, one need to enable the non-free APT repository, because -most firmware unfortunately is non-free. This is done by preseeding -the apt-mirror-setup step. This is unfortunate, but for a lot of -hardware it is the only option in Debian.</p> - -<p>The end result is two lines needed in your preseeding file to get -firmware installed automatically by the installer:</p> - -<p><blockquote><pre> -base-installer base-installer/includes string isenkram-cli -apt-mirror-setup apt-setup/non-free boolean true -</pre></blockquote></p> - -<p>The current version of isenkram-cli in testing/jessie will install -both firmware and user space packages when using this method. It also -do not work well, so use version 0.15 or later. Installing both -firmware and user space packages might give you a bit more than you -want, so I decided to split the tasksel task in two, one for firmware -and one for user space programs. The firmware task is enabled by -default, while the one for user space programs is not. This split is -implemented in the package currently in unstable.</p> - -<p>If you decide to give this a go, please let me know (via email) how -this recipe work for you. :)</p> - -<p>So, I bet you are wondering, how can this work. First and -foremost, it work because tasksel is modular, and driven by whatever -files it find in /usr/lib/tasksel/ and /usr/share/tasksel/. So the -isenkram-cli package place two files for tasksel to find. First there -is the task description file (/usr/share/tasksel/descs/isenkram.desc):</p> + Nasjonalbiblioteket avslutter sin ulovlige bruk av Google Skjemaer + http://people.skolelinux.org/pere/blog/Nasjonalbiblioteket_avslutter_sin_ulovlige_bruk_av_Google_Skjemaer.html + http://people.skolelinux.org/pere/blog/Nasjonalbiblioteket_avslutter_sin_ulovlige_bruk_av_Google_Skjemaer.html + Thu, 12 Jan 2017 09:40:00 +0100 + <p>I dag fikk jeg en skikkelig gladmelding. Bakgrunnen er at før jul +arrangerte Nasjonalbiblioteket +<a href="http://www.nb.no/Bibliotekutvikling/Kunnskapsorganisering/Nasjonalt-verksregister/Seminar-om-verksregister">et +seminar om sitt knakende gode tiltak «verksregister»</a>. Eneste +måten å melde seg på dette seminaret var å sende personopplysninger +til Google via Google Skjemaer. Dette syntes jeg var tvilsom praksis, +da det bør være mulig å delta på seminarer arrangert av det offentlige +uten å måtte dele sine interesser, posisjon og andre +personopplysninger med Google. Jeg ba derfor om innsyn via +<a href="https://www.mimesbronn.no/">Mimes brønn</a> i +<a href="https://www.mimesbronn.no/request/personopplysninger_til_google_sk">avtaler +og vurderinger Nasjonalbiblioteket hadde rundt dette</a>. +Personopplysningsloven legger klare rammer for hva som må være på +plass før en kan be tredjeparter, spesielt i utlandet, behandle +personopplysninger på sine vegne, så det burde eksistere grundig +dokumentasjon før noe slikt kan bli lovlig. To jurister hos +Nasjonalbiblioteket mente først dette var helt i orden, og at Googles +standardavtale kunne brukes som databehandlingsavtale. Det syntes jeg +var merkelig, men har ikke hatt kapasitet til å følge opp saken før +for to dager siden.</p> + +<p>Gladnyheten i dag, som kom etter at jeg tipset Nasjonalbiblioteket +om at Datatilsynet underkjente Googles standardavtaler som +databehandleravtaler i 2011, er at Nasjonalbiblioteket har bestemt seg +for å avslutte bruken av Googles Skjemaer/Apps og gå i dialog med DIFI +for å finne bedre måter å håndtere påmeldinger i tråd med +personopplysningsloven. Det er fantastisk å se at av og til hjelper +det å spørre hva i alle dager det offentlige holder på med.</p> + + + + + Bryter NAV sin egen personvernerklæring? + http://people.skolelinux.org/pere/blog/Bryter_NAV_sin_egen_personvernerkl_ring_.html + http://people.skolelinux.org/pere/blog/Bryter_NAV_sin_egen_personvernerkl_ring_.html + Wed, 11 Jan 2017 06:50:00 +0100 + <p>Jeg leste med interesse en nyhetssak hos +<a href="http://www.digi.no/artikler/nav-avslorer-trygdemisbruk-ved-a-spore-ip-adresser/367394">digi.no</a> +og +<a href="https://www.nrk.no/buskerud/trygdesvindlere-avslores-av-utenlandske-ip-adresser-1.13313461">NRK</a> +om at det ikke bare er meg, men at også NAV bedriver geolokalisering +av IP-adresser, og at det gjøres analyse av IP-adressene til de som +sendes inn meldekort for å se om meldekortet sendes inn fra +utenlandske IP-adresser. Politiadvokat i Drammen, Hans Lyder Haare, +er sitert i NRK på at «De to er jo blant annet avslørt av +IP-adresser. At man ser at meldekortet kommer fra utlandet.»</p> + +<p>Jeg synes det er fint at det blir bedre kjent at IP-adresser +knyttes til enkeltpersoner og at innsamlet informasjon brukes til å +stedsbestemme personer også av aktører her i Norge. Jeg ser det som +nok et argument for å bruke +<a href="https://www.torproject.org/">Tor</a> så mye som mulig for å +gjøre gjøre IP-lokalisering vanskeligere, slik at en kan beskytte sin +privatsfære og unngå å dele sin fysiske plassering med +uvedkommede.</p> + +<P>Men det er en ting som bekymrer meg rundt denne nyheten. Jeg ble +tipset (takk #nuug) om +<a href="https://www.nav.no/no/NAV+og+samfunn/Kontakt+NAV/Teknisk+brukerstotte/Snarveier/personvernerkl%C3%A6ring-for-arbeids-og-velferdsetaten">NAVs +personvernerklæring</a>, som under punktet «Personvern og statistikk» +lyder:</p> -<p><blockquote><pre> -Task: isenkram-packages -Section: hardware -Description: Hardware specific packages (autodetected by isenkram) - Based on the detected hardware various hardware specific packages are - proposed. -Test-new-install: show show -Relevance: 8 -Packages: for-current-hardware - -Task: isenkram-firmware -Section: hardware -Description: Hardware specific firmware packages (autodetected by isenkram) - Based on the detected hardware various hardware specific firmware - packages are proposed. -Test-new-install: mark show -Relevance: 8 -Packages: for-current-hardware-firmware -</pre></blockquote></p> +<p><blockquote> -<p>The key parts are Test-new-install which indicate how the task -should be handled and the Packages line referencing to a script in -/usr/lib/tasksel/packages/. The scripts use other scripts to get a -list of packages to install. The for-current-hardware-firmware script -look like this to list relevant firmware for the machine: +<p>«Når du besøker nav.no, etterlater du deg elektroniske spor. Sporene +dannes fordi din nettleser automatisk sender en rekke opplysninger til +NAVs tjener (server-maskin) hver gang du ber om å få vist en side. Det +er eksempelvis opplysninger om hvilken nettleser og -versjon du +bruker, og din internettadresse (ip-adresse). For hver side som vises, +lagres følgende opplysninger:</p> -<p><blockquote><pre> -#!/bin/sh -# -PATH=/usr/sbin:$PATH -export PATH -isenkram-autoinstall-firmware -l -</pre></blockquote></p> +<ul> +<li>hvilken side du ser på</li> +<li>dato og tid</li> +<li>hvilken nettleser du bruker</li> +<li>din ip-adresse</li> +</ul> -<p>With those two pieces in place, the firmware is installed by -tasksel during the normal d-i run. :)</p> +<p>Ingen av opplysningene vil bli brukt til å identifisere +enkeltpersoner. NAV bruker disse opplysningene til å generere en +samlet statistikk som blant annet viser hvilke sider som er mest +populære. Statistikken er et redskap til å forbedre våre +tjenester.»</p> -<p>If you want to test what tasksel will install when isenkram-cli is -installed, run <tt>DEBIAN_PRIORITY=critical tasksel --test ---new-install</tt> to get the list of packages that tasksel would -install.</p> +</blockquote></p> -<p><a href="https://wiki.debian.org/DebianEdu/">Debian Edu</a> will be -pilots in testing this feature, as isenkram is used there now to -install firmware, replacing the earlier scripts.</p> - - - - - Ubuntu used to show the bread prizes at ICA Storo - http://people.skolelinux.org/pere/blog/Ubuntu_used_to_show_the_bread_prizes_at_ICA_Storo.html - http://people.skolelinux.org/pere/blog/Ubuntu_used_to_show_the_bread_prizes_at_ICA_Storo.html - Sat, 4 Oct 2014 15:20:00 +0200 - <p>Today I came across an unexpected Ubuntu boot screen. Above the -bread shelf on the ICA shop at Storo in Oslo, the grub menu of Ubuntu -with Linux kernel 3.2.0-23 (ie probably version 12.04 LTS) was stuck -on a screen normally showing the bread types and prizes:</p> - -<p align="center"><img width="70%" src="http://people.skolelinux.org/pere/blog/images/2014-10-04-ubuntu-ica-storo-crop.jpeg"></p> - -<p>If it had booted as it was supposed to, I would never had known -about this hidden Linux installation. It is interesting what -<a href="http://revealingerrors.com/">errors can reveal</a>.</p> +<p>Jeg klarer ikke helt å se hvordan analyse av de besøkendes +IP-adresser for å se hvem som sender inn meldekort via web fra en +IP-adresse i utlandet kan gjøres uten å komme i strid med påstanden om +at «ingen av opplysningene vil bli brukt til å identifisere +enkeltpersoner». Det virker dermed for meg som at NAV bryter sine +egen personvernerklæring, hvilket +<a href="http://people.skolelinux.org/pere/blog/Er_lover_brutt_n_r_personvernpolicy_ikke_stemmer_med_praksis_.html">Datatilsynet +fortalte meg i starten av desember antagelig er brudd på +personopplysningsloven</a>. + +<p>I tillegg er personvernerklæringen ganske misvisende i og med at +NAVs nettsider ikke bare forsyner NAV med personopplysninger, men i +tillegg ber brukernes nettleser kontakte fem andre nettjenere +(script.hotjar.com, static.hotjar.com, vars.hotjar.com, +www.google-analytics.com og www.googletagmanager.com), slik at +personopplysninger blir gjort tilgjengelig for selskapene Hotjar og +Google , og alle som kan lytte på trafikken på veien (som FRA, GCHQ og +NSA). Jeg klarer heller ikke se hvordan slikt spredning av +personopplysninger kan være i tråd med kravene i +personopplysningloven, eller i tråd med NAVs personvernerklæring.</p> + +<p>Kanskje NAV bør ta en nøye titt på sin personvernerklæring? Eller +kanskje Datatilsynet bør gjøre det?</p> - New lsdvd release version 0.17 is ready - http://people.skolelinux.org/pere/blog/New_lsdvd_release_version_0_17_is_ready.html - http://people.skolelinux.org/pere/blog/New_lsdvd_release_version_0_17_is_ready.html - Sat, 4 Oct 2014 08:40:00 +0200 - <p>The <a href="https://sourceforge.net/p/lsdvd/">lsdvd project</a> -got a new set of developers a few weeks ago, after the original -developer decided to step down and pass the project to fresh blood. -This project is now maintained by Petter Reinholdtsen and Steve -Dibb.</p> - -<p>I just wrapped up -<a href="https://sourceforge.net/p/lsdvd/mailman/message/32896061/">a -new lsdvd release</a>, available in git or from -<a href="https://sourceforge.net/projects/lsdvd/files/lsdvd/">the -download page</a>. This is the changelog dated 2014-10-03 for version -0.17.</p> - -<ul> - - <li>Ignore 'phantom' audio, subtitle tracks</li> - <li>Check for garbage in the program chains, which indicate that a track is - non-existant, to work around additional copy protection</li> - <li>Fix displaying content type for audio tracks, subtitles</li> - <li>Fix pallete display of first entry</li> - <li>Fix include orders</li> - <li>Ignore read errors in titles that would not be displayed anyway</li> - <li>Fix the chapter count</li> - <li>Make sure the array size and the array limit used when initialising - the palette size is the same.</li> - <li>Fix array printing.</li> - <li>Correct subsecond calculations.</li> - <li>Add sector information to the output format.</li> - <li>Clean up code to be closer to ANSI C and compile without warnings - with more GCC compiler warnings.</li> + Where did that package go? &mdash; geolocated IP traceroute + http://people.skolelinux.org/pere/blog/Where_did_that_package_go___mdash__geolocated_IP_traceroute.html + http://people.skolelinux.org/pere/blog/Where_did_that_package_go___mdash__geolocated_IP_traceroute.html + Mon, 9 Jan 2017 12:20:00 +0100 + <p>Did you ever wonder where the web trafic really flow to reach the +web servers, and who own the network equipment it is flowing through? +It is possible to get a glimpse of this from using traceroute, but it +is hard to find all the details. Many years ago, I wrote a system to +map the Norwegian Internet (trying to figure out if our plans for a +network game service would get low enough latency, and who we needed +to talk to about setting up game servers close to the users. Back +then I used traceroute output from many locations (I asked my friends +to run a script and send me their traceroute output) to create the +graph and the map. The output from traceroute typically look like +this: + +<p><pre> +traceroute to www.stortinget.no (85.88.67.10), 30 hops max, 60 byte packets + 1 uio-gw10.uio.no (129.240.202.1) 0.447 ms 0.486 ms 0.621 ms + 2 uio-gw8.uio.no (129.240.24.229) 0.467 ms 0.578 ms 0.675 ms + 3 oslo-gw1.uninett.no (128.39.65.17) 0.385 ms 0.373 ms 0.358 ms + 4 te3-1-2.br1.fn3.as2116.net (193.156.90.3) 1.174 ms 1.172 ms 1.153 ms + 5 he16-1-1.cr1.san110.as2116.net (195.0.244.234) 2.627 ms he16-1-1.cr2.oslosda310.as2116.net (195.0.244.48) 3.172 ms he16-1-1.cr1.san110.as2116.net (195.0.244.234) 2.857 ms + 6 ae1.ar8.oslosda310.as2116.net (195.0.242.39) 0.662 ms 0.637 ms ae0.ar8.oslosda310.as2116.net (195.0.242.23) 0.622 ms + 7 89.191.10.146 (89.191.10.146) 0.931 ms 0.917 ms 0.955 ms + 8 * * * + 9 * * * +[...] +</pre></p> + +<p>This show the DNS names and IP addresses of (at least some of the) +network equipment involved in getting the data traffic from me to the +www.stortinget.no server, and how long it took in milliseconds for a +package to reach the equipment and return to me. Three packages are +sent, and some times the packages do not follow the same path. This +is shown for hop 5, where three different IP addresses replied to the +traceroute request.</p> + +<p>There are many ways to measure trace routes. Other good traceroute +implementations I use are traceroute (using ICMP packages) mtr (can do +both ICMP, UDP and TCP) and scapy (python library with ICMP, UDP, TCP +traceroute and a lot of other capabilities). All of them are easily +available in <a href="https://www.debian.org/">Debian</a>.</p> + +<p>This time around, I wanted to know the geographic location of +different route points, to visualize how visiting a web page spread +information about the visit to a lot of servers around the globe. The +background is that a web site today often will ask the browser to get +from many servers the parts (for example HTML, JSON, fonts, +JavaScript, CSS, video) required to display the content. This will +leak information about the visit to those controlling these servers +and anyone able to peek at the data traffic passing by (like your ISP, +the ISPs backbone provider, FRA, GCHQ, NSA and others).</p> + +<p>Lets pick an example, the Norwegian parliament web site +www.stortinget.no. It is read daily by all members of parliament and +their staff, as well as political journalists, activits and many other +citizens of Norway. A visit to the www.stortinget.no web site will +ask your browser to contact 8 other servers: ajax.googleapis.com, +insights.hotjar.com, script.hotjar.com, static.hotjar.com, +stats.g.doubleclick.net, www.google-analytics.com, +www.googletagmanager.com and www.netigate.se. I extracted this by +asking <a href="http://phantomjs.org/">PhantomJS</a> to visit the +Stortinget web page and tell me all the URLs PhantomJS downloaded to +render the page (in HAR format using +<a href="https://github.com/ariya/phantomjs/blob/master/examples/netsniff.js">their +netsniff example</a>. I am very grateful to Gorm for showing me how +to do this). My goal is to visualize network traces to all IP +addresses behind these DNS names, do show where visitors personal +information is spread when visiting the page.</p> + +<p align="center"><a href="www.stortinget.no-geoip.kml"><img +src="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-geoip-small.png" alt="map of combined traces for URLs used by www.stortinget.no using GeoIP"/></a></p> + +<p>When I had a look around for options, I could not find any good +free software tools to do this, and decided I needed my own traceroute +wrapper outputting KML based on locations looked up using GeoIP. KML +is easy to work with and easy to generate, and understood by several +of the GIS tools I have available. I got good help from by NUUG +colleague Anders Einar with this, and the result can be seen in +<a href="https://github.com/petterreinholdtsen/kmltraceroute">my +kmltraceroute git repository</a>. Unfortunately, the quality of the +free GeoIP databases I could find (and the for-pay databases my +friends had access to) is not up to the task. The IP addresses of +central Internet infrastructure would typically be placed near the +controlling companies main office, and not where the router is really +located, as you can see from <a href="www.stortinget.no-geoip.kml">the +KML file I created</a> using the GeoLite City dataset from MaxMind. + +<p align="center"><a href="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-scapy.svg"><img +src="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-scapy-small.png" alt="scapy traceroute graph for URLs used by www.stortinget.no"/></a></p> + +<p>I also had a look at the visual traceroute graph created by +<a href="http://www.secdev.org/projects/scapy/">the scrapy project</a>, +showing IP network ownership (aka AS owner) for the IP address in +question. +<a href="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-scapy.svg">The +graph display a lot of useful information about the traceroute in SVG +format</a>, and give a good indication on who control the network +equipment involved, but it do not include geolocation. This graph +make it possible to see the information is made available at least for +UNINETT, Catchcom, Stortinget, Nordunet, Google, Amazon, Telia, Level +3 Communications and NetDNA.</p> + +<p align="center"><a href="https://geotraceroute.com/index.php?node=4&host=www.stortinget.no"><img +src="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-geotraceroute-small.png" alt="example geotraceroute view for www.stortinget.no"/></a></p> + +<p>In the process, I came across the +<a href="https://geotraceroute.com/">web service GeoTraceroute</a> by +Salim Gasmi. Its methology of combining guesses based on DNS names, +various location databases and finally use latecy times to rule out +candidate locations seemed to do a very good job of guessing correct +geolocation. But it could only do one trace at the time, did not have +a sensor in Norway and did not make the geolocations easily available +for postprocessing. So I contacted the developer and asked if he +would be willing to share the code (he refused until he had time to +clean it up), but he was interested in providing the geolocations in a +machine readable format, and willing to set up a sensor in Norway. So +since yesterday, it is possible to run traces from Norway in this +service thanks to a sensor node set up by +<a href="https://www.nuug.no/">the NUUG assosiation</a>, and get the +trace in KML format for further processing.</p> + +<p align="center"><a href="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-geotraceroute-kml-join.kml"><img +src="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-geotraceroute-kml-join.png" alt="map of combined traces for URLs used by www.stortinget.no using geotraceroute"/></a></p> + +<p>Here we can see a lot of trafic passes Sweden on its way to +Denmark, Germany, Holland and Ireland. Plenty of places where the +Snowden confirmations verified the traffic is read by various actors +without your best interest as their top priority.</p> + +<p>Combining KML files is trivial using a text editor, so I could loop +over all the hosts behind the urls imported by www.stortinget.no and +ask for the KML file from GeoTraceroute, and create a combined KML +file with all the traces (unfortunately only one of the IP addresses +behind the DNS name is traced this time. To get them all, one would +have to request traces using IP number instead of DNS names from +GeoTraceroute). That might be the next step in this project.</p> + +<p>Armed with these tools, I find it a lot easier to figure out where +the IP traffic moves and who control the boxes involved in moving it. +And every time the link crosses for example the Swedish border, we can +be sure Swedish Signal Intelligence (FRA) is listening, as GCHQ do in +Britain and NSA in USA and cables around the globe. (Hm, what should +we tell them? :) Keep that in mind if you ever send anything +unencrypted over the Internet.</p> + +<p>PS: KML files are drawn using +<a href="http://ivanrublev.me/kml/">the KML viewer from Ivan +Rublev<a/>, as it was less cluttered than the local Linux application +Marble. There are heaps of other options too.</p> -</ul> - -<p>This change bring together patches for lsdvd in use in various -Linux and Unix distributions, as well as patches submitted to the -project the last nine years. Please check it out. :)</p> +<p>As usual, if you use Bitcoin and want to show your support of my +activities, please send Bitcoin donations to my address +<b><a href="bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b&label=PetterReinholdtsenBlog">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b</a></b>.</p>