X-Git-Url: http://pere.pagekite.me/gitweb/homepage.git/blobdiff_plain/51d98ae3ba2fce3ed076d15c5ec88521669bccbc..53798080ccfe7c0d9ad356a83ded5b219b186c9b:/blog/index.rss diff --git a/blog/index.rss b/blog/index.rss index 61b9d1e9c9..0a657f587a 100644 --- a/blog/index.rss +++ b/blog/index.rss @@ -7,767 +7,664 @@ - First Jessie based Debian Edu beta release - http://people.skolelinux.org/pere/blog/First_Jessie_based_Debian_Edu_beta_release.html - http://people.skolelinux.org/pere/blog/First_Jessie_based_Debian_Edu_beta_release.html - Sun, 26 Apr 2015 14:10:00 +0200 - <p>I am happy to report that the Debian Edu team sent out -<a href="https://lists.debian.org/debian-edu-announce/2015/04/msg00000.html">this -announcement today</a>:</p> - -<pre> -the Debian Edu / Skolelinux project is pleased to announce the first -*beta* release of Debian Edu "Jessie" 8.0+edu0~b1, which for the first -time is composed entirely of packages from the current Debian stable -release, Debian 8 "Jessie". - -(As most reading this will know, Debian "Jessie" hasn't actually been -released by now. The release is still in progress but should finish -later today ;) - -We expect to make a final release of Debian Edu "Jessie" in the coming -weeks, timed with the first point release of Debian Jessie. Upgrades -from this beta release of Debian Edu Jessie to the final release will -be possible and encouraged! - -Please report feedback to debian-edu@lists.debian.org and/or submit -bugs: http://wiki.debian.org/DebianEdu/HowTo/ReportBugs - -Debian Edu - sometimes also known as "Skolelinux" - is a complete -operating system for schools, universities and other -organisations. Through its pre- prepared installation profiles -administrators can install servers, workstations and laptops which -will work in harmony on the school network. With Debian Edu, the -teachers themselves or their technical support staff can roll out a -complete multi-user, multi-machine study environment within hours or -days. - -Debian Edu is already in use at several hundred schools all over the -world, particularly in Germany, Spain and Norway. Installations come -with hundreds of applications pre-installed, plus the whole Debian -archive of thousands of compatible packages within easy reach. - -For those who want to give Debian Edu Jessie a try, download and -installation instructions are available, including detailed -instructions in the manual explaining the first steps, such as setting -up a network or adding users. Please note that the password for the -user your prompted for during installation must have a length of at -least 5 characters! - -== Where to download == - -A multi-architecture CD / usbstick image (649 MiB) for network booting -can be downloaded at the following locations: - - http://ftp.skolelinux.org/skolelinux-cd/debian-edu-8.0+edu0~b1-CD.iso - rsync -avzP ftp.skolelinux.org::skolelinux-cd/debian-edu-8.0+edu0~b1-CD.iso . - -The SHA1SUM of this image is: 54a524d16246cddd8d2cfd6ea52f2dd78c47ee0a - -Alternatively an extended DVD / usbstick image (4.9 GiB) is also -available, with more software included (saving additional download -time): - - http://ftp.skolelinux.org/skolelinux-cd/debian-edu-8.0+edu0~b1-USB.iso - rsync -avzP ftp.skolelinux.org::skolelinux-cd/debian-edu-8.0+edu0~b1-USB.iso - -The SHA1SUM of this image is: fb1f1504a490c077a48653898f9d6a461cb3c636 - -Sources are available from the Debian archive, see -http://ftp.debian.org/debian-cd/8.0.0/source/ for some download -options. - -== Debian Edu Jessie manual in seven languages == - -Please see https://wiki.debian.org/DebianEdu/Documentation/Jessie/ for -the English version of the Debian Edu jessie manual. - -This manual has been fully translated to German, French, Italian, -Danish, Dutch and Norwegian Bokmål. A partly translated version exists -for Spanish. See http://maintainer.skolelinux.org/debian-edu-doc/ for -online version of the translated manual. - -More information about Debian 8 "Jessie" itself is provided in the -release notes and the installation manual: -- http://www.debian.org/releases/jessie/releasenotes -- http://www.debian.org/releases/jessie/installmanual - - -== Errata / known problems == - - It takes up to 15 minutes for a changed hostname to be updated via - DHCP (#780461). - - The hostname script fails to update LTSP server hostname (#783087). - -Workaround: run update-hostname-from-ip on the client to update the -hostname immediately. - -Check https://wiki.debian.org/DebianEdu/Status/Jessie for a possibly -more current and complete list. - -== Some more details about Debian Edu 8.0+edu0~b1 Codename Jessie released 2015-04-25 == - -=== Software updates === - -Everything which is new in Debian 8 Jessie, e.g.: - - * Linux kernel 3.16.7-ctk9; for the i386 architecture, support for - i486 processors has been dropped; oldest supported ones: i586 (like - Intel Pentium and AMD K5). - - * Desktop environments KDE Plasma Workspaces 4.11.13, GNOME 3.14, - Xfce 4.12, LXDE 0.5.6 - * new optional desktop environment: MATE 1.8 - * KDE Plasma Workspaces is installed by default; to choose one of - the others see the manual. - * the browsers Iceweasel 31 ESR and Chromium 41 - * LibreOffice 4.3.3 - * GOsa 2.7.4 - * LTSP 5.5.4 - * CUPS print system 1.7.5 - * new boot framework: systemd - * Educational toolbox GCompris 14.12 - * Music creator Rosegarden 14.02 - * Image editor Gimp 2.8.14 - * Virtual stargazer Stellarium 0.13.1 - * golearn 0.9 - * tuxpaint 0.9.22 - * New version of debian-installer from Debian Jessie. - * Debian Jessie includes about 43000 packages available for installation. - * More information about Debian 8 Jessie is provided in its release - notes and the installation manual, see the link above. - -=== Installation changes === - - Installations done via PXE now also install firmware automatically - for the hardware present. - -=== Fixed bugs === - -A number of bugs have been fixed in this release; the most noticeable -from a user perspective: - - * Inserting incorrect DNS information in Gosa will no longer break - DNS completely, but instead stop DNS updates until the incorrect - information is corrected (710362) - - * shutdown-at-night now shuts the system down if gdm3 is used (775608). - -=== Sugar desktop removed === - -As the Sugar desktop was removed from Debian Jessie, it is also not -available in Debian Edu jessie. - - -== About Debian Edu / Skolelinux == - -Debian Edu, also known as Skolelinux, is a Linux distribution based on -Debian providing an out-of-the box environment of a completely -configured school network. Directly after installation a school server -running all services needed for a school network is set up just -waiting for users and machines being added via GOsa², a comfortable -Web-UI. A netbooting environment is prepared using PXE, so after -initial installation of the main server from CD or USB stick all other -machines can be installed via the network. The provided school server -provides LDAP database and Kerberos authentication service, -centralized home directories, DHCP server, web proxy and many other -services. The desktop contains more than 60 educational software -packages and more are available from the Debian archive, and schools -can choose between KDE, GNOME, LXDE, Xfce and MATE desktop -environment. - -== About Debian == - -The Debian Project was founded in 1993 by Ian Murdock to be a truly -free community project. Since then the project has grown to be one of -the largest and most influential open source projects. Thousands of -volunteers from all over the world work together to create and -maintain Debian software. Available in 70 languages, and supporting a -huge range of computer types, Debian calls itself the universal -operating system. - -== Thanks == - -Thanks to everyone making Debian and Debian Edu / Skolelinux happen! -You rock. -</pre> + Detecting NFS hangs on Linux without hanging yourself... + http://people.skolelinux.org/pere/blog/Detecting_NFS_hangs_on_Linux_without_hanging_yourself___.html + http://people.skolelinux.org/pere/blog/Detecting_NFS_hangs_on_Linux_without_hanging_yourself___.html + Thu, 9 Mar 2017 15:20:00 +0100 + <p>Over the years, administrating thousand of NFS mounting linux +computers at the time, I often needed a way to detect if the machine +was experiencing NFS hang. If you try to use <tt>df</tt> or look at a +file or directory affected by the hang, the process (and possibly the +shell) will hang too. So you want to be able to detect this without +risking the detection process getting stuck too. It has not been +obvious how to do this. When the hang has lasted a while, it is +possible to find messages like these in dmesg:</p> + +<p><blockquote> +nfs: server nfsserver not responding, still trying +<br>nfs: server nfsserver OK +</blockquote></p> + +<p>It is hard to know if the hang is still going on, and it is hard to +be sure looking in dmesg is going to work. If there are lots of other +messages in dmesg the lines might have rotated out of site before they +are noticed.</p> + +<p>While reading through the nfs client implementation in linux kernel +code, I came across some statistics that seem to give a way to detect +it. The om_timeouts sunrpc value in the kernel will increase every +time the above log entry is inserted into dmesg. And after digging a +bit further, I discovered that this value show up in +/proc/self/mountstats on Linux.</p> + +<p>The mountstats content seem to be shared between files using the +same file system context, so it is enough to check one of the +mountstats files to get the state of the mount point for the machine. +I assume this will not show lazy umounted NFS points, nor NFS mount +points in a different process context (ie with a different filesystem +view), but that does not worry me.</p> + +<p>The content for a NFS mount point look similar to this:</p> + +<p><blockquote><pre> +[...] +device /dev/mapper/Debian-var mounted on /var with fstype ext3 +device nfsserver:/mnt/nfsserver/home0 mounted on /mnt/nfsserver/home0 with fstype nfs statvers=1.1 + opts: rw,vers=3,rsize=65536,wsize=65536,namlen=255,acregmin=3,acregmax=60,acdirmin=30,acdirmax=60,soft,nolock,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=129.240.3.145,mountvers=3,mountport=4048,mountproto=udp,local_lock=all + age: 7863311 + caps: caps=0x3fe7,wtmult=4096,dtsize=8192,bsize=0,namlen=255 + sec: flavor=1,pseudoflavor=1 + events: 61063112 732346265 1028140 35486205 16220064 8162542 761447191 71714012 37189 3891185 45561809 110486139 4850138 420353 15449177 296502 52736725 13523379 0 52182 9016896 1231 0 0 0 0 0 + bytes: 166253035039 219519120027 0 0 40783504807 185466229638 11677877 45561809 + RPC iostats version: 1.0 p/v: 100003/3 (nfs) + xprt: tcp 925 1 6810 0 0 111505412 111480497 109 2672418560317 0 248 53869103 22481820 + per-op statistics + NULL: 0 0 0 0 0 0 0 0 + GETATTR: 61063106 61063108 0 9621383060 6839064400 453650 77291321 78926132 + SETATTR: 463469 463470 0 92005440 66739536 63787 603235 687943 + LOOKUP: 17021657 17021657 0 3354097764 4013442928 57216 35125459 35566511 + ACCESS: 14281703 14290009 5 2318400592 1713803640 1709282 4865144 7130140 + READLINK: 125 125 0 20472 18620 0 1112 1118 + READ: 4214236 4214237 0 715608524 41328653212 89884 22622768 22806693 + WRITE: 8479010 8494376 22 187695798568 1356087148 178264904 51506907 231671771 + CREATE: 171708 171708 0 38084748 46702272 873 1041833 1050398 + MKDIR: 3680 3680 0 773980 993920 26 23990 24245 + SYMLINK: 903 903 0 233428 245488 6 5865 5917 + MKNOD: 80 80 0 20148 21760 0 299 304 + REMOVE: 429921 429921 0 79796004 61908192 3313 2710416 2741636 + RMDIR: 3367 3367 0 645112 484848 22 5782 6002 + RENAME: 466201 466201 0 130026184 121212260 7075 5935207 5961288 + LINK: 289155 289155 0 72775556 67083960 2199 2565060 2585579 + READDIR: 2933237 2933237 0 516506204 13973833412 10385 3190199 3297917 + READDIRPLUS: 1652839 1652839 0 298640972 6895997744 84735 14307895 14448937 + FSSTAT: 6144 6144 0 1010516 1032192 51 9654 10022 + FSINFO: 2 2 0 232 328 0 1 1 + PATHCONF: 1 1 0 116 140 0 0 0 + COMMIT: 0 0 0 0 0 0 0 0 + +device binfmt_misc mounted on /proc/sys/fs/binfmt_misc with fstype binfmt_misc +[...] +</pre></blockquote></p> + +<p>The key number to look at is the third number in the per-op list. +It is the number of NFS timeouts experiences per file system +operation. Here 22 write timeouts and 5 access timeouts. If these +numbers are increasing, I believe the machine is experiencing NFS +hang. Unfortunately the timeout value do not start to increase right +away. The NFS operations need to time out first, and this can take a +while. The exact timeout value depend on the setup. For example the +defaults for TCP and UDP mount points are quite different, and the +timeout value is affected by the soft, hard, timeo and retrans NFS +mount options.</p> + +<p>The only way I have been able to get working on Debian and RedHat +Enterprise Linux for getting the timeout count is to peek in /proc/. +But according to +<ahref="http://docs.oracle.com/cd/E19253-01/816-4555/netmonitor-12/index.html">Solaris +10 System Administration Guide: Network Services</a>, the 'nfsstat -c' +command can be used to get these timeout values. But this do not work +on Linux, as far as I can tell. I +<ahref="http://bugs.debian.org/857043">asked Debian about this</a>, +but have not seen any replies yet.</p> + +<p>Is there a better way to figure out if a Linux NFS client is +experiencing NFS hangs? Is there a way to detect which processes are +affected? Is there a way to get the NFS mount going quickly once the +network problem causing the NFS hang has been cleared? I would very +much welcome some clues, as we regularly run into NFS hangs.</p> - Debian Edu interview: Shirish Agarwal - http://people.skolelinux.org/pere/blog/Debian_Edu_interview__Shirish_Agarwal.html - http://people.skolelinux.org/pere/blog/Debian_Edu_interview__Shirish_Agarwal.html - Wed, 15 Apr 2015 09:20:00 +0200 - <p>It was a surprise to me to learn that project to create a complete -computer system for schools I've involved in, -<a href="http://www.skolelinux.org/">Debian Edu / Skolelinux</a>, was -being used in India. But apparently it is, and I managed to get an -interview with one of the friends of the project there, Shirish -Agarwal.</p> - -<p><strong>Who are you, and how do you spend your days?</strong></p> - -<p>My name is Shirish Agarwal. Based out of the educational and -historical city of Pune, from the western state of Maharashtra, India. -My bread comes from giving training, giving policy tips, -installations on free software to mom and pop shops in different -fields from Desktop publishing to retail shops as well as work with -few software start-ups as well.</p> - -<p><strong>How did you get in contact with the Skolelinux / Debian Edu -project?</strong></p> - -<p>It started innocently enough. I have been using Debian for a few -years and in one local minidebconf / debutsav I was asked if there was -anything for schools or education. I had worked / played with free -educational softwares such as Gcompris and Stellarium for my many -nieces and nephews so researched and found Debian Edu or Skolelinux as -it was known then. Since then I have started using the various -education meta-packages provided by the project.</p> - -<p><strong>What do you see as the advantages of Skolelinux / Debian -Edu?</strong></p> - -<p>It's closest I have seen where a package full of educational -software are packed, which are free and open (both literally and -figuratively). Even if I take the simplest software which is -gcompris, the number of activities therein are amazing. Another one of -the softwares that I have liked for a long time is stellarium. Even -pysycache is cool except for couple of issues I encountered -<a href="https://bugs.debian.org/781841">#781841</a> and -<a href="https://bugs.debian.org/781842">#781842</a>.</p> - -<p>I prefer software installed on the system over web based solutions, -as a web site can disappear any time but the software on disk has the -possibility of a larger life span. Of course with both it's more a -question if it has enough users who make it fun or sustainable or both -for the developer per-se.</p> - -<p><strong>What do you see as the disadvantages of Skolelinux / Debian -Edu?</strong></p> - -<p>I do see that the Debian Edu team seems to be short-handed and I -think more efforts should be made to make it popular and ask and take -help from people and the larger community wherever possible.</p> - -<p>I don't see any disadvantage to use Skolelinux apart from the fact -that most apps. are generic which is good or bad how you see it. -However, saying that I do acknowledge the fact that the canvas is -pretty big and there are lot of interesting ideas that could be done -but for reasons not known not done or if done I don't know about them. -Let me share some of the ideas (these are more upstream based but -still) I have had for a long time :</p> - -<p>1. Classical maths question of two trains in opposing directions -each running @x kmph/mph at y distance, when they will meet and how -far would each travel and similar questions like these. - -<p>The computer is a fantastic system where questions like these can -be drawn, animated and the methodology and answers teased out in -interactive manner. While sites such as the -<a href="http://mathforum.org/dr.math/faq/faq.two.trains.html">Ask -Dr. Math FAQ on The Two Trains problem</a> (as an example or point of -inspiration) can be used there is lot more that can be done. I dunno -if there is a free software which does something like this. The idea -being a blend of objects + animation + interaction which does -this. The whole interaction could be gamified with points or sounds or -colourful celebration whenever the user gets even part of the question -or/and methodology right. That would help reinforce good behaviour. -This understanding could be used to share/showcase everything from how -the first wheel came to be, to evolution to how astronomy started, -psychics and everything in-between.</p> - -<p>One specific idea in the train part was having the Linux mascot on -one train and the BSD or GNU mascot on the other train and they -meeting somewhere in-between. Characters from blender movies could -also be used.</p> - -<p>2. Loads of crossword-puzzles with reference to subjects: We have -enormous data sets in Wikipedia and Wikitionary. I don't think it -should be a big job to design crossword puzzles. Using categories and -sub-categories it should be doable to have Q&A single word answers -from the existing data-sets. What would make it easy or hard could be -the length of the word + existence of many or few vowels depending on -the user's input.</p> - -<p>3. Jigsaw puzzles - We already have a great software called -palapeli with number of slicers making it pretty interesting. What -needs to be done is to download large number of public domain and -copyleft images, tease and use IPTC tags to categorise them into -nature, history etc. and let it loose. This could turn to be really -huge collection of images. One source could be taken from -commons.wikimedia.org, others could be huge collection of royalty-free -stock photos. Potential is immense.</p> - -<p>Apart from this, free software suffers in two directions, we lag -both in development (of using new features per-se) and maintenance a -lot. This is more so in educational software as these applications -need to be timely and the opportunity cost of missing deadlines is -immense. If we are able to solve issues of funding for development and -maintenance of such software I don't see any big difficulties. I know -of few start-ups in and around India who would love to develop and -maintain such software if funding issues could be solved.</p> - -<p><strong>Which free software do you use daily?</strong></p> - -<p>That would be huge list. Some of the softwares are obviously apt, -aptitude, debdelta, leafpad, the shell of course (zsh nowadays), -quassel for IRC. In games I use shisen-sho while card-games are evenly -between kpat and Aiselriot. In desktops it's a tie between -gnome-flashback and mate.</p> - -<p><strong>Which strategy do you believe is the right one to use to -get schools to use free software?</strong></p> - -<p>I think it should first start with using specific FOSS apps. in -whatever environment they are. If it's MS-Windows or Mac so be it. -Once they are habitual with the apps. and there is buy-in from the -school management then it could be installed anywhere. Most of the -people now understand the concept of a repository because of the -various online stores so it isn't hard to convince on that front.</p> - -<p>What is harder is having enough people with technical skills and -passion to service them. If you get buy-in from one or two teachers -then ideas like above could also be asked to be done as a project as -well.</p> - -<p>I think where we fall short more than anything is in marketing. For -instance, Debian has this whole range of fonts in its archive but -there isn't even a page where all those different fonts in the La -Ipsum format could be tried out for newcomers.</p> - -<p>One of the issues faced constantly in installations is with updates -and upgrades. People have this myth that each update and upgrade -means the user interface will / has to change. I have seen this -innumerable times. That perhaps is one of the reasons which browsers -like Iceweasel / Firefox change user interfaces so much, not because -it might be needed or be functional but because people believe that -changed user interfaces are better. This, can easily be pointed with -the user interfaces changed with almost every MS-Windows and Mac OS -releases.</p> - -<p>The problems with Debian Edu for deployment are many. The biggest -is the huge gap between what is taught in schools and what Debian Edu -is aimed at. - -<p>Me and my friends did teach on week-ends in a government school for -around 2 years, and -<a href="https://flossexperiences.wordpress.com/2012/10/08/sharings/">gathered -some experience</a> there. Some of the things we learnt/discovered -there was :</p> - -<ol> - - <li>Most of the teachers are very territorial about their subjects - and they do not want you to teach anything out of the - portion/syllabus given.</li> - - <li>They want any activity on the system in accordance to whatever - is in the syllabus.</li> - - <li>There are huge barriers both with the English language and at - times with objects or whatever. An example, let's say in gcompris - you have objects falling down and you have to name them and let's - say the falling object is a hat or a fedora hat, this would not be - as recognizable as say a - <a href="https://en.wikipedia.org/wiki/Puneri_Pagadi">Puneri - Pagdi</a> so there is need to inject local objects, words wherever - possible. Especially for word-games there are so many hindi words - which have become part of english vocabulary (for instance in - parley), those could be made into a hinglish collection or - something but that is something for upstream to do.</li> - -</ol> + How does it feel to be wiretapped, when you should be doing the wiretapping... + http://people.skolelinux.org/pere/blog/How_does_it_feel_to_be_wiretapped__when_you_should_be_doing_the_wiretapping___.html + http://people.skolelinux.org/pere/blog/How_does_it_feel_to_be_wiretapped__when_you_should_be_doing_the_wiretapping___.html + Wed, 8 Mar 2017 11:50:00 +0100 + <p>So the new president in the United States of America claim to be +surprised to discover that he was wiretapped during the election +before he was elected president. He even claim this must be illegal. +Well, doh, if it is one thing the confirmations from Snowden +documented, it is that the entire population in USA is wiretapped, one +way or another. Of course the president candidates were wiretapped, +alongside the senators, judges and the rest of the people in USA.</p> + +<p>Next, the Federal Bureau of Investigation ask the Department of +Justice to go public rejecting the claims that Donald Trump was +wiretapped illegally. I fail to see the relevance, given that I am +sure the surveillance industry in USA believe they have all the legal +backing they need to conduct mass surveillance on the entire +world.</p> + +<p>There is even the director of the FBI stating that he never saw an +order requesting wiretapping of Donald Trump. That is not very +surprising, given how the FISA court work, with all its activity being +secret. Perhaps he only heard about it?</p> + +<p>What I find most sad in this story is how Norwegian journalists +present it. In a news reports the other day in the radio from the +Norwegian National broadcasting Company (NRK), I heard the journalist +claim that 'the FBI denies any wiretapping', while the reality is that +'the FBI denies any illegal wiretapping'. There is a fundamental and +important difference, and it make me sad that the journalists are +unable to grasp it.</p> + +<p><strong>Update 2017-03-13:</strong> Look like +<a href="https://theintercept.com/2017/03/13/rand-paul-is-right-nsa-routinely-monitors-americans-communications-without-warrants/">The +Intercept report that US Senator Rand Paul confirm what I state above</a>.</p> - I'm going to the Open Source Developers' Conference Nordic 2015! - http://people.skolelinux.org/pere/blog/I_m_going_to_the_Open_Source_Developers__Conference_Nordic_2015_.html - http://people.skolelinux.org/pere/blog/I_m_going_to_the_Open_Source_Developers__Conference_Nordic_2015_.html - Tue, 7 Apr 2015 10:30:00 +0200 - <p>I am happy to let you all know that I'm going to the <a -href="http://act.osdc.no/osdc2015no/">Open Source Developers' -Conference Nordic 2015</a>!</p> - -<p>It take place Friday 8th to Sunday 10th of May in Oslo next to -where I work, and I finally got around to submitting -<a href="http://act.osdc.no/osdc2015no/talk/6192">a talk proposal for -it</a> (dead link for most people until the talk is accepted). As -part of my involvement with the -<a href="http://www.nuug.no/">Norwegian Unix User Group member -association</a> I have been slightly involved in the planning of this -conference for a while now, with a focus on organising a Civic Hacking -Hackathon with our friends -over at <a href="http://www.mysociety.org/">mySociety</a> and -<a href="http://www.holderdeord.no/">Holder de ord</a>. This part is -named the 'My Society' track in the program. There is still space for -more talks and participants. I hope to see you there.</p> - -<p>Check out <a href="http://act.osdc.no/osdc2015no/talks">the talks -submitted and accepted so far</a>.</p> + Norwegian Bokmål translation of The Debian Administrator's Handbook complete, proofreading in progress + http://people.skolelinux.org/pere/blog/Norwegian_Bokm_l_translation_of_The_Debian_Administrator_s_Handbook_complete__proofreading_in_progress.html + http://people.skolelinux.org/pere/blog/Norwegian_Bokm_l_translation_of_The_Debian_Administrator_s_Handbook_complete__proofreading_in_progress.html + Fri, 3 Mar 2017 14:50:00 +0100 + <p>For almost a year now, we have been working on making a Norwegian +Bokmål edition of <a href="https://debian-handbook.info/">The Debian +Administrator's Handbook</a>. Now, thanks to the tireless effort of +Ole-Erik, Ingrid and Andreas, the initial translation is complete, and +we are working on the proof reading to ensure consistent language and +use of correct computer science terms. The plan is to make the book +available on paper, as well as in electronic form. For that to +happen, the proof reading must be completed and all the figures need +to be translated. If you want to help out, get in touch.</p> + +<p><a href="http://people.skolelinux.org/pere/debian-handbook/debian-handbook-nb-NO.pdf">A + +fresh PDF edition</a> in A4 format (the final book will have smaller +pages) of the book created every morning is available for +proofreading. If you find any errors, please +<a href="https://hosted.weblate.org/projects/debian-handbook/">visit +Weblate and correct the error</a>. The +<a href="http://l.github.io/debian-handbook/stat/nb-NO/index.html">state +of the translation including figures</a> is a useful source for those +provide Norwegian bokmål screen shots and figures.</p> - Proof reading the Norwegian translation of Free Culture by Lessig - http://people.skolelinux.org/pere/blog/Proof_reading_the_Norwegian_translation_of_Free_Culture_by_Lessig.html - http://people.skolelinux.org/pere/blog/Proof_reading_the_Norwegian_translation_of_Free_Culture_by_Lessig.html - Sat, 4 Apr 2015 09:30:00 +0200 - <p>During eastern I had some time to continue working on the Norwegian -<a href="http://www.docbook.org/">docbook</a> version of the 2004 book -<a href="http://free-culture.cc/">Free Culture</a> by Lawrence Lessig. -At the moment I am proof reading the finished text, looking for typos, -inconsistent wordings and sentences that do not flow as they should. -I'm more than two thirds done with the text, and welcome others to -check the text up to chapter 13. The current status is available on the -<a href="https://github.com/petterreinholdtsen/free-culture-lessig">github</a> -project pages. You can also check out the -<a href="https://github.com/petterreinholdtsen/free-culture-lessig/blob/master/archive/freeculture.nb.pdf?raw=true">PDF</a>, -<a href="https://github.com/petterreinholdtsen/free-culture-lessig/blob/master/archive/freeculture.nb.epub?raw=true">EPUB</a> -and HTML version available in the -<a href="https://github.com/petterreinholdtsen/free-culture-lessig/tree/master/archive">archive -directory</a>.</p> - -<p>Please report typos, bugs and improvements to the github project if -you find any.</p> + Unlimited randomness with the ChaosKey? + http://people.skolelinux.org/pere/blog/Unlimited_randomness_with_the_ChaosKey_.html + http://people.skolelinux.org/pere/blog/Unlimited_randomness_with_the_ChaosKey_.html + Wed, 1 Mar 2017 20:50:00 +0100 + <p>A few days ago I ordered a small batch of +<a href="http://altusmetrum.org/ChaosKey/">the ChaosKey</a>, a small +USB dongle for generating entropy created by Bdale Garbee and Keith +Packard. Yesterday it arrived, and I am very happy to report that it +work great! According to its designers, to get it to work out of the +box, you need the Linux kernel version 4.1 or later. I tested on a +Debian Stretch machine (kernel version 4.9), and there it worked just +fine, increasing the available entropy very quickly. I wrote a small +test oneliner to test. It first print the current entropy level, +drain /dev/random, and then print the entropy level for five seconds. +Here is the situation without the ChaosKey inserted:</p> + +<blockquote><pre> +% cat /proc/sys/kernel/random/entropy_avail; \ + dd bs=1M if=/dev/random of=/dev/null count=1; \ + for n in $(seq 1 5); do \ + cat /proc/sys/kernel/random/entropy_avail; \ + sleep 1; \ + done +300 +0+1 oppføringer inn +0+1 oppføringer ut +28 byte kopiert, 0,000264565 s, 106 kB/s +4 +8 +12 +17 +21 +% +</pre></blockquote> + +<p>The entropy level increases by 3-4 every second. In such case any +application requiring random bits (like a HTTPS enabled web server) +will halt and wait for more entrpy. And here is the situation with +the ChaosKey inserted:</p> + +<blockquote><pre> +% cat /proc/sys/kernel/random/entropy_avail; \ + dd bs=1M if=/dev/random of=/dev/null count=1; \ + for n in $(seq 1 5); do \ + cat /proc/sys/kernel/random/entropy_avail; \ + sleep 1; \ + done +1079 +0+1 oppføringer inn +0+1 oppføringer ut +104 byte kopiert, 0,000487647 s, 213 kB/s +433 +1028 +1031 +1035 +1038 +% +</pre></blockquote> + +<p>Quite the difference. :) I bought a few more than I need, in case +someone want to buy one here in Norway. :)</p> + +<p>Update: The dongle was presented at Debconf last year. You might +find <a href="https://debconf16.debconf.org/talks/94/">the talk +recording illuminating</a>. It explains exactly what the source of +randomness is, if you are unable to spot it from the schema drawing +available from the ChaosKey web site linked at the start of this blog +post.</p> - Frikanalen, Norwegian TV channel for technical topics - http://people.skolelinux.org/pere/blog/Frikanalen__Norwegian_TV_channel_for_technical_topics.html - http://people.skolelinux.org/pere/blog/Frikanalen__Norwegian_TV_channel_for_technical_topics.html - Mon, 9 Mar 2015 11:10:00 +0100 - <p>The <a href="http://www.nuug.no/">Norwegian Unix User Group</a>, -where I am a member, and where people interested in free software, -open standards and UNIX like operating systems like Linux and the BSDs -come together, record our monthly technical presentations on video. -The purpose is to document the talks and spread them to a wider -audience. For this, the the Norwegian nationwide open channel -<a href="http://www.frikanalen.no/">Frikanalen</a> is a useful venue. -Since a few days ago, when I figured out the -<a href="http://beta.frikanalen.no/api/">REST API</a> to program the -<a href="http://beta.frikanalen.tv/guide/">channel time schedule</a>, -the channel has been filled with NUUG talks, related recordings and -some Creative Commons licensed TED talks (from archive.org). I fill -all "leftover bits" on the channel with content from NUUG, which at -the moment is almost 17 of 24 hours every day.</p> - -<p>The list of NUUG videos -<a href="http://beta.frikanalen.tv/organization/82">uploaded so far</a> -include things like a -<a href="http://beta.frikanalen.tv/video/625090">one hour talk by John -Perry Barlow when he visited Oslo</a>, a presentation of -<a href="http://beta.frikanalen.tv/video/624275">Haiku, the BeOS -re-implementation</a>, the -<a href="http://beta.frikanalen.tv/video/624493">history of FiksGataMi, -the Norwegian version of FixMyStreet</a>, the good old -<a href="http://beta.frikanalen.tv/video/623566">Warriors of the net -video</A> and many others.</p> - -<p>We have a large backlog of NUUG talks not yet uploaded to -Frikanalen, and plan to upload every useful bit to the channel to -spread the word there. I also hope to find useful recordings from the -Chaos Computer Club and Debian conferences and spread them on the -channel as well. But this require locating the videos and their meta -information (title, description, license, etc), and preparing the -recordings for broadcast, and I have not yet had the spare time to -focus on this. Perhaps you want to help. Please join us on IRC, -<a href="irc://irc.freenode.net/%23nuug">#nuug on irc.freenode.net</a> -if you want to help make this happen.</p> - -<p>But as I said, already the channel is already almost exclusively -filled with technical topics, and if you want to learn something new -today, check out the <a href="http://www.frikanalen.tv/se">Ogg Theora -web stream</a> or use one of the other ways to get access to the -channel. Unfortunately the Ogg Theora recoding for distribution still -do not properly sync the video and sound. It is generated by recoding -a internal MPEG transport stream with MPEG4 coded video (ie H.264) to -Ogg Theora / Vorbis, and we have not been able to find a way that -produces acceptable quality. Help needed, please get in touch if you -know how to fix it using free software.</p> + Detect OOXML files with undefined behaviour? + http://people.skolelinux.org/pere/blog/Detect_OOXML_files_with_undefined_behaviour_.html + http://people.skolelinux.org/pere/blog/Detect_OOXML_files_with_undefined_behaviour_.html + Tue, 21 Feb 2017 00:20:00 +0100 + <p>I just noticed +<a href="http://www.arkivrad.no/aktuelt/riksarkivarens-forskrift-pa-horing">the +new Norwegian proposal for archiving rules in the goverment</a> list +<a href="http://www.ecma-international.org/publications/standards/Ecma-376.htm">ECMA-376</a> +/ ISO/IEC 29500 (aka OOXML) as valid formats to put in long term +storage. Luckily such files will only be accepted based on +pre-approval from the National Archive. Allowing OOXML files to be +used for long term storage might seem like a good idea as long as we +forget that there are plenty of ways for a "valid" OOXML document to +have content with no defined interpretation in the standard, which +lead to a question and an idea.</p> + +<p>Is there any tool to detect if a OOXML document depend on such +undefined behaviour? It would be useful for the National Archive (and +anyone else interested in verifying that a document is well defined) +to have such tool available when considering to approve the use of +OOXML. I'm aware of the +<a href="https://github.com/arlm/officeotron/">officeotron OOXML +validator</a>, but do not know how complete it is nor if it will +report use of undefined behaviour. Are there other similar tools +available? Please send me an email if you know of any such tool.</p> - The Citizenfour documentary on the Snowden confirmations to Norway - http://people.skolelinux.org/pere/blog/The_Citizenfour_documentary_on_the_Snowden_confirmations_to_Norway.html - http://people.skolelinux.org/pere/blog/The_Citizenfour_documentary_on_the_Snowden_confirmations_to_Norway.html - Sat, 28 Feb 2015 22:10:00 +0100 - <p>Today I was happy to learn that the documentary -<a href="https://citizenfourfilm.com/">Citizenfour</a> by -<a href="https://en.wikipedia.org/wiki/Laura_Poitras">Laura Poitras</a> -finally will show up in Norway. According to the magazine -<a href="http://montages.no/">Montages</a>, a deal has finally been -made for -<a href="http://montages.no/nyheter/snowden-dokumentaren-citizenfour-far-norsk-kinodistribusjon/">Cinema -distribution in Norway</a> and the movie will have its premiere soon. -This is great news. As part of my involvement with -<a href="http://www.nuug.no/">the Norwegian Unix User Group</a>, me and -a friend have -<a href="http://www.nuug.no/news/Dokumentar_om_Snowdenbekreftelsene_til_Norge_.shtml">tried -to get the movie to Norway</a> ourselves, but obviously -<a href="http://www.nuug.no/news/Dokumentar_om_Snowdenbekreftelsene_endelig_til_Norge_.shtml">we -were too late</a> and Tor Fosse beat us to it. I am happy he did, as -the movie will make its way to the public and we do not have to make -it happen ourselves. -<a href="https://www.youtube.com/watch?v=XiGwAvd5mvM">The trailer</a> -can be seen on youtube, if you are curious what kind of film this -is.</p> - -<p>The whistle blower Edward Snowden really deserve political asylum -here in Norway, but I am afraid he would not be safe.</p> + Ruling ignored our objections to the seizure of popcorn-time.no (#domstolkontroll) + http://people.skolelinux.org/pere/blog/Ruling_ignored_our_objections_to_the_seizure_of_popcorn_time_no___domstolkontroll_.html + http://people.skolelinux.org/pere/blog/Ruling_ignored_our_objections_to_the_seizure_of_popcorn_time_no___domstolkontroll_.html + Mon, 13 Feb 2017 21:30:00 +0100 + <p>A few days ago, we received the ruling from +<a href="http://people.skolelinux.org/pere/blog/A_day_in_court_challenging_seizure_of_popcorn_time_no_for__domstolkontroll.html">my +day in court</a>. The case in question is a challenge of the seizure +of the DNS domain popcorn-time.no. The ruling simply did not mention +most of our arguments, and seemed to take everything ØKOKRIM said at +face value, ignoring our demonstration and explanations. But it is +hard to tell for sure, as we still have not seen most of the documents +in the case and thus were unprepared and unable to contradict several +of the claims made in court by the opposition. We are considering an +appeal, but it is partly a question of funding, as it is costing us +quite a bit to pay for our lawyer. If you want to help, please +<a href="http://www.nuug.no/dns-beslag-donasjon.shtml">donate to the +NUUG defense fund</a>.</p> + +<p>The details of the case, as far as we know it, is available in +Norwegian from +<a href="https://www.nuug.no/news/tags/dns-domenebeslag/">the NUUG +blog</a>. This also include +<a href="https://www.nuug.no/news/Avslag_etter_rettslig_h_ring_om_DNS_beslaget___vurderer_veien_videre.shtml">the +ruling itself</a>.</p> - The Norwegian open channel Frikanalen - 24x7 on the Internet - http://people.skolelinux.org/pere/blog/The_Norwegian_open_channel_Frikanalen___24x7_on_the_Internet.html - http://people.skolelinux.org/pere/blog/The_Norwegian_open_channel_Frikanalen___24x7_on_the_Internet.html - Wed, 25 Feb 2015 09:10:00 +0100 - <p>The Norwegian nationwide open channel -<a href="http://www.frikanalen.no/">Frikanalen</a> is still going -strong. It allow everyone to send the video they want on national -television. It is a TV station administrated completely using a web -browser, running only <ahref="https://github.com/Frikanalen">Free -Software</a>, providing <ahref="http://beta.frikanalen.tv/api">a REST -api</a> for administrators and members, and with distribution on the -national DVB-T distribution network RiksTV. But only between 12:00 -and 17:30 Norwegian time. This has finally changed, after many years -with limited distribution. A few weeks ago, we set up a Ogg Theora -stream via icecast to allow everyone with Internet access to check out -the channel the rest of the day. This is presented on -<a href="http://www.frikanalen.tv/se">the Frikanalen web site now</a>. And -since a few days ago, the channel is also available -via <a href="https://www.uninett.no/iptv-tilgang">multicast on -UNINETT</a>, available for those using IPTV TVs and set-top boxes in -the Norwegian National Research and Education network.</p> - -<p>If you want to see what is on the channel, point your media player -to one of these sources. The first should work with most players and -browsers, while as far as I know, the multicast UDP stream only work -with VLC.</p> - -<ul> - <li><a href="http://video.nuug.no/frikanalen.ogv">http://video.nuug.no/frikanalen.ogv</a></li> - <li>udp://@224.17.43.129:1234</li> -</ul> - -<p>The Ogg Theora / icecast stream is not working well, as the video -and audio is slightly out of sync. We have not been able to figure -out how to fix it. It is generated by recoding a internal MPEG -transport stream with MPEG4 coded video (ie H.264) to Ogg Theora / -Vorbis, and the result is less then stellar. If you have ideas how to -fix it, please let us know on frikanalen (at) nuug.no. We currently -use this with ffmpeg2theora 0.29:</p> - -<blockquote><pre> -./ffmpeg2theora.linux &lt;OBE_gemini_URL.ts&gt; -F 25 -x 720 -y 405 \ - --deinterlace --inputfps 25 -c 1 -H 48000 --keyint 8 --buf-delay 100 \ - --nosync -V 700 -o - | oggfwd video.nuug.no 8000 &lt;pw&gt; /frikanalen.ogv -</pre></blockquote> - -<p>If you get the multicast UDP stream working, please let me know, as -I am curious how far the multicast stream reach. It do not make it to -my home network, nor any other commercially available network in -Norway that I am aware of.</p> + A day in court challenging seizure of popcorn-time.no for #domstolkontroll + http://people.skolelinux.org/pere/blog/A_day_in_court_challenging_seizure_of_popcorn_time_no_for__domstolkontroll.html + http://people.skolelinux.org/pere/blog/A_day_in_court_challenging_seizure_of_popcorn_time_no_for__domstolkontroll.html + Fri, 3 Feb 2017 11:10:00 +0100 + <p align="center"><img width="70%" src="http://people.skolelinux.org/pere/blog/images/2017-02-01-popcorn-time-in-court.jpeg"></p> + +<p>On Wednesday, I spent the entire day in court in Follo Tingrett +representing <a href="https://www.nuug.no/">the member association +NUUG</a>, alongside <a href="https://www.efn.no/">the member +association EFN</a> and <a href="http://www.imc.no">the DNS registrar +IMC</a>, challenging the seizure of the DNS name popcorn-time.no. It +was interesting to sit in a court of law for the first time in my +life. Our team can be seen in the picture above: attorney Ola +Tellesbø, EFN board member Tom Fredrik Blenning, IMC CEO Morten Emil +Eriksen and NUUG board member Petter Reinholdtsen.</p> + +<p><a href="http://www.domstol.no/no/Enkelt-domstol/follo-tingrett/Nar-gar-rettssaken/Beramming/?cid=AAAA1701301512081262234UJFBVEZZZZZEJBAvtale">The +case at hand</a> is that the Norwegian National Authority for +Investigation and Prosecution of Economic and Environmental Crime (aka +Økokrim) decided on their own, to seize a DNS domain early last +year, without following +<a href="https://www.norid.no/no/regelverk/navnepolitikk/#link12">the +official policy of the Norwegian DNS authority</a> which require a +court decision. The web site in question was a site covering Popcorn +Time. And Popcorn Time is the name of a technology with both legal +and illegal applications. Popcorn Time is a client combining +searching a Bittorrent directory available on the Internet with +downloading/distribute content via Bittorrent and playing the +downloaded content on screen. It can be used illegally if it is used +to distribute content against the will of the right holder, but it can +also be used legally to play a lot of content, for example the +millions of movies +<a href="https://archive.org/details/movies">available from the +Internet Archive</a> or the collection +<a href="http://vodo.net/films/">available from Vodo</a>. We created +<a href="magnet:?xt=urn:btih:86c1802af5a667ca56d3918aecb7d3c0f7173084&dn=PresentasjonFolloTingrett.mov&tr=udp%3A%2F%2Fpublic.popcorn-tracker.org%3A6969%2Fannounce">a +video demonstrating legally use of Popcorn Time</a> and played it in +Court. It can of course be downloaded using Bittorrent.</p> + +<p>I did not quite know what to expect from a day in court. The +government held on to their version of the story and we held on to +ours, and I hope the judge is able to make sense of it all. We will +know in two weeks time. Unfortunately I do not have high hopes, as +the Government have the upper hand here with more knowledge about the +case, better training in handling criminal law and in general higher +standing in the courts than fairly unknown DNS registrar and member +associations. It is expensive to be right also in Norway. So far the +case have cost more than NOK 70 000,-. To help fund the case, NUUG +and EFN have asked for donations, and managed to collect around NOK 25 +000,- so far. Given the presentation from the Government, I expect +the government to appeal if the case go our way. And if the case do +not go our way, I hope we have enough funding to appeal.</p> + +<p>From the other side came two people from Økokrim. On the benches, +appearing to be part of the group from the government were two people +from the Simonsen Vogt Wiik lawyer office, and three others I am not +quite sure who was. Økokrim had proposed to present two witnesses +from The Motion Picture Association, but this was rejected because +they did not speak Norwegian and it was a bit late to bring in a +translator, but perhaps the two from MPA were present anyway. All +seven appeared to know each other. Good to see the case is take +seriously.</p> + +<p>If you, like me, believe the courts should be involved before a DNS +domain is hijacked by the government, or you believe the Popcorn Time +technology have a lot of useful and legal applications, I suggest you +too <a href="http://www.nuug.no/dns-beslag-donasjon.shtml">donate to +the NUUG defense fund</a>. Both Bitcoin and bank transfer are +available. If NUUG get more than we need for the legal action (very +unlikely), the rest will be spend promoting free software, open +standards and unix-like operating systems in Norway, so no matter what +happens the money will be put to good use.</p> + +<p>If you want to lean more about the case, I recommend you check out +<a href="https://www.nuug.no/news/tags/dns-domenebeslag/">the blog +posts from NUUG covering the case</a>. They cover the legal arguments +on both sides.</p> - En enklere Osloskolehverdag med automatisk sjekk av Fronter - http://people.skolelinux.org/pere/blog/En_enklere_Osloskolehverdag_med_automatisk_sjekk_av_Fronter.html - http://people.skolelinux.org/pere/blog/En_enklere_Osloskolehverdag_med_automatisk_sjekk_av_Fronter.html - Thu, 12 Feb 2015 10:30:00 +0100 - <p>En stund nå har jeg vært nødt til å forholde meg til -<a href="https://fronter.com/osloskoler/">Fronter</a>, en nettløsning -Osloskolen bruker for kontakt mellom hjem og skole. Løsningen -imponerer ikke, og det er lagt opp til at vi foreldre skal logge inn -regelmessig for å se om noe har endret seg. Idéen om å la folk stikke -innom nettsider for å se om det har skjedd endringer er så idiotisk at -jeg har lett etter et alternativ. Fronterløsningen har en innebygget -løsning der en kan abonnere på forsiden (som viser en oppsummering av -det en har tilgang til), og få tilsendt en kopi hver natt, men det -fjerner jo bare behovet for å stikke innom, ikke den idiotiske ideen -om at folk skal huske hvordan nettsiden så ut sist og oppdage hva som -er endret.</p> - -<p>For å gjøre livet enklere har jeg derfor brukt litt tid på å lage -et program som kobler seg opp og sjekker etter endringer automatisk, -slik at jeg kan få beskjed fra datamaskinen når noe endrer seg i -stedet for å forsøke å finne ut av det selv. I går ble scriptet -brukbart, og jeg er dermed klar til å dele det med deg.</p> - -<p>Jeg startet med å skrive programmet i Python, og hadde en versjon -som logget inn og hentet ned enkeltsider fra Fronter. Men -Fronter-websidene suger golfballer gjennom en hageslange, med -uleselig HTML, flere nivåer av iframes og en struktur på innholdet som -er svært vanskelig å finne ut av, så jeg ga til slutt opp lxml-parsing -med Python og forsøkte meg med WWW::Mechanize for Perl som jeg kjente -fra før. I ettertid har jeg oppdaget at WWW:Mechanize også finnes for -Python, så jeg kunne antagelig droppet språkbyttet. Men da jeg -oppdaget det hadde jeg kommet så langt med Perl-utgaven, så jeg hoppet -ikke tilbake.</p> - -<p>For å logge inn i Fronter besøker en enten skolens websider eller -den sentrale innloggingsiden <tt>https://fronter.com/osloskoler/</tt>. -Perl-koden for å logge inn ser slik ut:</p> - -<pre> -my $mech = WWW::Mechanize->new(); -$mech->get('https://fronter.com/osloskoler/'); -$mech->submit_form(fields => { - username => $username, - password => $password, -} ); -</pre> - -<p>Neste steg er å få oversikt over hvilke «rom» en har tilgang til. -På vår skole er det rom for skolen, biblioteket, elevrådet, -aktivitetsskolen og klasser der en har unger, og dette vil være -forskjellig fra person til person. Etter å ha romstert rundt i -Fronter-grensesnittet endel kom jeg over en grei HTML-side med -oversikt over rommene, -<tt>https://fronter.com/osloskoler/adm/projects.phtml?mode=displayRoomchooser</tt>, -så jeg bruker denne til å hente ut romoversikt med rom-ID.</p> - -<pre> -my %room; -$mech->get('https://fronter.com/osloskoler/adm/projects.phtml?mode=displayRoomchooser'); -for my $link ($mech->links()) { - my $url = $link->url(); - if ($url =~ m%/links/list_files.phtml\?edit=(\d+)$%) { - $room{$link->text()} = $1; - } -} -</pre> - -<p>Når en har rom-ID kan en slå opp websiden for rommet, som starter -på -<tt>https://fronter.com/osloskoler/contentframeset.phtml?goto_prjid=$ROMID</tt> -(der $ROMID byttes ut med rom-ID-tallet). Det gir en side med -iframes, og en må tre nivåer ned i iframes før en får tak i -HTML-informasjonen som vises frem når en ser på det aktuelle rommet. -Her ga jeg opp den robuste parsingen og hardkodet endel URL-er som i -stedet bør spores opp maskinelt. HTML-informasjonen som vises lagres -i en fil etter at økt- og innloggings-nøkkel er fjernet og deretter -bruker jeg <tt>lynx --dump --nolist</tt> for å hente ut en tekstlig -utgave av websiden. Denne tekstlige utgaven sammenlignes med forrige -versjon og oversikt over endringer kan så sendes ut på egnet vis.</p> - -<p>Jeg valgte å bruke git til å holde rede på endringer, så jeg -sjekker inn HTML og tekst-utgaver i git og bruker git til å vise frem -endringene i tekstutgavene. Programvaren for å gjøre dette er testet -på Debian GNU/Linux og kan -<a href="https://github.com/petterreinholdtsen/fronter-scraper-oslo">lastes -ned fra github</a>.</p> - -<p>For å bruke dette selv, kjør følgende kommandoer på din -Debian-maskin (forutsetter sudo-tilgang for installasjon av -programvare):</p> - -<pre> -sudo apt-get install git lynx-cur libio-prompter-perl libwww-mechanize-perl \ - libconfig-inifiles-perl -git clone https://github.com/petterreinholdtsen/fronter-scraper-oslo -cd fronter-scraper-oslo -./update-git -</pre> - -<p>Det gjenstår endel, men systemet er allerede nyttig for meg. Jeg -ønsker at systemet også skal laste ned PDF-er og slikt som er lagt ut -for nedlasting på sidene, slik at f.eks. ukeplaner kommer inn i -git-arkivet mitt automatisk og jeg får automatisk beskjed når ny -ukeplan er lagt ut. Kanskje du kan bidra med å få det på plass, eller -kanskje du har andre ting du vil fikse? Jeg tar gjerne imot endringer -og forbedringer. Det er mye som kan gjøres bedre, og scriptet er ikke -veldig robust mot endringer hos nettsidene til Fronter. Jeg regner -dermed med at det vil trengs oppdateringer jevnlig etter hvert som -Fronter-løsningen endrer seg.</p> + Nasjonalbiblioteket avslutter sin ulovlige bruk av Google Skjemaer + http://people.skolelinux.org/pere/blog/Nasjonalbiblioteket_avslutter_sin_ulovlige_bruk_av_Google_Skjemaer.html + http://people.skolelinux.org/pere/blog/Nasjonalbiblioteket_avslutter_sin_ulovlige_bruk_av_Google_Skjemaer.html + Thu, 12 Jan 2017 09:40:00 +0100 + <p>I dag fikk jeg en skikkelig gladmelding. Bakgrunnen er at før jul +arrangerte Nasjonalbiblioteket +<a href="http://www.nb.no/Bibliotekutvikling/Kunnskapsorganisering/Nasjonalt-verksregister/Seminar-om-verksregister">et +seminar om sitt knakende gode tiltak «verksregister»</a>. Eneste +måten å melde seg på dette seminaret var å sende personopplysninger +til Google via Google Skjemaer. Dette syntes jeg var tvilsom praksis, +da det bør være mulig å delta på seminarer arrangert av det offentlige +uten å måtte dele sine interesser, posisjon og andre +personopplysninger med Google. Jeg ba derfor om innsyn via +<a href="https://www.mimesbronn.no/">Mimes brønn</a> i +<a href="https://www.mimesbronn.no/request/personopplysninger_til_google_sk">avtaler +og vurderinger Nasjonalbiblioteket hadde rundt dette</a>. +Personopplysningsloven legger klare rammer for hva som må være på +plass før en kan be tredjeparter, spesielt i utlandet, behandle +personopplysninger på sine vegne, så det burde eksistere grundig +dokumentasjon før noe slikt kan bli lovlig. To jurister hos +Nasjonalbiblioteket mente først dette var helt i orden, og at Googles +standardavtale kunne brukes som databehandlingsavtale. Det syntes jeg +var merkelig, men har ikke hatt kapasitet til å følge opp saken før +for to dager siden.</p> + +<p>Gladnyheten i dag, som kom etter at jeg tipset Nasjonalbiblioteket +om at Datatilsynet underkjente Googles standardavtaler som +databehandleravtaler i 2011, er at Nasjonalbiblioteket har bestemt seg +for å avslutte bruken av Googles Skjemaer/Apps og gå i dialog med DIFI +for å finne bedre måter å håndtere påmeldinger i tråd med +personopplysningsloven. Det er fantastisk å se at av og til hjelper +det å spørre hva i alle dager det offentlige holder på med.</p> - Nude body scanner now present on Norwegian airport - http://people.skolelinux.org/pere/blog/Nude_body_scanner_now_present_on_Norwegian_airport.html - http://people.skolelinux.org/pere/blog/Nude_body_scanner_now_present_on_Norwegian_airport.html - Tue, 10 Feb 2015 15:20:00 +0100 - <p>Aftenposten, one of the largest newspapers in Norway, today report -that -<a href="http://www.aftenposten.no/reise/Slik-skannes-kroppen-din-i-fremtidens-sikkerhetskontroll-490666_1.snd">three -of the nude body scanners now is put to use at Gardermoen</a>, the -main airport in Norway. This way the travelers can have their body -photographed without cloths when visiting Norway. Of course this -horrible news is presented with a positive spin, stating that "now -travelers can move past the security check point faster and more -efficiently", but fail to mention that the machines in question take -pictures of their nude bodies and store them internally in the -computer, while only presenting sketch figure of the body to the -public. The article is written in a way that leave the impression -that the new machines do not take these nude pictures and only create -the sketch figures. In reality the same nude pictures are still -taken, but not presented to everyone. They are still available for -the owners of the system and the people doing maintenance of the -scanners, as long as they are taken and stored.</p> - -<p>Wikipedia have a more on -<a href="https://en.wikipedia.org/wiki/Full_body_scanner">Full body -scanners</a>, including example images and a summary of the -controversy about these scanners.</p> - -<p>Personally I will decline to use these machines, as I believe strip -searches of my body is a very intrusive attack on my privacy, and not -something everyone should have to accept to travel.</p> + Bryter NAV sin egen personvernerklæring? + http://people.skolelinux.org/pere/blog/Bryter_NAV_sin_egen_personvernerkl_ring_.html + http://people.skolelinux.org/pere/blog/Bryter_NAV_sin_egen_personvernerkl_ring_.html + Wed, 11 Jan 2017 06:50:00 +0100 + <p>Jeg leste med interesse en nyhetssak hos +<a href="http://www.digi.no/artikler/nav-avslorer-trygdemisbruk-ved-a-spore-ip-adresser/367394">digi.no</a> +og +<a href="https://www.nrk.no/buskerud/trygdesvindlere-avslores-av-utenlandske-ip-adresser-1.13313461">NRK</a> +om at det ikke bare er meg, men at også NAV bedriver geolokalisering +av IP-adresser, og at det gjøres analyse av IP-adressene til de som +sendes inn meldekort for å se om meldekortet sendes inn fra +utenlandske IP-adresser. Politiadvokat i Drammen, Hans Lyder Haare, +er sitert i NRK på at «De to er jo blant annet avslørt av +IP-adresser. At man ser at meldekortet kommer fra utlandet.»</p> + +<p>Jeg synes det er fint at det blir bedre kjent at IP-adresser +knyttes til enkeltpersoner og at innsamlet informasjon brukes til å +stedsbestemme personer også av aktører her i Norge. Jeg ser det som +nok et argument for å bruke +<a href="https://www.torproject.org/">Tor</a> så mye som mulig for å +gjøre gjøre IP-lokalisering vanskeligere, slik at en kan beskytte sin +privatsfære og unngå å dele sin fysiske plassering med +uvedkommede.</p> + +<P>Men det er en ting som bekymrer meg rundt denne nyheten. Jeg ble +tipset (takk #nuug) om +<a href="https://www.nav.no/no/NAV+og+samfunn/Kontakt+NAV/Teknisk+brukerstotte/Snarveier/personvernerkl%C3%A6ring-for-arbeids-og-velferdsetaten">NAVs +personvernerklæring</a>, som under punktet «Personvern og statistikk» +lyder:</p> + +<p><blockquote> + +<p>«Når du besøker nav.no, etterlater du deg elektroniske spor. Sporene +dannes fordi din nettleser automatisk sender en rekke opplysninger til +NAVs tjener (server-maskin) hver gang du ber om å få vist en side. Det +er eksempelvis opplysninger om hvilken nettleser og -versjon du +bruker, og din internettadresse (ip-adresse). For hver side som vises, +lagres følgende opplysninger:</p> + +<ul> +<li>hvilken side du ser på</li> +<li>dato og tid</li> +<li>hvilken nettleser du bruker</li> +<li>din ip-adresse</li> +</ul> + +<p>Ingen av opplysningene vil bli brukt til å identifisere +enkeltpersoner. NAV bruker disse opplysningene til å generere en +samlet statistikk som blant annet viser hvilke sider som er mest +populære. Statistikken er et redskap til å forbedre våre +tjenester.»</p> + +</blockquote></p> + +<p>Jeg klarer ikke helt å se hvordan analyse av de besøkendes +IP-adresser for å se hvem som sender inn meldekort via web fra en +IP-adresse i utlandet kan gjøres uten å komme i strid med påstanden om +at «ingen av opplysningene vil bli brukt til å identifisere +enkeltpersoner». Det virker dermed for meg som at NAV bryter sine +egen personvernerklæring, hvilket +<a href="http://people.skolelinux.org/pere/blog/Er_lover_brutt_n_r_personvernpolicy_ikke_stemmer_med_praksis_.html">Datatilsynet +fortalte meg i starten av desember antagelig er brudd på +personopplysningsloven</a>. + +<p>I tillegg er personvernerklæringen ganske misvisende i og med at +NAVs nettsider ikke bare forsyner NAV med personopplysninger, men i +tillegg ber brukernes nettleser kontakte fem andre nettjenere +(script.hotjar.com, static.hotjar.com, vars.hotjar.com, +www.google-analytics.com og www.googletagmanager.com), slik at +personopplysninger blir gjort tilgjengelig for selskapene Hotjar og +Google , og alle som kan lytte på trafikken på veien (som FRA, GCHQ og +NSA). Jeg klarer heller ikke se hvordan slikt spredning av +personopplysninger kan være i tråd med kravene i +personopplysningloven, eller i tråd med NAVs personvernerklæring.</p> + +<p>Kanskje NAV bør ta en nøye titt på sin personvernerklæring? Eller +kanskje Datatilsynet bør gjøre det?</p> - Nagios module to check if the Frikanalen video stream is working - http://people.skolelinux.org/pere/blog/Nagios_module_to_check_if_the_Frikanalen_video_stream_is_working.html - http://people.skolelinux.org/pere/blog/Nagios_module_to_check_if_the_Frikanalen_video_stream_is_working.html - Sun, 8 Feb 2015 13:00:00 +0100 - <p>When running a TV station with both broadcast and web stream -distribution, it is useful to know that the stream is working. As I -am involved in the Norwegian open channel -<a href="http://www.frikanalen.no/">Frikanalen</a> as part of my -activity in the <a href="http://www.nuug.no/">NUUG member -organisation</a>, I wrote a script to use mplayer to connect to a -video stream, pick two images 35 seconds apart and compare them. If -the images are missing or identical, something is probably wrong with -the stream and an alarm should be triggered. The script is written as -a Nagios plugin, allowing us to use Nagios to run the check regularly -and sound the alarm when something is wrong. It is able to detect -both a hanging and a broken video stream.</p> - -<p>I just uploaded the code for the script into the -<a href="https://github.com/Frikanalen/frikanalen/blob/master/nagios-plugin/check_video_stream_images">Frikanalen -git repository</a> on github. If you run a TV station with web -streaming, perhaps you can find it useful too.</p> - -<p>Last year, the Frikanalen public TV station transformed into using -only Linux based free software to administrate, schedule and -distribute the TV content. The -<a href="https://github.com/Frikanalen">source code for the entire TV -station</a> is available from the Github project page. Everyone can -use it to send their content on national TV, and we provide both a web -GUI and <a href="http://beta.frikanalen.tv/api/">a web API</a> to -<a href="http://beta.frikanalen.tv/login/?next=/members/video/">add</a> -and <a href="http://beta.frikanalen.tv/members/plan/">schedule -content</a>. And thanks to last weeks developer gathering and -following activity, we now have the schedule -<a href="http://beta.frikanalen.tv/xmltv/2015/01/01">available as -XMLTV</a> too. Still a lot of work left to do, especially with the -process to add videos and with the scheduling, so your contribution is -most welcome. Perhaps you want to set up your own TV station?</p> - -<p>Update 2015-02-25: Got a tip from Uninett about their -<a href="https://scm.uninett.no/maalepaaler/qstream/">qstream -monitoring system</a>, which gather connection time, jitter, packet -loss and burst bandwidth usage. It look useful to check if UDP -streams are working as they should.</p> + Where did that package go? &mdash; geolocated IP traceroute + http://people.skolelinux.org/pere/blog/Where_did_that_package_go___mdash__geolocated_IP_traceroute.html + http://people.skolelinux.org/pere/blog/Where_did_that_package_go___mdash__geolocated_IP_traceroute.html + Mon, 9 Jan 2017 12:20:00 +0100 + <p>Did you ever wonder where the web trafic really flow to reach the +web servers, and who own the network equipment it is flowing through? +It is possible to get a glimpse of this from using traceroute, but it +is hard to find all the details. Many years ago, I wrote a system to +map the Norwegian Internet (trying to figure out if our plans for a +network game service would get low enough latency, and who we needed +to talk to about setting up game servers close to the users. Back +then I used traceroute output from many locations (I asked my friends +to run a script and send me their traceroute output) to create the +graph and the map. The output from traceroute typically look like +this: + +<p><pre> +traceroute to www.stortinget.no (85.88.67.10), 30 hops max, 60 byte packets + 1 uio-gw10.uio.no (129.240.202.1) 0.447 ms 0.486 ms 0.621 ms + 2 uio-gw8.uio.no (129.240.24.229) 0.467 ms 0.578 ms 0.675 ms + 3 oslo-gw1.uninett.no (128.39.65.17) 0.385 ms 0.373 ms 0.358 ms + 4 te3-1-2.br1.fn3.as2116.net (193.156.90.3) 1.174 ms 1.172 ms 1.153 ms + 5 he16-1-1.cr1.san110.as2116.net (195.0.244.234) 2.627 ms he16-1-1.cr2.oslosda310.as2116.net (195.0.244.48) 3.172 ms he16-1-1.cr1.san110.as2116.net (195.0.244.234) 2.857 ms + 6 ae1.ar8.oslosda310.as2116.net (195.0.242.39) 0.662 ms 0.637 ms ae0.ar8.oslosda310.as2116.net (195.0.242.23) 0.622 ms + 7 89.191.10.146 (89.191.10.146) 0.931 ms 0.917 ms 0.955 ms + 8 * * * + 9 * * * +[...] +</pre></p> + +<p>This show the DNS names and IP addresses of (at least some of the) +network equipment involved in getting the data traffic from me to the +www.stortinget.no server, and how long it took in milliseconds for a +package to reach the equipment and return to me. Three packages are +sent, and some times the packages do not follow the same path. This +is shown for hop 5, where three different IP addresses replied to the +traceroute request.</p> + +<p>There are many ways to measure trace routes. Other good traceroute +implementations I use are traceroute (using ICMP packages) mtr (can do +both ICMP, UDP and TCP) and scapy (python library with ICMP, UDP, TCP +traceroute and a lot of other capabilities). All of them are easily +available in <a href="https://www.debian.org/">Debian</a>.</p> + +<p>This time around, I wanted to know the geographic location of +different route points, to visualize how visiting a web page spread +information about the visit to a lot of servers around the globe. The +background is that a web site today often will ask the browser to get +from many servers the parts (for example HTML, JSON, fonts, +JavaScript, CSS, video) required to display the content. This will +leak information about the visit to those controlling these servers +and anyone able to peek at the data traffic passing by (like your ISP, +the ISPs backbone provider, FRA, GCHQ, NSA and others).</p> + +<p>Lets pick an example, the Norwegian parliament web site +www.stortinget.no. It is read daily by all members of parliament and +their staff, as well as political journalists, activits and many other +citizens of Norway. A visit to the www.stortinget.no web site will +ask your browser to contact 8 other servers: ajax.googleapis.com, +insights.hotjar.com, script.hotjar.com, static.hotjar.com, +stats.g.doubleclick.net, www.google-analytics.com, +www.googletagmanager.com and www.netigate.se. I extracted this by +asking <a href="http://phantomjs.org/">PhantomJS</a> to visit the +Stortinget web page and tell me all the URLs PhantomJS downloaded to +render the page (in HAR format using +<a href="https://github.com/ariya/phantomjs/blob/master/examples/netsniff.js">their +netsniff example</a>. I am very grateful to Gorm for showing me how +to do this). My goal is to visualize network traces to all IP +addresses behind these DNS names, do show where visitors personal +information is spread when visiting the page.</p> + +<p align="center"><a href="www.stortinget.no-geoip.kml"><img +src="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-geoip-small.png" alt="map of combined traces for URLs used by www.stortinget.no using GeoIP"/></a></p> + +<p>When I had a look around for options, I could not find any good +free software tools to do this, and decided I needed my own traceroute +wrapper outputting KML based on locations looked up using GeoIP. KML +is easy to work with and easy to generate, and understood by several +of the GIS tools I have available. I got good help from by NUUG +colleague Anders Einar with this, and the result can be seen in +<a href="https://github.com/petterreinholdtsen/kmltraceroute">my +kmltraceroute git repository</a>. Unfortunately, the quality of the +free GeoIP databases I could find (and the for-pay databases my +friends had access to) is not up to the task. The IP addresses of +central Internet infrastructure would typically be placed near the +controlling companies main office, and not where the router is really +located, as you can see from <a href="www.stortinget.no-geoip.kml">the +KML file I created</a> using the GeoLite City dataset from MaxMind. + +<p align="center"><a href="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-scapy.svg"><img +src="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-scapy-small.png" alt="scapy traceroute graph for URLs used by www.stortinget.no"/></a></p> + +<p>I also had a look at the visual traceroute graph created by +<a href="http://www.secdev.org/projects/scapy/">the scrapy project</a>, +showing IP network ownership (aka AS owner) for the IP address in +question. +<a href="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-scapy.svg">The +graph display a lot of useful information about the traceroute in SVG +format</a>, and give a good indication on who control the network +equipment involved, but it do not include geolocation. This graph +make it possible to see the information is made available at least for +UNINETT, Catchcom, Stortinget, Nordunet, Google, Amazon, Telia, Level +3 Communications and NetDNA.</p> + +<p align="center"><a href="https://geotraceroute.com/index.php?node=4&host=www.stortinget.no"><img +src="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-geotraceroute-small.png" alt="example geotraceroute view for www.stortinget.no"/></a></p> + +<p>In the process, I came across the +<a href="https://geotraceroute.com/">web service GeoTraceroute</a> by +Salim Gasmi. Its methology of combining guesses based on DNS names, +various location databases and finally use latecy times to rule out +candidate locations seemed to do a very good job of guessing correct +geolocation. But it could only do one trace at the time, did not have +a sensor in Norway and did not make the geolocations easily available +for postprocessing. So I contacted the developer and asked if he +would be willing to share the code (he refused until he had time to +clean it up), but he was interested in providing the geolocations in a +machine readable format, and willing to set up a sensor in Norway. So +since yesterday, it is possible to run traces from Norway in this +service thanks to a sensor node set up by +<a href="https://www.nuug.no/">the NUUG assosiation</a>, and get the +trace in KML format for further processing.</p> + +<p align="center"><a href="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-geotraceroute-kml-join.kml"><img +src="http://people.skolelinux.org/pere/blog/images/2017-01-09-www.stortinget.no-geotraceroute-kml-join.png" alt="map of combined traces for URLs used by www.stortinget.no using geotraceroute"/></a></p> + +<p>Here we can see a lot of trafic passes Sweden on its way to +Denmark, Germany, Holland and Ireland. Plenty of places where the +Snowden confirmations verified the traffic is read by various actors +without your best interest as their top priority.</p> + +<p>Combining KML files is trivial using a text editor, so I could loop +over all the hosts behind the urls imported by www.stortinget.no and +ask for the KML file from GeoTraceroute, and create a combined KML +file with all the traces (unfortunately only one of the IP addresses +behind the DNS name is traced this time. To get them all, one would +have to request traces using IP number instead of DNS names from +GeoTraceroute). That might be the next step in this project.</p> + +<p>Armed with these tools, I find it a lot easier to figure out where +the IP traffic moves and who control the boxes involved in moving it. +And every time the link crosses for example the Swedish border, we can +be sure Swedish Signal Intelligence (FRA) is listening, as GCHQ do in +Britain and NSA in USA and cables around the globe. (Hm, what should +we tell them? :) Keep that in mind if you ever send anything +unencrypted over the Internet.</p> + +<p>PS: KML files are drawn using +<a href="http://ivanrublev.me/kml/">the KML viewer from Ivan +Rublev<a/>, as it was less cluttered than the local Linux application +Marble. There are heaps of other options too.</p> + +<p>As usual, if you use Bitcoin and want to show your support of my +activities, please send Bitcoin donations to my address +<b><a href="bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b&label=PetterReinholdtsenBlog">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b</a></b>.</p>