X-Git-Url: http://pere.pagekite.me/gitweb/homepage.git/blobdiff_plain/bb4d9ea49f1d44cdc1f3d37ce60ba313f79d8bad..2d047348b0dfe1d3bab7955e9bf9b52223e84373:/blog/index.html diff --git a/blog/index.html b/blog/index.html index 3d11f5139f..7ee76c94b8 100644 --- a/blog/index.html +++ b/blog/index.html @@ -20,257 +20,96 @@
-
What would it cost to store all phone calls in Norway?
-
1st May 2015
-

Many years ago, a friend of mine calculated how much it would cost -to store the sound of all phone calls in Norway, and came up with the -cost of around 20 million NOK (2.4 mill EUR) for all the calls in a -year. I got curious and wondered what the same calculation would look -like today. To do so one need an idea of how much data storage is -needed for each minute of sound, how many minutes all the calls in -Norway sums up to, and the cost of data storage.

- -

The 2005 numbers are from -digi.no, -the 2012 numbers are from -a -NKOM report, and I got the 2013 numbers after asking NKOM via -email. I was told the numbers for 2014 will be presented May 20th, -and decided not to wait for those, as I doubt they will be very -different from the numbers from 2013.

- -

The amount of data storage per minute sound depend on the wanted -quality, and for phone calls it is generally believed that 8 Kbit/s is -enough. See for example a -summary -on voice quality from Cisco for some alternatives. 8 Kbit/s is 60 -Kbytes/min, and this can be multiplied with the number of call minutes -to get the storage requirements.

- -

Storage prices varies a lot, depending on speed, backup strategies, -availability requirements etc. But a simple way to calculate can be -to use the price of a TiB-disk (around 1000 NOK / 120 EUR) and double -it to take space, power and redundancy into account. It could be much -higher with high speed and good redundancy requirements.

- -

But back to the question, What would it cost to store all phone -calls in Norway? Not much. Here is a small table showing the -estimated cost, which is within the budget constraint of most medium -and large organisations:

- - - - - - -
YearCall minutesSizePrice in NOK / EUR
200524 000 000 0001.3 PiB3 mill / 358 000
201218 000 000 0001.0 PiB2.2 mill / 262 000
201317 000 000 000950 TiB2.1 mill / 250 000
- -

This is the cost of buying the storage. Maintenance need to be -taken into account too, but calculating that is left as an exercise -for the reader. But it is obvious to me from those numbers that -recording the sound of all phone calls in Norway is not going to be -stopped because it is too expensive. I wonder if someone already is -collecting the data?

-
-
- - - Tags: english, personvern, surveillance. - - -
-
-
- -
-
First Jessie based Debian Edu beta release
-
26th April 2015
-

I am happy to report that the Debian Edu team sent out -this -announcement today:

- -
-the Debian Edu / Skolelinux project is pleased to announce the first
-*beta* release of Debian Edu "Jessie" 8.0+edu0~b1, which for the first
-time is composed entirely of packages from the current Debian stable
-release, Debian 8 "Jessie".
-
-(As most reading this will know, Debian "Jessie" hasn't actually been
-released by now. The release is still in progress but should finish
-later today ;)
-
-We expect to make a final release of Debian Edu "Jessie" in the coming
-weeks, timed with the first point release of Debian Jessie. Upgrades
-from this beta release of Debian Edu Jessie to the final release will
-be possible and encouraged!
-
-Please report feedback to debian-edu@lists.debian.org and/or submit
-bugs: http://wiki.debian.org/DebianEdu/HowTo/ReportBugs
-
-Debian Edu - sometimes also known as "Skolelinux" - is a complete
-operating system for schools, universities and other
-organisations. Through its pre- prepared installation profiles
-administrators can install servers, workstations and laptops which
-will work in harmony on the school network.  With Debian Edu, the
-teachers themselves or their technical support staff can roll out a
-complete multi-user, multi-machine study environment within hours or
-days.
-
-Debian Edu is already in use at several hundred schools all over the
-world, particularly in Germany, Spain and Norway. Installations come
-with hundreds of applications pre-installed, plus the whole Debian
-archive of thousands of compatible packages within easy reach.
-
-For those who want to give Debian Edu Jessie a try, download and
-installation instructions are available, including detailed
-instructions in the manual explaining the first steps, such as setting
-up a network or adding users.  Please note that the password for the
-user your prompted for during installation must have a length of at
-least 5 characters!
-
-== Where to download ==
-
-A multi-architecture CD / usbstick image (649 MiB) for network booting
-can be downloaded at the following locations:
-
-    http://ftp.skolelinux.org/skolelinux-cd/debian-edu-8.0+edu0~b1-CD.iso
-    rsync -avzP ftp.skolelinux.org::skolelinux-cd/debian-edu-8.0+edu0~b1-CD.iso . 
-
-The SHA1SUM of this image is: 54a524d16246cddd8d2cfd6ea52f2dd78c47ee0a
-
-Alternatively an extended DVD / usbstick image (4.9 GiB) is also
-available, with more software included (saving additional download
-time):
-
-    http://ftp.skolelinux.org/skolelinux-cd/debian-edu-8.0+edu0~b1-USB.iso
-    rsync -avzP ftp.skolelinux.org::skolelinux-cd/debian-edu-8.0+edu0~b1-USB.iso 
-
-The SHA1SUM of this image is: fb1f1504a490c077a48653898f9d6a461cb3c636
-
-Sources are available from the Debian archive, see
-http://ftp.debian.org/debian-cd/8.0.0/source/ for some download
-options.
-
-== Debian Edu Jessie manual in seven languages ==
-
-Please see https://wiki.debian.org/DebianEdu/Documentation/Jessie/ for
-the English version of the Debian Edu jessie manual.
-
-This manual has been fully translated to German, French, Italian,
-Danish, Dutch and Norwegian Bokmål. A partly translated version exists
-for Spanish.  See http://maintainer.skolelinux.org/debian-edu-doc/ for
-online version of the translated manual.
-
-More information about Debian 8 "Jessie" itself is provided in the
-release notes and the installation manual:
-- http://www.debian.org/releases/jessie/releasenotes
-- http://www.debian.org/releases/jessie/installmanual
-
-
-== Errata / known problems ==
-
-    It takes up to 15 minutes for a changed hostname to be updated via
-    DHCP (#780461).
-
-    The hostname script fails to update LTSP server hostname (#783087). 
+      
Simpler recipe on how to make a simple $7 IMSI Catcher using Debian

+      
 9th August 2017

+      
On friday, I came across an interesting article in the Norwegian
+web based ICT news magazine digi.no on
+how
+to collect the IMSI numbers of nearby cell phones using the cheap
+DVB-T software defined radios.  The article refered to instructions
+and a recipe by
+Keld Norman on Youtube on how to make a simple $7 IMSI Catcher, and I decided to test them out.

+
+
The instructions said to use Ubuntu, install pip using apt (to
+bypass apt), use pip to install pybombs (to bypass both apt and pip),
+and the ask pybombs to fetch and build everything you need from
+scratch.  I wanted to see if I could do the same on the most recent
+Debian packages, but this did not work because pybombs tried to build
+stuff that no longer build with the most recent openssl library or
+some other version skew problem.  While trying to get this recipe
+working, I learned that the apt->pip->pybombs route was a long detour,
+and the only piece of software dependency missing in Debian was the
+gr-gsm package.  I also found out that the lead upstream developer of
+gr-gsm (the name stand for GNU Radio GSM) project already had a set of
+Debian packages provided in an Ubuntu PPA repository.  All I needed to
+do was to dget the Debian source package and built it.

+
+
The IMSI collector is a python script listening for packages on the
+loopback network device and printing to the terminal some specific GSM
+packages with IMSI numbers in them.  The code is fairly short and easy
+to understand.  The reason this work is because gr-gsm include a tool
+to read GSM data from a software defined radio like a DVB-T USB stick
+and other software defined radios, decode them and inject them into a
+network device on your Linux machine (using the loopback device by
+default).  This proved to work just fine, and I've been testing the
+collector for a few days now.

+
+
The updated and simpler recipe is thus to

 
-Workaround: run update-hostname-from-ip on the client to update the
-hostname immediately.
-
-Check https://wiki.debian.org/DebianEdu/Status/Jessie for a possibly
-more current and complete list.
-
-== Some more details about Debian Edu 8.0+edu0~b1 Codename Jessie released 2015-04-25 ==
-
-=== Software updates ===
-
-Everything which is new in Debian 8 Jessie, e.g.:
-
- * Linux kernel 3.16.7-ctk9; for the i386 architecture, support for
-   i486 processors has been dropped; oldest supported ones: i586 (like
-   Intel Pentium and AMD K5).
-
- * Desktop environments KDE Plasma Workspaces 4.11.13, GNOME 3.14,
-   Xfce 4.12, LXDE 0.5.6
-   * new optional desktop environment: MATE 1.8
-   * KDE Plasma Workspaces is installed by default; to choose one of
-     the others see the manual.
- * the browsers Iceweasel 31 ESR and Chromium 41
- * LibreOffice 4.3.3
- * GOsa 2.7.4
- * LTSP 5.5.4
- * CUPS print system 1.7.5
- * new boot framework: systemd
- * Educational toolbox GCompris 14.12
- * Music creator Rosegarden 14.02
- * Image editor Gimp 2.8.14
- * Virtual stargazer Stellarium 0.13.1
- * golearn 0.9
- * tuxpaint 0.9.22
- * New version of debian-installer from Debian Jessie.
- * Debian Jessie includes about 43000 packages available for installation.
- * More information about Debian 8 Jessie is provided in its release
-   notes and the installation manual, see the link above.
-
-=== Installation changes ===
-
-    Installations done via PXE now also install firmware automatically
-    for the hardware present.
-
-=== Fixed bugs ===
-
-A number of bugs have been fixed in this release; the most noticeable
-from a user perspective:
-
- * Inserting incorrect DNS information in Gosa will no longer break
-   DNS completely, but instead stop DNS updates until the incorrect
-   information is corrected (710362)
-
- * shutdown-at-night now shuts the system down if gdm3 is used (775608). 
-
-=== Sugar desktop removed ===
-
-As the Sugar desktop was removed from Debian Jessie, it is also not
-available in Debian Edu jessie.
+
    
 
+
  1. start with a Debian machine running Stretch or newer,
    2. 
 
-== About Debian Edu / Skolelinux ==
+
  2. build and install the gr-gsm package available from
+http://ppa.launchpad.net/ptrkrysik/gr-gsm/ubuntu/pool/main/g/gr-gsm/,
    3. 
 
-Debian Edu, also known as Skolelinux, is a Linux distribution based on
-Debian providing an out-of-the box environment of a completely
-configured school network. Directly after installation a school server
-running all services needed for a school network is set up just
-waiting for users and machines being added via GOsa², a comfortable
-Web-UI. A netbooting environment is prepared using PXE, so after
-initial installation of the main server from CD or USB stick all other
-machines can be installed via the network. The provided school server
-provides LDAP database and Kerberos authentication service,
-centralized home directories, DHCP server, web proxy and many other
-services.  The desktop contains more than 60 educational software
-packages and more are available from the Debian archive, and schools
-can choose between KDE, GNOME, LXDE, Xfce and MATE desktop
-environment.
+
  3. clone the git repostory from https://github.com/Oros42/IMSI-catcher,
    4. 
 
-== About Debian ==
+
  4. run grgsm_livemon and adjust the frequency until the terminal
+where it was started is filled with a stream of text (meaning you
+found a GSM station).
    5. 
 
-The Debian Project was founded in 1993 by Ian Murdock to be a truly
-free community project. Since then the project has grown to be one of
-the largest and most influential open source projects. Thousands of
-volunteers from all over the world work together to create and
-maintain Debian software. Available in 70 languages, and supporting a
-huge range of computer types, Debian calls itself the universal
-operating system.
+
  5. go into the IMSI-catcher directory and run 'sudo python simple_IMSI-catcher.py' to extract the IMSI numbers.
    6. 
 
-== Thanks ==
+

 
-Thanks to everyone making Debian and Debian Edu / Skolelinux happen!
-You rock.
-
+

To make it even easier in the future to get this sniffer up and +running, I decided to package +the gr-gsm project +for Debian (WNPP +#871055), and the package was uploaded into the NEW queue today. +Luckily the gnuradio maintainer has promised to help me, as I do not +know much about gnuradio stuff yet.

+ +

I doubt this "IMSI cacher" is anywhere near as powerfull as +commercial tools like +The +Spy Phone Portable IMSI / IMEI Catcher or the +Harris +Stingray, but I hope the existance of cheap alternatives can make +more people realise how their whereabouts when carrying a cell phone +is easily tracked. Seeing the data flow on the screen, realizing that +I live close to a police station and knowing that the police is also +wearing cell phones, I wonder how hard it would be for criminals to +track the position of the police officers to discover when there are +police near by, or for foreign military forces to track the location +of the Norwegian military forces, or for anyone to track the location +of government officials...

+ +

It is worth noting that the data reported by the IMSI-catcher +script mentioned above is only a fraction of the data broadcasted on +the GSM network. It will only collect one frequency at the time, +while a typical phone will be using several frequencies, and not all +phones will be using the frequencies tracked by the grgsm_livemod +program. Also, there is a lot of radio chatter being ignored by the +simple_IMSI-catcher script, which would be collected by extending the +parser code. I wonder if gr-gsm can be set up to listen to more than +one frequency?

- Tags: debian edu, english. + Tags: debian, english, personvern, surveillance.
@@ -278,193 +117,37 @@ You rock.
-
Debian Edu interview: Shirish Agarwal
-
15th April 2015
-

It was a surprise to me to learn that project to create a complete -computer system for schools I've involved in, -Debian Edu / Skolelinux, was -being used in India. But apparently it is, and I managed to get an -interview with one of the friends of the project there, Shirish -Agarwal.

- -

Who are you, and how do you spend your days?

- -

My name is Shirish Agarwal. Based out of the educational and -historical city of Pune, from the western state of Maharashtra, India. -My bread comes from giving training, giving policy tips, -installations on free software to mom and pop shops in different -fields from Desktop publishing to retail shops as well as work with -few software start-ups as well.

- -

How did you get in contact with the Skolelinux / Debian Edu -project?

- -

It started innocently enough. I have been using Debian for a few -years and in one local minidebconf / debutsav I was asked if there was -anything for schools or education. I had worked / played with free -educational softwares such as Gcompris and Stellarium for my many -nieces and nephews so researched and found Debian Edu or Skolelinux as -it was known then. Since then I have started using the various -education meta-packages provided by the project.

- -

What do you see as the advantages of Skolelinux / Debian -Edu?

- -

It's closest I have seen where a package full of educational -software are packed, which are free and open (both literally and -figuratively). Even if I take the simplest software which is -gcompris, the number of activities therein are amazing. Another one of -the softwares that I have liked for a long time is stellarium. Even -pysycache is cool except for couple of issues I encountered -#781841 and -#781842.

- -

I prefer software installed on the system over web based solutions, -as a web site can disappear any time but the software on disk has the -possibility of a larger life span. Of course with both it's more a -question if it has enough users who make it fun or sustainable or both -for the developer per-se.

- -

What do you see as the disadvantages of Skolelinux / Debian -Edu?

- -

I do see that the Debian Edu team seems to be short-handed and I -think more efforts should be made to make it popular and ask and take -help from people and the larger community wherever possible.

- -

I don't see any disadvantage to use Skolelinux apart from the fact -that most apps. are generic which is good or bad how you see it. -However, saying that I do acknowledge the fact that the canvas is -pretty big and there are lot of interesting ideas that could be done -but for reasons not known not done or if done I don't know about them. -Let me share some of the ideas (these are more upstream based but -still) I have had for a long time :

- -

1. Classical maths question of two trains in opposing directions -each running @x kmph/mph at y distance, when they will meet and how -far would each travel and similar questions like these. - -

The computer is a fantastic system where questions like these can -be drawn, animated and the methodology and answers teased out in -interactive manner. While sites such as the -Ask -Dr. Math FAQ on The Two Trains problem (as an example or point of -inspiration) can be used there is lot more that can be done. I dunno -if there is a free software which does something like this. The idea -being a blend of objects + animation + interaction which does -this. The whole interaction could be gamified with points or sounds or -colourful celebration whenever the user gets even part of the question -or/and methodology right. That would help reinforce good behaviour. -This understanding could be used to share/showcase everything from how -the first wheel came to be, to evolution to how astronomy started, -psychics and everything in-between.

- -

One specific idea in the train part was having the Linux mascot on -one train and the BSD or GNU mascot on the other train and they -meeting somewhere in-between. Characters from blender movies could -also be used.

- -

2. Loads of crossword-puzzles with reference to subjects: We have -enormous data sets in Wikipedia and Wikitionary. I don't think it -should be a big job to design crossword puzzles. Using categories and -sub-categories it should be doable to have Q&A single word answers -from the existing data-sets. What would make it easy or hard could be -the length of the word + existence of many or few vowels depending on -the user's input.

- -

3. Jigsaw puzzles - We already have a great software called -palapeli with number of slicers making it pretty interesting. What -needs to be done is to download large number of public domain and -copyleft images, tease and use IPTC tags to categorise them into -nature, history etc. and let it loose. This could turn to be really -huge collection of images. One source could be taken from -commons.wikimedia.org, others could be huge collection of royalty-free -stock photos. Potential is immense.

- -

Apart from this, free software suffers in two directions, we lag -both in development (of using new features per-se) and maintenance a -lot. This is more so in educational software as these applications -need to be timely and the opportunity cost of missing deadlines is -immense. If we are able to solve issues of funding for development and -maintenance of such software I don't see any big difficulties. I know -of few start-ups in and around India who would love to develop and -maintain such software if funding issues could be solved.

- -

Which free software do you use daily?

- -

That would be huge list. Some of the softwares are obviously apt, -aptitude, debdelta, leafpad, the shell of course (zsh nowadays), -quassel for IRC. In games I use shisen-sho while card-games are evenly -between kpat and Aiselriot. In desktops it's a tie between -gnome-flashback and mate.

- -

Which strategy do you believe is the right one to use to -get schools to use free software?

- -

I think it should first start with using specific FOSS apps. in -whatever environment they are. If it's MS-Windows or Mac so be it. -Once they are habitual with the apps. and there is buy-in from the -school management then it could be installed anywhere. Most of the -people now understand the concept of a repository because of the -various online stores so it isn't hard to convince on that front.

- -

What is harder is having enough people with technical skills and -passion to service them. If you get buy-in from one or two teachers -then ideas like above could also be asked to be done as a project as -well.

- -

I think where we fall short more than anything is in marketing. For -instance, Debian has this whole range of fonts in its archive but -there isn't even a page where all those different fonts in the La -Ipsum format could be tried out for newcomers.

- -

One of the issues faced constantly in installations is with updates -and upgrades. People have this myth that each update and upgrade -means the user interface will / has to change. I have seen this -innumerable times. That perhaps is one of the reasons which browsers -like Iceweasel / Firefox change user interfaces so much, not because -it might be needed or be functional but because people believe that -changed user interfaces are better. This, can easily be pointed with -the user interfaces changed with almost every MS-Windows and Mac OS -releases.

- -

The problems with Debian Edu for deployment are many. The biggest -is the huge gap between what is taught in schools and what Debian Edu -is aimed at. - -

Me and my friends did teach on week-ends in a government school for -around 2 years, and -gathered -some experience there. Some of the things we learnt/discovered -there was :

- -
    - -
  1. Most of the teachers are very territorial about their subjects - and they do not want you to teach anything out of the - portion/syllabus given.
    2. - -
  2. They want any activity on the system in accordance to whatever - is in the syllabus.
    3. - -
  3. There are huge barriers both with the English language and at - times with objects or whatever. An example, let's say in gcompris - you have objects falling down and you have to name them and let's - say the falling object is a hat or a fedora hat, this would not be - as recognizable as say a - Puneri - Pagdi so there is need to inject local objects, words wherever - possible. Especially for word-games there are so many hindi words - which have become part of english vocabulary (for instance in - parley), those could be made into a hinglish collection or - something but that is something for upstream to do.
    4. - -
+
Norwegian Bokmål edition of Debian Administrator's Handbook is now available
+
25th July 2017
+

+ +

I finally received a copy of the Norwegian Bokmål edition of +"The Debian Administrator's +Handbook". This test copy arrived in the mail a few days ago, and +I am very happy to hold the result in my hand. We spent around one and a half year translating it. This paperbook edition +is available +from lulu.com. If you buy it quickly, you save 25% on the list +price. The book is also available for download in electronic form as +PDF, EPUB and Mobipocket, as can be +read online +as a web page.

+ +

This is the second book I publish (the first was the book +"Free Culture" by Lawrence Lessig +in +English, +French +and +Norwegian +Bokmål), and I am very excited to finally wrap up this +project. I hope +"Håndbok +for Debian-administratoren" will be well received.

- Tags: debian edu, english, intervju. + Tags: debian, debian-handbook, english.
@@ -472,33 +155,50 @@ there was :

-
I'm going to the Open Source Developers' Conference Nordic 2015!
-
7th April 2015
-

I am happy to let you all know that I'm going to the Open Source Developers' -Conference Nordic 2015!

- -

It take place Friday 8th to Sunday 10th of May in Oslo next to -where I work, and I finally got around to submitting -a talk proposal for -it (dead link for most people until the talk is accepted). As -part of my involvement with the -Norwegian Unix User Group member -association I have been slightly involved in the planning of this -conference for a while now, with a focus on organising a Civic Hacking -Hackathon with our friends -over at mySociety and -Holder de ord. This part is -named the 'My Society' track in the program. There is still space for -more talks and participants. I hope to see you there.

- -

Check out the talks -submitted and accepted so far.

+
«Rapporten ser ikke på informasjonssikkerhet knyttet til personlig integritet»
+
27th June 2017
+

Jeg kom over teksten +«Killing +car privacy by federal mandate» av Leonid Reyzin på Freedom to +Tinker i dag, og det gleder meg å se en god gjennomgang om hvorfor det +er et urimelig inngrep i privatsfæren å la alle biler kringkaste sin +posisjon og bevegelse via radio. Det omtalte forslaget basert på +Dedicated Short Range Communication (DSRC) kalles Basic Safety Message +(BSM) i USA og Cooperative Awareness Message (CAM) i Europa, og det +norske Vegvesenet er en av de som ser ut til å kunne tenke seg å +pålegge alle biler å fjerne nok en bit av innbyggernes privatsfære. +Anbefaler alle å lese det som står der. + +

Mens jeg tittet litt på DSRC på biler i Norge kom jeg over et sitat +jeg synes er illustrativt for hvordan det offentlige Norge håndterer +problemstillinger rundt innbyggernes privatsfære i SINTEF-rapporten +«Informasjonssikkerhet +i AutoPASS-brikker» av Trond Foss:

+ +

+«Rapporten ser ikke på informasjonssikkerhet knyttet til personlig + integritet.» +

+ +

Så enkelt kan det tydeligvis gjøres når en vurderer +informasjonssikkerheten. Det holder vel at folkene på toppen kan si +at «Personvernet er ivaretatt», som jo er den populære intetsigende +frasen som gjør at mange tror enkeltindividers integritet tas vare på. +Sitatet fikk meg til å undres på hvor ofte samme tilnærming, å bare se +bort fra behovet for personlig itegritet, blir valgt når en velger å +legge til rette for nok et inngrep i privatsfæren til personer i +Norge. Det er jo sjelden det får reaksjoner. Historien om +reaksjonene på Helse Sør-Østs tjenesteutsetting er jo sørgelig nok et +unntak og toppen av isfjellet, desverre. Tror jeg fortsatt takker nei +til både AutoPASS og holder meg så langt unna det norske helsevesenet +som jeg kan, inntil de har demonstrert og dokumentert at de verdsetter +individets privatsfære og personlige integritet høyere enn kortsiktig +gevist og samfunnsnytte.

- Tags: english, fiksgatami, nuug, offentlig innsyn. + Tags: norsk, personvern, sikkerhet.
@@ -506,25 +206,61 @@ submitted and accepted so far.

-
Proof reading the Norwegian translation of Free Culture by Lessig
-
4th April 2015
-

During eastern I had some time to continue working on the Norwegian -docbook version of the 2004 book -Free Culture by Lawrence Lessig. -At the moment I am proof reading the finished text, looking for typos, -inconsistent wordings and sentences that do not flow as they should. -I'm more than two thirds done with the text, and welcome others to -check the text up to chapter 13. The current status is available on the -github -project pages. You can also check out the -PDF, -EPUB -and HTML version available in the -archive -directory.

- -

Please report typos, bugs and improvements to the github project if -you find any.

+
Updated sales number for my Free Culture paper editions
+
12th June 2017
+

It is pleasing to see that the work we put down in publishing new +editions of the classic Free +Culture book by the founder of the Creative Commons movement, +Lawrence Lessig, is still being appreciated. I had a look at the +latest sales numbers for the paper edition today. Not too impressive, +but happy to see some buyers still exist. All the revenue from the +books is sent to the Creative +Commons Corporation, and they receive the largest cut if you buy +directly from Lulu. Most books are sold via Amazon, with Ingram +second and only a small fraction directly from Lulu. The ebook +edition is available for free from +Github.

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
Title / languageQuantity
2016 jan-jun2016 jul-dec2017 jan-may
Culture Libre / French3615
Fri kultur / Norwegian710
Free Culture / English142716
Total243431
+ +

A bit sad to see the low sales number on the Norwegian edition, and +a bit surprising the English edition still selling so well.

+ +

If you would like to translate and publish the book in your native +language, I would be happy to help make it happen. Please get in +touch.

@@ -537,61 +273,59 @@ you find any.

-
Frikanalen, Norwegian TV channel for technical topics
-
9th March 2015
-

The Norwegian Unix User Group, -where I am a member, and where people interested in free software, -open standards and UNIX like operating systems like Linux and the BSDs -come together, record our monthly technical presentations on video. -The purpose is to document the talks and spread them to a wider -audience. For this, the the Norwegian nationwide open channel -Frikanalen is a useful venue. -Since a few days ago, when I figured out the -REST API to program the -channel time schedule, -the channel has been filled with NUUG talks, related recordings and -some Creative Commons licensed TED talks (from archive.org). I fill -all "leftover bits" on the channel with content from NUUG, which at -the moment is almost 17 of 24 hours every day.

- -

The list of NUUG videos -uploaded so far -include things like a -one hour talk by John -Perry Barlow when he visited Oslo, a presentation of -Haiku, the BeOS -re-implementation, the -history of FiksGataMi, -the Norwegian version of FixMyStreet, the good old -Warriors of the net -video and many others.

- -

We have a large backlog of NUUG talks not yet uploaded to -Frikanalen, and plan to upload every useful bit to the channel to -spread the word there. I also hope to find useful recordings from the -Chaos Computer Club and Debian conferences and spread them on the -channel as well. But this require locating the videos and their meta -information (title, description, license, etc), and preparing the -recordings for broadcast, and I have not yet had the spare time to -focus on this. Perhaps you want to help. Please join us on IRC, -#nuug on irc.freenode.net -if you want to help make this happen.

- -

But as I said, already the channel is already almost exclusively -filled with technical topics, and if you want to learn something new -today, check out the Ogg Theora -web stream or use one of the other ways to get access to the -channel. Unfortunately the Ogg Theora recoding for distribution still -do not properly sync the video and sound. It is generated by recoding -a internal MPEG transport stream with MPEG4 coded video (ie H.264) to -Ogg Theora / Vorbis, and we have not been able to find a way that -produces acceptable quality. Help needed, please get in touch if you -know how to fix it using free software.

+
Release 0.1.1 of free software archive system Nikita announced
+
10th June 2017
+

I am very happy to report that the +Nikita Noark 5 +core project tagged its second release today. The free software +solution is an implementation of the Norwegian archive standard Noark +5 used by government offices in Norway. These were the changes in +version 0.1.1 since version 0.1.0 (from NEWS.md): + +

    + +
  • Continued work on the angularjs GUI, including document upload.
    • +
  • Implemented correspondencepartPerson, correspondencepartUnit and + correspondencepartInternal
    • +
  • Applied for coverity coverage and started submitting code on + regualr basis.
    • +
  • Started fixing bugs reported by coverity
    • +
  • Corrected and completed HATEOAS links to make sure entire API is + available via URLs in _links.
    • +
  • Corrected all relation URLs to use trailing slash.
    • +
  • Add initial support for storing data in ElasticSearch.
    • +
  • Now able to receive and store uploaded files in the archive.
    • +
  • Changed JSON output for object lists to have relations in _links.
    • +
  • Improve JSON output for empty object lists.
    • +
  • Now uses correct MIME type application/vnd.noark5-v4+json.
    • +
  • Added support for docker container images.
    • +
  • Added simple API browser implemented in JavaScript/Angular.
    • +
  • Started on archive client implemented in JavaScript/Angular.
    • +
  • Started on prototype to show the public mail journal.
    • +
  • Improved performance by disabling Sprint FileWatcher.
    • +
  • Added support for 'arkivskaper', 'saksmappe' and 'journalpost'.
    • +
  • Added support for some metadata codelists.
    • +
  • Added support for Cross-origin resource sharing (CORS).
    • +
  • Changed login method from Basic Auth to JSON Web Token (RFC 7519) + style.
    • +
  • Added support for GET-ing ny-* URLs.
    • +
  • Added support for modifying entities using PUT and eTag.
    • +
  • Added support for returning XML output on request.
    • +
  • Removed support for English field and class names, limiting ourself + to the official names.
    • +
  • ...
    • + +
+ +

If this sound interesting to you, please contact us on IRC (#nikita +on irc.freenode.net) or email +(nikita-noark +mailing list).

- Tags: english, frikanalen, nuug, video. + Tags: english, nuug, offentlig innsyn, standard.
@@ -599,36 +333,99 @@ know how to fix it using free software.

-
The Citizenfour documentary on the Snowden confirmations to Norway
-
28th February 2015
-

Today I was happy to learn that the documentary -Citizenfour by -Laura Poitras -finally will show up in Norway. According to the magazine -Montages, a deal has finally been -made for -Cinema -distribution in Norway and the movie will have its premiere soon. -This is great news. As part of my involvement with -the Norwegian Unix User Group, me and -a friend have -tried -to get the movie to Norway ourselves, but obviously -we -were too late and Tor Fosse beat us to it. I am happy he did, as -the movie will make its way to the public and we do not have to make -it happen ourselves. -The trailer -can be seen on youtube, if you are curious what kind of film this -is.

- -

The whistle blower Edward Snowden really deserve political asylum -here in Norway, but I am afraid he would not be safe.

+
Idea for storing trusted timestamps in a Noark 5 archive
+
7th June 2017
+

This is a copy of +an +email I posted to the nikita-noark mailing list. Please follow up +there if you would like to discuss this topic. The background is that +we are making a free software archive system based on the Norwegian +Noark +5 standard for government archives.

+ +

I've been wondering a bit lately how trusted timestamps could be +stored in Noark 5. +Trusted +timestamps can be used to verify that some information +(document/file/checksum/metadata) have not been changed since a +specific time in the past. This is useful to verify the integrity of +the documents in the archive.

+ +

Then it occured to me, perhaps the trusted timestamps could be +stored as dokument variants (ie dokumentobjekt referered to from +dokumentbeskrivelse) with the filename set to the hash it is +stamping?

+ +

Given a "dokumentbeskrivelse" with an associated "dokumentobjekt", +a new dokumentobjekt is associated with "dokumentbeskrivelse" with the +same attributes as the stamped dokumentobjekt except these +attributes:

+ +
    + +
  • format -> "RFC3161" +
  • mimeType -> "application/timestamp-reply" +
  • formatDetaljer -> "<source URL for timestamp service>" +
  • filenavn -> "<sjekksum>.tsr" + +
+ +

This assume a service following +IETF RFC 3161 is +used, which specifiy the given MIME type for replies and the .tsr file +ending for the content of such trusted timestamp. As far as I can +tell from the Noark 5 specifications, it is OK to have several +variants/renderings of a dokument attached to a given +dokumentbeskrivelse objekt. It might be stretching it a bit to make +some of these variants represent crypto-signatures useful for +verifying the document integrity instead of representing the dokument +itself.

+ +

Using the source of the service in formatDetaljer allow several +timestamping services to be used. This is useful to spread the risk +of key compromise over several organisations. It would only be a +problem to trust the timestamps if all of the organisations are +compromised.

+ +

The following oneliner on Linux can be used to generate the tsr +file. $input is the path to the file to checksum, and $sha256 is the +SHA-256 checksum of the file (ie the ".tsr" value mentioned +above).

+ +

+openssl ts -query -data "$inputfile" -cert -sha256 -no_nonce \
+  | curl -s -H "Content-Type: application/timestamp-query" \
+      --data-binary "@-" http://zeitstempel.dfn.de > $sha256.tsr
+

+ +

To verify the timestamp, you first need to download the public key +of the trusted timestamp service, for example using this command:

+ +

+wget -O ca-cert.txt \
+  https://pki.pca.dfn.de/global-services-ca/pub/cacert/chain.txt
+

+ +

Note, the public key should be stored alongside the timestamps in +the archive to make sure it is also available 100 years from now. It +is probably a good idea to standardise how and were to store such +public keys, to make it easier to find for those trying to verify +documents 100 or 1000 years from now. :)

+ +

The verification itself is a simple openssl command:

+ +

+openssl ts -verify -data $inputfile -in $sha256.tsr \
+  -CAfile ca-cert.txt -text
+

+ +

Is there any reason this approach would not work? Is it somehow against +the Noark 5 specification?

- Tags: english, nuug, personvern, surveillance. + Tags: english, offentlig innsyn, standard.
@@ -636,59 +433,129 @@ here in Norway, but I am afraid he would not be safe.

-
The Norwegian open channel Frikanalen - 24x7 on the Internet
-
25th February 2015
-

The Norwegian nationwide open channel -Frikanalen is still going -strong. It allow everyone to send the video they want on national -television. It is a TV station administrated completely using a web -browser, running only Free -Software, providing a REST -api for administrators and members, and with distribution on the -national DVB-T distribution network RiksTV. But only between 12:00 -and 17:30 Norwegian time. This has finally changed, after many years -with limited distribution. A few weeks ago, we set up a Ogg Theora -stream via icecast to allow everyone with Internet access to check out -the channel the rest of the day. This is presented on -the Frikanalen web site now. And -since a few days ago, the channel is also available -via multicast on -UNINETT, available for those using IPTV TVs and set-top boxes in -the Norwegian National Research and Education network.

- -

If you want to see what is on the channel, point your media player -to one of these sources. The first should work with most players and -browsers, while as far as I know, the multicast UDP stream only work -with VLC.

+
NÃ¥r nynorskoversettelsen svikter til eksamen...
+
3rd June 2017
+

Aftenposten +melder i dag om feil i eksamensoppgavene for eksamen i politikk og +menneskerettigheter, der teksten i bokmåls og nynorskutgaven ikke var +like. Oppgaveteksten er gjengitt i artikkelen, og jeg ble nysgjerring +på om den fri oversetterløsningen +Apertium ville gjort en bedre +jobb enn Utdanningsdirektoratet. Det kan se slik ut.

+ +

Her er bokmålsoppgaven fra eksamenen:

+ +
+

Drøft utfordringene knyttet til nasjonalstatenes og andre aktørers +rolle og muligheter til å håndtere internasjonale utfordringer, som +for eksempel flykningekrisen.

+ +

Vedlegge er eksempler på tekster som kan gi relevante perspektiver +på temaet:

+
    +
  1. Flykningeregnskapet 2016, UNHCR og IDMC +
  2. «Grenseløst Europa for fall» A-Magasinet, 26. november 2015 +
- +
-

The Ogg Theora / icecast stream is not working well, as the video -and audio is slightly out of sync. We have not been able to figure -out how to fix it. It is generated by recoding a internal MPEG -transport stream with MPEG4 coded video (ie H.264) to Ogg Theora / -Vorbis, and the result is less then stellar. If you have ideas how to -fix it, please let us know on frikanalen (at) nuug.no. We currently -use this with ffmpeg2theora 0.29:

+

Dette oversetter Apertium slik:

-
-./ffmpeg2theora.linux <OBE_gemini_URL.ts> -F 25 -x 720 -y 405 \
- --deinterlace --inputfps 25 -c 1 -H 48000 --keyint 8 --buf-delay 100 \
- --nosync -V 700 -o - | oggfwd video.nuug.no 8000 <pw> /frikanalen.ogv
-
+
+

Drøft utfordringane knytte til nasjonalstatane sine og rolla til +andre aktørar og høve til å handtera internasjonale utfordringar, som +til dømes *flykningekrisen.

+ +

Vedleggja er døme på tekster som kan gje relevante perspektiv på +temaet:

+ +
    +
  1. *Flykningeregnskapet 2016, *UNHCR og *IDMC
    2. +
  2. «*Grenseløst Europa for fall» A-Magasinet, 26. november 2015
    3. +
+ +
-

If you get the multicast UDP stream working, please let me know, as -I am curious how far the multicast stream reach. It do not make it to -my home network, nor any other commercially available network in -Norway that I am aware of.

+

Ord som ikke ble forstått er markert med stjerne (*), og trenger +ekstra språksjekk. Men ingen ord er forsvunnet, slik det var i +oppgaven elevene fikk presentert på eksamen. Jeg mistenker dog at +"andre aktørers rolle og muligheter til ..." burde vært oversatt til +"rolla til andre aktørar og deira høve til ..." eller noe slikt, men +det er kanskje flisespikking. Det understreker vel bare at det alltid +trengs korrekturlesning etter automatisk oversettelse.

+
+
+ + + Tags: debian, norsk, stavekontroll. + + +
+
+
+ +
+
Epost inn som arkivformat i Riksarkivarens forskrift?
+
27th April 2017
+

I disse dager, med frist 1. mai, har Riksarkivaren ute en høring på +sin forskrift. Som en kan se er det ikke mye tid igjen før fristen +som går ut på søndag. Denne forskriften er det som lister opp hvilke +formater det er greit å arkivere i +Noark +5-løsninger i Norge.

+ +

Jeg fant høringsdokumentene hos +Norsk +Arkivråd etter å ha blitt tipset på epostlisten til +fri +programvareprosjektet Nikita Noark5-Core, som lager et Noark 5 +Tjenestegresesnitt. Jeg er involvert i Nikita-prosjektet og takket +være min interesse for tjenestegrensesnittsprosjektet har jeg lest en +god del Noark 5-relaterte dokumenter, og til min overraskelse oppdaget +at standard epost ikke er på listen over godkjente formater som kan +arkiveres. Høringen med frist søndag er en glimrende mulighet til å +forsøke å gjøre noe med det. Jeg holder på med +egen +høringsuttalelse, og lurer på om andre er interessert i å støtte +forslaget om å tillate arkivering av epost som epost i arkivet.

+ +

Er du igang med å skrive egen høringsuttalelse allerede? I så fall +kan du jo vurdere å ta med en formulering om epost-lagring. Jeg tror +ikke det trengs så mye. Her et kort forslag til tekst:

+ +

+ +

Viser til høring sendt ut 2017-02-17 (Riksarkivarens referanse + 2016/9840 HELHJO), og tillater oss å sende inn noen innspill om + revisjon av Forskrift om utfyllende tekniske og arkivfaglige + bestemmelser om behandling av offentlige arkiver (Riksarkivarens + forskrift).

+ +

Svært mye av vår kommuikasjon foregår i dag på e-post.  Vi + foreslår derfor at Internett-e-post, slik det er beskrevet i IETF + RFC 5322, + https://tools.ietf.org/html/rfc5322. bør + inn som godkjent dokumentformat.  Vi foreslår at forskriftens + oversikt over godkjente dokumentformater ved innlevering i § 5-16 + endres til å ta med Internett-e-post.

+ +

+ +

Som del av arbeidet med tjenestegrensesnitt har vi testet hvordan +epost kan lagres i en Noark 5-struktur, og holder på å skrive et +forslag om hvordan dette kan gjøres som vil bli sendt over til +arkivverket så snart det er ferdig. De som er interesserte kan +følge +fremdriften på web.

+ +

Oppdatering 2017-04-28: I dag ble høringuttalelsen jeg skrev + sendt + inn av foreningen NUUG.

- Tags: english, frikanalen, nuug, video. + Tags: norsk, offentlig innsyn, standard.
@@ -696,118 +563,52 @@ Norway that I am aware of.

-
En enklere Osloskolehverdag med automatisk sjekk av Fronter
-
12th February 2015
-

En stund nå har jeg vært nødt til å forholde meg til -Fronter, en nettløsning -Osloskolen bruker for kontakt mellom hjem og skole. Løsningen -imponerer ikke, og det er lagt opp til at vi foreldre skal logge inn -regelmessig for å se om noe har endret seg. Idéen om å la folk stikke -innom nettsider for å se om det har skjedd endringer er så idiotisk at -jeg har lett etter et alternativ. Fronterløsningen har en innebygget -løsning der en kan abonnere på forsiden (som viser en oppsummering av -det en har tilgang til), og få tilsendt en kopi hver natt, men det -fjerner jo bare behovet for å stikke innom, ikke den idiotiske ideen -om at folk skal huske hvordan nettsiden så ut sist og oppdage hva som -er endret.

- -

For å gjøre livet enklere har jeg derfor brukt litt tid på å lage -et program som kobler seg opp og sjekker etter endringer automatisk, -slik at jeg kan få beskjed fra datamaskinen når noe endrer seg i -stedet for å forsøke å finne ut av det selv. I går ble scriptet -brukbart, og jeg er dermed klar til å dele det med deg.

- -

Jeg startet med å skrive programmet i Python, og hadde en versjon -som logget inn og hentet ned enkeltsider fra Fronter. Men -Fronter-websidene suger golfballer gjennom en hageslange, med -uleselig HTML, flere nivåer av iframes og en struktur på innholdet som -er svært vanskelig å finne ut av, så jeg ga til slutt opp lxml-parsing -med Python og forsøkte meg med WWW::Mechanize for Perl som jeg kjente -fra før. I ettertid har jeg oppdaget at WWW:Mechanize også finnes for -Python, så jeg kunne antagelig droppet språkbyttet. Men da jeg -oppdaget det hadde jeg kommet så langt med Perl-utgaven, så jeg hoppet -ikke tilbake.

- -

For å logge inn i Fronter besøker en enten skolens websider eller -den sentrale innloggingsiden https://fronter.com/osloskoler/. -Perl-koden for å logge inn ser slik ut:

- -
-my $mech = WWW::Mechanize->new();
-$mech->get('https://fronter.com/osloskoler/');
-$mech->submit_form(fields => {
-    username => $username,
-    password => $password,
-} );
-
- -

Neste steg er å få oversikt over hvilke «rom» en har tilgang til. -På vår skole er det rom for skolen, biblioteket, elevrådet, -aktivitetsskolen og klasser der en har unger, og dette vil være -forskjellig fra person til person. Etter å ha romstert rundt i -Fronter-grensesnittet endel kom jeg over en grei HTML-side med -oversikt over rommene, -https://fronter.com/osloskoler/adm/projects.phtml?mode=displayRoomchooser, -så jeg bruker denne til å hente ut romoversikt med rom-ID.

- -
-my %room;
-$mech->get('https://fronter.com/osloskoler/adm/projects.phtml?mode=displayRoomchooser');
-for my $link ($mech->links()) {
-    my $url = $link->url();
-    if ($url =~ m%/links/list_files.phtml\?edit=(\d+)$%) {
-        $room{$link->text()} = $1;
-    }
-}
-
- -

Når en har rom-ID kan en slå opp websiden for rommet, som starter -på -https://fronter.com/osloskoler/contentframeset.phtml?goto_prjid=$ROMID -(der $ROMID byttes ut med rom-ID-tallet). Det gir en side med -iframes, og en må tre nivåer ned i iframes før en får tak i -HTML-informasjonen som vises frem når en ser på det aktuelle rommet. -Her ga jeg opp den robuste parsingen og hardkodet endel URL-er som i -stedet bør spores opp maskinelt. HTML-informasjonen som vises lagres -i en fil etter at økt- og innloggings-nøkkel er fjernet og deretter -bruker jeg lynx --dump --nolist for å hente ut en tekstlig -utgave av websiden. Denne tekstlige utgaven sammenlignes med forrige -versjon og oversikt over endringer kan så sendes ut på egnet vis.

- -

Jeg valgte å bruke git til å holde rede på endringer, så jeg -sjekker inn HTML og tekst-utgaver i git og bruker git til å vise frem -endringene i tekstutgavene. Programvaren for å gjøre dette er testet -på Debian GNU/Linux og kan -lastes -ned fra github.

- -

For å bruke dette selv, kjør følgende kommandoer på din -Debian-maskin (forutsetter sudo-tilgang for installasjon av -programvare):

- -
-sudo apt-get install git lynx-cur libio-prompter-perl libwww-mechanize-perl \
-      libconfig-inifiles-perl
-git clone https://github.com/petterreinholdtsen/fronter-scraper-oslo
-cd fronter-scraper-oslo
-./update-git
-
- -

Det gjenstår endel, men systemet er allerede nyttig for meg. Jeg -ønsker at systemet også skal laste ned PDF-er og slikt som er lagt ut -for nedlasting på sidene, slik at f.eks. ukeplaner kommer inn i -git-arkivet mitt automatisk og jeg får automatisk beskjed når ny -ukeplan er lagt ut. Kanskje du kan bidra med å få det på plass, eller -kanskje du har andre ting du vil fikse? Jeg tar gjerne imot endringer -og forbedringer. Det er mye som kan gjøres bedre, og scriptet er ikke -veldig robust mot endringer hos nettsidene til Fronter. Jeg regner -dermed med at det vil trengs oppdateringer jevnlig etter hvert som -Fronter-løsningen endrer seg.

+
Offentlig elektronisk postjournal blokkerer tilgang for utvalgte webklienter
+
20th April 2017
+

Jeg oppdaget i dag at nettstedet som +publiserer offentlige postjournaler fra statlige etater, OEP, har +begynt å blokkerer enkelte typer webklienter fra å få tilgang. Vet +ikke hvor mange det gjelder, men det gjelder i hvert fall libwww-perl +og curl. For å teste selv, kjør følgende:

+ +
+% curl -v -s https://www.oep.no/pub/report.xhtml?reportId=3 2>&1 |grep '< HTTP'
+< HTTP/1.1 404 Not Found
+% curl -v -s --header 'User-Agent:Opera/12.0' https://www.oep.no/pub/report.xhtml?reportId=3 2>&1 |grep '< HTTP'
+< HTTP/1.1 200 OK
+%
+
+ +

Her kan en se at tjenesten gir «404 Not Found» for curl i +standardoppsettet, mens den gir «200 OK» hvis curl hevder å være Opera +versjon 12.0. Offentlig elektronisk postjournal startet blokkeringen +2017-03-02.

+ +

Blokkeringen vil gjøre det litt vanskeligere å maskinelt hente +informasjon fra oep.no. Kan blokkeringen være gjort for å hindre +automatisert innsamling av informasjon fra OEP, slik Pressens +Offentlighetsutvalg gjorde for å dokumentere hvordan departementene +hindrer innsyn i +rapporten +«Slik hindrer departementer innsyn» som ble publiserte i januar +2017. Det virker usannsynlig, da det jo er trivielt å bytte +User-Agent til noe nytt.

+ +

Finnes det juridisk grunnlag for det offentlige å diskriminere +webklienter slik det gjøres her? Der tilgang gis eller ikke alt etter +hva klienten sier at den heter? Da OEP eies av DIFI og driftes av +Basefarm, finnes det kanskje noen dokumenter sendt mellom disse to +aktørene man kan be om innsyn i for å forstå hva som har skjedd. Men +postjournalen +til DIFI viser kun to dokumenter det siste året mellom DIFI og +Basefarm. +Mimes brønn neste, +tenker jeg.

- Tags: norsk, web. + Tags: norsk, offentlig innsyn.
@@ -815,39 +616,101 @@ Fronter-løsningen endrer seg.

-
Nude body scanner now present on Norwegian airport
-
10th February 2015
-

Aftenposten, one of the largest newspapers in Norway, today report -that -three -of the nude body scanners now is put to use at Gardermoen, the -main airport in Norway. This way the travelers can have their body -photographed without cloths when visiting Norway. Of course this -horrible news is presented with a positive spin, stating that "now -travelers can move past the security check point faster and more -efficiently", but fail to mention that the machines in question take -pictures of their nude bodies and store them internally in the -computer, while only presenting sketch figure of the body to the -public. The article is written in a way that leave the impression -that the new machines do not take these nude pictures and only create -the sketch figures. In reality the same nude pictures are still -taken, but not presented to everyone. They are still available for -the owners of the system and the people doing maintenance of the -scanners, as long as they are taken and stored.

- -

Wikipedia have a more on -Full body -scanners, including example images and a summary of the -controversy about these scanners.

- -

Personally I will decline to use these machines, as I believe strip -searches of my body is a very intrusive attack on my privacy, and not -something everyone should have to accept to travel.

+
Free software archive system Nikita now able to store documents
+
19th March 2017
+

The Nikita +Noark 5 core project is implementing the Norwegian standard for +keeping an electronic archive of government documents. +The +Noark 5 standard document the requirement for data systems used by +the archives in the Norwegian government, and the Noark 5 web interface +specification document a REST web service for storing, searching and +retrieving documents and metadata in such archive. I've been involved +in the project since a few weeks before Christmas, when the Norwegian +Unix User Group +announced +it supported the project. I believe this is an important project, +and hope it can make it possible for the government archives in the +future to use free software to keep the archives we citizens depend +on. But as I do not hold such archive myself, personally my first use +case is to store and analyse public mail journal metadata published +from the government. I find it useful to have a clear use case in +mind when developing, to make sure the system scratches one of my +itches.

+ +

If you would like to help make sure there is a free software +alternatives for the archives, please join our IRC channel +(#nikita on +irc.freenode.net) and +the +project mailing list.

+ +

When I got involved, the web service could store metadata about +documents. But a few weeks ago, a new milestone was reached when it +became possible to store full text documents too. Yesterday, I +completed an implementation of a command line tool +archive-pdf to upload a PDF file to the archive using this +API. The tool is very simple at the moment, and find existing +fonds, series and +files while asking the user to select which one to use if more than +one exist. Once a file is identified, the PDF is associated with the +file and uploaded, using the title extracted from the PDF itself. The +process is fairly similar to visiting the archive, opening a cabinet, +locating a file and storing a piece of paper in the archive. Here is +a test run directly after populating the database with test data using +our API tester:

+ +

+~/src//noark5-tester$ ./archive-pdf mangelmelding/mangler.pdf
+using arkiv: Title of the test fonds created 2017-03-18T23:49:32.103446
+using arkivdel: Title of the test series created 2017-03-18T23:49:32.103446
+
+ 0 - Title of the test case file created 2017-03-18T23:49:32.103446
+ 1 - Title of the test file created 2017-03-18T23:49:32.103446
+Select which mappe you want (or search term): 0
+Uploading mangelmelding/mangler.pdf
+  PDF title: Mangler i spesifikasjonsdokumentet for NOARK 5 Tjenestegrensesnitt
+  File 2017/1: Title of the test case file created 2017-03-18T23:49:32.103446
+~/src//noark5-tester$
+

+ +

You can see here how the fonds (arkiv) and serie (arkivdel) only had +one option, while the user need to choose which file (mappe) to use +among the two created by the API tester. The archive-pdf +tool can be found in the git repository for the API tester.

+ +

In the project, I have been mostly working on +the API +tester so far, while getting to know the code base. The API +tester currently use +the HATEOAS links +to traverse the entire exposed service API and verify that the exposed +operations and objects match the specification, as well as trying to +create objects holding metadata and uploading a simple XML file to +store. The tester has proved very useful for finding flaws in our +implementation, as well as flaws in the reference site and the +specification.

+ +

The test document I uploaded is a summary of all the specification +defects we have collected so far while implementing the web service. +There are several unclear and conflicting parts of the specification, +and we have +started +writing down the questions we get from implementing it. We use a +format inspired by how The +Austin Group collect defect reports for the POSIX standard with +their +instructions for the MANTIS defect tracker system, in lack of an official way to structure defect reports for Noark 5 (our first submitted defect report was a request for a procedure for submitting defect reports :). + +

The Nikita project is implemented using Java and Spring, and is +fairly easy to get up and running using Docker containers for those +that want to test the current code base. The API tester is +implemented in Python.

- Tags: english, personvern. + Tags: english, nuug, offentlig innsyn, standard.
@@ -862,6 +725,54 @@ something everyone should have to accept to travel.

Archive