I use the lsdvd tool -to handle my fairly large DVD collection. It is a nice command line -tool to get details about a DVD, like title, tracks, track length, -etc, in XML, Perl or human readable format. But lsdvd have not seen -any new development since 2006 and had a few irritating bugs affecting -its use with some DVDs. Upstream seemed to be dead, and in January I -sent a small probe asking for a version control repository for the -project, without any reply. But I use it regularly and would like to -get an updated version -into Debian. So two weeks ago I tried harder to get in touch with -the project admin, and after getting a reply from him explaining that -he was no longer interested in the project, I asked if I could take -over. And yesterday, I became project admin.
- -I've been in touch with a Gentoo developer and the Debian -maintainer interested in joining forces to maintain the upstream -project, and I hope we can get a new release out fairly quickly, -collecting the patches spread around on the internet into on place. -I've added the relevant Debian patches to the freshly created git -repository, and expect the Gentoo patches to make it too. If you got -a DVD collection and care about command line tools, check out -the git source and join -the project mailing -list. :)
+ +On friday, I came across an interesting article in the Norwegian +web based ICT news magazine digi.no on +how +to collect the IMSI numbers of nearby cell phones using the cheap +DVB-T software defined radios. The article refered to instructions +and a recipe by +Keld Norman on Youtube on how to make a simple $7 IMSI Catcher, and I decided to test them out.
+ +The instructions said to use Ubuntu, install pip using apt (to +bypass apt), use pip to install pybombs (to bypass both apt and pip), +and the ask pybombs to fetch and build everything you need from +scratch. I wanted to see if I could do the same on the most recent +Debian packages, but this did not work because pybombs tried to build +stuff that no longer build with the most recent openssl library or +some other version skew problem. While trying to get this recipe +working, I learned that the apt->pip->pybombs route was a long detour, +and the only piece of software dependency missing in Debian was the +gr-gsm package. I also found out that the lead upstream developer of +gr-gsm (the name stand for GNU Radio GSM) project already had a set of +Debian packages provided in an Ubuntu PPA repository. All I needed to +do was to dget the Debian source package and built it.
+ +The IMSI collector is a python script listening for packages on the +loopback network device and printing to the terminal some specific GSM +packages with IMSI numbers in them. The code is fairly short and easy +to understand. The reason this work is because gr-gsm include a tool +to read GSM data from a software defined radio like a DVB-T USB stick +and other software defined radios, decode them and inject them into a +network device on your Linux machine (using the loopback device by +default). This proved to work just fine, and I've been testing the +collector for a few days now.
+ +The updated and simpler recipe is thus to
+ +-
+
+
- start with a Debian machine running Stretch or newer, + +
- build and install the gr-gsm package available from +http://ppa.launchpad.net/ptrkrysik/gr-gsm/ubuntu/pool/main/g/gr-gsm/, + +
- clone the git repostory from https://github.com/Oros42/IMSI-catcher, + +
- run grgsm_livemon and adjust the frequency until the terminal +where it was started is filled with a stream of text (meaning you +found a GSM station). + +
- go into the IMSI-catcher directory and run 'sudo python simple_IMSI-catcher.py' to extract the IMSI numbers. + +
To make it even easier in the future to get this sniffer up and +running, I decided to package +the gr-gsm project +for Debian (WNPP +#871055), and the package was uploaded into the NEW queue today. +Luckily the gnuradio maintainer has promised to help me, as I do not +know much about gnuradio stuff yet.
+ +I doubt this "IMSI cacher" is anywhere near as powerfull as +commercial tools like +The +Spy Phone Portable IMSI / IMEI Catcher or the +Harris +Stingray, but I hope the existance of cheap alternatives can make +more people realise how their whereabouts when carrying a cell phone +is easily tracked. Seeing the data flow on the screen, realizing that +I live close to a police station and knowing that the police is also +wearing cell phones, I wonder how hard it would be for criminals to +track the position of the police officers to discover when there are +police near by, or for foreign military forces to track the location +of the Norwegian military forces, or for anyone to track the location +of government officials...
+ +It is worth noting that the data reported by the IMSI-catcher +script mentioned above is only a fraction of the data broadcasted on +the GSM network. It will only collect one frequency at the time, +while a typical phone will be using several frequencies, and not all +phones will be using the frequencies tracked by the grgsm_livemod +program. Also, there is a lot of radio chatter being ignored by the +simple_IMSI-catcher script, which would be collected by extending the +parser code. I wonder if gr-gsm can be set up to listen to more than +one frequency?
Rundt omkring i Oslo og ÃstlandsomrÃ¥det henger det bokser over -veiene som jeg har lurt pÃ¥ hva gjør. De har ut fra plassering og -vinkling sett ut som bokser som sniffer ut et eller annet fra -forbipasserende trafikk, men det har vært uklart for meg hva det er de -leser av. Her om dagen tok jeg bilde av en slik boks som henger under -ei -skibru pÃ¥ Sollihøgda:
- -Boksen er tydelig merket «Kapsch >>>», logoen til -det sveitsiske selskapet Kapsch som -blant annet lager sensorsystemer for veitrafikk. Men de lager mye -forskjellig, og jeg kjente ikke igjen boksen på utseendet etter en -kjapp titt på produktlista til selskapet.
- -I og med at boksen henger over veien E16, en riksvei vedlikeholdt -av Statens Vegvesen, så antok jeg at det burde være mulig å bruke -REST-API-et som gir tilgang til vegvesenets database over veier, -skilter og annet veirelatert til å finne ut hva i alle dager dette -kunne være. De har både -en -datakatalog og -et -søk, der en kan søke etter ulike typer oppføringer innen for et -gitt geografisk område. Jeg laget et enkelt shell-script for å hente -ut antall av en gitt type innenfor området skibrua dekker, og listet -opp navnet på typene som ble funnet. Orket ikke slå opp hvordan -URL-koding av aktuelle strenger kunne gjøres mer generisk, og brukte -en stygg sed-linje i stedet.
- -- -Aktuelt ID-område 1-874 var riktig i datakatalogen da jeg laget -scriptet. Det vil endre seg over tid. Skriptet listet så opp -aktuelle typer i og rundt skibrua: - --#!/bin/sh -urlmap() { - sed \ - -e 's/ / /g' -e 's/{/%7B/g' \ - -e 's/}/%7D/g' -e 's/\[/%5B/g' \ - -e 's/\]/%5D/g' -e 's/ /%20/g' \ - -e 's/,/%2C/g' -e 's/\"/%22/g' \ - -e 's/:/%3A/g' -} - -lookup() { - url="$1" - curl -s -H 'Accept: application/vnd.vegvesen.nvdb-v1+xml' \ - "https://www.vegvesen.no/nvdb/api$url" | xmllint --format - -} - -for id in $(seq 1 874) ; do - search="{ - lokasjon: { - bbox: \"10.34425,59.96386,10.34458,59.96409\", - srid: \"WGS84\" - }, - objektTyper: [{ - id: $id, antall: 10 - }] -}" - - query=/sok?kriterie=$(echo $search | urlmap) - if lookup "$query" | - grep -q '<totaltAntallReturnert>0<' - then - : - else - echo $id - lookup "/datakatalog/objekttyper/$id" |grep '^ <navn>' - fi -done - -exit 0 -
- --5 - <navn>Rekkverk</navn> -14 - <navn>Rekkverksende</navn> -47 - <navn>Trafikklomme</navn> -49 - <navn>Trafikkøy</navn> -60 - <navn>Bru</navn> -79 - <navn>Stikkrenne/Kulvert</navn> -80 - <navn>Grøft, åpen</navn> -86 - <navn>Belysningsstrekning</navn> -95 - <navn>Skiltpunkt</navn> -96 - <navn>Skiltplate</navn> -98 - <navn>Referansestolpe</navn> -99 - <navn>Vegoppmerking, langsgående</navn> -105 - <navn>Fartsgrense</navn> -106 - <navn>Vinterdriftsstrategi</navn> -172 - <navn>Trafikkdeler</navn> -241 - <navn>Vegdekke</navn> -293 - <navn>Breddemåling</navn> -301 - <navn>Kantklippareal</navn> -318 - <navn>Snø-/isrydding</navn> -445 - <navn>Skred</navn> -446 - <navn>Dokumentasjon</navn> -452 - <navn>Undergang</navn> -528 - <navn>Tverrprofil</navn> -532 - <navn>Vegreferanse</navn> -534 - <navn>Region</navn> -535 - <navn>Fylke</navn> -536 - <navn>Kommune</navn> -538 - <navn>Gate</navn> -539 - <navn>Transportlenke</navn> -540 - <navn>Trafikkmengde</navn> -570 - <navn>Trafikkulykke</navn> -571 - <navn>Ulykkesinvolvert enhet</navn> -572 - <navn>Ulykkesinvolvert person</navn> -579 - <navn>Politidistrikt</navn> -583 - <navn>Vegbredde</navn> -591 - <navn>Høydebegrensning</navn> -592 - <navn>Nedbøyningsmåling</navn> -597 - <navn>Støy-luft, Strekningsdata</navn> -601 - <navn>Oppgravingsdata</navn> -602 - <navn>Oppgravingslag</navn> -603 - <navn>PMS-parsell</navn> -604 - <navn>Vegnormalstrekning</navn> -605 - <navn>Værrelatert strekning</navn> -616 - <navn>Feltstrekning</navn> -617 - <navn>Adressepunkt</navn> -626 - <navn>Friksjonsmåleserie</navn> -629 - <navn>Vegdekke, flatelapping</navn> -639 - <navn>Kurvatur, horisontalelement</navn> -640 - <navn>Kurvatur, vertikalelement</navn> -642 - <navn>Kurvatur, vertikalpunkt</navn> -643 - <navn>Statistikk, trafikkmengde</navn> -647 - <navn>Statistikk, vegbredde</navn> -774 - <navn>Nedbøyningsmåleserie</navn> -775 - <navn>ATK, influensstrekning</navn> -794 - <navn>Systemobjekt</navn> -810 - <navn>Vinterdriftsklasse</navn> -821 - <navn>Funksjonell vegklasse</navn> -825 - <navn>Kurvatur, stigning</navn> -838 - <navn>Vegbredde, beregnet</navn> -862 - <navn>Reisetidsregistreringspunkt</navn> -871 - <navn>Bruksklasse</navn> -
Av disse ser ID 775 og 862 mest relevant ut. ID 775 antar jeg -refererer til fotoboksen som stÃ¥r like ved brua, mens -«Reisetidsregistreringspunkt» kanskje kan være boksen som henger der. -Hvordan finner jeg sÃ¥ ut hva dette kan være for noe. En titt pÃ¥ -datakatalogsiden -for ID 862/Reisetidsregistreringspunkt viser at det er finnes 53 -slike mÃ¥lere i Norge, og hvor de er plassert, men gir ellers fÃ¥ -detaljer. Det er plassert 40 pÃ¥ østlandet og 13 i Trondheimsregionen. -Men siden nevner «AutoPASS», og hvis en slÃ¥r opp oppføringen pÃ¥ -Sollihøgda nevner den «Ciber AS» som ID for eksternt system. (Kan det -være snakk om -Ciber -Norge AS, et selskap eid av Ciber Europe Bv?) Et nettsøk pÃ¥ - «Ciber AS autopass» fører meg til en artikkel fra NRK Trøndelag i - 2013 med tittel -«Sjekk -dette hvis du vil unngÃ¥ kø». Artikkelen henviser til vegvesenets -nettside -reisetider.no -som har en -kartside -for Ãstlandet som viser at det mÃ¥les mellom Sandvika og Sollihøgda. -Det kan dermed se ut til at jeg har funnet ut hva boksene gjør.
- -Hvis det stemmer, så er dette bokser som leser av AutoPASS-ID-en -til alle passerende biler med AutoPASS-brikke, og dermed gjør det mulig -for de som kontrollerer boksene å holde rede på hvor en gitt bil er -når den passerte et slikt målepunkt. NRK-artikkelen forteller at -denne informasjonen i dag kun brukes til å koble to -AutoPASS-brikkepasseringer passeringer sammen for å beregne -reisetiden, og at bruken er godkjent av Datatilsynet. Det er desverre -ikke mulig for en sjåfør som passerer under en slik boks å kontrollere -at AutoPASS-ID-en kun brukes til dette i dag og i fremtiden.
- -I tillegg til denne type AutoPASS-sniffere vet jeg at det også -finnes mange automatiske stasjoner som tar betalt pr. passering (aka -bomstasjoner), og der lagres informasjon om tid, sted og bilnummer i -10 år. Finnes det andre slike sniffere plassert ut på veiene?
- -Personlig har jeg valgt å ikke bruke AutoPASS-brikke, for å gjøre -det vanskeligere og mer kostbart for de som vil invadere privatsfæren -og holde rede på hvor bilen min beveger seg til enhver tid. Jeg håper -flere vil gjøre det samme, selv om det gir litt høyere private -utgifter (dyrere bompassering). Vern om privatsfæren koster i disse -dager.
- -Takk til Jan Kristian Jensen i Statens Vegvesen for tips om -dokumentasjon på vegvesenets REST-API.
+ +I finally received a copy of the Norwegian Bokmål edition of +"The Debian Administrator's +Handbook". This test copy arrived in the mail a few days ago, and +I am very happy to hold the result in my hand. We spent around one and a half year translating it. This paperbook edition +is available +from lulu.com. If you buy it quickly, you save 25% on the list +price. The book is also available for download in electronic form as +PDF, EPUB and Mobipocket, as can be +read online +as a web page.
+ +This is the second book I publish (the first was the book +"Free Culture" by Lawrence Lessig +in +English, +French +and +Norwegian +Bokmål), and I am very excited to finally wrap up this +project. I hope +"Håndbok +for Debian-administratoren" will be well received.
The Debian installer could be -a lot quicker. When we install more than 2000 packages in -Skolelinux / Debian Edu using -tasksel in the installer, unpacking the binary packages take forever. -A part of the slow I/O issue was discussed in -bug #613428 about too -much file system sync-ing done by dpkg, which is the package -responsible for unpacking the binary packages. Other parts (like code -executed by postinst scripts) might also sync to disk during -installation. All this sync-ing to disk do not really make sense to -me. If the machine crash half-way through, I start over, I do not try -to salvage the half installed system. So the failure sync-ing is -supposed to protect against, hardware or system crash, is not really -relevant while the installer is running.
- -A few days ago, I thought of a way to get rid of all the file -system sync()-ing in a fairly non-intrusive way, without the need to -change the code in several packages. The idea is not new, but I have -not heard anyone propose the approach using dpkg-divert before. It -depend on the small and clever package -eatmydata, which -uses LD_PRELOAD to replace the system functions for syncing data to -disk with functions doing nothing, thus allowing programs to live -dangerous while speeding up disk I/O significantly. Instead of -modifying the implementation of dpkg, apt and tasksel (which are the -packages responsible for selecting, fetching and installing packages), -it occurred to me that we could just divert the programs away, replace -them with a simple shell wrapper calling -"eatmydata $program $@", to get the same effect. -Two days ago I decided to test the idea, and wrapped up a simple -implementation for the Debian Edu udeb.
- -The effect was stunning. In my first test it reduced the running -time of the pkgsel step (installing tasks) from 64 to less than 44 -minutes (20 minutes shaved off the installation) on an old Dell -Latitude D505 machine. I am not quite sure what the optimised time -would have been, as I messed up the testing a bit, causing the debconf -priority to get low enough for two questions to pop up during -installation. As soon as I saw the questions I moved the installation -along, but do not know how long the question were holding up the -installation. I did some more measurements using Debian Edu Jessie, -and got these results. The time measured is the time stamp in -/var/log/syslog between the "pkgsel: starting tasksel" and the -"pkgsel: finishing up" lines, if you want to do the same measurement -yourself. In Debian Edu, the tasksel dialog do not show up, and the -timing thus do not depend on how quickly the user handle the tasksel -dialog.
- -Machine/setup | -Original tasksel | -Optimised tasksel | -Reduction | -||||
---|---|---|---|---|---|---|---|
Latitude D505 Main+LTSP LXDE | -64 min (07:46-08:50) | -<44 min (11:27-12:11) | ->20 min 18% | -
Title / language | Quantity | ||||||
---|---|---|---|---|---|---|---|
2016 jan-jun | 2016 jul-dec | 2017 jan-may | |||||
Latitude D505 Roaming LXDE | -57 min (08:48-09:45) | -34 min (07:43-08:17) | -23 min 40% | +Culture Libre / French | +3 | +6 | +15 |
Latitude D505 Minimal | -22 min (10:37-10:59) | -11 min (11:16-11:27) | -11 min 50% | +Fri kultur / Norwegian | +7 | +1 | +0 |
Thinkpad X200 Minimal | -6 min (08:19-08:25) | -4 min (08:04-08:08) | -2 min 33% | +Free Culture / English | +14 | +27 | +16 |
Thinkpad X200 Roaming KDE | -19 min (09:21-09:40) | -15 min (10:25-10:40) | -4 min 21% | +Total | +24 | +34 | +31 |
The test is done using a netinst ISO on a USB stick, so some of the -time is spent downloading packages. The connection to the Internet -was 100Mbit/s during testing, so downloading should not be a -significant factor in the measurement. Download typically took a few -seconds to a few minutes, depending on the amount of packages being -installed.
- -The speedup is implemented by using two hooks in -Debian -Installer, the pre-pkgsel.d hook to set up the diverts, and the -finish-install.d hook to remove the divert at the end of the -installation. I picked the pre-pkgsel.d hook instead of the -post-base-installer.d hook because I test using an ISO without the -eatmydata package included, and the post-base-installer.d hook in -Debian Edu can only operate on packages included in the ISO. The -negative effect of this is that I am unable to activate this -optimization for the kernel installation step in d-i. If the code is -moved to the post-base-installer.d hook, the speedup would be larger -for the entire installation.
- -I've implemented this in the -debian-edu-install -git repository, and plan to provide the optimization as part of the -Debian Edu installation. If you want to test this yourself, you can -create two files in the installer (or in an udeb). One shell script -need do go into /usr/lib/pre-pkgsel.d/, with content like this:
++-#!/bin/sh -set -e -. /usr/share/debconf/confmodule -info() { - logger -t my-pkgsel "info: $*" -} -error() { - logger -t my-pkgsel "error: $*" -} -override_install() { - apt-install eatmydata || true - if [ -x /target/usr/bin/eatmydata ] ; then - for bin in dpkg apt-get aptitude tasksel ; do - file=/usr/bin/$bin - # Test that the file exist and have not been diverted already. - if [ -f /target$file ] ; then - info "diverting $file using eatmydata" - printf "#!/bin/sh\neatmydata $bin.distrib \"\$@\"\n" \ - > /target$file.edu - chmod 755 /target$file.edu - in-target dpkg-divert --package debian-edu-config \ - --rename --quiet --add $file - ln -sf ./$bin.edu /target$file - else - error "unable to divert $file, as it is missing." - fi - done - else - error "unable to find /usr/bin/eatmydata after installing the eatmydata pacage" - fi -} - -override_install -
A bit sad to see the low sales number on the Norwegian edition, and +a bit surprising the English edition still selling so well.
-To clean up, another shell script should go into -/usr/lib/finish-install.d/ with code like this: - -
- --#! /bin/sh -e -. /usr/share/debconf/confmodule -error() { - logger -t my-finish-install "error: $@" -} -remove_install_override() { - for bin in dpkg apt-get aptitude tasksel ; do - file=/usr/bin/$bin - if [ -x /target$file.edu ] ; then - rm /target$file - in-target dpkg-divert --package debian-edu-config \ - --rename --quiet --remove $file - rm /target$file.edu - else - error "Missing divert for $file." - fi - done - sync # Flush file buffers before continuing -} - -remove_install_override -
In Debian Edu, I placed both code fragments in a separate script -edu-eatmydata-install and call it from the pre-pkgsel.d and -finish-install.d scripts.
- -By now you might ask if this change should get into the normal -Debian installer too? I suspect it should, but am not sure the -current debian-installer coordinators find it useful enough. It also -depend on the side effects of the change. I'm not aware of any, but I -guess we will see if the change is safe after some more testing. -Perhaps there is some package in Debian depending on sync() and -fsync() having effect? Perhaps it should go into its own udeb, to -allow those of us wanting to enable it to do so without affecting -everyone.
- -Update 2014-09-24: Since a few days ago, enabling this optimization -will break installation of all programs using gnutls because of -bug #702711. An updated -eatmydata package in Debian will solve it.
+If you would like to translate and publish the book in your native +language, I would be happy to help make it happen. Please get in +touch.
Yesterday, I had the pleasure of attending a talk with the -Norwegian Unix User Group about -the -OpenPGP keyserver pool sks-keyservers.net, and was very happy to -learn that there is a large set of publicly available key servers to -use when looking for peoples public key. So far I have used -subkeys.pgp.net, and some times wwwkeys.nl.pgp.net when the former -were misbehaving, but those days are ended. The servers I have used -up until yesterday have been slow and some times unavailable. I hope -those problems are gone now.
- -Behind the round robin DNS entry of the -sks-keyservers.net service -there is a pool of more than 100 keyservers which are checked every -day to ensure they are well connected and up to date. It must be -better than what I have used so far. :)
- -Yesterdays speaker told me that the service is the default -keyserver provided by the default configuration in GnuPG, but this do -not seem to be used in Debian. Perhaps it should?
- -Anyway, I've updated my ~/.gnupg/options file to now include this -line:
- -+ +-keyserver pool.sks-keyservers.net -
I am very happy to report that the +Nikita Noark 5 +core project tagged its second release today. The free software +solution is an implementation of the Norwegian archive standard Noark +5 used by government offices in Norway. These were the changes in +version 0.1.1 since version 0.1.0 (from NEWS.md): -
With GnuPG version 2 one can also locate the keyserver using SRV -entries in DNS. Just for fun, I did just that at work, so now every -user of GnuPG at the University of Oslo should find a OpenGPG -keyserver automatically should their need it:
+-
-
- Continued work on the angularjs GUI, including document upload. +
- Implemented correspondencepartPerson, correspondencepartUnit and + correspondencepartInternal +
- Applied for coverity coverage and started submitting code on + regualr basis. +
- Started fixing bugs reported by coverity +
- Corrected and completed HATEOAS links to make sure entire API is + available via URLs in _links. +
- Corrected all relation URLs to use trailing slash. +
- Add initial support for storing data in ElasticSearch. +
- Now able to receive and store uploaded files in the archive. +
- Changed JSON output for object lists to have relations in _links. +
- Improve JSON output for empty object lists. +
- Now uses correct MIME type application/vnd.noark5-v4+json. +
- Added support for docker container images. +
- Added simple API browser implemented in JavaScript/Angular. +
- Started on archive client implemented in JavaScript/Angular. +
- Started on prototype to show the public mail journal. +
- Improved performance by disabling Sprint FileWatcher. +
- Added support for 'arkivskaper', 'saksmappe' and 'journalpost'. +
- Added support for some metadata codelists. +
- Added support for Cross-origin resource sharing (CORS). +
- Changed login method from Basic Auth to JSON Web Token (RFC 7519) + style. +
- Added support for GET-ing ny-* URLs. +
- Added support for modifying entities using PUT and eTag. +
- Added support for returning XML output on request. +
- Removed support for English field and class names, limiting ourself + to the official names. +
- ... + +
+-% host -t srv _pgpkey-http._tcp.uio.no -_pgpkey-http._tcp.uio.no has SRV record 0 100 11371 pool.sks-keyservers.net. -% -
Now if only -the -HKP lookup protocol supported finding signature paths, I would be -very happy. It can look up a given key or search for a user ID, but I -normally do not want that, but to find a trust path from my key to -another key. Given a user ID or key ID, I would like to find (and -download) the keys representing a signature path from my key to the -key in question, to be able to get a trust path between the two keys. -This is as far as I can tell not possible today. Perhaps something -for a future version of the protocol?
+If this sound interesting to you, please contact us on IRC (#nikita +on irc.freenode.net) or email +(nikita-noark +mailing list).
Two years later, I am still not sure if it is legal here in Norway -to use or publish a video in H.264 or MPEG4 format edited by the -commercially licensed video editors, without limiting the use to -create "personal" or "non-commercial" videos or get a license -agreement with MPEG LA. If one -want to publish and broadcast video in a non-personal or commercial -setting, it might be that those tools can not be used, or that video -format can not be used, without breaking their copyright license. I -am not sure. -Back -then, I found that the copyright license terms for Adobe Premiere -and Apple Final Cut Pro both specified that one could not use the -program to produce anything else without a patent license from MPEG -LA. The issue is not limited to those two products, though. Other -much used products like those from Avid and Sorenson Media have terms -of use are similar to those from Adobe and Apple. The complicating -factor making me unsure if those terms have effect in Norway or not is -that the patents in question are not valid in Norway, but copyright -licenses are.
- -These are the terms for Avid Artist Suite, according to their -published -end user -license -text (converted to lower case text for easier reading):
+ +This is a copy of +an +email I posted to the nikita-noark mailing list. Please follow up +there if you would like to discuss this topic. The background is that +we are making a free software archive system based on the Norwegian +Noark +5 standard for government archives.
+ +I've been wondering a bit lately how trusted timestamps could be +stored in Noark 5. +Trusted +timestamps can be used to verify that some information +(document/file/checksum/metadata) have not been changed since a +specific time in the past. This is useful to verify the integrity of +the documents in the archive.
+ +Then it occured to me, perhaps the trusted timestamps could be +stored as dokument variants (ie dokumentobjekt referered to from +dokumentbeskrivelse) with the filename set to the hash it is +stamping?
+ +Given a "dokumentbeskrivelse" with an associated "dokumentobjekt", +a new dokumentobjekt is associated with "dokumentbeskrivelse" with the +same attributes as the stamped dokumentobjekt except these +attributes:
--+18.2. MPEG-4. MPEG-4 technology may be included with the -software. MPEG LA, L.L.C. requires this notice:
- -This product is licensed under the MPEG-4 visual patent portfolio -license for the personal and non-commercial use of a consumer for (i) -encoding video in compliance with the MPEG-4 visual standard (âMPEG-4 -videoâ) and/or (ii) decoding MPEG-4 video that was encoded by a -consumer engaged in a personal and non-commercial activity and/or was -obtained from a video provider licensed by MPEG LA to provide MPEG-4 -video. No license is granted or shall be implied for any other -use. Additional information including that relating to promotional, -internal and commercial uses and licensing may be obtained from MPEG -LA, LLC. See http://www.mpegla.com. This product is licensed under -the MPEG-4 systems patent portfolio license for encoding in compliance -with the MPEG-4 systems standard, except that an additional license -and payment of royalties are necessary for encoding in connection with -(i) data stored or replicated in physical media which is paid for on a -title by title basis and/or (ii) data which is paid for on a title by -title basis and is transmitted to an end user for permanent storage -and/or use, such additional license may be obtained from MPEG LA, -LLC. See http://www.mpegla.com for additional details.
- -18.3. H.264/AVC. H.264/AVC technology may be included with the -software. MPEG LA, L.L.C. requires this notice:
- -This product is licensed under the AVC patent portfolio license for -the personal use of a consumer or other uses in which it does not -receive remuneration to (i) encode video in compliance with the AVC -standard (âAVC videoâ) and/or (ii) decode AVC video that was encoded -by a consumer engaged in a personal activity and/or was obtained from -a video provider licensed to provide AVC video. No license is granted -or shall be implied for any other use. Additional information may be -obtained from MPEG LA, L.L.C. See http://www.mpegla.com.
-
-
-
- format -> "RFC3161" +
- mimeType -> "application/timestamp-reply" +
- formatDetaljer -> "<source URL for timestamp service>" +
- filenavn -> "<sjekksum>.tsr"
-
The Sorenson Media software have -similar terms:
+
Note the requirement that the videos created can only be used for -personal or non-commercial purposes.
+++This assume a service following +IETF RFC 3161 is +used, which specifiy the given MIME type for replies and the .tsr file +ending for the content of such trusted timestamp. As far as I can +tell from the Noark 5 specifications, it is OK to have several +variants/renderings of a dokument attached to a given +dokumentbeskrivelse objekt. It might be stretching it a bit to make +some of these variants represent crypto-signatures useful for +verifying the document integrity instead of representing the dokument +itself.
+ +Using the source of the service in formatDetaljer allow several +timestamping services to be used. This is useful to spread the risk +of key compromise over several organisations. It would only be a +problem to trust the timestamps if all of the organisations are +compromised.
+ +The following oneliner on Linux can be used to generate the tsr +file. $input is the path to the file to checksum, and $sha256 is the +SHA-256 checksum of the file (ie the "
-.tsr" value mentioned +above). With respect to a license from Sorenson pertaining to MPEG-4 Video -Decoders and/or Encoders: Any such product is licensed under the -MPEG-4 visual patent portfolio license for the personal and -non-commercial use of a consumer for (i) encoding video in compliance -with the MPEG-4 visual standard (âMPEG-4 videoâ) and/or (ii) decoding -MPEG-4 video that was encoded by a consumer engaged in a personal and -non-commercial activity and/or was obtained from a video provider -licensed by MPEG LA to provide MPEG-4 video. No license is granted or -shall be implied for any other use. Additional information including -that relating to promotional, internal and commercial uses and -licensing may be obtained from MPEG LA, LLC. See -http://www.mpegla.com.
- -With respect to a license from Sorenson pertaining to MPEG-4 -Consumer Recorded Data Encoder, MPEG-4 Systems Internet Data Encoder, -MPEG-4 Mobile Data Encoder, and/or MPEG-4 Unique Use Encoder: Any such -product is licensed under the MPEG-4 systems patent portfolio license -for encoding in compliance with the MPEG-4 systems standard, except -that an additional license and payment of royalties are necessary for -encoding in connection with (i) data stored or replicated in physical -media which is paid for on a title by title basis and/or (ii) data -which is paid for on a title by title basis and is transmitted to an -end user for permanent storage and/or use. Such additional license may -be obtained from MPEG LA, LLC. See http://www.mpegla.com for -additional details.
+-+openssl ts -query -data "$inputfile" -cert -sha256 -no_nonce \ + | curl -s -H "Content-Type: application/timestamp-query" \ + --data-binary "@-" http://zeitstempel.dfn.de > $sha256.tsr +
To verify the timestamp, you first need to download the public key +of the trusted timestamp service, for example using this command:
-Some free software like -Handbrake and -FFMPEG uses GPL/LGPL licenses and do -not have any such terms included, so for those, there is no -requirement to limit the use to personal and non-commercial.
-Lenge siden jeg har hatt tid til å publisere lenker til skriverier -jeg har hatt glede og nytte av av å lese. Her er en liten norsk -lenkesamling.
- --
-
-
- Sjøslag -om fiskemilliardene (NRK Ytring 2014-03-03) - litt om hvordan de -norske felles matressurser røves fra felleskapet. - -
- Matkrisen -kan komme til Norge (Aftenposten 2014-4-01) - hvordan miljøendringene vil gjøre matproduksjonen i Norge mer sårbar. - -
- Norge -trenger kornlager (NRK Ytring 2014-06-07) Chr. Anton Smedshaug -forteller litt om Norges sårbare matsituasjon etter at Staten solgte -Norges kornlager. - -
- PST -vil overvåke datatastaturer (NRK 2014-03-04) - PST ønsker retten -til å bryte seg inn på private PC-er og legge inn spionprogrammer. -Hvilket nok vil gjøre Linux mer populært, men gjør at en i enda mindre -grad enn i dag kan stole på datamaskiner - neppe en god ide for -samfunnet totalt sett. - -
- «Ruter -fremstår som et pøbelvelde» (OsloBy 2014-03-05) - et eksempel på -hvordan kollektivtransportselskapet i Oslo håndterer sine kunder. - -
- Clear -Channel nektet å vise Greenpeace-reklame i Oslo (Dagbladet -2014-03-05) - forteller litt om hvordan hvilke budskap som når ut i -det offentlige rom kontrolleres i Norge. - -
- Svarte -ikke på kritikken (Dagbladet 2014-03-06) - innlegg fra Norsk -presseforbund der de nok en gang tar opp det forkastelige i at -politiet nå har full tilgang til å bedrive telefonkontroll av -advokater. - -
- «Putin -spiller poker, ikke sjakk. I sjakk har man regler.» (Aftenposten -2014-03-08) - sjakklegenden Kasparov forklarer litt om hvordan han ser -at Russlands politikk fungerer, blant annet i lys av started av -Ukraina-krisen. - -
- I -seng med fienden (Aftenposten 2014-03-10) - kronikk fra Eirik -H. Vinje om hvordan menn og kvinner settes opp mot hverandre i det -offentlige ordskiftet, kanskje på sviktende grunnlag. - -
- Fritt -frem for skulk (Aftenposten 2014-03-14) - skildring av hvordan -norske elever i dag ikke lenger har rimelig krav om oppmøte på -skolen. - -
- «Datalagringsdirektiv» -avslørte abort, sykdom og våpenkjøp (Aftenposten 2014-03-14) - om -hvordan forskere har dokumentert hvordan innsamling av metadata om -telefoni og Internett-bruk kan være svært avslørende. - -
- Konsentrasjonssvikt -på pensum (Dagbladet 2014-03-14) - Kommentar om hvordan (feil) -bruk IKT i skolen kan ødelegge mer enn det bidrar til læring. - -
- Reservasjonsrettsstaten -(blogg fra Doremus 2014-02-09) - morsom beskrivelse om hvordan -regjeringens forslag til reservasjonsrett for leger kan utvides til å -gjelde alles samvittighet. - -
- Autoritær -gjøkunge (Aftenposten 2014-03-25) - Kronikk av Bjørn Stærk om -snurpenots-overvåkningen som varsleren Snowden dokumenterte. - -
- Leveransekrise -i Offentlig sektor â mener Mike Bracken, Executive Director of Digital -in the Cabinet Office (blogg fra Friprog-senteret 2014-03-26). - -
- Norge -må stanse avlyttingen (Dagbladet 2014-03-26) - leserinnlegg fra -Felix Horne der han ber om at Norge gjør en innsats for å få slutt på -overvåkning av innbyggerne som gjøres i Norge av Etiopiske -myndigheter. - -
- Demokrati -er ingen naturlig styreform (Aftenposten 2014-04-01) - kronikk av -Stein Ringen om hvordan demokrati som styreform går tapt når -innbyggerne tar det for gitt. - -
- Ytringsansvar -ere Enhver tilladte! (NRK Ytring 2014-04-01) - innspill fra Trygve -Svensson og Helge Svare om at hver enkelt av oss har et ansvar for å -ytre oss i den offentlige debatten. - -
- Jeg -er ingen god samfunnsborger (Aftenposten 2014-04-16), kronikk av -Simen Tveitereid om alternative måter å motiveres i samfunnet, uten å -hige etter mer penger og flere ting. - -
- DLD-dommen: -Avgjørelsen får umiddelbar virkning (Aftenposten 2014-04-10) - -kronikk av Høyres Michael Tetzschner, en partiutbryter i DLD-saken som -stemte nei til DLD i Stortinget i 2011. - -
- Datalagringsdirektivets -endelikt (blogg fra John Wessel-Aas 2014-04-11) - oppsummering -av hvordan direktivet ble funnet ugyldig i EU-domstolen. - -
- Kronikk: -Kapitulasjonspresidenten (VG 2014-04-22) - kronikk av Einar -Kr. Steffenak om hvordan Stortingspresidenten og regjeringen viser sin -prinsippløshet i møte med Kina. - -
- Innerst -inne er alle nordmenn (Aftenposten 2014-04-27) - kronikk fra Bjørn -Stærk om hvordan vi i Vesten i stor grad baserer oss på en fantasi om -at alle i verden bærer på en drøm om å bli som oss. - -
- Det -italienske senatet gav seg selv 134 milliarder euro i sluttpakke -(Aftenposten 2014-06-19) - forsker Simen Gaure forteller hvordan -løgner og fantasi fra nettkilder i stor grad blir akseptert som -sannhet - antagelig også av deg og meg. - -
- Et -forsvar for brÃ¥kmakerne (Dagbladet 2014-05-30) - kronikk av Dag -Ãystein Nome som beskriver hvordan dagens skole ikke fungerer sÃ¥ godt -for mange elever. - -
- Betalte -med slitt seddel - havnet i arresten (Osloby 2014-06-25)) - -dokumentasjon av Oslopolitiets angrep på vår alles rett til å ferdes -uten elektronisk sporing. Jeg bruker kontanter i så stor grad som -mulig da banken ikke har noe med hvor jeg er og hva jeg kjøper. Vi -som gjør dette risikerer som beskrevet overgrep som frihetsberøvelse -og registrering og lagring av fingeravtrykk og bilde i politiets -database over mistenkte. - -
- Fredsprisen -til Snowden (Aftenposten 2014-06-28) - leder som forklarer hvorfor -varsleren Snowden bør få fredsprisen. - -
- Strategi -for politistaten (Dagbladet 2014-08-01) - leder som advarer om -sterke krefter som bruker terrortrusselen til å lirke Norge nærmere å -bli en politistat. - -
- Vi -må tenke nytt om narkotika (NRK Ytring 2014-08-03) - Mark Lewis -forklarer hvorfor legalisering og offentlig kontroll av -narkotikamarkedet er mye bedre enn å overlate det til kriminelle. - - -
+ ++wget -O ca-cert.txt \ + https://pki.pca.dfn.de/global-services-ca/pub/cacert/chain.txt +
Note, the public key should be stored alongside the timestamps in +the archive to make sure it is also available 100 years from now. It +is probably a good idea to standardise how and were to store such +public keys, to make it easier to find for those trying to verify +documents 100 or 1000 years from now. :)
+ +The verification itself is a simple openssl command:
+ ++ ++openssl ts -verify -data $inputfile -in $sha256.tsr \ + -CAfile ca-cert.txt -text +
Is there any reason this approach would not work? Is it somehow against +the Noark 5 specification?
The complete and free âout of the boxâ software solution for -schools, Debian Edu / -Skolelinux, is used quite a lot in Germany, and one of the people -involved is Bernd Zeitzen, who show up on the project mailing lists -from time to time with interesting questions and tips on how to adjust -the setup. I managed to interview him this summer.
- -Who are you, and how do you spend your days?
- -My name is Bernd Zeitzen and I'm married with Hedda, a self -employed physiotherapist. My former profession is tool maker, but I -haven't worked for 30 years in this job. 30 years ago I started to -support my wife and become her officeworker and a few years later the -administrator for a small computer network, today based on Ubuntu -Server (Samba, OpenVPN). For her daily work she has to use Windows -Desktops because the software she needs to organize her business only -works with Windows . :-(
- -In 1988 we started with one PC and DOS, then I learned to use -Windows 98, 2000, XP, â¦, 8, Ubuntu, MacOSX. Today we are running a -Linux server with 6 Windows clients and 10 persons (teacher of -children with special needs, speech therapist, occupational therapist, -psychologist and officeworkers) using our Samba shares via OpenVPN to -work with the documentations of our patients.
- -How did you get in contact with the Skolelinux / Debian Edu -project?
- -Two years ago a friend of mine asked me, if I want to get a job in -his school (Gymnasium -Harsewinkel). They started with Skolelinux / Debian Edu and they -were looking for people to give support to the teachers using the -software and the network and teaching the pupils increasing their -computer skills in optional lessons. I'm spending 4-6 hours a week -with this job.
- -What do you see as the advantages of Skolelinux / Debian -Edu?
- -The independence.
- -First: Every person is allowed to use, share and develop the -software. Even if you are poor, you are allowed to use the software -included in Skolelinux/Debian Edu and all the other Free Software.
- -Second: The software runs on old machines and this gives us the -possibility to recycle computers, weeded out from offices. The -servers and desktops are running for more than two years and they are -working reliable.
- -We have two servers (one tjener and one terminal server), 45 -workstations in three classrooms and seven laptops as a mobile -solution for all classrooms. These machines are all booting from the -terminal server. In the moment we are installing 30 laptops as mobile -workstations. Then the pupils have the possibility to work with these -machines in their classrooms. Internet access is realized by a WLAN -router, connected to the schools network. This is all done without a -dedicated system administrator or a computer science teacher.
- -What do you see as the disadvantages of Skolelinux / Debian -Edu?
- -Teachers and pupils are Windows users. <Irony on> And Linux -isn't cool. It's software for freaks using the command line. <Irony -off> They don't realize the stability of the system.
- -Which free software do you use daily?
- -Firefox, Thunderbird, LibreOffice, Ubuntu Server 12.04 (Samba, -Apache, MySQL, Joomla!, ⦠and Skolelinux / Debian Edu)
- -Which strategy do you believe is the right one to use to -get schools to use free software?
- -In Germany we have the situation: every school is free to decide -which software they want to use. This decision is influenced by -teachers who learned to use Windows and MS Office. They buy a PC with -Windows preinstalled and an additional testing version of MS -Office. They don't know about the possibility to use Free Software -instead. Another problem are the publisher of school books. They -develop their software, added to the school books, for Windows.
+ +Aftenposten +melder i dag om feil i eksamensoppgavene for eksamen i politikk og +menneskerettigheter, der teksten i bokmåls og nynorskutgaven ikke var +like. Oppgaveteksten er gjengitt i artikkelen, og jeg ble nysgjerring +på om den fri oversetterløsningen +Apertium ville gjort en bedre +jobb enn Utdanningsdirektoratet. Det kan se slik ut.
+ +Her er bokmålsoppgaven fra eksamenen:
+ +++ +Drøft utfordringene knyttet til nasjonalstatenes og andre aktørers +rolle og muligheter til å håndtere internasjonale utfordringer, som +for eksempel flykningekrisen.
+ +Vedlegge er eksempler på tekster som kan gi relevante perspektiver +på temaet:
++
+ +- Flykningeregnskapet 2016, UNHCR og IDMC +
- «Grenseløst Europa for fall» A-Magasinet, 26. november 2015 +
Dette oversetter Apertium slik:
+ +++ +Drøft utfordringane knytte til nasjonalstatane sine og rolla til +andre aktørar og høve til å handtera internasjonale utfordringar, som +til dømes *flykningekrisen.
+ +Vedleggja er døme på tekster som kan gje relevante perspektiv på +temaet:
+ ++
+ +- *Flykningeregnskapet 2016, *UNHCR og *IDMC
+- «*Grenseløst Europa for fall» A-Magasinet, 26. november 2015
+
Ord som ikke ble forstått er markert med stjerne (*), og trenger +ekstra språksjekk. Men ingen ord er forsvunnet, slik det var i +oppgaven elevene fikk presentert på eksamen. Jeg mistenker dog at +"andre aktørers rolle og muligheter til ..." burde vært oversatt til +"rolla til andre aktørar og deira høve til ..." eller noe slikt, men +det er kanskje flisespikking. Det understreker vel bare at det alltid +trengs korrekturlesning etter automatisk oversettelse.
This summer I finally had time to continue working on the Norwegian -docbook version of the 2004 book -Free Culture by Lawrence Lessig, -to get a Norwegian text explaining the problems with todays copyright -law. Yesterday, I finally completed translated the book text. There -are still some foot/end notes left to translate, the colophon page -need to be rewritten, and a few words and phrases still need to be -translated, but the Norwegian text is ready for the first proof -reading. :) More spell checking is needed, and several illustrations -need to be cleaned up. The work stopped up because I had to give -priority to other projects the last year, and the progress graph of -the translation show this very well:
- -If you want to read the result, check out the -github -project pages and the -PDF, -EPUB -and HTML version available in the -archive -directory.
- -Please report typos, bugs and improvements to the github project if -you find any.
+ +I disse dager, med frist 1. mai, har Riksarkivaren ute en høring på +sin forskrift. Som en kan se er det ikke mye tid igjen før fristen +som går ut på søndag. Denne forskriften er det som lister opp hvilke +formater det er greit å arkivere i +Noark +5-løsninger i Norge.
+ +Jeg fant høringsdokumentene hos +Norsk +Arkivråd etter å ha blitt tipset på epostlisten til +fri +programvareprosjektet Nikita Noark5-Core, som lager et Noark 5 +Tjenestegresesnitt. Jeg er involvert i Nikita-prosjektet og takket +være min interesse for tjenestegrensesnittsprosjektet har jeg lest en +god del Noark 5-relaterte dokumenter, og til min overraskelse oppdaget +at standard epost ikke er på listen over godkjente formater som kan +arkiveres. Høringen med frist søndag er en glimrende mulighet til å +forsøke å gjøre noe med det. Jeg holder på med +egen +høringsuttalelse, og lurer på om andre er interessert i å støtte +forslaget om å tillate arkivering av epost som epost i arkivet.
+ +Er du igang med å skrive egen høringsuttalelse allerede? I så fall +kan du jo vurdere å ta med en formulering om epost-lagring. Jeg tror +ikke det trengs så mye. Her et kort forslag til tekst:
+ ++ ++ +Viser til høring sendt ut 2017-02-17 (Riksarkivarens referanse + 2016/9840 HELHJO), og tillater oss å sende inn noen innspill om + revisjon av Forskrift om utfyllende tekniske og arkivfaglige + bestemmelser om behandling av offentlige arkiver (Riksarkivarens + forskrift).
+ +Svært mye av vår kommuikasjon foregår i dag på e-post. Vi + foreslår derfor at Internett-e-post, slik det er beskrevet i IETF + RFC 5322, + https://tools.ietf.org/html/rfc5322. bør + inn som godkjent dokumentformat. Vi foreslår at forskriftens + oversikt over godkjente dokumentformater ved innlevering i § 5-16 + endres til å ta med Internett-e-post.
+ +
Som del av arbeidet med tjenestegrensesnitt har vi testet hvordan +epost kan lagres i en Noark 5-struktur, og holder på å skrive et +forslag om hvordan dette kan gjøres som vil bli sendt over til +arkivverket så snart det er ferdig. De som er interesserte kan +følge +fremdriften på web.
+ +Oppdatering 2017-04-28: I dag ble høringuttalelsen jeg skrev + sendt + inn av foreningen NUUG.
The Debian Edu / Skolelinux -project provide an instruction manual for teachers, system -administrators and other users that contain useful tips for setting up -and maintaining a Debian Edu installation. This text is about how the -text processing of this manual is handled in the project.
- -One goal of the project is to provide information in the native -language of its users, and for this we need to handle translations. -But we also want to make sure each language contain the same -information, so for this we need a good way to keep the translations -in sync. And we want it to be easy for our users to improve the -documentation, avoiding the need to learn special formats or tools to -contribute, and the obvious way to do this is to make it possible to -edit the documentation using a web browser. We also want it to be -easy for translators to keep the translation up to date, and give them -help in figuring out what need to be translated. Here is the list of -tools and the process we have found trying to reach all these -goals.
- -We maintain the authoritative source of our manual in the -Debian -wiki, as several wiki pages written in English. It consist of one -front page with references to the different chapters, several pages -for each chapter, and finally one "collection page" gluing all the -chapters together into one large web page (aka -the -AllInOne page). The AllInOne page is the one used for further -processing and translations. Thanks to the fact that the -MoinMoin installation on -wiki.debian.org support exporting pages in -the Docbook format, we can fetch -the list of pages to export using the raw version of the AllInOne -page, loop over each of them to generate a Docbook XML version of the -manual. This process also download images and transform image -references to use the locally downloaded images. The generated -Docbook XML files are slightly broken, so some post-processing is done -using the documentation/scripts/get_manual program, and the -result is a nice Docbook XML file (debian-edu-wheezy-manual.xml) and -a handfull of images. The XML file can now be used to generate PDF, HTML -and epub versions of the English manual. This is the basic step of -our process, making PDF (using dblatex), HTML (using xsltproc) and -epub (using dbtoepub) version from Docbook XML, and the resulting files -are placed in the debian-edu-doc-en binary package.
- -But English documentation is not enough for us. We want translated -documentation too, and we want to make it easy for translators to -track the English original. For this we use the -poxml package, -which allow us to transform the English Docbook XML file into a -translation file (a .pot file), usable with the normal gettext based -translation tools used by those translating free software. The pot -file is used to create and maintain translation files (several .po -files), which the translations update with the native language -translations of all titles, paragraphs and blocks of text in the -original. The next step is combining the original English Docbook XML -and the translation file (say debian-edu-wheezy-manual.nb.po), to -create a translated Docbook XML file (in this case -debian-edu-wheezy-manual.nb.xml). This translated (or partly -translated, if the translation is not complete) Docbook XML file can -then be used like the original to create a PDF, HTML and epub version -of the documentation.
- -The translators use different tools to edit the .po files. We -recommend using -lokalize, -while some use emacs and vi, others can use web based editors like -Poodle or -Transifex. All we care about -is where the .po file end up, in our git repository. Updated -translations can either be committed directly to git, or submitted as -bug reports -against the debian-edu-doc package.
- -One challenge is images, which both might need to be translated (if -they show translated user applications), and are needed in different -formats when creating PDF and HTML versions (epub is a HTML version in -this regard). For this we transform the original PNG images to the -needed density and format during build, and have a way to provide -translated images by storing translated versions in -images/$LANGUAGECODE/. I am a bit unsure about the details here. The -package maintainers know more.
- -If you wonder what the result look like, we provide -the content -of the documentation packages on the web. See for example the -Italian -PDF version or the -German -HTML version. We do not yet build the epub version by default, -but perhaps it will be done in the future.
- -To learn more, check out -the -debian-edu-doc package, -the -manual on the wiki and -the -translation instructions in the manual.
+ +Jeg oppdaget i dag at nettstedet som +publiserer offentlige postjournaler fra statlige etater, OEP, har +begynt å blokkerer enkelte typer webklienter fra å få tilgang. Vet +ikke hvor mange det gjelder, men det gjelder i hvert fall libwww-perl +og curl. For å teste selv, kjør følgende:
+ ++ ++% curl -v -s https://www.oep.no/pub/report.xhtml?reportId=3 2>&1 |grep '< HTTP' +< HTTP/1.1 404 Not Found +% curl -v -s --header 'User-Agent:Opera/12.0' https://www.oep.no/pub/report.xhtml?reportId=3 2>&1 |grep '< HTTP' +< HTTP/1.1 200 OK +% +
Her kan en se at tjenesten gir «404 Not Found» for curl i +standardoppsettet, mens den gir «200 OK» hvis curl hevder å være Opera +versjon 12.0. Offentlig elektronisk postjournal startet blokkeringen +2017-03-02.
+ +Blokkeringen vil gjøre det litt vanskeligere å maskinelt hente +informasjon fra oep.no. Kan blokkeringen være gjort for å hindre +automatisert innsamling av informasjon fra OEP, slik Pressens +Offentlighetsutvalg gjorde for å dokumentere hvordan departementene +hindrer innsyn i +rapporten +«Slik hindrer departementer innsyn» som ble publiserte i januar +2017. Det virker usannsynlig, da det jo er trivielt å bytte +User-Agent til noe nytt.
+ +Finnes det juridisk grunnlag for det offentlige å diskriminere +webklienter slik det gjøres her? Der tilgang gis eller ikke alt etter +hva klienten sier at den heter? Da OEP eies av DIFI og driftes av +Basefarm, finnes det kanskje noen dokumenter sendt mellom disse to +aktørene man kan be om innsyn i for å forstå hva som har skjedd. Men +postjournalen +til DIFI viser kun to dokumenter det siste året mellom DIFI og +Basefarm. +Mimes brønn neste, +tenker jeg.
Jeg har fortsatt behov for å kunne laste ned innslag fra NRKs -nettsted av og til for å se senere når jeg ikke er på nett, men -min -oppskrift fra 2011 sluttet å fungere da NRK byttet -avspillermetode. I dag fikk jeg endelig lett etter oppdatert løsning, -og jeg er veldig glad for å fortelle at den enkleste måten å laste ned -innslag er å bruke siste versjon 2014.06.07 av -youtube-dl. Støtten i -youtube-dl kom -inn for 23 dager siden og -versjonen i -Debian fungerer fint også som backport til Debian Wheezy. Det er -et lite problem, det håndterer kun URLer med små bokstaver, men hvis -en har en URL med store bokstaver kan en bare gjøre alle store om til -små bokstaver for å få youtube-dl til å laste ned. Rapporterte -nettopp -problemet til -utviklerne, og antar de får fikset det snart.
- -Dermed er alt klart til å laste ned dokumentarene om -USAs -hemmelige avlytting og -Selskapene -bak USAs avlytting, i tillegg til -intervjuet -med Edward Snowden gjort av den tyske tv-kanalen ARD. Anbefaler -alle å se disse, sammen med -foredraget -til Jacob Appelbaum på siste CCC-konferanse, for å forstå mer om -hvordan overvåkningen av borgerne brer om seg.
- -Takk til gode venner på foreningen NUUGs IRC-kanal -#nuug på irc.freenode.net -for tipsene som fikk meg i mål.
- -Oppdatering 2014-06-17: Etter at jeg publiserte -denne, ble jeg tipset om bloggposten -"Downloading -HD content from tv.nrk.no" av Ingvar Hagelund, som har alternativ -implementasjon og tips for å lage mkv-fil med undertekstene inkludert. -Kanskje den passer bedre for deg? I tillegg ble feilen i youtube-dl -ble fikset litt senere ut på dagen i går, samt at youtube-dl fikk -støtte for å laste ned undertitler. Takk til Anders Einar Hilden for -god innsats og youtube-dl-utviklerne for rask respons.
+ +The Nikita +Noark 5 core project is implementing the Norwegian standard for +keeping an electronic archive of government documents. +The +Noark 5 standard document the requirement for data systems used by +the archives in the Norwegian government, and the Noark 5 web interface +specification document a REST web service for storing, searching and +retrieving documents and metadata in such archive. I've been involved +in the project since a few weeks before Christmas, when the Norwegian +Unix User Group +announced +it supported the project. I believe this is an important project, +and hope it can make it possible for the government archives in the +future to use free software to keep the archives we citizens depend +on. But as I do not hold such archive myself, personally my first use +case is to store and analyse public mail journal metadata published +from the government. I find it useful to have a clear use case in +mind when developing, to make sure the system scratches one of my +itches.
+ +If you would like to help make sure there is a free software +alternatives for the archives, please join our IRC channel +(#nikita on +irc.freenode.net) and +the +project mailing list.
+ +When I got involved, the web service could store metadata about +documents. But a few weeks ago, a new milestone was reached when it +became possible to store full text documents too. Yesterday, I +completed an implementation of a command line tool +archive-pdf to upload a PDF file to the archive using this +API. The tool is very simple at the moment, and find existing +fonds, series and +files while asking the user to select which one to use if more than +one exist. Once a file is identified, the PDF is associated with the +file and uploaded, using the title extracted from the PDF itself. The +process is fairly similar to visiting the archive, opening a cabinet, +locating a file and storing a piece of paper in the archive. Here is +a test run directly after populating the database with test data using +our API tester:
+ ++ ++~/src//noark5-tester$ ./archive-pdf mangelmelding/mangler.pdf +using arkiv: Title of the test fonds created 2017-03-18T23:49:32.103446 +using arkivdel: Title of the test series created 2017-03-18T23:49:32.103446 + + 0 - Title of the test case file created 2017-03-18T23:49:32.103446 + 1 - Title of the test file created 2017-03-18T23:49:32.103446 +Select which mappe you want (or search term): 0 +Uploading mangelmelding/mangler.pdf + PDF title: Mangler i spesifikasjonsdokumentet for NOARK 5 Tjenestegrensesnitt + File 2017/1: Title of the test case file created 2017-03-18T23:49:32.103446 +~/src//noark5-tester$ +
You can see here how the fonds (arkiv) and serie (arkivdel) only had +one option, while the user need to choose which file (mappe) to use +among the two created by the API tester. The archive-pdf +tool can be found in the git repository for the API tester.
+ +In the project, I have been mostly working on +the API +tester so far, while getting to know the code base. The API +tester currently use +the HATEOAS links +to traverse the entire exposed service API and verify that the exposed +operations and objects match the specification, as well as trying to +create objects holding metadata and uploading a simple XML file to +store. The tester has proved very useful for finding flaws in our +implementation, as well as flaws in the reference site and the +specification.
+ +The test document I uploaded is a summary of all the specification +defects we have collected so far while implementing the web service. +There are several unclear and conflicting parts of the specification, +and we have +started +writing down the questions we get from implementing it. We use a +format inspired by how The +Austin Group collect defect reports for the POSIX standard with +their +instructions for the MANTIS defect tracker system, in lack of an official way to structure defect reports for Noark 5 (our first submitted defect report was a request for a procedure for submitting defect reports :). + +
The Nikita project is implemented using Java and Spring, and is +fairly easy to get up and running using Docker containers for those +that want to test the current code base. The API tester is +implemented in Python.
Archive
-
+
- 2017
+
-
+
+
- January (4) + +
- February (3) + +
- March (5) + +
- April (2) + +
- June (5) + +
- July (1) + +
- August (1) + +
+
+ - 2016
+
-
+
+
- January (3) + +
- February (2) + +
- March (3) + +
- April (8) + +
- May (8) + +
- June (2) + +
- July (2) + +
- August (5) + +
- September (2) + +
- October (3) + +
- November (8) + +
- December (5) + +
+
+ - 2015
+
-
+
+
- January (7) + +
- February (6) + +
- March (1) + +
- April (4) + +
- May (3) + +
- June (4) + +
- July (6) + +
- August (2) + +
- September (2) + +
- October (9) + +
- November (6) + +
- December (3) + +
+
- 2014
-
@@ -1217,7 +821,13 @@ god innsats og youtube-dl-utviklerne for rask respons.
- August (2) -
- September (4) +
- September (5) + +
- October (6) + +
- November (3) + +
- December (5)
@@ -1390,65 +1000,73 @@ god innsats og youtube-dl-utviklerne for rask respons.
- bankid (4) -
- bitcoin (8) +
- bitcoin (9) -
- bootsystem (14) +
- bootsystem (16)
- bsa (2)
- chrpath (2) -
- debian (102) +
- debian (151) + +
- debian edu (158) -
- debian edu (149) +
- debian-handbook (4)
- digistan (10) -
- dld (15) +
- dld (16) -
- docbook (12) +
- docbook (24)
- drivstoffpriser (4) -
- english (254) +
- english (351) -
- fiksgatami (21) +
- fiksgatami (23)
- fildeling (12) -
- freeculture (13) +
- freeculture (30) -
- freedombox (8) +
- freedombox (9) -
- frikanalen (11) +
- frikanalen (18) -
- intervju (41) +
- h264 (20) -
- isenkram (9) +
- intervju (42) -
- kart (19) +
- isenkram (15) + +
- kart (20)
- ldap (9)
- lenker (8) +
- lsdvd (2) +
- ltsp (1)
- mesh network (8) -
- multimedia (30) +
- multimedia (39) -
- norsk (248) +
- nice free software (9) -
- nuug (162) +
- norsk (291) -
- offentlig innsyn (11) +
- nuug (189) + +
- offentlig innsyn (33)
- open311 (2) -
- opphavsrett (48) +
- opphavsrett (64) -
- personvern (75) +
- personvern (101)
- raid (1) @@ -1458,37 +1076,39 @@ god innsats og youtube-dl-utviklerne for rask respons.
- rfid (3) -
- robot (9) +
- robot (10)
- rss (1) -
- ruter (4) +
- ruter (5)
- scraperwiki (2) -
- sikkerhet (41) +
- sikkerhet (53)
- sitesummary (4) -
- skepsis (4) +
- skepsis (5) + +
- standard (55) -
- standard (45) +
- stavekontroll (6) -
- stavekontroll (3) +
- stortinget (11) -
- stortinget (9) +
- surveillance (49) -
- surveillance (26) +
- sysadmin (3) -
- sysadmin (1) +
- usenix (2)
- valg (8) -
- video (43) +
- video (59)
- vitenskap (4) -
- web (33) +
- web (40)