1 <?xml version=
"1.0" encoding=
"utf-8"?>
2 <rss version='
2.0' xmlns:lj='http://www.livejournal.org/rss/lj/
1.0/'
>
4 <title>Petter Reinholdtsen - Entries tagged nice free software
</title>
5 <description>Entries tagged nice free software
</description>
6 <link>https://people.skolelinux.org/pere/blog/
</link>
10 <title>GnuCOBOL, a free platform to learn and use COBOL - nice free software
</title>
11 <link>https://people.skolelinux.org/pere/blog/GnuCOBOL__a_free_platform_to_learn_and_use_COBOL___nice_free_software.html
</link>
12 <guid isPermaLink=
"true">https://people.skolelinux.org/pere/blog/GnuCOBOL__a_free_platform_to_learn_and_use_COBOL___nice_free_software.html
</guid>
13 <pubDate>Wed,
29 Apr
2020 13:
10:
00 +
0200</pubDate>
14 <description><p
>The curiosity got the better of me when
15 <a href=
"https://developers.slashdot.org/story/
20/
04/
06/
1424246/new-jersey-desperately-needs-cobol-programmers
">Slashdot
16 reported
</a
> that New Jersey was desperately looking for
17 <a href=
"https://en.wikipedia.org/wiki/COBOL
">COBOL
</a
> programmers,
18 and a few days later it was reported that
19 <a href=
"https://onezero.medium.com/ibm-rallies-cobol-engineers-to-save-overloaded-unemployment-systems-eeadf13eddce
">IBM
20 tried to locate COBOL programmers
</a
>.
</p
>
22 <p
>I thus decided to have a look at free software alternatives to
23 learn COBOL, and had the pleasure to find
24 <a href=
"https://sourceforge.net/projects/open-cobol/
">GnuCOBOL
</a
> was
25 already
<a href=
"https://tracker.debian.org/pkg/gnucobol
">in
26 Debian
</a
>. It used to be called Open Cobol, and is a
"compiler
"
27 transforming COBOL code to C or C++ before giving it to GCC or Visual
28 Studio to build binaries.
</p
>
30 <p
>I managed to get in touch with upstream, and was impressed with the
31 quick response, and also was happy to see a new Debian maintainer
32 taking over when the original one recently asked to be replaced. A
33 new Debian upload was done as recently as yesterday.
</p
>
35 <p
>Using the Debian package, I was able to follow a simple COBOL
36 introduction and make and run simple COBOL programs. It was fun to
37 learn a new programming language. If you want to test for yourself,
38 <a href=
"https://en.wikipedia.org/wiki/GnuCOBOL
">the GnuCOBOL Wikipedia
39 page
</a
> have a few simple examples to get you startet.
</p
>
41 <p
>As I do not have much experience with COBOL, I do not know how
42 standard compliant it is, but it claim to pass most tests from COBOL
43 test suite, which sound good to me. It is nice to know it is possible
44 to learn COBOL using software without any usage restrictions, and I am
45 very happy such nice free software project as this is available. If
46 you as me is curious about COBOL, check it out.
</p
>
48 <p
>As usual, if you use Bitcoin and want to show your support of my
49 activities, please send Bitcoin donations to my address
50 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
55 <title>PlantUML for text based UML diagram modelling - nice free software
</title>
56 <link>https://people.skolelinux.org/pere/blog/PlantUML_for_text_based_UML_diagram_modelling___nice_free_software.html
</link>
57 <guid isPermaLink=
"true">https://people.skolelinux.org/pere/blog/PlantUML_for_text_based_UML_diagram_modelling___nice_free_software.html
</guid>
58 <pubDate>Mon,
25 Mar
2019 09:
35:
00 +
0100</pubDate>
59 <description><p
>As part of my involvement with the
60 <a href=
"https://gitlab.com/OsloMet-ABI/nikita-noark5-core/
">Nikita
61 Noark
5 core project
</a
>, I have been proposing improvements to the
62 API specification created by
<a href=
"https://www.arkivverket.no/
">The
63 National Archives of Norway
</a
> and helped migrating the text from a
64 version control system unfriendly binary format (docx) to Markdown in
65 git. Combined with the migration to a public git repository (on
66 github), this has made it possible for anyone to suggest improvement
67 to the text.
</p
>
69 <p
>The specification is filled with UML diagrams. I believe the
70 original diagrams were modelled using Sparx Systems Enterprise
71 Architect, and exported as EMF files for import into docx. This
72 approach make it very hard to track changes using a version control
73 system. To improve the situation I have been looking for a good text
74 based UML format with associated command line free software tools on
75 Linux and Windows, to allow anyone to send in corrections to the UML
76 diagrams in the specification. The tool must be text based to work
77 with git, and command line to be able to run it automatically to
78 generate the diagram images. Finally, it must be free software to
79 allow anyone, even those that can not accept a non-free software
80 license, to contribute.
</p
>
82 <p
>I did not know much about free software UML modelling tools when I
83 started. I have used dia and inkscape for simple modelling in the
84 past, but neither are available on Windows, as far as I could tell. I
86 <a href=
"https://modeling-languages.com/text-uml-tools-complete-list/
">list
87 of text mode uml tools
</a
>, and tested out a few of the tools listed
88 there.
<a href=
"http://plantuml.com/
">The PlantUML tool
</a
> seemed
89 most promising. After verifying that the packages
90 <a href=
"https://tracker.debian.org/pkg/plantuml
">is available in
91 Debian
</a
> and found
<a href=
"https://github.com/plantuml/plantuml
">its
92 Java source
</a
> under a GPL license on github, I set out to test if it
93 could represent the diagrams we needed, ie the ones currently in
94 <a href=
"https://github.com/arkivverket/noark5-tjenestegrensesnitt-standard/
">the
95 Noark
5 Tjenestegrensesnitt specification
</a
>. I am happy to report
96 that it could represent them, even thought it have a few warts here
99 <p
>After a few days of modelling I completed the task this weekend. A
100 temporary link to the complete set of diagrams (original and from
101 PlantUML) is available in
102 <a href=
"https://github.com/arkivverket/noark5-tjenestegrensesnitt-standard/issues/
76">the
103 github issue discussing the need for a text based UML format
</a
>, but
104 please note I lack a sensible tool to convert EMF files to PNGs, so
105 the
"original
" rendering is not as good as the original was in the
106 publised PDF.
</p
>
108 <p
>Here is an example UML diagram, showing the core classes for
109 keeping metadata about archived documents:
</p
>
113 skinparam classAttributeIconSize
0
115 !include media/uml-class-arkivskaper.iuml
116 !include media/uml-class-arkiv.iuml
117 !include media/uml-class-klassifikasjonssystem.iuml
118 !include media/uml-class-klasse.iuml
119 !include media/uml-class-arkivdel.iuml
120 !include media/uml-class-mappe.iuml
121 !include media/uml-class-merknad.iuml
122 !include media/uml-class-registrering.iuml
123 !include media/uml-class-basisregistrering.iuml
124 !include media/uml-class-dokumentbeskrivelse.iuml
125 !include media/uml-class-dokumentobjekt.iuml
126 !include media/uml-class-konvertering.iuml
127 !include media/uml-datatype-elektronisksignatur.iuml
129 Arkivstruktur.Arkivskaper
"+arkivskaper
1..*
" <-o
"+arkiv
0..*
" Arkivstruktur.Arkiv
130 Arkivstruktur.Arkiv o--
> "+underarkiv
0..*
" Arkivstruktur.Arkiv
131 Arkivstruktur.Arkiv
"+arkiv
1" o--
> "+arkivdel
0..*
" Arkivstruktur.Arkivdel
132 Arkivstruktur.Klassifikasjonssystem
"+klassifikasjonssystem [
0.
.1]
" <--o
"+arkivdel
1..*
" Arkivstruktur.Arkivdel
133 Arkivstruktur.Klassifikasjonssystem
"+klassifikasjonssystem [
0.
.1]
" o--
> "+klasse
0..*
" Arkivstruktur.Klasse
134 Arkivstruktur.Arkivdel
"+arkivdel
0.
.1" o--
> "+mappe
0..*
" Arkivstruktur.Mappe
135 Arkivstruktur.Arkivdel
"+arkivdel
0.
.1" o--
> "+registrering
0..*
" Arkivstruktur.Registrering
136 Arkivstruktur.Klasse
"+klasse
0.
.1" o--
> "+mappe
0..*
" Arkivstruktur.Mappe
137 Arkivstruktur.Klasse
"+klasse
0.
.1" o--
> "+registrering
0..*
" Arkivstruktur.Registrering
138 Arkivstruktur.Mappe --
> "+undermappe
0..*
" Arkivstruktur.Mappe
139 Arkivstruktur.Mappe
"+mappe
0.
.1" o--
> "+registrering
0..*
" Arkivstruktur.Registrering
140 Arkivstruktur.Merknad
"+merknad
0..*
" <--* Arkivstruktur.Mappe
141 Arkivstruktur.Merknad
"+merknad
0..*
" <--* Arkivstruktur.Dokumentbeskrivelse
142 Arkivstruktur.Basisregistrering -|
> Arkivstruktur.Registrering
143 Arkivstruktur.Merknad
"+merknad
0..*
" <--* Arkivstruktur.Basisregistrering
144 Arkivstruktur.Registrering
"+registrering
1..*
" o--
> "+dokumentbeskrivelse
0..*
" Arkivstruktur.Dokumentbeskrivelse
145 Arkivstruktur.Dokumentbeskrivelse
"+dokumentbeskrivelse
1" o-
> "+dokumentobjekt
0..*
" Arkivstruktur.Dokumentobjekt
146 Arkivstruktur.Dokumentobjekt *-
> "+konvertering
0..*
" Arkivstruktur.Konvertering
147 Arkivstruktur.ElektroniskSignatur -[hidden]-
> Arkivstruktur.Dokumentobjekt
151 <p
><a href=
"http://plantuml.com/class-diagram
">The format
</a
> is quite
152 compact, with little redundant information. The text expresses
153 entities and relations, and there is little layout related fluff. One
154 can reuse content by using include files, allowing for consistent
155 naming across several diagrams. The include files can be standalone
156 PlantUML too. Here is the content of
157 <tt
>media/uml-class-arkivskaper.iuml
</tt
>:
</p
>
161 class Arkivstruktur.Arkivskaper
<Arkivenhet
> {
162 +arkivskaperID : string
163 +arkivskaperNavn : string
164 +beskrivelse : string [
0.
.1]
169 <p
>This is what the complete diagram for the PlantUML notation above
172 <p
><img width=
"80%
" src=
"http://people.skolelinux.org/pere/blog/images/
2019-
03-
25-noark5-plantuml-diagrameksempel.png
"></p
>
174 <p
>A cool feature of PlantUML is that the generated PNG files include
175 the entire original source diagram as text. The source (with include
176 statements expanded) can be extracted using for example
177 <tt
>exiftool
</tt
>. Another cool feature is that parts of the entities
178 can be hidden after inclusion. This allow to use include files with
179 all attributes listed, even for UML diagrams that should not list any
180 attributes.
</p
>
182 <p
>The diagram also show some of the warts. Some times the layout
183 engine place text labels on top of each other, and some times it place
184 the class boxes too close to each other, not leaving room for the
185 labels on the relationship arrows. The former can be worked around by
186 placing extra newlines in the labes (ie
"\n
"). I did not do it here
187 to be able to demonstrate the issue. I have not found a good way
188 around the latter, so I normally try to reduce the problem by changing
189 from vertical to horizontal links to improve the layout.
</p
>
191 <p
>All in all, I am quite happy with PlantUML, and very impressed with
192 how quickly its lead developer responds to questions. So far I got an
193 answer to my questions in a few hours when I send an email. I
194 definitely recommend looking at PlantUML if you need to make UML
195 diagrams. Note, PlantUML can draw a lot more than class relations.
196 Check out the documention for a complete list. :)
</p
>
198 <p
>As usual, if you use Bitcoin and want to show your support of my
199 activities, please send Bitcoin donations to my address
200 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
205 <title>Measuring the speaker frequency response using the AUDMES free software GUI - nice free software
</title>
206 <link>https://people.skolelinux.org/pere/blog/Measuring_the_speaker_frequency_response_using_the_AUDMES_free_software_GUI___nice_free_software.html
</link>
207 <guid isPermaLink=
"true">https://people.skolelinux.org/pere/blog/Measuring_the_speaker_frequency_response_using_the_AUDMES_free_software_GUI___nice_free_software.html
</guid>
208 <pubDate>Mon,
22 Oct
2018 08:
40:
00 +
0200</pubDate>
209 <description><p
><img src=
"http://people.skolelinux.org/pere/blog/images/
2018-
10-
22-audmes-measure-speakers.png
" align=
"right
" width=
"40%
"/
></p
>
211 <p
>My current home stereo is a patchwork of various pieces I got on
212 flee markeds over the years. It is amazing what kind of equipment
213 show up there. I
've been wondering for a while if it was possible to
214 measure how well this equipment is working together, and decided to
215 see how far I could get using free software. After trawling the web I
216 came across an article from DIY Audio and Video on
217 <a href=
"https://www.diyaudioandvideo.com/Tutorial/SpeakerResponseTesting/
">Speaker
218 Testing and Analysis
</a
> describing how to test speakers, and it listing
219 several software options, among them
220 <a href=
"https://sourceforge.net/projects/audmes/
">AUDio MEasurement
221 System (AUDMES)
</a
>. It is the only free software system I could find
222 focusing on measuring speakers and audio frequency response. In the
223 process I also found an interesting article from NOVO on
224 <a href=
"http://novo.press/understanding-speaker-specifications-and-frequency-response/
">Understanding
225 Speaker Specifications and Frequency Response
</a
> and an article from
227 <a href=
"https://www.ecoustics.com/articles/understanding-speaker-frequency-response/
">Understanding
228 Speaker Frequency Response
</a
>, with a lot of information on what to
229 look for and how to interpret the graphs. Armed with this knowledge,
230 I set out to measure the state of my speakers.
</p
>
232 <p
>The first hurdle was that AUDMES hadn
't seen a commit for
10 years
233 and did not build with current compilers and libraries. I got in
234 touch with its author, who no longer was spending time on the program
235 but gave me write access to the subversion repository on Sourceforge.
236 The end result is that now the code build on Linux and is capable of
237 saving and loading the collected frequency response data in CSV
238 format. The application is quite nice and flexible, and I was able to
239 select the input and output audio interfaces independently. This made
240 it possible to use a USB mixer as the input source, while sending
241 output via my laptop headphone connection. I lacked the hardware and
242 cabling to figure out a different way to get independent cabling to
243 speakers and microphone.
</p
>
245 <p
>Using this setup I could see how a large range of high frequencies
246 apparently were not making it out of my speakers. The picture show
247 the frequency response measurement of one of the speakers. Note the
248 frequency lines seem to be slightly misaligned, compared to the CSV
249 output from the program. I can not hear several of these are high
250 frequencies, according to measurement from
251 <a href=
"http://freehearingtestsoftware.com
">Free Hearing Test
252 Software
</a
>, an freeware system to measure your hearing (still
253 looking for a free software alternative), so I do not know if they are
254 coming out out the speakers. I thus do not quite know how to figure
255 out if the missing frequencies is a problem with the microphone, the
256 amplifier or the speakers, but I managed to rule out the audio card in my
257 PC by measuring my Bose noise canceling headset using its own
258 microphone. This setup was able to see the high frequency tones, so
259 the problem with my stereo had to be in the amplifier or speakers.
</p
>
261 <p
>Anyway, to try to role out one factor I ended up picking up a new
262 set of speakers at a flee marked, and these work a lot better than the
263 old speakers, so I guess the microphone and amplifier is OK. If you
264 need to measure your own speakers, check out AUDMES. If more people
265 get involved, perhaps the project could become good enough to
266 <a href=
"https://bugs.debian.org/
910876">include in Debian
</a
>? And if
267 you know of some other free software to measure speakers and amplifier
268 performance, please let me know. I am aware of the freeware option
269 <a href=
"https://www.roomeqwizard.com/
">REW
</a
>, but I want something
270 that can be developed also when the vendor looses interest.
</p
>
272 <p
>As usual, if you use Bitcoin and want to show your support of my
273 activities, please send Bitcoin donations to my address
274 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
279 <title>youtube-dl for nedlasting fra NRK med undertekster - nice free software
</title>
280 <link>https://people.skolelinux.org/pere/blog/youtube_dl_for_nedlasting_fra_NRK_med_undertekster___nice_free_software.html
</link>
281 <guid isPermaLink=
"true">https://people.skolelinux.org/pere/blog/youtube_dl_for_nedlasting_fra_NRK_med_undertekster___nice_free_software.html
</guid>
282 <pubDate>Sat,
28 Apr
2018 10:
30:
00 +
0200</pubDate>
283 <description><p
>I
<a href=
"https://no.wikipedia.org/wiki/VHS
">VHS-kassettenes
</a
>
284 tid var det rett frem å ta vare på et TV-program en ønsket å kunne se
285 senere, uten å være avhengig av at programmet ble sendt på nytt.
286 Kanskje ønsket en å se programmet på hytten der det ikke var
287 TV-signal, eller av andre grunner ha det tilgjengelig for fremtidig
288 fornøyelse. Dette er blitt vanskeligere med introduksjon av
289 digital-TV og webstreaming, der opptak til harddisk er utenfor de
290 flestes kontroll hvis de bruker ufri programvare og bokser kontrollert
291 av andre. Men for NRK her i Norge, finnes det heldigvis flere fri
292 programvare-alternativer, som jeg har
293 <a href=
"http://people.skolelinux.org/pere/blog/Hvordan_enkelt_laste_ned_filmer_fra_NRK.html
">skrevet
</a
>
294 <a href=
"http://people.skolelinux.org/pere/blog/Hvordan_enkelt_laste_ned_filmer_fra_NRK_med_den__nye__l_sningen.html
">om
</a
>
295 <a href=
"http://people.skolelinux.org/pere/blog/Nedlasting_fra_NRK__som_Matroska_med_undertekster.html
">før
</a
>.
296 Så lenge kilden for nedlastingen er lovlig lagt ut på nett (hvilket
297 jeg antar NRK gjør), så er slik lagring til privat bruk også lovlig i
300 <p
>Sist jeg så på saken, i
2016, nevnte jeg at
301 <a href=
"https://rg3.github.com/youtube-dl/
">youtube-dl
</a
> ikke kunne
302 bake undertekster fra NRK inn i videofilene, og at jeg derfor
303 foretrakk andre alternativer. Nylig oppdaget jeg at dette har endret
304 seg. Fordelen med youtube-dl er at den er tilgjengelig direkte fra
305 Linux-distribusjoner som
<a href=
"https://www.debian.org/
">Debian
</a
>
306 og
<a href=
"https://www.ubuntu.com/
">Ubuntu
</a
>, slik at en slipper å
307 finne ut selv hvordan en skal få dem til å virke.
</p
>
309 <p
>For å laste ned et NRK-innslag med undertekster, og få den norske
310 underteksten pakket inn i videofilen, så kan følgende kommando
314 youtube-dl --write-sub --sub-format ttml \
315 --convert-subtitles srt --embed-subs \
316 https://tv.nrk.no/serie/ramm-ferdig-gaa/MUHU11000316/
27-
04-
2018
317 </pre
></p
>
319 <p
>URL-eksemplet er dagens toppsak på tv.nrk.no. Resultatet er en
320 MP4-fil med filmen og undertekster som kan spilles av med VLC. Merk
321 at VLC ikke viser frem undertekster før du aktiverer dem. For å gjøre
322 det, høyreklikk med musa i fremviservinduet, velg menyvalget for
323 undertekst og så norsk språk. Jeg testet også
'--write-auto-sub
',
324 men det kommandolinjeargumentet ser ikke ut til å fungere, så jeg
325 endte opp med settet med argumentlisten over, som jeg fant i en
326 feilrapport i youtube-dl-prosjektets samling over feilrapporter.
</p
>
328 <p
>Denne støtten i youtube-dl gjør det svært enkelt å lagre
329 NRK-innslag, det være seg nyheter, filmer, serier eller dokumentater,
330 for å ha dem tilgjengelig for fremtidig referanse og bruk, uavhengig
331 av hvor lenge innslagene ligger tilgjengelig hos NRK. Så får det ikke
332 hjelpe at NRKs jurister mener at det er
333 <a href=
"http://people.skolelinux.org/pere/blog/Best___ikke_fortelle_noen_at_streaming_er_nedlasting___.html
">vesensforskjellig
334 å legge tilgjengelig for nedlasting og for streaming
</a
>, når det rent
335 teknisk er samme sak.
</p
>
337 <p
>Programmet youtube-dl støtter også en rekke andre nettsteder, se
338 prosjektoversikten for
339 <a href=
"http://rg3.github.io/youtube-dl/supportedsites.html
">en
340 komplett liste
</a
>.
</p
>
345 <title>Oolite, a life in space as vagabond and mercenary - nice free software
</title>
346 <link>https://people.skolelinux.org/pere/blog/Oolite__a_life_in_space_as_vagabond_and_mercenary___nice_free_software.html
</link>
347 <guid isPermaLink=
"true">https://people.skolelinux.org/pere/blog/Oolite__a_life_in_space_as_vagabond_and_mercenary___nice_free_software.html
</guid>
348 <pubDate>Sun,
11 Dec
2016 11:
40:
00 +
0100</pubDate>
349 <description><p align=
"center
"><img width=
"70%
" src=
"http://people.skolelinux.org/pere/blog/images/
2016-
12-
11-nice-oolite.png
"/
></p
>
351 <p
>In my early years, I played
352 <a href=
"http://wiki.alioth.net/index.php/Classic_Elite
">the epic game
353 Elite
</a
> on my PC. I spent many months trading and fighting in
354 space, and reached the
'elite
' fighting status before I moved on. The
355 original Elite game was available on Commodore
64 and the IBM PC
356 edition I played had a
64 KB executable. I am still impressed today
357 that the authors managed to squeeze both a
3D engine and details about
358 more than
2000 planet systems across
7 galaxies into a binary so
361 <p
>I have known about
<a href=
"http://www.oolite.org/
">the free
362 software game Oolite inspired by Elite
</a
> for a while, but did not
363 really have time to test it properly until a few days ago. It was
364 great to discover that my old knowledge about trading routes were
365 still valid. But my fighting and flying abilities were gone, so I had
366 to retrain to be able to dock on a space station. And I am still not
367 able to make much resistance when I am attacked by pirates, so I
368 bougth and mounted the most powerful laser in the rear to be able to
369 put up at least some resistance while fleeing for my life. :)
</p
>
371 <p
>When playing Elite in the late eighties, I had to discover
372 everything on my own, and I had long lists of prices seen on different
373 planets to be able to decide where to trade what. This time I had the
375 <a href=
"http://wiki.alioth.net/index.php/Main_Page
">Elite wiki
</a
>,
376 where information about each planet is easily available with common
377 price ranges and suggested trading routes. This improved my ability
378 to earn money and I have been able to earn enough to buy a lot of
379 useful equipent in a few days. I believe I originally played for
380 months before I could get a docking computer, while now I could get it
381 after less then a week.
</p
>
383 <p
>If you like science fiction and dreamed of a life as a vagabond in
384 space, you should try out Oolite. It is available for Linux, MacOSX
385 and Windows, and is included in Debian and derivatives since
2011.
</p
>
387 <p
>As usual, if you use Bitcoin and want to show your support of my
388 activities, please send Bitcoin donations to my address
389 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
394 <title>Coz can help you find bottlenecks in multi-threaded software - nice free software
</title>
395 <link>https://people.skolelinux.org/pere/blog/Coz_can_help_you_find_bottlenecks_in_multi_threaded_software___nice_free_software.html
</link>
396 <guid isPermaLink=
"true">https://people.skolelinux.org/pere/blog/Coz_can_help_you_find_bottlenecks_in_multi_threaded_software___nice_free_software.html
</guid>
397 <pubDate>Thu,
11 Aug
2016 12:
00:
00 +
0200</pubDate>
398 <description><p
>This summer, I read a great article
399 "<a href=
"https://www.usenix.org/publications/login/summer2016/curtsinger
">coz:
400 This Is the Profiler You
're Looking For
</a
>" in USENIX ;login: about
401 how to profile multi-threaded programs. It presented a system for
402 profiling software by running experiences in the running program,
403 testing how run time performance is affected by
"speeding up
" parts of
404 the code to various degrees compared to a normal run. It does this by
405 slowing down parallel threads while the
"faster up
" code is running
406 and measure how this affect processing time. The processing time is
407 measured using probes inserted into the code, either using progress
408 counters (COZ_PROGRESS) or as latency meters (COZ_BEGIN/COZ_END). It
409 can also measure unmodified code by measuring complete the program
410 runtime and running the program several times instead.
</p
>
412 <p
>The project and presentation was so inspiring that I would like to
413 get the system into Debian. I
414 <a href=
"https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=
830708">created
415 a WNPP request for it
</a
> and contacted upstream to try to make the
416 system ready for Debian by sending patches. The build process need to
417 be changed a bit to avoid running
'git clone
' to get dependencies, and
418 to include the JavaScript web page used to visualize the collected
419 profiling information included in the source package.
420 But I expect that should work out fairly soon.
</p
>
422 <p
>The way the system work is fairly simple. To run an coz experiment
423 on a binary with debug symbols available, start the program like this:
425 <p
><blockquote
><pre
>
426 coz run --- program-to-run
427 </pre
></blockquote
></p
>
429 <p
>This will create a text file profile.coz with the instrumentation
430 information. To show what part of the code affect the performance
431 most, use a web browser and either point it to
432 <a href=
"http://plasma-umass.github.io/coz/
">http://plasma-umass.github.io/coz/
</a
>
433 or use the copy from git (in the gh-pages branch). Check out this web
434 site to have a look at several example profiling runs and get an idea what the end result from the profile runs look like. To make the
435 profiling more useful you include
&lt;coz.h
&gt; and insert the
436 COZ_PROGRESS or COZ_BEGIN and COZ_END at appropriate places in the
437 code, rebuild and run the profiler. This allow coz to do more
438 targeted experiments.
</p
>
440 <p
>A video published by ACM
441 <a href=
"https://www.youtube.com/watch?v=jE0V-p1odPg
">presenting the
442 Coz profiler
</a
> is available from Youtube. There is also a paper
443 from the
25th Symposium on Operating Systems Principles available
445 <a href=
"https://www.usenix.org/conference/atc16/technical-sessions/presentation/curtsinger
">Coz:
446 finding code that counts with causal profiling
</a
>.
</p
>
448 <p
><a href=
"https://github.com/plasma-umass/coz
">The source code
</a
>
449 for Coz is available from github. It will only build with clang
451 <a href=
"https://gcc.gnu.org/bugzilla/show_bug.cgi?id=
55606">C++
452 feature missing in GCC
</a
>, but I
've submitted
453 <a href=
"https://github.com/plasma-umass/coz/pull/
67">a patch to solve
454 it
</a
> and hope it will be included in the upstream source soon.
</p
>
456 <p
>Please get in touch if you, like me, would like to see this piece
457 of software in Debian. I would very much like some help with the
458 packaging effort, as I lack the in depth knowledge on how to package
459 C++ libraries.
</p
>
464 <title>Creepy, visualise geotagged social media information - nice free software
</title>
465 <link>https://people.skolelinux.org/pere/blog/Creepy__visualise_geotagged_social_media_information___nice_free_software.html
</link>
466 <guid isPermaLink=
"true">https://people.skolelinux.org/pere/blog/Creepy__visualise_geotagged_social_media_information___nice_free_software.html
</guid>
467 <pubDate>Sun,
24 Jan
2016 10:
50:
00 +
0100</pubDate>
468 <description><p
>Most people seem not to realise that every time they walk around
469 with the computerised radio beacon known as a mobile phone their
470 position is tracked by the phone company and often stored for a long
471 time (like every time a SMS is received or sent). And if their
472 computerised radio beacon is capable of running programs (often called
473 mobile apps) downloaded from the Internet, these programs are often
474 also capable of tracking their location (if the app requested access
475 during installation). And when these programs send out information to
476 central collection points, the location is often included, unless
477 extra care is taken to not send the location. The provided
478 information is used by several entities, for good and bad (what is
479 good and bad, depend on your point of view). What is certain, is that
480 the private sphere and the right to free movement is challenged and
481 perhaps even eradicated for those announcing their location this way,
482 when they share their whereabouts with private and public
485 <p align=
"center
"><img width=
"70%
" src=
"http://people.skolelinux.org/pere/blog/images/
2016-
01-
24-nice-creepy-desktop-window.png
"></p
>
487 <p
>The phone company logs provide a register of locations to check out
488 when one want to figure out what the tracked person was doing. It is
489 unavailable for most of us, but provided to selected government
490 officials, company staff, those illegally buying information from
491 unfaithful servants and crackers stealing the information. But the
492 public information can be collected and analysed, and a free software
493 tool to do so is called
494 <a href=
"http://www.geocreepy.com/
">Creepy or Cree.py
</a
>. I
495 discovered it when I read
496 <a href=
"http://www.aftenposten.no/kultur/Slik-kan-du-bli-overvaket-pa-Twitter-og-Instagram-uten-a-ane-det-
7787884.html
">an
497 article about Creepy
</a
> in the Norwegian newspaper Aftenposten i
498 November
2014, and decided to check if it was available in Debian.
499 The python program was in Debian, but
500 <a href=
"https://tracker.debian.org/pkg/creepy
">the version in
501 Debian
</a
> was completely broken and practically unmaintained. I
502 uploaded a new version which did not work quite right, but did not
503 have time to fix it then. This Christmas I decided to finally try to
504 get Creepy operational in Debian. Now a fixed version is available in
505 Debian unstable and testing, and almost all Debian specific patches
507 <a href=
"https://github.com/jkakavas/creepy
">upstream
</a
>.
</p
>
509 <p
>The Creepy program visualises geolocation information fetched from
510 Twitter, Instagram, Flickr and Google+, and allow one to get a
511 complete picture of every social media message posted recently in a
512 given area, or track the movement of a given individual across all
513 these services. Earlier it was possible to use the search API of at
514 least some of these services without identifying oneself, but these
515 days it is impossible. This mean that to use Creepy, you need to
516 configure it to log in as yourself on these services, and provide
517 information to them about your search interests. This should be taken
518 into account when using Creepy, as it will also share information
519 about yourself with the services.
</p
>
521 <p
>The picture above show the twitter messages sent from (or at least
522 geotagged with a position from) the city centre of Oslo, the capital
523 of Norway. One useful way to use Creepy is to first look at
524 information tagged with an area of interest, and next look at all the
525 information provided by one or more individuals who was in the area.
526 I tested it by checking out which celebrity provide their location in
527 twitter messages by checkout out who sent twitter messages near a
528 Norwegian TV station, and next could track their position over time,
529 making it possible to locate their home and work place, among other
530 things. A similar technique have been
531 <a href=
"http://www.buzzfeed.com/maxseddon/does-this-soldiers-instagram-account-prove-russia-is-covertl
">used
532 to locate Russian soldiers in Ukraine
</a
>, and it is both a powerful
533 tool to discover lying governments, and a useful tool to help people
534 understand the value of the private information they provide to the
537 <p
>The package is not trivial to backport to Debian Stable/Jessie, as
538 it depend on several python modules currently missing in Jessie (at
539 least python-instagram, python-flickrapi and
540 python-requests-toolbelt).
</p
>
542 <p
>(I have uploaded
543 <a href=
"https://screenshots.debian.net/package/creepy
">the image to
544 screenshots.debian.net
</a
> and licensed it under the same terms as the
545 Creepy program in Debian.)
</p
>
550 <title>OpenALPR, find car license plates in video streams - nice free software
</title>
551 <link>https://people.skolelinux.org/pere/blog/OpenALPR__find_car_license_plates_in_video_streams___nice_free_software.html
</link>
552 <guid isPermaLink=
"true">https://people.skolelinux.org/pere/blog/OpenALPR__find_car_license_plates_in_video_streams___nice_free_software.html
</guid>
553 <pubDate>Wed,
23 Dec
2015 01:
00:
00 +
0100</pubDate>
554 <description><p
>When I was a kid, we used to collect
"car numbers
", as we used to
555 call the car license plate numbers in those days. I would write the
556 numbers down in my little book and compare notes with the other kids
557 to see how many region codes we had seen and if we had seen some
558 exotic or special region codes and numbers. It was a fun game to pass
559 time, as we kids have plenty of it.
</p
>
561 <p
>A few days I came across
562 <a href=
"https://github.com/openalpr/openalpr
">the OpenALPR
563 project
</a
>, a free software project to automatically discover and
564 report license plates in images and video streams, and provide the
565 "car numbers
" in a machine readable format. I
've been looking for
566 such system for a while now, because I believe it is a bad idea that the
567 <a href=
"https://en.wikipedia.org/wiki/Automatic_number_plate_recognition
">automatic
568 number plate recognition
</a
> tool only is available in the hands of
569 the powerful, and want it to be available also for the powerless to
570 even the score when it comes to surveillance and sousveillance. I
571 discovered the developer
572 <a href=
"https://bugs.debian.org/
747509">wanted to get the tool into
573 Debian
</a
>, and as I too wanted it to be in Debian, I volunteered to
574 help him get it into shape to get the package uploaded into the Debian
577 <p
>Today we finally managed to get the package into shape and uploaded
578 it into Debian, where it currently
579 <a href=
"https://ftp-master.debian.org//new/openalpr_2.2
.1-
1.html
">waits
580 in the NEW queue
</a
> for review by the Debian ftpmasters.
</p
>
582 <p
>I guess you are wondering why on earth such tool would be useful
583 for the common folks, ie those not running a large government
584 surveillance system? Well, I plan to put it in a computer on my bike
585 and in my car, tracking the cars nearby and allowing me to be notified
586 when number plates on my watch list are discovered. Another use case
587 was suggested by a friend of mine, who wanted to set it up at his home
588 to open the car port automatically when it discovered the plate on his
589 car. When I mentioned it perhaps was a bit foolhardy to allow anyone
590 capable of placing his license plate number of a piece of cardboard to
591 open his car port, men replied that it was always unlocked anyway. I
592 guess for such use case it make sense. I am sure there are other use
593 cases too, for those with imagination and a vision.
</p
>
595 <p
>If you want to build your own version of the Debian package, check
596 out the upstream git source and symlink ./distros/debian to ./debian/
597 before running
"debuild
" to build the source. Or wait a bit until the
598 package show up in unstable.
</p
>
603 <title>listadmin, the quick way to moderate mailman lists - nice free software
</title>
604 <link>https://people.skolelinux.org/pere/blog/listadmin__the_quick_way_to_moderate_mailman_lists___nice_free_software.html
</link>
605 <guid isPermaLink=
"true">https://people.skolelinux.org/pere/blog/listadmin__the_quick_way_to_moderate_mailman_lists___nice_free_software.html
</guid>
606 <pubDate>Wed,
22 Oct
2014 20:
00:
00 +
0200</pubDate>
607 <description><p
>If you ever had to moderate a mailman list, like the ones on
608 alioth.debian.org, you know the web interface is fairly slow to
609 operate. First you visit one web page, enter the moderation password
610 and get a new page shown with a list of all the messages to moderate
611 and various options for each email address. This take a while for
612 every list you moderate, and you need to do it regularly to do a good
613 job as a list moderator. But there is a quick alternative,
614 <a href=
"http://heim.ifi.uio.no/kjetilho/hacks/#listadmin
">the
615 listadmin program
</a
>. It allow you to check lists for new messages
616 to moderate in a fraction of a second. Here is a test run on two
617 lists I recently took over:
</p
>
619 <p
><blockquote
><pre
>
620 % time listadmin xiph
621 fetching data for pkg-xiph-commits@lists.alioth.debian.org ... nothing in queue
622 fetching data for pkg-xiph-maint@lists.alioth.debian.org ... nothing in queue
628 </pre
></blockquote
></p
>
630 <p
>In
1.7 seconds I had checked two mailing lists and confirmed that
631 there are no message in the moderation queue. Every morning I
632 currently moderate
68 mailman lists, and it normally take around two
633 minutes. When I took over the two pkg-xiph lists above a few days
634 ago, there were
400 emails waiting in the moderator queue. It took me
635 less than
15 minutes to process them all using the listadmin
638 <p
>If you install
639 <a href=
"https://tracker.debian.org/pkg/listadmin
">the listadmin
640 package
</a
> from Debian and create a file
<tt
>~/.listadmin.ini
</tt
>
641 with content like this, the moderation task is a breeze:
</p
>
643 <p
><blockquote
><pre
>
644 username username@example.org
647 discard_if_reason
"Posting restricted to members only. Remove us from your mail list.
"
650 adminurl https://{domain}/mailman/admindb/{list}
651 mailman-list@lists.example.com
654 other-list@otherserver.example.org
655 </pre
></blockquote
></p
>
657 <p
>There are other options to set as well. Check the manual page to
658 learn the details.
</p
>
660 <p
>If you are forced to moderate lists on a mailman installation where
661 the SSL certificate is self signed or not properly signed by a
662 generally accepted signing authority, you can set a environment
663 variable when calling listadmin to disable SSL verification:
</p
>
665 <p
><blockquote
><pre
>
666 PERL_LWP_SSL_VERIFY_HOSTNAME=
0 listadmin
667 </pre
></blockquote
></p
>
669 <p
>If you want to moderate a subset of the lists you take care of, you
670 can provide an argument to the listadmin script like I do in the
671 initial screen dump (the xiph argument). Using an argument, only
672 lists matching the argument string will be processed. This make it
673 quick to accept messages if you notice the moderation request in your
676 <p
>Without the listadmin program, I would never be the moderator of
68
677 mailing lists, as I simply do not have time to spend on that if the
678 process was any slower. The listadmin program have saved me hours of
679 time I could spend elsewhere over the years. It truly is nice free
682 <p
>As usual, if you use Bitcoin and want to show your support of my
683 activities, please send Bitcoin donations to my address
684 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
686 <p
>Update
2014-
10-
27: Added missing
'username
' statement in
687 configuration example. Also, I
've been told that the
688 PERL_LWP_SSL_VERIFY_HOSTNAME=
0 setting do not work for everyone. Not
694 <title>S3QL, a locally mounted cloud file system - nice free software
</title>
695 <link>https://people.skolelinux.org/pere/blog/S3QL__a_locally_mounted_cloud_file_system___nice_free_software.html
</link>
696 <guid isPermaLink=
"true">https://people.skolelinux.org/pere/blog/S3QL__a_locally_mounted_cloud_file_system___nice_free_software.html
</guid>
697 <pubDate>Wed,
9 Apr
2014 11:
30:
00 +
0200</pubDate>
698 <description><p
>For a while now, I have been looking for a sensible offsite backup
699 solution for use at home. My requirements are simple, it must be
700 cheap and locally encrypted (in other words, I keep the encryption
701 keys, the storage provider do not have access to my private files).
702 One idea me and my friends had many years ago, before the cloud
703 storage providers showed up, was to use Google mail as storage,
704 writing a Linux block device storing blocks as emails in the mail
705 service provided by Google, and thus get heaps of free space. On top
706 of this one can add encryption, RAID and volume management to have
707 lots of (fairly slow, I admit that) cheap and encrypted storage. But
708 I never found time to implement such system. But the last few weeks I
709 have looked at a system called
710 <a href=
"https://bitbucket.org/nikratio/s3ql/
">S3QL
</a
>, a locally
711 mounted network backed file system with the features I need.
</p
>
713 <p
>S3QL is a fuse file system with a local cache and cloud storage,
714 handling several different storage providers, any with Amazon S3,
715 Google Drive or OpenStack API. There are heaps of such storage
716 providers. S3QL can also use a local directory as storage, which
717 combined with sshfs allow for file storage on any ssh server. S3QL
718 include support for encryption, compression, de-duplication, snapshots
719 and immutable file systems, allowing me to mount the remote storage as
720 a local mount point, look at and use the files as if they were local,
721 while the content is stored in the cloud as well. This allow me to
722 have a backup that should survive fire. The file system can not be
723 shared between several machines at the same time, as only one can
724 mount it at the time, but any machine with the encryption key and
725 access to the storage service can mount it if it is unmounted.
</p
>
727 <p
>It is simple to use. I
'm using it on Debian Wheezy, where the
728 package is included already. So to get started, run
<tt
>apt-get
729 install s3ql
</tt
>. Next, pick a storage provider. I ended up picking
730 Greenqloud, after reading their nice recipe on
731 <a href=
"https://greenqloud.zendesk.com/entries/
44611757-How-To-Use-S3QL-to-mount-a-StorageQloud-bucket-on-Debian-Wheezy
">how
732 to use S3QL with their Amazon S3 service
</a
>, because I trust the laws
733 in Iceland more than those in USA when it come to keeping my personal
734 data safe and private, and thus would rather spend money on a company
735 in Iceland. Another nice recipe is available from the article
736 <a href=
"http://www.admin-magazine.com/HPC/Articles/HPC-Cloud-Storage
">S3QL
737 Filesystem for HPC Storage
</a
> by Jeff Layton in the HPC section of
738 Admin magazine. When the provider is picked, figure out how to get
739 the API key needed to connect to the storage API. With Greencloud,
740 the key did not show up until I had added payment details to my
743 <p
>Armed with the API access details, it is time to create the file
744 system. First, create a new bucket in the cloud. This bucket is the
745 file system storage area. I picked a bucket name reflecting the
746 machine that was going to store data there, but any name will do.
747 I
'll refer to it as
<tt
>bucket-name
</tt
> below. In addition, one need
748 the API login and password, and a locally created password. Store it
749 all in ~root/.s3ql/authinfo2 like this:
751 <p
><blockquote
><pre
>
753 storage-url: s3c://s.greenqloud.com:
443/bucket-name
754 backend-login: API-login
755 backend-password: API-password
756 fs-passphrase: local-password
757 </pre
></blockquote
></p
>
759 <p
>I create my local passphrase using
<tt
>pwget
50</tt
> or similar,
760 but any sensible way to create a fairly random password should do it.
761 Armed with these details, it is now time to run mkfs, entering the API
762 details and password to create it:
</p
>
764 <p
><blockquote
><pre
>
765 # mkdir -m
700 /var/lib/s3ql-cache
766 # mkfs.s3ql --cachedir /var/lib/s3ql-cache --authfile /root/.s3ql/authinfo2 \
767 --ssl s3c://s.greenqloud.com:
443/bucket-name
769 Enter backend password:
770 Before using S3QL, make sure to read the user
's guide, especially
771 the
'Important Rules to Avoid Loosing Data
' section.
772 Enter encryption password:
773 Confirm encryption password:
774 Generating random encryption key...
775 Creating metadata tables...
785 Compressing and uploading metadata...
786 Wrote
0.00 MB of compressed metadata.
787 #
</pre
></blockquote
></p
>
789 <p
>The next step is mounting the file system to make the storage available.
791 <p
><blockquote
><pre
>
792 # mount.s3ql --cachedir /var/lib/s3ql-cache --authfile /root/.s3ql/authinfo2 \
793 --ssl --allow-root s3c://s.greenqloud.com:
443/bucket-name /s3ql
794 Using
4 upload threads.
795 Downloading and decompressing metadata...
805 Mounting filesystem...
807 Filesystem Size Used Avail Use% Mounted on
808 s3c://s.greenqloud.com:
443/bucket-name
1.0T
0 1.0T
0% /s3ql
810 </pre
></blockquote
></p
>
812 <p
>The file system is now ready for use. I use rsync to store my
813 backups in it, and as the metadata used by rsync is downloaded at
814 mount time, no network traffic (and storage cost) is triggered by
815 running rsync. To unmount, one should not use the normal umount
816 command, as this will not flush the cache to the cloud storage, but
817 instead running the umount.s3ql command like this:
819 <p
><blockquote
><pre
>
822 </pre
></blockquote
></p
>
824 <p
>There is a fsck command available to check the file system and
825 correct any problems detected. This can be used if the local server
826 crashes while the file system is mounted, to reset the
"already
827 mounted
" flag. This is what it look like when processing a working
828 file system:
</p
>
830 <p
><blockquote
><pre
>
831 # fsck.s3ql --force --ssl s3c://s.greenqloud.com:
443/bucket-name
832 Using cached metadata.
833 File system seems clean, checking anyway.
834 Checking DB integrity...
835 Creating temporary extra indices...
836 Checking lost+found...
837 Checking cached objects...
838 Checking names (refcounts)...
839 Checking contents (names)...
840 Checking contents (inodes)...
841 Checking contents (parent inodes)...
842 Checking objects (reference counts)...
843 Checking objects (backend)...
844 ..processed
5000 objects so far..
845 ..processed
10000 objects so far..
846 ..processed
15000 objects so far..
847 Checking objects (sizes)...
848 Checking blocks (referenced objects)...
849 Checking blocks (refcounts)...
850 Checking inode-block mapping (blocks)...
851 Checking inode-block mapping (inodes)...
852 Checking inodes (refcounts)...
853 Checking inodes (sizes)...
854 Checking extended attributes (names)...
855 Checking extended attributes (inodes)...
856 Checking symlinks (inodes)...
857 Checking directory reachability...
858 Checking unix conventions...
859 Checking referential integrity...
860 Dropping temporary indices...
861 Backing up old metadata...
871 Compressing and uploading metadata...
872 Wrote
0.89 MB of compressed metadata.
874 </pre
></blockquote
></p
>
876 <p
>Thanks to the cache, working on files that fit in the cache is very
877 quick, about the same speed as local file access. Uploading large
878 amount of data is to me limited by the bandwidth out of and into my
879 house. Uploading
685 MiB with a
100 MiB cache gave me
305 kiB/s,
880 which is very close to my upload speed, and downloading the same
881 Debian installation ISO gave me
610 kiB/s, close to my download speed.
882 Both were measured using
<tt
>dd
</tt
>. So for me, the bottleneck is my
883 network, not the file system code. I do not know what a good cache
884 size would be, but suspect that the cache should e larger than your
885 working set.
</p
>
887 <p
>I mentioned that only one machine can mount the file system at the
888 time. If another machine try, it is told that the file system is
891 <p
><blockquote
><pre
>
892 # mount.s3ql --cachedir /var/lib/s3ql-cache --authfile /root/.s3ql/authinfo2 \
893 --ssl --allow-root s3c://s.greenqloud.com:
443/bucket-name /s3ql
894 Using
8 upload threads.
895 Backend reports that fs is still mounted elsewhere, aborting.
897 </pre
></blockquote
></p
>
899 <p
>The file content is uploaded when the cache is full, while the
900 metadata is uploaded once every
24 hour by default. To ensure the
901 file system content is flushed to the cloud, one can either umount the
902 file system, or ask S3QL to flush the cache and metadata using
905 <p
><blockquote
><pre
>
906 # s3qlctrl upload-meta /s3ql
907 # s3qlctrl flushcache /s3ql
909 </pre
></blockquote
></p
>
911 <p
>If you are curious about how much space your data uses in the
912 cloud, and how much compression and deduplication cut down on the
913 storage usage, you can use s3qlstat on the mounted file system to get
916 <p
><blockquote
><pre
>
918 Directory entries:
9141
921 Total data size:
22049.38 MB
922 After de-duplication:
21955.46 MB (
99.57% of total)
923 After compression:
21877.28 MB (
99.22% of total,
99.64% of de-duplicated)
924 Database size:
2.39 MB (uncompressed)
925 (some values do not take into account not-yet-uploaded dirty blocks in cache)
927 </pre
></blockquote
></p
>
929 <p
>I mentioned earlier that there are several possible suppliers of
930 storage. I did not try to locate them all, but am aware of at least
931 <a href=
"https://www.greenqloud.com/
">Greenqloud
</a
>,
932 <a href=
"http://drive.google.com/
">Google Drive
</a
>,
933 <a href=
"http://aws.amazon.com/s3/
">Amazon S3 web serivces
</a
>,
934 <a href=
"http://www.rackspace.com/
">Rackspace
</a
> and
935 <a href=
"http://crowncloud.net/
">Crowncloud
</A
>. The latter even
936 accept payment in Bitcoin. Pick one that suit your need. Some of
937 them provide several GiB of free storage, but the prize models are
938 quite different and you will have to figure out what suits you
941 <p
>While researching this blog post, I had a look at research papers
942 and posters discussing the S3QL file system. There are several, which
943 told me that the file system is getting a critical check by the
944 science community and increased my confidence in using it. One nice
946 "<a href=
"http://www.lanl.gov/orgs/adtsc/publications/science_highlights_2013/docs/pg68_69.pdf
">An
947 Innovative Parallel Cloud Storage System using OpenStack’s SwiftObject
948 Store and Transformative Parallel I/O Approach
</a
>" by Hsing-Bung
949 Chen, Benjamin McClelland, David Sherrill, Alfred Torrez, Parks Fields
950 and Pamela Smith. Please have a look.
</p
>
952 <p
>Given my problems with different file systems earlier, I decided to
953 check out the mounted S3QL file system to see if it would be usable as
954 a home directory (in other word, that it provided POSIX semantics when
955 it come to locking and umask handling etc). Running
956 <a href=
"http://people.skolelinux.org/pere/blog/Testing_if_a_file_system_can_be_used_for_home_directories___.html
">my
957 test code to check file system semantics
</a
>, I was happy to discover that
958 no error was found. So the file system can be used for home
959 directories, if one chooses to do so.
</p
>
961 <p
>If you do not want a locally file system, and want something that
962 work without the Linux fuse file system, I would like to mention the
963 <a href=
"http://www.tarsnap.com/
">Tarsnap service
</a
>, which also
964 provide locally encrypted backup using a command line client. It have
965 a nicer access control system, where one can split out read and write
966 access, allowing some systems to write to the backup and others to
967 only read from it.
</p
>
969 <p
>As usual, if you use Bitcoin and want to show your support of my
970 activities, please send Bitcoin donations to my address
971 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
976 <title>ReactOS Windows clone - nice free software
</title>
977 <link>https://people.skolelinux.org/pere/blog/ReactOS_Windows_clone___nice_free_software.html
</link>
978 <guid isPermaLink=
"true">https://people.skolelinux.org/pere/blog/ReactOS_Windows_clone___nice_free_software.html
</guid>
979 <pubDate>Tue,
1 Apr
2014 12:
10:
00 +
0200</pubDate>
980 <description><p
>Microsoft have announced that Windows XP reaches its end of life
981 2014-
04-
08, in
7 days. But there are heaps of machines still running
982 Windows XP, and depending on Windows XP to run their applications, and
983 upgrading will be expensive, both when it comes to money and when it
984 comes to the amount of effort needed to migrate from Windows XP to a
985 new operating system. Some obvious options (buy new a Windows
986 machine, buy a MacOSX machine, install Linux on the existing machine)
987 are already well known and covered elsewhere. Most of them involve
988 leaving the user applications installed on Windows XP behind and
989 trying out replacements or updated versions. In this blog post I want
990 to mention one strange bird that allow people to keep the hardware and
991 the existing Windows XP applications and run them on a free software
992 operating system that is Windows XP compatible.
</p
>
994 <p
><a href=
"http://www.reactos.org/
">ReactOS
</a
> is a free software
995 operating system (GNU GPL licensed) working on providing a operating
996 system that is binary compatible with Windows, able to run windows
997 programs directly and to use Windows drivers for hardware directly.
998 The project goal is for Windows user to keep their existing machines,
999 drivers and software, and gain the advantages from user a operating
1000 system without usage limitations caused by non-free licensing. It is
1001 a Windows clone running directly on the hardware, so quite different
1002 from the approach taken by
<a href=
"http://www.winehq.org/
">the Wine
1003 project
</a
>, which make it possible to run Windows binaries on
1006 <p
>The ReactOS project share code with the Wine project, so most
1007 shared libraries available on Windows are already implemented already.
1008 There is also a software manager like the one we are used to on Linux,
1009 allowing the user to install free software applications with a simple
1010 click directly from the Internet. Check out the
1011 <a href=
"http://www.reactos.org/screenshots
">screen shots on the
1012 project web site
</a
> for an idea what it look like (it looks just like
1013 Windows before metro).
</p
>
1015 <p
>I do not use ReactOS myself, preferring Linux and Unix like
1016 operating systems. I
've tested it, and it work fine in a virt-manager
1017 virtual machine. The browser, minesweeper, notepad etc is working
1018 fine as far as I can tell. Unfortunately, my main test application
1019 is the software included on a CD with the Lego Mindstorms NXT, which
1020 seem to install just fine from CD but fail to leave any binaries on
1021 the disk after the installation. So no luck with that test software.
1022 No idea why, but hope someone else figure out and fix the problem.
1023 I
've tried the ReactOS Live ISO on a physical machine, and it seemed
1024 to work just fine. If you like Windows and want to keep running your
1025 old Windows binaries, check it out by
1026 <a href=
"http://www.reactos.org/download
">downloading
</a
> the
1027 installation CD, the live CD or the preinstalled virtual machine
1033 <title>Video DVD reader library / python-dvdvideo - nice free software
</title>
1034 <link>https://people.skolelinux.org/pere/blog/Video_DVD_reader_library___python_dvdvideo___nice_free_software.html
</link>
1035 <guid isPermaLink=
"true">https://people.skolelinux.org/pere/blog/Video_DVD_reader_library___python_dvdvideo___nice_free_software.html
</guid>
1036 <pubDate>Fri,
21 Mar
2014 15:
25:
00 +
0100</pubDate>
1037 <description><p
>Keeping your DVD collection safe from scratches and curious
1038 children fingers while still having it available when you want to see a
1039 movie is not straight forward. My preferred method at the moment is
1040 to store a full copy of the ISO on a hard drive, and use VLC, Popcorn
1041 Hour or other useful players to view the resulting file. This way the
1042 subtitles and bonus material are still available and using the ISO is
1043 just like inserting the original DVD record in the DVD player.
</p
>
1045 <p
>Earlier I used dd for taking security copies, but it do not handle
1046 DVDs giving read errors (which are quite a few of them). I
've also
1048 <a href=
"http://people.skolelinux.org/pere/blog/Ripping_problematic_DVDs_using_dvdbackup_and_genisoimage.html
">dvdbackup
1049 and genisoimage
</a
>, but these days I use the marvellous python library
1051 <a href=
"http://bblank.thinkmo.de/blog/new-software-python-dvdvideo
">python-dvdvideo
</a
>
1052 written by Bastian Blank. It is
1053 <a href=
"http://packages.qa.debian.org/p/python-dvdvideo.html
">in Debian
1054 already
</a
> and the binary package name is python3-dvdvideo. Instead
1055 of trying to read every block from the DVD, it parses the file
1056 structure and figure out which block on the DVD is actually in used,
1057 and only read those blocks from the DVD. This work surprisingly well,
1058 and I have been able to almost backup my entire DVD collection using
1059 this method.
</p
>
1061 <p
>So far, python-dvdvideo have failed on between
10 and
1062 20 DVDs, which is a small fraction of my collection. The most common
1064 <a href=
"https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=
720831">DVDs
1065 using UTF-
16 instead of UTF-
8 characters
</a
>, which according to
1066 Bastian is against the DVD specification (and seem to cause some
1067 players to fail too). A rarer problem is what seem to be inconsistent
1068 DVD structures, as the python library
1069 <a href=
"https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=
723079">claim
1070 there is a overlap between objects
</a
>. An equally rare problem claim
1071 <a href=
"https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=
741878">some
1072 value is out of range
</a
>. No idea what is going on there. I wish I
1073 knew enough about the DVD format to fix these, to ensure my movie
1074 collection will stay with me in the future.
</p
>
1076 <p
>So, if you need to keep your DVDs safe, back them up using
1077 python-dvdvideo. :)
</p
>
1082 <title>Free Timetabling Software - nice free software
</title>
1083 <link>https://people.skolelinux.org/pere/blog/Free_Timetabling_Software___nice_free_software.html
</link>
1084 <guid isPermaLink=
"true">https://people.skolelinux.org/pere/blog/Free_Timetabling_Software___nice_free_software.html
</guid>
1085 <pubDate>Sat,
7 Jul
2012 09:
50:
00 +
0200</pubDate>
1086 <description><p
>Included in
<a href=
"http://www.skolelinux.org/
">Debian Edu /
1087 Skolelinux
</a
> is a large collection of end user and school specific
1088 software. It is one of the packages not installed by default but
1089 provided in the Debian archive for schools to install if they want to,
1090 is a system to automatically plan the school time table using
1091 information about available teachers, classes and rooms, combined with
1092 the list of required courses and how many hours each topic should
1093 receive. The software is
1095 <a href=
"http://lalescu.ro/liviu/fet/
">named FET
</a
>, and it provide a
1096 graphical user interface to input the required information, save the
1097 result in a fairly simple XML format, and generate time tables for
1098 both teachers and students. It is available both for
1099 <a href=
"http://lalescu.ro/liviu/fet/download.html
">Linux, MacOSX and
1100 Windows
</a
>.
</p
>
1102 <p
>This is
<a href=
"http://lalescu.ro/liviu/fet/features.html
">the
1103 feature list
</a
>, liftet from the project web site:
</p
>
1107 <li
>FET is free software, licensed under the GNU GPL v2 or later.
1108 You can freely use, copy, modify and redistribute it
</li
>
1110 <li
>Localized to en_US (US English, default), ar (Arabic), ca
1111 (Catalan), da (Danish), de (German), el (Greek), es (Spanish), fa
1112 (Persian), fr (French), gl (Galician), he (Hebrew), hu
1113 (Hungarian), id (Indonesian), it (Italian), lt (Lithuanian), mk
1114 (Macedonian), ms (Malay), nl (Dutch), pl (Polish), pt_BR
1115 (Brazilian Portuguese), ro (Romanian), ru (Russian), si (Sinhala),
1116 sk (Slovak), sr (Serbian), tr (Turkish), uk (Ukrainian), uz
1117 (Uzbek) and vi (Vietnamese) (incompletely for some languages)
1120 <li
>Fully automatic generation algorithm, allowing also
1121 semi-automatic or manual allocation
</li
>
1123 <li
>Platform independent implementation, allowing running on
1124 GNU/Linux, Windows, Mac and any system that Qt supports
</li
>
1126 <li
>Flexible modular XML format for the input file, allowing editing
1127 with an XML editor or by hand (besides FET interface)
</li
>
1129 <li
>Import/export from CSV format
</li
>
1131 <li
>The resulted timetables are exported into HTML, XML and CSV
1134 <li
>Flexible students structure, organized into sets: years, groups
1135 and subgroups. FET allows overlapping years and groups and
1136 non-overlapping subgroups. You can even define individual students
1137 (as separate sets)
</li
>
1139 <li
>Each constraint has a weight percentage, from
0.0% to
100.0%
1140 (but some special constraints are allowed to have only
100% weight
1141 percentage)
</li
>
1143 <li
>Limits for the algorithm (all these limits can be increased on
1144 demand, as a custom version, because this would require a bit more
1147 <li
>Maximum total number of hours (periods) per day:
60</li
>
1148 <li
>Maximum number of working days per week:
35</li
>
1149 <li
>Maximum total number of teachers:
6000</li
>
1150 <li
>Maximum total number of sets of students:
30000</li
>
1151 <li
>Maximum total number of subjects:
6000</li
>
1152 <li
>Virtually unlimited number of activity tags
</li
>
1153 <li
>Maximum number of activities:
30000</li
>
1154 <li
>Maximum number of rooms:
6000</li
>
1155 <li
>Maximum number of buildings:
6000</li
>
1156 <li
>Possibility of adding multiple teachers and
1157 students sets for each activity. (it is possible
1158 also to have no teachers or no students sets for an
1159 activity)
</li
>
1160 <li
>Virtually unlimited number of time constraints
</li
>
1161 <li
>Virtually unlimited number of space constraints
</li
>
1162 </ul
></li
>
1164 <li
>A large and flexible palette of time constraints:
1166 <li
>Break periods
</li
>
1167 <li
>For teacher(s):
1169 <li
>Not available periods
</li
>
1170 <li
>Max/min days per week
</li
>
1171 <li
>Max gaps per day/week
</li
>
1172 <li
>Max hours daily/continuously
</li
>
1173 <li
>Min hours daily
</li
>
1174 <li
>Max hours daily/continuously with an activity tag
</li
>
1176 <li
>Respect working in an hourly interval a max number of
1177 days per week
</li
>
1178 </ul
></li
>
1179 <li
>For students (sets):
1181 <li
>Not available periods
</li
>
1182 <li
>Begins early (specify max allowed beginnings at second hour)
</li
>
1183 <li
>Max gaps per day/week
</li
>
1184 <li
>Max hours daily/continuously
</li
>
1185 <li
>Min hours daily
</li
>
1186 <li
>Max hours daily/continuously with an activity tag
</li
>
1188 <li
>Respect working in an hourly interval a max number of
1189 days per week
</li
>
1190 </ul
></li
>
1191 <li
>For an activity or a set of activities/subactivities:
1193 <li
>A single preferred starting time
</li
>
1194 <li
>A set of preferred starting times
</li
>
1195 <li
>A set of preferred time slots
</li
>
1196 <li
>Min/max days between them
</li
>
1197 <li
>End(s) students day
</li
>
1198 <li
>Same starting time/day/hour
</li
>
1199 <li
>Occupy max time slots from selection (a complex and
1200 flexible constraint, useful in many situations)
</li
>
1201 <li
>Consecutive, ordered, grouped (for
2 or
3 (sub)activities)
</li
>
1202 <li
>Not overlapping
</li
>
1203 <li
>Max simultaneous in selected time slots
</li
>
1204 <li
>Min gaps between a set of (sub)activities
</li
>
1205 </ul
></li
>
1206 </ul
></li
>
1208 <li
>A large and flexible palette of space constraints:
1210 <li
>Room not available periods
</li
>
1211 <li
>For teacher(s):
1213 <li
>Home room(s)
</li
>
1214 <li
>Max building changes per day/week
</li
>
1215 <li
>Min gaps between building changes
</li
>
1219 <li
>For students (sets):
1221 <li
>Home room(s)
</li
>
1222 <li
>Max building changes per day/week
</li
>
1223 <li
>Min gaps between building changes
</li
>
1226 <li
>Preferred room(s):
1228 <li
>For a subject
</li
>
1229 <li
>For an activity tag
</li
>
1230 <li
>For a subject and an activity tag
</li
>
1231 <li
>Individually for a (sub)activity
</li
>
1235 <li
>For a set of activities:
1237 <li
>Occupy a maximum number of different rooms
</li
>
1242 </ul
></p
>
1244 <p
>I have not used it myself, as I am not involved in time table
1245 planning at a school, but it seem to work fine when I test it. If you
1246 need to set up your schools time table, and is tired of doing it
1247 manually, check it out.
1249 A quick summary on how to use it can be found in
1250 <a href=
"http://marvelsoft.co.in/wp/
2012/
03/generate-timetable-for-state-cbse-icse-igcse-schools-free/
">a
1251 blog post from MarvelSoft
</a
>. If you find FET useful, please provide
1252 a recipe for the Debian Edu project in the
1253 <a href=
"http://wiki.debian.org/DebianEdu#Howtos
">Debian Edu HowTo
1254 section
</a
>.
</p
>