1 <?xml version=
"1.0" encoding=
"utf-8"?>
2 <rss version='
2.0' xmlns:lj='http://www.livejournal.org/rss/lj/
1.0/'
>
4 <title>Petter Reinholdtsen - Entries tagged debian
</title>
5 <description>Entries tagged debian
</description>
6 <link>http://www.hungry.com/~pere/blog/
</link>
10 <title>Some of my
2024 free software activities
</title>
11 <link>http://www.hungry.com/~pere/blog/Some_of_my_2024_free_software_activities.html
</link>
12 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Some_of_my_2024_free_software_activities.html
</guid>
13 <pubDate>Mon,
10 Feb
2025 09:
30:
00 +
0100</pubDate>
14 <description><p
>It is a while since I posted a summary of the free software and
15 open culture activities and projects I have worked on. Here is a
16 quick summary of the major ones from last year.
</p
>
18 <p
>I guess the biggest project of the year has been migrating orphaned
19 packages in Debian without a version control system to have a git
20 repository on salsa.debian.org. When I started in April around
450
21 the orphaned packages needed git. I
've since migrated around
250 of
22 the packages to a salsa git repository, and around
40 packages were
23 left when I took a break. Not sure who did the around
160 conversions
24 I was not involved in, but I am very glad I got some help on the
25 project. I stopped partly because some of the remaining packages
26 needed more disk space to build than I have available on my
27 development machine, and partly because some had a strange build setup
28 I could not figure out. I had a time budget of
20 minutes per
29 package, if the package proved problematic and likely to take longer,
30 I moved to another package. Might continue later, if I manage to free
31 up some disk space.
</p
>
33 <p
>Another rather big project was the translation to Norwegian Bokmål
34 and publishing of the first book ever published by a Sámi woman, the
35 «
<a href=
"http://www.hungry.com/~pere/publisher/#infoerlifellerdoed2024
">Møter
36 vi liv eller død?
</a
>» book by Elsa Laula, with a PD0 and CC-BY
37 license. I released it during the summer, and to my surprise it has
38 already sold several copies. As I suck at marketing, I did not expect
39 to sell any.
</p
>
41 <p
>A smaller, but more long term project (for more than
10 years now),
42 and related to orphaned packages in Debian, is my project to ensure a
43 simple way to install hardware related packages in Debian when the
44 relevant hardware is present in a machine. It made a fairly big
45 advance forward last year, partly because I have been poking and
46 begging package maintainers and upstream developers to include
47 AppStream metadata XML in their packages. I
've also released a few
48 new versions of the isenkram system with some robustness improvements.
49 Today
127 packages in Debian provide such information, allowing
50 <tt
>isenkram-lookup
</tt
> to propose them. Will keep pushing until the
51 around
35 package names currently hard coded in the isenkram package
52 are down to zero, so only information provided by individual packages
53 are used for this feature.
</p
>
55 <p
>As part of the work on AppStream, I have sponsored several packages
56 into Debian where the maintainer wanted to fix the issue but lacked
57 direct upload rights. I
've also sponsored a few other packages, when
58 approached by the maintainer.
</p
>
60 <p
>I would also like to mention two hardware related packages in
61 particular where I have been involved, the megactl and mfi-util
62 packages. Both work with the hardware RAID systems in several Dell
63 PowerEdge servers, and the first one is already available in Debian
64 (and of course, proposed by isenkram when used on the appropriate Dell
65 server), the other is waiting for NEW processing since this autumn. I
66 manage several such Dell servers and would like the tools needed to
67 monitor and configure these RAID controllers to be available from
68 within Debian out of the box.
</p
>
70 <p
>Vaguely related to hardware support in Debian, I have also been
71 trying to find ways to help out the Debian ROCm team, to improve the
72 support in Debian for my artificial idiocy (AI) compute node. So far
73 only uploaded one package, helped test the initial packaging of
74 llama.cpp and tried to figure out how to get good speech recognition
75 like Whisper into Debian.
<p
>
77 <p
>I am still involved in the LinuxCNC project, and organised a
78 developer gathering in Norway last summer. A new one is planned the
79 summer of
2025. I
've also helped evaluate patches and uploaded new
80 versions of LinuxCNC into Debian.
</p
>
82 <p
>After a
10 years long break, we managed to get a new and improved
83 upstream version of
<tt
>lsdvd
</tt
> released just before Christmas. As
84 I use it regularly to maintain my DVD archive, I was very happy to
85 finally get out a version supporting DVDDiscID useful for uniquely
86 identifying DVDs. I am dreaming of a Internet service mapping DVD IDs
87 to IMDB movie IDs, to make life as a DVD collector easier.
</p
>
89 <p
>My involvement in Norwegian archive standardisation and the free
90 software implementation of the vendor neutral Noark
5 API continued
91 for the entire year. I
've been pushing patches into both the API and
92 the test code for the API, participated in several editorial meetings
93 regarding the Noark
5 Tjenestegrensesnitt specification, submitted
94 several proposals for improvements for the same. We also organised a
95 small seminar for Noark
5 interested people, and is organising a new
96 seminar in a month.
</p
>
98 <p
>Part of the year was spent working on and coordinating a Norwegian
99 Bokmål translation of the marvellous children
's book
100 «
<a href=
"https://fsfe.org/activities/ada-zangemann/
">Ada and
101 Zangemann
<a
>», which focus on the right to repair and control your own
102 property, and the value of controlling the software on the devices you
103 own. The translation is mostly complete, and is now waiting for a
104 transformation of the project and manuscript to use Docbook XML
105 instead of a home made semi-text based format. Great progress is
106 being made and the new book build process is almost complete.
</p
>
108 <p
>I have also been looking at how to companies in Norway can use free
109 software to report their accounting summaries to the Norwegian
110 government. Several new regulations make it very hard for companies
111 to do use free software for accounting, and I would like to change
112 this. Found a few drafts for opening up the reporting process, and
113 have read up on some of the specifications, but nothing much is
114 working yet.
</p
>
116 <p
>These were just the top of the iceberg, but I guess this blog post
117 is long enough now. If you would like to help with any of these
118 projects, please get in touch, either directly on the project mailing
119 lists and forums, or with me via email, IRC or Signal. :)
</p
>
121 <p
>As usual, if you use Bitcoin and want to show your support of my
122 activities, please send Bitcoin donations to my address
123 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
128 <title>New oggz release
1.1.2 after
15 years
</title>
129 <link>http://www.hungry.com/~pere/blog/New_oggz_release_1_1_2_after_15_years.html
</link>
130 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_oggz_release_1_1_2_after_15_years.html
</guid>
131 <pubDate>Sun,
9 Feb
2025 01:
15:
00 +
0100</pubDate>
132 <description><p
>A little over a week ago, I noticed
133 <a href=
"https://tracker.debian.org/pkg/liboggz
">the liboggz
134 package
</a
> on my Debian dashboard had not had a new upstream release
135 for a while. A closer look showed that its last release, version
136 1.1.1, happened in
2010. A few patches had accumulated in the Debian
137 package, and I even noticed that I had passed on these patches to
138 upstream five years ago. A handful crash bugs had been reported
139 against the Debian package, and looking at the upstream repository I
140 even found a few crash bugs reported there too. To add insult to
141 injury, I discovered that upstream had accumulated several fixes in the
142 years between
2010 and now, and many of them had not made their way
143 into the Debian package. I decided enough was enough, and that a new
144 upstream release was needed fixing these nasty crash bugs. Luckily I
145 am also a member of the Xiph team, aka upstream, and could actually go
146 to work immediately to fix it.
</p
>
148 <p
>I started by adding automatic build testing on
149 <a href=
"https://gitlab.xiph.org/xiph/liboggz
">the Xiph gitlab oggz
150 instance
</a
>, to get a better idea of the state of affairs with the
151 code base. This exposed a few build problems, which I had to fix. In
152 parallel to this, I sent an email announcing my wish for a new release
153 to every person who had committed to the upstream code base since
154 2010, and asked for help doing a new release both on email and on the
155 #xiph IRC channel. Sadly only a fraction of their email providers
156 accepted my email. But Ralph Giles in the Xiph team came to the
157 rescue and provided invaluable help to guide be through the release
158 Xiph process. While this was going on, I spent a few days tracking
159 down the crash bugs with good help from
160 <a href=
"https://www.valgrind.org/
">valgrind
</a
>, and came up with
161 patch proposals to get rid of at least these specific crash bugs. The
162 open issues also had to be checked. Several of them proved to be
163 fixed already, but a few I had to creat patches for. I also checked
164 out the Debian, Arch, Fedora, Suse and Gentoo packages to see if there
165 were patches applied in these Linux distributions that should be
166 passed upstream. The end result was ready yesterday. A new liboggz
167 release, version
1.1.2, was tagged, wrapped up and published on the
168 project page. And today, the new release was uploaded into
171 <p
>You are probably by now curious on what actually changed in the
172 library. I guess the most interesting new feature was support for
173 Opus and VP8. Almost all other changes were stability or
174 documentation fixes. The rest were related to the gitlab continuous
175 integration testing. All in all, this was really a minor update,
176 hence the version bump only from
1.1.1 to to
1.1.2, but it was long
177 overdue and I am very happy that it is out the door.
</p
>
179 <p
>One change proposed upstream was not included this time, as it
180 extended the API and changed some of the existing library methods, and
181 thus require a major SONAME bump and possibly code changes in every
182 program using the library. As I am not that familiar with the code
183 base, I am unsure if I am the right person to evaluate the change.
184 Perhaps later.
</p
>
186 <p
>Since the release was tagged, a few minor fixes has been committed
187 upstream already: automatic testing the cross building to Windows, and
188 documentation updates linking to the correct project page. If a
189 important issue is discovered with this release, I guess a new release
190 might happen soon including the minor fixes. If not, perhaps they can
191 wait fifteen years. :)
</p
>
193 <p
>I would like to send a big thank you to everyone that helped make
194 this release happen, from the people adding fixes upstream over the
195 course of fifteen years, to the ones reporting crash bugs, other bugs
196 and those maintaining the package in various Linux distributions.
197 Thank you very much for your time and interest.
</p
>
199 <p
>As usual, if you use Bitcoin and want to show your support of my
200 activities, please send Bitcoin donations to my address
201 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
206 <title>121 packages in Debian mapped to hardware for automatic recommendation
</title>
207 <link>http://www.hungry.com/~pere/blog/
121_packages_in_Debian_mapped_to_hardware_for_automatic_recommendation.html
</link>
208 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/
121_packages_in_Debian_mapped_to_hardware_for_automatic_recommendation.html
</guid>
209 <pubDate>Sun,
19 Jan
2025 12:
40:
00 +
0100</pubDate>
210 <description><p
>For some years now, I have been working on a automatic hardware
211 based package recommendation system for Debian and other Linux
212 distributions. The isenkram system I started on back in
2013 now
213 consist of two subsystems, one locating firmware files using the
214 information provided by apt-file, and one matching hardware to
215 packages using information provided by AppStream. The former is very
216 similar to the mechanism implemented in debian-installer to pick the
217 right firmware packages to install. This post is about the latter
218 system. Thanks to steady progress and good help from both other
219 Debian and upstream developers, I am happy to report that
220 <a href=
"https://tracker.debian.org/pkg/isenkram
">the Isenkram
221 system
</a
> now are able to recommend
121 packages using information
223 <a href=
"https://www.freedesktop.org/wiki/Distributions/AppStream/
">AppStream
</a
>.
</p
>
225 <p
>The mapping is done using modalias information provided by the
226 kernel, the same information used by udev when creating device files,
227 and the kernel when deciding which kernel modules to load. To get all
228 the modalias identifiers relevant for your machine, you can run the
229 following command on the command line:
</p
>
232 find /sys/devices -name modalias -print0 | xargs -
0 sort -u
235 <p
>The modalias identifiers can look something like this:
</p
>
239 cpu:type:x86,ven0000fam0006mod003F:feature:,
0000,
0001,
0002,
0003,
0004,
0005,
0006,
0007,
0008,
0009,
000B,
000C,
000D,
000E,
000F,
0010,
0011,
0013,
0015,
0016,
0017,
0018,
0019,
001A,
001B,
001C,
001D,
001F,
002B,
0034,
003A,
003B,
003D,
0068,
006B,
006C,
006D,
006F,
0070,
0072,
0074,
0075,
0076,
0078,
0079,
007C,
0080,
0081,
0082,
0083,
0084,
0085,
0086,
0087,
0088,
0089,
008B,
008C,
008D,
008E,
008F,
0091,
0092,
0093,
0094,
0095,
0096,
0097,
0098,
0099,
009A,
009B,
009C,
009D,
009E,
00C0,
00C5,
00E1,
00E3,
00EB,
00ED,
00F0,
00F1,
00F3,
00F5,
00F6,
00F9,
00FA,
00FB,
00FD,
00FF,
0100,
0101,
0102,
0103,
0111,
0120,
0121,
0123,
0125,
0127,
0128,
0129,
012A,
012C,
012D,
0140,
0160,
0161,
0165,
016C,
017B,
01C0,
01C1,
01C2,
01C4,
01C5,
01C6,
01F9,
024A,
025A,
025B,
025C,
025F,
0282
240 dmi:bvnDellInc.:bvr2.18
.1:bd08/
14/
2023:br2.18:svnDellInc.:pnPowerEdgeR730:pvr:rvnDellInc.:rn0H21J3:rvrA09:cvnDellInc.:ct23:cvr:skuSKU=NotProvided
241 pci:v00008086d00008D3Bsv00001028sd00000600bc07sc80i00
244 usb:v413CpA001d0000dc09dsc00dp00ic09isc00ip00in00
247 <p
>The entries above are a selection of the complete set available on
248 a Dell PowerEdge R730 machine I have access to, to give an idea about
249 the various styles of hardware identifiers presented in the modalias
250 format. When looking up relevant packages in a Debian Testing
251 installation on the same R730, I get this list of packages
255 % sudo isenkram-lookup
257 firmware-nvidia-graphics
264 <p
>The list consist of firmware packages requested by kernel modules,
265 as well packages with program to get the status from the RAID
266 controller and to maintain the LAN console. When the edac-utils
267 package providing tools to check the ECC RAM status will enter testing
268 in a few days, it will also show up as a proposal from isenkram. In
269 addition, once the mfiutil package we uploaded in October get past the
270 NEW processing, it will also propose a tool to configure the RAID
271 controller.
</p
>
273 <p
>Another example is the trusty old Lenovo Thinkpad X230, which have
274 hardware handled by several packages in the archive. This is running
275 on Debian Stable:
</p
>
284 firmware-misc-nonfree
298 <p
>Here there proposal consist of software to handle the camera,
299 bluetooth, network card, wifi card, GPU, fan, fingerprint reader and
300 acceleration sensor on the machine.
</p
>
302 <p
>Here is the complete set of packages currently providing hardware
303 mapping via AppStream in Debian Unstable: air-quality-sensor,
304 alsa-firmware-loaders, antpm, array-info, avarice, avrdude,
305 bmusb-v4l2proxy, brltty, calibre, colorhug-client, concordance-common,
306 consolekit, dahdi-firmware-nonfree, dahdi-linux, edac-utils,
307 eegdev-plugins-free, ekeyd, elogind, firmware-amd-graphics,
308 firmware-ath9k-htc, firmware-atheros, firmware-b43-installer,
309 firmware-b43legacy-installer, firmware-bnx2, firmware-bnx2x,
310 firmware-brcm80211, firmware-carl9170, firmware-cavium,
311 firmware-intel-graphics, firmware-intel-misc, firmware-ipw2x00,
312 firmware-ivtv, firmware-iwlwifi, firmware-libertas,
313 firmware-linux-free, firmware-mediatek, firmware-misc-nonfree,
314 firmware-myricom, firmware-netronome, firmware-netxen,
315 firmware-nvidia-graphics, firmware-qcom-soc, firmware-qlogic,
316 firmware-realtek, firmware-ti-connectivity, fpga-icestorm, g810-led,
317 galileo, garmin-forerunner-tools, gkrellm-thinkbat, goldencheetah,
318 gpsman, gpstrans, gqrx-sdr, i8kutils, imsprog, ledger-wallets-udev,
319 libairspy0, libam7xxx0.1, libbladerf2, libgphoto2-
6t64,
320 libhamlib-utils, libm2k0.9
.0, libmirisdr4, libnxt, libopenxr1-monado,
321 libosmosdr0, librem5-flash-image, librtlsdr0, libticables2-
8,
322 libx52pro0, libykpers-
1-
1, libyubikey-udev, limesuite,
323 linuxcnc-uspace, lomoco, madwimax, media-player-info, megactl, mixxx,
324 mkgmap, msi-keyboard, mu-editor, mustang-plug, nbc, nitrokey-app, nqc,
325 ola, openfpgaloader, openocd, openrazer-driver-dkms, pcmciautils,
326 pcscd, pidgin-blinklight, ponyprog, printer-driver-splix,
327 python-yubico-tools, python3-btchip, qlcplus, rosegarden, scdaemon,
328 sispmctl, solaar, spectools, sunxi-tools, t2n, thinkfan, tlp,
329 tp-smapi-dkms, trezor, tucnak, ubertooth, usbrelay, uuu, viking,
330 w1retap, wsl, xawtv, xinput-calibrator, xserver-xorg-input-wacom and
333 <p
>In addition to these, there are several
334 <a href=
"https://udd.debian.org/cgi-bin/bts-usertags.cgi?user=pere%
40hungry.com
&tag=appstream-modalias
">with
335 patches pending in the Debian bug tracking system
</a
>, and even more
336 where no-one wrote patches yet. Good candiates for the latter are
338 <a href=
"https://udd.debian.org/lintian-tag.cgi?tag=appstream-metadata-missing-modalias-provide
">with
339 udev rules but no AppStream hardware information
</a
>.
</p
>
341 <p
>The isenkram system consist of two packages, isenkram-cli with the
342 command line tools, and isenkram with a GUI background process. The
343 latter will listen for dbus events from udev emitted when new hardware
344 become available (like when inserting a USB dongle or discovering a
345 new bluetooth device), look up the modalias entry for this piece of
346 hardware in AppStream (and a hard coded list of mappings from isenkram
347 - currently working hard to move this list to AppStream), and pop up a
348 dialog proposing to install any not already installed packages
349 supporting this hardware. It work very well today when inserting the
350 LEGO Mindstorms RCX, NXT and EV3 controllers. :) If you want to make
351 sure more hardware related packages get recommended, please help out
352 fixing the remaining packages in Debian to provide AppStream metadata
353 with hardware mappings.
</p
>
355 <p
>As usual, if you use Bitcoin and want to show your support of my
356 activities, please send Bitcoin donations to my address
357 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
362 <title>What is the most supported MIME type in Debian in
2025?
</title>
363 <link>http://www.hungry.com/~pere/blog/What_is_the_most_supported_MIME_type_in_Debian_in_2025_.html
</link>
364 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_is_the_most_supported_MIME_type_in_Debian_in_2025_.html
</guid>
365 <pubDate>Sat,
18 Jan
2025 10:
30:
00 +
0100</pubDate>
366 <description><p
><a href=
"http://www.hungry.com/~pere/blog/What_is_the_most_supported_MIME_type_in_Debian_in_2018_.html
">Seven
</a
>
368 <a href=
"http://www.hungry.com/~pere/blog/What_is_the_most_supported_MIME_type_in_Debian_.html
">twelve
</a
>
369 years ago, I measured what the most supported MIME type in Debian
370 was
</a
>, first by analysing the desktop files in all packages in the
371 archive, then by analysing the DEP-
11 AppStream data set. I guess it
372 is time to repeat the measurement, only for unstable as last time:
</p
>
374 <p
><strong
>Debian Unstable:
</strong
></p
>
378 ----- -----------------------
390 36 audio/x-vorbis+ogg
401 <p
>The list was created like this using a sid chroot:
</p
>
404 cat /var/lib/apt/lists/*sid*_dep11_Components-amd64.yml.gz | \
405 zcat | awk
'/^ - \S+\/\S+$/ {print $
2 }
' | sort | \
406 uniq -c | sort -nr | head -
20
409 <p
>It is nice to see that the same number of packages now support PNG
410 and JPEG. Last time JPEG had more support than PNG. Most of the MIME
411 types are known to me, but the
'audio/x-scpls
' one I have no idea what
412 represent, except it being an audio format. To find the packages
413 claiming support for this format, the appstreamcli command from the
414 appstream package can be used:
417 % appstreamcli what-provides mediatype audio/x-scpls | grep Package: | sort -u
418 Package: alsaplayer-common
425 Package: cynthiune.app
430 Package: kylin-burner
432 Package: mediaconch-gui
433 Package: mediainfo-gui
445 Package: soundconverter
452 <p
>Look like several video and auto tools understand the format.
453 Similarly one can check out the number of packages supporting the STL
454 format commonly used for
3D printing:
</p
>
457 % appstreamcli what-provides mediatype model/stl | grep Package: | sort -u
460 Package: open3d-viewer
464 <p
>How strange the
465 <a href=
"https://tracker.debian.org/pkg/slic3r
">slic3r
</a
> and
466 <a href=
"https://tracker.debian.org/pkg/slic3r-prusa
">prusa-slicer
</a
>
467 packages do not support STL. Perhaps just missing package metadata?
468 Luckily the amount of package metadata in Debian is getting better,
469 and hopefully this way of locating relevant packages for any file
470 format will be the preferred one soon.
472 <p
>As usual, if you use Bitcoin and want to show your support of my
473 activities, please send Bitcoin donations to my address
474 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
479 <title>The
2025 LinuxCNC Norwegian developer gathering
</title>
480 <link>http://www.hungry.com/~pere/blog/The_2025_LinuxCNC_Norwegian_developer_gathering.html
</link>
481 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_2025_LinuxCNC_Norwegian_developer_gathering.html
</guid>
482 <pubDate>Sat,
11 Jan
2025 14:
30:
00 +
0100</pubDate>
483 <description><p
><a href=
"https://linuxcnc.org/
">The LinuxCNC project
</a
> is
484 trotting along. And I believe this great software system for
485 numerical control of machines such as milling machines, lathes, plasma
486 cutters, routers, cutting machines, robots and hexapods, would do even
487 better with more in-person developer gatherings, so we plan to
488 organise such gathering this summer too.
</p
>
490 <p
>This year we would like to invite to a small LinuxCNC and free
491 software fabrication workshop/gathering in Norway this summer for the
492 weekend starting July
4th
2025. New this year is the slightly larger
493 scope, and we invite people also outside the LinuxCNC community to
494 join. As earlier, we suggest to organize it as an
495 <a href=
"https://en.wikipedia.org/wiki/Unconference
">unconference
</a
>,
496 where the participants create the program upon arrival.
</p
>
498 <p
>The location is a metal workshop
15 minutes drive away from to the
499 Gardermoen airport (OSL), where there is a lot of space and a hotel only
500 5 minutes away by car. We plan to fire up the barbeque in the evenings.
</p
>
502 <p
>Please let us know if you would like to join. We track the list of
503 participants on
<a href=
"https://pad.efn.no/p/linuxcnc-
2025-norway
">a
504 simple pad
</a
>, please add yourself there if you are interested in joining.
</p
>
506 <p
><a href=
"https://www.nuugfoundation.no/
">The NUUG Foundation
</a
> has on
507 our request offered to handle any money involved with this gathering,
508 in other words holding any sponsor funds and paying any bills.
509 NUUG Foundation is a spinnoff from the NUUG member organisation here
510 in Norway with long ties to the free software and open standards
511 communities.
</p
>
513 <p
>As usual we hope to find sponsors to pay for food, lodging and travel.
</p
>
515 <p
>As usual, if you use Bitcoin and want to show your support of my
516 activities, please send Bitcoin donations to my address
517 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
522 <title>New lsdvd release
0.18 after ten years
</title>
523 <link>http://www.hungry.com/~pere/blog/New_lsdvd_release_0_18_after_ten_years.html
</link>
524 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_lsdvd_release_0_18_after_ten_years.html
</guid>
525 <pubDate>Sat,
21 Dec
2024 10:
50:
00 +
0100</pubDate>
526 <description><p
>The rumors of the death of
527 <a href=
"https://sourceforge.net/projects/lsdvd/
">the lsdvd project
</a
>
528 is slightly exaggerated. And the last few months, we have been
529 working on fixing and improving it, culminating in a new release last
530 night. This is the list of changes in the new
0.18 release, as
531 <a href=
"https://sourceforge.net/p/lsdvd/mailman/message/
59108028/
">announced
532 on the project mailing list
</a
>:
</p
>
536 <li
>Simplified autoconf setup, dropped --enable-debug option.
</li
>
537 <li
>Improved video resolution reporting (
<a href=
"https://sourceforge.net/p/lsdvd/patches/
8/
">Fixes #
8</a
>).
</li
>
538 <li
>Applied patches fetched from BSDs (
<a href=
"https://sourceforge.net/p/lsdvd/patches/
7/
">Fixes #
7</a
>).
</li
>
539 <li
>Corrected Perl output (
<a href=
"https://sourceforge.net/p/lsdvd/patches/
1/
">Fixes #
1</a
>).
</li
>
540 <li
>Adjusted Pan and Scan entries to produce valid XML.
</li
>
541 <li
>Changed --help output from stderr to stdout.
</li
>
542 <li
>Corrected aspect ratio and audio format formatting.
</li
>
543 <li
>Avoid segfault when hitting a NULL pointer in the IFO structure.
</li
>
544 <li
>Change build rules to supress compiler flags, to make it easier to
545 spot warnings.
</li
>
546 <li
>Set default DVD device based on OS (Linux, *BSD, Darwin)
</li
>
547 <li
>Added libdvdread DVDDiscID to output.
</li
>
548 <li
>Corrected typo in longest track value in XML format.
</li
>
549 <li
>Switched XML output to use libxml to avoid string encoding issues.
</li
>
550 <li
>Added simple build time test suite.
</li
>
551 <li
>Cleaned up language code handling and adding missing mapping for
552 language codes
'nb
' and
'nn
'.
</li
>
553 <li
>Added JSON output support using -Oj.
</li
>
556 <p
>The most exciting news to me is easy access to the DVDDiscID, which
557 make it a lot easier to identify DVD duplicates across a large
558 collection of DVDs. During testing it has proved to be very effective
559 ad identifying when DVDs in a DVD box (say all Star Wars movies) is
560 identical to DVDs sold individually (like the same Star Wars movies
561 packaged individually).
</p
>
563 <p
>Because none of the current developers got access to do tarball
564 releases on Sourceforge any more, the release is only available as
565 <a href=
"https://sourceforge.net/p/lsdvd/git/ci/
0.18/tree/
">a git
566 tag
</a
> in the repository. Lets hope it do not take ten years for the
567 next release. The project are discussing to move away from
568 Sourceforge, but it has not yet concluded.
</p
>
570 <p
>As usual, if you use Bitcoin and want to show your support of my
571 activities, please send Bitcoin donations to my address
572 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
577 <title>More than
200 orphaned Debian packages moved to git,
216 to go
</title>
578 <link>http://www.hungry.com/~pere/blog/More_than_200_orphaned_Debian_packages_moved_to_git__216_to_go.html
</link>
579 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/More_than_200_orphaned_Debian_packages_moved_to_git__216_to_go.html
</guid>
580 <pubDate>Thu,
11 Jul
2024 12:
30:
00 +
0200</pubDate>
581 <description><p
><a href=
"http://www.hungry.com/~pere/blog/Time_to_move_orphaned_Debian_packages_to_git.html
">In
582 April
</a
>, I started migrating orphaned Debian packages without any
583 version control system listed in debian/control to git. This morning,
584 my Debian QA page finally reached
200 QA packages migrated. In
585 reality there are a few more, as the packages uploaded by someone else
586 after my initial upload have disappeared from my QA uploads list. As
587 I am running out of steam and will most likely focus on other parts of
588 Debian moving forward, I hope someone else will find time to continue
589 the migration to bring the number of orphaned packages without any
590 version control system down to zero. Here is the updated recipe if
591 someone want to help out.
</p
>
593 <p
>To locate packages to work on, the following one-liner can be used:
</p
>
595 <blockquote
><pre
>
596 PGPASSWORD=
"udd-mirror
" psql --port=
5432 --host=udd-mirror.debian.net \
597 --username=udd-mirror udd -c
"select source from sources \
598 where release =
'sid
' and (vcs_url ilike
'%anonscm.debian.org%
' \
599 OR vcs_browser ilike
'%anonscm.debian.org%
' or vcs_url IS NULL \
600 OR vcs_browser IS NULL) AND maintainer ilike
'%packages@qa.debian.org%
' \
601 order by random() limit
10;
"
602 </pre
></blockquote
>
604 <p
>Pick a random package from the list and run the latest edition of
606 <tt
><a href=
"http://www.hungry.com/~pere/blog/images/
2024-
07-
11-debian-snap-to-salsa.sh
">debian-snap-to-salsa
</a
></tt
>
607 with the package name as the argument to prepare a git repository with
608 the existing packaging. This will download old Debian packages from
609 <tt
>snapshot.debian.org
</tt
>. Note that very recent uploads will not
610 be included, so check out the package on
<tt
>tracker.debian.org
</tt
>.
611 Next, run
<tt
>gbp buildpackage --git-ignore-new
</tt
> to verify that
612 the package build as it should, and then visit
613 <a href=
"https://salsa.debian.org/debian/
">https://salsa.debian.org/debian/
</a
>
614 and make sure there is not already a git repository for the package
615 there. I also did
<tt
>git log -p debian/control
</tt
> and look for vcs
616 entries to check if the package used to have a git repository on
617 Alioth, and see if it can be a useful starting point moving forward.
618 If all this check out, I created a new gitlab project below the Debian
619 group on salsa, push the package source there and upload a new version.
620 I tend to also ensure build hardening is enabled, if it prove to be
621 easy, and check if I can easily fix any lintian issues or bug reports.
622 If the process took more than
20 minutes, I dropped it and moved on to
623 another package.
</p
>
625 <p
>If I found patches in debian/patches/ that were not yet passed
626 upstream, I would send an email to make sure upstream know about them.
627 This has proved to be a valuable step, and caused several new releases
628 for software that initially appeared abandoned. :)
</p
>
630 <p
>As usual, if you use Bitcoin and want to show your support of my
631 activities, please send Bitcoin donations to my address
632 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
637 <title>Some notes from the
2024 LinuxCNC Norwegian developer gathering
</title>
638 <link>http://www.hungry.com/~pere/blog/Some_notes_from_the_2024_LinuxCNC_Norwegian_developer_gathering.html
</link>
639 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Some_notes_from_the_2024_LinuxCNC_Norwegian_developer_gathering.html
</guid>
640 <pubDate>Wed,
10 Jul
2024 14:
45:
00 +
0200</pubDate>
641 <description><p
>The Norwegian
<a href=
"https://linuxcnc.org/
">The LinuxCNC
</a
>
642 developer gathering
2024 is over. It was a great and productive
643 weekend, and I am sad that it is over.
</p
>
645 <p
>Regular readers probably still remember what LinuxCNC is, but her
646 is a quick summary for those that forgot? LinuxCNC is a free software
647 system for numerical control of machines such as milling machines,
648 lathes, plasma cutters, routers, cutting machines, robots and
649 hexapods. It eats G-code and produce motor movement and other changes
650 to the physical world, while reading sensor input.
</p
>
652 <p
>I am not quite sure about the total head count, as not all people
653 were present at the gathering the entire weekend, but I believe it was
654 close to
10 people showing their faces at the gathering. The
"hard
655 core
" of the group, who stayed the entire weekend, were two from
656 Norway, two from Germany and one from England. I am happy with the
657 outcome from the gathering. We managed to wrap up a new stable
658 LinuxCNC release
2.9.3 and even tested it on real hardware within
659 minutes of the release. The release notes for
2.9.3 are still being
660 written, but should show up on on the project site in the next few
661 days. We managed to go through around twenty pull requests and merge
662 then into either the stable release (
2.9) or the development branch
663 (master). There are still around thirty pull requests left to
664 process, so we are not out of work yet. We even managed to
665 fix/improve a slightly worn lathe, and experiment with running a
666 mechanical clock using G-code.
</p
>
668 <p
>The evening barbeque worked well both on Saturday and Sunday. It
669 is quite fun to light up a charcoal grill using compressed air. Sadly
670 the weather was not the best, so we stayed indoors most of the
673 <p
>This gathering was made possible partly with sponsoring from both
674 <a href=
"https://www.redpill-linpro.com/
">Redpill Linpro
</a
>,
675 <a href=
"https://debian.org/
">Debian
</a
> and
676 <a href=
"https://nuugfoundation.no/
">NUUG Foundation
</a
>, and we are
677 most grateful for the support. I would also like to thank the local
678 school for lending us some furniture, and of course the rest of the
679 members of the organizers team, Asle and Bosse, for their countless
680 contributions. The gathering was such success that we want to do it
681 again next year.
</p
>
683 <p
>We plan to organize the next Norwegian LinuxCNC developer gathering
684 at the end of June next year, the weekend Friday
27th to Sunday
29th
685 of June
2025. I recommend you reserve the dates on your calendar
686 today. Other related communities are also welcome to join in, for
687 example those working on systems like FreeCAD and opencamlib, as I am
688 sure we have much in common and sharing experiences would be very
689 useful to all involved. We are of course looking for sponsors for
690 this gathering already. The total budget for this gathering was
691 around NOK
25.000 (around EUR
2.300), so our needs are quite modest.
692 Perhaps a machine or tools company would like to help out the free
693 software manufacturing community by sponsoring food, lodging and
694 transport for such gathering?
</p
>
699 <title>The
2024 LinuxCNC Norwegian developer gathering
</title>
700 <link>http://www.hungry.com/~pere/blog/The_2024_LinuxCNC_Norwegian_developer_gathering.html
</link>
701 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_2024_LinuxCNC_Norwegian_developer_gathering.html
</guid>
702 <pubDate>Fri,
31 May
2024 07:
45:
00 +
0200</pubDate>
703 <description><p
><a href=
"https://linuxcnc.org/
">The LinuxCNC project
</a
> is still
704 going strong. And I believe this great software system for numerical control of
705 machines such as milling machines, lathes, plasma cutters, routers,
706 cutting machines, robots and hexapods, would do even better with more
707 in-person developer gatherings, so we plan to organise such gathering
708 this summer too.
</p
>
710 <p
>The Norwegian LinuxCNC developer gathering take place the weekend
711 Friday July
5th to
7th this year, and is open for everyone interested
712 in contributing to LinuxCNC and free software manufacturing. Up to
713 date information about the gathering can be found in
714 <a href=
"https://sourceforge.net/p/emc/mailman/emc-developers/thread/
123eaae0-f3b9-
4170-a251-b7d608f1e974%
40bofh.no/
">the
715 developer mailing list thread
</a
> where the gathering was announced.
716 Thanks to the good people at
718 <a href=
"https://www.debian.org/
">Debian
</a
> as well as leftover money
719 from last years gathering from
720 <a href=
"https://www.redpill-linpro.com/
">Redpill-Linpro
</a
> and
721 <a href=
"https://www.nuugfoundation.no/no/
">NUUG Foundation
</a
>, we
722 have enough sponsor funds to pay for food, and probably also shelter
723 for the people traveling from afar to join us. If you would like to
724 join the gathering, get in touch and add your details on
725 <a href=
"https://pad.efn.no/p/linuxcnc-
2024-norway
">the pad
</a
>.
</p
>
727 <p
>As usual, if you use Bitcoin and want to show your support of my
728 activities, please send Bitcoin donations to my address
729 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
734 <title>45 orphaned Debian packages moved to git,
391 to go
</title>
735 <link>http://www.hungry.com/~pere/blog/
45_orphaned_Debian_packages_moved_to_git__391_to_go.html
</link>
736 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/
45_orphaned_Debian_packages_moved_to_git__391_to_go.html
</guid>
737 <pubDate>Thu,
25 Apr
2024 22:
00:
00 +
0200</pubDate>
738 <description><p
>Nine days ago, I started migrating orphaned Debian packages with no
739 version control system listed in debian/control of the source to git.
740 At the time there were
438 such packages. Now there are
391,
741 according to the UDD. In reality it is slightly less, as there is a
742 delay between uploads and UDD updates. In the nine days since, I have
743 thus been able to work my way through ten percent of the packages. I
744 am starting to run out of steam, and hope someone else will also help
745 brushing some dust of these packages. Here is a recipe how to do it.
747 I start by picking a random package by querying the UDD for a list of
748 10 random packages from the set of remaining packages:
750 <blockquote
><pre
>
751 PGPASSWORD=
"udd-mirror
" psql --port=
5432 --host=udd-mirror.debian.net \
752 --username=udd-mirror udd -c
"select source from sources \
753 where release =
'sid
' and (vcs_url ilike
'%anonscm.debian.org%
' \
754 OR vcs_browser ilike
'%anonscm.debian.org%
' or vcs_url IS NULL \
755 OR vcs_browser IS NULL) AND maintainer ilike
'%packages@qa.debian.org%
' \
756 order by random() limit
10;
"
757 </pre
></blockquote
>
759 <p
>Next, I visit http://salsa.debian.org/debian and search for the
760 package name, to ensure no git repository already exist. If it does,
761 I clone it and try to get it to an uploadable state, and add the Vcs-*
762 entries in d/control to make the repository more widely known. These
763 packages are a minority, so I will not cover that use case here.
</p
>
765 <p
>For packages without an existing git repository, I run the
766 following script
<tt
>debian-snap-to-salsa
</tt
> to prepare a git
767 repository with the existing packaging.
</p
>
769 <blockquote
><pre
>
772 # See also https://bugs.debian.org/
804722#
31
776 # Move to this Standards-Version.
781 if [ -z
"$PKG
" ]; then
782 echo
"usage: $
0 <pkgname
>"
786 if [ -e
"${PKG}-salsa
" ]; then
787 echo
"error: ${PKG}-salsa already exist, aborting.
"
791 if [ -z
"ALLOWFAILURE
" ] ; then
795 # Fetch every snapshotted source package. Manually loop until all
796 # transfers succeed, as
'gbp import-dscs --debsnap
' do not fail on
798 until debsnap --force -v $PKG || $ALLOWFAILURE ; do sleep
1; done
799 mkdir ${PKG}-salsa; cd ${PKG}-salsa
802 # Specify branches to override any debian/gbp.conf file present in the
804 gbp import-dscs --debian-branch=master --upstream-branch=upstream \
805 --pristine-tar ../source-$PKG/*.dsc
807 # Add Vcs pointing to Salsa Debian project (must be manually created
809 if ! grep -q ^Vcs- debian/control ; then
810 awk
"BEGIN { s=
1 } /^\$/ { if (s==
1) { print \
"Vcs-Browser: https://salsa.debian.org/debian/$PKG\
"; print \
"Vcs-Git: https://salsa.debian.org/debian/$PKG.git\
" }; s=
0 } { print }
" < debian/control
> debian/control.new
&& mv debian/control.new debian/control
811 git commit -m
"Updated vcs in d/control to Salsa.
" debian/control
814 # Tell gbp to enforce the use of pristine-tar.
815 inifile +inifile debian/gbp.conf +create +section DEFAULT +key pristine-tar +value True
816 git add debian/gbp.conf
817 git commit -m
"Added d/gbp.conf to enforce the use of pristine-tar.
" debian/gbp.conf
819 # Update to latest Standards-Version.
820 SV=
"$(grep ^Standards-Version: debian/control|awk
'{print $
2}
')
"
821 if [ $SV_LATEST != $SV ]; then
822 sed -i
"s/\(Standards-Version: \)\(.*\)/\
1$SV_LATEST/
" debian/control
823 git commit -m
"Updated Standards-Version from $SV to $SV_LATEST.
" debian/control
826 if grep -q pkg-config debian/control; then
827 sed -i s/pkg-config/pkgconf/ debian/control
828 git commit -m
"Replaced obsolete pkg-config build dependency with pkgconf.
" debian/control
831 if grep -q libncurses5-dev debian/control; then
832 sed -i s/libncurses5-dev/libncurses-dev/ debian/control
833 git commit -m
"Replaced obsolete libncurses5-dev build dependency with libncurses-dev.
" debian/control
835 </pre
></blockquote
>
837 Some times the debsnap script fail to download some of the versions.
838 In those cases I investigate, and if I decide the failing versions
839 will not be missed, I call it using ALLOWFAILURE=true to ignore the
840 problem and create the git repository anyway.
</p
>
842 <p
>With the git repository in place, I do a test build (gbp
843 buildpackage) to ensure the build is actually working. If it does not
844 I pick a different package, or if the build failure is trivial to fix,
845 I fix it before continuing. At this stage I revisit
846 http://salsa.debian.org/debian and create the project under this group
847 for the package. I then follow the instructions to publish the local
848 git repository. Here is from a recent example:
</p
>
850 <blockquote
><pre
>
851 git remote add origin git@salsa.debian.org:debian/perl-byacc.git
852 git push --set-upstream origin master upstream pristine-tar
854 </pre
></blockquote
>
856 <p
>With a working build, I have a look at the build rules if I want to
857 remove some more dust. I normally try to move to debhelper compat
858 level
13, which involves removing debian/compat and modifying
859 debian/control to build depend on debhelper-compat (=
13). I also test
860 with
'Rules-Requires-Root: no
' in debian/control and verify in
861 debian/rules that hardening is enabled, and include all of these if
862 the package still build. If it fail to build with level
13, I try
863 with
12,
11,
10 and so on until I find a level where it build, as I do
864 not want to spend a lot of time fixing build issues.
</p
>
866 <p
>Some times, when I feel inspired, I make sure debian/copyright is
867 converted to the machine readable format, often by starting with
868 'debhelper -cc
' and then cleaning up the autogenerated content until
869 it matches realities. If I feel like it, I might also clean up
870 non-dh-based debian/rules files to use the short style dh build
873 <p
>Once I have removed all the dust I care to process for the package,
874 I run
'gbp dch
' to generate a debian/changelog entry based on the
875 commits done so far, run
'dch -r
' to switch from
'UNRELEASED
' to
876 'unstable
' and get an editor to make sure the
'QA upload
' marker is in
877 place and that all long commit descriptions are wrapped into sensible
878 lengths, run
'debcommit --release -a
' to commit and tag the new
879 debian/changelog entry, run
'debuild -S
' to build a source only
880 package, and
'dput ../perl-byacc_2.0-
10_source.changes
' to do the
881 upload. During the entire process, and many times per step, I run
882 'debuild
' to verify the changes done still work. I also some times
883 verify the set of built files using
'find debian
' to see if I can spot
884 any problems (like no file in usr/bin any more or empty package). I
885 also try to fix all lintian issues reported at the end of each
886 'debuild
' run.
</p
>
888 <p
>If I find Debian specific patches, I try to ensure their metadata
889 is fairly up to date and some times I even try to reach out to
890 upstream, to make the upstream project aware of the patches. Most of
891 my emails bounce, so the success rate is low. For projects with no
892 Homepage entry in debian/control I try to track down one, and for
893 packages with no debian/watch file I try to create one. But at least
894 for some of the packages I have been unable to find a functioning
895 upstream, and must skip both of these.
</p
>
897 <p
>If I could handle ten percent in nine days, twenty people could
898 complete the rest in less then five days. I use approximately twenty
899 minutes per package, when I have twenty minutes spare time to spend.
900 Perhaps you got twenty minutes to spare too?
</p
>
902 <p
>As usual, if you use Bitcoin and want to show your support of my
903 activities, please send Bitcoin donations to my address
904 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
906 <p
><strong
>Update
2024-
05-
04:
</strong
> There is
907 <a href=
"http://www.hungry.com/~pere/blog/images/
2024-
05-
04-debian-snap-to-salsa.sh
">an
908 updated edition of my migration script
</a
>, last updated
909 2024-
05-
04.
</p
>
914 <title>Time to move orphaned Debian packages to git
</title>
915 <link>http://www.hungry.com/~pere/blog/Time_to_move_orphaned_Debian_packages_to_git.html
</link>
916 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Time_to_move_orphaned_Debian_packages_to_git.html
</guid>
917 <pubDate>Sun,
14 Apr
2024 09:
30:
00 +
0200</pubDate>
918 <description><p
>There are several packages in Debian without a associated git
919 repository with the packaging history. This is unfortunate and it
920 would be nice if more of these would do so. Quote a lot of these are
921 without a maintainer, ie listed as maintained by the
922 '<a href=
"https://qa.debian.org/developer.php?email=packages%
40qa.debian.org
">Debian
923 QA Group
</a
>' place holder. In fact,
438 packages have this property
924 according to UDD (
<tt
>SELECT source FROM sources WHERE release =
'sid
'
925 AND (vcs_url ilike
'%anonscm.debian.org%
' OR vcs_browser ilike
926 '%anonscm.debian.org%
' or vcs_url IS NULL OR vcs_browser IS NULL) AND
927 maintainer ilike
'%packages@qa.debian.org%
';
</tt
>). Such packages can
928 be updated without much coordination by any Debian developer, as they
929 are considered orphaned.
</p
>
931 <p
>To try to improve the situation and reduce the number of packages
932 without associated git repository, I started a few days ago to search
933 out candiates and provide them with a git repository under the
934 'debian
' collaborative Salsa project. I started with the packages
935 pointing to obsolete Alioth git repositories, and am now working my
936 way across the ones completely without git references. In addition to
937 updating the Vcs-* debian/control fields, I try to update
938 Standards-Version, debhelper compat level, simplify d/rules, switch to
939 Rules-Requires-Root: no and fix lintian issues reported. I only
940 implement those that are trivial to fix, to avoid spending too much
941 time on each orphaned package. So far my experience is that it take
942 aproximately
20 minutes to convert a package without any git
943 references, and a lot more for packages with existing git repositories
944 incompatible with git-buildpackages.
</p
>
946 <p
>So far I have converted
10 packages, and I will keep going until I
947 run out of steam. As should be clear from the numbers, there is
948 enough packages remaining for more people to do the same without
949 stepping on each others toes. I find it useful to start by searching
950 for a git repo already on salsa, as I find that some times a git repo
951 has already been created, but no new version is uploaded to Debian
952 yet. In those cases I start with the existing git repository. I
953 convert to the git-buildpackage+pristine-tar workflow, and ensure a
954 debian/gbp.conf file with
"pristine-tar=True
" is added early, to avoid
955 uploading a orig.tar.gz with the wrong checksum by mistake. Did that
956 three times in the begin before I remembered my mistake.
</p
>
958 <p
>So, if you are a Debian Developer and got some spare time, perhaps
959 considering migrating some orphaned packages to git?
</p
>
961 <p
>As usual, if you use Bitcoin and want to show your support of my
962 activities, please send Bitcoin donations to my address
963 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
968 <title>New and improved sqlcipher in Debian for accessing Signal database
</title>
969 <link>http://www.hungry.com/~pere/blog/New_and_improved_sqlcipher_in_Debian_for_accessing_Signal_database.html
</link>
970 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_and_improved_sqlcipher_in_Debian_for_accessing_Signal_database.html
</guid>
971 <pubDate>Sun,
12 Nov
2023 12:
00:
00 +
0100</pubDate>
972 <description><p
>For a while now I wanted to have direct access to the
973 <a href=
"https://signal.org/
">Signal
</a
> database of messages and
974 channels of my Desktop edition of Signal. I prefer the enforced end
975 to end encryption of Signal these days for my communication with
976 friends and family, to increase the level of safety and privacy as
977 well as raising the cost of the mass surveillance government and
978 non-government entities practice these days. In August I came across
980 <a href=
"https://www.yoranbrondsema.com/post/the-guide-to-extracting-statistics-from-your-signal-conversations/
">recipe
981 on how to use sqlcipher to extract statistics from the Signal
982 database
</a
> explaining how to do this. Unfortunately this did not
983 work with the version of sqlcipher in Debian. The
984 <a href=
"http://tracker.debian.org/sqlcipher/
">sqlcipher
</a
>
985 package is a
"fork
" of the sqlite package with added support for
986 encrypted databases. Sadly the current Debian maintainer
987 <a href=
"https://bugs.debian.org/
961598">announced more than three
988 years ago that he did not have time to maintain sqlcipher
</a
>, so it
989 seemed unlikely to be upgraded by the maintainer. I was reluctant to
990 take on the job myself, as I have very limited experience maintaining
991 shared libraries in Debian. After waiting and hoping for a few
992 months, I gave up the last week, and set out to update the package. In
993 the process I orphaned it to make it more obvious for the next person
994 looking at it that the package need proper maintenance.
</p
>
996 <p
>The version in Debian was around five years old, and quite a lot of
997 changes had taken place upstream into the Debian maintenance git
998 repository. After spending a few days importing the new upstream
999 versions, realising that upstream did not care much for SONAME
1000 versioning as I saw library symbols being both added and removed with
1001 minor version number changes to the project, I concluded that I had to
1002 do a SONAME bump of the library package to avoid surprising the
1003 reverse dependencies. I even added a simple
1004 autopkgtest script to ensure the package work as intended. Dug deep
1005 into the hole of learning shared library maintenance, I set out a few
1006 days ago to upload the new version to Debian experimental to see what
1007 the quality assurance framework in Debian had to say about the result.
1008 The feedback told me the pacakge was not too shabby, and yesterday I
1009 uploaded the latest version to Debian unstable. It should enter
1010 testing today or tomorrow, perhaps delayed by
1011 <a href=
"https://bugs.debian.org/
1055812">a small library
1012 transition
</a
>.
</p
>
1014 <p
>Armed with a new version of sqlcipher, I can now have a look at the
1015 SQL database in ~/.config/Signal/sql/db.sqlite. First, one need to
1016 fetch the encryption key from the Signal configuration using this
1017 simple JSON extraction command:
</p
>
1019 <pre
>/usr/bin/jq -r
'.
"key
"' ~/.config/Signal/config.json
</pre
>
1021 <p
>Assuming the result from that command is
'secretkey
', which is a
1022 hexadecimal number representing the key used to encrypt the database.
1023 Next, one can now connect to the database and inject the encryption
1024 key for access via SQL to fetch information from the database. Here
1025 is an example dumping the database structure:
</p
>
1028 % sqlcipher ~/.config/Signal/sql/db.sqlite
1029 sqlite
> PRAGMA key =
"x
'secretkey
'";
1031 CREATE TABLE sqlite_stat1(tbl,idx,stat);
1032 CREATE TABLE conversations(
1033 id STRING PRIMARY KEY ASC,
1041 , profileFamilyName TEXT, profileFullName TEXT, e164 TEXT, serviceId TEXT, groupId TEXT, profileLastFetchedAt INTEGER);
1042 CREATE TABLE identityKeys(
1043 id STRING PRIMARY KEY ASC,
1047 id STRING PRIMARY KEY ASC,
1050 CREATE TABLE sessions(
1051 id TEXT PRIMARY KEY,
1052 conversationId TEXT,
1054 , ourServiceId STRING, serviceId STRING);
1055 CREATE TABLE attachment_downloads(
1056 id STRING primary key,
1061 CREATE TABLE sticker_packs(
1062 id TEXT PRIMARY KEY,
1066 coverStickerId INTEGER,
1068 downloadAttempts INTEGER,
1069 installedAt INTEGER,
1072 stickerCount INTEGER,
1074 , attemptedStatus STRING, position INTEGER DEFAULT
0 NOT NULL, storageID STRING, storageVersion INTEGER, storageUnknownFields BLOB, storageNeedsSync
1075 INTEGER DEFAULT
0 NOT NULL);
1076 CREATE TABLE stickers(
1077 id INTEGER NOT NULL,
1078 packId TEXT NOT NULL,
1082 isCoverOnly INTEGER,
1087 PRIMARY KEY (id, packId),
1088 CONSTRAINT stickers_fk
1089 FOREIGN KEY (packId)
1090 REFERENCES sticker_packs(id)
1093 CREATE TABLE sticker_references(
1096 CONSTRAINT sticker_references_fk
1098 REFERENCES sticker_packs(id)
1101 CREATE TABLE emojis(
1102 shortName TEXT PRIMARY KEY,
1105 CREATE TABLE messages(
1106 rowid INTEGER PRIMARY KEY ASC,
1112 schemaVersion INTEGER,
1113 conversationId STRING,
1114 received_at INTEGER,
1116 hasAttachments INTEGER,
1117 hasFileAttachments INTEGER,
1118 hasVisualMediaAttachments INTEGER,
1119 expireTimer INTEGER,
1120 expirationStartTimestamp INTEGER,
1123 messageTimer INTEGER,
1124 messageTimerStart INTEGER,
1125 messageTimerExpiresAt INTEGER,
1128 sourceServiceId TEXT, serverGuid STRING NULL, sourceDevice INTEGER, storyId STRING, isStory INTEGER
1129 GENERATED ALWAYS AS (type IS
'story
'), isChangeCreatedByUs INTEGER NOT NULL DEFAULT
0, isTimerChangeFromSync INTEGER
1130 GENERATED ALWAYS AS (
1131 json_extract(json,
'$.expirationTimerUpdate.fromSync
') IS
1
1132 ), seenStatus NUMBER default
0, storyDistributionListId STRING, expiresAt INT
1135 expirationStartTimestamp + (expireTimer *
1000),
1137 )), shouldAffectActivity INTEGER
1138 GENERATED ALWAYS AS (
1142 'change-number-notification
',
1143 'contact-removed-notification
',
1144 'conversation-merge
',
1145 'group-v1-migration
',
1146 'keychange
',
1147 'message-history-unsynced
',
1148 'profile-change
',
1150 'universal-timer-notification
',
1151 'verified-change
'
1153 ), shouldAffectPreview INTEGER
1154 GENERATED ALWAYS AS (
1158 'change-number-notification
',
1159 'contact-removed-notification
',
1160 'conversation-merge
',
1161 'group-v1-migration
',
1162 'keychange
',
1163 'message-history-unsynced
',
1164 'profile-change
',
1166 'universal-timer-notification
',
1167 'verified-change
'
1169 ), isUserInitiatedMessage INTEGER
1170 GENERATED ALWAYS AS (
1174 'change-number-notification
',
1175 'contact-removed-notification
',
1176 'conversation-merge
',
1177 'group-v1-migration
',
1178 'group-v2-change
',
1179 'keychange
',
1180 'message-history-unsynced
',
1181 'profile-change
',
1183 'universal-timer-notification
',
1184 'verified-change
'
1186 ), mentionsMe INTEGER NOT NULL DEFAULT
0, isGroupLeaveEvent INTEGER
1187 GENERATED ALWAYS AS (
1188 type IS
'group-v2-change
' AND
1189 json_array_length(json_extract(json,
'$.groupV2Change.details
')) IS
1 AND
1190 json_extract(json,
'$.groupV2Change.details[
0].type
') IS
'member-remove
' AND
1191 json_extract(json,
'$.groupV2Change.from
') IS NOT NULL AND
1192 json_extract(json,
'$.groupV2Change.from
') IS json_extract(json,
'$.groupV2Change.details[
0].aci
')
1193 ), isGroupLeaveEventFromOther INTEGER
1194 GENERATED ALWAYS AS (
1195 isGroupLeaveEvent IS
1
1197 isChangeCreatedByUs IS
0
1199 GENERATED ALWAYS AS (
1200 json_extract(json,
'$.callId
')
1202 CREATE TABLE sqlite_stat4(tbl,idx,neq,nlt,ndlt,sample);
1204 id TEXT PRIMARY KEY,
1205 queueType TEXT STRING NOT NULL,
1206 timestamp INTEGER NOT NULL,
1209 CREATE TABLE reactions(
1210 conversationId STRING,
1213 messageReceivedAt INTEGER,
1214 targetAuthorAci STRING,
1215 targetTimestamp INTEGER,
1217 , messageId STRING);
1218 CREATE TABLE senderKeys(
1219 id TEXT PRIMARY KEY NOT NULL,
1220 senderId TEXT NOT NULL,
1221 distributionId TEXT NOT NULL,
1223 lastUpdatedDate NUMBER NOT NULL
1225 CREATE TABLE unprocessed(
1226 id STRING PRIMARY KEY ASC,
1233 serverTimestamp INTEGER,
1234 sourceServiceId STRING
1235 , serverGuid STRING NULL, sourceDevice INTEGER, receivedAtCounter INTEGER, urgent INTEGER, story INTEGER);
1236 CREATE TABLE sendLogPayloads(
1237 id INTEGER PRIMARY KEY ASC,
1239 timestamp INTEGER NOT NULL,
1240 contentHint INTEGER NOT NULL,
1242 , urgent INTEGER, hasPniSignatureMessage INTEGER DEFAULT
0 NOT NULL);
1243 CREATE TABLE sendLogRecipients(
1244 payloadId INTEGER NOT NULL,
1246 recipientServiceId STRING NOT NULL,
1247 deviceId INTEGER NOT NULL,
1249 PRIMARY KEY (payloadId, recipientServiceId, deviceId),
1251 CONSTRAINT sendLogRecipientsForeignKey
1252 FOREIGN KEY (payloadId)
1253 REFERENCES sendLogPayloads(id)
1256 CREATE TABLE sendLogMessageIds(
1257 payloadId INTEGER NOT NULL,
1259 messageId STRING NOT NULL,
1261 PRIMARY KEY (payloadId, messageId),
1263 CONSTRAINT sendLogMessageIdsForeignKey
1264 FOREIGN KEY (payloadId)
1265 REFERENCES sendLogPayloads(id)
1268 CREATE TABLE preKeys(
1269 id STRING PRIMARY KEY ASC,
1271 , ourServiceId NUMBER
1272 GENERATED ALWAYS AS (json_extract(json,
'$.ourServiceId
')));
1273 CREATE TABLE signedPreKeys(
1274 id STRING PRIMARY KEY ASC,
1276 , ourServiceId NUMBER
1277 GENERATED ALWAYS AS (json_extract(json,
'$.ourServiceId
')));
1278 CREATE TABLE badges(
1279 id TEXT PRIMARY KEY,
1280 category TEXT NOT NULL,
1282 descriptionTemplate TEXT NOT NULL
1284 CREATE TABLE badgeImageFiles(
1285 badgeId TEXT REFERENCES badges(id)
1288 'order
' INTEGER NOT NULL,
1293 CREATE TABLE storyReads (
1294 authorId STRING NOT NULL,
1295 conversationId STRING NOT NULL,
1296 storyId STRING NOT NULL,
1297 storyReadDate NUMBER NOT NULL,
1299 PRIMARY KEY (authorId, storyId)
1301 CREATE TABLE storyDistributions(
1302 id STRING PRIMARY KEY NOT NULL,
1305 senderKeyInfoJson STRING
1306 , deletedAtTimestamp INTEGER, allowsReplies INTEGER, isBlockList INTEGER, storageID STRING, storageVersion INTEGER, storageUnknownFields BLOB, storageNeedsSync INTEGER);
1307 CREATE TABLE storyDistributionMembers(
1308 listId STRING NOT NULL REFERENCES storyDistributions(id)
1311 serviceId STRING NOT NULL,
1313 PRIMARY KEY (listId, serviceId)
1315 CREATE TABLE uninstalled_sticker_packs (
1316 id STRING NOT NULL PRIMARY KEY,
1317 uninstalledAt NUMBER NOT NULL,
1319 storageVersion NUMBER,
1320 storageUnknownFields BLOB,
1321 storageNeedsSync INTEGER NOT NULL
1323 CREATE TABLE groupCallRingCancellations(
1324 ringId INTEGER PRIMARY KEY,
1325 createdAt INTEGER NOT NULL
1327 CREATE TABLE IF NOT EXISTS
'messages_fts_data
'(id INTEGER PRIMARY KEY, block BLOB);
1328 CREATE TABLE IF NOT EXISTS
'messages_fts_idx
'(segid, term, pgno, PRIMARY KEY(segid, term)) WITHOUT ROWID;
1329 CREATE TABLE IF NOT EXISTS
'messages_fts_content
'(id INTEGER PRIMARY KEY, c0);
1330 CREATE TABLE IF NOT EXISTS
'messages_fts_docsize
'(id INTEGER PRIMARY KEY, sz BLOB);
1331 CREATE TABLE IF NOT EXISTS
'messages_fts_config
'(k PRIMARY KEY, v) WITHOUT ROWID;
1332 CREATE TABLE edited_messages(
1333 messageId STRING REFERENCES messages(id)
1337 , conversationId STRING);
1338 CREATE TABLE mentions (
1339 messageId REFERENCES messages(id) ON DELETE CASCADE,
1344 CREATE TABLE kyberPreKeys(
1345 id STRING PRIMARY KEY NOT NULL,
1346 json TEXT NOT NULL, ourServiceId NUMBER
1347 GENERATED ALWAYS AS (json_extract(json,
'$.ourServiceId
')));
1348 CREATE TABLE callsHistory (
1349 callId TEXT PRIMARY KEY,
1350 peerId TEXT NOT NULL, -- conversation id (legacy) | uuid | groupId | roomId
1351 ringerId TEXT DEFAULT NULL, -- ringer uuid
1352 mode TEXT NOT NULL, -- enum
"Direct
" |
"Group
"
1353 type TEXT NOT NULL, -- enum
"Audio
" |
"Video
" |
"Group
"
1354 direction TEXT NOT NULL, -- enum
"Incoming
" |
"Outgoing
1355 -- Direct: enum
"Pending
" |
"Missed
" |
"Accepted
" |
"Deleted
"
1356 -- Group: enum
"GenericGroupCall
" |
"OutgoingRing
" |
"Ringing
" |
"Joined
" |
"Missed
" |
"Declined
" |
"Accepted
" |
"Deleted
"
1357 status TEXT NOT NULL,
1358 timestamp INTEGER NOT NULL,
1359 UNIQUE (callId, peerId) ON CONFLICT FAIL
1361 [ dropped all indexes to save space in this blog post ]
1362 CREATE TRIGGER messages_on_view_once_update AFTER UPDATE ON messages
1364 new.body IS NOT NULL AND new.isViewOnce =
1
1366 DELETE FROM messages_fts WHERE rowid = old.rowid;
1368 CREATE TRIGGER messages_on_insert AFTER INSERT ON messages
1369 WHEN new.isViewOnce IS NOT
1 AND new.storyId IS NULL
1371 INSERT INTO messages_fts
1374 (new.rowid, new.body);
1376 CREATE TRIGGER messages_on_delete AFTER DELETE ON messages BEGIN
1377 DELETE FROM messages_fts WHERE rowid = old.rowid;
1378 DELETE FROM sendLogPayloads WHERE id IN (
1379 SELECT payloadId FROM sendLogMessageIds
1380 WHERE messageId = old.id
1382 DELETE FROM reactions WHERE rowid IN (
1383 SELECT rowid FROM reactions
1384 WHERE messageId = old.id
1386 DELETE FROM storyReads WHERE storyId = old.storyId;
1388 CREATE VIRTUAL TABLE messages_fts USING fts5(
1390 tokenize =
'signal_tokenizer
'
1392 CREATE TRIGGER messages_on_update AFTER UPDATE ON messages
1394 (new.body IS NULL OR old.body IS NOT new.body) AND
1395 new.isViewOnce IS NOT
1 AND new.storyId IS NULL
1397 DELETE FROM messages_fts WHERE rowid = old.rowid;
1398 INSERT INTO messages_fts
1401 (new.rowid, new.body);
1403 CREATE TRIGGER messages_on_insert_insert_mentions AFTER INSERT ON messages
1405 INSERT INTO mentions (messageId, mentionAci, start, length)
1407 SELECT messages.id, bodyRanges.value -
>> 'mentionAci
' as mentionAci,
1408 bodyRanges.value -
>> 'start
' as start,
1409 bodyRanges.value -
>> 'length
' as length
1410 FROM messages, json_each(messages.json -
>> 'bodyRanges
') as bodyRanges
1411 WHERE bodyRanges.value -
>> 'mentionAci
' IS NOT NULL
1413 AND messages.id = new.id;
1415 CREATE TRIGGER messages_on_update_update_mentions AFTER UPDATE ON messages
1417 DELETE FROM mentions WHERE messageId = new.id;
1418 INSERT INTO mentions (messageId, mentionAci, start, length)
1420 SELECT messages.id, bodyRanges.value -
>> 'mentionAci
' as mentionAci,
1421 bodyRanges.value -
>> 'start
' as start,
1422 bodyRanges.value -
>> 'length
' as length
1423 FROM messages, json_each(messages.json -
>> 'bodyRanges
') as bodyRanges
1424 WHERE bodyRanges.value -
>> 'mentionAci
' IS NOT NULL
1426 AND messages.id = new.id;
1431 <p
>Finally I have the tool needed to inspect and process Signal
1432 messages that I need, without using the vendor provided client. Now
1433 on to transforming it to a more useful format.
</p
>
1435 <p
>As usual, if you use Bitcoin and want to show your support of my
1436 activities, please send Bitcoin donations to my address
1437 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1442 <title>New chrpath release
0.17</title>
1443 <link>http://www.hungry.com/~pere/blog/New_chrpath_release_0_17.html
</link>
1444 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_chrpath_release_0_17.html
</guid>
1445 <pubDate>Fri,
10 Nov
2023 07:
30:
00 +
0100</pubDate>
1446 <description><p
>The chrpath package provide a simple command line tool to remove or
1447 modify the rpath or runpath of compiled ELF program. It is almost
10
1448 years since I updated the code base, but I stumbled over the tool
1449 today, and decided it was time to move the code base from Subversion
1450 to git and find a new home for it, as the previous one (Debian Alioth)
1451 has been shut down. I decided to go with
1452 <a href=
"https://codeberg.org/
">Codeberg
</a
> this time, as it is my git
1453 service of choice these days, did a quick and dirty migration to git
1454 and updated the code with a few patches I found in the Debian bug
1455 tracker. These are the release notes:
</p
>
1457 <p
>New in
0.17 released
2023-
11-
10:
</p
>
1460 <li
>Moved project to Codeberg, as Alioth is shut down.
</li
>
1461 <li
>Add Solaris support (use
&lt;sys/byteorder.h
> instead of
&lt;byteswap.h
>).
1462 Patch from Rainer Orth.
</li
>
1463 <li
>Added missing newline from printf() line. Patch from Frank Dana.
</li
>
1464 <li
>Corrected handling of multiple ELF sections. Patch from Frank Dana.
</li
>
1465 <li
>Updated build rules for .deb. Partly based on patch from djcj.
</li
>
1468 <p
>The latest edition is tagged and available from
1469 <a href=
"https://codeberg.org/pere/chrpath
">https://codeberg.org/pere/chrpath
</a
>.
1471 <p
>As usual, if you use Bitcoin and want to show your support of my
1472 activities, please send Bitcoin donations to my address
1473 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1478 <title>Test framework for DocBook processors / formatters
</title>
1479 <link>http://www.hungry.com/~pere/blog/Test_framework_for_DocBook_processors___formatters.html
</link>
1480 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Test_framework_for_DocBook_processors___formatters.html
</guid>
1481 <pubDate>Sun,
5 Nov
2023 13:
00:
00 +
0100</pubDate>
1482 <description><p
>All the books I have published so far has been using
1483 <a href=
"https://docbook.org/
">DocBook
</a
> somewhere in the process.
1484 For the first book, the source format was DocBook, while for every
1485 later book it was an intermediate format used as the stepping stone to
1486 be able to present the same manuscript in several formats, on paper,
1487 as ebook in ePub format, as a HTML page and as a PDF file either for
1488 paper production or for Internet consumption. This is made possible
1489 with a wide variety of free software tools with DocBook support in
1490 Debian. The source format of later books have been docx via rst,
1491 Markdown, Filemaker and Asciidoc, and for all of these I was able to
1492 generate a suitable DocBook file for further processing using
1493 <a href=
"https://tracker.debian.org/pkg/pandoc
">pandoc
</a
>,
1494 <a href=
"https://tracker.debian.org/pkg/asciidoc
">a2x
</a
> and
1495 <a href=
"https://tracker.debian.org/pkg/asciidoctor
">asciidoctor
</a
>,
1496 as well as rendering using
1497 <a href=
"https://tracker.debian.org/pkg/xmlto
">xmlto
</a
>,
1498 <a href=
"https://tracker.debian.org/pkg/dbtoepub
">dbtoepub
</a
>,
1499 <a href=
"https://tracker.debian.org/pkg/dblatex
">dblatex
</a
>,
1500 <a href=
"https://tracker.debian.org/pkg/docbook-xsl
">docbook-xsl
</a
> and
1501 <a href=
"https://tracker.debian.org/pkg/fop
">fop
</a
>.
</p
>
1503 <p
>Most of the
<a href=
"http://www.hungry.com/~pere/publisher/
">books I
1504 have published
</a
> are translated books, with English as the source
1505 language. The use of
1506 <a href=
"https://tracker.debian.org/pkg/po4a
">po4a
</a
> to
1507 handle translations using the gettext PO format has been a blessing,
1508 but publishing translated books had triggered the need to ensure the
1509 DocBook tools handle relevant languages correctly. For every new
1510 language I have published, I had to submit patches dblatex, dbtoepub
1511 and docbook-xsl fixing incorrect language and country specific issues
1512 in the framework themselves. Typically this has been missing keywords
1513 like
'figure
' or sort ordering of index entries. After a while it
1514 became tiresome to only discover issues like this by accident, and I
1515 decided to write a DocBook
"test framework
" exercising various
1516 features of DocBook and allowing me to see all features exercised for
1517 a given language. It consist of a set of DocBook files, a version
4
1518 book, a version
5 book, a v4 book set, a v4 selection of problematic
1519 tables, one v4 testing sidefloat and finally one v4 testing a book of
1520 articles. The DocBook files are accompanied with a set of build rules
1521 for building PDF using dblatex and docbook-xsl/fop, HTML using xmlto
1522 or docbook-xsl and epub using dbtoepub. The result is a set of files
1523 visualizing footnotes, indexes, table of content list, figures,
1524 formulas and other DocBook features, allowing for a quick review on
1525 the completeness of the given locale settings. To build with a
1526 different language setting, all one need to do is edit the lang= value
1527 in the .xml file to pick a different ISO
639 code value and run
1528 'make
'.
</p
>
1530 <p
>The
<a href=
"https://codeberg.org/pere/docbook-example/
">test framework
1531 source code
</a
> is available from Codeberg, and a generated set of
1532 presentations of the various examples is available as Codeberg static
1534 <a href=
"https://pere.codeberg.page/docbook-example/
">https://pere.codeberg.page/docbook-example/
</a
>.
1535 Using this test framework I have been able to discover and report
1536 several bugs and missing features in various tools, and got a lot of
1537 them fixed. For example I got Northern Sami keywords added to both
1538 docbook-xsl and dblatex, fixed several typos in Norwegian bokmål and
1539 Norwegian Nynorsk, support for non-ascii title IDs added to pandoc,
1540 Norwegian index sorting support fixed in xindy and initial Norwegian
1541 Bokmål support added to dblatex. Some issues still remains, though.
1542 Default index sorting rules are still broken in several tools, so the
1543 Norwegian letters æ, ø and å are more often than not sorted properly
1544 in the book index.
</p
>
1546 <p
>The test framework recently received some more polish, as part of
1547 publishing my latest book. This book contained a lot of fairly
1548 complex tables, which exposed bugs in some of the tools. This made me
1549 add a new test file with various tables, as well as spend some time to
1550 brush up the build rules. My goal is for the test framework to
1551 exercise all DocBook features to make it easier to see which features
1552 work with different processors, and hopefully get them all to support
1553 the full set of DocBook features. Feel free to send patches to extend
1554 the test set, and test it with your favorite DocBook processor.
1555 Please visit these two URLs to learn more:
</p
>
1558 <li
><a href=
"https://codeberg.org/pere/docbook-example/
">https://codeberg.org/pere/docbook-example/
</a
></li
>
1559 <li
><a href=
"https://pere.codeberg.page/docbook-example/
">https://pere.codeberg.page/docbook-example/
</a
></li
>
1562 <p
>If you want to learn more on Docbook and translations, I recommend
1563 having a look at the
<a href=
"https://docbook.org/
">the DocBook
1565 <a href=
"https://doccookbook.sourceforge.net/html/en/
">the DoCookBook
1566 site
<a/
> and my earlier blog post on
1567 <a href=
"http://www.hungry.com/~pere/blog/From_English_wiki_to_translated_PDF_and_epub_via_Docbook.html
">how
1568 the Skolelinux project process and translate documentation
</a
>, a talk I gave earlier this year on
1569 <a href=
"https://www.nuug.no/aktiviteter/
20230314-oversetting-og-publisering-av-b%c3%b8ker-med-fri-programvare/
">how
1570 to translate and publish books using free software
</a
> (Norwegian
1575 https://github.com/docbook/xslt10-stylesheets/issues/
205 (docbook-xsl: sme support)
1576 https://bugs.debian.org/
968437 (xindy: index sorting rules for nb/nn)
1577 https://bugs.debian.org/
856123 (pandoc: markdown to docbook with non-english titles)
1578 https://bugs.debian.org/
864813 (dblatex: missing nb words)
1579 https://bugs.debian.org/
756386 (dblatex: index sorting rules for nb/nn)
1580 https://bugs.debian.org/
796871 (dbtoepub: index sorting rules for nb/nn)
1581 https://bugs.debian.org/
792616 (dblatex: PDF metadata)
1582 https://bugs.debian.org/
686908 (docbook-xsl: index sorting rules for nb/nn)
1583 https://sourceforge.net/tracker/?func=detail
&atid=
373747&aid=
3556630&group_id=
21935 (docbook-xsl: nb/nn support)
1584 https://bugs.debian.org/
684391 (dblatex: initial nb support)
1588 <p
>As usual, if you use Bitcoin and want to show your support of my
1589 activities, please send Bitcoin donations to my address
1590 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1595 <title>What did I learn from OpenSnitch this summer?
</title>
1596 <link>http://www.hungry.com/~pere/blog/What_did_I_learn_from_OpenSnitch_this_summer_.html
</link>
1597 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_did_I_learn_from_OpenSnitch_this_summer_.html
</guid>
1598 <pubDate>Sun,
11 Jun
2023 08:
30:
00 +
0200</pubDate>
1599 <description><p
>With yesterdays
1600 <a href=
"https://www.debian.org/News/
2023/
20230610">release of Debian
1601 12 Bookworm
</a
>, I am happy to know the
1602 <a href=
"https://tracker.debian.org/pkg/opensnitch
">the interactive
1603 application firewall OpenSnitch
</a
> is available for a wider audience.
1604 I have been running it for a few weeks now, and have been surprised
1605 about some of the programs connecting to the Internet. Some programs
1606 are obviously calling out from my machine, like the NTP network based
1607 clock adjusting system and Tor to reach other Tor clients, but others
1608 were more dubious. For example, the KDE Window manager try to look up
1609 the host name in DNS, for no apparent reason, but if this lookup is
1610 blocked the KDE desktop get periodically stuck when I use it. Another
1611 surprise was how much Firefox call home directly to mozilla.com,
1612 mozilla.net and googleapis.com, to mention a few, when I visit other
1613 web pages. This direct connection happen even if I told Firefox to
1614 always use a proxy, and the proxy setting is ignored for this traffic.
1615 Other surprising connections come from audacity and dirmngr (I do not
1616 use Gnome). It took some trial and error to get a good default set of
1617 permissions. Without it, I would get popups asking for permissions at
1618 any time, also the most inconvenient ones where I am in the middle of
1619 a time sensitive gaming session.
</p
>
1621 <p
>I suspect some application developers should rethink when then need
1622 to use network connections or DNS lookups, and recommend testing
1623 OpenSnitch (only
<tt
>apt install opensnitch
</tt
> away in Debian
1624 Bookworm) to locate and report any surprising Internet connections on
1625 your desktop machine.
</p
>
1627 <p
>At the moment the upstream developer and Debian package maintainer
1628 is working on making the system more reliable in Debian, by enabling
1629 the eBPF kernel module to track processes and connections instead of
1630 depending in content in /proc/. This should enter unstable fairly
1633 <p
>As usual, if you use Bitcoin and want to show your support of my
1634 activities, please send Bitcoin donations to my address
1635 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1637 <p
><strong
>Update
2023-
06-
12</strong
>: I got a tip about
1638 <a href=
"https://wiki.debian.org/PrivacyIssues
">a list of privacy
1639 issues in Free Software
</a
> and the
1640 <a href=
"irc://irc.debian.org/%
23debian-privacy
">#debian-privacy IRC
1641 channel
</a
> discussing these topics.
</p
>
1647 <title>wmbusmeters, parse data from your utility meter - nice free software
</title>
1648 <link>http://www.hungry.com/~pere/blog/wmbusmeters__parse_data_from_your_utility_meter___nice_free_software.html
</link>
1649 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/wmbusmeters__parse_data_from_your_utility_meter___nice_free_software.html
</guid>
1650 <pubDate>Fri,
19 May
2023 21:
50:
00 +
0200</pubDate>
1651 <description><p
>There is a European standard for reading utility meters like water,
1652 gas, electricity or heat distribution meters. The
1653 <a href=
"https://en.wikipedia.org/wiki/Meter-Bus
">Meter-Bus standard
1654 (EN
13757-
2, EN
13757-
3 and EN
13757–
4)
</a
> provide a cross vendor way
1655 to talk to and collect meter data. I ran into this standard when I
1656 wanted to monitor some heat distribution meters, and managed to find
1657 free software that could do the job. The meters in question broadcast
1658 encrypted messages with meter information via radio, and the hardest
1659 part was to track down the encryption keys from the vendor. With this
1660 in place I could set up a MQTT gateway to submit the meter data for
1663 <p
>The free software systems in question,
1664 <a href=
"https://tracker.debian.org/pkg/rtl-wmbus
">rtl-wmbus
</a
> to
1665 read the messages from a software defined radio, and
1666 <a href=
"https://tracker.debian.org/pkg/wmbusmeters
">wmbusmeters
</a
> to
1667 decrypt and decode the content of the messages, is working very well
1668 and allowe me to get frequent updates from my meters. I got in touch
1669 with upstream last year to see if there was any interest in publishing
1670 the packages via Debian. I was very happy to learn that Fredrik
1671 Öhrström volunteered to maintain the packages, and I have since
1672 assisted him in getting Debian package build rules in place as well as
1673 sponsoring the packages into the Debian archive. Sadly we completed
1674 it too late for them to become part of the next stable Debian release
1675 (Bookworm). The wmbusmeters package just cleared the NEW queue. It
1676 will need some work to fix a built problem, but I expect Fredrik will
1677 find a solution soon.
</p
>
1679 <p
>If you got a infrastructure meter supporting the Meter Bus
1680 standard, I strongly recommend having a look at these nice
1683 <p
>As usual, if you use Bitcoin and want to show your support of my
1684 activities, please send Bitcoin donations to my address
1685 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1690 <title>The
2023 LinuxCNC Norwegian developer gathering
</title>
1691 <link>http://www.hungry.com/~pere/blog/The_2023_LinuxCNC_Norwegian_developer_gathering.html
</link>
1692 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_2023_LinuxCNC_Norwegian_developer_gathering.html
</guid>
1693 <pubDate>Sun,
14 May
2023 20:
30:
00 +
0200</pubDate>
1694 <description><p
>The LinuxCNC project is making headway these days. A lot of
1695 patches and issues have seen activity on
1696 <a href=
"https://github.com/LinuxCNC/linuxcnc/
">the project github
1697 pages
</a
> recently. A few weeks ago there was a developer gathering
1698 over at the
<a href=
"https://tormach.com/
">Tormach
</a
> headquarter in
1699 Wisconsin, and now we are planning a new gathering in Norway. If you
1700 wonder what LinuxCNC is, lets quote Wikipedia:
</p
>
1703 "LinuxCNC is a software system for numerical control of
1704 machines such as milling machines, lathes, plasma cutters, routers,
1705 cutting machines, robots and hexapods. It can control up to
9 axes or
1706 joints of a CNC machine using G-code (RS-
274NGC) as input. It has
1707 several GUIs suited to specific kinds of usage (touch screen,
1708 interactive development).
"
1711 <p
>The Norwegian developer gathering take place the weekend June
16th
1712 to
18th this year, and is open for everyone interested in contributing
1713 to LinuxCNC. Up to date information about the gathering can be found
1715 <a href=
"https://sourceforge.net/p/emc/mailman/emc-developers/thread/sa64jp06nob.fsf%
40hjemme.reinholdtsen.name/#msg37837251
">the
1716 developer mailing list thread
</a
> where the gathering was announced.
1717 Thanks to the good people at
1718 <a href=
"https://www.debian.org/
">Debian
</a
>,
1719 <a href=
"https://www.redpill-linpro.com/
">Redpill-Linpro
</a
> and
1720 <a href=
"https://www.nuugfoundation.no/no/
">NUUG Foundation
</a
>, we
1721 have enough sponsor funds to pay for food, and shelter for the people
1722 traveling from afar to join us. If you would like to join the
1723 gathering, get in touch.
</p
>
1725 <p
>As usual, if you use Bitcoin and want to show your support of my
1726 activities, please send Bitcoin donations to my address
1727 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1732 <title>OpenSnitch in Debian ready for prime time
</title>
1733 <link>http://www.hungry.com/~pere/blog/OpenSnitch_in_Debian_ready_for_prime_time.html
</link>
1734 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/OpenSnitch_in_Debian_ready_for_prime_time.html
</guid>
1735 <pubDate>Sat,
13 May
2023 12:
10:
00 +
0200</pubDate>
1736 <description><p
>A bit delayed,
1737 <a href=
"https://tracker.debian.org/pkg/opensnitch
">the interactive
1738 application firewall OpenSnitch
</a
> package in Debian now got the
1739 latest fixes ready for Debian Bookworm. Because it depend on a
1740 package missing on some architectures, the autopkgtest check of the
1741 testing migration script did not understand that the tests were
1742 actually working, so the migration was delayed. A bug in the package
1743 dependencies is also fixed, so those installing the firewall package
1744 (opensnitch) now also get the GUI admin tool (python3-opensnitch-ui)
1745 installed by default. I am very grateful to Gustavo Iñiguez Goya for
1746 his work on getting the package ready for Debian Bookworm.
</p
>
1748 <p
>Armed with this package I have discovered some surprising
1749 connections from programs I believed were able to work completly
1750 offline, and it has already proven its worth, at least to me. If you
1751 too want to get more familiar with the kind of programs using
1752 Internett connections on your machine, I recommend testing
<tt
>apt
1753 install opensnitch
</tt
> in Bookworm and see what you think.
</p
>
1755 <p
>The package is still not able to build its eBPF module within
1756 Debian. Not sure how much work it would be to get it working, but
1757 suspect some kernel related packages need to be extended with more
1758 header files to get it working.
</p
>
1760 <p
>As usual, if you use Bitcoin and want to show your support of my
1761 activities, please send Bitcoin donations to my address
1762 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1767 <title>Speech to text, she APTly whispered, how hard can it be?
</title>
1768 <link>http://www.hungry.com/~pere/blog/Speech_to_text__she_APTly_whispered__how_hard_can_it_be_.html
</link>
1769 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Speech_to_text__she_APTly_whispered__how_hard_can_it_be_.html
</guid>
1770 <pubDate>Sun,
23 Apr
2023 09:
40:
00 +
0200</pubDate>
1771 <description><p
>While visiting a convention during Easter, it occurred to me that
1772 it would be great if I could have a digital Dictaphone with
1773 transcribing capabilities, providing me with texts to cut-n-paste into
1774 stuff I need to write. The background is that long drives often bring
1775 up the urge to write on texts I am working on, which of course is out
1776 of the question while driving. With the release of
1777 <a href=
"https://github.com/openai/whisper/
">OpenAI Whisper
</a
>, this
1778 seem to be within reach with Free Software, so I decided to give it a
1779 go. OpenAI Whisper is a Linux based neural network system to read in
1780 audio files and provide text representation of the speech in that
1781 audio recording. It handle multiple languages and according to its
1782 creators even can translate into a different language than the spoken
1783 one. I have not tested the latter feature. It can either use the CPU
1784 or a GPU with CUDA support. As far as I can tell, CUDA in practice
1785 limit that feature to NVidia graphics cards. I have few of those, as
1786 they do not work great with free software drivers, and have not tested
1787 the GPU option. While looking into the matter, I did discover some
1788 work to provide CUDA support on non-NVidia GPUs, and some work with
1789 the library used by Whisper to port it to other GPUs, but have not
1790 spent much time looking into GPU support yet. I
've so far used an old
1791 X220 laptop as my test machine, and only transcribed using its
1794 <p
>As it from a privacy standpoint is unthinkable to use computers
1795 under control of someone else (aka a
"cloud
" service) to transcribe
1796 ones thoughts and personal notes, I want to run the transcribing
1797 system locally on my own computers. The only sensible approach to me
1798 is to make the effort I put into this available for any Linux user and
1799 to upload the needed packages into Debian. Looking at Debian Bookworm, I
1800 discovered that only three packages were missing,
1801 <a href=
"https://bugs.debian.org/
1034307">tiktoken
</a
>,
1802 <a href=
"https://bugs.debian.org/
1034144">triton
</a
>, and
1803 <a href=
"https://bugs.debian.org/
1034091">openai-whisper
</a
>. For a while
1805 <a href=
"https://bugs.debian.org/
1034286">ffmpeg-python
</a
> was
1807 <a href=
"https://github.com/kkroening/ffmpeg-python/issues/
760">upstream
1808 seem to have vanished
</a
> I found it safer
1809 <a href=
"https://github.com/openai/whisper/pull/
1242">to rewrite
1810 whisper
</a
> to stop depending on in than to introduce ffmpeg-python
1811 into Debian. I decided to place these packages under the umbrella of
1812 <a href=
"https://salsa.debian.org/deeplearning-team
">the Debian Deep
1813 Learning Team
</a
>, which seem like the best team to look after such
1814 packages. Discussing the topic within the group also made me aware
1815 that the triton package was already a future dependency of newer
1816 versions of the torch package being planned, and would be needed after
1817 Bookworm is released.
</p
>
1819 <p
>All required code packages have been now waiting in
1820 <a href=
"https://ftp-master.debian.org/new.html
">the Debian NEW
1821 queue
</a
> since Wednesday, heading for Debian Experimental until
1822 Bookworm is released. An unsolved issue is how to handle the neural
1823 network models used by Whisper. The default behaviour of Whisper is
1824 to require Internet connectivity and download the model requested to
1825 <tt
>~/.cache/whisper/
</tt
> on first invocation. This obviously would
1826 fail
<a href=
"https://people.debian.org/~bap/dfsg-faq.html
">the
1827 deserted island test of free software
</a
> as the Debian packages would
1828 be unusable for someone stranded with only the Debian archive and solar
1829 powered computer on a deserted island.
</p
>
1831 <p
>Because of this, I would love to include the models in the Debian
1832 mirror system. This is problematic, as the models are very large
1833 files, which would put a heavy strain on the Debian mirror
1834 infrastructure around the globe. The strain would be even higher if
1835 the models change often, which luckily as far as I can tell they do
1836 not. The small model, which according to its creator is most useful
1837 for English and in my experience is not doing a great job there
1838 either, is
462 MiB (deb is
414 MiB). The medium model, which to me
1839 seem to handle English speech fairly well is
1.5 GiB (deb is
1.3 GiB)
1840 and the large model is
2.9 GiB (deb is
2.6 GiB). I would assume
1841 everyone with enough resources would prefer to use the large model for
1842 highest quality. I believe the models themselves would have to go
1843 into the non-free part of the Debian archive, as they are not really
1844 including any useful source code for updating the models. The
1845 "source
", aka the model training set, according to the creators
1846 consist of
"680,
000 hours of multilingual and multitask supervised
1847 data collected from the web
", which to me reads material with both
1848 unknown copyright terms, unavailable to the general public. In other
1849 words, the source is not available according to the Debian Free
1850 Software Guidelines and the model should be considered non-free.
</p
>
1852 <p
>I asked the Debian FTP masters for advice regarding uploading a
1853 model package on their IRC channel, and based on the feedback there it
1854 is still unclear to me if such package would be accepted into the
1855 archive. In any case I wrote build rules for a
1856 <a href=
"https://salsa.debian.org/deeplearning-team/openai-whisper-model
">OpenAI
1857 Whisper model package
</a
> and
1858 <a href=
"https://github.com/openai/whisper/pull/
1257">modified the
1859 Whisper code base
</a
> to prefer shared files under
<tt
>/usr/
</tt
> and
1860 <tt
>/var/
</tt
> over user specific files in
<tt
>~/.cache/whisper/
</tt
>
1861 to be able to use these model packages, to prepare for such
1862 possibility. One solution might be to include only one of the models
1863 (small or medium, I guess) in the Debian archive, and ask people to
1864 download the others from the Internet. Not quite sure what to do
1865 here, and advice is most welcome (use the debian-ai mailing list).
</p
>
1867 <p
>To make it easier to test the new packages while I wait for them to
1868 clear the NEW queue, I created an APT source targeting bookworm. I
1869 selected Bookworm instead of Bullseye, even though I know the latter
1870 would reach more users, is that some of the required dependencies are
1871 missing from Bullseye and I during this phase of testing did not want
1872 to backport a lot of packages just to get up and running.
</p
>
1874 <p
>Here is a recipe to run as user root if you want to test OpenAI
1875 Whisper using Debian packages on your Debian Bookworm installation,
1876 first adding the APT repository GPG key to the list of trusted keys,
1877 then setting up the APT repository and finally installing the packages
1878 and one of the models:
</p
>
1880 <p
><pre
>
1881 curl https://geekbay.nuug.no/~pere/openai-whisper/D78F5C4796F353D211B119E28200D9B589641240.asc \
1882 -o /etc/apt/trusted.gpg.d/pere-whisper.asc
1883 mkdir -p /etc/apt/sources.list.d
1884 cat
> /etc/apt/sources.list.d/pere-whisper.list
&lt;
&lt;EOF
1885 deb https://geekbay.nuug.no/~pere/openai-whisper/ bookworm main
1886 deb-src https://geekbay.nuug.no/~pere/openai-whisper/ bookworm main
1889 apt install openai-whisper
1890 </pre
></p
>
1892 <p
>The package work for me, but have not yet been tested on any other
1893 computer than my own. With it, I have been able to (badly) transcribe
1894 a
2 minute
40 second Norwegian audio clip to test using the small
1895 model. This took
11 minutes and around
2.2 GiB of RAM. Transcribing
1896 the same file with the medium model gave a accurate text in
77 minutes
1897 using around
5.2 GiB of RAM. My test machine had too little memory to
1898 test the large model, which I believe require
11 GiB of RAM. In
1899 short, this now work for me using Debian packages, and I hope it will
1900 for you and everyone else once the packages enter Debian.
</p
>
1902 <p
>Now I can start on the audio recording part of this project.
</p
>
1904 <p
>As usual, if you use Bitcoin and want to show your support of my
1905 activities, please send Bitcoin donations to my address
1906 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1911 <title>rtlsdr-scanner, software defined radio frequency scanner for Linux - nice free software
</title>
1912 <link>http://www.hungry.com/~pere/blog/rtlsdr_scanner__software_defined_radio_frequency_scanner_for_Linux____nice_free_software.html
</link>
1913 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/rtlsdr_scanner__software_defined_radio_frequency_scanner_for_Linux____nice_free_software.html
</guid>
1914 <pubDate>Fri,
7 Apr
2023 23:
10:
00 +
0200</pubDate>
1915 <description><p
>Today I finally found time to track down a useful radio frequency
1916 scanner for my software defined radio. Just for fun I tried to locate
1917 the radios used in the areas, and a good start would be to scan all
1918 the frequencies to see what is in use. I
've tried to find a useful
1919 program earlier, but ran out of time before I managed to find a useful
1920 tool. This time I was more successful, and after a few false leads I
1921 found a description of
1922 <a href=
"https://www.kali.org/tools/rtlsdr-scanner/
">rtlsdr-scanner
1923 over at the Kali site
</a
>, and was able to track down
1924 <a href=
"https://gitlab.com/kalilinux/packages/rtlsdr-scanner.git
">the
1925 Kali package git repository
</a
> to build a deb package for the
1926 scanner. Sadly the package is missing from the Debian project itself,
1927 at least in Debian Bullseye. Two runtime dependencies,
1928 <a href=
"https://gitlab.com/kalilinux/packages/python-visvis.git
">python-visvis
</a
>
1930 <a href=
"https://gitlab.com/kalilinux/packages/python-rtlsdr.git
">python-rtlsdr
</a
>
1931 had to be built and installed separately. Luckily
'<tt
>gbp
1932 buildpackage
</tt
>' handled them just fine and no further packages had
1933 to be manually built. The end result worked out of the box after
1934 installation.
</p
>
1936 <p
>My initial scans for FM channels worked just fine, so I knew the
1937 scanner was functioning. But when I tried to scan every frequency
1938 from
100 to
1000 MHz, the program stopped unexpectedly near the
1939 completion. After some debugging I discovered USB software radio I
1940 used rejected frequencies above
948 MHz, triggering a unreported
1941 exception breaking the scan. Changing the scan to end at
957 worked
1942 better. I similarly found the lower limit to be around
15, and ended
1943 up with the following full scan:
</p
>
1945 <p
><a href=
"http://www.hungry.com/~pere/blog/images/
2023-
04-
07-radio-freq-scanning.png
"><img src=
"http://www.hungry.com/~pere/blog/images/
2023-
04-
07-radio-freq-scanning.png
" width=
"100%
"></a
></p
>
1947 <p
>Saving the scan did not work, but exporting it as a CSV file worked
1948 just fine. I ended up with around
477k CVS lines with dB level for
1949 the given frequency.
</p
>
1951 <p
>The save failure seem to be a missing UTF-
8 encoding issue in the
1952 python code. Will see if I can find time to send a patch
1953 <a href=
"https://github.com/CdeMills/RTLSDR-Scanner/
">upstream
</a
>
1954 later to fix this exception:
</p
>
1957 Traceback (most recent call last):
1958 File
"/usr/lib/python3/dist-packages/rtlsdr_scanner/main_window.py
", line
485, in __on_save
1959 save_plot(fullName, self.scanInfo, self.spectrum, self.locations)
1960 File
"/usr/lib/python3/dist-packages/rtlsdr_scanner/file.py
", line
408, in save_plot
1961 handle.write(json.dumps(data, indent=
4))
1962 TypeError: a bytes-like object is required, not
'str
'
1963 Traceback (most recent call last):
1964 File
"/usr/lib/python3/dist-packages/rtlsdr_scanner/main_window.py
", line
485, in __on_save
1965 save_plot(fullName, self.scanInfo, self.spectrum, self.locations)
1966 File
"/usr/lib/python3/dist-packages/rtlsdr_scanner/file.py
", line
408, in save_plot
1967 handle.write(json.dumps(data, indent=
4))
1968 TypeError: a bytes-like object is required, not
'str
'
1971 <p
>As usual, if you use Bitcoin and want to show your support of my
1972 activities, please send Bitcoin donations to my address
1973 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1978 <title>OpenSnitch available in Debian Sid and Bookworm
</title>
1979 <link>http://www.hungry.com/~pere/blog/OpenSnitch_available_in_Debian_Sid_and_Bookworm.html
</link>
1980 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/OpenSnitch_available_in_Debian_Sid_and_Bookworm.html
</guid>
1981 <pubDate>Sat,
25 Feb
2023 20:
30:
00 +
0100</pubDate>
1982 <description><p
>Thanks to the efforts of the OpenSnitch lead developer Gustavo
1983 Iñiguez Goya allowing me to sponsor the upload,
1984 <a href=
"https://tracker.debian.org/pkg/opensnitch
">the interactive
1985 application firewall OpenSnitch
</a
> is now available in Debian
1986 Testing, soon to become the next stable release of Debian.
</p
>
1988 <p
>This is a package which set up a network firewall on one or more
1989 machines, which is controlled by a graphical user interface that will
1990 ask the user if a program should be allowed to connect to the local
1991 network or the Internet. If some background daemon is trying to dial
1992 home, it can be blocked from doing so with a simple mouse click, or by
1993 default simply by not doing anything when the GUI question dialog pop
1994 up. A list of all programs discovered using the network is provided
1995 in the GUI, giving the user an overview of how the machine(s) programs
1996 use the network.
</p
>
1998 <p
>OpenSnitch was uploaded for NEW processing about a month ago, and I
1999 had little hope of it getting accepted and shaping up in time for the
2000 package freeze, but the Debian ftpmasters proved to be amazingly quick
2001 at checking out the package and it was accepted into the archive about
2002 week after the first upload. It is now team maintained under the Go
2003 language team umbrella. A few fixes to the default setup is only in
2004 Sid, and should migrate to Testing/Bookworm in a week.
</p
>
2006 <p
>During testing I ran into an
2007 <a href=
"https://github.com/evilsocket/opensnitch/issues/
813">issue
2008 with Minecraft server broadcasts disappearing
</a
>, which was quickly
2009 resolved by the developer with a patch and a proposed configuration
2010 change. I
've been told this was caused by the Debian packages default
2011 use if /proc/ information to track down kernel status, instead of the
2012 newer eBPF module that can be used. The reason is simply that
2013 upstream and I have failed to find a way to build the eBPF modules for
2014 OpenSnitch without a complete configured Linux kernel source tree,
2015 which as far as we can tell is unavailable as a build dependency in
2016 Debian. We tried unsuccessfully so far to use the kernel-headers
2017 package. It would be great if someone could provide some clues how to
2018 build eBPF modules on build daemons in Debian, possibly without the full
2019 kernel source.
</p
>
2021 <p
>As usual, if you use Bitcoin and want to show your support of my
2022 activities, please send Bitcoin donations to my address
2023 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2028 <title>Is the desktop recommending your program for opening its files?
</title>
2029 <link>http://www.hungry.com/~pere/blog/Is_the_desktop_recommending_your_program_for_opening_its_files_.html
</link>
2030 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Is_the_desktop_recommending_your_program_for_opening_its_files_.html
</guid>
2031 <pubDate>Sun,
29 Jan
2023 11:
00:
00 +
0100</pubDate>
2032 <description><p
>Linux desktop systems
2033 <a href=
"https://specifications.freedesktop.org/basedir-spec/basedir-spec-latest.html
">have
2034 standardized
</a
> how programs present themselves to the desktop
2035 system. If a package include a .desktop file in
2036 /usr/share/applications/, Gnome, KDE, LXDE, Xfce and the other desktop
2037 environments will pick up the file and use its content to generate the
2038 menu of available programs in the system. A lesser known fact is that
2039 a package can also explain to the desktop system how to recognize the
2040 files created by the program in question, and use it to open these
2041 files on request, for example via a GUI file browser.
</p
>
2043 <p
>A while back I ran into a package that did not tell the desktop
2044 system how to recognize its files and was not used to open its files
2045 in the file browser and fixed it. In the process I wrote a simple
2046 debian/tests/ script to ensure the setup keep working. It might be
2047 useful for other packages too, to ensure any future version of the
2048 package keep handling its own files.
</p
>
2050 <p
>For this to work the file format need a useful MIME type that can
2051 be used to identify the format. If the file format do not yet have a
2052 MIME type, it should define one and preferably also
2053 <a href=
"https://www.iana.org/assignments/media-types/media-types.xhtml
">register
2054 it with IANA
</a
> to ensure the MIME type string is reserved.
</p
>
2056 <p
>The script uses the
<tt
>xdg-mime
</tt
> program from xdg-utils to
2057 query the database of standardized package information and ensure it
2058 return sensible values. It also need the location of an example file
2059 for xdg-mime to guess the format of.
</p
>
2064 # Author: Petter Reinholdtsen
2065 # License: GPL v2 or later at your choice.
2067 # Validate the MIME setup, making sure motor types have
2068 # application/vnd.openmotor+yaml associated with them and is connected
2069 # to the openmotor desktop file.
2073 mimetype=
"application/vnd.openmotor+yaml
"
2074 testfile=
"test/data/real/o3100/motor.ric
"
2075 mydesktopfile=
"openmotor.desktop
"
2077 filemime=
"$(xdg-mime query filetype
"$testfile
")
"
2079 if [
"$mimetype
" !=
"$filemime
" ] ; then
2081 echo
"error: xdg-mime claim motor file MIME type is $filemine, not $mimetype
"
2083 echo
"success: xdg-mime report correct mime type $mimetype for motor file
"
2086 desktop=$(xdg-mime query default
"$mimetype
")
2088 if [
"$mydesktopfile
" !=
"$desktop
" ]; then
2090 echo
"error: xdg-mime claim motor file should be handled by $desktop, not $mydesktopfile
"
2092 echo
"success: xdg-mime agree motor file should be handled by $mydesktopfile
"
2098 <p
>It is a simple way to ensure your users are not very surprised when
2099 they try to open one of your file formats in their file browser.
</p
>
2101 <p
>As usual, if you use Bitcoin and want to show your support of my
2102 activities, please send Bitcoin donations to my address
2103 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2108 <title>Opensnitch, the application level interactive firewall, heading into the Debian archive
</title>
2109 <link>http://www.hungry.com/~pere/blog/Opensnitch__the_application_level_interactive_firewall__heading_into_the_Debian_archive.html
</link>
2110 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Opensnitch__the_application_level_interactive_firewall__heading_into_the_Debian_archive.html
</guid>
2111 <pubDate>Sun,
22 Jan
2023 23:
55:
00 +
0100</pubDate>
2112 <description><p
>While reading a
2113 <a href=
"https://sneak.berlin/
20230115/macos-scans-your-local-files-now/
">blog
2114 post claiming MacOS X recently started scanning local files and
2115 reporting information about them to Apple
</a
>, even on a machine where
2116 all such callback features had been disabled, I came across a
2117 description of the Little Snitch application for MacOS X. It seemed
2118 like a very nice tool to have in the tool box, and I decided to see if
2119 something similar was available for Linux.
</p
>
2121 <p
>It did not take long to find
2122 <a href=
"https://github.com/evilsocket/opensnitch
">the OpenSnitch
2123 package
</a
>, which has been in development since
2017, and now is in
2124 version
1.5.0. It has had a
2125 <a href=
"https://bugs.debian.org/
909567">request for Debian
2126 packaging
</a
> since
2018, but no-one completed the job so far. Just
2127 for fun, I decided to see if I could help, and I was very happy to
2129 <a href=
"https://github.com/evilsocket/opensnitch/issues/
304">upstream
2130 want a Debian package too
</a
>.
</p
>
2132 <p
>After struggling a bit with getting the program to run, figuring
2133 out building Go programs (and a little failed detour to look at eBPF
2134 builds too - help needed), I am very happy to report that I am
2135 sponsoring upstream to maintain the package in Debian, and it has
2136 since this morning been waiting in NEW for the ftpmasters to have a
2137 look. Perhaps it can get into the archive in time for the Bookworm
2140 <p
>As usual, if you use Bitcoin and want to show your support of my
2141 activities, please send Bitcoin donations to my address
2142 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2147 <title>LinuxCNC MQTT publisher component
</title>
2148 <link>http://www.hungry.com/~pere/blog/LinuxCNC_MQTT_publisher_component.html
</link>
2149 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/LinuxCNC_MQTT_publisher_component.html
</guid>
2150 <pubDate>Sun,
8 Jan
2023 19:
30:
00 +
0100</pubDate>
2151 <description><p
>I watched
<a href=
"https://yewtu.be/watch?v=jmKUV3aNLjk
">a
2015
2152 video from Andreas Schiffler
</a
> the other day, where he set up
2153 <a href=
"https://linuxcnc.org/
">LinuxCNC
</a
> to send status
2154 information to the MQTT broker IBM Bluemix. As I also use MQTT for
2155 graphing, it occured to me that a generic MQTT LinuxCNC component
2156 would be useful and I set out to implement it. Today I got the first
2157 draft limping along and submitted as
2158 <a href=
"https://github.com/LinuxCNC/linuxcnc/pull/
2253">a patch to the
2159 LinuxCNC project
</a
>.
</p
>
2161 <p
>The simple part was setting up the MQTT publishing code in Python.
2162 I already have set up other parts submitting data to my Mosquito MQTT
2163 broker, so I could reuse that code. Writing a LinuxCNC component in
2164 Python as new to me, but using existing examples in the code
2165 repository and the extensive documentation, this was fairly straight
2166 forward. The hardest part was creating a automated test for the
2167 component to ensure it was working. Testing it in a simulated
2168 LinuxCNC machine proved very useful, as I discovered features I needed
2169 that I had not thought of yet, and adjusted the code quite a bit to
2170 make it easier to test without a operational MQTT broker
2171 available.
</p
>
2173 <p
>The draft is ready and working, but I am unsure which LinuxCNC HAL
2174 pins I should collect and publish by default (in other words, the
2175 default set of information pieces published), and how to get the
2176 machine name from the LinuxCNC INI file. The latter is a minor
2177 detail, but I expect it would be useful in a setup with several
2178 machines available. I am hoping for feedback from the experienced
2179 LinuxCNC developers and users, to make the component even better
2180 before it can go into the mainland LinuxCNC code base.
</p
>
2182 <p
>Since I started on the MQTT component, I came across
2183 <a href=
"https://yewtu.be/watch?v=Bqa2grG0XtA
">another video from Kent
2184 VanderVelden
</a
> where he combine LinuxCNC with a set of screen glasses
2185 controlled by a Raspberry Pi, and it occured to me that it would
2186 be useful for such use cases if LinuxCNC also provided a REST API for
2187 querying its status. I hope to start on such component once the MQTT
2188 component is working well.
</p
>
2190 <p
>As usual, if you use Bitcoin and want to show your support of my
2191 activities, please send Bitcoin donations to my address
2192 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2197 <title>ONVIF IP camera management tool finally in Debian
</title>
2198 <link>http://www.hungry.com/~pere/blog/ONVIF_IP_camera_management_tool_finally_in_Debian.html
</link>
2199 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/ONVIF_IP_camera_management_tool_finally_in_Debian.html
</guid>
2200 <pubDate>Sat,
24 Dec
2022 08:
00:
00 +
0100</pubDate>
2201 <description><p
>Merry Christmas to you all. Here is a small gift to all those with
2202 IP cameras following the
<a href=
"https://www.onvif.org/
">ONVIF
2203 specification
</a
>. There is finally a nice command line and GUI tool
2204 in Debian to manage ONVIF IP cameras. After working with upstream for
2205 a few months and sponsoring the upload, I am very happy to report that
2206 the
<a href=
"https://tracker.debian.org/libonvif
">libonvif package
</a
>
2207 entered Debian Sid last night.
</p
>
2209 <p
>The package provide a C library to communicate with such cameras, a
2210 command line tool to locate and update settings of (like password) the
2211 cameras and a GUI tool to configure and control the units as well as
2212 preview the video from the camera. Libonvif is available on Both
2213 Linux and Windows and the GUI tool uses the Qt library. The main
2214 competitors are non-free software, while libonvif is GNU GPL licensed.
2215 I am very glad Debian users in the future can control their cameras
2216 using a free software system provided by Debian. But the ONVIF world
2217 is full of slightly broken firmware, where the cameras pretend to
2218 follow the ONVIF specification but fail to set some configuration
2219 values or refuse to provide video to more than one recipient at the
2220 time, and the onvif project is quite young and might take a while
2221 before it completely work with your camera. Upstream seem eager to
2222 improve the library, so handling any broken camera might be just
<a
2223 href=
"https://github.com/sr99622/libonvif/
">a bug report away
</a
>.
</p
>
2225 <p
>The package just cleared NEW, and need a new source only upload
2226 before it can enter testing. This will happen in the next few
2229 <p
>As usual, if you use Bitcoin and want to show your support of my
2230 activities, please send Bitcoin donations to my address
2231 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2236 <title>Managing and using ONVIF IP cameras with Linux
</title>
2237 <link>http://www.hungry.com/~pere/blog/Managing_and_using_ONVIF_IP_cameras_with_Linux.html
</link>
2238 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Managing_and_using_ONVIF_IP_cameras_with_Linux.html
</guid>
2239 <pubDate>Wed,
19 Oct
2022 12:
30:
00 +
0200</pubDate>
2240 <description><p
>Recently I have been looking at how to control and collect data
2241 from a handful IP cameras using Linux. I both wanted to change their
2242 settings and to make their imagery available via a free software
2243 service under my control. Here is a summary of the tools I found.
</p
>
2245 <p
>First I had to identify the cameras and their protocols. As far as
2246 I could tell, they were using some SOAP looking protocol and their
2247 internal web server seem to only work with Microsoft Internet Explorer
2248 with some proprietary binary plugin, which in these days of course is
2249 a security disaster and also made it impossible for me to use the
2250 camera web interface. Luckily I discovered that the SOAP looking
2251 protocol is actually following
<a href=
"https://www.onvif.org/
">the
2252 ONVIF specification
</a
>, which seem to be supported by a lot of IP
2253 cameras these days.
</p
>
2255 <p
>Once the protocol was identified, I was able to find what appear to
2256 be the most popular way to configure ONVIF cameras, the free software
2258 <a href=
"https://sourceforge.net/projects/onvifdm/
">ONVIF Device
2259 Manager
</a
>. Lacking any other options at the time, I tried
2260 unsuccessfully to get it running using Wine, but was missing a dotnet
2261 40 library and I found no way around it to run it on Linux.
</p
>
2263 <p
>The next tool I found to configure the cameras were a non-free Linux Qt
2264 client
<a href=
"https://www.lingodigit.com/onvif_nvcdemo.html
">ONVIF
2265 Device Tool
</a
>. I did not like its terms of use, so did not spend
2266 much time on it.
</p
>
2268 <p
>To collect the video and make it available in a web interface, I
2269 found the Zoneminder tool in Debian. A recent version was able to
2270 automatically detect and configure ONVIF devices, so I could use it to
2271 set up motion detection in and collection of the camera output. I had
2272 initial problems getting the ONVIF autodetection to work, as both
2273 Firefox and Chromium
<a href=
"https://bugs.debian.org/
1001188">refused
2274 the inter-tab communication
</a
> being used by the Zoneminder web
2275 pages, but managed to get konqueror to work. Apparently the
"Enhanced
2276 Tracking Protection
" in Firefox cause the problem. I ended up
2277 upgrading to the Bookworm edition of Zoneminder in the process to try
2278 to fix the issue, and believe the problem might be solved now.
</p
>
2280 <p
>In the process I came across the nice Linux GUI tool
2281 <a href=
"https://gitlab.com/caspermeijn/onvifviewer/
">ONVIF Viewer
</a
>
2282 allowing me to preview the camera output and validate the login
2283 passwords required. Sadly its author has grown tired of maintaining
2284 the software, so it might not see any future updates. Which is sad,
2285 as the viewer is sightly unstable and the picture tend to lock up.
2286 Note, this lockup might be due to limitations in the cameras and not
2287 the viewer implementation. I suspect the camera is only able to
2288 provide pictures to one client at the time, and the Zoneminder feed
2289 might interfere with the GUI viewer. I have
2290 <a href=
"https://bugs.debian.org/
1000820">asked for the tool to be
2291 included in Debian
</a
>.
</p
>
2293 <p
>Finally, I found what appear to be very nice Linux free software
2294 replacement for the Windows tool, named
2295 <a href=
"https://github.com/sr99622/libonvif/
">libonvif
</a
>. It
2296 provide a C library to talk to ONVIF devices as well as a command line
2297 and GUI tool using the library. Using the GUI tool I was able to change
2298 the admin passwords and update other settings of the cameras. I have
2299 <a href=
"https://bugs.debian.org/
1021980">asked for the package to be
2300 included in Debian
</a
>.
</p
>
2302 <p
>As usual, if you use Bitcoin and want to show your support of my
2303 activities, please send Bitcoin donations to my address
2304 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2306 <p
><strong
>Update
2022-
10-
20</strong
>: Since my initial publication of
2307 this text, I got several suggestions for more free software Linux
2308 tools. There is
<a href=
"https://github.com/quatanium/python-onvif
">a
2309 ONVIF python library
</a
> (already
2310 <a href=
"https://bugs.debian.org/
824240">requested into Debian
</a
>) and
2311 <a href=
"https://github.com/FalkTannhaeuser/python-onvif-zeep
">a python
3
2312 fork
</a
> using a different SOAP dependency. There is also
2313 <a href=
"https://www.home-assistant.io/integrations/onvif/
">support for
2314 ONVIF in Home Assistant
</a
>, and there is an alternative to Zoneminder
2315 called
<a href=
"https://www.shinobi.video/
">Shinobi
</a
>. The latter
2316 two are not included in Debian either. I have not tested any of these
2322 <title>Time to translate the Bullseye edition of the Debian Administrator
's Handbook
</title>
2323 <link>http://www.hungry.com/~pere/blog/Time_to_translate_the_Bullseye_edition_of_the_Debian_Administrator_s_Handbook.html
</link>
2324 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Time_to_translate_the_Bullseye_edition_of_the_Debian_Administrator_s_Handbook.html
</guid>
2325 <pubDate>Mon,
12 Sep
2022 15:
45:
00 +
0200</pubDate>
2326 <description><p align=
"center
"><img align=
"center
" src=
"http://www.hungry.com/~pere/blog/images/
2020-
10-
20-debian-handbook-nb-testprint.jpeg
" width=
"60%
"/
></p
>
2328 <p
>(The picture is of the previous edition.)
</p
>
2330 <p
>Almost two years after the previous Norwegian Bokmål translation of
2331 the
"<a href=
"https://debian-handbook.info/
">The Debian Administrator
's
2332 Handbook
</a
>" was published, a new edition is finally being prepared. The
2333 english text is updated, and it is time to start working on the
2334 translations. Around
37 percent of the strings have been updated, one
2335 way or another, and the translations starting from a complete Debian Buster
2336 edition now need to bring their translation up from
63% to
100%. The
2337 complete book is licensed using a Creative Commons license, and has
2338 been published in several languages over the years. The translations
2339 are done by volunteers to bring Linux in their native tongue. The
2340 last time I checked, it complete text was available in English,
2341 Norwegian Bokmål, German, Indonesian, Brazil Portuguese and Spanish.
2342 In addition, work has been started for Arabic (Morocco), Catalan,
2343 Chinese (Simplified), Chinese (Traditional), Croatian, Czech, Danish,
2344 Dutch, French, Greek, Italian, Japanese, Korean, Persian, Polish,
2345 Romanian, Russian, Swedish, Turkish and Vietnamese.
</p
>
2347 <p
>The translation is conducted on
2348 <a href=
"https://hosted.weblate.org/projects/debian-handbook/
">the
2349 hosted weblate project page
</a
>. Prospective translators are
2350 recommeded to subscribe to
2351 <a href=
"http://lists.alioth.debian.org/mailman/listinfo/debian-handbook-translators
">the
2352 translators mailing list
</a
> and should also check out
2353 <a href=
"https://debian-handbook.info/contribute/
">the instructions for
2354 contributors
</a
>.
</p
>
2356 <p
>I am one of the Norwegian Bokmål translators of this book, and we
2357 have just started. Your contribution is most welcome.
</p
>
2359 <p
>As usual, if you use Bitcoin and want to show your support of my
2360 activities, please send Bitcoin donations to my address
2361 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2366 <title>Automatic LinuxCNC servo PID tuning?
</title>
2367 <link>http://www.hungry.com/~pere/blog/Automatic_LinuxCNC_servo_PID_tuning_.html
</link>
2368 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Automatic_LinuxCNC_servo_PID_tuning_.html
</guid>
2369 <pubDate>Sat,
16 Jul
2022 22:
30:
00 +
0200</pubDate>
2370 <description><p
>While working on a CNC with servo motors controlled by the
2371 <a href=
"https://en.wikipedia.org/wiki/LinuxCNC
">LinuxCNC
</a
>
2372 <a href=
"https://en.wikipedia.org/wiki/PID_controller
">PID
2373 controller
</a
>, I recently had to learn how to tune the collection of values
2374 that control such mathematical machinery that a PID controller is. It
2375 proved to be a lot harder than I hoped, and I still have not succeeded
2376 in getting the Z PID controller to successfully defy gravity, nor X
2377 and Y to move accurately and reliably. But while climbing up this
2378 rather steep learning curve, I discovered that some motor control
2379 systems are able to tune their PID controllers. I got the impression
2380 from the documentation that LinuxCNC were not. This proved to be not
2383 <p
>The LinuxCNC
2384 <a href=
"http://linuxcnc.org/docs/html/man/man9/pid
.9.html
">pid
2385 component
</a
> is the recommended PID controller to use. It uses eight
2386 constants
<tt
>Pgain
</tt
>,
<tt
>Igain
</tt
>,
<tt
>Dgain
</tt
>,
2387 <tt
>bias
</tt
>,
<tt
>FF0
</tt
>,
<tt
>FF1
</tt
>,
<tt
>FF2
</tt
> and
2388 <tt
>FF3
</tt
> to calculate the output value based on current and wanted
2389 state, and all of these need to have a sensible value for the
2390 controller to behave properly. Note, there are even more values
2391 involved, theser are just the most important ones. In my case I need
2392 the X, Y and Z axes to follow the requested path with little error.
2393 This has proved quite a challenge for someone who have never tuned a
2394 PID controller before, but there is at least some help to be found.
2396 <p
>I discovered that included in LinuxCNC was this old PID component
2397 at_pid claiming to have auto tuning capabilities. Sadly it had been
2398 neglected since
2011, and could not be used as a plug in replacement
2399 for the default pid component. One would have to rewriting the
2400 LinuxCNC HAL setup to test at_pid. This was rather sad, when I wanted
2401 to quickly test auto tuning to see if it did a better job than me at
2402 figuring out good P, I and D values to use.
</p
>
2404 <p
>I decided to have a look if the situation could be improved. This
2405 involved trying to understand the code and history of the pid and
2406 at_pid components. Apparently they had a common ancestor, as code
2407 structure, comments and variable names were quite close to each other.
2408 Sadly this was not reflected in the git history, making it hard to
2409 figure out what really happened. My guess is that the author of
2410 <a href=
"https://github.com/LinuxCNC/linuxcnc/blob/master/src/hal/components/at_pid.c
">at_pid.c
</a
>
2412 <a href=
"https://github.com/LinuxCNC/linuxcnc/blob/master/src/hal/components/pid.c
">pid.c
</a
>,
2413 rewrote it to follow the structure he wished pid.c to have, then added
2414 support for auto tuning and finally got it included into the LinuxCNC
2415 repository. The restructuring and lack of early history made it
2416 harder to figure out which part of the code were relevant to the auto
2417 tuning, and which part of the code needed to be updated to work the
2418 same way as the current pid.c implementation. I started by trying to
2419 isolate relevant changes in pid.c, and applying them to at_pid.c. My
2420 aim was to make sure the at_pid component could replace the pid
2421 component with a simple change in the HAL setup loadrt line, without
2422 having to
"rewire
" the rest of the HAL configuration. After a few
2423 hours following this approach, I had learned quite a lot about the
2424 code structure of both components, while concluding I was heading down
2425 the wrong rabbit hole, and should get back to the surface and find a
2426 different path.
</p
>
2428 <p
>For the second attempt, I decided to throw away all the PID control
2429 related part of the original at_pid.c, and instead isolate and lift
2430 the auto tuning part of the code and inject it into a copy of pid.c.
2431 This ensured compatibility with the current pid component, while
2432 adding auto tuning as a run time option. To make it easier to identify
2433 the relevant parts in the future, I wrapped all the auto tuning code
2434 with
'#ifdef AUTO_TUNER
'. The end result behave just like the current
2435 pid component by default, as that part of the code is identical. The
2436 <a href=
"https://github.com/LinuxCNC/linuxcnc/pull/
1820">end result
2437 entered the LinuxCNC master branch
</a
> a few days ago.
</p
>
2439 <p
>To enable auto tuning, one need to set a few HAL pins in the PID
2440 component. The most important ones are
<tt
>tune-effort
</tt
>,
2441 <tt
>tune-mode
</tt
> and
<tt
>tune-start
</tt
>. But lets take a step
2442 back, and see what the auto tuning code will do. I do not know the
2443 mathematical foundation of the at_pid algorithm, but from observation
2444 I can tell that the algorithm will, when enabled, produce a square
2445 wave pattern centered around the
<tt
>bias
</tt
> value on the output pin
2446 of the PID controller. This can be seen using the HAL Scope provided
2447 by LinuxCNC. In my case, this is translated into voltage (+-
10V) sent
2448 to the motor controller, which in turn is translated into motor speed.
2449 So at_pid will ask the motor to move the axis back and forth. The
2450 number of cycles in the pattern is controlled by the
2451 <tt
>tune-cycles
</tt
> pin, and the extremes of the wave pattern is
2452 controlled by the
<tt
>tune-effort
</tt
> pin. Of course, trying to
2453 change the direction of a physical object instantly (as in going
2454 directly from a positive voltage to the equivalent negative voltage)
2455 do not change velocity instantly, and it take some time for the object
2456 to slow down and move in the opposite direction. This result in a
2457 more smooth movement wave form, as the axis in question were vibrating
2458 back and forth. When the axis reached the target speed in the
2459 opposing direction, the auto tuner change direction again. After
2460 several of these changes, the average time delay between the
'peaks
'
2461 and
'valleys
' of this movement graph is then used to calculate
2462 proposed values for Pgain, Igain and Dgain, and insert them into the
2463 HAL model to use by the pid controller. The auto tuned settings are
2464 not great, but htye work a lot better than the values I had been able
2465 to cook up on my own, at least for the horizontal X and Y axis. But I
2466 had to use very small
<tt
>tune-effort
<tt
> values, as my motor
2467 controllers error out if the voltage change too quickly. I
've been
2468 less lucky with the Z axis, which is moving a heavy object up and
2469 down, and seem to confuse the algorithm. The Z axis movement became a
2470 lot better when I introduced a
<tt
>bias
</tt
> value to counter the
2471 gravitational drag, but I will have to work a lot more on the Z axis
2472 PID values.
</p
>
2474 <p
>Armed with this knowledge, it is time to look at how to do the
2475 tuning. Lets say the HAL configuration in question load the PID
2476 component for X, Y and Z like this:
</p
>
2478 <blockquote
><pre
>
2479 loadrt pid names=pid.x,pid.y,pid.z
2480 </pre
></blockquote
>
2482 <p
>Armed with the new and improved at_pid component, the new line will
2483 look like this:
</p
>
2485 <blockquote
><pre
>
2486 loadrt at_pid names=pid.x,pid.y,pid.z
2487 </pre
></blockquote
>
2489 <p
>The rest of the HAL setup can stay the same. This work because the
2490 components are referenced by name. If the component had used count=
3
2491 instead, all use of pid.# had to be changed to at_pid.#.
</p
>
2493 <p
>To start tuning the X axis, move the axis to the middle of its
2494 range, to make sure it do not hit anything when it start moving back
2495 and forth. Next, set the
<tt
>tune-effort
</tt
> to a low number in the
2496 output range. I used
0.1 as my initial value. Next, assign
1 to the
2497 <tt
>tune-mode
</tt
> value. Note, this will disable the pid controlling
2498 part and feed
0 to the output pin, which in my case initially caused a
2499 lot of drift. In my case it proved to be a good idea with X and Y to
2500 tune the motor driver to make sure
0 voltage stopped the motor
2501 rotation. On the other hand, for the Z axis this proved to be a bad
2502 idea, so it will depend on your setup. It might help to set the
2503 <tt
>bias
</tt
> value to a output value that reduce or eliminate the
2504 axis drift. Finally, after setting
<tt
>tune-mode
</tt
>, set
2505 <tt
>tune-start
</tt
> to
1 to activate the auto tuning. If all go well,
2506 your axis will vibrate for a few seconds and when it is done, new
2507 values for Pgain, Igain and Dgain will be active. To test them,
2508 change
<tt
>tune-mode
</tt
> back to
0. Note that this might cause the
2509 machine to suddenly jerk as it bring the axis back to its commanded
2510 position, which it might have drifted away from during tuning. To
2511 summarize with some halcmd lines:
</p
>
2513 <blockquote
><pre
>
2514 setp pid.x.tune-effort
0.1
2515 setp pid.x.tune-mode
1
2516 setp pid.x.tune-start
1
2517 # wait for the tuning to complete
2518 setp pid.x.tune-mode
0
2519 </pre
></blockquote
>
2521 <p
>After doing this task quite a few times while trying to figure out
2522 how to properly tune the PID controllers on the machine in, I decided
2523 to figure out if this process could be automated, and wrote a script
2524 to do the entire tuning process from power on. The end result will
2525 ensure the machine is powered on and ready to run, home all axis if it
2526 is not already done, check that the extra tuning pins are available,
2527 move the axis to its mid point, run the auto tuning and re-enable the
2528 pid controller when it is done. It can be run several times. Check
2530 <a href=
"https://github.com/SebKuzminsky/MazakVQC1540/blob/bon-dev/scripts/run-auto-pid-tuner
">run-auto-pid-tuner
</a
>
2531 script on github if you want to learn how it is done.
</p
>
2533 <p
>My hope is that this little adventure can inspire someone who know
2534 more about motor PID controller tuning can implement even better
2535 algorithms for automatic PID tuning in LinuxCNC, making life easier
2536 for both me and all the others that want to use LinuxCNC but lack the
2537 in depth knowledge needed to tune PID controllers well.
</p
>
2539 <p
>As usual, if you use Bitcoin and want to show your support of my
2540 activities, please send Bitcoin donations to my address
2541 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2546 <title>LinuxCNC translators life just got a bit easier
</title>
2547 <link>http://www.hungry.com/~pere/blog/LinuxCNC_translators_life_just_got_a_bit_easier.html
</link>
2548 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/LinuxCNC_translators_life_just_got_a_bit_easier.html
</guid>
2549 <pubDate>Fri,
3 Jun
2022 21:
10:
00 +
0200</pubDate>
2550 <description><p
>Back in oktober last year, when I started looking at the
2551 <a href=
"https://en.wikipedia.org/wiki/LinuxCNC
">LinuxCNC
</a
> system, I
2552 proposed to change the documentation build system make life easier for
2553 translators. The original system consisted of independently written
2554 documentation files for each language, with no automated way to track
2555 changes done in other translations and no help for the translators to
2556 know how much was left to translated. By using
2557 <a href=
"https://po4a.org/
">the po4a system
</a
> to generate POT and PO
2558 files from the English documentation, this can be improved. A small
2559 team of LinuxCNC contributors got together and today our labour
2560 finally payed off. Since a few hours ago, it is now possible to
2561 translate
<a href=
"https://hosted.weblate.org/projects/linuxcnc/
">the
2562 LinuxCNC documentation on Weblate
</a
>, alongside the program itself.
</p
>
2564 <p
>The effort to migrate the documentation to use po4a has been both
2565 slow and frustrating. I am very happy we finally made it.
</p
>
2567 <p
>As usual, if you use Bitcoin and want to show your support of my
2568 activities, please send Bitcoin donations to my address
2569 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2574 <title>geteltorito make CD firmware upgrades a breeze
</title>
2575 <link>http://www.hungry.com/~pere/blog/geteltorito_make_CD_firmware_upgrades_a_breeze.html
</link>
2576 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/geteltorito_make_CD_firmware_upgrades_a_breeze.html
</guid>
2577 <pubDate>Wed,
20 Apr
2022 11:
50:
00 +
0200</pubDate>
2578 <description><p
>Recently I wanted to upgrade the firmware of my thinkpad, and
2579 located the firmware download page from Lenovo (which annoyingly do
2580 not allow access via Tor, forcing me to hand them more personal
2581 information that I would like). The
2582 <a href=
"https://support.lenovo.com/no/en/search?query=thinkpad firmware bios upgrade iso
&SearchType=Customer search
&searchLocation=Masthead
">download
2583 from Lenovo
</a
> is a bootable ISO image, which is a bit of a problem
2584 when all I got available is a USB memory stick. I tried booting the
2585 ISO as a USB stick, but this did not work. But genisoimage came to
2586 the rescue.
</p
>
2588 <P
>The geteltorito program in
2589 <a href=
"http://tracker.debian.org/cdrkit
">the genisoimage binary
2590 package
</a
> is able to convert the bootable ISO image to a bootable
2591 USB stick using a simple command line recipe, which I then can write
2592 to the most recently inserted USB stick:
</p
>
2594 <blockquote
><pre
>
2595 geteltorito -o usbstick.img lenovo-firmware.iso
2596 sudo dd bs=
10M if=usbstick.img of=$(ls -tr /dev/sd?|tail -
1)
2597 </pre
></blockquote
>
2599 <p
>This USB stick booted the firmware upgrader just fine, and in a few
2600 minutes my machine had the latest and greatest BIOS firmware in place.
</p
>
2605 <title>Run your industrial metal working machine using Debian?
</title>
2606 <link>http://www.hungry.com/~pere/blog/Run_your_industrial_metal_working_machine_using_Debian_.html
</link>
2607 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Run_your_industrial_metal_working_machine_using_Debian_.html
</guid>
2608 <pubDate>Wed,
2 Mar
2022 18:
40:
00 +
0100</pubDate>
2609 <description><p
>After many months of hard work by the good people involved in
2610 <a href=
"https://en.wikipedia.org/wiki/LinuxCNC
">LinuxCNC
</a
>, the
2611 system was accepted Sunday
2612 <a href=
"https://tracker.debian.org/pkg/linuxcnc
">into Debian
</a
>.
2613 Once it was available from Debian, I was surprised to discover from
2614 <a href=
"https://qa.debian.org/popcon.php?package=linuxcnc
">its
2615 popularity-contest numbers
</a
> that people have been reporting its use
2616 since
2012.
<a href=
"http://linuxcnc.org/
">Its project site
</a
> might
2617 be a good place to check out, but sadly is not working when visiting
2620 <p
>But what is LinuxCNC, you are probably wondering? Perhaps a
2621 Wikipedia quote is in place?
</p
>
2624 "LinuxCNC is a software system for numerical control of
2625 machines such as milling machines, lathes, plasma cutters, routers,
2626 cutting machines, robots and hexapods. It can control up to
9 axes or
2627 joints of a CNC machine using G-code (RS-
274NGC) as input. It has
2628 several GUIs suited to specific kinds of usage (touch screen,
2629 interactive development).
"
2632 <p
>It can even control
3D printers. And even though the Wikipedia
2633 page indicate that it can only work with hard real time kernel
2634 features, it can also work with the user space soft real time features
2635 provided by the Debian kernel.
2636 <a href=
"https://github.com/linuxcnc/linuxcnc
">The source code
</a
> is
2637 available from Github. The last few months I
've been involved in the
2638 translation setup for the program and documentation. Translators are
2640 <a href=
"https://hosted.weblate.org/engage/linuxcnc/
">join the
2641 effort
</a
> using Weblate.
</p
>
2643 <p
>As usual, if you use Bitcoin and want to show your support of my
2644 activities, please send Bitcoin donations to my address
2645 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2650 <title>Debian still an excellent choice for Lego builders
</title>
2651 <link>http://www.hungry.com/~pere/blog/Debian_still_an_excellent_choice_for_Lego_builders.html
</link>
2652 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_still_an_excellent_choice_for_Lego_builders.html
</guid>
2653 <pubDate>Sun,
24 Oct
2021 07:
10:
00 +
0200</pubDate>
2654 <description><p
>The Debian Lego team saw a lot of activity the last few weeks. All
2655 the packages under the team umbrella has been updated to fix
2656 packaging, lintian issues and BTS reports. In addition, a new and
2657 inspiring team member appeared on both the
2658 <a href=
"https://alioth-lists.debian.net/cgi-bin/mailman/listinfo/debian-lego-team
">debian-lego-team
2659 Team mailing list
</a
> and
2660 <a href=
"irc://irc.debian.org/%
23debian-lego
">IRC channel
2661 #debian-lego
</a
>. If you are interested in Lego CAD design and LEGO
2662 Mindstorms programming, check out the
2663 <a href=
"http://wiki.debian.org/LegoDesigners
">team wiki page
</a
> to
2664 see what Debian can offer the Lego enthusiast.
</p
>
2666 <p
>Patches has been sent upstream, causing new upstream releases, one
2667 even the first one in more than ten years, and old upstreams was
2668 released with new ones. There are still a lot of work left, and the
2669 team welcome more members to help us make sure Debian is the Linux
2670 distribution of choice for Lego builders. If you want to contribute,
2671 join us in the IRC channel and become part of
2672 <a href=
"https://salsa.debian.org/debian-lego-team/
">the team on
2673 Salsa
</a
>.
</p
>
2675 <p
>As usual, if you use Bitcoin and want to show your support of my
2676 activities, please send Bitcoin donations to my address
2677 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2682 <title>Six complete translations of The Debian Administrator
's Handbook for Buster
</title>
2683 <link>http://www.hungry.com/~pere/blog/Six_complete_translations_of_The_Debian_Administrator_s_Handbook_for_Buster.html
</link>
2684 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Six_complete_translations_of_The_Debian_Administrator_s_Handbook_for_Buster.html
</guid>
2685 <pubDate>Mon,
5 Jul
2021 19:
20:
00 +
0200</pubDate>
2686 <description><p
>I am happy observe that the
<a href=
"https://debian-handbook.info/
">The
2687 Debian Administrator
's Handbook
</a
> is available in six languages now.
2688 I am not sure which one of these are completely proof read, but the
2689 complete book is available in these languages:
2693 <li
>English
</li
>
2694 <li
>Norwegian Bokmål
</li
>
2695 <li
>German
</li
>
2696 <li
>Indonesian
</li
>
2697 <li
>Brazil Portuguese
</li
>
2698 <li
>Spanish
</li
>
2702 <p
>This is the list of languages more than
70% complete, in other
2703 words with not too much left to do:
</p
>
2707 <li
>Chinese (Simplified) -
90%
</li
>
2708 <li
>French -
79%
</li
>
2709 <li
>Italian -
79%
</li
>
2710 <li
>Japanese -
77%
</li
>
2711 <li
>Arabic (Morocco) -
75%
</li
>
2712 <li
>Persian -
71%
</li
>
2716 <p
>I wonder how long it will take to bring these to
100%.
</p
>
2718 <p
>Then there is the list of languages about halfway done:
</p
>
2722 <li
>Russian -
63%
</li
>
2723 <li
>Swedish -
53%
</li
>
2724 <li
>Chinese (Traditional) -
46%
</li
>
2725 <li
>Catalan -
45%
</li
>
2729 <p
>Several are on to a good start:
</p
>
2733 <li
>Dutch -
26%
</li
>
2734 <li
>Vietnamese -
25%
</li
>
2735 <li
>Polish -
23%
</li
>
2736 <li
>Czech -
22%
</li
>
2737 <li
>Turkish -
18%
</li
>
2741 <p
>Finally, there are the ones just getting started:
</p
>
2745 <li
>Korean -
4%
</li
>
2746 <li
>Croatian -
2%
</li
>
2747 <li
>Greek -
2%
</li
>
2748 <li
>Danish -
1%
</li
>
2749 <li
>Romanian -
1%
</li
>
2753 <p
>If you want to help provide a Debian instruction book in your own
2755 <a href=
"https://hosted.weblate.org/projects/debian-handbook/#languages
">Weblate
</a
>
2756 to contribute to the translations.
</p
>
2758 <p
>As usual, if you use Bitcoin and want to show your support of my
2759 activities, please send Bitcoin donations to my address
2760 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2765 <title>Latest Jami back in Debian Testing, and scriptable using dbus
</title>
2766 <link>http://www.hungry.com/~pere/blog/Latest_Jami_back_in_Debian_Testing__and_scriptable_using_dbus.html
</link>
2767 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Latest_Jami_back_in_Debian_Testing__and_scriptable_using_dbus.html
</guid>
2768 <pubDate>Tue,
12 Jan
2021 17:
00:
00 +
0100</pubDate>
2769 <description><p
>After a lot of hard work by its maintainer Alexandre Viau and
2770 others, the decentralized communication platform
2771 <a href=
"https://en.wikipedia.org/wiki/Jami_(software)
">Jami
</a
>
2772 (earlier known as Ring), managed to get
2773 <a href=
"https://tracker.debian.org/pkg/ring
">its latest version
</a
>
2774 into Debian Testing. Several of its dependencies has caused build and
2775 propagation problems, which all seem to be solved now.
</p
>
2777 <p
>In addition to the fact that Jami is decentralized, similar to how
2778 bittorrent is decentralized, I first of all like how it is not
2779 connected to external IDs like phone numbers. This allow me to set up
2780 computers to send me notifications using Jami without having to find
2781 get a phone number for each computer. Automatic notification via Jami
2782 is also made trivial thanks to the provided client side API (as a DBus
2783 service). Here is my bourne shell script demonstrating how to let any
2784 system send a message to any Jami address. It will create a new
2785 identity before sending the message, if no Jami identity exist
2788 <p
><pre
>
2791 # Usage: $
0 <jami-address
> <message
>
2793 # Send
<message
> to
<jami-address
>, create local jami account if
2796 # License: GPL v2 or later at your choice
2797 # Author: Petter Reinholdtsen
2800 if [ -z
"$HOME
" ] ; then
2801 echo
"error: missing \$HOME, required for dbus to work
"
2805 # First, get dbus running if not already running
2806 DBUSLAUNCH=/usr/bin/dbus-launch
2807 PIDFILE=/run/asterisk/dbus-session.pid
2808 if [ -e $PIDFILE ] ; then
2810 if ! kill -
0 $DBUS_SESSION_BUS_PID
2>/dev/null ; then
2811 unset DBUS_SESSION_BUS_ADDRESS
2814 if [ -z
"$DBUS_SESSION_BUS_ADDRESS
" ]
&& [ -x
"$DBUSLAUNCH
" ]; then
2815 DBUS_SESSION_BUS_ADDRESS=
"unix:path=$HOME/.dbus
"
2816 dbus-daemon --session --address=
"$DBUS_SESSION_BUS_ADDRESS
" --nofork --nopidfile --syslog-only
< /dev/null
> /dev/null
2>&1 3>&1 &
2817 DBUS_SESSION_BUS_PID=$!
2819 echo DBUS_SESSION_BUS_PID=$DBUS_SESSION_BUS_PID
2820 echo DBUS_SESSION_BUS_ADDRESS=\
""$DBUS_SESSION_BUS_ADDRESS
"\
"
2821 echo export DBUS_SESSION_BUS_ADDRESS
2827 part=
"$
1"; shift
2828 op=
"$
1"; shift
2829 dbus-send --session \
2830 --dest=
"cx.ring.Ring
" /cx/ring/Ring/$part cx.ring.Ring.$part.$op $*
2834 part=
"$
1"; shift
2835 op=
"$
1"; shift
2836 dbus-send --session --print-reply \
2837 --dest=
"cx.ring.Ring
" /cx/ring/Ring/$part cx.ring.Ring.$part.$op $*
2841 dringopreply ConfigurationManager getAccountList | \
2842 grep string | awk -F
'"' '{print $
2}
' | head -n
1
2845 account=$(firstaccount)
2847 if [ -z
"$account
" ] ; then
2848 echo
"Missing local account, trying to create it
"
2849 dringop ConfigurationManager addAccount \
2850 dict:string:string:
"Account.type
",
"RING
",
"Account.videoEnabled
",
"false
"
2851 account=$(firstaccount)
2852 if [ -z
"$account
" ] ; then
2853 echo
"unable to create local account
"
2858 # Not using dringopreply to ensure $
2 can contain spaces
2859 dbus-send --print-reply --session \
2860 --dest=cx.ring.Ring \
2861 /cx/ring/Ring/ConfigurationManager \
2862 cx.ring.Ring.ConfigurationManager.sendTextMessage \
2863 string:
"$account
" string:
"$
1" \
2864 dict:string:string:
"text/plain
",
"$
2"
2865 </pre
></p
>
2867 <p
>If you want to check it out yourself, visit the
2868 <a href=
"https://jami.net/
">the Jami system project page
</a
> to learn
2869 more, and install the latest Jami client from Debian Unstable or
2872 <p
>As usual, if you use Bitcoin and want to show your support of my
2873 activities, please send Bitcoin donations to my address
2874 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2879 <title>Buster based Bokmål edition of Debian Administrator
's Handbook
</title>
2880 <link>http://www.hungry.com/~pere/blog/Buster_based_Bokm_l_edition_of_Debian_Administrator_s_Handbook.html
</link>
2881 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Buster_based_Bokm_l_edition_of_Debian_Administrator_s_Handbook.html
</guid>
2882 <pubDate>Tue,
20 Oct
2020 18:
35:
00 +
0200</pubDate>
2883 <description><p align=
"center
"><img align=
"center
" src=
"http://www.hungry.com/~pere/blog/images/
2020-
10-
20-debian-handbook-nb-testprint.jpeg
" width=
"60%
"/
></p
>
2885 <p
>I am happy to report that we finally made it! Norwegian Bokmål
2886 became the first translation published on paper of the new Buster
2887 based edition of
"<a href=
"https://debian-handbook.info/
">The Debian
2888 Administrator
's Handbook
</a
>". The print proof reading copy arrived
2889 some days ago, and it looked good, so now the book is approved for
2890 general distribution. This updated paperback edition
<a
2891 href=
"https://debian-handbook.info/get/#norwegian
">is available from
2892 lulu.com
</a
>. The book is also available for download in electronic
2893 form as PDF, EPUB and Mobipocket, and can also be
2894 <a href=
"https://debian-handbook.info/browse/nb-NO/stable/
">read online
</a
>.
</p
>
2896 <p
>I am very happy to wrap up this Creative Common licensed project,
2897 which concludes several months of work by several volunteers. The
2898 number of Linux related books published in Norwegian are few, and I
2899 really hope this one will gain many readers, as it is packed with deep
2900 knowledge on Linux and the Debian ecosystem. The book will be
2901 available for various Internet book stores like Amazon and Barnes
&
2902 Noble soon, but I recommend buying
2903 "<a href=
"https://www.lulu.com/en/us/shop/roland-mas-and-rapha%C3%ABl-hertzog/h%C3%A5ndbok-for-debian-administratoren/paperback/product-
9j7qwq.html
">Håndbok
2904 for Debian-administratoren
</a
>" directly from the source at Lulu.
2906 <p
>As usual, if you use Bitcoin and want to show your support of my
2907 activities, please send Bitcoin donations to my address
2908 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2913 <title>Buster update of Norwegian Bokmål edition of Debian Administrator
's Handbook almost done
</title>
2914 <link>http://www.hungry.com/~pere/blog/Buster_update_of_Norwegian_Bokm_l_edition_of_Debian_Administrator_s_Handbook_almost_done.html
</link>
2915 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Buster_update_of_Norwegian_Bokm_l_edition_of_Debian_Administrator_s_Handbook_almost_done.html
</guid>
2916 <pubDate>Fri,
11 Sep
2020 09:
45:
00 +
0200</pubDate>
2917 <description><p
>Thanks to the good work of several volunteers, the updated edition
2918 of the Norwegian translation for
2919 "<a href=
"https://debian-handbook.info/
">The Debian Administrator
's
2920 Handbook
</a
>" is now almost completed. After many months of proof
2921 reading, I consider the proof reading complete enough for us to move
2922 to the next step, and have asked for the print version to be prepared
2923 and sent of to the print on demand service lulu.com. While it is
2924 still not to late if you find any incorrect translations on
2925 <a href=
"https://hosted.weblate.org/languages/nb_NO/debian-handbook/
">the
2926 hosted Weblate service
</a
>, but it will be soon. :) You can check out
2927 <a href=
" https://debian-handbook.info/browse/nb-NO/stable/
">the Buster
2928 edition on the web
</a
> until the print edition is ready.
</p
>
2930 <p
>The book will be for sale on lulu.com and various web book stores,
2931 with links available from the web site for the book linked to above.
2932 I hope a lot of readers find it useful.
</p
>
2934 <p
>As usual, if you use Bitcoin and want to show your support of my
2935 activities, please send Bitcoin donations to my address
2936 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2941 <title>Working on updated Norwegian Bokmål edition of Debian Administrator
's Handbook
</title>
2942 <link>http://www.hungry.com/~pere/blog/Working_on_updated_Norwegian_Bokm_l_edition_of_Debian_Administrator_s_Handbook.html
</link>
2943 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Working_on_updated_Norwegian_Bokm_l_edition_of_Debian_Administrator_s_Handbook.html
</guid>
2944 <pubDate>Sat,
4 Jul
2020 23:
55:
00 +
0200</pubDate>
2945 <description><p
>Three years ago, the first Norwegian Bokmål edition of
2946 "<a href=
"https://debian-handbook.info/
">The Debian Administrator
's
2947 Handbook
</a
>" was published. This was based on Debian Jessie. Now a
2948 new and updated version based on Buster is getting ready. Work on the
2949 updated Norwegian Bokmål edition has been going on for a few months
2950 now, and yesterday, we reached the first mile stone, with
100% of the
2951 texts being translated. A lot of proof reading remains, of course,
2952 but a major step towards a new edition has been taken.
</p
>
2954 <p
>The book is translated by volunteers, and we would love to get some
2955 help with the proof reading. The translation uses
2956 <a href=
"https://hosted.weblate.org/languages/nb_NO/debian-handbook/
">the
2957 hosted Weblate service
</a
>, and we welcome everyone to have a look and
2958 submit improvements and suggestions. There is also a proof readers
2959 PDF available on request, get in touch if you want to help out that
2962 <p
>As usual, if you use Bitcoin and want to show your support of my
2963 activities, please send Bitcoin donations to my address
2964 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2969 <title>Secure Socket API - a simple and powerful approach for TLS support in software
</title>
2970 <link>http://www.hungry.com/~pere/blog/Secure_Socket_API___a_simple_and_powerful_approach_for_TLS_support_in_software.html
</link>
2971 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Secure_Socket_API___a_simple_and_powerful_approach_for_TLS_support_in_software.html
</guid>
2972 <pubDate>Sat,
6 Jun
2020 12:
40:
00 +
0200</pubDate>
2973 <description><p
>As a member of the
<a href=
"https://www.nuug.no/
">Norwegian Unix
2974 User Group
</a
>, I have the pleasure of receiving the
2975 <a href=
"https://www.usenix.org/
">USENIX
</a
> magazine
2976 <a href=
"https://www.usenix.org/publications/login/
">;login:
</a
>
2977 several times a year. I rarely have time to read all the articles,
2978 but try to at least skim through them all as there is a lot of nice
2979 knowledge passed on there. I even carry the latest issue with me most
2980 of the time to try to get through all the articles when I have a few
2981 spare minutes.
</p
>
2983 <p
>The other day I came across a nice article titled
2984 "<a href=
"https://www.usenix.org/publications/login/winter2018/oneill
">The
2985 Secure Socket API: TLS as an Operating System Service
</a
>" with a
2986 marvellous idea I hope can make it all the way into the POSIX standard.
2987 The idea is as simple as it is powerful. By introducing a new
2988 socket() option IPPROTO_TLS to use TLS, and a system wide service to
2989 handle setting up TLS connections, one both make it trivial to add TLS
2990 support to any program currently using the POSIX socket API, and gain
2991 system wide control over certificates, TLS versions and encryption
2992 systems used. Instead of doing this:
</p
>
2994 <p
><blockquote
><pre
>
2995 int socket = socket(PF_INET, SOCK_STREAM, IPPROTO_TCP);
2996 </pre
></blockquote
></p
>
2998 <p
>the program code would be doing this:
<p
>
3000 <p
><blockquote
><pre
>
3001 int socket = socket(PF_INET, SOCK_STREAM, IPPROTO_TLS);
3002 </pre
></blockquote
></p
>
3004 <p
>According to the ;login: article, converting a C program to use TLS
3005 would normally modify only
5-
10 lines in the code, which is amazing
3006 when compared to using for example the OpenSSL API.
</p
>
3008 <p
>The project has set up the
3009 <a href=
"https://securesocketapi.org/
">https://securesocketapi.org/
</a
>
3010 web site to spread the idea, and the code for a kernel module and the
3011 associated system daemon is available from two github repositories:
3012 <a href=
"https://github.com/markoneill/ssa
">ssa
</a
> and
3013 <a href=
"https://github.com/markoneill/ssa-daemon
">ssa-daemon
</a
>.
3014 Unfortunately there is no explicit license information with the code,
3015 so its copyright status is unclear. A
3016 <a href=
"https://github.com/markoneill/ssa/issues/
2">request to solve
3017 this
</a
> about it has been unsolved since
2018-
08-
17.
</p
>
3019 <p
>I love the idea of extending socket() to gain TLS support, and
3020 understand why it is an advantage to implement this as a kernel module
3021 and system wide service daemon, but can not help to think that it
3022 would be a lot easier to get projects to move to this way of setting
3023 up TLS if it was done with a user space approach where programs
3024 wanting to use this API approach could just link with a wrapper
3027 <p
>I recommend you check out this simple and powerful approach to more
3028 secure network connections. :)
</p
>
3030 <p
>As usual, if you use Bitcoin and want to show your support of my
3031 activities, please send Bitcoin donations to my address
3032 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3037 <title>Jami as a Zoom client, a trick for password protected rooms...
</title>
3038 <link>http://www.hungry.com/~pere/blog/Jami_as_a_Zoom_client__a_trick_for_password_protected_rooms___.html
</link>
3039 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Jami_as_a_Zoom_client__a_trick_for_password_protected_rooms___.html
</guid>
3040 <pubDate>Fri,
8 May
2020 13:
30:
00 +
0200</pubDate>
3041 <description><p
>Half a year ago,
3042 <a href=
"http://www.hungry.com/~pere/blog/Jami_Ring__finally_functioning_peer_to_peer_communication_client.html
">I
3043 wrote
</a
> about
<a href=
"https://jami.net/
">the Jami communication
3044 client
</a
>, capable of peer-to-peer encrypted communication. It
3045 handle both messages, audio and video. It uses distributed hash
3046 tables instead of central infrastructure to connect its users to each
3047 other, which in my book is a plus. I mentioned briefly that it could
3048 also work as a SIP client, which came in handy when the higher
3049 educational sector in Norway started to promote Zoom as its video
3050 conferencing solution. I am reluctant to use the official Zoom client
3051 software, due to their
<a href=
"https://zoom.us/terms
">copyright
3052 license clauses
</a
> prohibiting users to reverse engineer (for example
3053 to check the security) and benchmark it, and thus prefer to connect to
3054 Zoom meetings with free software clients.
</p
>
3056 <p
>Jami worked OK as a SIP client to Zoom as long as there was no
3057 password set on the room. The Jami daemon leak memory like crazy
3058 (approximately
1 GiB a minute) when I am connected to the video
3059 conference, so I had to restart the client every
7-
10 minutes, which
3060 is not great. I tried to get other SIP Linux clients to work
3061 without success, so I decided I would have to live with this wart
3062 until someone managed to fix the leak in the dring code base. But
3063 another problem showed up once the rooms were password protected. I
3064 could not get my dial tone signaling through from Jami to Zoom, and
3065 dial tone signaling is used to enter the password when connecting to
3066 Zoom. I tried a lot of different permutations with my Jami and
3067 Asterisk setup to try to figure out why the signaling did not get
3068 through, only to finally discover that the fundamental problem seem to
3069 be that Zoom is simply not able to receive dial tone signaling when
3070 connecting via SIP. There seem to be nothing wrong with the Jami and
3071 Asterisk end, it is simply broken in the Zoom end. I got help from a
3072 very skilled VoIP engineer figuring out this last part. And being a
3073 very skilled engineer, he was also able to locate a solution for me.
3074 Or to be exact, a workaround that solve my initial problem of
3075 connecting to password protected Zoom rooms using Jami.
</p
>
3077 <p
>So, how do you do this, I am sure you are wondering by now. The
3079 <a href=
"https://support.zoom.us/hc/en-us/articles/
202405539-H-
323-SIP-Room-Connector-Dial-Strings#sip
">documented
3080 from Zoom
</a
>, and it is to modify the SIP address to include the room
3081 password. What is most surprising about this is that the
3082 automatically generated email from Zoom with instructions on how to
3083 connect via SIP do not mention this. The SIP address to use normally
3084 consist of the room ID (a number), an @ character and the IP address
3085 of the Zoom SIP gateway. But Zoom understand a lot more than just the
3086 room ID in front of the at sign. The format is
"<tt
>[Meeting
3087 ID].[Password].[Layout].[Host Key]
</tt
>", and you can here see how you
3088 can both enter password, control the layout (full screen, active
3089 presence and gallery) and specify the host key to start the meeting.
3090 The full SIP address entered into Jami to provide the password will
3091 then look like this (all using made up numbers):
</p
>
3093 <p
><blockquote
>
3094 <tt
>sip:
657837644.522827@
192.168.169.170</tt
>
3095 </blockquote
></p
>
3097 <p
>Now if only jami would reduce its memory usage, I could even
3098 recommend this setup to others. :)
</p
>
3100 <p
>As usual, if you use Bitcoin and want to show your support of my
3101 activities, please send Bitcoin donations to my address
3102 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3107 <title>GnuCOBOL, a free platform to learn and use COBOL - nice free software
</title>
3108 <link>http://www.hungry.com/~pere/blog/GnuCOBOL__a_free_platform_to_learn_and_use_COBOL___nice_free_software.html
</link>
3109 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/GnuCOBOL__a_free_platform_to_learn_and_use_COBOL___nice_free_software.html
</guid>
3110 <pubDate>Wed,
29 Apr
2020 13:
10:
00 +
0200</pubDate>
3111 <description><p
>The curiosity got the better of me when
3112 <a href=
"https://developers.slashdot.org/story/
20/
04/
06/
1424246/new-jersey-desperately-needs-cobol-programmers
">Slashdot
3113 reported
</a
> that New Jersey was desperately looking for
3114 <a href=
"https://en.wikipedia.org/wiki/COBOL
">COBOL
</a
> programmers,
3115 and a few days later it was reported that
3116 <a href=
"https://onezero.medium.com/ibm-rallies-cobol-engineers-to-save-overloaded-unemployment-systems-eeadf13eddce
">IBM
3117 tried to locate COBOL programmers
</a
>.
</p
>
3119 <p
>I thus decided to have a look at free software alternatives to
3120 learn COBOL, and had the pleasure to find
3121 <a href=
"https://sourceforge.net/projects/open-cobol/
">GnuCOBOL
</a
> was
3122 already
<a href=
"https://tracker.debian.org/pkg/gnucobol
">in
3123 Debian
</a
>. It used to be called Open Cobol, and is a
"compiler
"
3124 transforming COBOL code to C or C++ before giving it to GCC or Visual
3125 Studio to build binaries.
</p
>
3127 <p
>I managed to get in touch with upstream, and was impressed with the
3128 quick response, and also was happy to see a new Debian maintainer
3129 taking over when the original one recently asked to be replaced. A
3130 new Debian upload was done as recently as yesterday.
</p
>
3132 <p
>Using the Debian package, I was able to follow a simple COBOL
3133 introduction and make and run simple COBOL programs. It was fun to
3134 learn a new programming language. If you want to test for yourself,
3135 <a href=
"https://en.wikipedia.org/wiki/GnuCOBOL
">the GnuCOBOL Wikipedia
3136 page
</a
> have a few simple examples to get you startet.
</p
>
3138 <p
>As I do not have much experience with COBOL, I do not know how
3139 standard compliant it is, but it claim to pass most tests from COBOL
3140 test suite, which sound good to me. It is nice to know it is possible
3141 to learn COBOL using software without any usage restrictions, and I am
3142 very happy such nice free software project as this is available. If
3143 you as me is curious about COBOL, check it out.
</p
>
3145 <p
>As usual, if you use Bitcoin and want to show your support of my
3146 activities, please send Bitcoin donations to my address
3147 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3152 <title>Jami/Ring, finally functioning peer to peer communication client
</title>
3153 <link>http://www.hungry.com/~pere/blog/Jami_Ring__finally_functioning_peer_to_peer_communication_client.html
</link>
3154 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Jami_Ring__finally_functioning_peer_to_peer_communication_client.html
</guid>
3155 <pubDate>Wed,
19 Jun
2019 08:
50:
00 +
0200</pubDate>
3156 <description><p
>Some years ago, in
2016, I
3157 <a href=
"http://www.hungry.com/~pere/blog/Experience_and_updated_recipe_for_using_the_Signal_app_without_a_mobile_phone.html
">wrote
3158 for the first time about
</a
> the Ring peer to peer messaging system.
3159 It would provide messaging without any central server coordinating the
3160 system and without requiring all users to register a phone number or
3161 own a mobile phone. Back then, I could not get it to work, and put it
3162 aside until it had seen more development. A few days ago I decided to
3163 give it another try, and am happy to report that this time I am able
3164 to not only send and receive messages, but also place audio and video
3165 calls. But only if UDP is not blocked into your network.
</p
>
3167 <p
>The Ring system changed name earlier this year to
3168 <a href=
"https://en.wikipedia.org/wiki/Jami_(software)
">Jami
</a
>. I
3169 tried doing web search for
'ring
' when I discovered it for the first
3170 time, and can only applaud this change as it is impossible to find
3171 something called Ring among the noise of other uses of that word. Now
3172 you can search for
'jami
' and this client and
3173 <a href=
"https://jami.net/
">the Jami system
</a
> is the first hit at
3174 least on duckduckgo.
</p
>
3176 <p
>Jami will by default encrypt messages as well as audio and video
3177 calls, and try to send them directly between the communicating parties
3178 if possible. If this proves impossible (for example if both ends are
3179 behind NAT), it will use a central SIP TURN server maintained by the
3180 Jami project. Jami can also be a normal SIP client. If the SIP
3181 server is unencrypted, the audio and video calls will also be
3182 unencrypted. This is as far as I know the only case where Jami will
3183 do anything without encryption.
</p
>
3185 <p
>Jami is available for several platforms: Linux, Windows, MacOSX,
3186 Android, iOS, and Android TV. It is included in Debian already. Jami
3187 also work for those using F-Droid without any Google connections,
3188 while Signal do not.
3189 <a href=
"https://git.jami.net/savoirfairelinux/ring-project/wikis/technical/Protocol
">The
3190 protocol
</a
> is described in the Ring project wiki. The system uses a
3191 distributed hash table (DHT) system (similar to BitTorrent) running
3192 over UDP. On one of the networks I use, I discovered Jami failed to
3193 work. I tracked this down to the fact that incoming UDP packages
3194 going to ports
1-
49999 were blocked, and the DHT would pick a random
3195 port and end up in the low range most of the time. After talking to
3196 the developers, I solved this by enabling the dhtproxy in the
3197 settings, thus using TCP to talk to a central DHT proxy instead of
3199 peering directly with others. I
've been told the developers are
3200 working on allowing DHT to use TCP to avoid this problem. I also ran
3201 into a problem when trying to talk to the version of Ring included in
3202 Debian Stable (Stretch). Apparently the protocol changed between
3203 beta2 and the current version, making these clients incompatible.
3204 Hopefully the protocol will not be made incompatible in the
3207 <p
>It is worth noting that while looking at Jami and its features, I
3208 came across another communication platform I have not tested yet. The
3209 <a href=
"https://en.wikipedia.org/wiki/Tox_(protocol)
">Tox protocol
</a
>
3210 and
<a href=
"https://tox.chat/
">family of Tox clients
</a
>. It might
3211 become the topic of a future blog post.
</p
>
3213 <p
>As usual, if you use Bitcoin and want to show your support of my
3214 activities, please send Bitcoin donations to my address
3215 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3220 <title>Strategispillet Unknown Horizons nå tilgjengelig på bokmål
</title>
3221 <link>http://www.hungry.com/~pere/blog/Strategispillet_Unknown_Horizons_n__tilgjengelig_p__bokm_l.html
</link>
3222 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Strategispillet_Unknown_Horizons_n__tilgjengelig_p__bokm_l.html
</guid>
3223 <pubDate>Wed,
23 Jan
2019 07:
50:
00 +
0100</pubDate>
3224 <description><p
>I høst ble jeg inspirert til å bidra til oversettelsen av
3225 <a href=
"http://unknown-horizons.org/
">strategispillet Unknown
3226 Horizons
</a
>, og oversatte de nesten
200 strengene i prosjektet til
3227 bokmål. Deretter har jeg gått å ventet på at det kom en ny utgave som
3228 inneholdt disse oversettelsene. Nå er endelig ventetiden over. Den
3229 nye versjonen kom på nyåret, og ble
3230 <a href=
"https://tracker.debian.org/pkg/unknown-horizons
">lastet opp i
3231 Debian
</a
> for noen få dager siden. I går kveld fikk jeg testet det ut, og
3232 må innrømme at oversettelsene fungerer fint. Fant noen få tekster som
3233 måtte justeres, men ikke noe alvorlig. Har oppdatert
3234 <a href=
"https://hosted.weblate.org/projects/uh/
">oversettelsen på
3235 Weblate
</a
>, slik at neste utgave vil være enda bedre. :)
</p
>
3237 <p
>Spillet er et ressursstyringsspill ala Civilization, og er morsomt
3238 å spille for oss som liker slikt. :)
</p
>
3240 <p
>Som vanlig, hvis du bruker Bitcoin og ønsker å vise din støtte til
3241 det jeg driver med, setter jeg pris på om du sender Bitcoin-donasjoner
3243 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
3244 Merk, betaling med bitcoin er ikke anonymt. :)
</p
>
3249 <title>Debian now got everything you need to program Micro:bit
</title>
3250 <link>http://www.hungry.com/~pere/blog/Debian_now_got_everything_you_need_to_program_Micro_bit.html
</link>
3251 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_now_got_everything_you_need_to_program_Micro_bit.html
</guid>
3252 <pubDate>Tue,
22 Jan
2019 17:
20:
00 +
0100</pubDate>
3253 <description><p
>I am amazed and very pleased to discover that since a few days ago,
3254 everything you need to program the
<a href=
"https://microbit.org/
">BBC
3255 micro:bit
</a
> is available from the Debian archive. All this is
3256 thanks to the hard work of Nick Morrott and the Debian python
3257 packaging team. The micro:bit project recommend the mu-editor to
3258 program the microcomputer, as this editor will take care of all the
3259 machinery required to injekt/flash micropython alongside the program
3260 into the micro:bit, as long as the pieces are available.
</p
>
3262 <p
>There are three main pieces involved. The first to enter Debian
3264 <a href=
"https://tracker.debian.org/pkg/python-uflash
">python-uflash
</a
>,
3265 which was accepted into the archive
2019-
01-
12. The next one was
3266 <a href=
"https://tracker.debian.org/pkg/mu-editor
">mu-editor
</a
>, which
3267 showed up
2019-
01-
13. The final and hardest part to to into the
3269 <a href=
"https://tracker.debian.org/pkg/firmware-microbit-micropython
">firmware-microbit-micropython
</a
>,
3270 which needed to get its build system and dependencies into Debian
3271 before it was accepted
2019-
01-
20. The last one is already in Debian
3272 Unstable and should enter Debian Testing / Buster in three days. This
3273 all allow any user of the micro:bit to get going by simply running
3274 'apt install mu-editor
' when using Testing or Unstable, and once
3275 Buster is released as stable, all the users of Debian stable will be
3276 catered for.
</p
>
3278 <p
>As a minor final touch, I added rules to
3279 <a href=
"https://tracker.debian.org/pkg/isenkram
">the isenkram
3280 package
</a
> for recognizing micro:bit and recommend the mu-editor
3281 package. This make sure any user of the isenkram desktop daemon will
3282 get a popup suggesting to install mu-editor then the USB cable from
3283 the micro:bit is inserted for the first time.
</p
>
3285 <p
>This should make it easier to have fun.
</p
>
3287 <p
>As usual, if you use Bitcoin and want to show your support of my
3288 activities, please send Bitcoin donations to my address
3289 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3294 <title>Learn to program with Minetest on Debian
</title>
3295 <link>http://www.hungry.com/~pere/blog/Learn_to_program_with_Minetest_on_Debian.html
</link>
3296 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Learn_to_program_with_Minetest_on_Debian.html
</guid>
3297 <pubDate>Sat,
15 Dec
2018 15:
30:
00 +
0100</pubDate>
3298 <description><p
>A fun way to learn how to program
3299 <a href=
"https://www.python.org/
">Python
</a
> is to follow the
3300 instructions in the book
3301 "<a href=
"https://nostarch.com/programwithminecraft
">Learn to program
3302 with Minecraft
</a
>", which introduces programming in Python to people
3303 who like to play with Minecraft. The book uses a Python library to
3304 talk to a TCP/IP socket with an API accepting build instructions and
3305 providing information about the current players in a Minecraft world.
3306 The TCP/IP API was first created for the Minecraft implementation for
3307 Raspberry Pi, and has since been ported to some server versions of
3308 Minecraft. The book contain recipes for those using Windows, MacOSX
3309 and Raspian. But a little known fact is that you can follow the same
3310 recipes using the free software construction game
3311 <a href=
"https://minetest.net/
">Minetest
</a
>.
</p
>
3313 <p
>There is
<a href=
"https://github.com/sprintingkiwi/pycraft_mod
">a
3314 Minetest module implementing the same API
</a
>, making it possible to
3315 use the Python programs coded to talk to Minecraft with Minetest too.
3317 <a href=
"https://ftp-master.debian.org/new/minetest-mod-pycraft_0.20%
2Bgit20180331.0376a0a%
2Bdfsg-
1.html
">uploaded
3318 this module
</a
> to Debian two weeks ago, and as soon as it clears the
3319 FTP masters NEW queue, learning to program Python with Minetest on
3320 Debian will be a simple
'apt install
' away. The Debian package is
3321 maintained as part of the Debian Games team, and
3322 <a href=
"https://salsa.debian.org/games-team/unfinished/minetest-mod-pycraft
">the
3323 packaging rules
</a
> are currently located under
'unfinished
' on
3326 <p
>You will most likely need to install several of the Minetest
3327 modules in Debian for the examples included with the library to work
3328 well, as there are several blocks used by the example scripts that are
3329 provided via modules in Minetest. Without the required blocks, a
3330 simple stone block is used instead. My initial testing with a analog
3331 clock did not get gold arms as instructed in the python library, but
3332 instead used stone arms.
</p
>
3334 <p
>I tried to find a way to add the API to the desktop version of
3335 Minecraft, but were unable to find any working recipes. The
3336 <a href=
"https://www.epiphanydigest.com/tag/minecraft-python-api/
">recipes
</a
>
3337 I
<a href=
"https://github.com/kbsriram/mcpiapi
">found
</a
> are only
3338 working with a standalone Minecraft server setup. Are there any
3339 options to use with the normal desktop version?
</p
>
3341 <p
>As usual, if you use Bitcoin and want to show your support of my
3342 activities, please send Bitcoin donations to my address
3343 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3348 <title>Time for an official MIME type for patches?
</title>
3349 <link>http://www.hungry.com/~pere/blog/Time_for_an_official_MIME_type_for_patches_.html
</link>
3350 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Time_for_an_official_MIME_type_for_patches_.html
</guid>
3351 <pubDate>Thu,
1 Nov
2018 08:
15:
00 +
0100</pubDate>
3352 <description><p
>As part of my involvement in
3353 <a href=
"https://gitlab.com/OsloMet-ABI/nikita-noark5-core
">the Nikita
3354 archive API project
</a
>, I
've been importing a fairly large lump of
3355 emails into a test instance of the archive to see how well this would
3356 go. I picked a subset of
<a href=
"https://notmuchmail.org/
">my
3357 notmuch email database
</a
>, all public emails sent to me via
3358 @lists.debian.org, giving me a set of around
216 000 emails to import.
3359 In the process, I had a look at the various attachments included in
3360 these emails, to figure out what to do with attachments, and noticed
3361 that one of the most common attachment formats do not have
3362 <a href=
"https://www.iana.org/assignments/media-types/media-types.xhtml
">an
3363 official MIME type
</a
> registered with IANA/IETF. The output from
3364 diff, ie the input for patch, is on the top
10 list of formats
3365 included in these emails. At the moment people seem to use either
3366 text/x-patch or text/x-diff, but neither is officially registered. It
3367 would be better if one official MIME type were registered and used
3368 everywhere.
</p
>
3370 <p
>To try to get one official MIME type for these files, I
've brought
3372 <a href=
"https://www.ietf.org/mailman/listinfo/media-types
">the
3373 media-types mailing list
</a
>. If you are interested in discussion
3374 which MIME type to use as the official for patch files, or involved in
3375 making software using a MIME type for patches, perhaps you would like
3376 to join the discussion?
</p
>
3378 <p
>As usual, if you use Bitcoin and want to show your support of my
3379 activities, please send Bitcoin donations to my address
3380 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3385 <title>Automatic Google Drive sync using grive in Debian
</title>
3386 <link>http://www.hungry.com/~pere/blog/Automatic_Google_Drive_sync_using_grive_in_Debian.html
</link>
3387 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Automatic_Google_Drive_sync_using_grive_in_Debian.html
</guid>
3388 <pubDate>Thu,
4 Oct
2018 15:
20:
00 +
0200</pubDate>
3389 <description><p
>A few days, I rescued a Windows victim over to Debian. To try to
3390 rescue the remains, I helped set up automatic sync with Google Drive.
3391 I did not find any sensible Debian package handling this
3392 automatically, so I rebuild the grive2 source from
3393 <a href=
"http://www.webupd8.org/
">the Ubuntu UPD8 PPA
</a
> to do the
3394 task and added a autostart desktop entry and a small shell script to
3395 run in the background while the user is logged in to do the sync.
3396 Here is a sketch of the setup for future reference.
</p
>
3398 <p
>I first created
<tt
>~/googledrive
</tt
>, entered the directory and
3399 ran
'<tt
>grive -a
</tt
>' to authenticate the machine/user. Next, I
3400 created a autostart hook in
<tt
>~/.config/autostart/grive.desktop
</tt
>
3401 to start the sync when the user log in:
</p
>
3403 <p
><blockquote
><pre
>
3405 Name=Google drive autosync
3407 Exec=/home/user/bin/grive-sync
3408 </pre
></blockquote
></p
>
3410 <p
>Finally, I wrote the
<tt
>~/bin/grive-sync
</tt
> script to sync
3411 ~/googledrive/ with the files in Google Drive.
</p
>
3413 <p
><blockquote
><pre
>
3418 if [
"$syncpid
" ] ; then
3422 trap cleanup EXIT INT QUIT
3423 /usr/lib/grive/grive-sync.sh listen googledrive
2>&1 | sed
"s%^%$
0:%
" &
3426 if ! xhost
>/dev/null
2>&1 ; then
3427 echo
"no DISPLAY, exiting as the user probably logged out
"
3430 if [ ! -e /run/user/
1000/grive-sync.sh_googledrive ] ; then
3431 /usr/lib/grive/grive-sync.sh sync googledrive
3434 done
2>&1 | sed
"s%^%$
0:%
"
3435 </pre
></blockquote
></p
>
3437 <p
>Feel free to use the setup if you want. It can be assumed to be
3438 GNU GPL v2 licensed (or any later version, at your leisure), but I
3439 doubt this code is possible to claim copyright on.
</p
>
3441 <p
>As usual, if you use Bitcoin and want to show your support of my
3442 activities, please send Bitcoin donations to my address
3443 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3448 <title>Using the Kodi API to play Youtube videos
</title>
3449 <link>http://www.hungry.com/~pere/blog/Using_the_Kodi_API_to_play_Youtube_videos.html
</link>
3450 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Using_the_Kodi_API_to_play_Youtube_videos.html
</guid>
3451 <pubDate>Sun,
2 Sep
2018 23:
40:
00 +
0200</pubDate>
3452 <description><p
>I continue to explore my Kodi installation, and today I wanted to
3453 tell it to play a youtube URL I received in a chat, without having to
3454 insert search terms using the on-screen keyboard. After searching the
3455 web for API access to the Youtube plugin and testing a bit, I managed
3456 to find a recipe that worked. If you got a kodi instance with its API
3457 available from http://kodihost/jsonrpc, you can try the following to
3458 have check out a nice cover band.
</p
>
3460 <p
><blockquote
><pre
>curl --silent --header
'Content-Type: application/json
' \
3461 --data-binary
'{
"id
":
1,
"jsonrpc
":
"2.0",
"method
":
"Player.Open
",
3462 "params
": {
"item
": {
"file
":
3463 "plugin://plugin.video.youtube/play/?video_id=LuRGVM9O0qg
" } } }
' \
3464 http://projector.local/jsonrpc
</pre
></blockquote
></p
>
3466 <p
>I
've extended kodi-stream program to take a video source as its
3467 first argument. It can now handle direct video links, youtube links
3468 and
'desktop
' to stream my desktop to Kodi. It is almost like a
3469 Chromecast. :)
</p
>
3471 <p
>As usual, if you use Bitcoin and want to show your support of my
3472 activities, please send Bitcoin donations to my address
3473 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3478 <title>Sharing images with friends and family using RSS and EXIF/XMP metadata
</title>
3479 <link>http://www.hungry.com/~pere/blog/Sharing_images_with_friends_and_family_using_RSS_and_EXIF_XMP_metadata.html
</link>
3480 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Sharing_images_with_friends_and_family_using_RSS_and_EXIF_XMP_metadata.html
</guid>
3481 <pubDate>Tue,
31 Jul
2018 23:
30:
00 +
0200</pubDate>
3482 <description><p
>For a while now, I have looked for a sensible way to share images
3483 with my family using a self hosted solution, as it is unacceptable to
3484 place images from my personal life under the control of strangers
3485 working for data hoarders like Google or Dropbox. The last few days I
3486 have drafted an approach that might work out, and I would like to
3487 share it with you. I would like to publish images on a server under
3488 my control, and point some Internet connected display units using some
3489 free and open standard to the images I published. As my primary
3490 language is not limited to ASCII, I need to store metadata using
3491 UTF-
8. Many years ago, I hoped to find a digital photo frame capable
3492 of reading a RSS feed with image references (aka using the
3493 &lt;enclosure
&gt; RSS tag), but was unable to find a current supplier
3494 of such frames. In the end I gave up that approach.
</p
>
3496 <p
>Some months ago, I discovered that
3497 <a href=
"https://www.jwz.org/xscreensaver/
">XScreensaver
</a
> is able to
3498 read images from a RSS feed, and used it to set up a screen saver on
3499 my home info screen, showing images from the Daily images feed from
3500 NASA. This proved to work well. More recently I discovered that
3501 <a href=
"https://kodi.tv
">Kodi
</a
> (both using
3502 <a href=
"https://www.openelec.tv/
">OpenELEC
</a
> and
3503 <a href=
"https://libreelec.tv
">LibreELEC
</a
>) provide the
3504 <a href=
"https://github.com/grinsted/script.screensaver.feedreader
">Feedreader
</a
>
3505 screen saver capable of reading a RSS feed with images and news. For
3506 fun, I used it this summer to test Kodi on my parents TV by hooking up
3507 a Raspberry PI unit with LibreELEC, and wanted to provide them with a
3508 screen saver showing selected pictures from my selection.
</p
>
3510 <p
>Armed with motivation and a test photo frame, I set out to generate
3511 a RSS feed for the Kodi instance. I adjusted my
<a
3512 href=
"https://freedombox.org/
">Freedombox
</a
> instance, created
3513 /var/www/html/privatepictures/, wrote a small Perl script to extract
3514 title and description metadata from the photo files and generate the
3515 RSS file. I ended up using Perl instead of python, as the
3516 libimage-exiftool-perl Debian package seemed to handle the EXIF/XMP
3517 tags I ended up using, while python3-exif did not. The relevant EXIF
3518 tags only support ASCII, so I had to find better alternatives. XMP
3519 seem to have the support I need.
</p
>
3521 <p
>I am a bit unsure which EXIF/XMP tags to use, as I would like to
3522 use tags that can be easily added/updated using normal free software
3523 photo managing software. I ended up using the tags set using this
3524 exiftool command, as these tags can also be set using digiKam:
</p
>
3526 <blockquote
><pre
>
3527 exiftool -headline=
'The RSS image title
' \
3528 -description=
'The RSS image description.
' \
3529 -subject+=for-family photo.jpeg
3530 </pre
></blockquote
>
3532 <p
>I initially tried the
"-title
" and
"keyword
" tags, but they were
3533 invisible in digiKam, so I changed to
"-headline
" and
"-subject
". I
3534 use the keyword/subject
'for-family
' to flag that the photo should be
3535 shared with my family. Images with this keyword set are located and
3536 copied into my Freedombox for the RSS generating script to find.
</p
>
3538 <p
>Are there better ways to do this? Get in touch if you have better
3539 suggestions.
</p
>
3541 <p
>As usual, if you use Bitcoin and want to show your support of my
3542 activities, please send Bitcoin donations to my address
3543 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3548 <title>Simple streaming the Linux desktop to Kodi using GStreamer and RTP
</title>
3549 <link>http://www.hungry.com/~pere/blog/Simple_streaming_the_Linux_desktop_to_Kodi_using_GStreamer_and_RTP.html
</link>
3550 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Simple_streaming_the_Linux_desktop_to_Kodi_using_GStreamer_and_RTP.html
</guid>
3551 <pubDate>Thu,
12 Jul
2018 17:
55:
00 +
0200</pubDate>
3552 <description><p
>Last night, I wrote
3553 <a href=
"http://www.hungry.com/~pere/blog/Streaming_the_Linux_desktop_to_Kodi_using_VLC_and_RTSP.html
">a
3554 recipe to stream a Linux desktop using VLC to a instance of Kodi
</a
>.
3555 During the day I received valuable feedback, and thanks to the
3556 suggestions I have been able to rewrite the recipe into a much simpler
3557 approach requiring no setup at all. It is a single script that take
3558 care of it all.
</p
>
3560 <p
>This new script uses GStreamer instead of VLC to capture the
3561 desktop and stream it to Kodi. This fixed the video quality issue I
3562 saw initially. It further removes the need to add a m3u file on the
3563 Kodi machine, as it instead connects to
3564 <a href=
"https://kodi.wiki/view/JSON-RPC_API/v8
">the JSON-RPC API in
3565 Kodi
</a
> and simply ask Kodi to play from the stream created using
3566 GStreamer. Streaming the desktop to Kodi now become trivial. Copy
3567 the script below, run it with the DNS name or IP address of the kodi
3568 server to stream to as the only argument, and watch your screen show
3569 up on the Kodi screen. Note, it depend on multicast on the local
3570 network, so if you need to stream outside the local network, the
3571 script must be modified. Also note, I have no idea if audio work, as
3572 I only care about the picture part.
</p
>
3574 <blockquote
><pre
>
3577 # Stream the Linux desktop view to Kodi. See
3578 # http://www.hungry.com/~pere/blog/Streaming_the_Linux_desktop_to_Kodi_using_VLC_and_RTSP.html
3579 # for backgorund information.
3581 # Make sure the stream is stopped in Kodi and the gstreamer process is
3582 # killed if something go wrong (for example if curl is unable to find the
3583 # kodi server). Do the same when interrupting this script.
3587 params=
"$
3"
3588 curl --silent --header
'Content-Type: application/json
' \
3589 --data-binary
"{ \
"id\
":
1, \
"jsonrpc\
": \
"2.0\
", \
"method\
": \
"$cmd\
", \
"params\
": $params }
" \
3590 "http://$host/jsonrpc
"
3593 if [ -n
"$kodihost
" ] ; then
3594 # Stop the playing when we end
3595 playerid=$(kodicmd
"$kodihost
" Player.GetActivePlayers
"{}
" |
3596 jq .result[].playerid)
3597 kodicmd
"$kodihost
" Player.Stop
"{ \
"playerid\
" : $playerid }
" > /dev/null
3599 if [
"$gstpid
" ]
&& kill -
0 "$gstpid
" >/dev/null
2>&1; then
3600 kill
"$gstpid
"
3603 trap cleanup EXIT INT
3605 if [ -n
"$
1" ]; then
3616 pasrc=$(pactl list | grep -A2
'Source #
' | grep
'Name: .*\.monitor$
' | \
3617 cut -d
" " -f2|head -
1)
3618 gst-launch-
1.0 ximagesrc use-damage=
0 ! video/x-raw,framerate=
30/
1 ! \
3619 videoconvert ! queue2 ! \
3620 x264enc bitrate=
8000 speed-preset=superfast tune=zerolatency qp-min=
30 \
3621 key-int-max=
15 bframes=
2 ! video/x-h264,profile=high ! queue2 ! \
3622 mpegtsmux alignment=
7 name=mux ! rndbuffersize max=
1316 min=
1316 ! \
3623 udpsink host=$mcast port=$mcastport ttl-mc=$mcastttl auto-multicast=
1 sync=
0 \
3624 pulsesrc device=$pasrc ! audioconvert ! queue2 ! avenc_aac ! queue2 ! mux. \
3625 > /dev/null
2>&1 &
3628 # Give stream a second to get going
3631 # Ask kodi to start streaming using its JSON-RPC API
3632 kodicmd
"$kodihost
" Player.Open \
3633 "{\
"item\
": { \
"file\
": \
"udp://@$mcast:$mcastport\
" } }
" > /dev/null
3635 # wait for gst to end
3636 wait
"$gstpid
"
3637 </pre
></blockquote
>
3639 <p
>I hope you find the approach useful. I know I do.
</p
>
3641 <p
>As usual, if you use Bitcoin and want to show your support of my
3642 activities, please send Bitcoin donations to my address
3643 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3648 <title>Streaming the Linux desktop to Kodi using VLC and RTSP
</title>
3649 <link>http://www.hungry.com/~pere/blog/Streaming_the_Linux_desktop_to_Kodi_using_VLC_and_RTSP.html
</link>
3650 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Streaming_the_Linux_desktop_to_Kodi_using_VLC_and_RTSP.html
</guid>
3651 <pubDate>Thu,
12 Jul
2018 02:
00:
00 +
0200</pubDate>
3652 <description><p
>PS: See
3653 <ahref=
"http://www.hungry.com/~pere/blog/Simple_streaming_the_Linux_desktop_to_Kodi_using_GStreamer_and_RTP.html
">the
3654 followup post
</a
> for a even better approach.
</p
>
3656 <p
>A while back, I was asked by a friend how to stream the desktop to
3657 my projector connected to Kodi. I sadly had to admit that I had no
3658 idea, as it was a task I never had tried. Since then, I have been
3659 looking for a way to do so, preferable without much extra software to
3660 install on either side. Today I found a way that seem to kind of
3661 work. Not great, but it is a start.
</p
>
3663 <p
>I had a look at several approaches, for example
3664 <a href=
"https://github.com/mfoetsch/dlna_live_streaming
">using uPnP
3665 DLNA as described in
2011</a
>, but it required a uPnP server, fuse and
3666 local storage enough to store the stream locally. This is not going
3667 to work well for me, lacking enough free space, and it would
3668 impossible for my friend to get working.
</p
>
3670 <p
>Next, it occurred to me that perhaps I could use VLC to create a
3671 video stream that Kodi could play. Preferably using
3672 broadcast/multicast, to avoid having to change any setup on the Kodi
3673 side when starting such stream. Unfortunately, the only recipe I
3674 could find using multicast used the rtp protocol, and this protocol
3675 seem to not be supported by Kodi.
</p
>
3677 <p
>On the other hand, the rtsp protocol is working! Unfortunately I
3678 have to specify the IP address of the streaming machine in both the
3679 sending command and the file on the Kodi server. But it is showing my
3680 desktop, and thus allow us to have a shared look on the big screen at
3681 the programs I work on.
</p
>
3683 <p
>I did not spend much time investigating codeces. I combined the
3684 rtp and rtsp recipes from
3685 <a href=
"https://wiki.videolan.org/Documentation:Streaming_HowTo/Command_Line_Examples/
">the
3686 VLC Streaming HowTo/Command Line Examples
</a
>, and was able to get
3687 this working on the desktop/streaming end.
</p
>
3689 <blockquote
><pre
>
3690 vlc screen:// --sout \
3691 '#transcode{vcodec=mp4v,acodec=mpga,vb=
800,ab=
128}:rtp{dst=projector.local,port=
1234,sdp=rtsp://
192.168.11.4:
8080/test.sdp}
'
3692 </pre
></blockquote
>
3694 <p
>I ssh-ed into my Kodi box and created a file like this with the
3695 same IP address:
</p
>
3697 <blockquote
><pre
>
3698 echo rtsp://
192.168.11.4:
8080/test.sdp \
3699 > /storage/videos/screenstream.m3u
3700 </pre
></blockquote
>
3702 <p
>Note the
192.168.11.4 IP address is my desktops IP address. As far
3703 as I can tell the IP must be hardcoded for this to work. In other
3704 words, if someone elses machine is going to do the steaming, you have
3705 to update screenstream.m3u on the Kodi machine and adjust the vlc
3706 recipe. To get started, locate the file in Kodi and select the m3u
3707 file while the VLC stream is running. The desktop then show up in my
3708 big screen. :)
</p
>
3710 <p
>When using the same technique to stream a video file with audio,
3711 the audio quality is really bad. No idea if the problem is package
3712 loss or bad parameters for the transcode. I do not know VLC nor Kodi
3713 enough to tell.
</p
>
3715 <p
><strong
>Update
2018-
07-
12</strong
>: Johannes Schauer send me a few
3716 succestions and reminded me about an important step. The
"screen:
"
3717 input source is only available once the vlc-plugin-access-extra
3718 package is installed on Debian. Without it, you will see this error
3719 message:
"VLC is unable to open the MRL
'screen://
'. Check the log
3720 for details.
" He further found that it is possible to drop some parts
3721 of the VLC command line to reduce the amount of hardcoded information.
3722 It is also useful to consider using cvlc to avoid having the VLC
3723 window in the desktop view. In sum, this give us this command line on
3726 <blockquote
><pre
>
3727 cvlc screen:// --sout \
3728 '#transcode{vcodec=mp4v,acodec=mpga,vb=
800,ab=
128}:rtp{sdp=rtsp://:
8080/}
'
3729 </pre
></blockquote
>
3731 <p
>and this on the Kodi end
<p
>
3733 <blockquote
><pre
>
3734 echo rtsp://
192.168.11.4:
8080/ \
3735 > /storage/videos/screenstream.m3u
3736 </pre
></blockquote
>
3738 <p
>Still bad image quality, though. But I did discover that streaming
3739 a DVD using dvdsimple:///dev/dvd as the source had excellent video and
3740 audio quality, so I guess the issue is in the input or transcoding
3741 parts, not the rtsp part. I
've tried to change the vb and ab
3742 parameters to use more bandwidth, but it did not make a
3743 difference.
</p
>
3745 <p
>I further received a suggestion from Einar Haraldseid to try using
3746 gstreamer instead of VLC, and this proved to work great! He also
3747 provided me with the trick to get Kodi to use a multicast stream as
3748 its source. By using this monstrous oneliner, I can stream my desktop
3749 with good video quality in reasonable framerate to the
239.255.0.1
3750 multicast address on port
1234:
3752 <blockquote
><pre
>
3753 gst-launch-
1.0 ximagesrc use-damage=
0 ! video/x-raw,framerate=
30/
1 ! \
3754 videoconvert ! queue2 ! \
3755 x264enc bitrate=
8000 speed-preset=superfast tune=zerolatency qp-min=
30 \
3756 key-int-max=
15 bframes=
2 ! video/x-h264,profile=high ! queue2 ! \
3757 mpegtsmux alignment=
7 name=mux ! rndbuffersize max=
1316 min=
1316 ! \
3758 udpsink host=
239.255.0.1 port=
1234 ttl-mc=
1 auto-multicast=
1 sync=
0 \
3759 pulsesrc device=$(pactl list | grep -A2
'Source #
' | \
3760 grep
'Name: .*\.monitor$
' | cut -d
" " -f2|head -
1) ! \
3761 audioconvert ! queue2 ! avenc_aac ! queue2 ! mux.
3762 </pre
></blockquote
>
3764 <p
>and this on the Kodi end
<p
>
3766 <blockquote
><pre
>
3767 echo udp://@
239.255.0.1:
1234 \
3768 > /storage/videos/screenstream.m3u
3769 </pre
></blockquote
>
3771 <p
>Note the trick to pick a valid pulseaudio source. It might not
3772 pick the one you need. This approach will of course lead to trouble
3773 if more than one source uses the same multicast port and address.
3774 Note the ttl-mc=
1 setting, which limit the multicast packages to the
3775 local network. If the value is increased, your screen will be
3776 broadcasted further, one network
"hop
" for each increase (read up on
3777 multicast to learn more. :)!
</p
>
3779 <p
>Having cracked how to get Kodi to receive multicast streams, I
3780 could use this VLC command to stream to the same multicast address.
3781 The image quality is way better than the rtsp approach, but gstreamer
3782 seem to be doing a better job.
</p
>
3784 <blockquote
><pre
>
3785 cvlc screen:// --sout
'#transcode{vcodec=mp4v,acodec=mpga,vb=
800,ab=
128}:rtp{mux=ts,dst=
239.255.0.1,port=
1234,sdp=sap}
'
3786 </pre
></blockquote
>
3788 <p
>As usual, if you use Bitcoin and want to show your support of my
3789 activities, please send Bitcoin donations to my address
3790 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3795 <title>What is the most supported MIME type in Debian in
2018?
</title>
3796 <link>http://www.hungry.com/~pere/blog/What_is_the_most_supported_MIME_type_in_Debian_in_2018_.html
</link>
3797 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_is_the_most_supported_MIME_type_in_Debian_in_2018_.html
</guid>
3798 <pubDate>Mon,
9 Jul
2018 08:
05:
00 +
0200</pubDate>
3799 <description><p
>Five years ago,
3800 <a href=
"http://www.hungry.com/~pere/blog/What_is_the_most_supported_MIME_type_in_Debian_.html
">I
3801 measured what the most supported MIME type in Debian was
</a
>, by
3802 analysing the desktop files in all packages in the archive. Since
3803 then, the DEP-
11 AppStream system has been put into production, making
3804 the task a lot easier. This made me want to repeat the measurement,
3805 to see how much things changed. Here are the new numbers, for
3806 unstable only this time:
3808 <p
><strong
>Debian Unstable:
</strong
></p
>
3812 ----- -----------------------
3824 30 audio/x-vorbis+ogg
3825 29 image/x-portable-pixmap
3827 27 image/x-portable-bitmap
3829 26 application/x-ogg
3835 <p
>The list was created like this using a sid chroot:
"cat
3836 /var/lib/apt/lists/*sid*_dep11_Components-amd64.yml.gz| zcat | awk
'/^
3837 - \S+\/\S+$/ {print $
2 }
' | sort | uniq -c | sort -nr | head -
20"</p
>
3839 <p
>It is interesting to see how image formats have passed text/plain
3840 as the most announced supported MIME type. These days, thanks to the
3841 AppStream system, if you run into a file format you do not know, and
3842 want to figure out which packages support the format, you can find the
3843 MIME type of the file using
"file --mime
&lt;filename
&gt;
", and then
3844 look up all packages announcing support for this format in their
3845 AppStream metadata (XML or .desktop file) using
"appstreamcli
3846 what-provides mimetype
&lt;mime-type
&gt;. For example if you, like
3847 me, want to know which packages support inode/directory, you can get a
3848 list like this:
</p
>
3850 <p
><blockquote
><pre
>
3851 % appstreamcli what-provides mimetype inode/directory | grep Package: | sort
3858 Package: doublecmd-common
3860 Package: enlightenment
3880 </pre
></blockquote
></p
>
3882 <p
>Using the same method, I can quickly discover that the Sketchup file
3883 format is not yet supported by any package in Debian:
</p
>
3885 <p
><blockquote
><pre
>
3886 % appstreamcli what-provides mimetype application/vnd.sketchup.skp
3887 Could not find component providing
'mimetype::application/vnd.sketchup.skp
'.
3889 </pre
></blockquote
></p
>
3891 <p
>Yesterday I used it to figure out which packages support the STL
3D
3894 <p
><blockquote
><pre
>
3895 % appstreamcli what-provides mimetype application/sla|grep Package
3900 </pre
></blockquote
></p
>
3902 <p
>PS: A new version of Cura was uploaded to Debian yesterday.
</p
>
3904 <p
>As usual, if you use Bitcoin and want to show your support of my
3905 activities, please send Bitcoin donations to my address
3906 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3911 <title>Debian APT upgrade without enough free space on the disk...
</title>
3912 <link>http://www.hungry.com/~pere/blog/Debian_APT_upgrade_without_enough_free_space_on_the_disk___.html
</link>
3913 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_APT_upgrade_without_enough_free_space_on_the_disk___.html
</guid>
3914 <pubDate>Sun,
8 Jul
2018 12:
10:
00 +
0200</pubDate>
3915 <description><p
>Quite regularly, I let my Debian Sid/Unstable chroot stay untouch
3916 for a while, and when I need to update it there is not enough free
3917 space on the disk for apt to do a normal
'apt upgrade
'. I normally
3918 would resolve the issue by doing
'apt install
&lt;somepackages
&gt;
' to
3919 upgrade only some of the packages in one batch, until the amount of
3920 packages to download fall below the amount of free space available.
3921 Today, I had about
500 packages to upgrade, and after a while I got
3922 tired of trying to install chunks of packages manually. I concluded
3923 that I did not have the spare hours required to complete the task, and
3924 decided to see if I could automate it. I came up with this small
3925 script which I call
'apt-in-chunks
':
</p
>
3927 <p
><blockquote
><pre
>
3930 # Upgrade packages when the disk is too full to upgrade every
3931 # upgradable package in one lump. Fetching packages to upgrade using
3932 # apt, and then installing using dpkg, to avoid changing the package
3933 # flag for manual/automatic.
3938 if [
"$
1" ]; then
3939 grep -v
"$
1"
3945 for p in $(apt list --upgradable | ignore
"$@
" |cut -d/ -f1 | grep -v
'^Listing...
'); do
3946 echo
"Upgrading $p
"
3948 apt install --download-only -y $p
3949 for f in /var/cache/apt/archives/*.deb; do
3950 if [ -e
"$f
" ]; then
3951 dpkg -i /var/cache/apt/archives/*.deb
3956 </pre
></blockquote
></p
>
3958 <p
>The script will extract the list of packages to upgrade, try to
3959 download the packages needed to upgrade one package, install the
3960 downloaded packages using dpkg. The idea is to upgrade packages
3961 without changing the APT mark for the package (ie the one recording of
3962 the package was manually requested or pulled in as a dependency). To
3963 use it, simply run it as root from the command line. If it fail, try
3964 'apt install -f
' to clean up the mess and run the script again. This
3965 might happen if the new packages conflict with one of the old
3966 packages. dpkg is unable to remove, while apt can do this.
</p
>
3968 <p
>It take one option, a package to ignore in the list of packages to
3969 upgrade. The option to ignore a package is there to be able to skip
3970 the packages that are simply too large to unpack. Today this was
3971 'ghc
', but I have run into other large packages causing similar
3972 problems earlier (like TeX).
</p
>
3974 <p
>Update
2018-
07-
08: Thanks to Paul Wise, I am aware of two
3975 alternative ways to handle this. The
"unattended-upgrades
3976 --minimal-upgrade-steps
" option will try to calculate upgrade sets for
3977 each package to upgrade, and then upgrade them in order, smallest set
3978 first. It might be a better option than my above mentioned script.
3979 Also,
"aptutude upgrade
" can upgrade single packages, thus avoiding
3980 the need for using
"dpkg -i
" in the script above.
</p
>
3982 <p
>As usual, if you use Bitcoin and want to show your support of my
3983 activities, please send Bitcoin donations to my address
3984 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3989 <title>Version
3.1 of Cura, the
3D print slicer, is now in Debian
</title>
3990 <link>http://www.hungry.com/~pere/blog/Version_3_1_of_Cura__the_3D_print_slicer__is_now_in_Debian.html
</link>
3991 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Version_3_1_of_Cura__the_3D_print_slicer__is_now_in_Debian.html
</guid>
3992 <pubDate>Tue,
13 Feb
2018 06:
20:
00 +
0100</pubDate>
3993 <description><p
>A new version of the
3994 <a href=
"https://tracker.debian.org/pkg/cura
">3D printer slicer
3995 software Cura
</a
>, version
3.1.0, is now available in Debian Testing
3996 (aka Buster) and Debian Unstable (aka Sid). I hope you find it
3997 useful. It was uploaded the last few days, and the last update will
3998 enter testing tomorrow. See the
3999 <a href=
"https://ultimaker.com/en/products/cura-software/release-notes
">release
4000 notes
</a
> for the list of bug fixes and new features. Version
3.2
4001 was announced
6 days ago. We will try to get it into Debian as
4004 <p
>More information related to
3D printing is available on the
4005 <a href=
"https://wiki.debian.org/
3DPrinting
">3D printing
</a
> and
4006 <a href=
"https://wiki.debian.org/
3D-printer
">3D printer
</a
> wiki pages
4007 in Debian.
</p
>
4009 <p
>As usual, if you use Bitcoin and want to show your support of my
4010 activities, please send Bitcoin donations to my address
4011 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
4016 <title>Cura, the nice
3D print slicer, is now in Debian Unstable
</title>
4017 <link>http://www.hungry.com/~pere/blog/Cura__the_nice_3D_print_slicer__is_now_in_Debian_Unstable.html
</link>
4018 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Cura__the_nice_3D_print_slicer__is_now_in_Debian_Unstable.html
</guid>
4019 <pubDate>Sun,
17 Dec
2017 07:
00:
00 +
0100</pubDate>
4020 <description><p
>After several months of working and waiting, I am happy to report
4021 that the nice and user friendly
3D printer slicer software Cura just
4022 entered Debian Unstable. It consist of five packages,
4023 <a href=
"https://tracker.debian.org/pkg/cura
">cura
</a
>,
4024 <a href=
"https://tracker.debian.org/pkg/cura-engine
">cura-engine
</a
>,
4025 <a href=
"https://tracker.debian.org/pkg/libarcus
">libarcus
</a
>,
4026 <a href=
"https://tracker.debian.org/pkg/fdm-materials
">fdm-materials
</a
>,
4027 <a href=
"https://tracker.debian.org/pkg/libsavitar
">libsavitar
</a
> and
4028 <a href=
"https://tracker.debian.org/pkg/uranium
">uranium
</a
>. The last
4029 two, uranium and cura, entered Unstable yesterday. This should make
4030 it easier for Debian users to print on at least the Ultimaker class of
4031 3D printers. My nearest
3D printer is an Ultimaker
2+, so it will
4032 make life easier for at least me. :)
</p
>
4034 <p
>The work to make this happen was done by Gregor Riepl, and I was
4035 happy to assist him in sponsoring the packages. With the introduction
4036 of Cura, Debian is up to three
3D printer slicers at your service,
4037 Cura, Slic3r and Slic3r Prusa. If you own or have access to a
3D
4038 printer, give it a go. :)
</p
>
4040 <p
>The
3D printer software is maintained by the
3D printer Debian
4041 team, flocking together on the
4042 <a href=
"http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/
3dprinter-general
">3dprinter-general
</a
>
4043 mailing list and the
4044 <a href=
"irc://irc.debian.org/#debian-
3dprinting
">#debian-
3dprinting
</a
>
4045 IRC channel.
</p
>
4047 <p
>The next step for Cura in Debian is to update the cura package to
4048 version
3.0.3 and then update the entire set of packages to version
4049 3.1.0 which showed up the last few days.
</p
>
4054 <title>Generating
3D prints in Debian using Cura and Slic3r(-prusa)
</title>
4055 <link>http://www.hungry.com/~pere/blog/Generating_3D_prints_in_Debian_using_Cura_and_Slic3r__prusa_.html
</link>
4056 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Generating_3D_prints_in_Debian_using_Cura_and_Slic3r__prusa_.html
</guid>
4057 <pubDate>Mon,
9 Oct
2017 10:
50:
00 +
0200</pubDate>
4058 <description><p
>At my nearby maker space,
4059 <a href=
"http://sonen.ifi.uio.no/
">Sonen
</a
>, I heard the story that it
4060 was easier to generate gcode files for theyr
3D printers (Ultimake
2+)
4061 on Windows and MacOS X than Linux, because the software involved had
4062 to be manually compiled and set up on Linux while premade packages
4063 worked out of the box on Windows and MacOS X. I found this annoying,
4064 as the software involved,
4065 <a href=
"https://github.com/Ultimaker/Cura
">Cura
</a
>, is free software
4066 and should be trivial to get up and running on Linux if someone took
4067 the time to package it for the relevant distributions. I even found
4068 <a href=
"https://bugs.debian.org/
706656">a request for adding into
4069 Debian
</a
> from
2013, which had seem some activity over the years but
4070 never resulted in the software showing up in Debian. So a few days
4071 ago I offered my help to try to improve the situation.
</p
>
4073 <p
>Now I am very happy to see that all the packages required by a
4074 working Cura in Debian are uploaded into Debian and waiting in the NEW
4075 queue for the ftpmasters to have a look. You can track the progress
4077 <a href=
"https://qa.debian.org/developer.php?email=
3dprinter-general%
40lists.alioth.debian.org
">the
4078 status page for the
3D printer team
</a
>.
</p
>
4080 <p
>The uploaded packages are a bit behind upstream, and was uploaded
4081 now to get slots in
<a href=
"https://ftp-master.debian.org/new.html
">the NEW
4082 queue
</a
> while we work up updating the packages to the latest
4083 upstream version.
</p
>
4085 <p
>On a related note, two competitors for Cura, which I found harder
4086 to use and was unable to configure correctly for Ultimaker
2+ in the
4087 short time I spent on it, are already in Debian. If you are looking
4088 for
3D printer
"slicers
" and want something already available in
4090 <a href=
"https://tracker.debian.org/pkg/slic3r
">slic3r
</a
> and
4091 <a href=
"https://tracker.debian.org/pkg/slic3r-prusa
">slic3r-prusa
</a
>.
4092 The latter is a fork of the former.
</p
>
4094 <p
>As usual, if you use Bitcoin and want to show your support of my
4095 activities, please send Bitcoin donations to my address
4096 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
4101 <title>Visualizing GSM radio chatter using gr-gsm and Hopglass
</title>
4102 <link>http://www.hungry.com/~pere/blog/Visualizing_GSM_radio_chatter_using_gr_gsm_and_Hopglass.html
</link>
4103 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Visualizing_GSM_radio_chatter_using_gr_gsm_and_Hopglass.html
</guid>
4104 <pubDate>Fri,
29 Sep
2017 10:
30:
00 +
0200</pubDate>
4105 <description><p
>Every mobile phone announce its existence over radio to the nearby
4106 mobile cell towers. And this radio chatter is available for anyone
4107 with a radio receiver capable of receiving them. Details about the
4108 mobile phones with very good accuracy is of course collected by the
4109 phone companies, but this is not the topic of this blog post. The
4110 mobile phone radio chatter make it possible to figure out when a cell
4111 phone is nearby, as it include the SIM card ID (IMSI). By paying
4112 attention over time, one can see when a phone arrive and when it leave
4113 an area. I believe it would be nice to make this information more
4114 available to the general public, to make more people aware of how
4115 their phones are announcing their whereabouts to anyone that care to
4118 <p
>I am very happy to report that we managed to get something
4119 visualizing this information up and running for
4120 <a href=
"http://norwaymakers.org/osf17
">Oslo Skaperfestival
2017</a
>
4121 (Oslo Makers Festival) taking place today and tomorrow at Deichmanske
4122 library. The solution is based on the
4123 <a href=
"http://www.hungry.com/~pere/blog/Easier_recipe_to_observe_the_cell_phones_around_you.html
">simple
4124 recipe for listening to GSM chatter
</a
> I posted a few days ago, and
4125 will show up at the stand of
<a href=
"http://sonen.ifi.uio.no/
">Åpen
4126 Sone from the Computer Science department of the University of
4127 Oslo
</a
>. The presentation will show the nearby mobile phones (aka
4128 IMSIs) as dots in a web browser graph, with lines to the dot
4129 representing mobile base station it is talking to. It was working in
4130 the lab yesterday, and was moved into place this morning.
</p
>
4132 <p
>We set up a fairly powerful desktop machine using Debian
4133 Buster/Testing with several (five, I believe) RTL2838 DVB-T receivers
4134 connected and visualize the visible cell phone towers using an
4135 <a href=
"https://github.com/marlow925/hopglass
">English version of
4136 Hopglass
</a
>. A fairly powerfull machine is needed as the
4137 grgsm_livemon_headless processes from
4138 <a href=
"https://tracker.debian.org/pkg/gr-gsm
">gr-gsm
</a
> converting
4139 the radio signal to data packages is quite CPU intensive.
</p
>
4141 <p
>The frequencies to listen to, are identified using a slightly
4142 patched scan-and-livemon (to set the --args values for each receiver),
4143 and the Hopglass data is generated using the
4144 <a href=
"https://github.com/petterreinholdtsen/IMSI-catcher/tree/meshviewer-output
">patches
4145 in my meshviewer-output branch
</a
>. For some reason we could not get
4146 more than four SDRs working. There is also a geographical map trying
4147 to show the location of the base stations, but I believe their
4148 coordinates are hardcoded to some random location in Germany, I
4149 believe. The code should be replaced with code to look up location in
4150 a text file, a sqlite database or one of the online databases
4152 <a href=
"https://github.com/Oros42/IMSI-catcher/issues/
14">the github
4153 issue for the topic
</a
>.
4155 <p
>If this sound interesting, visit the stand at the festival!
</p
>
4160 <title>Easier recipe to observe the cell phones around you
</title>
4161 <link>http://www.hungry.com/~pere/blog/Easier_recipe_to_observe_the_cell_phones_around_you.html
</link>
4162 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Easier_recipe_to_observe_the_cell_phones_around_you.html
</guid>
4163 <pubDate>Sun,
24 Sep
2017 08:
30:
00 +
0200</pubDate>
4164 <description><p
>A little more than a month ago I wrote
4165 <a href=
"http://www.hungry.com/~pere/blog/Simpler_recipe_on_how_to_make_a_simple__7_IMSI_Catcher_using_Debian.html
">how
4166 to observe the SIM card ID (aka IMSI number) of mobile phones talking
4167 to nearby mobile phone base stations using Debian GNU/Linux and a
4168 cheap USB software defined radio
</a
>, and thus being able to pinpoint
4169 the location of people and equipment (like cars and trains) with an
4170 accuracy of a few kilometer. Since then we have worked to make the
4171 procedure even simpler, and it is now possible to do this without any
4172 manual frequency tuning and without building your own packages.
</p
>
4174 <p
>The
<a href=
"https://tracker.debian.org/pkg/gr-gsm
">gr-gsm
</a
>
4175 package is now included in Debian testing and unstable, and the
4176 IMSI-catcher code no longer require root access to fetch and decode
4177 the GSM data collected using gr-gsm.
</p
>
4179 <p
>Here is an updated recipe, using packages built by Debian and a git
4180 clone of two python scripts:
</p
>
4184 <li
>Start with a Debian machine running the Buster version (aka
4185 testing).
</li
>
4187 <li
>Run
'<tt
>apt install gr-gsm python-numpy python-scipy
4188 python-scapy
</tt
>' as root to install required packages.
</li
>
4190 <li
>Fetch the code decoding GSM packages using
'<tt
>git clone
4191 github.com/Oros42/IMSI-catcher.git
</tt
>'.
</li
>
4193 <li
>Insert USB software defined radio supported by GNU Radio.
</li
>
4195 <li
>Enter the IMSI-catcher directory and run
'<tt
>python
4196 scan-and-livemon
</tt
>' to locate the frequency of nearby base
4197 stations and start listening for GSM packages on one of them.
</li
>
4199 <li
>Enter the IMSI-catcher directory and run
'<tt
>python
4200 simple_IMSI-catcher.py
</tt
>' to display the collected information.
</li
>
4204 <p
>Note, due to a bug somewhere the scan-and-livemon program (actually
4205 <a href=
"https://github.com/ptrkrysik/gr-gsm/issues/
336">its underlying
4206 program grgsm_scanner
</a
>) do not work with the HackRF radio. It does
4207 work with RTL
8232 and other similar USB radio receivers you can get
4209 (
<a href=
"https://www.ebay.com/sch/items/?_nkw=rtl+
2832">for example
4210 from ebay
</a
>), so for now the solution is to scan using the RTL radio
4211 and only use HackRF for fetching GSM data.
</p
>
4213 <p
>As far as I can tell, a cell phone only show up on one of the
4214 frequencies at the time, so if you are going to track and count every
4215 cell phone around you, you need to listen to all the frequencies used.
4216 To listen to several frequencies, use the --numrecv argument to
4217 scan-and-livemon to use several receivers. Further, I am not sure if
4218 phones using
3G or
4G will show as talking GSM to base stations, so
4219 this approach might not see all phones around you. I typically see
4220 0-
400 IMSI numbers an hour when looking around where I live.
</p
>
4222 <p
>I
've tried to run the scanner on a
4223 <a href=
"https://wiki.debian.org/RaspberryPi
">Raspberry Pi
2 and
3
4224 running Debian Buster
</a
>, but the grgsm_livemon_headless process seem
4225 to be too CPU intensive to keep up. When GNU Radio print
'O
' to
4226 stdout, I am told there it is caused by a buffer overflow between the
4227 radio and GNU Radio, caused by the program being unable to read the
4228 GSM data fast enough. If you see a stream of
'O
's from the terminal
4229 where you started scan-and-livemon, you need a give the process more
4230 CPU power. Perhaps someone are able to optimize the code to a point
4231 where it become possible to set up RPi3 based GSM sniffers? I tried
4232 using Raspbian instead of Debian, but there seem to be something wrong
4233 with GNU Radio on raspbian, causing glibc to abort().
</p
>
4238 <title>Simpler recipe on how to make a simple $
7 IMSI Catcher using Debian
</title>
4239 <link>http://www.hungry.com/~pere/blog/Simpler_recipe_on_how_to_make_a_simple__7_IMSI_Catcher_using_Debian.html
</link>
4240 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Simpler_recipe_on_how_to_make_a_simple__7_IMSI_Catcher_using_Debian.html
</guid>
4241 <pubDate>Wed,
9 Aug
2017 23:
59:
00 +
0200</pubDate>
4242 <description><p
>On friday, I came across an interesting article in the Norwegian
4243 web based ICT news magazine digi.no on
4244 <a href=
"https://www.digi.no/artikler/sikkerhetsforsker-lagde-enkel-imsi-catcher-for-
60-kroner-na-kan-mobiler-kartlegges-av-alle/
398588">how
4245 to collect the IMSI numbers of nearby cell phones
</a
> using the cheap
4246 DVB-T software defined radios. The article refered to instructions
4247 and
<a href=
"https://www.youtube.com/watch?v=UjwgNd_as30
">a recipe by
4248 Keld Norman on Youtube on how to make a simple $
7 IMSI Catcher
</a
>, and I decided to test them out.
</p
>
4250 <p
>The instructions said to use Ubuntu, install pip using apt (to
4251 bypass apt), use pip to install pybombs (to bypass both apt and pip),
4252 and the ask pybombs to fetch and build everything you need from
4253 scratch. I wanted to see if I could do the same on the most recent
4254 Debian packages, but this did not work because pybombs tried to build
4255 stuff that no longer build with the most recent openssl library or
4256 some other version skew problem. While trying to get this recipe
4257 working, I learned that the apt-
>pip-
>pybombs route was a long detour,
4258 and the only piece of software dependency missing in Debian was the
4259 gr-gsm package. I also found out that the lead upstream developer of
4260 gr-gsm (the name stand for GNU Radio GSM) project already had a set of
4261 Debian packages provided in an Ubuntu PPA repository. All I needed to
4262 do was to dget the Debian source package and built it.
</p
>
4264 <p
>The IMSI collector is a python script listening for packages on the
4265 loopback network device and printing to the terminal some specific GSM
4266 packages with IMSI numbers in them. The code is fairly short and easy
4267 to understand. The reason this work is because gr-gsm include a tool
4268 to read GSM data from a software defined radio like a DVB-T USB stick
4269 and other software defined radios, decode them and inject them into a
4270 network device on your Linux machine (using the loopback device by
4271 default). This proved to work just fine, and I
've been testing the
4272 collector for a few days now.
</p
>
4274 <p
>The updated and simpler recipe is thus to
</p
>
4278 <li
>start with a Debian machine running Stretch or newer,
</li
>
4280 <li
>build and install the gr-gsm package available from
4281 <a href=
"http://ppa.launchpad.net/ptrkrysik/gr-gsm/ubuntu/pool/main/g/gr-gsm/
">http://ppa.launchpad.net/ptrkrysik/gr-gsm/ubuntu/pool/main/g/gr-gsm/
</a
>,
</li
>
4283 <li
>clone the git repostory from
<a href=
"https://github.com/Oros42/IMSI-catcher
">https://github.com/Oros42/IMSI-catcher
</a
>,
</li
>
4285 <li
>run grgsm_livemon and adjust the frequency until the terminal
4286 where it was started is filled with a stream of text (meaning you
4287 found a GSM station).
</li
>
4289 <li
>go into the IMSI-catcher directory and run
'sudo python simple_IMSI-catcher.py
' to extract the IMSI numbers.
</li
>
4293 <p
>To make it even easier in the future to get this sniffer up and
4294 running, I decided to package
4295 <a href=
"https://github.com/ptrkrysik/gr-gsm/
">the gr-gsm project
</a
>
4296 for Debian (
<a href=
"https://bugs.debian.org/
871055">WNPP
4297 #
871055</a
>), and the package was uploaded into the NEW queue today.
4298 Luckily the gnuradio maintainer has promised to help me, as I do not
4299 know much about gnuradio stuff yet.
</p
>
4301 <p
>I doubt this
"IMSI cacher
" is anywhere near as powerfull as
4302 commercial tools like
4303 <a href=
"https://www.thespyphone.com/portable-imsi-imei-catcher/
">The
4304 Spy Phone Portable IMSI / IMEI Catcher
</a
> or the
4305 <a href=
"https://en.wikipedia.org/wiki/Stingray_phone_tracker
">Harris
4306 Stingray
</a
>, but I hope the existance of cheap alternatives can make
4307 more people realise how their whereabouts when carrying a cell phone
4308 is easily tracked. Seeing the data flow on the screen, realizing that
4309 I live close to a police station and knowing that the police is also
4310 wearing cell phones, I wonder how hard it would be for criminals to
4311 track the position of the police officers to discover when there are
4312 police near by, or for foreign military forces to track the location
4313 of the Norwegian military forces, or for anyone to track the location
4314 of government officials...
</p
>
4316 <p
>It is worth noting that the data reported by the IMSI-catcher
4317 script mentioned above is only a fraction of the data broadcasted on
4318 the GSM network. It will only collect one frequency at the time,
4319 while a typical phone will be using several frequencies, and not all
4320 phones will be using the frequencies tracked by the grgsm_livemod
4321 program. Also, there is a lot of radio chatter being ignored by the
4322 simple_IMSI-catcher script, which would be collected by extending the
4323 parser code. I wonder if gr-gsm can be set up to listen to more than
4324 one frequency?
</p
>
4329 <title>Norwegian Bokmål edition of Debian Administrator
's Handbook is now available
</title>
4330 <link>http://www.hungry.com/~pere/blog/Norwegian_Bokm_l_edition_of_Debian_Administrator_s_Handbook_is_now_available.html
</link>
4331 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Norwegian_Bokm_l_edition_of_Debian_Administrator_s_Handbook_is_now_available.html
</guid>
4332 <pubDate>Tue,
25 Jul
2017 21:
10:
00 +
0200</pubDate>
4333 <description><p align=
"center
"><img align=
"center
" src=
"http://www.hungry.com/~pere/blog/images/
2017-
07-
25-debian-handbook-nb-testprint.png
"/
></p
>
4335 <p
>I finally received a copy of the Norwegian Bokmål edition of
4336 "<a href=
"https://debian-handbook.info/
">The Debian Administrator
's
4337 Handbook
</a
>". This test copy arrived in the mail a few days ago, and
4338 I am very happy to hold the result in my hand. We spent around one and a half year translating it. This paperbook edition
4339 <a href=
"https://debian-handbook.info/get/#norwegian
">is available
4340 from lulu.com
</a
>. If you buy it quickly, you save
25% on the list
4341 price. The book is also available for download in electronic form as
4342 PDF, EPUB and Mobipocket, as can be
4343 <a href=
"https://debian-handbook.info/browse/nb-NO/stable/
">read online
4344 as a web page
</a
>.
</p
>
4346 <p
>This is the second book I publish (the first was the book
4347 "<a href=
"http://free-culture.cc/
">Free Culture
</a
>" by Lawrence Lessig
4349 <a href=
"http://www.lulu.com/shop/lawrence-lessig/free-culture/paperback/product-
22440520.html
">English
</a
>,
4350 <a href=
"http://www.lulu.com/shop/lawrence-lessig/culture-libre/paperback/product-
22645082.html
">French
</a
>
4352 <a href=
"http://www.lulu.com/shop/lawrence-lessig/fri-kultur/paperback/product-
22441576.html
">Norwegian
4353 Bokmål
</a
>), and I am very excited to finally wrap up this
4355 "<a href=
"http://www.lulu.com/shop/rapha%C3%ABl-hertzog-and-roland-mas/h%C3%A5ndbok-for-debian-administratoren/paperback/product-
23262290.html
">Håndbok
4356 for Debian-administratoren
</a
>" will be well received.
</p
>
4361 <title>Når nynorskoversettelsen svikter til eksamen...
</title>
4362 <link>http://www.hungry.com/~pere/blog/N_r_nynorskoversettelsen_svikter_til_eksamen___.html
</link>
4363 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/N_r_nynorskoversettelsen_svikter_til_eksamen___.html
</guid>
4364 <pubDate>Sat,
3 Jun
2017 08:
20:
00 +
0200</pubDate>
4365 <description><p
><a href=
"http://www.aftenposten.no/norge/Krever-at-elever-ma-fa-annullert-eksamen-etter-rot-med-oppgavetekster-
622459b.html
">Aftenposten
4366 melder i dag
</a
> om feil i eksamensoppgavene for eksamen i politikk og
4367 menneskerettigheter, der teksten i bokmåls og nynorskutgaven ikke var
4368 like. Oppgaveteksten er gjengitt i artikkelen, og jeg ble nysgjerring
4369 på om den fri oversetterløsningen
4370 <a href=
"https://www.apertium.org/
">Apertium
</a
> ville gjort en bedre
4371 jobb enn Utdanningsdirektoratet. Det kan se slik ut.
</p
>
4373 <p
>Her er bokmålsoppgaven fra eksamenen:
</p
>
4376 <p
>Drøft utfordringene knyttet til nasjonalstatenes og andre aktørers
4377 rolle og muligheter til å håndtere internasjonale utfordringer, som
4378 for eksempel flykningekrisen.
</p
>
4380 <p
>Vedlegge er eksempler på tekster som kan gi relevante perspektiver
4381 på temaet:
</p
>
4383 <li
>Flykningeregnskapet
2016, UNHCR og IDMC
4384 <li
>«Grenseløst Europa for fall» A-Magasinet,
26. november
2015
4389 <p
>Dette oversetter Apertium slik:
</p
>
4392 <p
>Drøft utfordringane knytte til nasjonalstatane sine og rolla til
4393 andre aktørar og høve til å handtera internasjonale utfordringar, som
4394 til dømes *flykningekrisen.
</p
>
4396 <p
>Vedleggja er døme på tekster som kan gje relevante perspektiv på
4400 <li
>*Flykningeregnskapet
2016, *UNHCR og *IDMC
</li
>
4401 <li
>«*Grenseløst Europa for fall» A-Magasinet,
26. november
2015</li
>
4406 <p
>Ord som ikke ble forstått er markert med stjerne (*), og trenger
4407 ekstra språksjekk. Men ingen ord er forsvunnet, slik det var i
4408 oppgaven elevene fikk presentert på eksamen. Jeg mistenker dog at
4409 "andre aktørers rolle og muligheter til ...
" burde vært oversatt til
4410 "rolla til andre aktørar og deira høve til ...
" eller noe slikt, men
4411 det er kanskje flisespikking. Det understreker vel bare at det alltid
4412 trengs korrekturlesning etter automatisk oversettelse.
</p
>
4417 <title>Detecting NFS hangs on Linux without hanging yourself...
</title>
4418 <link>http://www.hungry.com/~pere/blog/Detecting_NFS_hangs_on_Linux_without_hanging_yourself___.html
</link>
4419 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Detecting_NFS_hangs_on_Linux_without_hanging_yourself___.html
</guid>
4420 <pubDate>Thu,
9 Mar
2017 15:
20:
00 +
0100</pubDate>
4421 <description><p
>Over the years, administrating thousand of NFS mounting linux
4422 computers at the time, I often needed a way to detect if the machine
4423 was experiencing NFS hang. If you try to use
<tt
>df
</tt
> or look at a
4424 file or directory affected by the hang, the process (and possibly the
4425 shell) will hang too. So you want to be able to detect this without
4426 risking the detection process getting stuck too. It has not been
4427 obvious how to do this. When the hang has lasted a while, it is
4428 possible to find messages like these in dmesg:
</p
>
4430 <p
><blockquote
>
4431 nfs: server nfsserver not responding, still trying
4432 <br
>nfs: server nfsserver OK
4433 </blockquote
></p
>
4435 <p
>It is hard to know if the hang is still going on, and it is hard to
4436 be sure looking in dmesg is going to work. If there are lots of other
4437 messages in dmesg the lines might have rotated out of site before they
4438 are noticed.
</p
>
4440 <p
>While reading through the nfs client implementation in linux kernel
4441 code, I came across some statistics that seem to give a way to detect
4442 it. The om_timeouts sunrpc value in the kernel will increase every
4443 time the above log entry is inserted into dmesg. And after digging a
4444 bit further, I discovered that this value show up in
4445 /proc/self/mountstats on Linux.
</p
>
4447 <p
>The mountstats content seem to be shared between files using the
4448 same file system context, so it is enough to check one of the
4449 mountstats files to get the state of the mount point for the machine.
4450 I assume this will not show lazy umounted NFS points, nor NFS mount
4451 points in a different process context (ie with a different filesystem
4452 view), but that does not worry me.
</p
>
4454 <p
>The content for a NFS mount point look similar to this:
</p
>
4456 <p
><blockquote
><pre
>
4458 device /dev/mapper/Debian-var mounted on /var with fstype ext3
4459 device nfsserver:/mnt/nfsserver/home0 mounted on /mnt/nfsserver/home0 with fstype nfs statvers=
1.1
4460 opts: rw,vers=
3,rsize=
65536,wsize=
65536,namlen=
255,acregmin=
3,acregmax=
60,acdirmin=
30,acdirmax=
60,soft,nolock,proto=tcp,timeo=
600,retrans=
2,sec=sys,mountaddr=
129.240.3.145,mountvers=
3,mountport=
4048,mountproto=udp,local_lock=all
4462 caps: caps=
0x3fe7,wtmult=
4096,dtsize=
8192,bsize=
0,namlen=
255
4463 sec: flavor=
1,pseudoflavor=
1
4464 events:
61063112 732346265 1028140 35486205 16220064 8162542 761447191 71714012 37189 3891185 45561809 110486139 4850138 420353 15449177 296502 52736725 13523379 0 52182 9016896 1231 0 0 0 0 0
4465 bytes:
166253035039 219519120027 0 0 40783504807 185466229638 11677877 45561809
4466 RPC iostats version:
1.0 p/v:
100003/
3 (nfs)
4467 xprt: tcp
925 1 6810 0 0 111505412 111480497 109 2672418560317 0 248 53869103 22481820
4469 NULL:
0 0 0 0 0 0 0 0
4470 GETATTR:
61063106 61063108 0 9621383060 6839064400 453650 77291321 78926132
4471 SETATTR:
463469 463470 0 92005440 66739536 63787 603235 687943
4472 LOOKUP:
17021657 17021657 0 3354097764 4013442928 57216 35125459 35566511
4473 ACCESS:
14281703 14290009 5 2318400592 1713803640 1709282 4865144 7130140
4474 READLINK:
125 125 0 20472 18620 0 1112 1118
4475 READ:
4214236 4214237 0 715608524 41328653212 89884 22622768 22806693
4476 WRITE:
8479010 8494376 22 187695798568 1356087148 178264904 51506907 231671771
4477 CREATE:
171708 171708 0 38084748 46702272 873 1041833 1050398
4478 MKDIR:
3680 3680 0 773980 993920 26 23990 24245
4479 SYMLINK:
903 903 0 233428 245488 6 5865 5917
4480 MKNOD:
80 80 0 20148 21760 0 299 304
4481 REMOVE:
429921 429921 0 79796004 61908192 3313 2710416 2741636
4482 RMDIR:
3367 3367 0 645112 484848 22 5782 6002
4483 RENAME:
466201 466201 0 130026184 121212260 7075 5935207 5961288
4484 LINK:
289155 289155 0 72775556 67083960 2199 2565060 2585579
4485 READDIR:
2933237 2933237 0 516506204 13973833412 10385 3190199 3297917
4486 READDIRPLUS:
1652839 1652839 0 298640972 6895997744 84735 14307895 14448937
4487 FSSTAT:
6144 6144 0 1010516 1032192 51 9654 10022
4488 FSINFO:
2 2 0 232 328 0 1 1
4489 PATHCONF:
1 1 0 116 140 0 0 0
4490 COMMIT:
0 0 0 0 0 0 0 0
4492 device binfmt_misc mounted on /proc/sys/fs/binfmt_misc with fstype binfmt_misc
4494 </pre
></blockquote
></p
>
4496 <p
>The key number to look at is the third number in the per-op list.
4497 It is the number of NFS timeouts experiences per file system
4498 operation. Here
22 write timeouts and
5 access timeouts. If these
4499 numbers are increasing, I believe the machine is experiencing NFS
4500 hang. Unfortunately the timeout value do not start to increase right
4501 away. The NFS operations need to time out first, and this can take a
4502 while. The exact timeout value depend on the setup. For example the
4503 defaults for TCP and UDP mount points are quite different, and the
4504 timeout value is affected by the soft, hard, timeo and retrans NFS
4505 mount options.
</p
>
4507 <p
>The only way I have been able to get working on Debian and RedHat
4508 Enterprise Linux for getting the timeout count is to peek in /proc/.
4510 <ahref=
"http://docs.oracle.com/cd/E19253-
01/
816-
4555/netmonitor-
12/index.html
">Solaris
4511 10 System Administration Guide: Network Services
</a
>, the
'nfsstat -c
'
4512 command can be used to get these timeout values. But this do not work
4513 on Linux, as far as I can tell. I
4514 <ahref=
"http://bugs.debian.org/
857043">asked Debian about this
</a
>,
4515 but have not seen any replies yet.
</p
>
4517 <p
>Is there a better way to figure out if a Linux NFS client is
4518 experiencing NFS hangs? Is there a way to detect which processes are
4519 affected? Is there a way to get the NFS mount going quickly once the
4520 network problem causing the NFS hang has been cleared? I would very
4521 much welcome some clues, as we regularly run into NFS hangs.
</p
>
4526 <title>Norwegian Bokmål translation of The Debian Administrator
's Handbook complete, proofreading in progress
</title>
4527 <link>http://www.hungry.com/~pere/blog/Norwegian_Bokm_l_translation_of_The_Debian_Administrator_s_Handbook_complete__proofreading_in_progress.html
</link>
4528 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Norwegian_Bokm_l_translation_of_The_Debian_Administrator_s_Handbook_complete__proofreading_in_progress.html
</guid>
4529 <pubDate>Fri,
3 Mar
2017 14:
50:
00 +
0100</pubDate>
4530 <description><p
>For almost a year now, we have been working on making a Norwegian
4531 Bokmål edition of
<a href=
"https://debian-handbook.info/
">The Debian
4532 Administrator
's Handbook
</a
>. Now, thanks to the tireless effort of
4533 Ole-Erik, Ingrid and Andreas, the initial translation is complete, and
4534 we are working on the proof reading to ensure consistent language and
4535 use of correct computer science terms. The plan is to make the book
4536 available on paper, as well as in electronic form. For that to
4537 happen, the proof reading must be completed and all the figures need
4538 to be translated. If you want to help out, get in touch.
</p
>
4540 <p
><a href=
"http://www.hungry.com/~pere/debian-handbook/debian-handbook-nb-NO.pdf
">A
4542 fresh PDF edition
</a
> in A4 format (the final book will have smaller
4543 pages) of the book created every morning is available for
4544 proofreading. If you find any errors, please
4545 <a href=
"https://hosted.weblate.org/projects/debian-handbook/
">visit
4546 Weblate and correct the error
</a
>. The
4547 <a href=
"http://l.github.io/debian-handbook/stat/nb-NO/index.html
">state
4548 of the translation including figures
</a
> is a useful source for those
4549 provide Norwegian bokmål screen shots and figures.
</p
>
4554 <title>Unlimited randomness with the ChaosKey?
</title>
4555 <link>http://www.hungry.com/~pere/blog/Unlimited_randomness_with_the_ChaosKey_.html
</link>
4556 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Unlimited_randomness_with_the_ChaosKey_.html
</guid>
4557 <pubDate>Wed,
1 Mar
2017 20:
50:
00 +
0100</pubDate>
4558 <description><p
>A few days ago I ordered a small batch of
4559 <a href=
"http://altusmetrum.org/ChaosKey/
">the ChaosKey
</a
>, a small
4560 USB dongle for generating entropy created by Bdale Garbee and Keith
4561 Packard. Yesterday it arrived, and I am very happy to report that it
4562 work great! According to its designers, to get it to work out of the
4563 box, you need the Linux kernel version
4.1 or later. I tested on a
4564 Debian Stretch machine (kernel version
4.9), and there it worked just
4565 fine, increasing the available entropy very quickly. I wrote a small
4566 test oneliner to test. It first print the current entropy level,
4567 drain /dev/random, and then print the entropy level for five seconds.
4568 Here is the situation without the ChaosKey inserted:
</p
>
4570 <blockquote
><pre
>
4571 % cat /proc/sys/kernel/random/entropy_avail; \
4572 dd bs=
1M if=/dev/random of=/dev/null count=
1; \
4573 for n in $(seq
1 5); do \
4574 cat /proc/sys/kernel/random/entropy_avail; \
4580 28 byte kopiert,
0,
000264565 s,
106 kB/s
4587 </pre
></blockquote
>
4589 <p
>The entropy level increases by
3-
4 every second. In such case any
4590 application requiring random bits (like a HTTPS enabled web server)
4591 will halt and wait for more entrpy. And here is the situation with
4592 the ChaosKey inserted:
</p
>
4594 <blockquote
><pre
>
4595 % cat /proc/sys/kernel/random/entropy_avail; \
4596 dd bs=
1M if=/dev/random of=/dev/null count=
1; \
4597 for n in $(seq
1 5); do \
4598 cat /proc/sys/kernel/random/entropy_avail; \
4604 104 byte kopiert,
0,
000487647 s,
213 kB/s
4611 </pre
></blockquote
>
4613 <p
>Quite the difference. :) I bought a few more than I need, in case
4614 someone want to buy one here in Norway. :)
</p
>
4616 <p
>Update: The dongle was presented at Debconf last year. You might
4617 find
<a href=
"https://debconf16.debconf.org/talks/
94/
">the talk
4618 recording illuminating
</a
>. It explains exactly what the source of
4619 randomness is, if you are unable to spot it from the schema drawing
4620 available from the ChaosKey web site linked at the start of this blog
4626 <title>Where did that package go?
&mdash; geolocated IP traceroute
</title>
4627 <link>http://www.hungry.com/~pere/blog/Where_did_that_package_go___mdash__geolocated_IP_traceroute.html
</link>
4628 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Where_did_that_package_go___mdash__geolocated_IP_traceroute.html
</guid>
4629 <pubDate>Mon,
9 Jan
2017 12:
20:
00 +
0100</pubDate>
4630 <description><p
>Did you ever wonder where the web trafic really flow to reach the
4631 web servers, and who own the network equipment it is flowing through?
4632 It is possible to get a glimpse of this from using traceroute, but it
4633 is hard to find all the details. Many years ago, I wrote a system to
4634 map the Norwegian Internet (trying to figure out if our plans for a
4635 network game service would get low enough latency, and who we needed
4636 to talk to about setting up game servers close to the users. Back
4637 then I used traceroute output from many locations (I asked my friends
4638 to run a script and send me their traceroute output) to create the
4639 graph and the map. The output from traceroute typically look like
4642 <p
><pre
>
4643 traceroute to www.stortinget.no (
85.88.67.10),
30 hops max,
60 byte packets
4644 1 uio-gw10.uio.no (
129.240.202.1)
0.447 ms
0.486 ms
0.621 ms
4645 2 uio-gw8.uio.no (
129.240.24.229)
0.467 ms
0.578 ms
0.675 ms
4646 3 oslo-gw1.uninett.no (
128.39.65.17)
0.385 ms
0.373 ms
0.358 ms
4647 4 te3-
1-
2.br1.fn3.as2116.net (
193.156.90.3)
1.174 ms
1.172 ms
1.153 ms
4648 5 he16-
1-
1.cr1.san110.as2116.net (
195.0.244.234)
2.627 ms he16-
1-
1.cr2.oslosda310.as2116.net (
195.0.244.48)
3.172 ms he16-
1-
1.cr1.san110.as2116.net (
195.0.244.234)
2.857 ms
4649 6 ae1.ar8.oslosda310.as2116.net (
195.0.242.39)
0.662 ms
0.637 ms ae0.ar8.oslosda310.as2116.net (
195.0.242.23)
0.622 ms
4650 7 89.191.10.146 (
89.191.10.146)
0.931 ms
0.917 ms
0.955 ms
4654 </pre
></p
>
4656 <p
>This show the DNS names and IP addresses of (at least some of the)
4657 network equipment involved in getting the data traffic from me to the
4658 www.stortinget.no server, and how long it took in milliseconds for a
4659 package to reach the equipment and return to me. Three packages are
4660 sent, and some times the packages do not follow the same path. This
4661 is shown for hop
5, where three different IP addresses replied to the
4662 traceroute request.
</p
>
4664 <p
>There are many ways to measure trace routes. Other good traceroute
4665 implementations I use are traceroute (using ICMP packages) mtr (can do
4666 both ICMP, UDP and TCP) and scapy (python library with ICMP, UDP, TCP
4667 traceroute and a lot of other capabilities). All of them are easily
4668 available in
<a href=
"https://www.debian.org/
">Debian
</a
>.
</p
>
4670 <p
>This time around, I wanted to know the geographic location of
4671 different route points, to visualize how visiting a web page spread
4672 information about the visit to a lot of servers around the globe. The
4673 background is that a web site today often will ask the browser to get
4674 from many servers the parts (for example HTML, JSON, fonts,
4675 JavaScript, CSS, video) required to display the content. This will
4676 leak information about the visit to those controlling these servers
4677 and anyone able to peek at the data traffic passing by (like your ISP,
4678 the ISPs backbone provider, FRA, GCHQ, NSA and others).
</p
>
4680 <p
>Lets pick an example, the Norwegian parliament web site
4681 www.stortinget.no. It is read daily by all members of parliament and
4682 their staff, as well as political journalists, activits and many other
4683 citizens of Norway. A visit to the www.stortinget.no web site will
4684 ask your browser to contact
8 other servers: ajax.googleapis.com,
4685 insights.hotjar.com, script.hotjar.com, static.hotjar.com,
4686 stats.g.doubleclick.net, www.google-analytics.com,
4687 www.googletagmanager.com and www.netigate.se. I extracted this by
4688 asking
<a href=
"http://phantomjs.org/
">PhantomJS
</a
> to visit the
4689 Stortinget web page and tell me all the URLs PhantomJS downloaded to
4690 render the page (in HAR format using
4691 <a href=
"https://github.com/ariya/phantomjs/blob/master/examples/netsniff.js
">their
4692 netsniff example
</a
>. I am very grateful to Gorm for showing me how
4693 to do this). My goal is to visualize network traces to all IP
4694 addresses behind these DNS names, do show where visitors personal
4695 information is spread when visiting the page.
</p
>
4697 <p align=
"center
"><a href=
"www.stortinget.no-geoip.kml
"><img
4698 src=
"http://www.hungry.com/~pere/blog/images/
2017-
01-
09-www.stortinget.no-geoip-small.png
" alt=
"map of combined traces for URLs used by www.stortinget.no using GeoIP
"/
></a
></p
>
4700 <p
>When I had a look around for options, I could not find any good
4701 free software tools to do this, and decided I needed my own traceroute
4702 wrapper outputting KML based on locations looked up using GeoIP. KML
4703 is easy to work with and easy to generate, and understood by several
4704 of the GIS tools I have available. I got good help from by NUUG
4705 colleague Anders Einar with this, and the result can be seen in
4706 <a href=
"https://github.com/petterreinholdtsen/kmltraceroute
">my
4707 kmltraceroute git repository
</a
>. Unfortunately, the quality of the
4708 free GeoIP databases I could find (and the for-pay databases my
4709 friends had access to) is not up to the task. The IP addresses of
4710 central Internet infrastructure would typically be placed near the
4711 controlling companies main office, and not where the router is really
4712 located, as you can see from
<a href=
"www.stortinget.no-geoip.kml
">the
4713 KML file I created
</a
> using the GeoLite City dataset from MaxMind.
4715 <p align=
"center
"><a href=
"http://www.hungry.com/~pere/blog/images/
2017-
01-
09-www.stortinget.no-scapy.svg
"><img
4716 src=
"http://www.hungry.com/~pere/blog/images/
2017-
01-
09-www.stortinget.no-scapy-small.png
" alt=
"scapy traceroute graph for URLs used by www.stortinget.no
"/
></a
></p
>
4718 <p
>I also had a look at the visual traceroute graph created by
4719 <a href=
"http://www.secdev.org/projects/scapy/
">the scrapy project
</a
>,
4720 showing IP network ownership (aka AS owner) for the IP address in
4722 <a href=
"http://www.hungry.com/~pere/blog/images/
2017-
01-
09-www.stortinget.no-scapy.svg
">The
4723 graph display a lot of useful information about the traceroute in SVG
4724 format
</a
>, and give a good indication on who control the network
4725 equipment involved, but it do not include geolocation. This graph
4726 make it possible to see the information is made available at least for
4727 UNINETT, Catchcom, Stortinget, Nordunet, Google, Amazon, Telia, Level
4728 3 Communications and NetDNA.
</p
>
4730 <p align=
"center
"><a href=
"https://geotraceroute.com/index.php?node=
4&host=www.stortinget.no
"><img
4731 src=
"http://www.hungry.com/~pere/blog/images/
2017-
01-
09-www.stortinget.no-geotraceroute-small.png
" alt=
"example geotraceroute view for www.stortinget.no
"/
></a
></p
>
4733 <p
>In the process, I came across the
4734 <a href=
"https://geotraceroute.com/
">web service GeoTraceroute
</a
> by
4735 Salim Gasmi. Its methology of combining guesses based on DNS names,
4736 various location databases and finally use latecy times to rule out
4737 candidate locations seemed to do a very good job of guessing correct
4738 geolocation. But it could only do one trace at the time, did not have
4739 a sensor in Norway and did not make the geolocations easily available
4740 for postprocessing. So I contacted the developer and asked if he
4741 would be willing to share the code (he refused until he had time to
4742 clean it up), but he was interested in providing the geolocations in a
4743 machine readable format, and willing to set up a sensor in Norway. So
4744 since yesterday, it is possible to run traces from Norway in this
4745 service thanks to a sensor node set up by
4746 <a href=
"https://www.nuug.no/
">the NUUG assosiation
</a
>, and get the
4747 trace in KML format for further processing.
</p
>
4749 <p align=
"center
"><a href=
"http://www.hungry.com/~pere/blog/images/
2017-
01-
09-www.stortinget.no-geotraceroute-kml-join.kml
"><img
4750 src=
"http://www.hungry.com/~pere/blog/images/
2017-
01-
09-www.stortinget.no-geotraceroute-kml-join.png
" alt=
"map of combined traces for URLs used by www.stortinget.no using geotraceroute
"/
></a
></p
>
4752 <p
>Here we can see a lot of trafic passes Sweden on its way to
4753 Denmark, Germany, Holland and Ireland. Plenty of places where the
4754 Snowden confirmations verified the traffic is read by various actors
4755 without your best interest as their top priority.
</p
>
4757 <p
>Combining KML files is trivial using a text editor, so I could loop
4758 over all the hosts behind the urls imported by www.stortinget.no and
4759 ask for the KML file from GeoTraceroute, and create a combined KML
4760 file with all the traces (unfortunately only one of the IP addresses
4761 behind the DNS name is traced this time. To get them all, one would
4762 have to request traces using IP number instead of DNS names from
4763 GeoTraceroute). That might be the next step in this project.
</p
>
4765 <p
>Armed with these tools, I find it a lot easier to figure out where
4766 the IP traffic moves and who control the boxes involved in moving it.
4767 And every time the link crosses for example the Swedish border, we can
4768 be sure Swedish Signal Intelligence (FRA) is listening, as GCHQ do in
4769 Britain and NSA in USA and cables around the globe. (Hm, what should
4770 we tell them? :) Keep that in mind if you ever send anything
4771 unencrypted over the Internet.
</p
>
4773 <p
>PS: KML files are drawn using
4774 <a href=
"http://ivanrublev.me/kml/
">the KML viewer from Ivan
4775 Rublev
<a/
>, as it was less cluttered than the local Linux application
4776 Marble. There are heaps of other options too.
</p
>
4778 <p
>As usual, if you use Bitcoin and want to show your support of my
4779 activities, please send Bitcoin donations to my address
4780 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
4785 <title>Appstream just learned how to map hardware to packages too!
</title>
4786 <link>http://www.hungry.com/~pere/blog/Appstream_just_learned_how_to_map_hardware_to_packages_too_.html
</link>
4787 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Appstream_just_learned_how_to_map_hardware_to_packages_too_.html
</guid>
4788 <pubDate>Fri,
23 Dec
2016 10:
30:
00 +
0100</pubDate>
4789 <description><p
>I received a very nice Christmas present today. As my regular
4790 readers probably know, I have been working on the
4791 <a href=
"http://packages.qa.debian.org/isenkram
">the Isenkram
4792 system
</a
> for many years. The goal of the Isenkram system is to make
4793 it easier for users to figure out what to install to get a given piece
4794 of hardware to work in Debian, and a key part of this system is a way
4795 to map hardware to packages. Isenkram have its own mapping database,
4796 and also uses data provided by each package using the AppStream
4797 metadata format. And today,
4798 <a href=
"https://tracker.debian.org/pkg/appstream
">AppStream
</a
> in
4799 Debian learned to look up hardware the same way Isenkram is doing it,
4800 ie using fnmatch():
</p
>
4802 <p
><pre
>
4803 % appstreamcli what-provides modalias \
4804 usb:v1130p0202d0100dc00dsc00dp00ic03isc00ip00in00
4805 Identifier: pymissile [generic]
4807 Summary: Control original Striker USB Missile Launcher
4809 % appstreamcli what-provides modalias usb:v0694p0002d0000
4810 Identifier: libnxt [generic]
4812 Summary: utility library for talking to the LEGO Mindstorms NXT brick
4815 Identifier: t2n [generic]
4817 Summary: Simple command-line tool for Lego NXT
4820 Identifier: python-nxt [generic]
4822 Summary: Python driver/interface/wrapper for the Lego Mindstorms NXT robot
4825 Identifier: nbc [generic]
4827 Summary: C compiler for LEGO Mindstorms NXT bricks
4830 </pre
></p
>
4832 <p
>A similar query can be done using the combined AppStream and
4833 Isenkram databases using the isenkram-lookup tool:
</p
>
4835 <p
><pre
>
4836 % isenkram-lookup usb:v1130p0202d0100dc00dsc00dp00ic03isc00ip00in00
4838 % isenkram-lookup usb:v0694p0002d0000
4844 </pre
></p
>
4846 <p
>You can find modalias values relevant for your machine using
4847 <tt
>cat $(find /sys/devices/ -name modalias)
</tt
>.
4849 <p
>If you want to make this system a success and help Debian users
4850 make the most of the hardware they have, please help
4851 <a href=
"https://wiki.debian.org/AppStream/Guidelines
">add AppStream
4852 metadata for your package following the guidelines
</a
> documented in
4853 the wiki. So far only
11 packages provide such information, among the
4854 several hundred hardware specific packages in Debian. The Isenkram
4855 database on the other hand contain
101 packages, mostly related to USB
4856 dongles. Most of the packages with hardware mapping in AppStream are
4857 LEGO Mindstorms related, because I have, as part of my involvement in
4858 <a href=
"https://wiki.debian.org/LegoDesigners
">the Debian LEGO
4859 team
</a
> given priority to making sure LEGO users get proposed the
4860 complete set of packages in Debian for that particular hardware. The
4861 team also got a nice Christmas present today. The
4862 <a href=
"https://tracker.debian.org/pkg/nxt-firmware
">nxt-firmware
4863 package
</a
> made it into Debian. With this package in place, it is
4864 now possible to use the LEGO Mindstorms NXT unit with only free
4865 software, as the nxt-firmware package contain the source and firmware
4866 binaries for the NXT brick.
</p
>
4868 <p
>As usual, if you use Bitcoin and want to show your support of my
4869 activities, please send Bitcoin donations to my address
4870 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
4875 <title>Isenkram updated with a lot more hardware-package mappings
</title>
4876 <link>http://www.hungry.com/~pere/blog/Isenkram_updated_with_a_lot_more_hardware_package_mappings.html
</link>
4877 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Isenkram_updated_with_a_lot_more_hardware_package_mappings.html
</guid>
4878 <pubDate>Tue,
20 Dec
2016 11:
55:
00 +
0100</pubDate>
4879 <description><p
><a href=
"http://packages.qa.debian.org/isenkram
">The Isenkram
4880 system
</a
> I wrote two years ago to make it easier in Debian to find
4881 and install packages to get your hardware dongles to work, is still
4882 going strong. It is a system to look up the hardware present on or
4883 connected to the current system, and map the hardware to Debian
4884 packages. It can either be done using the tools in isenkram-cli or
4885 using the user space daemon in the isenkram package. The latter will
4886 notify you, when inserting new hardware, about what packages to
4887 install to get the dongle working. It will even provide a button to
4888 click on to ask packagekit to install the packages.
</p
>
4890 <p
>Here is an command line example from my Thinkpad laptop:
</p
>
4892 <p
><pre
>
4909 </pre
></p
>
4911 <p
>It can also list the firware package providing firmware requested
4912 by the load kernel modules, which in my case is an empty list because
4913 I have all the firmware my machine need:
4915 <p
><pre
>
4916 % /usr/sbin/isenkram-autoinstall-firmware -l
4917 info: did not find any firmware files requested by loaded kernel modules. exiting
4919 </pre
></p
>
4921 <p
>The last few days I had a look at several of the around
250
4922 packages in Debian with udev rules. These seem like good candidates
4923 to install when a given hardware dongle is inserted, and I found
4924 several that should be proposed by isenkram. I have not had time to
4925 check all of them, but am happy to report that now there are
97
4926 packages packages mapped to hardware by Isenkram.
11 of these
4927 packages provide hardware mapping using AppStream, while the rest are
4928 listed in the modaliases file provided in isenkram.
</p
>
4930 <p
>These are the packages with hardware mappings at the moment. The
4931 <strong
>marked packages
</strong
> are also announcing their hardware
4932 support using AppStream, for everyone to use:
</p
>
4934 <p
>air-quality-sensor, alsa-firmware-loaders, argyll,
4935 <strong
>array-info
</strong
>, avarice, avrdude, b43-fwcutter,
4936 bit-babbler, bluez, bluez-firmware,
<strong
>brltty
</strong
>,
4937 <strong
>broadcom-sta-dkms
</strong
>, calibre, cgminer, cheese, colord,
4938 <strong
>colorhug-client
</strong
>, dahdi-firmware-nonfree, dahdi-linux,
4939 dfu-util, dolphin-emu, ekeyd, ethtool, firmware-ipw2x00, fprintd,
4940 fprintd-demo,
<strong
>galileo
</strong
>, gkrellm-thinkbat, gphoto2,
4941 gpsbabel, gpsbabel-gui, gpsman, gpstrans, gqrx-sdr, gr-fcdproplus,
4942 gr-osmosdr, gtkpod, hackrf, hdapsd, hdmi2usb-udev, hpijs-ppds, hplip,
4943 ipw3945-source, ipw3945d, kde-config-tablet, kinect-audio-setup,
4944 <strong
>libnxt
</strong
>, libpam-fprintd,
<strong
>lomoco
</strong
>,
4945 madwimax, minidisc-utils, mkgmap, msi-keyboard, mtkbabel,
4946 <strong
>nbc
</strong
>,
<strong
>nqc
</strong
>, nut-hal-drivers, ola,
4947 open-vm-toolbox, open-vm-tools, openambit, pcgminer, pcmciautils,
4948 pcscd, pidgin-blinklight, printer-driver-splix,
4949 <strong
>pymissile
</strong
>, python-nxt, qlandkartegt,
4950 qlandkartegt-garmin, rosegarden, rt2x00-source, sispmctl,
4951 soapysdr-module-hackrf, solaar, squeak-plugins-scratch, sunxi-tools,
4952 <strong
>t2n
</strong
>, thinkfan, thinkfinger-tools, tlp, tp-smapi-dkms,
4953 tp-smapi-source, tpb, tucnak, uhd-host, usbmuxd, viking,
4954 virtualbox-ose-guest-x11, w1retap, xawtv, xserver-xorg-input-vmmouse,
4955 xserver-xorg-input-wacom, xserver-xorg-video-qxl,
4956 xserver-xorg-video-vmware, yubikey-personalization and
4957 zd1211-firmware
</p
>
4959 <p
>If you know of other packages, please let me know with a wishlist
4960 bug report against the isenkram-cli package, and ask the package
4962 <a href=
"https://wiki.debian.org/AppStream/Guidelines
">add AppStream
4963 metadata according to the guidelines
</a
> to provide the information
4964 for everyone. In time, I hope to get rid of the isenkram specific
4965 hardware mapping and depend exclusively on AppStream.
</p
>
4967 <p
>Note, the AppStream metadata for broadcom-sta-dkms is matching too
4968 much hardware, and suggest that the package with with any ethernet
4969 card. See
<a href=
"http://bugs.debian.org/
838735">bug #
838735</a
> for
4970 the details. I hope the maintainer find time to address it soon. In
4971 the mean time I provide an override in isenkram.
</p
>
4976 <title>Oolite, a life in space as vagabond and mercenary - nice free software
</title>
4977 <link>http://www.hungry.com/~pere/blog/Oolite__a_life_in_space_as_vagabond_and_mercenary___nice_free_software.html
</link>
4978 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Oolite__a_life_in_space_as_vagabond_and_mercenary___nice_free_software.html
</guid>
4979 <pubDate>Sun,
11 Dec
2016 11:
40:
00 +
0100</pubDate>
4980 <description><p align=
"center
"><img width=
"70%
" src=
"http://www.hungry.com/~pere/blog/images/
2016-
12-
11-nice-oolite.png
"/
></p
>
4982 <p
>In my early years, I played
4983 <a href=
"http://wiki.alioth.net/index.php/Classic_Elite
">the epic game
4984 Elite
</a
> on my PC. I spent many months trading and fighting in
4985 space, and reached the
'elite
' fighting status before I moved on. The
4986 original Elite game was available on Commodore
64 and the IBM PC
4987 edition I played had a
64 KB executable. I am still impressed today
4988 that the authors managed to squeeze both a
3D engine and details about
4989 more than
2000 planet systems across
7 galaxies into a binary so
4992 <p
>I have known about
<a href=
"http://www.oolite.org/
">the free
4993 software game Oolite inspired by Elite
</a
> for a while, but did not
4994 really have time to test it properly until a few days ago. It was
4995 great to discover that my old knowledge about trading routes were
4996 still valid. But my fighting and flying abilities were gone, so I had
4997 to retrain to be able to dock on a space station. And I am still not
4998 able to make much resistance when I am attacked by pirates, so I
4999 bougth and mounted the most powerful laser in the rear to be able to
5000 put up at least some resistance while fleeing for my life. :)
</p
>
5002 <p
>When playing Elite in the late eighties, I had to discover
5003 everything on my own, and I had long lists of prices seen on different
5004 planets to be able to decide where to trade what. This time I had the
5006 <a href=
"http://wiki.alioth.net/index.php/Main_Page
">Elite wiki
</a
>,
5007 where information about each planet is easily available with common
5008 price ranges and suggested trading routes. This improved my ability
5009 to earn money and I have been able to earn enough to buy a lot of
5010 useful equipent in a few days. I believe I originally played for
5011 months before I could get a docking computer, while now I could get it
5012 after less then a week.
</p
>
5014 <p
>If you like science fiction and dreamed of a life as a vagabond in
5015 space, you should try out Oolite. It is available for Linux, MacOSX
5016 and Windows, and is included in Debian and derivatives since
2011.
</p
>
5018 <p
>As usual, if you use Bitcoin and want to show your support of my
5019 activities, please send Bitcoin donations to my address
5020 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
5025 <title>Quicker Debian installations using eatmydata
</title>
5026 <link>http://www.hungry.com/~pere/blog/Quicker_Debian_installations_using_eatmydata.html
</link>
5027 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Quicker_Debian_installations_using_eatmydata.html
</guid>
5028 <pubDate>Fri,
25 Nov
2016 14:
50:
00 +
0100</pubDate>
5029 <description><p
>Two years ago, I did some experiments with eatmydata and the Debian
5030 installation system, observing how using
5031 <a href=
"http://www.hungry.com/~pere/blog/Speeding_up_the_Debian_installer_using_eatmydata_and_dpkg_divert.html
">eatmydata
5032 could speed up the installation
</a
> quite a bit. My testing measured
5033 speedup around
20-
40 percent for Debian Edu, where we install around
5034 1000 packages from within the installer. The eatmydata package
5035 provide a way to disable/delay file system flushing. This is a bit
5036 risky in the general case, as files that should be stored on disk will
5037 stay only in memory a bit longer than expected, causing problems if a
5038 machine crashes at an inconvenient time. But for an installation, if
5039 the machine crashes during installation the process is normally
5040 restarted, and avoiding disk operations as much as possible to speed
5041 up the process make perfect sense.
5043 <p
>I added code in the Debian Edu specific installation code to enable
5044 <a href=
"https://tracker.debian.org/pkg/libeatmydata
">eatmydata
</a
>,
5045 but did not have time to push it any further. But a few months ago I
5046 picked it up again and worked with the libeatmydata package maintainer
5047 Mattia Rizzolo to make it easier for everyone to get this installation
5048 speedup in Debian. Thanks to our cooperation There is now an
5049 eatmydata-udeb package in Debian testing and unstable, and simply
5050 enabling/installing it in debian-installer (d-i) is enough to get the
5051 quicker installations. It can be enabled using preseeding. The
5052 following untested kernel argument should do the trick:
</p
>
5054 <blockquote
><pre
>
5055 preseed/early_command=
"anna-install eatmydata-udeb
"
5056 </pre
></blockquote
>
5058 <p
>This should ask d-i to install the package inside the d-i
5059 environment early in the installation sequence. Having it installed
5060 in d-i in turn will make sure the relevant scripts are called just
5061 after debootstrap filled /target/ with the freshly installed Debian
5062 system to configure apt to run dpkg with eatmydata. This is enough to
5063 speed up the installation process. There is a proposal to
5064 <a href=
"https://bugs.debian.org/
841153">extend the idea a bit further
5065 by using /etc/ld.so.preload instead of apt.conf
</a
>, but I have not
5066 tested its impact.
</p
>
5072 <title>Oversette bokmål til nynorsk, enklere enn du tror takket være Apertium
</title>
5073 <link>http://www.hungry.com/~pere/blog/Oversette_bokm_l_til_nynorsk__enklere_enn_du_tror_takket_v_re_Apertium.html
</link>
5074 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Oversette_bokm_l_til_nynorsk__enklere_enn_du_tror_takket_v_re_Apertium.html
</guid>
5075 <pubDate>Thu,
24 Nov
2016 10:
50:
00 +
0100</pubDate>
5076 <description><p
>I Norge er det mange som trenger å skrive både bokmål og nynorsk.
5077 Eksamensoppgaver, offentlige brev og nyheter er eksempler på tekster
5078 der det er krav om skriftspråk. I tillegg til alle skoleoppgavene som
5079 elever over det ganske land skal levere inn hvert år. Det mange ikke
5080 vet er at selv om de kommersielle alternativene
5081 <a href=
"https://translate.google.com/
">Google Translate
</a
> og
5082 <a href=
"https://www.bing.com/translator/
">Bing Translator
</a
> ikke kan
5083 bidra med å oversette mellom bokmål og nynorsk, så finnes det et
5084 utmerket fri programvarealternativ som kan. Oversetterverktøyet
5085 Apertium har støtte for en rekke språkkombinasjoner, og takket være
5086 den utrettelige innsatsen til blant annet Kevin Brubeck Unhammer, kan
5087 en bruke webtjenesten til å fylle inn en tekst på bokmål eller
5088 nynorsk, og få den automatoversatt til det andre skriftspråket.
5089 Resultatet er ikke perfekt, men et svært godt utgangspunkt. Av og til
5090 er resultatet så bra at det kan benyttes uten endringer. Jeg vet
5091 f.eks. at store deler av Joomla ble oversatt til nynorsk ved hjelp
5092 Apertium. Høres det ut som noe du kan ha bruk for? Besøk i så fall
5093 <a href=
"https://www.apertium.org/
">Apertium.org
</a
> og fyll inn
5094 teksten din i webskjemaet der.
5096 <p
>Hvis du trenger maskinell tilgang til den bakenforliggende
5097 teknologien kan du enten installere pakken
5098 <a href=
"https://tracker.debian.org/apertium-nno-nob
">apertium-nno-nob
</a
>
5099 på en Debian-maskin eller bruke web-API-et tilgjengelig fra
5100 api.apertium.org. Se
5101 <a href=
"http://wiki.apertium.org/wiki/Apertium-apy
">API-dokumentasjonen
</a
>
5102 for detaljer om web-API-et. Her kan du se hvordan resultatet blir for
5103 denne teksten som ble skrevet på bokmål over maskinoversatt til
5108 <p
>I Noreg er det mange som treng å skriva både bokmål og nynorsk.
5109 Eksamensoppgåver, offentlege brev og nyhende er døme på tekster der
5110 det er krav om skriftspråk. I tillegg til alle skuleoppgåvene som
5111 elevar over det ganske land skal levera inn kvart år. Det mange ikkje
5112 veit er at sjølv om dei kommersielle alternativa
5113 <a href=
"https://translate.google.com/
">Google *Translate
</a
> og
5114 <a href=
"https://www.bing.com/translator/
">Bing *Translator
</a
> ikkje
5115 kan bidra med å omsetja mellom bokmål og nynorsk, så finst det eit
5116 utmerka fri programvarealternativ som kan. Omsetjarverktøyet
5117 *Apertium har støtte for ei rekkje språkkombinasjonar, og takka vera
5118 den utrøyttelege innsatsen til blant anna Kevin Brubeck Unhammer, kan
5119 ein bruka *webtjenesten til å fylla inn ei tekst på bokmål eller
5120 nynorsk, og få den *automatoversatt til det andre skriftspråket.
5121 Resultatet er ikkje perfekt, men eit svært godt utgangspunkt. Av og
5122 til er resultatet så bra at det kan nyttast utan endringar. Eg veit
5123 t.d. at store delar av *Joomla vart omsett til nynorsk ved hjelp
5124 *Apertium. Høyrast det ut som noko du kan ha bruk for? Besøk i så
5125 fall
<a href=
"https://www.apertium.org/
">*Apertium.org
</a
> og fyll inn
5126 teksta di i *webskjemaet der.
5128 <p
>Viss du treng *maskinell tilgjenge til den *bakenforliggende
5129 teknologien kan du anten installera pakken
5130 <a href=
"https://tracker.debian.org/apertium-nno-nob
">*apertium-*nno-*nob
</a
>
5131 på ein *Debian-maskin eller bruka *web-*API-eit tilgjengeleg frå
5132 *api.*apertium.org. Sjå
5133 <a href=
"http://wiki.apertium.org/wiki/Apertium-apy
">*API-dokumentasjonen
</a
>
5134 for detaljar om *web-*API-eit. Her kan du sjå korleis resultatet vert
5135 for denne teksta som vart skreva på bokmål over *maskinoversatt til
5141 <title>Coz profiler for multi-threaded software is now in Debian
</title>
5142 <link>http://www.hungry.com/~pere/blog/Coz_profiler_for_multi_threaded_software_is_now_in_Debian.html
</link>
5143 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Coz_profiler_for_multi_threaded_software_is_now_in_Debian.html
</guid>
5144 <pubDate>Sun,
13 Nov
2016 12:
30:
00 +
0100</pubDate>
5145 <description><p
><a href=
"http://coz-profiler.org/
">The Coz profiler
</a
>, a nice
5146 profiler able to run benchmarking experiments on the instrumented
5147 multi-threaded program, finally
5148 <a href=
"https://tracker.debian.org/pkg/coz-profiler
">made it into
5149 Debian unstable yesterday
</A
>. Lluís Vilanova and I have spent many
5151 <a href=
"http://www.hungry.com/~pere/blog/Coz_can_help_you_find_bottlenecks_in_multi_threaded_software___nice_free_software.html
">I
5152 blogged about the coz tool
</a
> in August working with upstream to make
5153 it suitable for Debian. There are still issues with clang
5154 compatibility, inline assembly only working x86 and minimized
5155 JavaScript libraries.
</p
>
5157 <p
>To test it, install
'coz-profiler
' using apt and run it like this:
</p
>
5159 <p
><blockquote
>
5160 <tt
>coz run --- /path/to/binary-with-debug-info
</tt
>
5161 </blockquote
></p
>
5163 <p
>This will produce a profile.coz file in the current working
5164 directory with the profiling information. This is then given to a
5165 JavaScript application provided in the package and available from
5166 <a href=
"http://plasma-umass.github.io/coz/
">a project web page
</a
>.
5167 To start the local copy, invoke it in a browser like this:
</p
>
5169 <p
><blockquote
>
5170 <tt
>sensible-browser /usr/share/coz-profiler/viewer/index.htm
</tt
>
5171 </blockquote
></p
>
5173 <p
>See the project home page and the
5174 <a href=
"https://www.usenix.org/publications/login/summer2016/curtsinger
">USENIX
5175 ;login: article on Coz
</a
> for more information on how it is
5181 <title>My own self balancing Lego Segway
</title>
5182 <link>http://www.hungry.com/~pere/blog/My_own_self_balancing_Lego_Segway.html
</link>
5183 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/My_own_self_balancing_Lego_Segway.html
</guid>
5184 <pubDate>Fri,
4 Nov
2016 10:
15:
00 +
0100</pubDate>
5185 <description><p
>A while back I received a Gyro sensor for the NXT
5186 <a href=
"mindstorms.lego.com
">Mindstorms
</a
> controller as a birthday
5187 present. It had been on my wishlist for a while, because I wanted to
5188 build a Segway like balancing lego robot. I had already built
5189 <a href=
"http://www.nxtprograms.com/NXT2/segway/
">a simple balancing
5190 robot
</a
> with the kids, using the light/color sensor included in the
5191 NXT kit as the balance sensor, but it was not working very well. It
5192 could balance for a while, but was very sensitive to the light
5193 condition in the room and the reflective properties of the surface and
5194 would fall over after a short while. I wanted something more robust,
5196 <a href=
"https://www.hitechnic.com/cgi-bin/commerce.cgi?preadd=action
&key=NGY1044
">the
5197 gyro sensor from HiTechnic
</a
> I believed would solve it on my
5198 wishlist for some years before it suddenly showed up as a gift from my
5199 loved ones. :)
</p
>
5201 <p
>Unfortunately I have not had time to sit down and play with it
5202 since then. But that changed some days ago, when I was searching for
5203 lego segway information and came across a recipe from HiTechnic for
5205 <a href=
"http://www.hitechnic.com/blog/gyro-sensor/htway/
">the
5206 HTWay
</a
>, a segway like balancing robot. Build instructions and
5207 <a href=
"https://www.hitechnic.com/upload/
786-HTWayC.nxc
">source
5208 code
</a
> was included, so it was just a question of putting it all
5209 together. And thanks to the great work of many Debian developers, the
5210 compiler needed to build the source for the NXT is already included in
5211 Debian, so I was read to go in less than an hour. The resulting robot
5212 do not look very impressive in its simplicity:
</p
>
5214 <p align=
"center
"><img width=
"70%
" src=
"http://www.hungry.com/~pere/blog/images/
2016-
11-
04-lego-htway-robot.jpeg
"></p
>
5216 <p
>Because I lack the infrared sensor used to control the robot in the
5217 design from HiTechnic, I had to comment out the last task
5218 (taskControl). I simply placed /* and */ around it get the program
5219 working without that sensor present. Now it balances just fine until
5220 the battery status run low:
</p
>
5222 <p align=
"center
"><video width=
"70%
" controls=
"true
">
5223 <source src=
"http://www.hungry.com/~pere/blog/images/
2016-
11-
04-lego-htway-balancing.ogv
" type=
"video/ogg
">
5224 </video
></p
>
5226 <p
>Now we would like to teach it how to follow a line and take remote
5227 control instructions using the included Bluetooth receiver in the NXT.
</p
>
5229 <p
>If you, like me, love LEGO and want to make sure we find the tools
5230 they need to work with LEGO in Debian and all our derivative
5231 distributions like Ubuntu, check out
5232 <a href=
"http://wiki.debian.org/LegoDesigners
">the LEGO designers
5233 project page
</a
> and join the Debian LEGO team. Personally I own a
5234 RCX and NXT controller (no EV3), and would like to make sure the
5235 Debian tools needed to program the systems I own work as they
5241 <title>Experience and updated recipe for using the Signal app without a mobile phone
</title>
5242 <link>http://www.hungry.com/~pere/blog/Experience_and_updated_recipe_for_using_the_Signal_app_without_a_mobile_phone.html
</link>
5243 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Experience_and_updated_recipe_for_using_the_Signal_app_without_a_mobile_phone.html
</guid>
5244 <pubDate>Mon,
10 Oct
2016 11:
30:
00 +
0200</pubDate>
5245 <description><p
>In July
5246 <a href=
"http://www.hungry.com/~pere/blog/How_to_use_the_Signal_app_if_you_only_have_a_land_line__ie_no_mobile_phone_.html
">I
5247 wrote how to get the Signal Chrome/Chromium app working
</a
> without
5248 the ability to receive SMS messages (aka without a cell phone). It is
5249 time to share some experiences and provide an updated setup.
</p
>
5251 <p
>The Signal app have worked fine for several months now, and I use
5252 it regularly to chat with my loved ones. I had a major snag at the
5253 end of my summer vacation, when the the app completely forgot my
5254 setup, identity and keys. The reason behind this major mess was
5255 running out of disk space. To avoid that ever happening again I have
5256 started storing everything in
<tt
>userdata/
</tt
> in git, to be able to
5257 roll back to an earlier version if the files are wiped by mistake. I
5258 had to use it once after introducing the git backup. When rolling
5259 back to an earlier version, one need to use the
'reset session
' option
5260 in Signal to get going, and notify the people you talk with about the
5261 problem. I assume there is some sequence number tracking in the
5262 protocol to detect rollback attacks. The git repository is rather big
5263 (
674 MiB so far), but I have not tried to figure out if some of the
5264 content can be added to a .gitignore file due to lack of spare
5267 <p
>I
've also hit the
90 days timeout blocking, and noticed that this
5268 make it impossible to send messages using Signal. I could still
5269 receive them, but had to patch the code with a new timestamp to send.
5270 I believe the timeout is added by the developers to force people to
5271 upgrade to the latest version of the app, even when there is no
5272 protocol changes, to reduce the version skew among the user base and
5273 thus try to keep the number of support requests down.
</p
>
5275 <p
>Since my original recipe, the Signal source code changed slightly,
5276 making the old patch fail to apply cleanly. Below is an updated
5277 patch, including the shell wrapper I use to start Signal. The
5278 original version required a new user to locate the JavaScript console
5279 and call a function from there. I got help from a friend with more
5280 JavaScript knowledge than me to modify the code to provide a GUI
5281 button instead. This mean that to get started you just need to run
5282 the wrapper and click the
'Register without mobile phone
' to get going
5283 now. I
've also modified the timeout code to always set it to
90 days
5284 in the future, to avoid having to patch the code regularly.
</p
>
5286 <p
>So, the updated recipe for Debian Jessie:
</p
>
5290 <li
>First, install required packages to get the source code and the
5291 browser you need. Signal only work with Chrome/Chromium, as far as I
5292 know, so you need to install it.
5295 apt install git tor chromium
5296 git clone https://github.com/WhisperSystems/Signal-Desktop.git
5297 </pre
></li
>
5299 <li
>Modify the source code using command listed in the the patch
5300 block below.
</li
>
5302 <li
>Start Signal using the run-signal-app wrapper (for example using
5303 <tt
>`pwd`/run-signal-app
</tt
>).
5305 <li
>Click on the
'Register without mobile phone
', will in a phone
5306 number you can receive calls to the next minute, receive the
5307 verification code and enter it into the form field and press
5308 'Register
'. Note, the phone number you use will be user Signal
5309 username, ie the way others can find you on Signal.
</li
>
5311 <li
>You can now use Signal to contact others. Note, new contacts do
5312 not show up in the contact list until you restart Signal, and there is
5313 no way to assign names to Contacts. There is also no way to create or
5314 update chat groups. I suspect this is because the web app do not have
5315 a associated contact database.
</li
>
5319 <p
>I am still a bit uneasy about using Signal, because of the way its
5320 main author moxie0 reject federation and accept dependencies to major
5321 corporations like Google (part of the code is fetched from Google) and
5322 Amazon (the central coordination point is owned by Amazon). See for
5324 <a href=
"https://github.com/LibreSignal/LibreSignal/issues/
37">the
5325 LibreSignal issue tracker
</a
> for a thread documenting the authors
5326 view on these issues. But the network effect is strong in this case,
5327 and several of the people I want to communicate with already use
5328 Signal. Perhaps we can all move to
<a href=
"https://ring.cx/
">Ring
</a
>
5329 once it
<a href=
"https://bugs.debian.org/
830265">work on my
5330 laptop
</a
>? It already work on Windows and Android, and is included
5331 in
<a href=
"https://tracker.debian.org/pkg/ring
">Debian
</a
> and
5332 <a href=
"https://launchpad.net/ubuntu/+source/ring
">Ubuntu
</a
>, but not
5333 working on Debian Stable.
</p
>
5335 <p
>Anyway, this is the patch I apply to the Signal code to get it
5336 working. It switch to the production servers, disable to timeout,
5337 make registration easier and add the shell wrapper:
</p
>
5340 cd Signal-Desktop; cat
&lt;
&lt;EOF | patch -p1
5341 diff --git a/js/background.js b/js/background.js
5342 index
24b4c1d.
.579345f
100644
5343 --- a/js/background.js
5344 +++ b/js/background.js
5349 - var SERVER_URL =
'https://textsecure-service-staging.whispersystems.org
';
5350 + var SERVER_URL =
'https://textsecure-service-ca.whispersystems.org
';
5351 var SERVER_PORTS = [
80,
4433,
8443];
5352 - var ATTACHMENT_SERVER_URL =
'https://whispersystems-textsecure-attachments-staging.s3.amazonaws.com
';
5353 + var ATTACHMENT_SERVER_URL =
'https://whispersystems-textsecure-attachments.s3.amazonaws.com
';
5354 var messageReceiver;
5355 window.getSocketStatus = function() {
5356 if (messageReceiver) {
5357 diff --git a/js/expire.js b/js/expire.js
5358 index
639aeae..beb91c3
100644
5363 'use strict
';
5364 - var BUILD_EXPIRATION =
0;
5365 + var BUILD_EXPIRATION = Date.now() + (
90 *
24 *
60 *
60 *
1000);
5367 window.extension = window.extension || {};
5369 diff --git a/js/views/install_view.js b/js/views/install_view.js
5370 index
7816f4f.
.1d6233b
100644
5371 --- a/js/views/install_view.js
5372 +++ b/js/views/install_view.js
5375 'click .step1
': this.selectStep.bind(this,
1),
5376 'click .step2
': this.selectStep.bind(this,
2),
5377 -
'click .step3
': this.selectStep.bind(this,
3)
5378 +
'click .step3
': this.selectStep.bind(this,
3),
5379 +
'click .callreg
': function() { extension.install(
'standalone
') },
5382 clearQR: function() {
5383 diff --git a/options.html b/options.html
5384 index dc0f28e.
.8d709f6
100644
5388 &lt;div class=
'nav
'>
5389 &lt;h1
>{{ installWelcome }}
&lt;/h1
>
5390 &lt;p
>{{ installTagline }}
&lt;/p
>
5391 -
&lt;div
> &lt;a class=
'button step2
'>{{ installGetStartedButton }}
&lt;/a
> &lt;/div
>
5392 +
&lt;div
> &lt;a class=
'button step2
'>{{ installGetStartedButton }}
&lt;/a
>
5393 +
&lt;br
> &lt;a class=
"button callreg
">Register without mobile phone
&lt;/a
>
5396 &lt;span class=
'dot step1 selected
'>&lt;/span
>
5397 &lt;span class=
'dot step2
'>&lt;/span
>
5398 &lt;span class=
'dot step3
'>&lt;/span
>
5399 --- /dev/null
2016-
10-
07 09:
55:
13.730181472 +
0200
5400 +++ b/run-signal-app
2016-
10-
10 08:
54:
09.434172391 +
0200
5406 +userdata=
"`pwd`/userdata
"
5407 +if [ -d
"$userdata
" ]
&& [ ! -d
"$userdata/.git
" ] ; then
5408 + (cd $userdata
&& git init)
5410 +(cd $userdata
&& git add .
&& git commit -m
"Current status.
" || true)
5412 + --proxy-server=
"socks://localhost:
9050" \
5413 + --user-data-dir=$userdata --load-and-launch-app=`pwd`
5415 chmod a+rx run-signal-app
5418 <p
>As usual, if you use Bitcoin and want to show your support of my
5419 activities, please send Bitcoin donations to my address
5420 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
5425 <title>Isenkram, Appstream and udev make life as a LEGO builder easier
</title>
5426 <link>http://www.hungry.com/~pere/blog/Isenkram__Appstream_and_udev_make_life_as_a_LEGO_builder_easier.html
</link>
5427 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Isenkram__Appstream_and_udev_make_life_as_a_LEGO_builder_easier.html
</guid>
5428 <pubDate>Fri,
7 Oct
2016 09:
50:
00 +
0200</pubDate>
5429 <description><p
><a href=
"http://packages.qa.debian.org/isenkram
">The Isenkram
5430 system
</a
> provide a practical and easy way to figure out which
5431 packages support the hardware in a given machine. The command line
5432 tool
<tt
>isenkram-lookup
</tt
> and the tasksel options provide a
5433 convenient way to list and install packages relevant for the current
5434 hardware during system installation, both user space packages and
5435 firmware packages. The GUI background daemon on the other hand provide
5436 a pop-up proposing to install packages when a new dongle is inserted
5437 while using the computer. For example, if you plug in a smart card
5438 reader, the system will ask if you want to install
<tt
>pcscd
</tt
> if
5439 that package isn
't already installed, and if you plug in a USB video
5440 camera the system will ask if you want to install
<tt
>cheese
</tt
> if
5441 cheese is currently missing. This already work just fine.
</p
>
5443 <p
>But Isenkram depend on a database mapping from hardware IDs to
5444 package names. When I started no such database existed in Debian, so
5445 I made my own data set and included it with the isenkram package and
5446 made isenkram fetch the latest version of this database from git using
5447 http. This way the isenkram users would get updated package proposals
5448 as soon as I learned more about hardware related packages.
</p
>
5450 <p
>The hardware is identified using modalias strings. The modalias
5451 design is from the Linux kernel where most hardware descriptors are
5452 made available as a strings that can be matched using filename style
5453 globbing. It handle USB, PCI, DMI and a lot of other hardware related
5454 identifiers.
</p
>
5456 <p
>The downside to the Isenkram specific database is that there is no
5457 information about relevant distribution / Debian version, making
5458 isenkram propose obsolete packages too. But along came AppStream, a
5459 cross distribution mechanism to store and collect metadata about
5460 software packages. When I heard about the proposal, I contacted the
5461 people involved and suggested to add a hardware matching rule using
5462 modalias strings in the specification, to be able to use AppStream for
5463 mapping hardware to packages. This idea was accepted and AppStream is
5464 now a great way for a package to announce the hardware it support in a
5465 distribution neutral way. I wrote
5466 <a href=
"http://www.hungry.com/~pere/blog/Using_appstream_with_isenkram_to_install_hardware_related_packages_in_Debian.html
">a
5467 recipe on how to add such meta-information
</a
> in a blog post last
5468 December. If you have a hardware related package in Debian, please
5469 announce the relevant hardware IDs using AppStream.
</p
>
5471 <p
>In Debian, almost all packages that can talk to a LEGO Mindestorms
5472 RCX or NXT unit, announce this support using AppStream. The effect is
5473 that when you insert such LEGO robot controller into your Debian
5474 machine, Isenkram will propose to install the packages needed to get
5475 it working. The intention is that this should allow the local user to
5476 start programming his robot controller right away without having to
5477 guess what packages to use or which permissions to fix.
</p
>
5479 <p
>But when I sat down with my son the other day to program our NXT
5480 unit using his Debian Stretch computer, I discovered something
5481 annoying. The local console user (ie my son) did not get access to
5482 the USB device for programming the unit. This used to work, but no
5483 longer in Jessie and Stretch. After some investigation and asking
5484 around on #debian-devel, I discovered that this was because udev had
5485 changed the mechanism used to grant access to local devices. The
5486 ConsoleKit mechanism from
<tt
>/lib/udev/rules.d/
70-udev-acl.rules
</tt
>
5487 no longer applied, because LDAP users no longer was added to the
5488 plugdev group during login. Michael Biebl told me that this method
5489 was obsolete and the new method used ACLs instead. This was good
5490 news, as the plugdev mechanism is a mess when using a remote user
5491 directory like LDAP. Using ACLs would make sure a user lost device
5492 access when she logged out, even if the user left behind a background
5493 process which would retain the plugdev membership with the ConsoleKit
5494 setup. Armed with this knowledge I moved on to fix the access problem
5495 for the LEGO Mindstorms related packages.
</p
>
5497 <p
>The new system uses a udev tag,
'uaccess
'. It can either be
5498 applied directly for a device, or is applied in
5499 /lib/udev/rules.d/
70-uaccess.rules for classes of devices. As the
5500 LEGO Mindstorms udev rules did not have a class, I decided to add the
5501 tag directly in the udev rules files included in the packages. Here
5502 is one example. For the nqc C compiler for the RCX, the
5503 <tt
>/lib/udev/rules.d/
60-nqc.rules
</tt
> file now look like this:
5505 <p
><pre
>
5506 SUBSYSTEM==
"usb
", ACTION==
"add
", ATTR{idVendor}==
"0694", ATTR{idProduct}==
"0001", \
5507 SYMLINK+=
"rcx-%k
", TAG+=
"uaccess
"
5508 </pre
></p
>
5510 <p
>The key part is the
'TAG+=
"uaccess
"' at the end. I suspect all
5511 packages using plugdev in their /lib/udev/rules.d/ files should be
5512 changed to use this tag (either directly or indirectly via
5513 <tt
>70-uaccess.rules
</tt
>). Perhaps a lintian check should be created
5514 to detect this?
</p
>
5516 <p
>I
've been unable to find good documentation on the uaccess feature.
5517 It is unclear to me if the uaccess tag is an internal implementation
5518 detail like the udev-acl tag used by
5519 <tt
>/lib/udev/rules.d/
70-udev-acl.rules
</tt
>. If it is, I guess the
5520 indirect method is the preferred way. Michael
5521 <a href=
"https://github.com/systemd/systemd/issues/
4288">asked for more
5522 documentation from the systemd project
</a
> and I hope it will make
5523 this clearer. For now I use the generic classes when they exist and
5524 is already handled by
<tt
>70-uaccess.rules
</tt
>, and add the tag
5525 directly if no such class exist.
</p
>
5527 <p
>To learn more about the isenkram system, please check out
5528 <a href=
"http://www.hungry.com/~pere/blog/tags/isenkram/
">my
5529 blog posts tagged isenkram
</a
>.
</p
>
5531 <p
>To help out making life for LEGO constructors in Debian easier,
5532 please join us on our IRC channel
5533 <a href=
"irc://irc.debian.org/%
23debian-lego
">#debian-lego
</a
> and join
5534 the
<a href=
"https://alioth.debian.org/projects/debian-lego/
">Debian
5535 LEGO team
</a
> in the Alioth project we created yesterday. A mailing
5536 list is not yet created, but we are working on it. :)
</p
>
5538 <p
>As usual, if you use Bitcoin and want to show your support of my
5539 activities, please send Bitcoin donations to my address
5540 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
5545 <title>First draft Norwegian Bokmål edition of The Debian Administrator
's Handbook now public
</title>
5546 <link>http://www.hungry.com/~pere/blog/First_draft_Norwegian_Bokm_l_edition_of_The_Debian_Administrator_s_Handbook_now_public.html
</link>
5547 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/First_draft_Norwegian_Bokm_l_edition_of_The_Debian_Administrator_s_Handbook_now_public.html
</guid>
5548 <pubDate>Tue,
30 Aug
2016 10:
10:
00 +
0200</pubDate>
5549 <description><p
>In April we
5550 <a href=
"http://www.hungry.com/~pere/blog/Lets_make_a_Norwegian_Bokm_l_edition_of_The_Debian_Administrator_s_Handbook.html
">started
5551 to work
</a
> on a Norwegian Bokmål edition of the
"open access
" book on
5552 how to set up and administrate a Debian system. Today I am happy to
5553 report that the first draft is now publicly available. You can find
5554 it on
<a href=
"https://debian-handbook.info/get/
">get the Debian
5555 Administrator
's Handbook page
</a
> (under Other languages). The first
5556 eight chapters have a first draft translation, and we are working on
5557 proofreading the content. If you want to help out, please start
5559 <a href=
"https://hosted.weblate.org/projects/debian-handbook/
">the
5560 hosted weblate project page
</a
>, and get in touch using
5561 <a href=
"http://lists.alioth.debian.org/mailman/listinfo/debian-handbook-translators
">the
5562 translators mailing list
</a
>. Please also check out
5563 <a href=
"https://debian-handbook.info/contribute/
">the instructions for
5564 contributors
</a
>. A good way to contribute is to proofread the text
5565 and update weblate if you find errors.
</p
>
5567 <p
>Our goal is still to make the Norwegian book available on paper as well as
5568 electronic form.
</p
>
5573 <title>Coz can help you find bottlenecks in multi-threaded software - nice free software
</title>
5574 <link>http://www.hungry.com/~pere/blog/Coz_can_help_you_find_bottlenecks_in_multi_threaded_software___nice_free_software.html
</link>
5575 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Coz_can_help_you_find_bottlenecks_in_multi_threaded_software___nice_free_software.html
</guid>
5576 <pubDate>Thu,
11 Aug
2016 12:
00:
00 +
0200</pubDate>
5577 <description><p
>This summer, I read a great article
5578 "<a href=
"https://www.usenix.org/publications/login/summer2016/curtsinger
">coz:
5579 This Is the Profiler You
're Looking For
</a
>" in USENIX ;login: about
5580 how to profile multi-threaded programs. It presented a system for
5581 profiling software by running experiences in the running program,
5582 testing how run time performance is affected by
"speeding up
" parts of
5583 the code to various degrees compared to a normal run. It does this by
5584 slowing down parallel threads while the
"faster up
" code is running
5585 and measure how this affect processing time. The processing time is
5586 measured using probes inserted into the code, either using progress
5587 counters (COZ_PROGRESS) or as latency meters (COZ_BEGIN/COZ_END). It
5588 can also measure unmodified code by measuring complete the program
5589 runtime and running the program several times instead.
</p
>
5591 <p
>The project and presentation was so inspiring that I would like to
5592 get the system into Debian. I
5593 <a href=
"https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=
830708">created
5594 a WNPP request for it
</a
> and contacted upstream to try to make the
5595 system ready for Debian by sending patches. The build process need to
5596 be changed a bit to avoid running
'git clone
' to get dependencies, and
5597 to include the JavaScript web page used to visualize the collected
5598 profiling information included in the source package.
5599 But I expect that should work out fairly soon.
</p
>
5601 <p
>The way the system work is fairly simple. To run an coz experiment
5602 on a binary with debug symbols available, start the program like this:
5604 <p
><blockquote
><pre
>
5605 coz run --- program-to-run
5606 </pre
></blockquote
></p
>
5608 <p
>This will create a text file profile.coz with the instrumentation
5609 information. To show what part of the code affect the performance
5610 most, use a web browser and either point it to
5611 <a href=
"http://plasma-umass.github.io/coz/
">http://plasma-umass.github.io/coz/
</a
>
5612 or use the copy from git (in the gh-pages branch). Check out this web
5613 site to have a look at several example profiling runs and get an idea what the end result from the profile runs look like. To make the
5614 profiling more useful you include
&lt;coz.h
&gt; and insert the
5615 COZ_PROGRESS or COZ_BEGIN and COZ_END at appropriate places in the
5616 code, rebuild and run the profiler. This allow coz to do more
5617 targeted experiments.
</p
>
5619 <p
>A video published by ACM
5620 <a href=
"https://www.youtube.com/watch?v=jE0V-p1odPg
">presenting the
5621 Coz profiler
</a
> is available from Youtube. There is also a paper
5622 from the
25th Symposium on Operating Systems Principles available
5624 <a href=
"https://www.usenix.org/conference/atc16/technical-sessions/presentation/curtsinger
">Coz:
5625 finding code that counts with causal profiling
</a
>.
</p
>
5627 <p
><a href=
"https://github.com/plasma-umass/coz
">The source code
</a
>
5628 for Coz is available from github. It will only build with clang
5630 <a href=
"https://gcc.gnu.org/bugzilla/show_bug.cgi?id=
55606">C++
5631 feature missing in GCC
</a
>, but I
've submitted
5632 <a href=
"https://github.com/plasma-umass/coz/pull/
67">a patch to solve
5633 it
</a
> and hope it will be included in the upstream source soon.
</p
>
5635 <p
>Please get in touch if you, like me, would like to see this piece
5636 of software in Debian. I would very much like some help with the
5637 packaging effort, as I lack the in depth knowledge on how to package
5638 C++ libraries.
</p
>
5643 <title>Unlocking HTC Desire HD on Linux using unruu and fastboot
</title>
5644 <link>http://www.hungry.com/~pere/blog/Unlocking_HTC_Desire_HD_on_Linux_using_unruu_and_fastboot.html
</link>
5645 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Unlocking_HTC_Desire_HD_on_Linux_using_unruu_and_fastboot.html
</guid>
5646 <pubDate>Thu,
7 Jul
2016 11:
30:
00 +
0200</pubDate>
5647 <description><p
>Yesterday, I tried to unlock a HTC Desire HD phone, and it proved
5648 to be a slight challenge. Here is the recipe if I ever need to do it
5649 again. It all started by me wanting to try the recipe to set up
5650 <a href=
"https://blog.torproject.org/blog/mission-impossible-hardening-android-security-and-privacy
">an
5651 hardened Android installation
</a
> from the Tor project blog on a
5652 device I had access to. It is a old mobile phone with a broken
5653 microphone The initial idea had been to just
5654 <a href=
"http://wiki.cyanogenmod.org/w/Install_CM_for_ace
">install
5655 CyanogenMod on it
</a
>, but did not quite find time to start on it
5656 until a few days ago.
</p
>
5658 <p
>The unlock process is supposed to be simple: (
1) Boot into the boot
5659 loader (press volume down and power at the same time), (
2) select
5660 'fastboot
' before (
3) connecting the device via USB to a Linux
5661 machine, (
4) request the device identifier token by running
'fastboot
5662 oem get_identifier_token
', (
5) request the device unlocking key using
5663 the
<a href=
"http://www.htcdev.com/bootloader/
">HTC developer web
5664 site
</a
> and unlock the phone using the key file emailed to you.
</p
>
5666 <p
>Unfortunately, this only work fi you have hboot version
2.00.0029
5667 or newer, and the device I was working on had
2.00.0027. This
5668 apparently can be easily fixed by downloading a Windows program and
5669 running it on your Windows machine, if you accept the terms Microsoft
5670 require you to accept to use Windows - which I do not. So I had to
5671 come up with a different approach. I got a lot of help from AndyCap
5672 on #nuug, and would not have been able to get this working without
5675 <p
>First I needed to extract the hboot firmware from
5676 <a href=
"http://www.htcdev.com/ruu/PD9810000_Ace_Sense30_S_hboot_2.00
.0029.exe
">the
5677 windows binary for HTC Desire HD
</a
> downloaded as
'the RUU
' from HTC.
5678 For this there is is
<a href=
"https://github.com/kmdm/unruu/
">a github
5679 project named unruu
</a
> using libunshield. The unshield tool did not
5680 recognise the file format, but unruu worked and extracted rom.zip,
5681 containing the new hboot firmware and a text file describing which
5682 devices it would work for.
</p
>
5684 <p
>Next, I needed to get the new firmware into the device. For this I
5685 followed some instructions
5686 <a href=
"http://www.htc1guru.com/
2013/
09/new-ruu-zips-posted/
">available
5687 from HTC1Guru.com
</a
>, and ran these commands as root on a Linux
5688 machine with Debian testing:
</p
>
5690 <p
><pre
>
5691 adb reboot-bootloader
5692 fastboot oem rebootRUU
5693 fastboot flash zip rom.zip
5694 fastboot flash zip rom.zip
5696 </pre
></p
>
5698 <p
>The flash command apparently need to be done twice to take effect,
5699 as the first is just preparations and the second one do the flashing.
5700 The adb command is just to get to the boot loader menu, so turning the
5701 device on while holding volume down and the power button should work
5704 <p
>With the new hboot version in place I could start following the
5705 instructions on the HTC developer web site. I got the device token
5706 like this:
</p
>
5708 <p
><pre
>
5709 fastboot oem get_identifier_token
2>&1 | sed
's/(bootloader) //
'
5712 <p
>And once I got the unlock code via email, I could use it like
5715 <p
><pre
>
5716 fastboot flash unlocktoken Unlock_code.bin
5717 </pre
></p
>
5719 <p
>And with that final step in place, the phone was unlocked and I
5720 could start stuffing the software of my own choosing into the device.
5721 So far I only inserted a replacement recovery image to wipe the phone
5722 before I start. We will see what happen next. Perhaps I should
5723 install
<a href=
"https://www.debian.org/
">Debian
</a
> on it. :)
</p
>
5728 <title>How to use the Signal app if you only have a land line (ie no mobile phone)
</title>
5729 <link>http://www.hungry.com/~pere/blog/How_to_use_the_Signal_app_if_you_only_have_a_land_line__ie_no_mobile_phone_.html
</link>
5730 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_use_the_Signal_app_if_you_only_have_a_land_line__ie_no_mobile_phone_.html
</guid>
5731 <pubDate>Sun,
3 Jul
2016 14:
20:
00 +
0200</pubDate>
5732 <description><p
>For a while now, I have wanted to test
5733 <a href=
"https://whispersystems.org/
">the Signal app
</a
>, as it is
5734 said to provide end to end encrypted communication and several of my
5735 friends and family are already using it. As I by choice do not own a
5736 mobile phone, this proved to be harder than expected. And I wanted to
5737 have the source of the client and know that it was the code used on my
5738 machine. But yesterday I managed to get it working. I used the
5739 Github source, compared it to the source in
5740 <a href=
"https://chrome.google.com/webstore/detail/signal-private-messenger/bikioccmkafdpakkkcpdbppfkghcmihk?hl=en-US
">the
5741 Signal Chrome app
</a
> available from the Chrome web store, applied
5742 patches to use the production Signal servers, started the app and
5743 asked for the hidden
"register without a smart phone
" form. Here is
5744 the recipe how I did it.
</p
>
5746 <p
>First, I fetched the Signal desktop source from Github, using
5749 git clone https://github.com/WhisperSystems/Signal-Desktop.git
5752 <p
>Next, I patched the source to use the production servers, to be
5753 able to talk to other Signal users:
</p
>
5756 cat
&lt;
&lt;EOF | patch -p0
5757 diff -ur ./js/background.js userdata/Default/Extensions/bikioccmkafdpakkkcpdbppfkghcmihk/
0.15.0_0/js/background.js
5758 --- ./js/background.js
2016-
06-
29 13:
43:
15.630344628 +
0200
5759 +++ userdata/Default/Extensions/bikioccmkafdpakkkcpdbppfkghcmihk/
0.15.0_0/js/background.js
2016-
06-
29 14:
06:
29.530300934 +
0200
5764 - var SERVER_URL =
'https://textsecure-service-staging.whispersystems.org
';
5765 - var ATTACHMENT_SERVER_URL =
'https://whispersystems-textsecure-attachments-staging.s3.amazonaws.com
';
5766 + var SERVER_URL =
'https://textsecure-service-ca.whispersystems.org:
4433';
5767 + var ATTACHMENT_SERVER_URL =
'https://whispersystems-textsecure-attachments.s3.amazonaws.com
';
5768 var messageReceiver;
5769 window.getSocketStatus = function() {
5770 if (messageReceiver) {
5771 diff -ur ./js/expire.js userdata/Default/Extensions/bikioccmkafdpakkkcpdbppfkghcmihk/
0.15.0_0/js/expire.js
5772 --- ./js/expire.js
2016-
06-
29 13:
43:
15.630344628 +
0200
5773 +++ userdata/Default/Extensions/bikioccmkafdpakkkcpdbppfkghcmihk/
0.15.0_0/js/expire.js2016-
06-
29 14:
06:
29.530300934 +
0200
5776 'use strict
';
5777 - var BUILD_EXPIRATION =
0;
5778 + var BUILD_EXPIRATION =
1474492690000;
5780 window.extension = window.extension || {};
5785 <p
>The first part is changing the servers, and the second is updating
5786 an expiration timestamp. This timestamp need to be updated regularly.
5787 It is set
90 days in the future by the build process (Gruntfile.js).
5788 The value is seconds since
1970 times
1000, as far as I can tell.
</p
>
5790 <p
>Based on a tip and good help from the #nuug IRC channel, I wrote a
5791 script to launch Signal in Chromium.
</p
>
5798 --proxy-server=
"socks://localhost:
9050" \
5799 --user-data-dir=`pwd`/userdata --load-and-launch-app=`pwd`
5802 <p
> The script start the app and configure Chromium to use the Tor
5803 SOCKS5 proxy to make sure those controlling the Signal servers (today
5804 Amazon and Whisper Systems) as well as those listening on the lines
5805 will have a harder time location my laptop based on the Signal
5806 connections if they use source IP address.
</p
>
5808 <p
>When the script starts, one need to follow the instructions under
5809 "Standalone Registration
" in the CONTRIBUTING.md file in the git
5810 repository. I right clicked on the Signal window to get up the
5811 Chromium debugging tool, visited the
'Console
' tab and wrote
5812 'extension.install(
"standalone
")
' on the console prompt to get the
5813 registration form. Then I entered by land line phone number and
5814 pressed
'Call
'.
5 seconds later the phone rang and a robot voice
5815 repeated the verification code three times. After entering the number
5816 into the verification code field in the form, I could start using
5817 Signal from my laptop.
5819 <p
>As far as I can tell, The Signal app will leak who is talking to
5820 whom and thus who know who to those controlling the central server,
5821 but such leakage is hard to avoid with a centrally controlled server
5822 setup. It is something to keep in mind when using Signal - the
5823 content of your chats are harder to intercept, but the meta data
5824 exposing your contact network is available to people you do not know.
5825 So better than many options, but not great. And sadly the usage is
5826 connected to my land line, thus allowing those controlling the server
5827 to associate it to my home and person. I would prefer it if only
5828 those I knew could tell who I was on Signal. There are options
5829 avoiding such information leakage, but most of my friends are not
5830 using them, so I am stuck with Signal for now.
</p
>
5832 <p
><strong
>Update
2017-
01-
10</strong
>: There is an updated blog post
5834 <a href=
"http://www.hungry.com/~pere/blog/Experience_and_updated_recipe_for_using_the_Signal_app_without_a_mobile_phone.html
">Experience
5835 and updated recipe for using the Signal app without a mobile
5836 phone
</a
>.
</p
>
5841 <title>The new
"best
" multimedia player in Debian?
</title>
5842 <link>http://www.hungry.com/~pere/blog/The_new__best__multimedia_player_in_Debian_.html
</link>
5843 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_new__best__multimedia_player_in_Debian_.html
</guid>
5844 <pubDate>Mon,
6 Jun
2016 12:
50:
00 +
0200</pubDate>
5845 <description><p
>When I set out a few weeks ago to figure out
5846 <a href=
"http://www.hungry.com/~pere/blog/What_is_the_best_multimedia_player_in_Debian_.html
">which
5847 multimedia player in Debian claimed to support most file formats /
5848 MIME types
</a
>, I was a bit surprised how varied the sets of MIME types
5849 the various players claimed support for. The range was from
55 to
130
5850 MIME types. I suspect most media formats are supported by all
5851 players, but this is not really reflected in the MimeTypes values in
5852 their desktop files. There are probably also some bogus MIME types
5853 listed, but it is hard to identify which one this is.
</p
>
5855 <p
>Anyway, in the mean time I got in touch with upstream for some of
5856 the players suggesting to add more MIME types to their desktop files,
5857 and decided to spend some time myself improving the situation for my
5858 favorite media player VLC. The fixes for VLC entered Debian unstable
5859 yesterday. The complete list of MIME types can be seen on the
5860 <a href=
"https://wiki.debian.org/DebianMultimedia/PlayerSupport
">Multimedia
5861 player MIME type support status
</a
> Debian wiki page.
</p
>
5863 <p
>The new
"best
" multimedia player in Debian? It is VLC, followed by
5864 totem, parole, kplayer, gnome-mpv, mpv, smplayer, mplayer-gui and
5865 kmplayer. I am sure some of the other players desktop files support
5866 several of the formats currently listed as working only with vlc,
5867 toten and parole.
</p
>
5869 <p
>A sad observation is that only
14 MIME types are listed as
5870 supported by all the tested multimedia players in Debian in their
5871 desktop files: audio/mpeg, audio/vnd.rn-realaudio, audio/x-mpegurl,
5872 audio/x-ms-wma, audio/x-scpls, audio/x-wav, video/mp4, video/mpeg,
5873 video/quicktime, video/vnd.rn-realvideo, video/x-matroska,
5874 video/x-ms-asf, video/x-ms-wmv and video/x-msvideo. Personally I find
5875 it sad that video/ogg and video/webm is not supported by all the media
5876 players in Debian. As far as I can tell, all of them can handle both
5882 <title>A program should be able to open its own files on Linux
</title>
5883 <link>http://www.hungry.com/~pere/blog/A_program_should_be_able_to_open_its_own_files_on_Linux.html
</link>
5884 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/A_program_should_be_able_to_open_its_own_files_on_Linux.html
</guid>
5885 <pubDate>Sun,
5 Jun
2016 08:
30:
00 +
0200</pubDate>
5886 <description><p
>Many years ago, when koffice was fresh and with few users, I
5887 decided to test its presentation tool when making the slides for a
5888 talk I was giving for NUUG on Japhar, a free Java virtual machine. I
5889 wrote the first draft of the slides, saved the result and went to bed
5890 the day before I would give the talk. The next day I took a plane to
5891 the location where the meeting should take place, and on the plane I
5892 started up koffice again to polish the talk a bit, only to discover
5893 that kpresenter refused to load its own data file. I cursed a bit and
5894 started making the slides again from memory, to have something to
5895 present when I arrived. I tested that the saved files could be
5896 loaded, and the day seemed to be rescued. I continued to polish the
5897 slides until I suddenly discovered that the saved file could no longer
5898 be loaded into kpresenter. In the end I had to rewrite the slides
5899 three times, condensing the content until the talk became shorter and
5900 shorter. After the talk I was able to pinpoint the problem
&ndash;
5901 kpresenter wrote inline images in a way itself could not understand.
5902 Eventually that bug was fixed and kpresenter ended up being a great
5903 program to make slides. The point I
'm trying to make is that we
5904 expect a program to be able to load its own data files, and it is
5905 embarrassing to its developers if it can
't.
</p
>
5907 <p
>Did you ever experience a program failing to load its own data
5908 files from the desktop file browser? It is not a uncommon problem. A
5909 while back I discovered that the screencast recorder
5910 gtk-recordmydesktop would save an Ogg Theora video file the KDE file
5911 browser would refuse to open. No video player claimed to understand
5912 such file. I tracked down the cause being
<tt
>file --mime-type
</tt
>
5913 returning the application/ogg MIME type, which no video player I had
5914 installed listed as a MIME type they would understand. I asked for
5915 <a href=
"http://bugs.gw.com/view.php?id=
382">file to change its
5916 behavour
</a
> and use the MIME type video/ogg instead. I also asked
5917 several video players to add video/ogg to their desktop files, to give
5918 the file browser an idea what to do about Ogg Theora files. After a
5919 while, the desktop file browsers in Debian started to handle the
5920 output from gtk-recordmydesktop properly.
</p
>
5922 <p
>But history repeats itself. A few days ago I tested the music
5923 system Rosegarden again, and I discovered that the KDE and xfce file
5924 browsers did not know what to do with the Rosegarden project files
5925 (*.rg). I
've reported
<a href=
"http://bugs.debian.org/
825993">the
5926 rosegarden problem to BTS
</a
> and a fix is commited to git and will be
5927 included in the next upload. To increase the chance of me remembering
5928 how to fix the problem next time some program fail to load its files
5929 from the file browser, here are some notes on how to fix it.
</p
>
5931 <p
>The file browsers in Debian in general operates on MIME types.
5932 There are two sources for the MIME type of a given file. The output from
5933 <tt
>file --mime-type
</tt
> mentioned above, and the content of the
5934 shared MIME type registry (under /usr/share/mime/). The file MIME
5935 type is mapped to programs supporting the MIME type, and this
5936 information is collected from
5937 <a href=
"https://www.freedesktop.org/wiki/Specifications/desktop-entry-spec/
">the
5938 desktop files
</a
> available in /usr/share/applications/. If there is
5939 one desktop file claiming support for the MIME type of the file, it is
5940 activated when asking to open a given file. If there are more, one
5941 can normally select which one to use by right-clicking on the file and
5942 selecting the wanted one using
'Open with
' or similar. In general
5943 this work well. But it depend on each program picking a good MIME
5945 <a href=
"http://www.iana.org/assignments/media-types/media-types.xhtml
">a
5946 MIME type registered with IANA
</a
>), file and/or the shared MIME
5947 registry recognizing the file and the desktop file to list the MIME
5948 type in its list of supported MIME types.
</p
>
5950 <p
>The
<tt
>/usr/share/mime/packages/rosegarden.xml
</tt
> entry for
5951 <a href=
"http://www.freedesktop.org/wiki/Specifications/shared-mime-info-spec
">the
5952 Shared MIME database
</a
> look like this:
</p
>
5954 <p
><blockquote
><pre
>
5955 &lt;?xml version=
"1.0" encoding=
"UTF-
8"?
&gt;
5956 &lt;mime-info xmlns=
"http://www.freedesktop.org/standards/shared-mime-info
"&gt;
5957 &lt;mime-type type=
"audio/x-rosegarden
"&gt;
5958 &lt;sub-class-of type=
"application/x-gzip
"/
&gt;
5959 &lt;comment
&gt;Rosegarden project file
&lt;/comment
&gt;
5960 &lt;glob pattern=
"*.rg
"/
&gt;
5961 &lt;/mime-type
&gt;
5962 &lt;/mime-info
&gt;
5963 </pre
></blockquote
></p
>
5965 <p
>This states that audio/x-rosegarden is a kind of application/x-gzip
5966 (it is a gzipped XML file). Note, it is much better to use an
5967 official MIME type registered with IANA than it is to make up ones own
5968 unofficial ones like the x-rosegarden type used by rosegarden.
</p
>
5970 <p
>The desktop file of the rosegarden program failed to list
5971 audio/x-rosegarden in its list of supported MIME types, causing the
5972 file browsers to have no idea what to do with *.rg files:
</p
>
5974 <p
><blockquote
><pre
>
5975 % grep Mime /usr/share/applications/rosegarden.desktop
5976 MimeType=audio/x-rosegarden-composition;audio/x-rosegarden-device;audio/x-rosegarden-project;audio/x-rosegarden-template;audio/midi;
5977 X-KDE-NativeMimeType=audio/x-rosegarden-composition
5979 </pre
></blockquote
></p
>
5981 <p
>The fix was to add
"audio/x-rosegarden;
" at the end of the
5982 MimeType= line.
</p
>
5984 <p
>If you run into a file which fail to open the correct program when
5985 selected from the file browser, please check out the output from
5986 <tt
>file --mime-type
</tt
> for the file, ensure the file ending and
5987 MIME type is registered somewhere under /usr/share/mime/ and check
5988 that some desktop file under /usr/share/applications/ is claiming
5989 support for this MIME type. If not, please report a bug to have it
5995 <title>Isenkram with PackageKit support - new version
0.23 available in Debian unstable
</title>
5996 <link>http://www.hungry.com/~pere/blog/Isenkram_with_PackageKit_support___new_version_0_23_available_in_Debian_unstable.html
</link>
5997 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Isenkram_with_PackageKit_support___new_version_0_23_available_in_Debian_unstable.html
</guid>
5998 <pubDate>Wed,
25 May
2016 10:
20:
00 +
0200</pubDate>
5999 <description><p
><a href=
"https://tracker.debian.org/pkg/isenkram
">The isenkram
6000 system
</a
> is a user-focused solution in Debian for handling hardware
6001 related packages. The idea is to have a database of mappings between
6002 hardware and packages, and pop up a dialog suggesting for the user to
6003 install the packages to use a given hardware dongle. Some use cases
6004 are when you insert a Yubikey, it proposes to install the software
6005 needed to control it; when you insert a braille reader list it
6006 proposes to install the packages needed to send text to the reader;
6007 and when you insert a ColorHug screen calibrator it suggests to
6008 install the driver for it. The system work well, and even have a few
6009 command line tools to install firmware packages and packages for the
6010 hardware already in the machine (as opposed to hotpluggable hardware).
</p
>
6012 <p
>The system was initially written using aptdaemon, because I found
6013 good documentation and example code on how to use it. But aptdaemon
6014 is going away and is generally being replaced by
6015 <a href=
"http://www.freedesktop.org/software/PackageKit/
">PackageKit
</a
>,
6016 so Isenkram needed a rewrite. And today, thanks to the great patch
6017 from my college Sunil Mohan Adapa in the FreedomBox project, the
6018 rewrite finally took place. I
've just uploaded a new version of
6019 Isenkram into Debian Unstable with the patch included, and the default
6020 for the background daemon is now to use PackageKit. To check it out,
6021 install the
<tt
>isenkram
</tt
> package and insert some hardware dongle
6022 and see if it is recognised.
</p
>
6024 <p
>If you want to know what kind of packages isenkram would propose for
6025 the machine it is running on, you can check out the isenkram-lookup
6026 program. This is what it look like on a Thinkpad X230:
</p
>
6028 <p
><blockquote
><pre
>
6044 </pre
></blockquote
></p
>
6046 <p
>The hardware mappings come from several places. The preferred way
6047 is for packages to announce their hardware support using
6048 <a href=
"https://www.freedesktop.org/software/appstream/docs/
">the
6049 cross distribution appstream system
</a
>.
6051 <a href=
"http://www.hungry.com/~pere/blog/tags/isenkram/
">previous
6052 blog posts about isenkram
</a
> to learn how to do that.
</p
>
6057 <title>Discharge rate estimate in new battery statistics collector for Debian
</title>
6058 <link>http://www.hungry.com/~pere/blog/Discharge_rate_estimate_in_new_battery_statistics_collector_for_Debian.html
</link>
6059 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Discharge_rate_estimate_in_new_battery_statistics_collector_for_Debian.html
</guid>
6060 <pubDate>Mon,
23 May
2016 09:
35:
00 +
0200</pubDate>
6061 <description><p
>Yesterday I updated the
6062 <a href=
"https://tracker.debian.org/pkg/battery-stats
">battery-stats
6063 package in Debian
</a
> with a few patches sent to me by skilled and
6064 enterprising users. There were some nice user and visible changes.
6065 First of all, both desktop menu entries now work. A design flaw in
6066 one of the script made the history graph fail to show up (its PNG was
6067 dumped in ~/.xsession-errors) if no controlling TTY was available.
6068 The script worked when called from the command line, but not when
6069 called from the desktop menu. I changed this to look for a DISPLAY
6070 variable or a TTY before deciding where to draw the graph, and now the
6071 graph window pop up as expected.
</p
>
6073 <p
>The next new feature is a discharge rate estimator in one of the
6074 graphs (the one showing the last few hours). New is also the user of
6075 colours showing charging in blue and discharge in red. The percentages
6076 of this graph is relative to last full charge, not battery design
6079 <p align=
"center
"><img src=
"http://www.hungry.com/~pere/blog/images/
2016-
05-
23-battery-stats-rate.png
"/
></p
>
6081 <p
>The other graph show the entire history of the collected battery
6082 statistics, comparing it to the design capacity of the battery to
6083 visualise how the battery life time get shorter over time. The red
6084 line in this graph is what the previous graph considers
100 percent:
6086 <p align=
"center
"><img src=
"http://www.hungry.com/~pere/blog/images/
2016-
05-
23-battery-stats-history.png
"/
></p
>
6088 <p
>In this graph you can see that I only charge the battery to
80
6089 percent of last full capacity, and how the capacity of the battery is
6090 shrinking. :(
</p
>
6092 <p
>The last new feature is in the collector, which now will handle
6093 more hardware models. On some hardware, Linux power supply
6094 information is stored in /sys/class/power_supply/ACAD/, while the
6095 collector previously only looked in /sys/class/power_supply/AC/. Now
6096 both are checked to figure if there is power connected to the
6099 <p
>If you are interested in how your laptop battery is doing, please
6101 <a href=
"https://tracker.debian.org/pkg/battery-stats
">battery-stats
</a
>
6102 in Debian unstable, or rebuild it on Jessie to get it working on
6103 Debian stable. :) The upstream source is available from
<a
6104 href=
"https://github.com/petterreinholdtsen/battery-stats
">github
</a
>.
6105 Patches are very welcome.
</p
>
6107 <p
>As usual, if you use Bitcoin and want to show your support of my
6108 activities, please send Bitcoin donations to my address
6109 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
6114 <title>Debian now with ZFS on Linux included
</title>
6115 <link>http://www.hungry.com/~pere/blog/Debian_now_with_ZFS_on_Linux_included.html
</link>
6116 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_now_with_ZFS_on_Linux_included.html
</guid>
6117 <pubDate>Thu,
12 May
2016 07:
30:
00 +
0200</pubDate>
6118 <description><p
>Today, after many years of hard work from many people,
6119 <a href=
"http://zfsonlinux.org/
">ZFS for Linux
</a
> finally entered
6120 Debian. The package status can be seen on
6121 <a href=
"https://tracker.debian.org/pkg/zfs-linux
">the package tracker
6122 for zfs-linux
</a
>. and
6123 <a href=
"https://qa.debian.org/developer.php?login=pkg-zfsonlinux-devel@lists.alioth.debian.org
">the
6124 team status page
</a
>. If you want to help out, please join us.
6125 <a href=
"http://anonscm.debian.org/gitweb/?p=pkg-zfsonlinux/zfs.git
">The
6126 source code
</a
> is available via git on Alioth. It would also be
6127 great if you could help out with
6128 <a href=
"https://tracker.debian.org/pkg/dkms
">the dkms package
</a
>, as
6129 it is an important piece of the puzzle to get ZFS working.
</p
>
6134 <title>What is the best multimedia player in Debian?
</title>
6135 <link>http://www.hungry.com/~pere/blog/What_is_the_best_multimedia_player_in_Debian_.html
</link>
6136 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_is_the_best_multimedia_player_in_Debian_.html
</guid>
6137 <pubDate>Sun,
8 May
2016 09:
40:
00 +
0200</pubDate>
6138 <description><p
><strong
>Where I set out to figure out which multimedia player in
6139 Debian claim support for most file formats.
</strong
></p
>
6141 <p
>A few years ago, I had a look at the media support for Browser
6142 plugins in Debian, to get an idea which plugins to include in Debian
6143 Edu. I created a script to extract the set of supported MIME types
6144 for each plugin, and used this to find out which multimedia browser
6145 plugin supported most file formats / media types.
6146 <a href=
"https://wiki.debian.org/DebianEdu/BrowserMultimedia
">The
6147 result
</a
> can still be seen on the Debian wiki, even though it have
6148 not been updated for a while. But browser plugins are less relevant
6149 these days, so I thought it was time to look at standalone
6152 <p
>A few days ago I was tired of VLC not being listed as a viable
6153 player when I wanted to play videos from the Norwegian National
6154 Broadcasting Company, and decided to investigate why. The cause is a
6155 <a href=
"https://bugs.debian.org/
822245">missing MIME type in the VLC
6156 desktop file
</a
>. In the process I wrote a script to compare the set
6157 of MIME types announced in the desktop file and the browser plugin,
6158 only to discover that there is quite a large difference between the
6159 two for VLC. This discovery made me dig up the script I used to
6160 compare browser plugins, and adjust it to compare desktop files
6161 instead, to try to figure out which multimedia player in Debian
6162 support most file formats.
</p
>
6164 <p
>The result can be seen on the Debian Wiki, as
6165 <a href=
"https://wiki.debian.org/DebianMultimedia/PlayerSupport
">a
6166 table listing all MIME types supported by one of the packages included
6167 in the table
</a
>, with the package supporting most MIME types being
6168 listed first in the table.
</p
>
6170 </p
>The best multimedia player in Debian? It is totem, followed by
6171 parole, kplayer, mpv, vlc, smplayer mplayer-gui gnome-mpv and
6172 kmplayer. Time for the other players to update their announced MIME
6178 <title>The Pyra - handheld computer with Debian preinstalled
</title>
6179 <link>http://www.hungry.com/~pere/blog/The_Pyra___handheld_computer_with_Debian_preinstalled.html
</link>
6180 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_Pyra___handheld_computer_with_Debian_preinstalled.html
</guid>
6181 <pubDate>Wed,
4 May
2016 10:
00:
00 +
0200</pubDate>
6182 <description>A friend of mine made me aware of
6183 <a href=
"https://pyra-handheld.com/boards/pages/pyra/
">The Pyra
</a
>, a
6184 handheld computer which will be delivered with Debian preinstalled. I
6185 would love to get one of those for my birthday. :)
</p
>
6187 <p
>The machine is a complete ARM-based PC with micro HDMI, SATA, USB
6188 plugs and many others connectors, and include a full keyboard and a
5"
6189 LCD touch screen. The
6000mAh battery is claimed to provide a whole
6190 day of battery life time, but I have not seen any independent tests
6191 confirming this. The vendor is still collecting preorders, and the
6192 last I heard last night was that
22 more orders were needed before
6193 production started.
</p
>
6195 <p
>As far as I know, this is the first handheld preinstalled with
6196 Debian. Please let me know if you know of any others. Is it the
6197 first computer being sold with Debian preinstalled?
</p
>
6202 <title>Lets make a Norwegian Bokmål edition of The Debian Administrator
's Handbook
</title>
6203 <link>http://www.hungry.com/~pere/blog/Lets_make_a_Norwegian_Bokm_l_edition_of_The_Debian_Administrator_s_Handbook.html
</link>
6204 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Lets_make_a_Norwegian_Bokm_l_edition_of_The_Debian_Administrator_s_Handbook.html
</guid>
6205 <pubDate>Sun,
10 Apr
2016 23:
20:
00 +
0200</pubDate>
6206 <description><p
>During this weekends
6207 <a href=
"http://www.nuug.no/news/Oslo__Takk_for_feilfiksingsfesten.shtml
">bug
6208 squashing party and developer gathering
</a
>, we decided to do our part
6209 to make sure there are good books about Debian available in Norwegian
6210 Bokmål, and got in touch with the people behind the
6211 <a href=
"http://debian-handbook.info/
">Debian Administrator
's Handbook
6212 project
</a
> to get started. If you want to help out, please start
6214 <a href=
"https://hosted.weblate.org/projects/debian-handbook/
">the
6215 hosted weblate project page
</a
>, and get in touch using
6216 <a href=
"http://lists.alioth.debian.org/mailman/listinfo/debian-handbook-translators
">the
6217 translators mailing list
</a
>. Please also check out
6218 <a href=
"https://debian-handbook.info/contribute/
">the instructions for
6219 contributors
</a
>.
</p
>
6221 <p
>The book is already available on paper in English, French and
6222 Japanese, and our goal is to get it available on paper in Norwegian
6223 Bokmål too. In addition to the paper edition, there are also EPUB and
6224 Mobi versions available. And there are incomplete translations
6225 available for many more languages.
</p
>
6230 <title>One in two hundred Debian users using ZFS on Linux?
</title>
6231 <link>http://www.hungry.com/~pere/blog/One_in_two_hundred_Debian_users_using_ZFS_on_Linux_.html
</link>
6232 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/One_in_two_hundred_Debian_users_using_ZFS_on_Linux_.html
</guid>
6233 <pubDate>Thu,
7 Apr
2016 22:
30:
00 +
0200</pubDate>
6234 <description><p
>Just for fun I had a look at the popcon number of ZFS related
6235 packages in Debian, and was quite surprised with what I found. I use
6236 ZFS myself at home, but did not really expect many others to do so.
6237 But I might be wrong.
</p
>
6239 <p
>According to
6240 <a href=
"https://qa.debian.org/popcon.php?package=spl-linux
">the popcon
6241 results for spl-linux
</a
>, there are
1019 Debian installations, or
6242 0.53% of the population, with the package installed. As far as I know
6243 the only use of the spl-linux package is as a support library for ZFS
6244 on Linux, so I use it here as proxy for measuring the number of ZFS
6245 installation on Linux in Debian. In the kFreeBSD variant of Debian
6246 the ZFS feature is already available, and there
6247 <a href=
"https://qa.debian.org/popcon.php?package=zfsutils
">the popcon
6248 results for zfsutils
</a
> show
1625 Debian installations or
0.84% of
6249 the population. So I guess I am not alone in using ZFS on Debian.
</p
>
6251 <p
>But even though the Debian project leader Lucas Nussbaum
6252 <a href=
"https://lists.debian.org/debian-devel-announce/
2015/
04/msg00006.html
">announced
6253 in April
2015</a
> that the legal obstacles blocking ZFS on Debian were
6254 cleared, the package is still not in Debian. The package is again in
6255 the NEW queue. Several uploads have been rejected so far because the
6256 debian/copyright file was incomplete or wrong, but there is no reason
6257 to give up. The current status can be seen on
6258 <a href=
"https://qa.debian.org/developer.php?login=pkg-zfsonlinux-devel@lists.alioth.debian.org
">the
6259 team status page
</a
>, and
6260 <a href=
"http://anonscm.debian.org/gitweb/?p=pkg-zfsonlinux/zfs.git
">the
6261 source code
</a
> is available on Alioth.
</p
>
6263 <p
>As I want ZFS to be included in next version of Debian to make sure
6264 my home server can function in the future using only official Debian
6265 packages, and the current blocker is to get the debian/copyright file
6266 accepted by the FTP masters in Debian, I decided a while back to try
6267 to help out the team. This was the background for my blog post about
6268 <a href=
"http://www.hungry.com/~pere/blog/Creating__updating_and_checking_debian_copyright_semi_automatically.html
">creating,
6269 updating and checking debian/copyright semi-automatically
</a
>, and I
6270 used the techniques I explored there to try to find any errors in the
6271 copyright file. It is not very easy to check every one of the around
6272 2000 files in the source package, but I hope we this time got it
6273 right. If you want to help out, check out the git source and try to
6274 find missing entries in the debian/copyright file.
</p
>
6279 <title>Full battery stats collector is now available in Debian
</title>
6280 <link>http://www.hungry.com/~pere/blog/Full_battery_stats_collector_is_now_available_in_Debian.html
</link>
6281 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Full_battery_stats_collector_is_now_available_in_Debian.html
</guid>
6282 <pubDate>Wed,
23 Mar
2016 22:
10:
00 +
0100</pubDate>
6283 <description><p
>Since this morning, the battery-stats package in Debian include an
6284 extended collector that will collect the complete battery history for
6285 later processing and graphing. The original collector store the
6286 battery level as percentage of last full level, while the new
6287 collector also record battery vendor, model, serial number, design
6288 full level, last full level and current battery level. This make it
6289 possible to predict the lifetime of the battery as well as visualise
6290 the energy flow when the battery is charging or discharging.
</p
>
6292 <p
>The new tools are available in
<tt
>/usr/share/battery-stats/
</tt
>
6293 in the version
0.5.1 package in unstable. Get the new battery level graph
6294 and lifetime prediction by running:
6296 <p
><pre
>
6297 /usr/share/battery-stats/battery-stats-graph /var/log/battery-stats.csv
6298 </pre
></p
>
6300 <p
>Or select the
'Battery Level Graph
' from your application menu.
</p
>
6302 <p
>The flow in/out of the battery can be seen by running (no menu
6303 entry yet):
</p
>
6305 <p
><pre
>
6306 /usr/share/battery-stats/battery-stats-graph-flow
6307 </pre
></p
>
6309 <p
>I
'm not quite happy with the way the data is visualised, at least
6310 when there are few data points. The graphs look a bit better with a
6311 few years of data.
</p
>
6313 <p
>A while back one important feature I use in the battery stats
6314 collector broke in Debian. The scripts in
6315 <tt
>/usr/lib/pm-utils/power.d/
</tt
> were no longer executed. I
6316 suspect it happened when Jessie started using systemd, but I do not
6317 know. The issue is reported as
6318 <a href=
"https://bugs.debian.org/
818649">bug #
818649</a
> against
6319 pm-utils. I managed to work around it by adding an udev rule to call
6320 the collector script every time the power connector is connected and
6321 disconnected. With this fix in place it was finally time to make a
6322 new release of the package, and get it into Debian.
</p
>
6324 <p
>If you are interested in how your laptop battery is doing, please
6326 <a href=
"https://tracker.debian.org/pkg/battery-stats
">battery-stats
</a
>
6327 in Debian unstable, or rebuild it on Jessie to get it working on
6328 Debian stable. :) The upstream source is available from
6329 <a href=
"https://github.com/petterreinholdtsen/battery-stats
">github
</a
>.
6330 As always, patches are very welcome.
</p
>
6335 <title>Making battery measurements a little easier in Debian
</title>
6336 <link>http://www.hungry.com/~pere/blog/Making_battery_measurements_a_little_easier_in_Debian.html
</link>
6337 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Making_battery_measurements_a_little_easier_in_Debian.html
</guid>
6338 <pubDate>Tue,
15 Mar
2016 15:
00:
00 +
0100</pubDate>
6339 <description><p
>Back in September, I blogged about
6340 <a href=
"http://www.hungry.com/~pere/blog/The_life_and_death_of_a_laptop_battery.html
">the
6341 system I wrote to collect statistics about my laptop battery
</a
>, and
6342 how it showed the decay and death of this battery (now replaced). I
6343 created a simple deb package to handle the collection and graphing,
6344 but did not want to upload it to Debian as there were already
6345 <a href=
"https://tracker.debian.org/pkg/battery-stats
">a battery-stats
6346 package in Debian
</a
> that should do the same thing, and I did not see
6347 a point of uploading a competing package when battery-stats could be
6348 fixed instead. I reported a few bugs about its non-function, and
6349 hoped someone would step in and fix it. But no-one did.
</p
>
6351 <p
>I got tired of waiting a few days ago, and took matters in my own
6352 hands. The end result is that I am now the new upstream developer of
6353 battery stats (
<a href=
"https://github.com/petterreinholdtsen/battery-stats
">available from github
</a
>) and part of the team maintaining
6354 battery-stats in Debian, and the package in Debian unstable is finally
6355 able to collect battery status using the
<tt
>/sys/class/power_supply/
</tt
>
6356 information provided by the Linux kernel. If you install the
6357 battery-stats package from unstable now, you will be able to get a
6358 graph of the current battery fill level, to get some idea about the
6359 status of the battery. The source package build and work just fine in
6360 Debian testing and stable (and probably oldstable too, but I have not
6361 tested). The default graph you get for that system look like this:
</p
>
6363 <p align=
"center
"><img src=
"http://www.hungry.com/~pere/blog/images/
2016-
03-
15-battery-stats-graph-example.png
" width=
"70%
" align=
"center
"></p
>
6365 <p
>My plans for the future is to merge my old scripts into the
6366 battery-stats package, as my old scripts collected a lot more details
6367 about the battery. The scripts are merged into the upstream
6368 battery-stats git repository already, but I am not convinced they work
6369 yet, as I changed a lot of paths along the way. Will have to test a
6370 bit more before I make a new release.
</p
>
6372 <p
>I will also consider changing the file format slightly, as I
6373 suspect the way I combine several values into one field might make it
6374 impossible to know the type of the value when using it for processing
6375 and graphing.
</p
>
6377 <p
>If you would like I would like to keep an close eye on your laptop
6378 battery, check out the battery-stats package in
6379 <a href=
"https://tracker.debian.org/pkg/battery-stats
">Debian
</a
> and
6381 <a href=
"https://github.com/petterreinholdtsen/battery-stats
">github
</a
>.
6382 I would love some help to improve the system further.
</p
>
6387 <title>Creating, updating and checking debian/copyright semi-automatically
</title>
6388 <link>http://www.hungry.com/~pere/blog/Creating__updating_and_checking_debian_copyright_semi_automatically.html
</link>
6389 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Creating__updating_and_checking_debian_copyright_semi_automatically.html
</guid>
6390 <pubDate>Fri,
19 Feb
2016 15:
00:
00 +
0100</pubDate>
6391 <description><p
>Making packages for Debian requires quite a lot of attention to
6392 details. And one of the details is the content of the
6393 debian/copyright file, which should list all relevant licenses used by
6394 the code in the package in question, preferably in
6395 <a href=
"https://www.debian.org/doc/packaging-manuals/copyright-format/
1.0/
">machine
6396 readable DEP5 format
</a
>.
</p
>
6398 <p
>For large packages with lots of contributors it is hard to write
6399 and update this file manually, and if you get some detail wrong, the
6400 package is normally rejected by the ftpmasters. So getting it right
6401 the first time around get the package into Debian faster, and save
6402 both you and the ftpmasters some work.. Today, while trying to figure
6403 out what was wrong with
6404 <a href=
"https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=
686447">the
6405 zfsonlinux copyright file
</a
>, I decided to spend some time on
6406 figuring out the options for doing this job automatically, or at least
6407 semi-automatically.
</p
>
6409 <p
>Lucikly, there are at least two tools available for generating the
6410 file based on the code in the source package,
6411 <tt
><a href=
"https://tracker.debian.org/pkg/debmake
">debmake
</a
></tt
>
6412 and
<tt
><a href=
"https://tracker.debian.org/pkg/cme
">cme
</a
></tt
>. I
'm
6413 not sure which one of them came first, but both seem to be able to
6414 create a sensible draft file. As far as I can tell, none of them can
6415 be trusted to get the result just right, so the content need to be
6416 polished a bit before the file is OK to upload. I found the debmake
6418 <a href=
"http://goofying-with-debian.blogspot.com/
2014/
07/debmake-checking-source-against-dep-
5.html
">a
6419 blog posts from
2014</a
>.
6421 <p
>To generate using debmake, use the -cc option:
6423 <p
><pre
>
6424 debmake -cc
> debian/copyright
6425 </pre
></p
>
6427 <p
>Note there are some problems with python and non-ASCII names, so
6428 this might not be the best option.
</p
>
6430 <p
>The cme option is based on a config parsing library, and I found
6432 <a href=
"https://ddumont.wordpress.com/
2015/
04/
05/improving-creation-of-debian-copyright-file/
">a
6433 blog post from
2015</a
>. To generate using cme, use the
'update
6434 dpkg-copyright
' option:
6436 <p
><pre
>
6437 cme update dpkg-copyright
6438 </pre
></p
>
6440 <p
>This will create or update debian/copyright. The cme tool seem to
6441 handle UTF-
8 names better than debmake.
</p
>
6443 <p
>When the copyright file is created, I would also like some help to
6444 check if the file is correct. For this I found two good options,
6445 <tt
>debmake -k
</tt
> and
<tt
>license-reconcile
</tt
>. The former seem
6446 to focus on license types and file matching, and is able to detect
6447 ineffective blocks in the copyright file. The latter reports missing
6448 copyright holders and years, but was confused by inconsistent license
6449 names (like CDDL vs. CDDL-
1.0). I suspect it is good to use both and
6450 fix all issues reported by them before uploading. But I do not know
6451 if the tools and the ftpmasters agree on what is important to fix in a
6452 copyright file, so the package might still be rejected.
</p
>
6454 <p
>The devscripts tool
<tt
>licensecheck
</tt
> deserve mentioning. It
6455 will read through the source and try to find all copyright statements.
6456 It is not comparing the result to the content of debian/copyright, but
6457 can be useful when verifying the content of the copyright file.
</p
>
6459 <p
>Are you aware of better tools in Debian to create and update
6460 debian/copyright file. Please let me know, or blog about it on
6461 planet.debian.org.
</p
>
6463 <p
>As usual, if you use Bitcoin and want to show your support of my
6464 activities, please send Bitcoin donations to my address
6465 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
6467 <p
><strong
>Update
2016-
02-
20</strong
>: I got a tip from Mike Gabriel
6468 on how to use licensecheck and cdbs to create a draft copyright file
6470 <p
><pre
>
6471 licensecheck --copyright -r `find * -type f` | \
6472 /usr/lib/cdbs/licensecheck2dep5
> debian/copyright.auto
6473 </pre
></p
>
6475 <p
>He mentioned that he normally check the generated file into the
6476 version control system to make it easier to discover license and
6477 copyright changes in the upstream source. I will try to do the same
6478 with my packages in the future.
</p
>
6480 <p
><strong
>Update
2016-
02-
21</strong
>: The cme author recommended
6481 against using -quiet for new users, so I removed it from the proposed
6482 command line.
</p
>
6487 <title>Using appstream in Debian to locate packages with firmware and mime type support
</title>
6488 <link>http://www.hungry.com/~pere/blog/Using_appstream_in_Debian_to_locate_packages_with_firmware_and_mime_type_support.html
</link>
6489 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Using_appstream_in_Debian_to_locate_packages_with_firmware_and_mime_type_support.html
</guid>
6490 <pubDate>Thu,
4 Feb
2016 16:
40:
00 +
0100</pubDate>
6491 <description><p
>The
<a href=
"https://wiki.debian.org/DEP-
11">appstream system
</a
>
6492 is taking shape in Debian, and one provided feature is a very
6493 convenient way to tell you which package to install to make a given
6494 firmware file available when the kernel is looking for it. This can
6495 be done using apt-file too, but that is for someone else to blog
6498 <p
>Here is a small recipe to find the package with a given firmware
6499 file, in this example I am looking for ctfw-
3.2.3.0.bin, randomly
6500 picked from the set of firmware announced using appstream in Debian
6501 unstable. In general you would be looking for the firmware requested
6502 by the kernel during kernel module loading. To find the package
6503 providing the example file, do like this:
</p
>
6505 <blockquote
><pre
>
6506 % apt install appstream
6510 % appstreamcli what-provides firmware:runtime ctfw-
3.2.3.0.bin | \
6511 awk
'/Package:/ {print $
2}
'
6514 </pre
></blockquote
>
6516 <p
>See
<a href=
"https://wiki.debian.org/AppStream/Guidelines
">the
6517 appstream wiki
</a
> page to learn how to embed the package metadata in
6518 a way appstream can use.
</p
>
6520 <p
>This same approach can be used to find any package supporting a
6521 given MIME type. This is very useful when you get a file you do not
6522 know how to handle. First find the mime type using
<tt
>file
6523 --mime-type
</tt
>, and next look up the package providing support for
6524 it. Lets say you got an SVG file. Its MIME type is image/svg+xml,
6525 and you can find all packages handling this type like this:
</p
>
6527 <blockquote
><pre
>
6528 % apt install appstream
6532 % appstreamcli what-provides mimetype image/svg+xml | \
6533 awk
'/Package:/ {print $
2}
'
6555 </pre
></blockquote
>
6557 <p
>I believe the MIME types are fetched from the desktop file for
6558 packages providing appstream metadata.
</p
>
6563 <title>Creepy, visualise geotagged social media information - nice free software
</title>
6564 <link>http://www.hungry.com/~pere/blog/Creepy__visualise_geotagged_social_media_information___nice_free_software.html
</link>
6565 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Creepy__visualise_geotagged_social_media_information___nice_free_software.html
</guid>
6566 <pubDate>Sun,
24 Jan
2016 10:
50:
00 +
0100</pubDate>
6567 <description><p
>Most people seem not to realise that every time they walk around
6568 with the computerised radio beacon known as a mobile phone their
6569 position is tracked by the phone company and often stored for a long
6570 time (like every time a SMS is received or sent). And if their
6571 computerised radio beacon is capable of running programs (often called
6572 mobile apps) downloaded from the Internet, these programs are often
6573 also capable of tracking their location (if the app requested access
6574 during installation). And when these programs send out information to
6575 central collection points, the location is often included, unless
6576 extra care is taken to not send the location. The provided
6577 information is used by several entities, for good and bad (what is
6578 good and bad, depend on your point of view). What is certain, is that
6579 the private sphere and the right to free movement is challenged and
6580 perhaps even eradicated for those announcing their location this way,
6581 when they share their whereabouts with private and public
6584 <p align=
"center
"><img width=
"70%
" src=
"http://www.hungry.com/~pere/blog/images/
2016-
01-
24-nice-creepy-desktop-window.png
"></p
>
6586 <p
>The phone company logs provide a register of locations to check out
6587 when one want to figure out what the tracked person was doing. It is
6588 unavailable for most of us, but provided to selected government
6589 officials, company staff, those illegally buying information from
6590 unfaithful servants and crackers stealing the information. But the
6591 public information can be collected and analysed, and a free software
6592 tool to do so is called
6593 <a href=
"http://www.geocreepy.com/
">Creepy or Cree.py
</a
>. I
6594 discovered it when I read
6595 <a href=
"http://www.aftenposten.no/kultur/Slik-kan-du-bli-overvaket-pa-Twitter-og-Instagram-uten-a-ane-det-
7787884.html
">an
6596 article about Creepy
</a
> in the Norwegian newspaper Aftenposten i
6597 November
2014, and decided to check if it was available in Debian.
6598 The python program was in Debian, but
6599 <a href=
"https://tracker.debian.org/pkg/creepy
">the version in
6600 Debian
</a
> was completely broken and practically unmaintained. I
6601 uploaded a new version which did not work quite right, but did not
6602 have time to fix it then. This Christmas I decided to finally try to
6603 get Creepy operational in Debian. Now a fixed version is available in
6604 Debian unstable and testing, and almost all Debian specific patches
6606 <a href=
"https://github.com/jkakavas/creepy
">upstream
</a
>.
</p
>
6608 <p
>The Creepy program visualises geolocation information fetched from
6609 Twitter, Instagram, Flickr and Google+, and allow one to get a
6610 complete picture of every social media message posted recently in a
6611 given area, or track the movement of a given individual across all
6612 these services. Earlier it was possible to use the search API of at
6613 least some of these services without identifying oneself, but these
6614 days it is impossible. This mean that to use Creepy, you need to
6615 configure it to log in as yourself on these services, and provide
6616 information to them about your search interests. This should be taken
6617 into account when using Creepy, as it will also share information
6618 about yourself with the services.
</p
>
6620 <p
>The picture above show the twitter messages sent from (or at least
6621 geotagged with a position from) the city centre of Oslo, the capital
6622 of Norway. One useful way to use Creepy is to first look at
6623 information tagged with an area of interest, and next look at all the
6624 information provided by one or more individuals who was in the area.
6625 I tested it by checking out which celebrity provide their location in
6626 twitter messages by checkout out who sent twitter messages near a
6627 Norwegian TV station, and next could track their position over time,
6628 making it possible to locate their home and work place, among other
6629 things. A similar technique have been
6630 <a href=
"http://www.buzzfeed.com/maxseddon/does-this-soldiers-instagram-account-prove-russia-is-covertl
">used
6631 to locate Russian soldiers in Ukraine
</a
>, and it is both a powerful
6632 tool to discover lying governments, and a useful tool to help people
6633 understand the value of the private information they provide to the
6636 <p
>The package is not trivial to backport to Debian Stable/Jessie, as
6637 it depend on several python modules currently missing in Jessie (at
6638 least python-instagram, python-flickrapi and
6639 python-requests-toolbelt).
</p
>
6641 <p
>(I have uploaded
6642 <a href=
"https://screenshots.debian.net/package/creepy
">the image to
6643 screenshots.debian.net
</a
> and licensed it under the same terms as the
6644 Creepy program in Debian.)
</p
>
6649 <title>Always download Debian packages using Tor - the simple recipe
</title>
6650 <link>http://www.hungry.com/~pere/blog/Always_download_Debian_packages_using_Tor___the_simple_recipe.html
</link>
6651 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Always_download_Debian_packages_using_Tor___the_simple_recipe.html
</guid>
6652 <pubDate>Fri,
15 Jan
2016 00:
30:
00 +
0100</pubDate>
6653 <description><p
>During his DebConf15 keynote, Jacob Appelbaum
6654 <a href=
"https://summit.debconf.org/debconf15/meeting/
331/what-is-to-be-done/
">observed
6655 that those listening on the Internet lines would have good reason to
6656 believe a computer have a given security hole
</a
> if it download a
6657 security fix from a Debian mirror. This is a good reason to always
6658 use encrypted connections to the Debian mirror, to make sure those
6659 listening do not know which IP address to attack. In August, Richard
6660 Hartmann observed that encryption was not enough, when it was possible
6661 to interfere download size to security patches or the fact that
6662 download took place shortly after a security fix was released, and
6663 <a href=
"http://richardhartmann.de/blog/posts/
2015/
08/
24-Tor-enabled_Debian_mirror/
">proposed
6664 to always use Tor to download packages from the Debian mirror
</a
>. He
6665 was not the first to propose this, as the
6666 <tt
><a href=
"https://tracker.debian.org/pkg/apt-transport-tor
">apt-transport-tor
</a
></tt
>
6667 package by Tim Retout already existed to make it easy to convince apt
6668 to use
<a href=
"https://www.torproject.org/
">Tor
</a
>, but I was not
6669 aware of that package when I read the blog post from Richard.
</p
>
6671 <p
>Richard discussed the idea with Peter Palfrader, one of the Debian
6672 sysadmins, and he set up a Tor hidden service on one of the central
6673 Debian mirrors using the address vwakviie2ienjx6t.onion, thus making
6674 it possible to download packages directly between two tor nodes,
6675 making sure the network traffic always were encrypted.
</p
>
6677 <p
>Here is a short recipe for enabling this on your machine, by
6678 installing
<tt
>apt-transport-tor
</tt
> and replacing http and https
6679 urls with tor+http and tor+https, and using the hidden service instead
6680 of the official Debian mirror site. I recommend installing
6681 <tt
>etckeeper
</tt
> before you start to have a history of the changes
6682 done in /etc/.
</p
>
6684 <blockquote
><pre
>
6685 apt install apt-transport-tor
6686 sed -i
's% http://ftp.debian.org/% tor+http://vwakviie2ienjx6t.onion/%
' /etc/apt/sources.list
6687 sed -i
's% http% tor+http%
' /etc/apt/sources.list
6688 </pre
></blockquote
>
6690 <p
>If you have more sources listed in /etc/apt/sources.list.d/, run
6691 the sed commands for these too. The sed command is assuming your are
6692 using the ftp.debian.org Debian mirror. Adjust the command (or just
6693 edit the file manually) to match your mirror.
</p
>
6695 <p
>This work in Debian Jessie and later. Note that tools like
6696 <tt
>apt-file
</tt
> only recently started using the apt transport
6697 system, and do not work with these tor+http URLs. For
6698 <tt
>apt-file
</tt
> you need the version currently in experimental,
6699 which need a recent apt version currently only in unstable. So if you
6700 need a working
<tt
>apt-file
</tt
>, this is not for you.
</p
>
6702 <p
>Another advantage from this change is that your machine will start
6703 using Tor regularly and at fairly random intervals (every time you
6704 update the package lists or upgrade or install a new package), thus
6705 masking other Tor traffic done from the same machine. Using Tor will
6706 become normal for the machine in question.
</p
>
6708 <p
>On
<a href=
"https://wiki.debian.org/FreedomBox
">Freedombox
</a
>, APT
6709 is set up by default to use
<tt
>apt-transport-tor
</tt
> when Tor is
6710 enabled. It would be great if it was the default on any Debian
6716 <title>OpenALPR, find car license plates in video streams - nice free software
</title>
6717 <link>http://www.hungry.com/~pere/blog/OpenALPR__find_car_license_plates_in_video_streams___nice_free_software.html
</link>
6718 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/OpenALPR__find_car_license_plates_in_video_streams___nice_free_software.html
</guid>
6719 <pubDate>Wed,
23 Dec
2015 01:
00:
00 +
0100</pubDate>
6720 <description><p
>When I was a kid, we used to collect
"car numbers
", as we used to
6721 call the car license plate numbers in those days. I would write the
6722 numbers down in my little book and compare notes with the other kids
6723 to see how many region codes we had seen and if we had seen some
6724 exotic or special region codes and numbers. It was a fun game to pass
6725 time, as we kids have plenty of it.
</p
>
6727 <p
>A few days I came across
6728 <a href=
"https://github.com/openalpr/openalpr
">the OpenALPR
6729 project
</a
>, a free software project to automatically discover and
6730 report license plates in images and video streams, and provide the
6731 "car numbers
" in a machine readable format. I
've been looking for
6732 such system for a while now, because I believe it is a bad idea that the
6733 <a href=
"https://en.wikipedia.org/wiki/Automatic_number_plate_recognition
">automatic
6734 number plate recognition
</a
> tool only is available in the hands of
6735 the powerful, and want it to be available also for the powerless to
6736 even the score when it comes to surveillance and sousveillance. I
6737 discovered the developer
6738 <a href=
"https://bugs.debian.org/
747509">wanted to get the tool into
6739 Debian
</a
>, and as I too wanted it to be in Debian, I volunteered to
6740 help him get it into shape to get the package uploaded into the Debian
6743 <p
>Today we finally managed to get the package into shape and uploaded
6744 it into Debian, where it currently
6745 <a href=
"https://ftp-master.debian.org//new/openalpr_2.2
.1-
1.html
">waits
6746 in the NEW queue
</a
> for review by the Debian ftpmasters.
</p
>
6748 <p
>I guess you are wondering why on earth such tool would be useful
6749 for the common folks, ie those not running a large government
6750 surveillance system? Well, I plan to put it in a computer on my bike
6751 and in my car, tracking the cars nearby and allowing me to be notified
6752 when number plates on my watch list are discovered. Another use case
6753 was suggested by a friend of mine, who wanted to set it up at his home
6754 to open the car port automatically when it discovered the plate on his
6755 car. When I mentioned it perhaps was a bit foolhardy to allow anyone
6756 capable of placing his license plate number of a piece of cardboard to
6757 open his car port, men replied that it was always unlocked anyway. I
6758 guess for such use case it make sense. I am sure there are other use
6759 cases too, for those with imagination and a vision.
</p
>
6761 <p
>If you want to build your own version of the Debian package, check
6762 out the upstream git source and symlink ./distros/debian to ./debian/
6763 before running
"debuild
" to build the source. Or wait a bit until the
6764 package show up in unstable.
</p
>
6769 <title>Using appstream with isenkram to install hardware related packages in Debian
</title>
6770 <link>http://www.hungry.com/~pere/blog/Using_appstream_with_isenkram_to_install_hardware_related_packages_in_Debian.html
</link>
6771 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Using_appstream_with_isenkram_to_install_hardware_related_packages_in_Debian.html
</guid>
6772 <pubDate>Sun,
20 Dec
2015 12:
20:
00 +
0100</pubDate>
6773 <description><p
>Around three years ago, I created
6774 <a href=
"http://packages.qa.debian.org/isenkram
">the isenkram
6775 system
</a
> to get a more practical solution in Debian for handing
6776 hardware related packages. A GUI system in the isenkram package will
6777 present a pop-up dialog when some hardware dongle supported by
6778 relevant packages in Debian is inserted into the machine. The same
6779 lookup mechanism to detect packages is available as command line
6780 tools in the isenkram-cli package. In addition to mapping hardware,
6781 it will also map kernel firmware files to packages and make it easy to
6782 install needed firmware packages automatically. The key for this
6783 system to work is a good way to map hardware to packages, in other
6784 words, allow packages to announce what hardware they will work
6787 <p
>I started by providing data files in the isenkram source, and
6788 adding code to download the latest version of these data files at run
6789 time, to ensure every user had the most up to date mapping available.
6790 I also added support for storing the mapping in the Packages file in
6791 the apt repositories, but did not push this approach because while I
6792 was trying to figure out how to best store hardware/package mappings,
6793 <a href=
"http://www.freedesktop.org/software/appstream/docs/
">the
6794 appstream system
</a
> was announced. I got in touch and suggested to
6795 add the hardware mapping into that data set to be able to use
6796 appstream as a data source, and this was accepted at least for the
6797 Debian version of appstream.
</p
>
6799 <p
>A few days ago using appstream in Debian for this became possible,
6800 and today I uploaded a new version
0.20 of isenkram adding support for
6801 appstream as a data source for mapping hardware to packages. The only
6802 package so far using appstream to announce its hardware support is my
6803 pymissile package. I got help from Matthias Klumpp with figuring out
6804 how do add the required
6805 <a href=
"https://appstream.debian.org/html/sid/main/metainfo/pymissile.html
">metadata
6806 in pymissile
</a
>. I added a file debian/pymissile.metainfo.xml with
6807 this content:
</p
>
6809 <blockquote
><pre
>
6810 &lt;?xml version=
"1.0" encoding=
"UTF-
8"?
&gt;
6811 &lt;component
&gt;
6812 &lt;id
&gt;pymissile
&lt;/id
&gt;
6813 &lt;metadata_license
&gt;MIT
&lt;/metadata_license
&gt;
6814 &lt;name
&gt;pymissile
&lt;/name
&gt;
6815 &lt;summary
&gt;Control original Striker USB Missile Launcher
&lt;/summary
&gt;
6816 &lt;description
&gt;
6818 Pymissile provides a curses interface to control an original
6819 Marks and Spencer / Striker USB Missile Launcher, as well as a
6820 motion control script to allow a webcamera to control the
6823 &lt;/description
&gt;
6824 &lt;provides
&gt;
6825 &lt;modalias
&gt;usb:v1130p0202d*
&lt;/modalias
&gt;
6826 &lt;/provides
&gt;
6827 &lt;/component
&gt;
6828 </pre
></blockquote
>
6830 <p
>The key for isenkram is the component/provides/modalias value,
6831 which is a glob style match rule for hardware specific strings
6832 (modalias strings) provided by the Linux kernel. In this case, it
6833 will map to all USB devices with vendor code
1130 and product code
6836 <p
>Note, it is important that the license of all the metadata files
6837 are compatible to have permissions to aggregate them into archive wide
6838 appstream files. Matthias suggested to use MIT or BSD licenses for
6839 these files. A challenge is figuring out a good id for the data, as
6840 it is supposed to be globally unique and shared across distributions
6841 (in other words, best to coordinate with upstream what to use). But
6842 it can be changed later or, so we went with the package name as
6843 upstream for this project is dormant.
</p
>
6845 <p
>To get the metadata file installed in the correct location for the
6846 mirror update scripts to pick it up and include its content the
6847 appstream data source, the file must be installed in the binary
6848 package under /usr/share/appdata/. I did this by adding the following
6849 line to debian/pymissile.install:
</p
>
6851 <blockquote
><pre
>
6852 debian/pymissile.metainfo.xml usr/share/appdata
6853 </pre
></blockquote
>
6855 <p
>With that in place, the command line tool isenkram-lookup will list
6856 all packages useful on the current computer automatically, and the GUI
6857 pop-up handler will propose to install the package not already
6858 installed if a hardware dongle is inserted into the machine in
6861 <p
>Details of the modalias field in appstream is available from the
6862 <a href=
"https://wiki.debian.org/DEP-
11">DEP-
11</a
> proposal.
</p
>
6864 <p
>To locate the modalias values of all hardware present in a machine,
6865 try running this command on the command line:
</p
>
6867 <blockquote
><pre
>
6868 cat $(find /sys/devices/|grep modalias)
6869 </pre
></blockquote
>
6871 <p
>To learn more about the isenkram system, please check out
6872 <a href=
"http://www.hungry.com/~pere/blog/tags/isenkram/
">my
6873 blog posts tagged isenkram
</a
>.
</p
>
6878 <title>The GNU General Public License is not magic pixie dust
</title>
6879 <link>http://www.hungry.com/~pere/blog/The_GNU_General_Public_License_is_not_magic_pixie_dust.html
</link>
6880 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_GNU_General_Public_License_is_not_magic_pixie_dust.html
</guid>
6881 <pubDate>Mon,
30 Nov
2015 09:
55:
00 +
0100</pubDate>
6882 <description><p
>A blog post from my fellow Debian developer Paul Wise titled
6883 "<a href=
"http://bonedaddy.net/pabs3/log/
2015/
11/
27/sfc-supporter/
">The
6884 GPL is not magic pixie dust
</a
>" explain the importance of making sure
6885 the
<a href=
"http://www.gnu.org/copyleft/gpl.html
">GPL
</a
> is enforced.
6886 I quote the blog post from Paul in full here with his permission:
<p
>
6890 <p
><a href=
"https://sfconservancy.org/supporter/
"><img src=
"https://sfconservancy.org/img/supporter-badge.png
" width=
"194" height=
"90" alt=
"Become a Software Freedom Conservancy Supporter!
" align=
"right
" border=
"0" /
></a
></p
>
6893 The GPL is not magic pixie dust. It does not work by itself.
<br/
>
6895 The first step is to choose a
6896 <a href=
"https://copyleft.org/
">copyleft
</a
> license for your
6899 The next step is, when someone fails to follow that copyleft license,
6900 <b
>it must be enforced
</b
><br/
>
6902 and its a simple fact of our modern society that such type of
6905 is incredibly expensive to do and incredibly difficult to do.
6908 <p
><small
>--
<a href=
"http://ebb.org/bkuhn/
">Bradley Kuhn
</a
>, in
6909 <a href=
"http://faif.us/
" title=
"Free as in Freedom
">FaiF
</a
>
6910 <a href=
"http://faif.us/cast/
2015/nov/
24/
0x57/
">episode
6911 0x57</a
></small
></p
>
6913 <p
>As the Debian Website
6914 <a href=
"https://bugs.debian.org/
794116">used
</a
>
6915 <a href=
"https://anonscm.debian.org/viewvc/webwml/webwml/english/intro/free.wml?r1=
1.24&amp;r2=
1.25">to
</a
>
6916 imply, public domain and permissively licensed software can lead to
6917 the production of more proprietary software as people discover useful
6918 software, extend it and or incorporate it into their hardware or
6919 software products. Copyleft licenses such as the GNU GPL were created
6920 to close off this avenue to the production of proprietary software but
6921 such licenses are not enough. With the ongoing adoption of Free
6922 Software by individuals and groups, inevitably the community
's
6923 expectations of license compliance are violated, usually out of
6924 ignorance of the way Free Software works, but not always. As Karen
6925 and Bradley explained in
<a href=
"http://faif.us/
" title=
"Free as in
6926 Freedom
">FaiF
</a
>
6927 <a href=
"http://faif.us/cast/
2015/nov/
24/
0x57/
">episode
0x57</a
>,
6928 copyleft is nothing if no-one is willing and able to stand up in court
6929 to protect it. The reality of today
's world is that legal
6930 representation is expensive, difficult and time consuming. With
6931 <a href=
"http://gpl-violations.org/
">gpl-violations.org
</a
> in hiatus
6932 <a href=
"http://gpl-violations.org/news/
20151027-homepage-recovers/
">until
</a
>
6933 some time in
2016, the
<a href=
"https://sfconservancy.org/
">Software
6934 Freedom Conservancy
</a
> (a tax-exempt charity) is the major defender
6935 of the Linux project, Debian and other groups against GPL violations.
6936 In March the SFC supported a
6937 <a href=
"https://sfconservancy.org/news/
2015/mar/
05/vmware-lawsuit/
">lawsuit
6938 by Christoph Hellwig
</a
> against VMware for refusing to
6939 <a href=
"https://sfconservancy.org/linux-compliance/vmware-lawsuit-faq.html
">comply
6940 with the GPL
</a
> in relation to their use of parts of the Linux
6941 kernel. Since then two of their sponsors pulled corporate funding and
6943 <a href=
"https://sfconservancy.org/blog/
2015/nov/
24/faif-carols-fundraiser/
">blocked
6944 or cancelled their talks
</a
>. As a result they have decided to rely
6945 less on corporate funding and more on the broad community of
6946 individuals who support Free Software and copyleft. So the SFC has
6947 <a href=
"https://sfconservancy.org/news/
2015/nov/
23/
2015fundraiser/
">launched
</a
>
6948 a
<a href=
"https://sfconservancy.org/supporter/
">campaign
</a
> to create
6949 a community of folks who stand up for copyleft and the GPL by
6950 supporting their work on promoting and supporting copyleft and Free
6953 <p
>If you support Free Software,
6954 <a href=
"https://sfconservancy.org/blog/
2015/nov/
26/like-what-I-do/
">like
</a
>
6955 what the SFC do, agree with their
6956 <a href=
"https://sfconservancy.org/linux-compliance/principles.html
">compliance
6957 principles
</a
>, are happy about their
6958 <a href=
"https://sfconservancy.org/supporter/
">successes
</a
> in
2015,
6959 work on a project that is an SFC
6960 <a href=
"https://sfconservancy.org/members/current/
">member
</a
> and or
6961 just want to stand up for copyleft, please join
6962 <a href=
"https://identi.ca/cwebber/image/JQGPA4qbTyyp3-MY8QpvuA
">Christopher
6963 Allan Webber
</a
>,
6964 <a href=
"https://sfconservancy.org/blog/
2015/nov/
24/faif-carols-fundraiser/
">Carol
6966 <a href=
"http://www.jonobacon.org/
2015/
11/
25/supporting-software-freedom-conservancy/
">Jono
6967 Bacon
</a
>, myself and
6968 <a href=
"https://sfconservancy.org/sponsors/#supporters
">others
</a
> in
6970 <a href=
"https://sfconservancy.org/supporter/
">supporter
</a
>. For the
6971 next week your donation will be
6972 <a href=
"https://sfconservancy.org/news/
2015/nov/
27/black-friday/
">matched
</a
>
6973 by an anonymous donor. Please also consider asking your employer to
6974 match your donation or become a sponsor of SFC. Don
't forget to
6975 spread the word about your support for SFC via email, your blog and or
6976 social media accounts.
</p
>
6980 <p
>I agree with Paul on this topic and just signed up as a Supporter
6981 of Software Freedom Conservancy myself. Perhaps you should be a
6982 supporter too?
</p
>
6987 <title>PGP key transition statement for key EE4E02F9
</title>
6988 <link>http://www.hungry.com/~pere/blog/PGP_key_transition_statement_for_key_EE4E02F9.html
</link>
6989 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/PGP_key_transition_statement_for_key_EE4E02F9.html
</guid>
6990 <pubDate>Tue,
17 Nov
2015 10:
50:
00 +
0100</pubDate>
6991 <description><p
>I
've needed a new OpenPGP key for a while, but have not had time to
6992 set it up properly. I wanted to generate it offline and have it
6993 available on
<a href=
"http://shop.kernelconcepts.de/#openpgp
">a OpenPGP
6994 smart card
</a
> for daily use, and learning how to do it and finding
6995 time to sit down with an offline machine almost took forever. But
6996 finally I
've been able to complete the process, and have now moved
6997 from my old GPG key to a new GPG key. See
6998 <a href=
"http://www.hungry.com/~pere/blog/images/
2015-
11-
17-new-gpg-key-transition.txt
">the
6999 full transition statement, signed with both my old and new key
</a
> for
7000 the details. This is my new key:
</p
>
7003 pub
3936R/
<a href=
"http://pgp.cs.uu.nl/stats/
111D6B29EE4E02F9.html
">111D6B29EE4E02F9
</a
> 2015-
11-
03 [expires:
2019-
11-
14]
7004 Key fingerprint =
3AC7 B2E3 ACA5 DF87
78F1 D827
111D
6B29 EE4E
02F9
7005 uid Petter Reinholdtsen
&lt;pere@hungry.com
&gt;
7006 uid Petter Reinholdtsen
&lt;pere@debian.org
&gt;
7007 sub
4096R/
87BAFB0E
2015-
11-
03 [expires:
2019-
11-
02]
7008 sub
4096R/F91E6DE9
2015-
11-
03 [expires:
2019-
11-
02]
7009 sub
4096R/A0439BAB
2015-
11-
03 [expires:
2019-
11-
02]
7012 <p
>The key can be downloaded from the OpenPGP key servers, signed by
7013 my old key.
</p
>
7015 <p
>If you signed my old key
7016 (
<a href=
"http://pgp.cs.uu.nl/stats/DB4CCC4B2A30D729.html
">DB4CCC4B2A30D729
</a
>),
7017 I
'd very much appreciate a signature on my new key, details and
7018 instructions in the transition statement. I m happy to reciprocate if
7019 you have a similarly signed transition statement to present.
</p
>
7024 <title>The life and death of a laptop battery
</title>
7025 <link>http://www.hungry.com/~pere/blog/The_life_and_death_of_a_laptop_battery.html
</link>
7026 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_life_and_death_of_a_laptop_battery.html
</guid>
7027 <pubDate>Thu,
24 Sep
2015 16:
00:
00 +
0200</pubDate>
7028 <description><p
>When I get a new laptop, the battery life time at the start is OK.
7029 But this do not last. The last few laptops gave me a feeling that
7030 within a year, the life time is just a fraction of what it used to be,
7031 and it slowly become painful to use the laptop without power connected
7032 all the time. Because of this, when I got a new Thinkpad X230 laptop
7033 about two years ago, I decided to monitor its battery state to have
7034 more hard facts when the battery started to fail.
</p
>
7036 <img src=
"http://www.hungry.com/~pere/blog/images/
2015-
09-
24-laptop-battery-graph.png
"/
>
7038 <p
>First I tried to find a sensible Debian package to record the
7039 battery status, assuming that this must be a problem already handled
7040 by someone else. I found
7041 <a href=
"https://tracker.debian.org/pkg/battery-stats
">battery-stats
</a
>,
7042 which collects statistics from the battery, but it was completely
7043 broken. I sent a few suggestions to the maintainer, but decided to
7044 write my own collector as a shell script while I waited for feedback
7046 <a href=
"http://www.ifweassume.com/
2013/
08/the-de-evolution-of-my-laptop-battery.html
">a
7047 blog post about the battery development on a MacBook Air
</a
> I also
7049 <a href=
"https://github.com/jradavenport/batlog.git
">batlog
</a
>, not
7050 available in Debian.
</p
>
7052 <p
>I started my collector
2013-
07-
15, and it has been collecting
7053 battery stats ever since. Now my
7054 /var/log/hjemmenett-battery-status.log file contain around
115,
000
7055 measurements, from the time the battery was working great until now,
7056 when it is unable to charge above
7% of original capacity. My
7057 collector shell script is quite simple and look like this:
</p
>
7062 # http://www.ifweassume.com/
2013/
08/the-de-evolution-of-my-laptop-battery.html
7064 # http://blog.sleeplessbeastie.eu/
2013/
01/
02/debian-how-to-monitor-battery-capacity/
7065 logfile=/var/log/hjemmenett-battery-status.log
7067 files=
"manufacturer model_name technology serial_number \
7068 energy_full energy_full_design energy_now cycle_count status
"
7070 if [ ! -e
"$logfile
" ] ; then
7072 printf
"timestamp,
"
7074 printf
"%s,
" $f
7077 )
> "$logfile
"
7081 # Print complete message in one echo call, to avoid race condition
7082 # when several log processes run in parallel.
7083 msg=$(printf
"%s,
" $(date +%s); \
7084 for f in $files; do \
7085 printf
"%s,
" $(cat $f); \
7087 echo
"$msg
"
7090 cd /sys/class/power_supply
7093 (cd $bat
&& log_battery
>> "$logfile
")
7097 <p
>The script is called when the power management system detect a
7098 change in the power status (power plug in or out), and when going into
7099 and out of hibernation and suspend. In addition, it collect a value
7100 every
10 minutes. This make it possible for me know when the battery
7101 is discharging, charging and how the maximum charge change over time.
7102 The code for the Debian package
7103 <a href=
"https://github.com/petterreinholdtsen/battery-status
">is now
7104 available on github
</a
>.
</p
>
7106 <p
>The collected log file look like this:
</p
>
7109 timestamp,manufacturer,model_name,technology,serial_number,energy_full,energy_full_design,energy_now,cycle_count,status,
7110 1376591133,LGC,
45N1025,Li-ion,
974,
62800000,
62160000,
39050000,
0,Discharging,
7112 1443090528,LGC,
45N1025,Li-ion,
974,
4900000,
62160000,
4900000,
0,Full,
7113 1443090601,LGC,
45N1025,Li-ion,
974,
4900000,
62160000,
4900000,
0,Full,
7116 <p
>I wrote a small script to create a graph of the charge development
7117 over time. This graph depicted above show the slow death of my laptop
7120 <p
>But why is this happening? Why are my laptop batteries always
7121 dying in a year or two, while the batteries of space probes and
7122 satellites keep working year after year. If we are to believe
7123 <a href=
"http://batteryuniversity.com/learn/article/how_to_prolong_lithium_based_batteries
">Battery
7124 University
</a
>, the cause is me charging the battery whenever I have a
7125 chance, and the fix is to not charge the Lithium-ion batteries to
100%
7126 all the time, but to stay below
90% of full charge most of the time.
7127 I
've been told that the Tesla electric cars
7128 <a href=
"http://my.teslamotors.com/de_CH/forum/forums/battery-charge-limit
">limit
7129 the charge of their batteries to
80%
</a
>, with the option to charge to
7130 100% when preparing for a longer trip (not that I would want a car
7131 like Tesla where rights to privacy is abandoned, but that is another
7132 story), which I guess is the option we should have for laptops on
7133 Linux too.
</p
>
7135 <p
>Is there a good and generic way with Linux to tell the battery to
7136 stop charging at
80%, unless requested to charge to
100% once in
7137 preparation for a longer trip? I found
7138 <a href=
"http://askubuntu.com/questions/
34452/how-can-i-limit-battery-charging-to-
80-capacity
">one
7139 recipe on askubuntu for Ubuntu to limit charging on Thinkpad to
7140 80%
</a
>, but could not get it to work (kernel module refused to
7143 <p
>I wonder why the battery capacity was reported to be more than
100%
7144 at the start. I also wonder why the
"full capacity
" increases some
7145 times, and if it is possible to repeat the process to get the battery
7146 back to design capacity. And I wonder if the discharge and charge
7147 speed change over time, or if this stay the same. I did not yet try
7148 to write a tool to calculate the derivative values of the battery
7149 level, but suspect some interesting insights might be learned from
7152 <p
>Update
2015-
09-
24: I got a tip to install the packages
7153 acpi-call-dkms and tlp (unfortunately missing in Debian stable)
7154 packages instead of the tp-smapi-dkms package I had tried to use
7155 initially, and use
'tlp setcharge
40 80' to change when charging start
7156 and stop. I
've done so now, but expect my existing battery is toast
7157 and need to be replaced. The proposal is unfortunately Thinkpad
7163 <title>New laptop - some more clues and ideas based on feedback
</title>
7164 <link>http://www.hungry.com/~pere/blog/New_laptop___some_more_clues_and_ideas_based_on_feedback.html
</link>
7165 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_laptop___some_more_clues_and_ideas_based_on_feedback.html
</guid>
7166 <pubDate>Sun,
5 Jul
2015 21:
40:
00 +
0200</pubDate>
7167 <description><p
>Several people contacted me after my previous blog post about my
7168 need for a new laptop, and provided very useful feedback. I wish to
7169 thank every one of these. Several pointed me to the possibility of
7170 fixing my X230, and I am already in the process of getting Lenovo to
7171 do so thanks to the on site, next day support contract covering the
7172 machine. But the battery is almost useless (I expect to replace it
7173 with a non-official battery) and I do not expect the machine to live
7174 for many more years, so it is time to plan its replacement. If I did
7175 not have a support contract, it was suggested to find replacement parts
7176 using
<a href=
"http://www.francecrans.com/
">FrancEcrans
</a
>, but it
7177 might present a language barrier as I do not understand French.
</p
>
7179 <p
>One tip I got was to use the
7180 <a href=
"https://skinflint.co.uk/?cat=nb
">Skinflint
</a
> web service to
7181 compare laptop models. It seem to have more models available than
7182 prisjakt.no. Another tip I got from someone I know have similar
7183 keyboard preferences was that the HP EliteBook
840 keyboard is not
7184 very good, and this matches my experience with earlier EliteBook
7185 keyboards I tested. Because of this, I will not consider it any further.
7187 <p
>When I wrote my blog post, I was not aware of Thinkpad X250, the
7188 newest Thinkpad X model. The keyboard reintroduces mouse buttons
7189 (which is missing from the X240), and is working fairly well with
7190 Debian Sid/Unstable according to
7191 <a href=
"http://www.corsac.net/X250/
">Corsac.net
</a
>. The reports I
7192 got on the keyboard quality are not consistent. Some say the keyboard
7193 is good, others say it is ok, while others say it is not very good.
7194 Those with experience from X41 and and X60 agree that the X250
7195 keyboard is not as good as those trusty old laptops, and suggest I
7196 keep and fix my X230 instead of upgrading, or get a used X230 to
7197 replace it. I
'm also told that the X250 lack leds for caps lock, disk
7198 activity and battery status, which is very convenient on my X230. I
'm
7199 also told that the CPU fan is running very often, making it a bit
7200 noisy. In any case, the X250 do not work out of the box with Debian
7201 Stable/Jessie, one of my requirements.
</p
>
7203 <p
>I have also gotten a few vendor proposals, one was
7204 <a href=
"http://pro-star.com
">Pro-Star
</a
>, another was
7205 <a href=
"http://shop.gluglug.org.uk/product/libreboot-x200/
">Libreboot
</a
>.
7206 The latter look very attractive to me.
</p
>
7208 <p
>Again, thank you all for the very useful feedback. It help a lot
7209 as I keep looking for a replacement.
</p
>
7211 <p
>Update
2015-
07-
06: I was recommended to check out the
7212 <a href=
"">lapstore.de
</a
> web shop for used laptops. They got several
7214 <a href=
"http://www.lapstore.de/f.php/shop/lapstore/f/
411/lang/x/kw/Lenovo_ThinkPad_X_Serie/
">old
7215 thinkpad X models
</a
>, and provide one year warranty.
</p
>
7220 <title>Time to find a new laptop, as the old one is broken after only two years
</title>
7221 <link>http://www.hungry.com/~pere/blog/Time_to_find_a_new_laptop__as_the_old_one_is_broken_after_only_two_years.html
</link>
7222 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Time_to_find_a_new_laptop__as_the_old_one_is_broken_after_only_two_years.html
</guid>
7223 <pubDate>Fri,
3 Jul
2015 07:
10:
00 +
0200</pubDate>
7224 <description><p
>My primary work horse laptop is failing, and will need a
7225 replacement soon. The left
5 cm of the screen on my Thinkpad X230
7226 started flickering yesterday, and I suspect the cause is a broken
7227 cable, as changing the angle of the screen some times get rid of the
7228 flickering.
</p
>
7230 <p
>My requirements have not really changed since I bought it, and is
7232 <a href=
"http://www.hungry.com/~pere/blog/Thank_you_Thinkpad_X41__for_your_long_and_trustworthy_service.html
">I
7233 described them in
2013</a
>. The last time I bought a laptop, I had
7235 <a href=
"http://www.prisjakt.no/category.php?k=
353">prisjakt.no
</a
>
7236 where I could select at least a few of the requirements (mouse pin,
7237 wifi, weight) and go through the rest manually. Three button mouse
7238 and a good keyboard is not available as an option, and all the three
7239 laptop models proposed today (Thinkpad X240, HP EliteBook
820 G1 and
7240 G2) lack three mouse buttons). It is also unclear to me how good the
7241 keyboard on the HP EliteBooks are. I hope Lenovo have not messed up
7242 the keyboard, even if the quality and robustness in the X series have
7243 deteriorated since X41.
</p
>
7245 <p
>I wonder how I can find a sensible laptop when none of the options
7246 seem sensible to me? Are there better services around to search the
7247 set of available laptops for features? Please send me an email if you
7248 have suggestions.
</p
>
7250 <p
>Update
2015-
07-
23: I got a suggestion to check out the FSF
7251 <a href=
"http://www.fsf.org/resources/hw/endorsement/respects-your-freedom
">list
7252 of endorsed hardware
</a
>, which is useful background information.
</p
>
7257 <title>How to stay with sysvinit in Debian Jessie
</title>
7258 <link>http://www.hungry.com/~pere/blog/How_to_stay_with_sysvinit_in_Debian_Jessie.html
</link>
7259 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_stay_with_sysvinit_in_Debian_Jessie.html
</guid>
7260 <pubDate>Sat,
22 Nov
2014 01:
00:
00 +
0100</pubDate>
7261 <description><p
>By now, it is well known that Debian Jessie will not be using
7262 sysvinit as its boot system by default. But how can one keep using
7263 sysvinit in Jessie? It is fairly easy, and here are a few recipes,
7265 <a href=
"http://www.vitavonni.de/blog/
201410/
2014102101-avoiding-systemd.html
">Erich
7266 Schubert
</a
> and
7267 <a href=
"http://smcv.pseudorandom.co.uk/
2014/still_universal/
">Simon
7270 <p
>If you already are using Wheezy and want to upgrade to Jessie and
7271 keep sysvinit as your boot system, create a file
7272 <tt
>/etc/apt/preferences.d/use-sysvinit
</tt
> with this content before
7273 you upgrade:
</p
>
7275 <p
><blockquote
><pre
>
7276 Package: systemd-sysv
7277 Pin: release o=Debian
7279 </pre
></blockquote
><p
>
7281 <p
>This file content will tell apt and aptitude to not consider
7282 installing systemd-sysv as part of any installation and upgrade
7283 solution when resolving dependencies, and thus tell it to avoid
7284 systemd as a default boot system. The end result should be that the
7285 upgraded system keep using sysvinit.
</p
>
7287 <p
>If you are installing Jessie for the first time, there is no way to
7288 get sysvinit installed by default (debootstrap used by
7289 debian-installer have no option for this), but one can tell the
7290 installer to switch to sysvinit before the first boot. Either by
7291 using a kernel argument to the installer, or by adding a line to the
7292 preseed file used. First, the kernel command line argument:
7294 <p
><blockquote
><pre
>
7295 preseed/late_command=
"in-target apt-get install --purge -y sysvinit-core
"
7296 </pre
></blockquote
><p
>
7298 <p
>Next, the line to use in a preseed file:
</p
>
7300 <p
><blockquote
><pre
>
7301 d-i preseed/late_command string in-target apt-get install -y sysvinit-core
7302 </pre
></blockquote
><p
>
7304 <p
>One can of course also do this after the first boot by installing
7305 the sysvinit-core package.
</p
>
7307 <p
>I recommend only using sysvinit if you really need it, as the
7308 sysvinit boot sequence in Debian have several hardware specific bugs
7309 on Linux caused by the fact that it is unpredictable when hardware
7310 devices show up during boot. But on the other hand, the new default
7311 boot system still have a few rough edges I hope will be fixed before
7312 Jessie is released.
</p
>
7314 <p
>Update
2014-
11-
26: Inspired by
7315 <ahref=
"https://www.mirbsd.org/permalinks/wlog-
10-tg_e20141125-tg.htm#e20141125-tg_wlog-
10-tg
">a
7316 blog post by Torsten Glaser
</a
>, added --purge to the preseed
7322 <title>A Debian package for SMTP via Tor (aka SMTorP) using exim4
</title>
7323 <link>http://www.hungry.com/~pere/blog/A_Debian_package_for_SMTP_via_Tor__aka_SMTorP__using_exim4.html
</link>
7324 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/A_Debian_package_for_SMTP_via_Tor__aka_SMTorP__using_exim4.html
</guid>
7325 <pubDate>Mon,
10 Nov
2014 13:
40:
00 +
0100</pubDate>
7326 <description><p
>The right to communicate with your friends and family in private,
7327 without anyone snooping, is a right every citicen have in a liberal
7328 democracy. But this right is under serious attack these days.
</p
>
7330 <p
>A while back it occurred to me that one way to make the dragnet
7331 surveillance conducted by NSA, GCHQ, FRA and others (and confirmed by
7332 the whisleblower Snowden) more expensive for Internet email,
7333 is to deliver all email using SMTP via Tor. Such SMTP option would be
7334 a nice addition to the FreedomBox project if we could send email
7335 between FreedomBox machines without leaking metadata about the emails
7336 to the people peeking on the wire. I
7337 <a href=
"http://lists.alioth.debian.org/pipermail/freedombox-discuss/
2014-October/
006493.html
">proposed
7338 this on the FreedomBox project mailing list in October
</a
> and got a
7339 lot of useful feedback and suggestions. It also became obvious to me
7340 that this was not a novel idea, as the same idea was tested and
7341 documented by Johannes Berg as early as
2006, and both
7342 <a href=
"https://github.com/pagekite/Mailpile/wiki/SMTorP
">the
7343 Mailpile
</a
> and
<a href=
"http://dee.su/cables
">the Cables
</a
> systems
7344 propose a similar method / protocol to pass emails between users.
</p
>
7346 <p
>To implement such system one need to set up a Tor hidden service
7347 providing the SMTP protocol on port
25, and use email addresses
7348 looking like username@hidden-service-name.onion. With such addresses
7349 the connections to port
25 on hidden-service-name.onion using Tor will
7350 go to the correct SMTP server. To do this, one need to configure the
7351 Tor daemon to provide the hidden service and the mail server to accept
7352 emails for this .onion domain. To learn more about Exim configuration
7353 in Debian and test the design provided by Johannes Berg in his FAQ, I
7354 set out yesterday to create a Debian package for making it trivial to
7355 set up such SMTP over Tor service based on Debian. Getting it to work
7356 were fairly easy, and
7357 <a href=
"https://github.com/petterreinholdtsen/exim4-smtorp
">the
7358 source code for the Debian package
</a
> is available from github. I
7359 plan to move it into Debian if further testing prove this to be a
7360 useful approach.
</p
>
7362 <p
>If you want to test this, set up a blank Debian machine without any
7363 mail system installed (or run
<tt
>apt-get purge exim4-config
</tt
> to
7364 get rid of exim4). Install tor, clone the git repository mentioned
7365 above, build the deb and install it on the machine. Next, run
7366 <tt
>/usr/lib/exim4-smtorp/setup-exim-hidden-service
</tt
> and follow
7367 the instructions to get the service up and running. Restart tor and
7368 exim when it is done, and test mail delivery using swaks like
7371 <p
><blockquote
><pre
>
7372 torsocks swaks --server dutlqrrmjhtfa3vp.onion \
7373 --to fbx@dutlqrrmjhtfa3vp.onion
7374 </pre
></blockquote
></p
>
7376 <p
>This will test the SMTP delivery using tor. Replace the email
7377 address with your own address to test your server. :)
</p
>
7379 <p
>The setup procedure is still to complex, and I hope it can be made
7380 easier and more automatic. Especially the tor setup need more work.
7381 Also, the package include a tor-smtp tool written in C, but its task
7382 should probably be rewritten in some script language to make the deb
7383 architecture independent. It would probably also make the code easier
7384 to review. The tor-smtp tool currently need to listen on a socket for
7385 exim to talk to it and is started using xinetd. It would be better if
7386 no daemon and no socket is needed. I suspect it is possible to get
7387 exim to run a command line tool for delivery instead of talking to a
7388 socket, and hope to figure out how in a future version of this
7391 <p
>Until I wipe my test machine, I can be reached using the
7392 <tt
>fbx@dutlqrrmjhtfa3vp.onion
</tt
> mail address, deliverable over
7393 SMTorP. :)
</p
>
7398 <title>listadmin, the quick way to moderate mailman lists - nice free software
</title>
7399 <link>http://www.hungry.com/~pere/blog/listadmin__the_quick_way_to_moderate_mailman_lists___nice_free_software.html
</link>
7400 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/listadmin__the_quick_way_to_moderate_mailman_lists___nice_free_software.html
</guid>
7401 <pubDate>Wed,
22 Oct
2014 20:
00:
00 +
0200</pubDate>
7402 <description><p
>If you ever had to moderate a mailman list, like the ones on
7403 alioth.debian.org, you know the web interface is fairly slow to
7404 operate. First you visit one web page, enter the moderation password
7405 and get a new page shown with a list of all the messages to moderate
7406 and various options for each email address. This take a while for
7407 every list you moderate, and you need to do it regularly to do a good
7408 job as a list moderator. But there is a quick alternative,
7409 <a href=
"http://heim.ifi.uio.no/kjetilho/hacks/#listadmin
">the
7410 listadmin program
</a
>. It allow you to check lists for new messages
7411 to moderate in a fraction of a second. Here is a test run on two
7412 lists I recently took over:
</p
>
7414 <p
><blockquote
><pre
>
7415 % time listadmin xiph
7416 fetching data for pkg-xiph-commits@lists.alioth.debian.org ... nothing in queue
7417 fetching data for pkg-xiph-maint@lists.alioth.debian.org ... nothing in queue
7423 </pre
></blockquote
></p
>
7425 <p
>In
1.7 seconds I had checked two mailing lists and confirmed that
7426 there are no message in the moderation queue. Every morning I
7427 currently moderate
68 mailman lists, and it normally take around two
7428 minutes. When I took over the two pkg-xiph lists above a few days
7429 ago, there were
400 emails waiting in the moderator queue. It took me
7430 less than
15 minutes to process them all using the listadmin
7433 <p
>If you install
7434 <a href=
"https://tracker.debian.org/pkg/listadmin
">the listadmin
7435 package
</a
> from Debian and create a file
<tt
>~/.listadmin.ini
</tt
>
7436 with content like this, the moderation task is a breeze:
</p
>
7438 <p
><blockquote
><pre
>
7439 username username@example.org
7442 discard_if_reason
"Posting restricted to members only. Remove us from your mail list.
"
7445 adminurl https://{domain}/mailman/admindb/{list}
7446 mailman-list@lists.example.com
7449 other-list@otherserver.example.org
7450 </pre
></blockquote
></p
>
7452 <p
>There are other options to set as well. Check the manual page to
7453 learn the details.
</p
>
7455 <p
>If you are forced to moderate lists on a mailman installation where
7456 the SSL certificate is self signed or not properly signed by a
7457 generally accepted signing authority, you can set a environment
7458 variable when calling listadmin to disable SSL verification:
</p
>
7460 <p
><blockquote
><pre
>
7461 PERL_LWP_SSL_VERIFY_HOSTNAME=
0 listadmin
7462 </pre
></blockquote
></p
>
7464 <p
>If you want to moderate a subset of the lists you take care of, you
7465 can provide an argument to the listadmin script like I do in the
7466 initial screen dump (the xiph argument). Using an argument, only
7467 lists matching the argument string will be processed. This make it
7468 quick to accept messages if you notice the moderation request in your
7471 <p
>Without the listadmin program, I would never be the moderator of
68
7472 mailing lists, as I simply do not have time to spend on that if the
7473 process was any slower. The listadmin program have saved me hours of
7474 time I could spend elsewhere over the years. It truly is nice free
7477 <p
>As usual, if you use Bitcoin and want to show your support of my
7478 activities, please send Bitcoin donations to my address
7479 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
7481 <p
>Update
2014-
10-
27: Added missing
'username
' statement in
7482 configuration example. Also, I
've been told that the
7483 PERL_LWP_SSL_VERIFY_HOSTNAME=
0 setting do not work for everyone. Not
7489 <title>Debian Jessie, PXE and automatic firmware installation
</title>
7490 <link>http://www.hungry.com/~pere/blog/Debian_Jessie__PXE_and_automatic_firmware_installation.html
</link>
7491 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_Jessie__PXE_and_automatic_firmware_installation.html
</guid>
7492 <pubDate>Fri,
17 Oct
2014 14:
10:
00 +
0200</pubDate>
7493 <description><p
>When PXE installing laptops with Debian, I often run into the
7494 problem that the WiFi card require some firmware to work properly.
7495 And it has been a pain to fix this using preseeding in Debian.
7496 Normally something more is needed. But thanks to
7497 <a href=
"https://packages.qa.debian.org/i/isenkram.html
">my isenkram
7498 package
</a
> and its recent tasksel extension, it has now become easy
7499 to do this using simple preseeding.
</p
>
7501 <p
>The isenkram-cli package provide tasksel tasks which will install
7502 firmware for the hardware found in the machine (actually, requested by
7503 the kernel modules for the hardware). (It can also install user space
7504 programs supporting the hardware detected, but that is not the focus
7505 of this story.)
</p
>
7507 <p
>To get this working in the default installation, two preeseding
7508 values are needed. First, the isenkram-cli package must be installed
7509 into the target chroot (aka the hard drive) before tasksel is executed
7510 in the pkgsel step of the debian-installer system. This is done by
7511 preseeding the base-installer/includes debconf value to include the
7512 isenkram-cli package. The package name is next passed to debootstrap
7513 for installation. With the isenkram-cli package in place, tasksel
7514 will automatically use the isenkram tasks to detect hardware specific
7515 packages for the machine being installed and install them, because
7516 isenkram-cli contain tasksel tasks.
</p
>
7518 <p
>Second, one need to enable the non-free APT repository, because
7519 most firmware unfortunately is non-free. This is done by preseeding
7520 the apt-mirror-setup step. This is unfortunate, but for a lot of
7521 hardware it is the only option in Debian.
</p
>
7523 <p
>The end result is two lines needed in your preseeding file to get
7524 firmware installed automatically by the installer:
</p
>
7526 <p
><blockquote
><pre
>
7527 base-installer base-installer/includes string isenkram-cli
7528 apt-mirror-setup apt-setup/non-free boolean true
7529 </pre
></blockquote
></p
>
7531 <p
>The current version of isenkram-cli in testing/jessie will install
7532 both firmware and user space packages when using this method. It also
7533 do not work well, so use version
0.15 or later. Installing both
7534 firmware and user space packages might give you a bit more than you
7535 want, so I decided to split the tasksel task in two, one for firmware
7536 and one for user space programs. The firmware task is enabled by
7537 default, while the one for user space programs is not. This split is
7538 implemented in the package currently in unstable.
</p
>
7540 <p
>If you decide to give this a go, please let me know (via email) how
7541 this recipe work for you. :)
</p
>
7543 <p
>So, I bet you are wondering, how can this work. First and
7544 foremost, it work because tasksel is modular, and driven by whatever
7545 files it find in /usr/lib/tasksel/ and /usr/share/tasksel/. So the
7546 isenkram-cli package place two files for tasksel to find. First there
7547 is the task description file (/usr/share/tasksel/descs/isenkram.desc):
</p
>
7549 <p
><blockquote
><pre
>
7550 Task: isenkram-packages
7552 Description: Hardware specific packages (autodetected by isenkram)
7553 Based on the detected hardware various hardware specific packages are
7555 Test-new-install: show show
7557 Packages: for-current-hardware
7559 Task: isenkram-firmware
7561 Description: Hardware specific firmware packages (autodetected by isenkram)
7562 Based on the detected hardware various hardware specific firmware
7563 packages are proposed.
7564 Test-new-install: mark show
7566 Packages: for-current-hardware-firmware
7567 </pre
></blockquote
></p
>
7569 <p
>The key parts are Test-new-install which indicate how the task
7570 should be handled and the Packages line referencing to a script in
7571 /usr/lib/tasksel/packages/. The scripts use other scripts to get a
7572 list of packages to install. The for-current-hardware-firmware script
7573 look like this to list relevant firmware for the machine:
7575 <p
><blockquote
><pre
>
7578 PATH=/usr/sbin:$PATH
7580 isenkram-autoinstall-firmware -l
7581 </pre
></blockquote
></p
>
7583 <p
>With those two pieces in place, the firmware is installed by
7584 tasksel during the normal d-i run. :)
</p
>
7586 <p
>If you want to test what tasksel will install when isenkram-cli is
7587 installed, run
<tt
>DEBIAN_PRIORITY=critical tasksel --test
7588 --new-install
</tt
> to get the list of packages that tasksel would
7591 <p
><a href=
"https://wiki.debian.org/DebianEdu/
">Debian Edu
</a
> will be
7592 pilots in testing this feature, as isenkram is used there now to
7593 install firmware, replacing the earlier scripts.
</p
>
7598 <title>Ubuntu used to show the bread prizes at ICA Storo
</title>
7599 <link>http://www.hungry.com/~pere/blog/Ubuntu_used_to_show_the_bread_prizes_at_ICA_Storo.html
</link>
7600 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Ubuntu_used_to_show_the_bread_prizes_at_ICA_Storo.html
</guid>
7601 <pubDate>Sat,
4 Oct
2014 15:
20:
00 +
0200</pubDate>
7602 <description><p
>Today I came across an unexpected Ubuntu boot screen. Above the
7603 bread shelf on the ICA shop at Storo in Oslo, the grub menu of Ubuntu
7604 with Linux kernel
3.2.0-
23 (ie probably version
12.04 LTS) was stuck
7605 on a screen normally showing the bread types and prizes:
</p
>
7607 <p align=
"center
"><img width=
"70%
" src=
"http://www.hungry.com/~pere/blog/images/
2014-
10-
04-ubuntu-ica-storo-crop.jpeg
"></p
>
7609 <p
>If it had booted as it was supposed to, I would never had known
7610 about this hidden Linux installation. It is interesting what
7611 <a href=
"http://revealingerrors.com/
">errors can reveal
</a
>.
</p
>
7616 <title>New lsdvd release version
0.17 is ready
</title>
7617 <link>http://www.hungry.com/~pere/blog/New_lsdvd_release_version_0_17_is_ready.html
</link>
7618 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_lsdvd_release_version_0_17_is_ready.html
</guid>
7619 <pubDate>Sat,
4 Oct
2014 08:
40:
00 +
0200</pubDate>
7620 <description><p
>The
<a href=
"https://sourceforge.net/p/lsdvd/
">lsdvd project
</a
>
7621 got a new set of developers a few weeks ago, after the original
7622 developer decided to step down and pass the project to fresh blood.
7623 This project is now maintained by Petter Reinholdtsen and Steve
7626 <p
>I just wrapped up
7627 <a href=
"https://sourceforge.net/p/lsdvd/mailman/message/
32896061/
">a
7628 new lsdvd release
</a
>, available in git or from
7629 <a href=
"https://sourceforge.net/projects/lsdvd/files/lsdvd/
">the
7630 download page
</a
>. This is the changelog dated
2014-
10-
03 for version
7635 <li
>Ignore
'phantom
' audio, subtitle tracks
</li
>
7636 <li
>Check for garbage in the program chains, which indicate that a track is
7637 non-existant, to work around additional copy protection
</li
>
7638 <li
>Fix displaying content type for audio tracks, subtitles
</li
>
7639 <li
>Fix pallete display of first entry
</li
>
7640 <li
>Fix include orders
</li
>
7641 <li
>Ignore read errors in titles that would not be displayed anyway
</li
>
7642 <li
>Fix the chapter count
</li
>
7643 <li
>Make sure the array size and the array limit used when initialising
7644 the palette size is the same.
</li
>
7645 <li
>Fix array printing.
</li
>
7646 <li
>Correct subsecond calculations.
</li
>
7647 <li
>Add sector information to the output format.
</li
>
7648 <li
>Clean up code to be closer to ANSI C and compile without warnings
7649 with more GCC compiler warnings.
</li
>
7653 <p
>This change bring together patches for lsdvd in use in various
7654 Linux and Unix distributions, as well as patches submitted to the
7655 project the last nine years. Please check it out. :)
</p
>
7660 <title>How to test Debian Edu Jessie despite some fatal problems with the installer
</title>
7661 <link>http://www.hungry.com/~pere/blog/How_to_test_Debian_Edu_Jessie_despite_some_fatal_problems_with_the_installer.html
</link>
7662 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_test_Debian_Edu_Jessie_despite_some_fatal_problems_with_the_installer.html
</guid>
7663 <pubDate>Fri,
26 Sep
2014 12:
20:
00 +
0200</pubDate>
7664 <description><p
>The
<a href=
"http://www.skolelinux.org/
">Debian Edu / Skolelinux
7665 project
</a
> provide a Linux solution for schools, including a
7666 powerful desktop with education software, a central server providing
7667 web pages, user database, user home directories, central login and PXE
7668 boot of both clients without disk and the installation to install Debian
7669 Edu on machines with disk (and a few other services perhaps to small
7670 to mention here). We in the Debian Edu team are currently working on
7671 the Jessie based version, trying to get everything in shape before the
7672 freeze, to avoid having to maintain our own package repository in the
7674 <a href=
"https://wiki.debian.org/DebianEdu/Status/Jessie
">current
7675 status
</a
> can be seen on the Debian wiki, and there is still heaps of
7676 work left. Some fatal problems block testing, breaking the installer,
7677 but it is possible to work around these to get anyway. Here is a
7678 recipe on how to get the installation limping along.
</p
>
7680 <p
>First, download the test ISO via
7681 <a href=
"ftp://ftp.skolelinux.no/cd-edu-testing-nolocal-netinst/debian-edu-amd64-i386-NETINST-
1.iso
">ftp
</a
>,
7682 <a href=
"http://ftp.skolelinux.no/cd-edu-testing-nolocal-netinst/debian-edu-amd64-i386-NETINST-
1.iso
">http
</a
>
7684 ftp.skolelinux.org::cd-edu-testing-nolocal-netinst/debian-edu-amd64-i386-NETINST-
1.iso).
7685 The ISO build was broken on Tuesday, so we do not get a new ISO every
7686 12 hours or so, but thankfully the ISO we already got we are able to
7687 install with some tweaking.
</p
>
7689 <p
>When you get to the Debian Edu profile question, go to tty2
7690 (use Alt-Ctrl-F2), run
</p
>
7692 <p
><blockquote
><pre
>
7693 nano /usr/bin/edu-eatmydata-install
7694 </pre
></blockquote
></p
>
7696 <p
>and add
'exit
0' as the second line, disabling the eatmydata
7697 optimization. Return to the installation, select the profile you want
7698 and continue. Without this change, exim4-config will fail to install
7699 due to a known bug in eatmydata.
</p
>
7701 <p
>When you get the grub question at the end, answer /dev/sda (or if
7702 this do not work, figure out what your correct value would be. All my
7703 test machines need /dev/sda, so I have no advice if it do not fit
7704 your need.
</p
>
7706 <p
>If you installed a profile including a graphical desktop, log in as
7707 root after the initial boot from hard drive, and install the
7708 education-desktop-XXX metapackage. XXX can be kde, gnome, lxde, xfce
7709 or mate. If you want several desktop options, install more than one
7710 metapackage. Once this is done, reboot and you should have a working
7711 graphical login screen. This workaround should no longer be needed
7712 once the education-tasks package version
1.801 enter testing in two
7715 <p
>I believe the ISO build will start working on two days when the new
7716 tasksel package enter testing and Steve McIntyre get a chance to
7717 update the debian-cd git repository. The eatmydata, grub and desktop
7718 issues are already fixed in unstable and testing, and should show up
7719 on the ISO as soon as the ISO build start working again. Well the
7720 eatmydata optimization is really just disabled. The proper fix
7721 require an upload by the eatmydata maintainer applying the patch
7722 provided in bug
<a href=
"https://bugs.debian.org/
702711">#
702711</a
>.
7723 The rest have proper fixes in unstable.
</p
>
7725 <p
>I hope this get you going with the installation testing, as we are
7726 quickly running out of time trying to get our Jessie based
7727 installation ready before the distribution freeze in a month.
</p
>
7732 <title>Suddenly I am the new upstream of the lsdvd command line tool
</title>
7733 <link>http://www.hungry.com/~pere/blog/Suddenly_I_am_the_new_upstream_of_the_lsdvd_command_line_tool.html
</link>
7734 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Suddenly_I_am_the_new_upstream_of_the_lsdvd_command_line_tool.html
</guid>
7735 <pubDate>Thu,
25 Sep
2014 11:
20:
00 +
0200</pubDate>
7736 <description><p
>I use the
<a href=
"https://sourceforge.net/p/lsdvd/
">lsdvd tool
</a
>
7737 to handle my fairly large DVD collection. It is a nice command line
7738 tool to get details about a DVD, like title, tracks, track length,
7739 etc, in XML, Perl or human readable format. But lsdvd have not seen
7740 any new development since
2006 and had a few irritating bugs affecting
7741 its use with some DVDs. Upstream seemed to be dead, and in January I
7742 sent a small probe asking for a version control repository for the
7743 project, without any reply. But I use it regularly and would like to
7744 get
<a href=
"https://packages.qa.debian.org/lsdvd
">an updated version
7745 into Debian
</a
>. So two weeks ago I tried harder to get in touch with
7746 the project admin, and after getting a reply from him explaining that
7747 he was no longer interested in the project, I asked if I could take
7748 over. And yesterday, I became project admin.
</p
>
7750 <p
>I
've been in touch with a Gentoo developer and the Debian
7751 maintainer interested in joining forces to maintain the upstream
7752 project, and I hope we can get a new release out fairly quickly,
7753 collecting the patches spread around on the internet into on place.
7754 I
've added the relevant Debian patches to the freshly created git
7755 repository, and expect the Gentoo patches to make it too. If you got
7756 a DVD collection and care about command line tools, check out
7757 <a href=
"https://sourceforge.net/p/lsdvd/git/ci/master/tree/
">the git source
</a
> and join
7758 <a href=
"https://sourceforge.net/p/lsdvd/mailman/
">the project mailing
7759 list
</a
>. :)
</p
>
7764 <title>Speeding up the Debian installer using eatmydata and dpkg-divert
</title>
7765 <link>http://www.hungry.com/~pere/blog/Speeding_up_the_Debian_installer_using_eatmydata_and_dpkg_divert.html
</link>
7766 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Speeding_up_the_Debian_installer_using_eatmydata_and_dpkg_divert.html
</guid>
7767 <pubDate>Tue,
16 Sep
2014 14:
00:
00 +
0200</pubDate>
7768 <description><p
>The
<a href=
"https://www.debian.org/
">Debian
</a
> installer could be
7769 a lot quicker. When we install more than
2000 packages in
7770 <a href=
"http://www.skolelinux.org/
">Skolelinux / Debian Edu
</a
> using
7771 tasksel in the installer, unpacking the binary packages take forever.
7772 A part of the slow I/O issue was discussed in
7773 <a href=
"https://bugs.debian.org/
613428">bug #
613428</a
> about too
7774 much file system sync-ing done by dpkg, which is the package
7775 responsible for unpacking the binary packages. Other parts (like code
7776 executed by postinst scripts) might also sync to disk during
7777 installation. All this sync-ing to disk do not really make sense to
7778 me. If the machine crash half-way through, I start over, I do not try
7779 to salvage the half installed system. So the failure sync-ing is
7780 supposed to protect against, hardware or system crash, is not really
7781 relevant while the installer is running.
</p
>
7783 <p
>A few days ago, I thought of a way to get rid of all the file
7784 system sync()-ing in a fairly non-intrusive way, without the need to
7785 change the code in several packages. The idea is not new, but I have
7786 not heard anyone propose the approach using dpkg-divert before. It
7787 depend on the small and clever package
7788 <a href=
"https://packages.qa.debian.org/eatmydata
">eatmydata
</a
>, which
7789 uses LD_PRELOAD to replace the system functions for syncing data to
7790 disk with functions doing nothing, thus allowing programs to live
7791 dangerous while speeding up disk I/O significantly. Instead of
7792 modifying the implementation of dpkg, apt and tasksel (which are the
7793 packages responsible for selecting, fetching and installing packages),
7794 it occurred to me that we could just divert the programs away, replace
7795 them with a simple shell wrapper calling
7796 "eatmydata
&nbsp;$program
&nbsp;$@
", to get the same effect.
7797 Two days ago I decided to test the idea, and wrapped up a simple
7798 implementation for the Debian Edu udeb.
</p
>
7800 <p
>The effect was stunning. In my first test it reduced the running
7801 time of the pkgsel step (installing tasks) from
64 to less than
44
7802 minutes (
20 minutes shaved off the installation) on an old Dell
7803 Latitude D505 machine. I am not quite sure what the optimised time
7804 would have been, as I messed up the testing a bit, causing the debconf
7805 priority to get low enough for two questions to pop up during
7806 installation. As soon as I saw the questions I moved the installation
7807 along, but do not know how long the question were holding up the
7808 installation. I did some more measurements using Debian Edu Jessie,
7809 and got these results. The time measured is the time stamp in
7810 /var/log/syslog between the
"pkgsel: starting tasksel
" and the
7811 "pkgsel: finishing up
" lines, if you want to do the same measurement
7812 yourself. In Debian Edu, the tasksel dialog do not show up, and the
7813 timing thus do not depend on how quickly the user handle the tasksel
7816 <p
><table
>
7819 <th
>Machine/setup
</th
>
7820 <th
>Original tasksel
</th
>
7821 <th
>Optimised tasksel
</th
>
7822 <th
>Reduction
</th
>
7826 <td
>Latitude D505 Main+LTSP LXDE
</td
>
7827 <td
>64 min (
07:
46-
08:
50)
</td
>
7828 <td
><44 min (
11:
27-
12:
11)
</td
>
7829 <td
>>20 min
18%
</td
>
7833 <td
>Latitude D505 Roaming LXDE
</td
>
7834 <td
>57 min (
08:
48-
09:
45)
</td
>
7835 <td
>34 min (
07:
43-
08:
17)
</td
>
7836 <td
>23 min
40%
</td
>
7840 <td
>Latitude D505 Minimal
</td
>
7841 <td
>22 min (
10:
37-
10:
59)
</td
>
7842 <td
>11 min (
11:
16-
11:
27)
</td
>
7843 <td
>11 min
50%
</td
>
7847 <td
>Thinkpad X200 Minimal
</td
>
7848 <td
>6 min (
08:
19-
08:
25)
</td
>
7849 <td
>4 min (
08:
04-
08:
08)
</td
>
7850 <td
>2 min
33%
</td
>
7854 <td
>Thinkpad X200 Roaming KDE
</td
>
7855 <td
>19 min (
09:
21-
09:
40)
</td
>
7856 <td
>15 min (
10:
25-
10:
40)
</td
>
7857 <td
>4 min
21%
</td
>
7860 </table
></p
>
7862 <p
>The test is done using a netinst ISO on a USB stick, so some of the
7863 time is spent downloading packages. The connection to the Internet
7864 was
100Mbit/s during testing, so downloading should not be a
7865 significant factor in the measurement. Download typically took a few
7866 seconds to a few minutes, depending on the amount of packages being
7867 installed.
</p
>
7869 <p
>The speedup is implemented by using two hooks in
7870 <a href=
"https://www.debian.org/devel/debian-installer/
">Debian
7871 Installer
</a
>, the pre-pkgsel.d hook to set up the diverts, and the
7872 finish-install.d hook to remove the divert at the end of the
7873 installation. I picked the pre-pkgsel.d hook instead of the
7874 post-base-installer.d hook because I test using an ISO without the
7875 eatmydata package included, and the post-base-installer.d hook in
7876 Debian Edu can only operate on packages included in the ISO. The
7877 negative effect of this is that I am unable to activate this
7878 optimization for the kernel installation step in d-i. If the code is
7879 moved to the post-base-installer.d hook, the speedup would be larger
7880 for the entire installation.
</p
>
7882 <p
>I
've implemented this in the
7883 <a href=
"https://packages.qa.debian.org/debian-edu-install
">debian-edu-install
</a
>
7884 git repository, and plan to provide the optimization as part of the
7885 Debian Edu installation. If you want to test this yourself, you can
7886 create two files in the installer (or in an udeb). One shell script
7887 need do go into /usr/lib/pre-pkgsel.d/, with content like this:
</p
>
7889 <p
><blockquote
><pre
>
7892 . /usr/share/debconf/confmodule
7894 logger -t my-pkgsel
"info: $*
"
7897 logger -t my-pkgsel
"error: $*
"
7899 override_install() {
7900 apt-install eatmydata || true
7901 if [ -x /target/usr/bin/eatmydata ] ; then
7902 for bin in dpkg apt-get aptitude tasksel ; do
7904 # Test that the file exist and have not been diverted already.
7905 if [ -f /target$file ] ; then
7906 info
"diverting $file using eatmydata
"
7907 printf
"#!/bin/sh\neatmydata $bin.distrib \
"\$@\
"\n
" \
7908 > /target$file.edu
7909 chmod
755 /target$file.edu
7910 in-target dpkg-divert --package debian-edu-config \
7911 --rename --quiet --add $file
7912 ln -sf ./$bin.edu /target$file
7914 error
"unable to divert $file, as it is missing.
"
7918 error
"unable to find /usr/bin/eatmydata after installing the eatmydata pacage
"
7923 </pre
></blockquote
></p
>
7925 <p
>To clean up, another shell script should go into
7926 /usr/lib/finish-install.d/ with code like this:
7928 <p
><blockquote
><pre
>
7930 . /usr/share/debconf/confmodule
7932 logger -t my-finish-install
"error: $@
"
7934 remove_install_override() {
7935 for bin in dpkg apt-get aptitude tasksel ; do
7937 if [ -x /target$file.edu ] ; then
7939 in-target dpkg-divert --package debian-edu-config \
7940 --rename --quiet --remove $file
7943 error
"Missing divert for $file.
"
7946 sync # Flush file buffers before continuing
7949 remove_install_override
7950 </pre
></blockquote
></p
>
7952 <p
>In Debian Edu, I placed both code fragments in a separate script
7953 edu-eatmydata-install and call it from the pre-pkgsel.d and
7954 finish-install.d scripts.
</p
>
7956 <p
>By now you might ask if this change should get into the normal
7957 Debian installer too? I suspect it should, but am not sure the
7958 current debian-installer coordinators find it useful enough. It also
7959 depend on the side effects of the change. I
'm not aware of any, but I
7960 guess we will see if the change is safe after some more testing.
7961 Perhaps there is some package in Debian depending on sync() and
7962 fsync() having effect? Perhaps it should go into its own udeb, to
7963 allow those of us wanting to enable it to do so without affecting
7966 <p
>Update
2014-
09-
24: Since a few days ago, enabling this optimization
7967 will break installation of all programs using gnutls because of
7968 <a href=
"https://bugs.debian.org/
702711">bug #
702711</a
>. An updated
7969 eatmydata package in Debian will solve it.
</p
>
7971 <p
>Update
2014-
10-
17: The bug mentioned above is fixed in testing and
7972 the optimization work again. And I have discovered that the
7973 dpkg-divert trick is not really needed and implemented a slightly
7974 simpler approach as part of the debian-edu-install package. See
7975 tools/edu-eatmydata-install in the source package.
</p
>
7977 <p
>Update
2014-
11-
11: Unfortunately, a new
7978 <a href=
"http://bugs.debian.org/
765738">bug #
765738</a
> in eatmydata only
7979 triggering on i386 made it into testing, and broke this installation
7980 optimization again. If
<a href=
"http://bugs.debian.org/
768893">unblock
7981 request
768893</a
> is accepted, it should be working again.
</p
>
7986 <title>Good bye subkeys.pgp.net, welcome pool.sks-keyservers.net
</title>
7987 <link>http://www.hungry.com/~pere/blog/Good_bye_subkeys_pgp_net__welcome_pool_sks_keyservers_net.html
</link>
7988 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Good_bye_subkeys_pgp_net__welcome_pool_sks_keyservers_net.html
</guid>
7989 <pubDate>Wed,
10 Sep
2014 13:
10:
00 +
0200</pubDate>
7990 <description><p
>Yesterday, I had the pleasure of attending a talk with the
7991 <a href=
"http://www.nuug.no/
">Norwegian Unix User Group
</a
> about
7992 <a href=
"http://www.nuug.no/aktiviteter/
20140909-sks-keyservers/
">the
7993 OpenPGP keyserver pool sks-keyservers.net
</a
>, and was very happy to
7994 learn that there is a large set of publicly available key servers to
7995 use when looking for peoples public key. So far I have used
7996 subkeys.pgp.net, and some times wwwkeys.nl.pgp.net when the former
7997 were misbehaving, but those days are ended. The servers I have used
7998 up until yesterday have been slow and some times unavailable. I hope
7999 those problems are gone now.
</p
>
8001 <p
>Behind the round robin DNS entry of the
8002 <a href=
"https://sks-keyservers.net/
">sks-keyservers.net
</a
> service
8003 there is a pool of more than
100 keyservers which are checked every
8004 day to ensure they are well connected and up to date. It must be
8005 better than what I have used so far. :)
</p
>
8007 <p
>Yesterdays speaker told me that the service is the default
8008 keyserver provided by the default configuration in GnuPG, but this do
8009 not seem to be used in Debian. Perhaps it should?
</p
>
8011 <p
>Anyway, I
've updated my ~/.gnupg/options file to now include this
8014 <p
><blockquote
><pre
>
8015 keyserver pool.sks-keyservers.net
8016 </pre
></blockquote
></p
>
8018 <p
>With GnuPG version
2 one can also locate the keyserver using SRV
8019 entries in DNS. Just for fun, I did just that at work, so now every
8020 user of GnuPG at the University of Oslo should find a OpenGPG
8021 keyserver automatically should their need it:
</p
>
8023 <p
><blockquote
><pre
>
8024 % host -t srv _pgpkey-http._tcp.uio.no
8025 _pgpkey-http._tcp.uio.no has SRV record
0 100 11371 pool.sks-keyservers.net.
8027 </pre
></blockquote
></p
>
8029 <p
>Now if only
8030 <a href=
"http://ietfreport.isoc.org/idref/draft-shaw-openpgp-hkp/
">the
8031 HKP lookup protocol
</a
> supported finding signature paths, I would be
8032 very happy. It can look up a given key or search for a user ID, but I
8033 normally do not want that, but to find a trust path from my key to
8034 another key. Given a user ID or key ID, I would like to find (and
8035 download) the keys representing a signature path from my key to the
8036 key in question, to be able to get a trust path between the two keys.
8037 This is as far as I can tell not possible today. Perhaps something
8038 for a future version of the protocol?
</p
>
8043 <title>From English wiki to translated PDF and epub via Docbook
</title>
8044 <link>http://www.hungry.com/~pere/blog/From_English_wiki_to_translated_PDF_and_epub_via_Docbook.html
</link>
8045 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/From_English_wiki_to_translated_PDF_and_epub_via_Docbook.html
</guid>
8046 <pubDate>Tue,
17 Jun
2014 11:
30:
00 +
0200</pubDate>
8047 <description><p
>The
<a href=
"http://www.skolelinux.org/
">Debian Edu / Skolelinux
8048 project
</a
> provide an instruction manual for teachers, system
8049 administrators and other users that contain useful tips for setting up
8050 and maintaining a Debian Edu installation. This text is about how the
8051 text processing of this manual is handled in the project.
</p
>
8053 <p
>One goal of the project is to provide information in the native
8054 language of its users, and for this we need to handle translations.
8055 But we also want to make sure each language contain the same
8056 information, so for this we need a good way to keep the translations
8057 in sync. And we want it to be easy for our users to improve the
8058 documentation, avoiding the need to learn special formats or tools to
8059 contribute, and the obvious way to do this is to make it possible to
8060 edit the documentation using a web browser. We also want it to be
8061 easy for translators to keep the translation up to date, and give them
8062 help in figuring out what need to be translated. Here is the list of
8063 tools and the process we have found trying to reach all these
8066 <p
>We maintain the authoritative source of our manual in the
8067 <a href=
"https://wiki.debian.org/DebianEdu/Documentation/Wheezy/
">Debian
8068 wiki
</a
>, as several wiki pages written in English. It consist of one
8069 front page with references to the different chapters, several pages
8070 for each chapter, and finally one
"collection page
" gluing all the
8071 chapters together into one large web page (aka
8072 <a href=
"https://wiki.debian.org/DebianEdu/Documentation/Wheezy/AllInOne
">the
8073 AllInOne page
</a
>). The AllInOne page is the one used for further
8074 processing and translations. Thanks to the fact that the
8075 <a href=
"http://moinmo.in/
">MoinMoin
</a
> installation on
8076 wiki.debian.org support exporting pages in
8077 <a href=
"http://www.docbook.org/
">the Docbook format
</a
>, we can fetch
8078 the list of pages to export using the raw version of the AllInOne
8079 page, loop over each of them to generate a Docbook XML version of the
8080 manual. This process also download images and transform image
8081 references to use the locally downloaded images. The generated
8082 Docbook XML files are slightly broken, so some post-processing is done
8083 using the
<tt
>documentation/scripts/get_manual
</tt
> program, and the
8084 result is a nice Docbook XML file (debian-edu-wheezy-manual.xml) and
8085 a handfull of images. The XML file can now be used to generate PDF, HTML
8086 and epub versions of the English manual. This is the basic step of
8087 our process, making PDF (using dblatex), HTML (using xsltproc) and
8088 epub (using dbtoepub) version from Docbook XML, and the resulting files
8089 are placed in the debian-edu-doc-en binary package.
</p
>
8091 <p
>But English documentation is not enough for us. We want translated
8092 documentation too, and we want to make it easy for translators to
8093 track the English original. For this we use the
8094 <a href=
"http://packages.qa.debian.org/p/poxml.html
">poxml
</a
> package,
8095 which allow us to transform the English Docbook XML file into a
8096 translation file (a .pot file), usable with the normal gettext based
8097 translation tools used by those translating free software. The pot
8098 file is used to create and maintain translation files (several .po
8099 files), which the translations update with the native language
8100 translations of all titles, paragraphs and blocks of text in the
8101 original. The next step is combining the original English Docbook XML
8102 and the translation file (say debian-edu-wheezy-manual.nb.po), to
8103 create a translated Docbook XML file (in this case
8104 debian-edu-wheezy-manual.nb.xml). This translated (or partly
8105 translated, if the translation is not complete) Docbook XML file can
8106 then be used like the original to create a PDF, HTML and epub version
8107 of the documentation.
</p
>
8109 <p
>The translators use different tools to edit the .po files. We
8111 <a href=
"http://www.kde.org/applications/development/lokalize/
">lokalize
</a
>,
8112 while some use emacs and vi, others can use web based editors like
8113 <a href=
"http://pootle.translatehouse.org/
">Poodle
</a
> or
8114 <a href=
"https://www.transifex.com/
">Transifex
</a
>. All we care about
8115 is where the .po file end up, in our git repository. Updated
8116 translations can either be committed directly to git, or submitted as
8117 <a href=
"https://bugs.debian.org/src:debian-edu-doc
">bug reports
8118 against the debian-edu-doc package
</a
>.
</p
>
8120 <p
>One challenge is images, which both might need to be translated (if
8121 they show translated user applications), and are needed in different
8122 formats when creating PDF and HTML versions (epub is a HTML version in
8123 this regard). For this we transform the original PNG images to the
8124 needed density and format during build, and have a way to provide
8125 translated images by storing translated versions in
8126 images/$LANGUAGECODE/. I am a bit unsure about the details here. The
8127 package maintainers know more.
</p
>
8129 <p
>If you wonder what the result look like, we provide
8130 <a href=
"http://maintainer.skolelinux.org/debian-edu-doc/
">the content
8131 of the documentation packages on the web
</a
>. See for example the
8132 <a href=
"http://maintainer.skolelinux.org/debian-edu-doc/it/debian-edu-wheezy-manual.pdf
">Italian
8133 PDF version
</a
> or the
8134 <a href=
"http://maintainer.skolelinux.org/debian-edu-doc/de/debian-edu-wheezy-manual.html
">German
8135 HTML version
</a
>. We do not yet build the epub version by default,
8136 but perhaps it will be done in the future.
</p
>
8138 <p
>To learn more, check out
8139 <a href=
"http://packages.qa.debian.org/d/debian-edu-doc.html
">the
8140 debian-edu-doc package
</a
>,
8141 <a href=
"https://wiki.debian.org/DebianEdu/Documentation/Wheezy/
">the
8142 manual on the wiki
</a
> and
8143 <a href=
"https://wiki.debian.org/DebianEdu/Documentation/Wheezy/Translations
">the
8144 translation instructions
</a
> in the manual.
</p
>
8149 <title>Install hardware dependent packages using tasksel (Isenkram
0.7)
</title>
8150 <link>http://www.hungry.com/~pere/blog/Install_hardware_dependent_packages_using_tasksel__Isenkram_0_7_.html
</link>
8151 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Install_hardware_dependent_packages_using_tasksel__Isenkram_0_7_.html
</guid>
8152 <pubDate>Wed,
23 Apr
2014 14:
50:
00 +
0200</pubDate>
8153 <description><p
>It would be nice if it was easier in Debian to get all the hardware
8154 related packages relevant for the computer installed automatically.
8155 So I implemented one, using
8156 <a href=
"http://packages.qa.debian.org/isenkram
">my Isenkram
8157 package
</a
>. To use it, install the tasksel and isenkram packages and
8158 run tasksel as user root. You should be presented with a new option,
8159 "Hardware specific packages (autodetected by isenkram)
". When you
8160 select it, tasksel will install the packages isenkram claim is fit for
8161 the current hardware, hot pluggable or not.
<p
>
8163 <p
>The implementation is in two files, one is the tasksel menu entry
8164 description, and the other is the script used to extract the list of
8165 packages to install. The first part is in
8166 <tt
>/usr/share/tasksel/descs/isenkram.desc
</tt
> and look like
8169 <p
><blockquote
><pre
>
8172 Description: Hardware specific packages (autodetected by isenkram)
8173 Based on the detected hardware various hardware specific packages are
8175 Test-new-install: mark show
8177 Packages: for-current-hardware
8178 </pre
></blockquote
></p
>
8180 <p
>The second part is in
8181 <tt
>/usr/lib/tasksel/packages/for-current-hardware
</tt
> and look like
8184 <p
><blockquote
><pre
>
8189 isenkram-autoinstall-firmware -l
8191 </pre
></blockquote
></p
>
8193 <p
>All in all, a very short and simple implementation making it
8194 trivial to install the hardware dependent package we all may want to
8195 have installed on our machines. I
've not been able to find a way to
8196 get tasksel to tell you exactly which packages it plan to install
8197 before doing the installation. So if you are curious or careful,
8198 check the output from the isenkram-* command line tools first.
</p
>
8200 <p
>The information about which packages are handling which hardware is
8201 fetched either from the isenkram package itself in
8202 /usr/share/isenkram/, from git.debian.org or from the APT package
8203 database (using the Modaliases header). The APT package database
8204 parsing have caused a nasty resource leak in the isenkram daemon (bugs
8205 <a href=
"http://bugs.debian.org/
719837">#
719837</a
> and
8206 <a href=
"http://bugs.debian.org/
730704">#
730704</a
>). The cause is in
8207 the python-apt code (bug
8208 <a href=
"http://bugs.debian.org/
745487">#
745487</a
>), but using a
8209 workaround I was able to get rid of the file descriptor leak and
8210 reduce the memory leak from ~
30 MiB per hardware detection down to
8211 around
2 MiB per hardware detection. It should make the desktop
8212 daemon a lot more useful. The fix is in version
0.7 uploaded to
8213 unstable today.
</p
>
8215 <p
>I believe the current way of mapping hardware to packages in
8216 Isenkram is is a good draft, but in the future I expect isenkram to
8217 use the AppStream data source for this. A proposal for getting proper
8218 AppStream support into Debian is floating around as
8219 <a href=
"https://wiki.debian.org/DEP-
11">DEP-
11</a
>, and
8220 <a href=
"https://wiki.debian.org/SummerOfCode2014/Projects#SummerOfCode2014.2FProjects
.2FAppStreamDEP11Implementation.AppStream
.2FDEP-
11_for_the_Debian_Archive
">GSoC
8221 project
</a
> will take place this summer to improve the situation. I
8222 look forward to seeing the result, and welcome patches for isenkram to
8223 start using the information when it is ready.
</p
>
8225 <p
>If you want your package to map to some specific hardware, either
8226 add a
"Xb-Modaliases
" header to your control file like I did in
8227 <a href=
"http://packages.qa.debian.org/pymissile
">the pymissile
8228 package
</a
> or submit a bug report with the details to the isenkram
8230 <a href=
"http://www.hungry.com/~pere/blog/tags/isenkram/
">all my
8231 blog posts tagged isenkram
</a
> for details on the notation. I expect
8232 the information will be migrated to AppStream eventually, but for the
8233 moment I got no better place to store it.
</p
>
8238 <title>FreedomBox milestone - all packages now in Debian Sid
</title>
8239 <link>http://www.hungry.com/~pere/blog/FreedomBox_milestone___all_packages_now_in_Debian_Sid.html
</link>
8240 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/FreedomBox_milestone___all_packages_now_in_Debian_Sid.html
</guid>
8241 <pubDate>Tue,
15 Apr
2014 22:
10:
00 +
0200</pubDate>
8242 <description><p
>The
<a href=
"https://wiki.debian.org/FreedomBox
">Freedombox
8243 project
</a
> is working on providing the software and hardware to make
8244 it easy for non-technical people to host their data and communication
8245 at home, and being able to communicate with their friends and family
8246 encrypted and away from prying eyes. It is still going strong, and
8247 today a major mile stone was reached.
</p
>
8249 <p
>Today, the last of the packages currently used by the project to
8250 created the system images were accepted into Debian Unstable. It was
8251 the freedombox-setup package, which is used to configure the images
8252 during build and on the first boot. Now all one need to get going is
8253 the build code from the freedom-maker git repository and packages from
8254 Debian. And once the freedombox-setup package enter testing, we can
8255 build everything directly from Debian. :)
</p
>
8257 <p
>Some key packages used by Freedombox are
8258 <a href=
"http://packages.qa.debian.org/freedombox-setup
">freedombox-setup
</a
>,
8259 <a href=
"http://packages.qa.debian.org/plinth
">plinth
</a
>,
8260 <a href=
"http://packages.qa.debian.org/pagekite
">pagekite
</a
>,
8261 <a href=
"http://packages.qa.debian.org/tor
">tor
</a
>,
8262 <a href=
"http://packages.qa.debian.org/privoxy
">privoxy
</a
>,
8263 <a href=
"http://packages.qa.debian.org/owncloud
">owncloud
</a
> and
8264 <a href=
"http://packages.qa.debian.org/dnsmasq
">dnsmasq
</a
>. There
8265 are plans to integrate more packages into the setup. User
8266 documentation is maintained on the Debian wiki. Please
8267 <a href=
"https://wiki.debian.org/FreedomBox/Manual/Jessie
">check out
8268 the manual
</a
> and help us improve it.
</p
>
8270 <p
>To test for yourself and create boot images with the FreedomBox
8271 setup, run this on a Debian machine using a user with sudo rights to
8272 become root:
</p
>
8274 <p
><pre
>
8275 sudo apt-get install git vmdebootstrap mercurial python-docutils \
8276 mktorrent extlinux virtualbox qemu-user-static binfmt-support \
8278 git clone http://anonscm.debian.org/git/freedombox/freedom-maker.git \
8280 make -C freedom-maker dreamplug-image raspberry-image virtualbox-image
8281 </pre
></p
>
8283 <p
>Root access is needed to run debootstrap and mount loopback
8284 devices. See the README in the freedom-maker git repo for more
8285 details on the build. If you do not want all three images, trim the
8286 make line. Note that the virtualbox-image target is not really
8287 virtualbox specific. It create a x86 image usable in kvm, qemu,
8288 vmware and any other x86 virtual machine environment. You might need
8289 the version of vmdebootstrap in Jessie to get the build working, as it
8290 include fixes for a race condition with kpartx.
</p
>
8292 <p
>If you instead want to install using a Debian CD and the preseed
8293 method, boot a Debian Wheezy ISO and use this boot argument to load
8294 the preseed values:
</p
>
8296 <p
><pre
>
8297 url=
<a href=
"http://www.reinholdtsen.name/freedombox/preseed-jessie.dat
">http://www.reinholdtsen.name/freedombox/preseed-jessie.dat
</a
>
8298 </pre
></p
>
8300 <p
>I have not tested it myself the last few weeks, so I do not know if
8301 it still work.
</p
>
8303 <p
>If you wonder how to help, one task you could look at is using
8304 systemd as the boot system. It will become the default for Linux in
8305 Jessie, so we need to make sure it is usable on the Freedombox. I did
8306 a simple test a few weeks ago, and noticed dnsmasq failed to start
8307 during boot when using systemd. I suspect there are other problems
8308 too. :) To detect problems, there is a test suite included, which can
8309 be run from the plinth web interface.
</p
>
8311 <p
>Give it a go and let us know how it goes on the mailing list, and help
8312 us get the new release published. :) Please join us on
8313 <a href=
"irc://irc.debian.org:
6667/%
23freedombox
">IRC (#freedombox on
8314 irc.debian.org)
</a
> and
8315 <a href=
"http://lists.alioth.debian.org/mailman/listinfo/freedombox-discuss
">the
8316 mailing list
</a
> if you want to help make this vision come true.
</p
>
8321 <title>S3QL, a locally mounted cloud file system - nice free software
</title>
8322 <link>http://www.hungry.com/~pere/blog/S3QL__a_locally_mounted_cloud_file_system___nice_free_software.html
</link>
8323 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/S3QL__a_locally_mounted_cloud_file_system___nice_free_software.html
</guid>
8324 <pubDate>Wed,
9 Apr
2014 11:
30:
00 +
0200</pubDate>
8325 <description><p
>For a while now, I have been looking for a sensible offsite backup
8326 solution for use at home. My requirements are simple, it must be
8327 cheap and locally encrypted (in other words, I keep the encryption
8328 keys, the storage provider do not have access to my private files).
8329 One idea me and my friends had many years ago, before the cloud
8330 storage providers showed up, was to use Google mail as storage,
8331 writing a Linux block device storing blocks as emails in the mail
8332 service provided by Google, and thus get heaps of free space. On top
8333 of this one can add encryption, RAID and volume management to have
8334 lots of (fairly slow, I admit that) cheap and encrypted storage. But
8335 I never found time to implement such system. But the last few weeks I
8336 have looked at a system called
8337 <a href=
"https://bitbucket.org/nikratio/s3ql/
">S3QL
</a
>, a locally
8338 mounted network backed file system with the features I need.
</p
>
8340 <p
>S3QL is a fuse file system with a local cache and cloud storage,
8341 handling several different storage providers, any with Amazon S3,
8342 Google Drive or OpenStack API. There are heaps of such storage
8343 providers. S3QL can also use a local directory as storage, which
8344 combined with sshfs allow for file storage on any ssh server. S3QL
8345 include support for encryption, compression, de-duplication, snapshots
8346 and immutable file systems, allowing me to mount the remote storage as
8347 a local mount point, look at and use the files as if they were local,
8348 while the content is stored in the cloud as well. This allow me to
8349 have a backup that should survive fire. The file system can not be
8350 shared between several machines at the same time, as only one can
8351 mount it at the time, but any machine with the encryption key and
8352 access to the storage service can mount it if it is unmounted.
</p
>
8354 <p
>It is simple to use. I
'm using it on Debian Wheezy, where the
8355 package is included already. So to get started, run
<tt
>apt-get
8356 install s3ql
</tt
>. Next, pick a storage provider. I ended up picking
8357 Greenqloud, after reading their nice recipe on
8358 <a href=
"https://greenqloud.zendesk.com/entries/
44611757-How-To-Use-S3QL-to-mount-a-StorageQloud-bucket-on-Debian-Wheezy
">how
8359 to use S3QL with their Amazon S3 service
</a
>, because I trust the laws
8360 in Iceland more than those in USA when it come to keeping my personal
8361 data safe and private, and thus would rather spend money on a company
8362 in Iceland. Another nice recipe is available from the article
8363 <a href=
"http://www.admin-magazine.com/HPC/Articles/HPC-Cloud-Storage
">S3QL
8364 Filesystem for HPC Storage
</a
> by Jeff Layton in the HPC section of
8365 Admin magazine. When the provider is picked, figure out how to get
8366 the API key needed to connect to the storage API. With Greencloud,
8367 the key did not show up until I had added payment details to my
8370 <p
>Armed with the API access details, it is time to create the file
8371 system. First, create a new bucket in the cloud. This bucket is the
8372 file system storage area. I picked a bucket name reflecting the
8373 machine that was going to store data there, but any name will do.
8374 I
'll refer to it as
<tt
>bucket-name
</tt
> below. In addition, one need
8375 the API login and password, and a locally created password. Store it
8376 all in ~root/.s3ql/authinfo2 like this:
8378 <p
><blockquote
><pre
>
8380 storage-url: s3c://s.greenqloud.com:
443/bucket-name
8381 backend-login: API-login
8382 backend-password: API-password
8383 fs-passphrase: local-password
8384 </pre
></blockquote
></p
>
8386 <p
>I create my local passphrase using
<tt
>pwget
50</tt
> or similar,
8387 but any sensible way to create a fairly random password should do it.
8388 Armed with these details, it is now time to run mkfs, entering the API
8389 details and password to create it:
</p
>
8391 <p
><blockquote
><pre
>
8392 # mkdir -m
700 /var/lib/s3ql-cache
8393 # mkfs.s3ql --cachedir /var/lib/s3ql-cache --authfile /root/.s3ql/authinfo2 \
8394 --ssl s3c://s.greenqloud.com:
443/bucket-name
8395 Enter backend login:
8396 Enter backend password:
8397 Before using S3QL, make sure to read the user
's guide, especially
8398 the
'Important Rules to Avoid Loosing Data
' section.
8399 Enter encryption password:
8400 Confirm encryption password:
8401 Generating random encryption key...
8402 Creating metadata tables...
8412 Compressing and uploading metadata...
8413 Wrote
0.00 MB of compressed metadata.
8414 #
</pre
></blockquote
></p
>
8416 <p
>The next step is mounting the file system to make the storage available.
8418 <p
><blockquote
><pre
>
8419 # mount.s3ql --cachedir /var/lib/s3ql-cache --authfile /root/.s3ql/authinfo2 \
8420 --ssl --allow-root s3c://s.greenqloud.com:
443/bucket-name /s3ql
8421 Using
4 upload threads.
8422 Downloading and decompressing metadata...
8432 Mounting filesystem...
8434 Filesystem Size Used Avail Use% Mounted on
8435 s3c://s.greenqloud.com:
443/bucket-name
1.0T
0 1.0T
0% /s3ql
8437 </pre
></blockquote
></p
>
8439 <p
>The file system is now ready for use. I use rsync to store my
8440 backups in it, and as the metadata used by rsync is downloaded at
8441 mount time, no network traffic (and storage cost) is triggered by
8442 running rsync. To unmount, one should not use the normal umount
8443 command, as this will not flush the cache to the cloud storage, but
8444 instead running the umount.s3ql command like this:
8446 <p
><blockquote
><pre
>
8449 </pre
></blockquote
></p
>
8451 <p
>There is a fsck command available to check the file system and
8452 correct any problems detected. This can be used if the local server
8453 crashes while the file system is mounted, to reset the
"already
8454 mounted
" flag. This is what it look like when processing a working
8455 file system:
</p
>
8457 <p
><blockquote
><pre
>
8458 # fsck.s3ql --force --ssl s3c://s.greenqloud.com:
443/bucket-name
8459 Using cached metadata.
8460 File system seems clean, checking anyway.
8461 Checking DB integrity...
8462 Creating temporary extra indices...
8463 Checking lost+found...
8464 Checking cached objects...
8465 Checking names (refcounts)...
8466 Checking contents (names)...
8467 Checking contents (inodes)...
8468 Checking contents (parent inodes)...
8469 Checking objects (reference counts)...
8470 Checking objects (backend)...
8471 ..processed
5000 objects so far..
8472 ..processed
10000 objects so far..
8473 ..processed
15000 objects so far..
8474 Checking objects (sizes)...
8475 Checking blocks (referenced objects)...
8476 Checking blocks (refcounts)...
8477 Checking inode-block mapping (blocks)...
8478 Checking inode-block mapping (inodes)...
8479 Checking inodes (refcounts)...
8480 Checking inodes (sizes)...
8481 Checking extended attributes (names)...
8482 Checking extended attributes (inodes)...
8483 Checking symlinks (inodes)...
8484 Checking directory reachability...
8485 Checking unix conventions...
8486 Checking referential integrity...
8487 Dropping temporary indices...
8488 Backing up old metadata...
8498 Compressing and uploading metadata...
8499 Wrote
0.89 MB of compressed metadata.
8501 </pre
></blockquote
></p
>
8503 <p
>Thanks to the cache, working on files that fit in the cache is very
8504 quick, about the same speed as local file access. Uploading large
8505 amount of data is to me limited by the bandwidth out of and into my
8506 house. Uploading
685 MiB with a
100 MiB cache gave me
305 kiB/s,
8507 which is very close to my upload speed, and downloading the same
8508 Debian installation ISO gave me
610 kiB/s, close to my download speed.
8509 Both were measured using
<tt
>dd
</tt
>. So for me, the bottleneck is my
8510 network, not the file system code. I do not know what a good cache
8511 size would be, but suspect that the cache should e larger than your
8512 working set.
</p
>
8514 <p
>I mentioned that only one machine can mount the file system at the
8515 time. If another machine try, it is told that the file system is
8518 <p
><blockquote
><pre
>
8519 # mount.s3ql --cachedir /var/lib/s3ql-cache --authfile /root/.s3ql/authinfo2 \
8520 --ssl --allow-root s3c://s.greenqloud.com:
443/bucket-name /s3ql
8521 Using
8 upload threads.
8522 Backend reports that fs is still mounted elsewhere, aborting.
8524 </pre
></blockquote
></p
>
8526 <p
>The file content is uploaded when the cache is full, while the
8527 metadata is uploaded once every
24 hour by default. To ensure the
8528 file system content is flushed to the cloud, one can either umount the
8529 file system, or ask S3QL to flush the cache and metadata using
8532 <p
><blockquote
><pre
>
8533 # s3qlctrl upload-meta /s3ql
8534 # s3qlctrl flushcache /s3ql
8536 </pre
></blockquote
></p
>
8538 <p
>If you are curious about how much space your data uses in the
8539 cloud, and how much compression and deduplication cut down on the
8540 storage usage, you can use s3qlstat on the mounted file system to get
8543 <p
><blockquote
><pre
>
8545 Directory entries:
9141
8548 Total data size:
22049.38 MB
8549 After de-duplication:
21955.46 MB (
99.57% of total)
8550 After compression:
21877.28 MB (
99.22% of total,
99.64% of de-duplicated)
8551 Database size:
2.39 MB (uncompressed)
8552 (some values do not take into account not-yet-uploaded dirty blocks in cache)
8554 </pre
></blockquote
></p
>
8556 <p
>I mentioned earlier that there are several possible suppliers of
8557 storage. I did not try to locate them all, but am aware of at least
8558 <a href=
"https://www.greenqloud.com/
">Greenqloud
</a
>,
8559 <a href=
"http://drive.google.com/
">Google Drive
</a
>,
8560 <a href=
"http://aws.amazon.com/s3/
">Amazon S3 web serivces
</a
>,
8561 <a href=
"http://www.rackspace.com/
">Rackspace
</a
> and
8562 <a href=
"http://crowncloud.net/
">Crowncloud
</A
>. The latter even
8563 accept payment in Bitcoin. Pick one that suit your need. Some of
8564 them provide several GiB of free storage, but the prize models are
8565 quite different and you will have to figure out what suits you
8568 <p
>While researching this blog post, I had a look at research papers
8569 and posters discussing the S3QL file system. There are several, which
8570 told me that the file system is getting a critical check by the
8571 science community and increased my confidence in using it. One nice
8573 "<a href=
"http://www.lanl.gov/orgs/adtsc/publications/science_highlights_2013/docs/pg68_69.pdf
">An
8574 Innovative Parallel Cloud Storage System using OpenStack’s SwiftObject
8575 Store and Transformative Parallel I/O Approach
</a
>" by Hsing-Bung
8576 Chen, Benjamin McClelland, David Sherrill, Alfred Torrez, Parks Fields
8577 and Pamela Smith. Please have a look.
</p
>
8579 <p
>Given my problems with different file systems earlier, I decided to
8580 check out the mounted S3QL file system to see if it would be usable as
8581 a home directory (in other word, that it provided POSIX semantics when
8582 it come to locking and umask handling etc). Running
8583 <a href=
"http://www.hungry.com/~pere/blog/Testing_if_a_file_system_can_be_used_for_home_directories___.html
">my
8584 test code to check file system semantics
</a
>, I was happy to discover that
8585 no error was found. So the file system can be used for home
8586 directories, if one chooses to do so.
</p
>
8588 <p
>If you do not want a locally file system, and want something that
8589 work without the Linux fuse file system, I would like to mention the
8590 <a href=
"http://www.tarsnap.com/
">Tarsnap service
</a
>, which also
8591 provide locally encrypted backup using a command line client. It have
8592 a nicer access control system, where one can split out read and write
8593 access, allowing some systems to write to the backup and others to
8594 only read from it.
</p
>
8596 <p
>As usual, if you use Bitcoin and want to show your support of my
8597 activities, please send Bitcoin donations to my address
8598 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
8603 <title>Freedombox on Dreamplug, Raspberry Pi and virtual x86 machine
</title>
8604 <link>http://www.hungry.com/~pere/blog/Freedombox_on_Dreamplug__Raspberry_Pi_and_virtual_x86_machine.html
</link>
8605 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Freedombox_on_Dreamplug__Raspberry_Pi_and_virtual_x86_machine.html
</guid>
8606 <pubDate>Fri,
14 Mar
2014 11:
00:
00 +
0100</pubDate>
8607 <description><p
>The
<a href=
"https://wiki.debian.org/FreedomBox
">Freedombox
8608 project
</a
> is working on providing the software and hardware for
8609 making it easy for non-technical people to host their data and
8610 communication at home, and being able to communicate with their
8611 friends and family encrypted and away from prying eyes. It has been
8612 going on for a while, and is slowly progressing towards a new test
8613 release (
0.2).
</p
>
8615 <p
>And what day could be better than the Pi day to announce that the
8616 new version will provide
"hard drive
" / SD card / USB stick images for
8617 Dreamplug, Raspberry Pi and VirtualBox (or any other virtualization
8618 system), and can also be installed using a Debian installer preseed
8619 file. The Debian based Freedombox is now based on Debian Jessie,
8620 where most of the needed packages used are already present. Only one,
8621 the freedombox-setup package, is missing. To try to build your own
8622 boot image to test the current status, fetch the freedom-maker scripts
8624 <a href=
"http://packages.qa.debian.org/vmdebootstrap
">vmdebootstrap
</a
>
8625 with a user with sudo access to become root:
8628 git clone http://anonscm.debian.org/git/freedombox/freedom-maker.git \
8630 sudo apt-get install git vmdebootstrap mercurial python-docutils \
8631 mktorrent extlinux virtualbox qemu-user-static binfmt-support \
8633 make -C freedom-maker dreamplug-image raspberry-image virtualbox-image
8636 <p
>Root access is needed to run debootstrap and mount loopback
8637 devices. See the README for more details on the build. If you do not
8638 want all three images, trim the make line. But note that thanks to
<a
8639 href=
"https://bugs.debian.org/
741407">a race condition in
8640 vmdebootstrap
</a
>, the build might fail without the patch to the
8641 kpartx call.
</p
>
8643 <p
>If you instead want to install using a Debian CD and the preseed
8644 method, boot a Debian Wheezy ISO and use this boot argument to load
8645 the preseed values:
</p
>
8648 url=
<a href=
"http://www.reinholdtsen.name/freedombox/preseed-jessie.dat
">http://www.reinholdtsen.name/freedombox/preseed-jessie.dat
</a
>
8651 <p
>But note that due to
<a href=
"https://bugs.debian.org/
740673">a
8652 recently introduced bug in apt in Jessie
</a
>, the installer will
8653 currently hang while setting up APT sources. Killing the
8654 '<tt
>apt-cdrom ident
</tt
>' process when it hang a few times during the
8655 installation will get the installation going. This affect all
8656 installations in Jessie, and I expect it will be fixed soon.
</p
>
8658 <p
>Give it a go and let us know how it goes on the mailing list, and help
8659 us get the new release published. :) Please join us on
8660 <a href=
"irc://irc.debian.org:
6667/%
23freedombox
">IRC (#freedombox on
8661 irc.debian.org)
</a
> and
8662 <a href=
"http://lists.alioth.debian.org/mailman/listinfo/freedombox-discuss
">the
8663 mailing list
</a
> if you want to help make this vision come true.
</p
>
8668 <title>New home and release
1.0 for netgroup and innetgr (aka ng-utils)
</title>
8669 <link>http://www.hungry.com/~pere/blog/New_home_and_release_1_0_for_netgroup_and_innetgr__aka_ng_utils_.html
</link>
8670 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_home_and_release_1_0_for_netgroup_and_innetgr__aka_ng_utils_.html
</guid>
8671 <pubDate>Sat,
22 Feb
2014 21:
45:
00 +
0100</pubDate>
8672 <description><p
>Many years ago, I wrote a GPL licensed version of the netgroup and
8673 innetgr tools, because I needed them in
8674 <a href=
"http://www.skolelinux.org/
">Skolelinux
</a
>. I called the project
8675 ng-utils, and it has served me well. I placed the project under the
8676 <a href=
"http://www.hungry.com/
">Hungry Programmer
</a
> umbrella, and it was maintained in our CVS
8677 repository. But many years ago, the CVS repository was dropped (lost,
8678 not migrated to new hardware, not sure), and the project have lacked a
8679 proper home since then.
</p
>
8681 <p
>Last summer, I had a look at the package and made a new release
8682 fixing a irritating crash bug, but was unable to store the changes in
8683 a proper source control system. I applied for a project on
8684 <a href=
"https://alioth.debian.org/
">Alioth
</a
>, but did not have time
8685 to follow up on it. Until today. :)
</p
>
8687 <p
>After many hours of cleaning and migration, the ng-utils project
8688 now have a new home, and a git repository with the highlight of the
8689 history of the project. I published all release tarballs and imported
8690 them into the git repository. As the project is really stable and not
8691 expected to gain new features any time soon, I decided to make a new
8692 release and call it
1.0. Visit the new project home on
8693 <a href=
"https://alioth.debian.org/projects/ng-utils/
">https://alioth.debian.org/projects/ng-utils/
</a
>
8694 if you want to check it out. The new version is also uploaded into
8695 <a href=
"http://packages.qa.debian.org/n/ng-utils.html
">Debian Unstable
</a
>.
</p
>
8700 <title>Testing sysvinit from experimental in Debian Hurd
</title>
8701 <link>http://www.hungry.com/~pere/blog/Testing_sysvinit_from_experimental_in_Debian_Hurd.html
</link>
8702 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Testing_sysvinit_from_experimental_in_Debian_Hurd.html
</guid>
8703 <pubDate>Mon,
3 Feb
2014 13:
40:
00 +
0100</pubDate>
8704 <description><p
>A few days ago I decided to try to help the Hurd people to get
8705 their changes into sysvinit, to allow them to use the normal sysvinit
8706 boot system instead of their old one. This follow up on the
8707 <a href=
"https://teythoon.cryptobitch.de//categories/gsoc.html
">great
8708 Google Summer of Code work
</a
> done last summer by Justus Winter to
8709 get Debian on Hurd working more like Debian on Linux. To get started,
8710 I downloaded a prebuilt hard disk image from
8711 <a href=
"http://ftp.debian-ports.org/debian-cd/hurd-i386/current/debian-hurd.img.tar.gz
">http://ftp.debian-ports.org/debian-cd/hurd-i386/current/debian-hurd.img.tar.gz
</a
>,
8712 and started it using virt-manager.
</p
>
8714 <p
>The first think I had to do after logging in (root without any
8715 password) was to get the network operational. I followed
8716 <a href=
"https://www.debian.org/ports/hurd/hurd-install
">the
8717 instructions on the Debian GNU/Hurd ports page
</a
> and ran these
8718 commands as root to get the machine to accept a IP address from the
8719 kvm internal DHCP server:
</p
>
8721 <p
><blockquote
><pre
>
8722 settrans -fgap /dev/netdde /hurd/netdde
8723 kill $(ps -ef|awk
'/[p]finet/ { print $
2}
')
8724 kill $(ps -ef|awk
'/[d]evnode/ { print $
2}
')
8726 </pre
></blockquote
></p
>
8728 <p
>After this, the machine had internet connectivity, and I could
8729 upgrade it and install the sysvinit packages from experimental and
8730 enable it as the default boot system in Hurd.
</p
>
8732 <p
>But before I did that, I set a password on the root user, as ssh is
8733 running on the machine it for ssh login to work a password need to be
8734 set. Also, note that a bug somewhere in openssh on Hurd block
8735 compression from working. Remember to turn that off on the client
8738 <p
>Run these commands as root to upgrade and test the new sysvinit
8741 <p
><blockquote
><pre
>
8742 cat
> /etc/apt/sources.list.d/experimental.list
&lt;
&lt;EOF
8743 deb http://http.debian.net/debian/ experimental main
8746 apt-get dist-upgrade
8747 apt-get install -t experimental initscripts sysv-rc sysvinit \
8748 sysvinit-core sysvinit-utils
8749 update-alternatives --config runsystem
8750 </pre
></blockquote
></p
>
8752 <p
>To reboot after switching boot system, you have to use
8753 <tt
>reboot-hurd
</tt
> instead of just
<tt
>reboot
</tt
>, as there is not
8754 yet a sysvinit process able to receive the signals from the normal
8755 'reboot
' command. After switching to sysvinit as the boot system,
8756 upgrading every package and rebooting, the network come up with DHCP
8757 after boot as it should, and the settrans/pkill hack mentioned at the
8758 start is no longer needed. But for some strange reason, there are no
8759 longer any login prompt in the virtual console, so I logged in using
8762 <p
>Note that there are some race conditions in Hurd making the boot
8763 fail some times. No idea what the cause is, but hope the Hurd porters
8764 figure it out. At least Justus said on IRC (#debian-hurd on
8765 irc.debian.org) that they are aware of the problem. A way to reduce
8766 the impact is to upgrade to the Hurd packages built by Justus by
8767 adding this repository to the machine:
</p
>
8769 <p
><blockquote
><pre
>
8770 cat
> /etc/apt/sources.list.d/hurd-ci.list
&lt;
&lt;EOF
8771 deb http://darnassus.sceen.net/~teythoon/hurd-ci/ sid main
8773 </pre
></blockquote
></p
>
8775 <p
>At the moment the prebuilt virtual machine get some packages from
8776 http://ftp.debian-ports.org/debian, because some of the packages in
8777 unstable do not yet include the required patches that are lingering in
8778 BTS. This is the completely list of
"unofficial
" packages installed:
</p
>
8780 <p
><blockquote
><pre
>
8781 # aptitude search
'?narrow(?version(CURRENT),?origin(Debian Ports))
'
8782 i emacs - GNU Emacs editor (metapackage)
8783 i gdb - GNU Debugger
8784 i hurd-recommended - Miscellaneous translators
8785 i isc-dhcp-client - ISC DHCP client
8786 i isc-dhcp-common - common files used by all the isc-dhcp* packages
8787 i libc-bin - Embedded GNU C Library: Binaries
8788 i libc-dev-bin - Embedded GNU C Library: Development binaries
8789 i libc0.3 - Embedded GNU C Library: Shared libraries
8790 i A libc0.3-dbg - Embedded GNU C Library: detached debugging symbols
8791 i libc0.3-dev - Embedded GNU C Library: Development Libraries and Hea
8792 i multiarch-support - Transitional package to ensure multiarch compatibilit
8793 i A x11-common - X Window System (X.Org) infrastructure
8794 i xorg - X.Org X Window System
8795 i A xserver-xorg - X.Org X server
8796 i A xserver-xorg-input-all - X.Org X server -- input driver metapackage
8798 </pre
></blockquote
></p
>
8800 <p
>All in all, testing hurd has been an interesting experience. :)
8801 X.org did not work out of the box and I never took the time to follow
8802 the porters instructions to fix it. This time I was interested in the
8803 command line stuff.
<p
>
8808 <title>New chrpath release
0.16</title>
8809 <link>http://www.hungry.com/~pere/blog/New_chrpath_release_0_16.html
</link>
8810 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_chrpath_release_0_16.html
</guid>
8811 <pubDate>Tue,
14 Jan
2014 11:
00:
00 +
0100</pubDate>
8812 <description><p
><a href=
"http://www.coverity.com/
">Coverity
</a
> is a nice tool to
8813 find problems in C, C++ and Java code using static source code
8814 analysis. It can detect a lot of different problems, and is very
8815 useful to find memory and locking bugs in the error handling part of
8816 the source. The company behind it provide
8817 <a href=
"https://scan.coverity.com/
">check of free software projects as
8818 a community service
</a
>, and many hundred free software projects are
8819 already checked. A few days ago I decided to have a closer look at
8820 the Coverity system, and discovered that the
8821 <a href=
"http://www.gnu.org/software/gnash/
">gnash
</a
> and
8822 <a href=
"http://sourceforge.net/projects/ipmitool/
">ipmitool
</a
>
8823 projects I am involved with was already registered. But these are
8824 fairly big, and I would also like to have a small and easy project to
8825 check, and decided to
<a href=
"http://scan.coverity.com/projects/
1179">request
8826 checking of the chrpath project
</a
>. It was
8827 added to the checker and discovered seven potential defects. Six of
8828 these were real, mostly resource
"leak
" when the program detected an
8829 error. Nothing serious, as the resources would be released a fraction
8830 of a second later when the program exited because of the error, but it
8831 is nice to do it right in case the source of the program some time in
8832 the future end up in a library. Having fixed all defects and added
8833 <a href=
"https://lists.alioth.debian.org/mailman/listinfo/chrpath-devel
">a
8834 mailing list for the chrpath developers
</a
>, I decided it was time to
8835 publish a new release. These are the release notes:
</p
>
8837 <p
>New in
0.16 released
2014-
01-
14:
</p
>
8841 <li
>Fixed all minor bugs discovered by Coverity.
</li
>
8842 <li
>Updated config.sub and config.guess from the GNU project.
</li
>
8843 <li
>Mention new project mailing list in the documentation.
</li
>
8848 <a href=
"https://alioth.debian.org/frs/?group_id=
31052">download the
8849 new version
0.16 from alioth
</a
>. Please let us know via the Alioth
8850 project if something is wrong with the new release. The test suite
8851 did not discover any old errors, so if you find a new one, please also
8852 include a test suite check.
</p
>
8857 <title>New chrpath release
0.15</title>
8858 <link>http://www.hungry.com/~pere/blog/New_chrpath_release_0_15.html
</link>
8859 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_chrpath_release_0_15.html
</guid>
8860 <pubDate>Sun,
24 Nov
2013 09:
30:
00 +
0100</pubDate>
8861 <description><p
>After many years break from the package and a vain hope that
8862 development would be continued by someone else, I finally pulled my
8863 acts together this morning and wrapped up a new release of chrpath,
8864 the command line tool to modify the rpath and runpath of already
8865 compiled ELF programs. The update was triggered by the persistence of
8866 Isha Vishnoi at IBM, which needed a new config.guess file to get
8867 support for the ppc64le architecture (powerpc
64-bit Little Endian) he
8868 is working on. I checked the
8869 <a href=
"http://packages.qa.debian.org/chrpath
">Debian
</a
>,
8870 <a href=
"https://launchpad.net/ubuntu/+source/chrpath
">Ubuntu
</a
> and
8871 <a href=
"https://admin.fedoraproject.org/pkgdb/acls/name/chrpath
">Fedora
</a
>
8872 packages for interesting patches (failed to find the source from
8873 OpenSUSE and Mandriva packages), and found quite a few nice fixes.
8874 These are the release notes:
</p
>
8876 <p
>New in
0.15 released
2013-
11-
24:
</p
>
8880 <li
>Updated config.sub and config.guess from the GNU project to work
8881 with newer architectures. Thanks to isha vishnoi for the heads
8884 <li
>Updated README with current URLs.
</li
>
8886 <li
>Added byteswap fix found in Ubuntu, credited Jeremy Kerr and
8887 Matthias Klose.
</li
>
8889 <li
>Added missing help for -k|--keepgoing option, using patch by
8890 Petr Machata found in Fedora.
</li
>
8892 <li
>Rewrite removal of RPATH/RUNPATH to make sure the entry in
8893 .dynamic is a NULL terminated string. Based on patch found in
8894 Fedora credited Axel Thimm and Christian Krause.
</li
>
8899 <a href=
"https://alioth.debian.org/frs/?group_id=
31052">download the
8900 new version
0.15 from alioth
</a
>. Please let us know via the Alioth
8901 project if something is wrong with the new release. The test suite
8902 did not discover any old errors, so if you find a new one, please also
8903 include a testsuite check.
</p
>
8908 <title>Debian init.d boot script example for rsyslog
</title>
8909 <link>http://www.hungry.com/~pere/blog/Debian_init_d_boot_script_example_for_rsyslog.html
</link>
8910 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_init_d_boot_script_example_for_rsyslog.html
</guid>
8911 <pubDate>Sat,
2 Nov
2013 22:
40:
00 +
0100</pubDate>
8912 <description><p
>If one of the points of switching to a new init system in Debian is
8913 <a href=
"http://thomas.goirand.fr/blog/?p=
147">to get rid of huge
8914 init.d scripts
</a
>, I doubt we need to switch away from sysvinit and
8915 init.d scripts at all. Here is an example init.d script, ie a rewrite
8916 of /etc/init.d/rsyslog:
</p
>
8918 <p
><pre
>
8919 #!/lib/init/init-d-script
8922 # Required-Start: $remote_fs $time
8923 # Required-Stop: umountnfs $time
8924 # X-Stop-After: sendsigs
8925 # Default-Start:
2 3 4 5
8926 # Default-Stop:
0 1 6
8927 # Short-Description: enhanced syslogd
8928 # Description: Rsyslog is an enhanced multi-threaded syslogd.
8929 # It is quite compatible to stock sysklogd and can be
8930 # used as a drop-in replacement.
8932 DESC=
"enhanced syslogd
"
8933 DAEMON=/usr/sbin/rsyslogd
8934 </pre
></p
>
8936 <p
>Pretty minimalistic to me... For the record, the original sysv-rc
8937 script was
137 lines, and the above is just
15 lines, most of it meta
8938 info/comments.
</p
>
8940 <p
>How to do this, you ask? Well, one create a new script
8941 /lib/init/init-d-script looking something like this:
8943 <p
><pre
>
8946 # Define LSB log_* functions.
8947 # Depend on lsb-base (
>=
3.2-
14) to ensure that this file is present
8948 # and status_of_proc is working.
8949 . /lib/lsb/init-functions
8952 # Function that starts the daemon/service
8958 #
0 if daemon has been started
8959 #
1 if daemon was already running
8960 #
2 if daemon could not be started
8961 start-stop-daemon --start --quiet --pidfile $PIDFILE --exec $DAEMON --test
> /dev/null \
8963 start-stop-daemon --start --quiet --pidfile $PIDFILE --exec $DAEMON -- \
8966 # Add code here, if necessary, that waits for the process to be ready
8967 # to handle requests from services started subsequently which depend
8968 # on this one. As a last resort, sleep for some time.
8972 # Function that stops the daemon/service
8977 #
0 if daemon has been stopped
8978 #
1 if daemon was already stopped
8979 #
2 if daemon could not be stopped
8980 # other if a failure occurred
8981 start-stop-daemon --stop --quiet --retry=TERM/
30/KILL/
5 --pidfile $PIDFILE --name $NAME
8982 RETVAL=
"$?
"
8983 [
"$RETVAL
" =
2 ]
&& return
2
8984 # Wait for children to finish too if this is a daemon that forks
8985 # and if the daemon is only ever run from this initscript.
8986 # If the above conditions are not satisfied then add some other code
8987 # that waits for the process to drop all resources that could be
8988 # needed by services started subsequently. A last resort is to
8989 # sleep for some time.
8990 start-stop-daemon --stop --quiet --oknodo --retry=
0/
30/KILL/
5 --exec $DAEMON
8991 [
"$?
" =
2 ]
&& return
2
8992 # Many daemons don
't delete their pidfiles when they exit.
8994 return
"$RETVAL
"
8998 # Function that sends a SIGHUP to the daemon/service
9002 # If the daemon can reload its configuration without
9003 # restarting (for example, when it is sent a SIGHUP),
9004 # then implement that here.
9006 start-stop-daemon --stop --signal
1 --quiet --pidfile $PIDFILE --name $NAME
9011 scriptbasename=
"$(basename $
1)
"
9012 echo
"SN: $scriptbasename
"
9013 if [
"$scriptbasename
" !=
"init-d-library
" ] ; then
9014 script=
"$
1"
9021 NAME=$(basename $DAEMON)
9022 PIDFILE=/var/run/$NAME.pid
9024 # Exit if the package is not installed
9025 #[ -x
"$DAEMON
" ] || exit
0
9027 # Read configuration variable file if it is present
9028 [ -r /etc/default/$NAME ]
&& . /etc/default/$NAME
9030 # Load the VERBOSE setting and other rcS variables
9033 case
"$
1" in
9035 [
"$VERBOSE
" != no ]
&& log_daemon_msg
"Starting $DESC
" "$NAME
"
9037 case
"$?
" in
9038 0|
1) [
"$VERBOSE
" != no ]
&& log_end_msg
0 ;;
9039 2) [
"$VERBOSE
" != no ]
&& log_end_msg
1 ;;
9043 [
"$VERBOSE
" != no ]
&& log_daemon_msg
"Stopping $DESC
" "$NAME
"
9045 case
"$?
" in
9046 0|
1) [
"$VERBOSE
" != no ]
&& log_end_msg
0 ;;
9047 2) [
"$VERBOSE
" != no ]
&& log_end_msg
1 ;;
9051 status_of_proc
"$DAEMON
" "$NAME
" && exit
0 || exit $?
9053 #reload|force-reload)
9055 # If do_reload() is not implemented then leave this commented out
9056 # and leave
'force-reload
' as an alias for
'restart
'.
9058 #log_daemon_msg
"Reloading $DESC
" "$NAME
"
9062 restart|force-reload)
9064 # If the
"reload
" option is implemented then remove the
9065 #
'force-reload
' alias
9067 log_daemon_msg
"Restarting $DESC
" "$NAME
"
9069 case
"$?
" in
9072 case
"$?
" in
9074 1) log_end_msg
1 ;; # Old process is still running
9075 *) log_end_msg
1 ;; # Failed to start
9085 echo
"Usage: $SCRIPTNAME {start|stop|status|restart|force-reload}
" >&2
9091 </pre
></p
>
9093 <p
>It is based on /etc/init.d/skeleton, and could be improved quite a
9094 lot. I did not really polish the approach, so it might not always
9095 work out of the box, but you get the idea. I did not try very hard to
9096 optimize it nor make it more robust either.
</p
>
9098 <p
>A better argument for switching init system in Debian than reducing
9099 the size of init scripts (which is a good thing to do anyway), is to
9100 get boot system that is able to handle the kernel events sensibly and
9101 robustly, and do not depend on the boot to run sequentially. The boot
9102 and the kernel have not behaved sequentially in years.
</p
>
9107 <title>Browser plugin for SPICE (spice-xpi) uploaded to Debian
</title>
9108 <link>http://www.hungry.com/~pere/blog/Browser_plugin_for_SPICE__spice_xpi__uploaded_to_Debian.html
</link>
9109 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Browser_plugin_for_SPICE__spice_xpi__uploaded_to_Debian.html
</guid>
9110 <pubDate>Fri,
1 Nov
2013 11:
00:
00 +
0100</pubDate>
9111 <description><p
><a href=
"http://www.spice-space.org/
">The SPICE protocol
</a
> for
9112 remote display access is the preferred solution with oVirt and RedHat
9113 Enterprise Virtualization, and I was sad to discover the other day
9114 that the browser plugin needed to use these systems seamlessly was
9115 missing in Debian. The
<a href=
"http://bugs.debian.org/
668284">request
9116 for a package
</a
> was from
2012-
04-
10 with no progress since
9117 2013-
04-
01, so I decided to wrap up a package based on the great work
9118 from Cajus Pollmeier and put it in a collab-maint maintained git
9119 repository to get a package I could use. I would very much like
9120 others to help me maintain the package (or just take over, I do not
9121 mind), but as no-one had volunteered so far, I just uploaded it to
9122 NEW. I hope it will be available in Debian in a few days.
</p
>
9124 <p
>The source is now available from
9125 <a href=
"http://anonscm.debian.org/gitweb/?p=collab-maint/spice-xpi.git;a=summary
">http://anonscm.debian.org/gitweb/?p=collab-maint/spice-xpi.git;a=summary
</a
>.
</p
>
9130 <title>Teaching vmdebootstrap to create Raspberry Pi SD card images
</title>
9131 <link>http://www.hungry.com/~pere/blog/Teaching_vmdebootstrap_to_create_Raspberry_Pi_SD_card_images.html
</link>
9132 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Teaching_vmdebootstrap_to_create_Raspberry_Pi_SD_card_images.html
</guid>
9133 <pubDate>Sun,
27 Oct
2013 17:
00:
00 +
0100</pubDate>
9134 <description><p
>The
9135 <a href=
"http://packages.qa.debian.org/v/vmdebootstrap.html
">vmdebootstrap
</a
>
9136 program is a a very nice system to create virtual machine images. It
9137 create a image file, add a partition table, mount it and run
9138 debootstrap in the mounted directory to create a Debian system on a
9139 stick. Yesterday, I decided to try to teach it how to make images for
9140 <a href=
"https://wiki.debian.org/RaspberryPi
">Raspberry Pi
</a
>, as part
9141 of a plan to simplify the build system for
9142 <a href=
"https://wiki.debian.org/FreedomBox
">the FreedomBox
9143 project
</a
>. The FreedomBox project already uses vmdebootstrap for
9144 the virtualbox images, but its current build system made multistrap
9145 based system for Dreamplug images, and it is lacking support for
9146 Raspberry Pi.
</p
>
9148 <p
>Armed with the knowledge on how to build
"foreign
" (aka non-native
9149 architecture) chroots for Raspberry Pi, I dived into the vmdebootstrap
9150 code and adjusted it to be able to build armel images on my amd64
9151 Debian laptop. I ended up giving vmdebootstrap five new options,
9152 allowing me to replicate the image creation process I use to make
9153 <a href=
"http://www.hungry.com/~pere/blog/A_Raspberry_Pi_based_batman_adv_Mesh_network_node.html
">Debian
9154 Jessie based mesh node images for the Raspberry Pi
</a
>. First, the
9155 <tt
>--foreign /path/to/binfm_handler
</tt
> option tell vmdebootstrap to
9156 call debootstrap with --foreign and to copy the handler into the
9157 generated chroot before running the second stage. This allow
9158 vmdebootstrap to create armel images on an amd64 host. Next I added
9159 two new options
<tt
>--bootsize size
</tt
> and
<tt
>--boottype
9160 fstype
</tt
> to teach it to create a separate /boot/ partition with the
9161 given file system type, allowing me to create an image with a vfat
9162 partition for the /boot/ stuff. I also added a
<tt
>--variant
9163 variant
</tt
> option to allow me to create smaller images without the
9164 Debian base system packages installed. Finally, I added an option
9165 <tt
>--no-extlinux
</tt
> to tell vmdebootstrap to not install extlinux
9166 as a boot loader. It is not needed on the Raspberry Pi and probably
9167 most other non-x86 architectures. The changes were accepted by the
9168 upstream author of vmdebootstrap yesterday and today, and is now
9170 <a href=
"http://git.liw.fi/cgi-bin/cgit/cgit.cgi/vmdebootstrap/
">the
9171 upstream project page
</a
>.
</p
>
9173 <p
>To use it to build a Raspberry Pi image using Debian Jessie, first
9174 create a small script (the customize script) to add the non-free
9175 binary blob needed to boot the Raspberry Pi and the APT source
9178 <p
><pre
>
9180 set -e # Exit on first error
9181 rootdir=
"$
1"
9182 cd
"$rootdir
"
9183 cat
&lt;
&lt;EOF
> etc/apt/sources.list
9184 deb http://http.debian.net/debian/ jessie main contrib non-free
9186 # Install non-free binary blob needed to boot Raspberry Pi. This
9187 # install a kernel somewhere too.
9188 wget https://raw.github.com/Hexxeh/rpi-update/master/rpi-update \
9189 -O $rootdir/usr/bin/rpi-update
9190 chmod a+x $rootdir/usr/bin/rpi-update
9191 mkdir -p $rootdir/lib/modules
9192 touch $rootdir/boot/start.elf
9193 chroot $rootdir rpi-update
9194 </pre
></p
>
9196 <p
>Next, fetch the latest vmdebootstrap script and call it like this
9197 to build the image:
</p
>
9200 sudo ./vmdebootstrap \
9203 --distribution jessie \
9204 --mirror http://http.debian.net/debian \
9213 --root-password raspberry \
9214 --hostname raspberrypi \
9215 --foreign /usr/bin/qemu-arm-static \
9216 --customize `pwd`/customize \
9218 --package git-core \
9219 --package binutils \
9220 --package ca-certificates \
9223 </pre
></p
>
9225 <p
>The list of packages being installed are the ones needed by
9226 rpi-update to make the image bootable on the Raspberry Pi, with the
9227 exception of netbase, which is needed by debootstrap to find
9228 /etc/hosts with the minbase variant. I really wish there was a way to
9229 set up an Raspberry Pi using only packages in the Debian archive, but
9230 that is not possible as far as I know, because it boots from the GPU
9231 using a non-free binary blob.
</p
>
9233 <p
>The build host need debootstrap, kpartx and qemu-user-static and
9234 probably a few others installed. I have not checked the complete
9235 build dependency list.
</p
>
9237 <p
>The resulting image will not use the hardware floating point unit
9238 on the Raspberry PI, because the armel architecture in Debian is not
9239 optimized for that use. So the images created will be a bit slower
9240 than
<a href=
"http://www.raspbian.org/
">Raspbian
</a
> based images.
</p
>
9245 <title>Good causes: Debian Outreach Program for Women, EFF documenting the spying and Open access in Norway
</title>
9246 <link>http://www.hungry.com/~pere/blog/Good_causes__Debian_Outreach_Program_for_Women__EFF_documenting_the_spying_and_Open_access_in_Norway.html
</link>
9247 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Good_causes__Debian_Outreach_Program_for_Women__EFF_documenting_the_spying_and_Open_access_in_Norway.html
</guid>
9248 <pubDate>Tue,
15 Oct
2013 21:
30:
00 +
0200</pubDate>
9249 <description><p
>The last few days I came across a few good causes that should get
9250 wider attention. I recommend signing and donating to each one of
9253 <p
>Via
<a href=
"http://www.debian.org/News/weekly/
2013/
18/
">Debian
9254 Project News for
2013-
10-
14</a
> I came across the Outreach Program for
9255 Women program which is a Google Summer of Code like initiative to get
9256 more women involved in free software. One debian sponsor has offered
9257 to match
<a href=
"http://debian.ch/opw2013
">any donation done to Debian
9258 earmarked
</a
> for this initiative. I donated a few minutes ago, and
9259 hope you will to. :)
</p
>
9261 <p
>And the Electronic Frontier Foundation just announced plans to
9262 create
<a href=
"https://supporters.eff.org/donate/nsa-videos
">video
9263 documentaries about the excessive spying
</a
> on every Internet user that
9264 take place these days, and their need to fund the work. I
've already
9265 donated. Are you next?
</p
>
9267 <p
>For my Norwegian audience, the organisation Studentenes og
9268 Akademikernes Internasjonale Hjelpefond is collecting signatures for a
9269 statement under the heading
9270 <a href=
"http://saih.no/Bloggers_United/
">Bloggers United for Open
9271 Access
</a
> for those of us asking for more focus on open access in the
9272 Norwegian government. So far
499 signatures. I hope you will sign it
9278 <title>Videos about the Freedombox project - for inspiration and learning
</title>
9279 <link>http://www.hungry.com/~pere/blog/Videos_about_the_Freedombox_project___for_inspiration_and_learning.html
</link>
9280 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Videos_about_the_Freedombox_project___for_inspiration_and_learning.html
</guid>
9281 <pubDate>Fri,
27 Sep
2013 14:
10:
00 +
0200</pubDate>
9282 <description><p
>The
<a href=
"http://www.freedomboxfoundation.org/
">Freedombox
9283 project
</a
> have been going on for a while, and have presented the
9284 vision, ideas and solution several places. Here is a little
9285 collection of videos of talks and presentation of the project.
</p
>
9289 <li
><a href=
"http://www.youtube.com/watch?v=ukvUz5taxvA
">FreedomBox -
9290 2,
5 minute marketing film
</a
> (Youtube)
</li
>
9292 <li
><a href=
"http://www.youtube.com/watch?v=SzW25QTVWsE
">Eben Moglen
9293 discusses the Freedombox on CBS news
2011</a
> (Youtube)
</li
>
9295 <li
><a href=
"http://www.youtube.com/watch?v=Ae8SZbxfE0g
">Eben Moglen -
9296 Freedom in the Cloud - Software Freedom, Privacy and and Security for
9297 Web
2.0 and Cloud computing at ISOC-NY Public Meeting
2010</a
>
9298 (Youtube)
</li
>
9300 <li
><a href=
"http://www.youtube.com/watch?v=vNaIji_3xBE
">Fosdem
2011
9301 Keynote by Eben Moglen presenting the Freedombox
</a
> (Youtube)
</li
>
9303 <li
><a href=
"http://www.youtube.com/watch?v=
9bDDUyJSQ9s
">Presentation of
9304 the Freedombox by James Vasile at Elevate in Gratz
2011</a
> (Youtube)
</li
>
9306 <li
><a href=
"http://www.youtube.com/watch?v=zQTmnk27g9s
"> Freedombox -
9307 Discovery, Identity, and Trust by Nick Daly at Freedombox Hackfest New
9308 York City in
2012</a
> (Youtube)
</li
>
9310 <li
><a href=
"http://www.youtube.com/watch?v=tkbSB4Ba7Ck
">Introduction
9311 to the Freedombox at Freedombox Hackfest New York City in
2012</a
>
9312 (Youtube)
</li
>
9314 <li
><a href=
"http://www.youtube.com/watch?v=z-P2Jaeg0aQ
">Freedom, Out
9315 of the Box! by Bdale Garbee at linux.conf.au Ballarat,
2012</a
> (Youtube)
</li
>
9317 <li
><a href=
"https://archive.fosdem.org/
2013/schedule/event/freedombox/
">Freedombox
9318 1.0 by Eben Moglen and Bdale Garbee at Fosdem
2013</a
> (FOSDEM)
</li
>
9320 <li
><a href=
"http://www.youtube.com/watch?v=e1LpYX2zVYg
">What is the
9321 FreedomBox today by Bdale Garbee at Debconf13 in Vaumarcus
9322 2013</a
> (Youtube)
</li
>
9326 <p
>A larger list is available from
9327 <a href=
"https://wiki.debian.org/FreedomBox/TalksAndPresentations
">the
9328 Freedombox Wiki
</a
>.
</p
>
9330 <p
>On other news, I am happy to report that Freedombox based on Debian
9331 Jessie is coming along quite well, and soon both Owncloud and using
9332 Tor should be available for testers of the Freedombox solution. :) In
9333 a few weeks I hope everything needed to test it is included in Debian.
9334 The withsqlite package is already in Debian, and the plinth package is
9335 pending in NEW. The third and vital part of that puzzle is the
9336 metapackage/setup framework, which is still pending an upload. Join
9337 us on
<a href=
"irc://irc.debian.org:
6667/%
23freedombox
">IRC
9338 (#freedombox on irc.debian.org)
</a
> and
9339 <a href=
"http://lists.alioth.debian.org/mailman/listinfo/freedombox-discuss
">the
9340 mailing list
</a
> if you want to help make this vision come true.
</p
>
9345 <title>Recipe to test the Freedombox project on amd64 or Raspberry Pi
</title>
9346 <link>http://www.hungry.com/~pere/blog/Recipe_to_test_the_Freedombox_project_on_amd64_or_Raspberry_Pi.html
</link>
9347 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Recipe_to_test_the_Freedombox_project_on_amd64_or_Raspberry_Pi.html
</guid>
9348 <pubDate>Tue,
10 Sep
2013 14:
20:
00 +
0200</pubDate>
9349 <description><p
>I was introduced to the
9350 <a href=
"http://www.freedomboxfoundation.org/
">Freedombox project
</a
>
9351 in
2010, when Eben Moglen presented his vision about serving the need
9352 of non-technical people to keep their personal information private and
9353 within the legal protection of their own homes. The idea is to give
9354 people back the power over their network and machines, and return
9355 Internet back to its intended peer-to-peer architecture. Instead of
9356 depending on a central service, the Freedombox will give everyone
9357 control over their own basic infrastructure.
</p
>
9359 <p
>I
've intended to join the effort since then, but other tasks have
9360 taken priority. But this summers nasty news about the misuse of trust
9361 and privilege exercised by the
"western
" intelligence gathering
9362 communities increased my eagerness to contribute to a point where I
9363 actually started working on the project a while back.
</p
>
9365 <p
>The
<a href=
"https://alioth.debian.org/projects/freedombox/
">initial
9366 Debian initiative
</a
> based on the vision from Eben Moglen, is to
9367 create a simple and cheap Debian based appliance that anyone can hook
9368 up in their home and get access to secure and private services and
9369 communication. The initial deployment platform have been the
9370 <a href=
"http://www.globalscaletechnologies.com/t-dreamplugdetails.aspx
">Dreamplug
</a
>,
9371 which is a piece of hardware I do not own. So to be able to test what
9372 the current Freedombox setup look like, I had to come up with a way to install
9373 it on some hardware I do have access to. I have rewritten the
9374 <a href=
"https://github.com/NickDaly/freedom-maker
">freedom-maker
</a
>
9375 image build framework to use .deb packages instead of only copying
9376 setup into the boot images, and thanks to this rewrite I am able to
9377 set up any machine supported by Debian Wheezy as a Freedombox, using
9378 the previously mentioned deb (and a few support debs for packages
9379 missing in Debian).
</p
>
9381 <p
>The current Freedombox setup consist of a set of bootstrapping
9383 (
<a href=
"https://github.com/petterreinholdtsen/freedombox-setup
">freedombox-setup
</a
>),
9384 and a administrative web interface
9385 (
<a href=
"https://github.com/NickDaly/Plinth
">plinth
</a
> + exmachina +
9386 withsqlite), as well as a privacy enhancing proxy based on
9387 <a href=
"http://packages.qa.debian.org/privoxy
">privoxy
</a
>
9388 (freedombox-privoxy). There is also a web/javascript based XMPP
9389 client (
<a href=
"http://packages.qa.debian.org/jwchat
">jwchat
</a
>)
9390 trying (unsuccessfully so far) to talk to the XMPP server
9391 (
<a href=
"http://packages.qa.debian.org/ejabberd
">ejabberd
</a
>). The
9392 web interface is pluggable, and the goal is to use it to enable OpenID
9393 services, mesh network connectivity, use of TOR, etc, etc. Not much of
9394 this is really working yet, see
9395 <a href=
"https://github.com/NickDaly/freedombox-todos/blob/master/TODO
">the
9396 project TODO
</a
> for links to GIT repositories. Most of the code is
9397 on github at the moment. The HTTP proxy is operational out of the
9398 box, and the admin web interface can be used to add/remove plinth
9399 users. I
've not been able to do anything else with it so far, but
9400 know there are several branches spread around github and other places
9401 with lots of half baked features.
</p
>
9403 <p
>Anyway, if you want to have a look at the current state, the
9404 following recipes should work to give you a test machine to poke
9407 <p
><strong
>Debian Wheezy amd64
</strong
></p
>
9411 <li
>Fetch normal Debian Wheezy installation ISO.
</li
>
9412 <li
>Boot from it, either as CD or USB stick.
</li
>
9413 <li
><p
>Press [tab] on the boot prompt and add this as a boot argument
9414 to the Debian installer:
<p
>
9415 <pre
>url=
<a href=
"http://www.reinholdtsen.name/freedombox/preseed-wheezy.dat
">http://www.reinholdtsen.name/freedombox/preseed-wheezy.dat
</a
></pre
></li
>
9417 <li
>Answer the few language/region/password questions and pick disk to
9418 install on.
</li
>
9420 <li
>When the installation is finished and the machine have rebooted a
9421 few times, your Freedombox is ready for testing.
</li
>
9425 <p
><strong
>Raspberry Pi Raspbian
</strong
></p
>
9429 <li
>Fetch a Raspbian SD card image, create SD card.
</li
>
9430 <li
>Boot from SD card, extend file system to fill the card completely.
</li
>
9431 <li
><p
>Log in and add this to /etc/sources.list:
</p
>
9433 deb
<a href=
"http://www.reinholdtsen.name/freedombox/
">http://www.reinholdtsen.name/freedombox
</a
> wheezy main
9434 </pre
></li
>
9435 <li
><p
>Run this as root:
</p
>
9437 wget -O - http://www.reinholdtsen.name/freedombox/BE1A583D.asc | \
9440 apt-get install freedombox-setup
9441 /usr/lib/freedombox/setup
9442 </pre
></li
>
9443 <li
>Reboot into your freshly created Freedombox.
</li
>
9447 <p
>You can test it on other architectures too, but because the
9448 freedombox-privoxy package is binary, it will only work as intended on
9449 the architectures where I have had time to build the binary and put it
9450 in my APT repository. But do not let this stop you. It is only a
9451 short
"<tt
>apt-get source -b freedombox-privoxy
</tt
>" away. :)
</p
>
9453 <p
>Note that by default Freedombox is a DHCP server on the
9454 192.168.1.0/
24 subnet, so if this is your subnet be careful and turn
9455 off the DHCP server by running
"<tt
>update-rc.d isc-dhcp-server
9456 disable
</tt
>" as root.
</p
>
9458 <p
>Please let me know if this works for you, or if you have any
9459 problems. We gather on the IRC channel
9460 <a href=
"irc://irc.debian.org:
6667/%
23freedombox
">#freedombox
</a
> on
9461 irc.debian.org and the
9462 <a href=
"http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/freedombox-discuss
">project
9463 mailing list
</a
>.
</p
>
9465 <p
>Once you get your freedombox operational, you can visit
9466 <tt
>http://your-host-name:
8001/
</tt
> to see the state of the plint
9467 welcome screen (dead end - do not be surprised if you are unable to
9468 get past it), and next visit
<tt
>http://your-host-name:
8001/help/
</tt
>
9469 to look at the rest of plinth. The default user is
'admin
' and the
9470 default password is
'secret
'.
</p
>
9475 <title>Intel
180 SSD disk with Lenovo firmware can not use Intel firmware
</title>
9476 <link>http://www.hungry.com/~pere/blog/Intel_180_SSD_disk_with_Lenovo_firmware_can_not_use_Intel_firmware.html
</link>
9477 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Intel_180_SSD_disk_with_Lenovo_firmware_can_not_use_Intel_firmware.html
</guid>
9478 <pubDate>Sun,
18 Aug
2013 14:
00:
00 +
0200</pubDate>
9479 <description><p
>Earlier, I reported about
9480 <a href=
"http://www.hungry.com/~pere/blog/How_to_fix_a_Thinkpad_X230_with_a_broken_180_GB_SSD_disk.html
">my
9481 problems using an Intel SSD
520 Series
180 GB disk
</a
>. Friday I was
9482 told by IBM that the original disk should be thrown away. And as
9483 there no longer was a problem if I bricked the firmware, I decided
9484 today to try to install Intel firmware to replace the Lenovo firmware
9485 currently on the disk.
</p
>
9487 <p
>I searched the Intel site for firmware, and found
9488 <a href=
"https://downloadcenter.intel.com/Detail_Desc.aspx?agr=Y
&ProdId=
3472&DwnldID=
18363&ProductFamily=Solid-State+Drives+and+Caching
&ProductLine=Intel%c2%ae+High+Performance+Solid-State+Drive
&ProductProduct=Intel%c2%ae+SSD+
520+Series+(
180GB%
2c+
2.5in+SATA+
6Gb%
2fs%
2c+
25nm%
2c+MLC)
&lang=eng
">issdfut_2.0
.4.iso
</a
>
9489 (aka Intel SATA Solid-State Drive Firmware Update Tool) which
9490 according to the site should contain the latest firmware for SSD
9491 disks. I inserted the broken disk in one of my spare laptops and
9492 booted the ISO from a USB stick. The disk was recognized, but the
9493 program claimed the newest firmware already were installed and refused
9494 to insert any Intel firmware. So no change, and the disk is still
9495 unable to handle write load. :( I guess the only way to get them
9496 working would be if Lenovo releases new firmware. No idea how likely
9497 that is. Anyway, just blogging about this test for completeness. I
9498 got a working Samsung disk, and see no point in spending more time on
9499 the broken disks.
</p
>
9504 <title>How to fix a Thinkpad X230 with a broken
180 GB SSD disk
</title>
9505 <link>http://www.hungry.com/~pere/blog/How_to_fix_a_Thinkpad_X230_with_a_broken_180_GB_SSD_disk.html
</link>
9506 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_fix_a_Thinkpad_X230_with_a_broken_180_GB_SSD_disk.html
</guid>
9507 <pubDate>Wed,
17 Jul
2013 23:
50:
00 +
0200</pubDate>
9508 <description><p
>Today I switched to
9509 <a href=
"http://www.hungry.com/~pere/blog/The_Thinkpad_is_dead__long_live_the_Thinkpad_X230_.html
">my
9510 new laptop
</a
>. I
've previously written about the problems I had with
9511 my new Thinkpad X230, which was delivered with an
9512 <a href=
"http://www.hungry.com/~pere/blog/Intel_SSD_520_Series_180_GB_with_Lenovo_firmware_still_lock_up_from_sustained_writes.html
">180
9513 GB Intel SSD disk with Lenovo firmware
</a
> that did not handle
9514 sustained writes. My hardware supplier have been very forthcoming in
9515 trying to find a solution, and after first trying with another
9516 identical
180 GB disks they decided to send me a
256 GB Samsung SSD
9517 disk instead to fix it once and for all. The Samsung disk survived
9518 the installation of Debian with encrypted disks (filling the disk with
9519 random data during installation killed the first two), and I thus
9520 decided to trust it with my data. I have installed it as a Debian Edu
9521 Wheezy roaming workstation hooked up with my Debian Edu Squeeze main
9522 server at home using Kerberos and LDAP, and will use it as my work
9523 station from now on.
</p
>
9525 <p
>As this is a solid state disk with no moving parts, I believe the
9526 Debian Wheezy default installation need to be tuned a bit to increase
9527 performance and increase life time of the disk. The Linux kernel and
9528 user space applications do not yet adjust automatically to such
9529 environment. To make it easier for my self, I created a draft Debian
9530 package
<tt
>ssd-setup
</tt
> to handle this tuning. The
9531 <a href=
"http://anonscm.debian.org/gitweb/?p=collab-maint/ssd-setup.git
">source
9532 for the ssd-setup package
</a
> is available from collab-maint, and it
9533 is set up to adjust the setup of the machine by just installing the
9534 package. If there is any non-SSD disk in the machine, the package
9535 will refuse to install, as I did not try to write any logic to sort
9536 file systems in SSD and non-SSD file systems.
</p
>
9538 <p
>I consider the package a draft, as I am a bit unsure how to best
9539 set up Debian Wheezy with an SSD. It is adjusted to my use case,
9540 where I set up the machine with one large encrypted partition (in
9541 addition to /boot), put LVM on top of this and set up partitions on
9542 top of this again. See the README file in the package source for the
9543 references I used to pick the settings. At the moment these
9544 parameters are tuned:
</p
>
9548 <li
>Set up cryptsetup to pass TRIM commands to the physical disk
9549 (adding discard to /etc/crypttab)
</li
>
9551 <li
>Set up LVM to pass on TRIM commands to the underlying device (in
9552 this case a cryptsetup partition) by changing issue_discards from
9553 0 to
1 in /etc/lvm/lvm.conf.
</li
>
9555 <li
>Set relatime as a file system option for ext3 and ext4 file
9558 <li
>Tell swap to use TRIM commands by adding
'discard
' to
9559 /etc/fstab.
</li
>
9561 <li
>Change I/O scheduler from cfq to deadline using a udev rule.
</li
>
9563 <li
>Run fstrim on every ext3 and ext4 file system every night (from
9564 cron.daily).
</li
>
9566 <li
>Adjust sysctl values vm.swappiness to
1 and vm.vfs_cache_pressure
9567 to
50 to reduce the kernel eagerness to swap out processes.
</li
>
9571 <p
>During installation, I cancelled the part where the installer fill
9572 the disk with random data, as this would kill the SSD performance for
9573 little gain. My goal with the encrypted file system is to ensure
9574 those stealing my laptop end up with a brick and not a working
9575 computer. I have no hope in keeping the really resourceful people
9576 from getting the data on the disk (see
9577 <a href=
"http://xkcd.com/
538/
">XKCD #
538</a
> for an explanation why).
9578 Thus I concluded that adding the discard option to crypttab is the
9579 right thing to do.
</p
>
9581 <p
>I considered using the noop I/O scheduler, as several recommended
9582 it for SSD, but others recommended deadline and a benchmark I found
9583 indicated that deadline might be better for interactive use.
</p
>
9585 <p
>I also considered using the
'discard
' file system option for ext3
9586 and ext4, but read that it would give a performance hit ever time a
9587 file is removed, and thought it best to that that slowdown once a day
9588 instead of during my work.
</p
>
9590 <p
>My package do not set up tmpfs on /var/run, /var/lock and /tmp, as
9591 this is already done by Debian Edu.
</p
>
9593 <p
>I have not yet started on the user space tuning. I expect
9594 iceweasel need some tuning, and perhaps other applications too, but
9595 have not yet had time to investigate those parts.
</p
>
9597 <p
>The package should work on Ubuntu too, but I have not yet tested it
9600 <p
>As for the answer to the question in the title of this blog post,
9601 as far as I know, the only solution I know about is to replace the
9602 disk. It might be possible to flash it with Intel firmware instead of
9603 the Lenovo firmware. But I have not tried and did not want to do so
9604 without approval from Lenovo as I wanted to keep the warranty on the
9605 disk until a solution was found and they wanted the broken disks
9611 <title>Intel SSD
520 Series
180 GB with Lenovo firmware still lock up from sustained writes
</title>
9612 <link>http://www.hungry.com/~pere/blog/Intel_SSD_520_Series_180_GB_with_Lenovo_firmware_still_lock_up_from_sustained_writes.html
</link>
9613 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Intel_SSD_520_Series_180_GB_with_Lenovo_firmware_still_lock_up_from_sustained_writes.html
</guid>
9614 <pubDate>Wed,
10 Jul
2013 13:
30:
00 +
0200</pubDate>
9615 <description><p
>A few days ago, I wrote about
9616 <a href=
"http://www.hungry.com/~pere/blog/The_Thinkpad_is_dead__long_live_the_Thinkpad_X230_.html
">the
9617 problems I experienced with my new X230 and its SSD disk
</a
>, which
9618 was dying during installation because it is unable to cope with
9619 sustained write. My supplier is in contact with
9620 <a href=
"http://www.lenovo.com/
">Lenovo
</a
>, and they wanted to send a
9621 replacement disk to try to fix the problem. They decided to send an
9622 identical model, so my hopes for a permanent fix was slim.
</p
>
9624 <p
>Anyway, today I got the replacement disk and tried to install
9625 Debian Edu Wheezy with encrypted disk on it. The new disk have the
9626 same firmware version as the original. This time my hope raised
9627 slightly as the installation progressed, as the original disk used to
9628 die after
4-
7% of the disk was written to, while this time it kept
9629 going past
10%,
20%,
40% and even past
50%. But around
60%, the disk
9630 died again and I was back on square one. I still do not have a new
9631 laptop with a disk I can trust. I can not live with a disk that might
9632 lock up when I download a new
9633 <a href=
"http://www.skolelinux.org/
">Debian Edu / Skolelinux
</a
> ISO or
9634 other large files. I look forward to hearing from my supplier with
9635 the next proposal from Lenovo.
</p
>
9637 <p
>The original disk is marked Intel SSD
520 Series
180 GB,
9638 11S0C38722Z1ZNME35X1TR, ISN: CVCV321407HB180EGN, SA: G57560302, FW:
9639 LF1i,
29MAY2013, PBA: G39779-
300, LBA
351,
651,
888, LI P/N:
0C38722,
9640 Pb-free
2LI, LC P/N:
16-
200366, WWN:
55CD2E40002756C4, Model:
9641 SSDSC2BW180A3L
2.5" 6Gb/s SATA SSD
180G
5V
1A, ASM P/N
0C38732, FRU
9642 P/N
45N8295, P0C38732.
</p
>
9644 <p
>The replacement disk is marked Intel SSD
520 Series
180 GB,
9645 11S0C38722Z1ZNDE34N0L0, ISN: CVCV315306RK180EGN, SA: G57560-
302, FW:
9646 LF1i,
22APR2013, PBA: G39779-
300, LBA
351,
651,
888, LI P/N:
0C38722,
9647 Pb-free
2LI, LC P/N:
16-
200366, WWN:
55CD2E40000AB69E, Model:
9648 SSDSC2BW180A3L
2.5" 6Gb/s SATA SSD
180G
5V
1A, ASM P/N
0C38732, FRU
9649 P/N
45N8295, P0C38732.
</p
>
9651 <p
>The only difference is in the first number (serial number?), ISN,
9652 SA, date and WNPP values. Mentioning all the details here in case
9653 someone is able to use the information to find a way to identify the
9654 failing disk among working ones (if any such working disk actually
9660 <title>July
13th: Debian/Ubuntu BSP and Skolelinux/Debian Edu developer gathering in Oslo
</title>
9661 <link>http://www.hungry.com/~pere/blog/July_13th__Debian_Ubuntu_BSP_and_Skolelinux_Debian_Edu_developer_gathering_in_Oslo.html
</link>
9662 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/July_13th__Debian_Ubuntu_BSP_and_Skolelinux_Debian_Edu_developer_gathering_in_Oslo.html
</guid>
9663 <pubDate>Tue,
9 Jul
2013 10:
40:
00 +
0200</pubDate>
9664 <description><p
>The upcoming Saturday,
2013-
07-
13, we are organising a combined
9665 Debian Edu developer gathering and Debian and Ubuntu bug squashing
9666 party in Oslo. It is organised by
<a href=
"http://www.nuug.no/
">the
9667 member assosiation NUUG
</a
> and
9668 <a href=
"http://www.skolelinux.org/
">the Debian Edu / Skolelinux
9669 project
</a
> together with
<a href=
"http://bitraf.no/
">the hack space
9670 Bitraf
</a
>.
</p
>
9672 <p
>It starts
10:
00 and continue until late evening. Everyone is
9673 welcome, and there is no fee to participate. There is on the other
9674 hand limited space, and only room for
30 people. Please put your name
9675 on
<a href=
"http://wiki.debian.org/BSP/
2013/
07/
13/no/Oslo
">the event
9676 wiki page
</a
> if you plan to join us.
</p
>
9681 <title>The Thinkpad is dead, long live the Thinkpad X230?
</title>
9682 <link>http://www.hungry.com/~pere/blog/The_Thinkpad_is_dead__long_live_the_Thinkpad_X230_.html
</link>
9683 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_Thinkpad_is_dead__long_live_the_Thinkpad_X230_.html
</guid>
9684 <pubDate>Fri,
5 Jul
2013 08:
30:
00 +
0200</pubDate>
9685 <description><p
>Half a year ago, I reported that I had to find a
9686 <a href=
"http://www.hungry.com/~pere/blog/Thank_you_Thinkpad_X41__for_your_long_and_trustworthy_service.html
">replacement
9687 for my trusty old Thinkpad X41
</a
>. Unfortunately I did not have much
9688 time to spend on it, and it took a while to find a model I believe
9689 will do the job, but two days ago the replacement finally arrived. I
9691 <a href=
"http://www.linlap.com/lenovo_thinkpad_x230
">Thinkpad X230
</a
>
9692 with SSD disk (NZDAJMN). I first test installed Debian Edu Wheezy as
9693 a roaming workstation, and it seemed to work flawlessly. But my
9694 second installation with encrypted disk was not as successful. More
9695 on that below.
</p
>
9697 <p
>I had a hard time trying to track down a good laptop, as my most
9698 important requirements (robust and with a good keyboard) are never
9699 listed in the feature list. But I did get good help from the search
9700 feature at
<a href=
"http://www.prisjakt.no/
">Prisjakt
</a
>, which
9701 allowed me to limit the list of interesting laptops based on my other
9702 requirements. A bit surprising that SSD disk are not disks according
9703 to that search interface, so I had to drop specifying the number of
9704 disks from my search parameters. I also asked around among friends to
9705 get their impression on keyboards and robustness.
</p
>
9707 <p
>So the new laptop arrived, and it is quite a lot wider than the
9708 X41. I am not quite convinced about the keyboard, as it is
9709 significantly wider than my old keyboard, and I have to stretch my
9710 hand a lot more to reach the edges. But the key response is fairly
9711 good and the individual key shape is fairly easy to handle, so I hope
9712 I will get used to it. My old X40 was starting to fail, and I really
9713 needed a new laptop now. :)
</p
>
9715 <p
>Turning off the touch pad was simple. All it took was a quick
9716 visit to the BIOS during boot it disable it.
</p
>
9718 <p
>But there is a fatal problem with the laptop. The
180 GB SSD disk
9719 lock up during load. And this happen when installing Debian Wheezy
9720 with encrypted disk, while the disk is being filled with random data.
9721 I also tested to install Ubuntu Raring, and it happen there too if I
9722 reenable the code to fill the disk with random data (it is disabled by
9723 default in Ubuntu). And the bug with is already known. It was
9724 reported to Debian as
<a href=
"http://bugs.debian.org/
691427">BTS
9725 report #
691427 2012-
10-
25</a
> (journal commit I/O error on brand-new
9726 Thinkpad T430s ext4 on lvm on SSD). It is also reported to the Linux
9727 kernel developers as
9728 <a href=
"https://bugzilla.kernel.org/show_bug.cgi?id=
51861">Kernel bugzilla
9729 report #
51861 2012-
12-
20</a
> (Intel SSD
520 stops working under load
9730 (SSDSC2BW180A3L in Lenovo ThinkPad T430s)). It is also reported on the
9731 Lenovo forums, both for
9732 <a href=
"http://forums.lenovo.com/t5/T400-T500-and-newer-T-series/T430s-Intel-SSD-
520-
180GB-issue/m-p/
1070549">T430
9733 2012-
11-
10</a
> and for
9734 <a href=
"http://forums.lenovo.com/t5/X-Series-ThinkPad-Laptops/x230-SATA-errors-with-
180GB-Intel-
520-SSD-under-heavy-write-load/m-p/
1068147">X230
9735 03-
20-
2013</a
>. The problem do not only affect installation. The
9736 reports state that the disk lock up during use if many writes are done
9737 on the disk, so it is much no use to work around the installation
9738 problem and end up with a computer that can lock up at any moment.
9740 <a href=
"https://git.efficios.com/?p=test-ssd.git
">small C program
9741 available
</a
> that will lock up the hard drive after running a few
9742 minutes by writing to a file.
</p
>
9744 <p
>I
've contacted my supplier and asked how to handle this, and after
9745 contacting PCHELP Norway (request
01D1FDP) which handle support
9746 requests for Lenovo, his first suggestion was to upgrade the disk
9747 firmware. Unfortunately there is no newer firmware available from
9748 Lenovo, as my disk already have the most recent one (version LF1i). I
9749 hope to hear more from him today and hope the problem can be
9755 <title>The Thinkpad is dead, long live the Thinkpad X230
</title>
9756 <link>http://www.hungry.com/~pere/blog/The_Thinkpad_is_dead__long_live_the_Thinkpad_X230.html
</link>
9757 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_Thinkpad_is_dead__long_live_the_Thinkpad_X230.html
</guid>
9758 <pubDate>Thu,
4 Jul
2013 09:
20:
00 +
0200</pubDate>
9759 <description><p
>Half a year ago, I reported that I had to find a replacement for my
9760 trusty old Thinkpad X41. Unfortunately I did not have much time to
9761 spend on it, but today the replacement finally arrived. I ended up
9762 picking a
<a href=
"http://www.linlap.com/lenovo_thinkpad_x230
">Thinkpad
9763 X230
</a
> with SSD disk (NZDAJMN). I first test installed Debian Edu
9764 Wheezy as a roaming workstation, and it worked flawlessly. As I write
9765 this, it is installing what I hope will be a more final installation,
9766 with a encrypted hard drive to ensure any dope head stealing it end up
9767 with an expencive door stop.
</p
>
9769 <p
>I had a hard time trying to track down a good laptop, as my most
9770 important requirements (robust and with a good keyboard) are never
9771 listed in the feature list. But I did get good help from the search
9772 feature at
<ahref=
"http://www.prisjakt.no/
">Prisjakt
</a
>, which
9773 allowed me to limit the list of interesting laptops based on my other
9774 requirements. A bit surprising that SSD disk are not disks, so I had
9775 to drop number of disks from my search parameters.
</p
>
9777 <p
>I am not quite convinced about the keyboard, as it is significantly
9778 wider than my old keyboard, and I have to stretch my hand a lot more
9779 to reach the edges. But the key response is fairly good and the
9780 individual key shape is fairly easy to handle, so I hope I will get
9781 used to it. My old X40 was starting to fail, and I really needed a
9782 new laptop now. :)
</p
>
9784 <p
>I look forward to figuring out how to turn off the touch pad.
</p
>
9789 <title>Automatically locate and install required firmware packages on Debian (Isenkram
0.4)
</title>
9790 <link>http://www.hungry.com/~pere/blog/Automatically_locate_and_install_required_firmware_packages_on_Debian__Isenkram_0_4_.html
</link>
9791 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Automatically_locate_and_install_required_firmware_packages_on_Debian__Isenkram_0_4_.html
</guid>
9792 <pubDate>Tue,
25 Jun
2013 11:
50:
00 +
0200</pubDate>
9793 <description><p
>It annoys me when the computer fail to do automatically what it is
9794 perfectly capable of, and I have to do it manually to get things
9795 working. One such task is to find out what firmware packages are
9796 needed to get the hardware on my computer working. Most often this
9797 affect the wifi card, but some times it even affect the RAID
9798 controller or the ethernet card. Today I pushed version
0.4 of the
9799 <a href=
"http://packages.qa.debian.org/isenkram
">Isenkram package
</a
>
9800 including a new script isenkram-autoinstall-firmware handling the
9801 process of asking all the loaded kernel modules what firmware files
9802 they want, find debian packages providing these files and install the
9803 debian packages. Here is a test run on my laptop:
</p
>
9805 <p
><pre
>
9806 # isenkram-autoinstall-firmware
9807 info: kernel drivers requested extra firmware: ipw2200-bss.fw ipw2200-ibss.fw ipw2200-sniffer.fw
9808 info: fetching http://http.debian.net/debian/dists/squeeze/Contents-i386.gz
9809 info: locating packages with the requested firmware files
9810 info: Updating APT sources after adding non-free APT source
9811 info: trying to install firmware-ipw2x00
9814 Preconfiguring packages ...
9815 Selecting previously deselected package firmware-ipw2x00.
9816 (Reading database ...
259727 files and directories currently installed.)
9817 Unpacking firmware-ipw2x00 (from .../firmware-ipw2x00_0.28+squeeze1_all.deb) ...
9818 Setting up firmware-ipw2x00 (
0.28+squeeze1) ...
9820 </pre
></p
>
9822 <p
>When all the requested firmware is present, a simple message is
9823 printed instead:
</p
>
9825 <p
><pre
>
9826 # isenkram-autoinstall-firmware
9827 info: did not find any firmware files requested by loaded kernel modules. exiting
9829 </pre
></p
>
9831 <p
>It could use some polish, but it is already working well and saving
9832 me some time when setting up new machines. :)
</p
>
9834 <p
>So, how does it work? It look at the set of currently loaded
9835 kernel modules, and look up each one of them using modinfo, to find
9836 the firmware files listed in the module meta-information. Next, it
9837 download the Contents file from a nearby APT mirror, and search for
9838 the firmware files in this file to locate the package with the
9839 requested firmware file. If the package is in the non-free section, a
9840 non-free APT source is added and the package is installed using
9841 <tt
>apt-get install
</tt
>. The end result is a slightly better working
9844 <p
>I hope someone find time to implement a more polished version of
9845 this script as part of the hw-detect debian-installer module, to
9846 finally fix
<a href=
"http://bugs.debian.org/
655507">BTS report
9847 #
655507</a
>. There really is no need to insert USB sticks with
9848 firmware during a PXE install when the packages already are available
9849 from the nearby Debian mirror.
</p
>
9854 <title>Fixing the Linux black screen of death on machines with Intel HD video
</title>
9855 <link>http://www.hungry.com/~pere/blog/Fixing_the_Linux_black_screen_of_death_on_machines_with_Intel_HD_video.html
</link>
9856 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Fixing_the_Linux_black_screen_of_death_on_machines_with_Intel_HD_video.html
</guid>
9857 <pubDate>Tue,
11 Jun
2013 11:
00:
00 +
0200</pubDate>
9858 <description><p
>When installing RedHat, Fedora, Debian and Ubuntu on some machines,
9859 the screen just turn black when Linux boot, either during installation
9860 or on first boot from the hard disk. I
've seen it once in a while the
9861 last few years, but only recently understood the cause. I
've seen it
9862 on HP laptops, and on my latest acquaintance the Packard Bell laptop.
9863 The reason seem to be in the wiring of some laptops. The system to
9864 control the screen background light is inverted, so when Linux try to
9865 turn the brightness fully on, it end up turning it off instead. I do
9866 not know which Linux drivers are affected, but this post is about the
9867 i915 driver used by the
9868 <a href=
"http://www.linlap.com/packard_bell_easynote_lv
">Packard Bell
9869 EasyNote LV
</a
>, Thinkpad X40 and many other laptops.
</p
>
9871 <p
>The problem can be worked around two ways. Either by adding
9872 i915.invert_brightness=
1 as a kernel option, or by adding a file in
9873 /etc/modprobe.d/ to tell modprobe to add the invert_brightness=
1
9874 option when it load the i915 kernel module. On Debian and Ubuntu, it
9875 can be done by running these commands as root:
</p
>
9878 echo options i915 invert_brightness=
1 | tee /etc/modprobe.d/i915.conf
9879 update-initramfs -u -k all
9882 <p
>Since March
2012 there is
9883 <a href=
"http://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=
4dca20efb1a9c2efefc28ad2867e5d6c3f5e1955
">a
9884 mechanism in the Linux kernel
</a
> to tell the i915 driver which
9885 hardware have this problem, and get the driver to invert the
9886 brightness setting automatically. To use it, one need to add a row in
9887 <a href=
"http://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/tree/drivers/gpu/drm/i915/intel_display.c
">the
9888 intel_quirks array
</a
> in the driver source
9889 <tt
>drivers/gpu/drm/i915/intel_display.c
</tt
> (look for
"<tt
>static
9890 struct intel_quirk intel_quirks
</tt
>"), specifying the PCI device
9891 number (vendor number
8086 is assumed) and subdevice vendor and device
9894 <p
>My Packard Bell EasyNote LV got this output from
<tt
>lspci
9895 -vvnn
</tt
> for the video card in question:
</p
>
9897 <p
><pre
>
9898 00:
02.0 VGA compatible controller [
0300]: Intel Corporation \
9899 3rd Gen Core processor Graphics Controller [
8086:
0156] \
9900 (rev
09) (prog-if
00 [VGA controller])
9901 Subsystem: Acer Incorporated [ALI] Device [
1025:
0688]
9902 Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- \
9903 ParErr- Stepping- SE RR- FastB2B- DisINTx+
9904 Status: Cap+
66MHz- UDF- FastB2B+ ParErr- DEVSEL=fast
>TAbort- \
9905 <TAbort-
<MAbort-
>SERR-
<PERR- INTx-
9907 Interrupt: pin A routed to IRQ
42
9908 Region
0: Memory at c2000000 (
64-bit, non-prefetchable) [size=
4M]
9909 Region
2: Memory at b0000000 (
64-bit, prefetchable) [size=
256M]
9910 Region
4: I/O ports at
4000 [size=
64]
9911 Expansion ROM at
<unassigned
> [disabled]
9912 Capabilities:
<access denied
>
9913 Kernel driver in use: i915
9914 </pre
></p
>
9916 <p
>The resulting intel_quirks entry would then look like this:
</p
>
9918 <p
><pre
>
9919 struct intel_quirk intel_quirks[] = {
9921 /* Packard Bell EasyNote LV11HC needs invert brightness quirk */
9922 {
0x0156,
0x1025,
0x0688, quirk_invert_brightness },
9925 </pre
></p
>
9927 <p
>According to the kernel module instructions (as seen using
9928 <tt
>modinfo i915
</tt
>), information about hardware needing the
9929 invert_brightness flag should be sent to the
9930 <a href=
"http://lists.freedesktop.org/mailman/listinfo/dri-devel
">dri-devel
9931 (at) lists.freedesktop.org
</a
> mailing list to reach the kernel
9932 developers. But my email about the laptop sent
2013-
06-
03 have not
9934 <a href=
"http://lists.freedesktop.org/archives/dri-devel/
2013-June/thread.html
">the
9935 web archive for the mailing list
</a
>, so I suspect they do not accept
9936 emails from non-subscribers. Because of this, I sent my patch also to
9937 the Debian bug tracking system instead as
9938 <a href=
"http://bugs.debian.org/
710938">BTS report #
710938</a
>, to make
9939 sure the patch is not lost.
</p
>
9941 <p
>Unfortunately, it is not enough to fix the kernel to get Laptops
9942 with this problem working properly with Linux. If you use Gnome, your
9943 worries should be over at this point. But if you use KDE, there is
9944 something in KDE ignoring the invert_brightness setting and turning on
9945 the screen during login. I
've reported it to Debian as
9946 <a href=
"http://bugs.debian.org/
711237">BTS report #
711237</a
>, and
9947 have no idea yet how to figure out exactly what subsystem is doing
9948 this. Perhaps you can help? Perhaps you know what the Gnome
9949 developers did to handle this, and this can give a clue to the KDE
9950 developers? Or you know where in KDE the screen brightness is changed
9951 during login? If so, please update the BTS report (or get in touch if
9952 you do not know how to update BTS).
</p
>
9954 <p
>Update
2013-
07-
19: The correct fix for this machine seem to be
9955 acpi_backlight=vendor, to disable ACPI backlight support completely,
9956 as the ACPI information on the machine is trash and it is better to
9957 leave it to the intel video driver to control the screen
9958 backlight.
</p
>
9963 <title>How to install Linux on a Packard Bell Easynote LV preinstalled with Windows
8</title>
9964 <link>http://www.hungry.com/~pere/blog/How_to_install_Linux_on_a_Packard_Bell_Easynote_LV_preinstalled_with_Windows_8.html
</link>
9965 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_install_Linux_on_a_Packard_Bell_Easynote_LV_preinstalled_with_Windows_8.html
</guid>
9966 <pubDate>Mon,
27 May
2013 15:
20:
00 +
0200</pubDate>
9967 <description><p
>Two days ago, I asked
9968 <a href=
"http://www.hungry.com/~pere/blog/How_can_I_install_Linux_on_a_Packard_Bell_Easynote_LV_preinstalled_with_Windows_8_.html
">how
9969 I could install Linux on a Packard Bell EasyNote LV computer
9970 preinstalled with Windows
8</a
>. I found a solution, but am horrified
9971 with the obstacles put in the way of Linux users on a laptop with UEFI
9972 and Windows
8.
</p
>
9974 <p
>I never found out if the cause of my problems were the use of UEFI
9975 secure booting or fast boot. I suspect fast boot was the problem,
9976 causing the firmware to boot directly from HD without considering any
9977 key presses and alternative devices, but do not know UEFI settings
9978 enough to tell.
</p
>
9980 <p
>There is no way to install Linux on the machine in question without
9981 opening the box and disconnecting the hard drive! This is as far as I
9982 can tell, the only way to get access to the firmware setup menu
9983 without accepting the Windows
8 license agreement. I am told (and
9984 found description on how to) that it is possible to configure the
9985 firmware setup once booted into Windows
8. But as I believe the terms
9986 of that agreement are completely unacceptable, accepting the license
9987 was never an alternative. I do not enter agreements I do not intend
9988 to follow.
</p
>
9990 <p
>I feared I had to return the laptops and ask for a refund, and
9991 waste many hours on this, but luckily there was a way to get it to
9992 work. But I would not recommend it to anyone planning to run Linux on
9993 it, and I have become sceptical to Windows
8 certified laptops. Is
9994 this the way Linux will be forced out of the market place, by making
9995 it close to impossible for
"normal
" users to install Linux without
9996 accepting the Microsoft Windows license terms? Or at least not
9997 without risking to loose the warranty?
</p
>
9999 <p
>I
've updated the
10000 <a href=
"http://www.linlap.com/packard_bell_easynote_lv
">Linux Laptop
10001 wiki page for Packard Bell EasyNote LV
</a
>, to ensure the next person
10002 do not have to struggle as much as I did to get Linux into the
10005 <p
>Thanks to Bob Rosbag, Florian Weimer, Philipp Kern, Ben Hutching,
10006 Michael Tokarev and others for feedback and ideas.
</p
>
10011 <title>How can I install Linux on a Packard Bell Easynote LV preinstalled with Windows
8?
</title>
10012 <link>http://www.hungry.com/~pere/blog/How_can_I_install_Linux_on_a_Packard_Bell_Easynote_LV_preinstalled_with_Windows_8_.html
</link>
10013 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_can_I_install_Linux_on_a_Packard_Bell_Easynote_LV_preinstalled_with_Windows_8_.html
</guid>
10014 <pubDate>Sat,
25 May
2013 18:
20:
00 +
0200</pubDate>
10015 <description><p
>I
've run into quite a problem the last few days. I bought three
10016 new laptops for my parents and a few others. I bought Packard Bell
10017 Easynote LV to run Kubuntu on and use as their home computer. But I
10018 am completely unable to figure out how to install Linux on it. The
10019 computer is preinstalled with Windows
8, and I suspect it uses UEFI
10020 instead of a BIOS to boot.
</p
>
10022 <p
>The problem is that I am unable to get it to PXE boot, and unable
10023 to get it to boot the Linux installer from my USB stick. I have yet
10024 to try the DVD install, and still hope it will work. when I turn on
10025 the computer, there is no information on what buttons to press to get
10026 the normal boot menu. I expect to get some boot menu to select PXE or
10027 USB stick booting. When booting, it first ask for the language to
10028 use, then for some regional settings, and finally if I will accept the
10029 Windows
8 terms of use. As these terms are completely unacceptable to
10030 me, I have no other choice but to turn off the computer and try again
10031 to get it to boot the Linux installer.
</p
>
10033 <p
>I have gathered my findings so far on a Linlap page about the
10034 <a href=
"http://www.linlap.com/packard_bell_easynote_lv
">Packard Bell
10035 EasyNote LV
</a
> model. If you have any idea how to get Linux
10036 installed on this machine, please get in touch or update that wiki
10037 page. If I can
't find a way to install Linux, I will have to return
10038 the laptop to the seller and find another machine for my parents.
</p
>
10040 <p
>I wonder, is this the way Linux will be forced out of the market
10041 using UEFI and
"secure boot
" by making it impossible to install Linux
10042 on new Laptops?
</p
>
10047 <title>How to transform a Debian based system to a Debian Edu installation
</title>
10048 <link>http://www.hungry.com/~pere/blog/How_to_transform_a_Debian_based_system_to_a_Debian_Edu_installation.html
</link>
10049 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_transform_a_Debian_based_system_to_a_Debian_Edu_installation.html
</guid>
10050 <pubDate>Fri,
17 May
2013 11:
50:
00 +
0200</pubDate>
10051 <description><p
><a href=
"http://www.skolelinux.org/
">Debian Edu / Skolelinux
</a
> is
10052 an operating system based on Debian intended for use in schools. It
10053 contain a turn-key solution for the computer network provided to
10054 pupils in the primary schools. It provide both the central server,
10055 network boot servers and desktop environments with heaps of
10056 educational software. The project was founded almost
12 years ago,
10057 2001-
07-
02. If you want to support the project, which is in need for
10058 cash to fund developer gatherings and other project related activity,
10059 <a href=
"http://www.linuxiskolen.no/slxdebianlabs/donations.html
">please
10060 donate some money
</a
>.
10062 <p
>A topic that come up again and again on the Debian Edu mailing
10063 lists and elsewhere, is the question on how to transform a Debian or
10064 Ubuntu installation into a Debian Edu installation. It isn
't very
10065 hard, and last week I wrote a script to replicate the steps done by
10066 the Debian Edu installer.
</p
>
10068 <p
>The script,
10069 <a href=
"http://anonscm.debian.org/viewvc/debian-edu/branches/wheezy/debian-edu-config/share/debian-edu-config/tools/debian-edu-bless?view=markup
">debian-edu-bless
<a/
>
10070 in the debian-edu-config package, will go through these six steps and
10071 transform an existing Debian Wheezy or Ubuntu (untested) installation
10072 into a Debian Edu Workstation:
</p
>
10076 <li
>Add skolelinux related APT sources.
</li
>
10077 <li
>Create /etc/debian-edu/config with the wanted configuration.
</li
>
10078 <li
>Install debian-edu-install to load preseeding values and pull in
10079 our configuration.
</li
>
10080 <li
>Preseed debconf database with profile setup in
10081 /etc/debian-edu/config, and run tasksel to install packages
10082 according to the profile specified in the config above,
10083 overriding some of the Debian automation machinery.
</li
>
10084 <li
>Run debian-edu-cfengine-D installation to configure everything
10085 that could not be done using preseeding.
</li
>
10086 <li
>Ask for a reboot to enable all the configuration changes.
</li
>
10090 <p
>There are some steps in the Debian Edu installation that can not be
10091 replicated like this. Disk partitioning and LVM setup, for example.
10092 So this script just assume there is enough disk space to install all
10093 the needed packages.
</p
>
10095 <p
>The script was created to help a Debian Edu student working on
10096 setting up
<a href=
"http://www.raspberrypi.org
">Raspberry Pi
</a
> as a
10097 Debian Edu client, and using it he can take the existing
10098 <a href=
"http://www.raspbian.org/FrontPage
">Raspbian
</a
> installation and
10099 transform it into a fully functioning Debian Edu Workstation (or
10100 Roaming Workstation, or whatever :).
</p
>
10102 <p
>The default setting in the script is to create a KDE Workstation.
10103 If a LXDE based Roaming workstation is wanted instead, modify the
10104 PROFILE and DESKTOP values at the top to look like this instead:
</p
>
10106 <p
><pre
>
10107 PROFILE=
"Roaming-Workstation
"
10108 DESKTOP=
"lxde
"
10109 </pre
></p
>
10111 <p
>The script could even become useful to set up Debian Edu servers in
10112 the cloud, by starting with a virtual Debian installation at some
10113 virtual hosting service and setting up all the services on first
10119 <title>Debian, the Linux distribution of choice for LEGO designers?
</title>
10120 <link>http://www.hungry.com/~pere/blog/Debian__the_Linux_distribution_of_choice_for_LEGO_designers_.html
</link>
10121 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian__the_Linux_distribution_of_choice_for_LEGO_designers_.html
</guid>
10122 <pubDate>Sat,
11 May
2013 20:
30:
00 +
0200</pubDate>
10123 <description><P
>In January,
10124 <a href=
"http://www.hungry.com/~pere/blog/New_IRC_channel_for_LEGO_designers_using_Debian.html
">I
10125 announced a
</a
> new
<a href=
"irc://irc.debian.org/%
23debian-lego
">IRC
10126 channel #debian-lego
</a
>, for those of us in the Debian and Linux
10127 community interested in
<a href=
"http://www.lego.com/
">LEGO
</a
>, the
10128 marvellous construction system from Denmark. We also created
10129 <a href=
"http://wiki.debian.org/LegoDesigners
">a wiki page
</a
> to have
10130 a place to take notes and write down our plans and hopes. And several
10131 people showed up to help. I was very happy to see the effect of my
10132 call. Since the small start, we have a debtags tag
10133 <a href=
"http://debtags.debian.net/search/bytag?wl=hardware::hobby:lego
">hardware::hobby:lego
</a
>
10134 tag for LEGO related packages, and now count
10 packages related to
10135 LEGO and
<a href=
"http://mindstorms.lego.com/
">Mindstorms
</a
>:
</p
>
10137 <p
><table
>
10138 <tr
><td
><a href=
"http://packages.qa.debian.org/brickos
">brickos
</a
></td
><td
>alternative OS for LEGO Mindstorms RCX. Supports development in C/C++
</td
></tr
>
10139 <tr
><td
><a href=
"http://packages.qa.debian.org/leocad
">leocad
</a
></td
><td
>virtual brick CAD software
</td
></tr
>
10140 <tr
><td
><a href=
"http://packages.qa.debian.org/libnxt
">libnxt
</a
></td
><td
>utility library for talking to the LEGO Mindstorms NX
</td
></tr
>
10141 <tr
><td
><a href=
"http://packages.qa.debian.org/lnpd
">lnpd
</a
></td
><td
>daemon for LNP communication with BrickOS
</td
></tr
>
10142 <tr
><td
><a href=
"http://packages.qa.debian.org/nbc
">nbc
</a
></td
><td
>compiler for LEGO Mindstorms NXT bricks
</td
></tr
>
10143 <tr
><td
><a href=
"http://packages.qa.debian.org/nqc
">nqc
</a
></td
><td
>Not Quite C compiler for LEGO Mindstorms RCX
</td
></tr
>
10144 <tr
><td
><a href=
"http://packages.qa.debian.org/python-nxt
">python-nxt
</a
></td
><td
>python driver/interface/wrapper for the Lego Mindstorms NXT robot
</td
></tr
>
10145 <tr
><td
><a href=
"http://packages.qa.debian.org/python-nxt-filer
">python-nxt-filer
</a
></td
><td
>simple GUI to manage files on a LEGO Mindstorms NXT
</td
></tr
>
10146 <tr
><td
><a href=
"http://packages.qa.debian.org/scratch
">scratch
</a
></td
><td
>easy to use programming environment for ages
8 and up
</td
></tr
>
10147 <tr
><td
><a href=
"http://packages.qa.debian.org/t2n
">t2n
</a
></td
><td
>simple command-line tool for Lego NXT
</td
></tr
>
10148 </table
></p
>
10150 <p
>Some of these are available in Wheezy, and all but one are
10151 currently available in Jessie/testing. leocad is so far only
10152 available in experimental.
</p
>
10154 <p
>If you care about LEGO in Debian, please join us on IRC and help
10155 adding the rest of the great free software tools available on Linux
10156 for LEGO designers.
</p
>
10161 <title>Debian Wheezy is out - and Debian Edu / Skolelinux should soon follow! #newinwheezy
</title>
10162 <link>http://www.hungry.com/~pere/blog/Debian_Wheezy_is_out___and_Debian_Edu___Skolelinux_should_soon_follow___newinwheezy.html
</link>
10163 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_Wheezy_is_out___and_Debian_Edu___Skolelinux_should_soon_follow___newinwheezy.html
</guid>
10164 <pubDate>Sun,
5 May
2013 07:
40:
00 +
0200</pubDate>
10165 <description><p
>When I woke up this morning, I was very happy to see that the
10166 <a href=
"http://www.debian.org/News/
2013/
20130504">release announcement
10167 for Debian Wheezy
</a
> was waiting in my mail box. This is a great
10168 Debian release, and I expect to move my machines at home over to it fairly
10171 <p
>The new debian release contain heaps of new stuff, and one program
10172 in particular make me very happy to see included. The
10173 <a href=
"http://scratch.mit.edu/
">Scratch
</a
> program, made famous by
10174 the
<a href=
"http://www.code.org/
">Teach kids code
</a
> movement, is
10175 included for the first time. Alongside similar programs like
10176 <a href=
"http://edu.kde.org/kturtle/
">kturtle
</a
> and
10177 <a href=
"http://wiki.sugarlabs.org/go/Activities/Turtle_Art
">turtleart
</a
>,
10178 it allow for visual programming where syntax errors can not happen,
10179 and a friendly programming environment for learning to control the
10180 computer. Scratch will also be included in the next release of Debian
10183 <p
>And now that Wheezy is wrapped up, we can wrap up the next Debian
10184 Edu/Skolelinux release too. The
10185 <a href=
"http://lists.debian.org/debian-edu/
2013/
04/msg00132.html
">first
10186 alpha release
</a
> went out last week, and the next should soon
10192 <title>Isenkram
0.2 finally in the Debian archive
</title>
10193 <link>http://www.hungry.com/~pere/blog/Isenkram_0_2_finally_in_the_Debian_archive.html
</link>
10194 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Isenkram_0_2_finally_in_the_Debian_archive.html
</guid>
10195 <pubDate>Wed,
3 Apr
2013 23:
40:
00 +
0200</pubDate>
10196 <description><p
>Today the
<a href=
"http://packages.qa.debian.org/isenkram
">Isenkram
10197 package
</a
> finally made it into the archive, after lingering in NEW
10198 for many months. I uploaded it to the Debian experimental suite
10199 2013-
01-
27, and today it was accepted into the archive.
</p
>
10201 <p
>Isenkram is a system for suggesting to users what packages to
10202 install to work with a pluggable hardware device. The suggestion pop
10203 up when the device is plugged in. For example if a Lego Mindstorm NXT
10204 is inserted, it will suggest to install the program needed to program
10205 the NXT controller. Give it a go, and report bugs and suggestions to
10211 <title>Bitcoin GUI now available from Debian/unstable (and Ubuntu/raring)
</title>
10212 <link>http://www.hungry.com/~pere/blog/Bitcoin_GUI_now_available_from_Debian_unstable__and_Ubuntu_raring_.html
</link>
10213 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Bitcoin_GUI_now_available_from_Debian_unstable__and_Ubuntu_raring_.html
</guid>
10214 <pubDate>Sat,
2 Feb
2013 09:
00:
00 +
0100</pubDate>
10215 <description><p
>My
10216 <a href=
"http://www.hungry.com/~pere/blog/How_to_backport_bitcoin_qt_version_0_7_2_2_to_Debian_Squeeze.html
">last
10217 bitcoin related blog post
</a
> mentioned that the new
10218 <a href=
"http://packages.qa.debian.org/bitcoin
">bitcoin package
</a
> for
10219 Debian was waiting in NEW. It was accepted by the Debian ftp-masters
10220 2013-
01-
19, and have been available in unstable since then. It was
10221 automatically copied to Ubuntu, and is available in their Raring
10222 version too.
</p
>
10224 <p
>But there is a strange problem with the build that block this new
10225 version from being available on the i386 and kfreebsd-i386
10226 architectures. For some strange reason, the autobuilders in Debian
10227 for these architectures fail to run the test suite on these
10228 architectures (
<a href=
"http://bugs.debian.org/
672524">BTS #
672524</a
>).
10229 We are so far unable to reproduce it when building it manually, and
10230 no-one have been able to propose a fix. If you got an idea what is
10231 failing, please let us know via the BTS.
</p
>
10233 <p
>One feature that is annoying me with of the bitcoin client, because
10234 I often run low on disk space, is the fact that the client will exit
10235 if it run short on space (
<a href=
"http://bugs.debian.org/
696715">BTS
10236 #
696715</a
>). So make sure you have enough disk space when you run
10239 <p
>As usual, if you use bitcoin and want to show your support of my
10240 activities, please send Bitcoin donations to my address
10241 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
10246 <title>Welcome to the world, Isenkram!
</title>
10247 <link>http://www.hungry.com/~pere/blog/Welcome_to_the_world__Isenkram_.html
</link>
10248 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Welcome_to_the_world__Isenkram_.html
</guid>
10249 <pubDate>Tue,
22 Jan
2013 22:
00:
00 +
0100</pubDate>
10250 <description><p
>Yesterday, I
10251 <a href=
"http://www.hungry.com/~pere/blog/First_prototype_ready_making_hardware_easier_to_use_in_Debian.html
">asked
10252 for testers
</a
> for my prototype for making Debian better at handling
10253 pluggable hardware devices, which I
10254 <a href=
"http://www.hungry.com/~pere/blog/Lets_make_hardware_dongles_easier_to_use_in_Debian.html
">set
10255 out to create
</a
> earlier this month. Several valuable testers showed
10256 up, and caused me to really want to to open up the development to more
10257 people. But before I did this, I want to come up with a sensible name
10258 for this project. Today I finally decided on a new name, and I have
10259 renamed the project from hw-support-handler to this new name. In the
10260 process, I moved the source to git and made it available as a
10261 <a href=
"http://anonscm.debian.org/gitweb/?p=collab-maint/isenkram.git
">collab-maint
</a
>
10262 repository in Debian. The new name? It is
<strong
>Isenkram
</strong
>.
10263 To fetch and build the latest version of the source, use
</p
>
10266 git clone http://anonscm.debian.org/git/collab-maint/isenkram.git
10267 cd isenkram
&& git-buildpackage -us -uc
10270 <p
>I have not yet adjusted all files to use the new name yet. If you
10271 want to hack on the source or improve the package, please go ahead.
10272 But please talk to me first on IRC or via email before you do major
10273 changes, to make sure we do not step on each others toes. :)
</p
>
10275 <p
>If you wonder what
'isenkram
' is, it is a Norwegian word for iron
10276 stuff, typically meaning tools, nails, screws, etc. Typical hardware
10277 stuff, in other words. I
've been told it is the Norwegian variant of
10278 the German word eisenkram, for those that are familiar with that
10281 <p
><strong
>Update
2013-
01-
26</strong
>: Added -us -us to build
10282 instructions, to avoid confusing people with an error from the signing
10285 <p
><strong
>Update
2013-
01-
27</strong
>: Switch to HTTP URL for the git
10286 clone argument to avoid the need for authentication.
</p
>
10291 <title>First prototype ready making hardware easier to use in Debian
</title>
10292 <link>http://www.hungry.com/~pere/blog/First_prototype_ready_making_hardware_easier_to_use_in_Debian.html
</link>
10293 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/First_prototype_ready_making_hardware_easier_to_use_in_Debian.html
</guid>
10294 <pubDate>Mon,
21 Jan
2013 12:
00:
00 +
0100</pubDate>
10295 <description><p
>Early this month I set out to try to
10296 <a href=
"http://www.hungry.com/~pere/blog/Lets_make_hardware_dongles_easier_to_use_in_Debian.html
">improve
10297 the Debian support for pluggable hardware devices
</a
>. Now my
10298 prototype is working, and it is ready for a larger audience. To test
10300 <a href=
"http://anonscm.debian.org/viewvc/debian-edu/trunk/src/hw-support-handler/
">source
10301 from the Debian Edu subversion repository
</a
>, build and install the
10302 package. You might have to log out and in again activate the
10303 autostart script.
</p
>
10305 <p
>The design is simple:
</p
>
10309 <li
>Add desktop entry in /usr/share/autostart/ causing a program
10310 hw-support-handlerd to start when the user log in.
</li
>
10312 <li
>This program listen for kernel events about new hardware (directly
10313 from the kernel like udev does), not using HAL dbus events as I
10314 initially did.
</li
>
10316 <li
>When new hardware is inserted, look up the hardware modalias in
10317 the APT database, a database
10318 <a href=
"http://anonscm.debian.org/viewvc/debian-edu/trunk/src/hw-support-handler/modaliases?view=markup
">available
10319 via HTTP
</a
> and a database available as part of the package.
</li
>
10321 <li
>If a package is mapped to the hardware in question, the package
10322 isn
't installed yet and this is the first time the hardware was
10323 plugged in, show a desktop notification suggesting to install the
10324 package or packages.
</li
>
10326 <li
>If the user click on the
'install package now
' button, ask
10327 aptdaemon via the PackageKit API to install the requrired package.
</li
>
10329 <li
>aptdaemon ask for root password or sudo password, and install the
10330 package while showing progress information in a window.
</li
>
10334 <p
>I still need to come up with a better name for the system. Here
10335 are some screen shots showing the prototype in action. First the
10336 notification, then the password request, and finally the request to
10337 approve all the dependencies. Sorry for the Norwegian Bokmål GUI.
</p
>
10339 <p
><img src=
"http://www.hungry.com/~pere/blog/images/
2013-
01-
21-hw-support-
1-notification.png
">
10340 <br
><img src=
"http://www.hungry.com/~pere/blog/images/
2013-
01-
21-hw-support-
2-password.png
">
10341 <br
><img src=
"http://www.hungry.com/~pere/blog/images/
2013-
01-
21-hw-support-
3-dependencies.png
">
10342 <br
><img src=
"http://www.hungry.com/~pere/blog/images/
2013-
01-
21-hw-support-
4-installing.png
">
10343 <br
><img src=
"http://www.hungry.com/~pere/blog/images/
2013-
01-
21-hw-support-
5-installing-details.png
" width=
"70%
"></p
>
10345 <p
>The prototype still need to be improved with longer timeouts, but
10346 is already useful. The database of hardware to package mappings also
10347 need more work. It is currently compatible with the Ubuntu way of
10348 storing such information in the package control file, but could be
10349 changed to use other formats instead or in addition to the current
10350 method. I
've dropped the use of discover for this mapping, as the
10351 modalias approach is more flexible and easier to use on Linux as long
10352 as the Linux kernel expose its modalias strings directly.
</p
>
10354 <p
><strong
>Update
2013-
01-
21 16:
50</strong
>: Due to popular demand,
10355 here is the command required to check out and build the source: Use
10356 '<tt
>svn checkout
10357 svn://svn.debian.org/debian-edu/trunk/src/hw-support-handler/; cd
10358 hw-support-handler; debuild
</tt
>'. If you lack debuild, install the
10359 devscripts package.
</p
>
10361 <p
><strong
>Update
2013-
01-
23 12:
00</strong
>: The project is now
10362 renamed to Isenkram and the source moved from the Debian Edu
10363 subversion repository to a Debian collab-maint git repository. See
10364 <a href=
"http://www.hungry.com/~pere/blog/Welcome_to_the_world__Isenkram_.html
">build
10365 instructions
</a
> for details.
</p
>
10370 <title>Thank you Thinkpad X41, for your long and trustworthy service
</title>
10371 <link>http://www.hungry.com/~pere/blog/Thank_you_Thinkpad_X41__for_your_long_and_trustworthy_service.html
</link>
10372 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Thank_you_Thinkpad_X41__for_your_long_and_trustworthy_service.html
</guid>
10373 <pubDate>Sat,
19 Jan
2013 09:
20:
00 +
0100</pubDate>
10374 <description><p
>This Christmas my trusty old laptop died. It died quietly and
10375 suddenly in bed. With a quiet whimper, it went completely quiet and
10376 black. The power button was no longer able to turn it on. It was a
10377 IBM Thinkpad X41, and the best laptop I ever had. Better than both
10378 Thinkpads X30, X31, X40, X60, X61 and X61S. Far better than the
10379 Compaq I had before that. Now I need to find a replacement. To keep
10380 going during Christmas, I moved the one year old SSD disk to my old
10381 X40 where it fitted (only one I had left that could use it), but it is
10382 not a durable solution.
10384 <p
>My laptop needs are fairly modest. This is my wishlist from when I
10385 got a new one more than
10 years ago. It still holds true.:)
</p
>
10389 <li
>Lightweight (around
1 kg) and small volume (preferably smaller
10390 than A4).
</li
>
10391 <li
>Robust, it will be in my backpack every day.
</li
>
10392 <li
>Three button mouse and a mouse pin instead of touch pad.
</li
>
10393 <li
>Long battery life time. Preferable a week.
</li
>
10394 <li
>Internal WIFI network card.
</li
>
10395 <li
>Internal Twisted Pair network card.
</li
>
10396 <li
>Some USB slots (
2-
3 is plenty)
</li
>
10397 <li
>Good keyboard - similar to the Thinkpad.
</li
>
10398 <li
>Video resolution at least
1024x768, with size around
12" (A4 paper
10400 <li
>Hardware supported by Debian Stable, ie the default kernel and
10401 X.org packages.
</li
>
10402 <li
>Quiet, preferably fan free (or at least not using the fan most of
10407 <p
>You will notice that there are no RAM and CPU requirements in the
10408 list. The reason is simply that the specifications on laptops the
10409 last
10-
15 years have been sufficient for my needs, and I have to look
10410 at other features to choose my laptop. But are there still made as
10411 robust laptops as my X41? The Thinkpad X60/X61 proved to be less
10412 robust, and Thinkpads seem to be heading in the wrong direction since
10413 Lenovo took over. But I
've been told that X220 and X1 Carbon might
10414 still be useful.
</p
>
10416 <p
>Perhaps I should rethink my needs, and look for a pad with an
10417 external keyboard? I
'll have to check the
10418 <a href=
"http://www.linux-laptop.net/
">Linux Laptops site
</a
> for
10419 well-supported laptops, or perhaps just buy one preinstalled from one
10420 of the vendors listed on the
<a href=
"http://linuxpreloaded.com/
">Linux
10421 Pre-loaded site
</a
>.
</p
>
10426 <title>How to find a browser plugin supporting a given MIME type
</title>
10427 <link>http://www.hungry.com/~pere/blog/How_to_find_a_browser_plugin_supporting_a_given_MIME_type.html
</link>
10428 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_find_a_browser_plugin_supporting_a_given_MIME_type.html
</guid>
10429 <pubDate>Fri,
18 Jan
2013 10:
40:
00 +
0100</pubDate>
10430 <description><p
>Some times I try to figure out which Iceweasel browser plugin to
10431 install to get support for a given MIME type. Thanks to
10432 <a href=
"https://wiki.ubuntu.com/MozillaTeam/Plugins
">specifications
10433 done by Ubuntu
</a
> and Mozilla, it is possible to do this in Debian.
10434 Unfortunately, not very many packages provide the needed meta
10435 information, Anyway, here is a small script to look up all browser
10436 plugin packages announcing ther MIME support using this specification:
</p
>
10442 def pkgs_handling_mimetype(mimetype):
10443 cache = apt.Cache()
10447 version = pkg.candidate
10448 if version is None:
10449 version = pkg.installed
10450 if version is None:
10452 record = version.record
10453 if not record.has_key(
'Npp-MimeType
'):
10455 mime_types = record[
'Npp-MimeType
'].split(
',
')
10456 for t in mime_types:
10457 t = t.rstrip().strip()
10459 thepkgs.append(pkg.name)
10461 mimetype =
"audio/ogg
"
10462 if
1 < len(sys.argv):
10463 mimetype = sys.argv[
1]
10464 print
"Browser plugin packages supporting %s:
" % mimetype
10465 for pkg in pkgs_handling_mimetype(mimetype):
10466 print
" %s
" %pkg
10469 <p
>It can be used like this to look up a given MIME type:
</p
>
10472 % ./apt-find-browserplug-for-mimetype
10473 Browser plugin packages supporting audio/ogg:
10475 % ./apt-find-browserplug-for-mimetype application/x-shockwave-flash
10476 Browser plugin packages supporting application/x-shockwave-flash:
10477 browser-plugin-gnash
10481 <p
>In Ubuntu this mechanism is combined with support in the browser
10482 itself to query for plugins and propose to install the needed
10483 packages. It would be great if Debian supported such feature too. Is
10484 anyone working on adding it?
</p
>
10486 <p
><strong
>Update
2013-
01-
18 14:
20</strong
>: The Debian BTS
10487 request for icweasel support for this feature is
10488 <a href=
"http://bugs.debian.org/
484010">#
484010</a
> from
2008 (and
10489 <a href=
"http://bugs.debian.org/
698426">#
698426</a
> from today). Lack
10490 of manpower and wish for a different design is the reason thus feature
10491 is not yet in iceweasel from Debian.
</p
>
10496 <title>What is the most supported MIME type in Debian?
</title>
10497 <link>http://www.hungry.com/~pere/blog/What_is_the_most_supported_MIME_type_in_Debian_.html
</link>
10498 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_is_the_most_supported_MIME_type_in_Debian_.html
</guid>
10499 <pubDate>Wed,
16 Jan
2013 10:
10:
00 +
0100</pubDate>
10500 <description><p
>The
<a href=
"http://wiki.debian.org/AppStreamDebianProposal
">DEP-
11
10501 proposal to add AppStream information to the Debian archive
</a
>, is a
10502 proposal to make it possible for a Desktop application to propose to
10503 the user some package to install to gain support for a given MIME
10504 type, font, library etc. that is currently missing. With such
10505 mechanism in place, it would be possible for the desktop to
10506 automatically propose and install leocad if some LDraw file is
10507 downloaded by the browser.
</p
>
10509 <p
>To get some idea about the current content of the archive, I decided
10510 to write a simple program to extract all .desktop files from the
10511 Debian archive and look up the claimed MIME support there. The result
10512 can be found on the
10513 <a href=
"http://ftp.skolelinux.org/pub/AppStreamTest
">Skolelinux FTP
10514 site
</a
>. Using the collected information, it become possible to
10515 answer the question in the title. Here are the
20 most supported MIME
10516 types in Debian stable (Squeeze), testing (Wheezy) and unstable (Sid).
10517 The complete list is available from the link above.
</p
>
10519 <p
><strong
>Debian Stable:
</strong
></p
>
10523 ----- -----------------------
10537 18 audio/x-musepack
10539 18 application/x-ogg
10546 <p
><strong
>Debian Testing:
</strong
></p
>
10550 ----- -----------------------
10566 18 application/x-ogg
10569 17 audio/x-musepack
10573 <p
><strong
>Debian Unstable:
</strong
></p
>
10577 ----- -----------------------
10594 18 application/x-ogg
10595 17 audio/x-musepack
10600 <p
>I am told that PackageKit can provide an API to access the kind of
10601 information mentioned in DEP-
11. I have not yet had time to look at
10602 it, but hope the PackageKit people in Debian are on top of these
10605 <p
><strong
>Update
2013-
01-
16 13:
35</strong
>: Updated numbers after
10606 discovering a typo in my script.
</p
>
10611 <title>Using modalias info to find packages handling my hardware
</title>
10612 <link>http://www.hungry.com/~pere/blog/Using_modalias_info_to_find_packages_handling_my_hardware.html
</link>
10613 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Using_modalias_info_to_find_packages_handling_my_hardware.html
</guid>
10614 <pubDate>Tue,
15 Jan
2013 08:
00:
00 +
0100</pubDate>
10615 <description><p
>Yesterday, I wrote about the
10616 <a href=
"http://www.hungry.com/~pere/blog/Modalias_strings___a_practical_way_to_map__stuff__to_hardware.html
">modalias
10617 values provided by the Linux kernel
</a
> following my hope for
10618 <a href=
"http://www.hungry.com/~pere/blog/Lets_make_hardware_dongles_easier_to_use_in_Debian.html
">better
10619 dongle support in Debian
</a
>. Using this knowledge, I have tested how
10620 modalias values attached to package names can be used to map packages
10621 to hardware. This allow the system to look up and suggest relevant
10622 packages when I plug in some new hardware into my machine, and replace
10623 discover and discover-data as the database used to map hardware to
10624 packages.
</p
>
10626 <p
>I create a modaliases file with entries like the following,
10627 containing package name, kernel module name (if relevant, otherwise
10628 the package name) and globs matching the relevant hardware
10629 modalias.
</p
>
10631 <p
><blockquote
>
10632 Package: package-name
10633 <br
>Modaliases: module(modaliasglob, modaliasglob, modaliasglob)
</p
>
10634 </blockquote
></p
>
10636 <p
>It is fairly trivial to write code to find the relevant packages
10637 for a given modalias value using this file.
</p
>
10639 <p
>An entry like this would suggest the video and picture application
10640 cheese for many USB web cameras (interface bus class
0E01):
</p
>
10642 <p
><blockquote
>
10644 <br
>Modaliases: cheese(usb:v*p*d*dc*dsc*dp*ic0Eisc01ip*)
</p
>
10645 </blockquote
></p
>
10647 <p
>An entry like this would suggest the pcmciautils package when a
10648 CardBus bridge (bus class
0607) PCI device is present:
</p
>
10650 <p
><blockquote
>
10651 Package: pcmciautils
10652 <br
>Modaliases: pcmciautils(pci:v*d*sv*sd*bc06sc07i*)
10653 </blockquote
></p
>
10655 <p
>An entry like this would suggest the package colorhug-client when
10656 plugging in a ColorHug with USB IDs
04D8:F8DA:
</p
>
10658 <p
><blockquote
>
10659 Package: colorhug-client
10660 <br
>Modaliases: colorhug-client(usb:v04D8pF8DAd*)
</p
>
10661 </blockquote
></p
>
10663 <p
>I believe the format is compatible with the format of the Packages
10664 file in the Debian archive. Ubuntu already uses their Packages file
10665 to store their mappings from packages to hardware.
</p
>
10667 <p
>By adding a XB-Modaliases: header in debian/control, any .deb can
10668 announce the hardware it support in a way my prototype understand.
10669 This allow those publishing packages in an APT source outside the
10670 Debian archive as well as those backporting packages to make sure the
10671 hardware mapping are included in the package meta information. I
've
10672 tested such header in the pymissile package, and its modalias mapping
10673 is working as it should with my prototype. It even made it to Ubuntu
10676 <p
>To test if it was possible to look up supported hardware using only
10677 the shell tools available in the Debian installer, I wrote a shell
10678 implementation of the lookup code. The idea is to create files for
10679 each modalias and let the shell do the matching. Please check out and
10681 <a href=
"http://anonscm.debian.org/viewvc/debian-edu/trunk/src/hw-support-handler/hw-support-lookup?view=co
">hw-support-lookup
</a
>
10682 shell script. It run without any extra dependencies and fetch the
10683 hardware mappings from the Debian archive and the subversion
10684 repository where I currently work on my prototype.
</p
>
10686 <p
>When I use it on a machine with a yubikey inserted, it suggest to
10687 install yubikey-personalization:
</p
>
10689 <p
><blockquote
>
10690 % ./hw-support-lookup
10691 <br
>yubikey-personalization
10693 </blockquote
></p
>
10695 <p
>When I run it on my Thinkpad X40 with a PCMCIA/CardBus slot, it
10696 propose to install the pcmciautils package:
</p
>
10698 <p
><blockquote
>
10699 % ./hw-support-lookup
10700 <br
>pcmciautils
10702 </blockquote
></p
>
10704 <p
>If you know of any hardware-package mapping that should be added to
10705 <a href=
"http://anonscm.debian.org/viewvc/debian-edu/trunk/src/hw-support-handler/modaliases?view=co
">my
10706 database
</a
>, please tell me about it.
</p
>
10708 <p
>It could be possible to generate several of the mappings between
10709 packages and hardware. One source would be to look at packages with
10710 kernel modules, ie packages with *.ko files in /lib/modules/, and
10711 extract their modalias information. Another would be to look at
10712 packages with udev rules, ie packages with files in
10713 /lib/udev/rules.d/, and extract their vendor/model information to
10714 generate a modalias matching rule. I have not tested any of these to
10715 see if it work.
</p
>
10717 <p
>If you want to help implementing a system to let us propose what
10718 packages to install when new hardware is plugged into a Debian
10719 machine, please send me an email or talk to me on
10720 <a href=
"irc://irc.debian.org/%
23debian-devel
">#debian-devel
</a
>.
</p
>
10725 <title>Modalias strings - a practical way to map
"stuff
" to hardware
</title>
10726 <link>http://www.hungry.com/~pere/blog/Modalias_strings___a_practical_way_to_map__stuff__to_hardware.html
</link>
10727 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Modalias_strings___a_practical_way_to_map__stuff__to_hardware.html
</guid>
10728 <pubDate>Mon,
14 Jan
2013 11:
20:
00 +
0100</pubDate>
10729 <description><p
>While looking into how to look up Debian packages based on hardware
10730 information, to find the packages that support a given piece of
10731 hardware, I refreshed my memory regarding modalias values, and decided
10732 to document the details. Here are my findings so far, also available
10734 <a href=
"http://anonscm.debian.org/viewvc/debian-edu/trunk/src/hw-support-handler/
">the
10735 Debian Edu subversion repository
</a
>:
10737 <p
><strong
>Modalias decoded
</strong
></p
>
10739 <p
>This document try to explain what the different types of modalias
10740 values stands for. It is in part based on information from
10741 &lt;URL:
<a href=
"https://wiki.archlinux.org/index.php/Modalias
">https://wiki.archlinux.org/index.php/Modalias
</a
> &gt;,
10742 &lt;URL:
<a href=
"http://unix.stackexchange.com/questions/
26132/how-to-assign-usb-driver-to-device
">http://unix.stackexchange.com/questions/
26132/how-to-assign-usb-driver-to-device
</a
> &gt;,
10743 &lt;URL:
<a href=
"http://code.metager.de/source/history/linux/stable/scripts/mod/file2alias.c
">http://code.metager.de/source/history/linux/stable/scripts/mod/file2alias.c
</a
> &gt; and
10744 &lt;URL:
<a href=
"http://cvs.savannah.gnu.org/viewvc/dmidecode/dmidecode.c?root=dmidecode
&view=markup
">http://cvs.savannah.gnu.org/viewvc/dmidecode/dmidecode.c?root=dmidecode
&view=markup
</a
> &gt;.
10746 <p
>The modalias entries for a given Linux machine can be found using
10747 this shell script:
</p
>
10750 find /sys -name modalias -print0 | xargs -
0 cat | sort -u
10753 <p
>The supported modalias globs for a given kernel module can be found
10754 using modinfo:
</p
>
10757 % /sbin/modinfo psmouse | grep alias:
10758 alias: serio:ty05pr*id*ex*
10759 alias: serio:ty01pr*id*ex*
10763 <p
><strong
>PCI subtype
</strong
></p
>
10765 <p
>A typical PCI entry can look like this. This is an Intel Host
10766 Bridge memory controller:
</p
>
10768 <p
><blockquote
>
10769 pci:v00008086d00002770sv00001028sd000001ADbc06sc00i00
10770 </blockquote
></p
>
10772 <p
>This represent these values:
</p
>
10775 v
00008086 (vendor)
10776 d
00002770 (device)
10777 sv
00001028 (subvendor)
10778 sd
000001AD (subdevice)
10780 sc
00 (bus subclass)
10784 <p
>The vendor/device values are the same values outputted from
'lspci
10785 -n
' as
8086:
2770. The bus class/subclass is also shown by lspci as
10786 0600. The
0600 class is a host bridge. Other useful bus values are
10787 0300 (VGA compatible card) and
0200 (Ethernet controller).
</p
>
10789 <p
>Not sure how to figure out the interface value, nor what it
10792 <p
><strong
>USB subtype
</strong
></p
>
10794 <p
>Some typical USB entries can look like this. This is an internal
10795 USB hub in a laptop:
</p
>
10797 <p
><blockquote
>
10798 usb:v1D6Bp0001d0206dc09dsc00dp00ic09isc00ip00
10799 </blockquote
></p
>
10801 <p
>Here is the values included in this alias:
</p
>
10804 v
1D6B (device vendor)
10805 p
0001 (device product)
10807 dc
09 (device class)
10808 dsc
00 (device subclass)
10809 dp
00 (device protocol)
10810 ic
09 (interface class)
10811 isc
00 (interface subclass)
10812 ip
00 (interface protocol)
10815 <p
>The
0900 device class/subclass means hub. Some times the relevant
10816 class is in the interface class section. For a simple USB web camera,
10817 these alias entries show up:
</p
>
10819 <p
><blockquote
>
10820 usb:v0AC8p3420d5000dcEFdsc02dp01ic01isc01ip00
10821 <br
>usb:v0AC8p3420d5000dcEFdsc02dp01ic01isc02ip00
10822 <br
>usb:v0AC8p3420d5000dcEFdsc02dp01ic0Eisc01ip00
10823 <br
>usb:v0AC8p3420d5000dcEFdsc02dp01ic0Eisc02ip00
10824 </blockquote
></p
>
10826 <p
>Interface class
0E01 is video control,
0E02 is video streaming (aka
10827 camera),
0101 is audio control device and
0102 is audio streaming (aka
10828 microphone). Thus this is a camera with microphone included.
</p
>
10830 <p
><strong
>ACPI subtype
</strong
></p
>
10832 <p
>The ACPI type is used for several non-PCI/USB stuff. This is an IR
10833 receiver in a Thinkpad X40:
</p
>
10835 <p
><blockquote
>
10836 acpi:IBM0071:PNP0511:
10837 </blockquote
></p
>
10839 <p
>The values between the colons are IDs.
</p
>
10841 <p
><strong
>DMI subtype
</strong
></p
>
10843 <p
>The DMI table contain lots of information about the computer case
10844 and model. This is an entry for a IBM Thinkpad X40, fetched from
10845 /sys/devices/virtual/dmi/id/modalias:
</p
>
10847 <p
><blockquote
>
10848 dmi:bvnIBM:bvr1UETB6WW(
1.66):bd06/
15/
2005:svnIBM:pn2371H4G:pvrThinkPadX40:rvnIBM:rn2371H4G:rvrNotAvailable:cvnIBM:ct10:cvrNotAvailable:
10849 </blockquote
></p
>
10851 <p
>The values present are
</p
>
10854 bvn IBM (BIOS vendor)
10855 bvr
1UETB
6WW(
1.66) (BIOS version)
10856 bd
06/
15/
2005 (BIOS date)
10857 svn IBM (system vendor)
10858 pn
2371H4G (product name)
10859 pvr ThinkPadX40 (product version)
10860 rvn IBM (board vendor)
10861 rn
2371H4G (board name)
10862 rvr NotAvailable (board version)
10863 cvn IBM (chassis vendor)
10864 ct
10 (chassis type)
10865 cvr NotAvailable (chassis version)
10868 <p
>The chassis type
10 is Notebook. Other interesting values can be
10869 found in the dmidecode source:
</p
>
10873 4 Low Profile Desktop
10886 17 Main Server Chassis
10887 18 Expansion Chassis
10889 20 Bus Expansion Chassis
10890 21 Peripheral Chassis
10892 23 Rack Mount Chassis
10901 <p
>The chassis type values are not always accurately set in the DMI
10902 table. For example my home server is a tower, but the DMI modalias
10903 claim it is a desktop.
</p
>
10905 <p
><strong
>SerIO subtype
</strong
></p
>
10907 <p
>This type is used for PS/
2 mouse plugs. One example is from my
10908 test machine:
</p
>
10910 <p
><blockquote
>
10911 serio:ty01pr00id00ex00
10912 </blockquote
></p
>
10914 <p
>The values present are
</p
>
10923 <p
>This type is supported by the psmouse driver. I am not sure what
10924 the valid values are.
</p
>
10926 <p
><strong
>Other subtypes
</strong
></p
>
10928 <p
>There are heaps of other modalias subtypes according to
10929 file2alias.c. There is the rest of the list from that source: amba,
10930 ap, bcma, ccw, css, eisa, hid, i2c, ieee1394, input, ipack, isapnp,
10931 mdio, of, parisc, pcmcia, platform, scsi, sdio, spi, ssb, vio, virtio,
10932 vmbus, x86cpu and zorro. I did not spend time documenting all of
10933 these, as they do not seem relevant for my intended use with mapping
10934 hardware to packages when new stuff is inserted during run time.
</p
>
10936 <p
><strong
>Looking up kernel modules using modalias values
</strong
></p
>
10938 <p
>To check which kernel modules provide support for a given modalias,
10939 one can use the following shell script:
</p
>
10942 for id in $(find /sys -name modalias -print0 | xargs -
0 cat | sort -u); do \
10943 echo
"$id
" ; \
10944 /sbin/modprobe --show-depends
"$id
"|sed
's/^/ /
' ; \
10948 <p
>The output can look like this (only the first few entries as the
10949 list is very long on my test machine):
</p
>
10953 insmod /lib/modules/
2.6.32-
5-
686/kernel/drivers/acpi/ac.ko
10955 FATAL: Module acpi:device: not found.
10957 insmod /lib/modules/
2.6.32-
5-
686/kernel/drivers/char/nvram.ko
10958 insmod /lib/modules/
2.6.32-
5-
686/kernel/drivers/leds/led-class.ko
10959 insmod /lib/modules/
2.6.32-
5-
686/kernel/net/rfkill/rfkill.ko
10960 insmod /lib/modules/
2.6.32-
5-
686/kernel/drivers/platform/x86/thinkpad_acpi.ko
10961 acpi:IBM0071:PNP0511:
10962 insmod /lib/modules/
2.6.32-
5-
686/kernel/lib/crc-ccitt.ko
10963 insmod /lib/modules/
2.6.32-
5-
686/kernel/net/irda/irda.ko
10964 insmod /lib/modules/
2.6.32-
5-
686/kernel/drivers/net/irda/nsc-ircc.ko
10968 <p
>If you want to help implementing a system to let us propose what
10969 packages to install when new hardware is plugged into a Debian
10970 machine, please send me an email or talk to me on
10971 <a href=
"irc://irc.debian.org/%
23debian-devel
">#debian-devel
</a
>.
</p
>
10973 <p
><strong
>Update
2013-
01-
15:
</strong
> Rewrite
"cat $(find ...)
" to
10974 "find ... -print0 | xargs -
0 cat
" to make sure it handle directories
10975 in /sys/ with space in them.
</p
>
10980 <title>Moved the pymissile Debian packaging to collab-maint
</title>
10981 <link>http://www.hungry.com/~pere/blog/Moved_the_pymissile_Debian_packaging_to_collab_maint.html
</link>
10982 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Moved_the_pymissile_Debian_packaging_to_collab_maint.html
</guid>
10983 <pubDate>Thu,
10 Jan
2013 20:
40:
00 +
0100</pubDate>
10984 <description><p
>As part of my investigation on how to improve the support in Debian
10985 for hardware dongles, I dug up my old Mark and Spencer USB Rocket
10986 Launcher and updated the Debian package
10987 <a href=
"http://packages.qa.debian.org/pymissile
">pymissile
</a
> to make
10988 sure udev will fix the device permissions when it is plugged in. I
10989 also added a
"Modaliases
" header to test it in the Debian archive and
10990 hopefully make the package be proposed by jockey in Ubuntu when a user
10991 plug in his rocket launcher. In the process I moved the source to a
10992 git repository under collab-maint, to make it easier for any DD to
10993 contribute.
<a href=
"http://code.google.com/p/pymissile/
">Upstream
</a
>
10994 is not very active, but the software still work for me even after five
10995 years of relative silence. The new git repository is not listed in
10996 the uploaded package yet, because I want to test the other changes a
10997 bit more before I upload the new version. If you want to check out
10998 the new version with a .desktop file included, visit the
10999 <a href=
"http://anonscm.debian.org/gitweb/?p=collab-maint/pymissile.git
">gitweb
11000 view
</a
> or use
"<tt
>git clone
11001 git://anonscm.debian.org/collab-maint/pymissile.git
</tt
>".
</p
>
11006 <title>Lets make hardware dongles easier to use in Debian
</title>
11007 <link>http://www.hungry.com/~pere/blog/Lets_make_hardware_dongles_easier_to_use_in_Debian.html
</link>
11008 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Lets_make_hardware_dongles_easier_to_use_in_Debian.html
</guid>
11009 <pubDate>Wed,
9 Jan
2013 15:
40:
00 +
0100</pubDate>
11010 <description><p
>One thing that annoys me with Debian and Linux distributions in
11011 general, is that there is a great package management system with the
11012 ability to automatically install software packages by downloading them
11013 from the distribution mirrors, but no way to get it to automatically
11014 install the packages I need to use the hardware I plug into my
11015 machine. Even if the package to use it is easily available from the
11016 Linux distribution. When I plug in a LEGO Mindstorms NXT, it could
11017 suggest to automatically install the python-nxt, nbc and t2n packages
11018 I need to talk to it. When I plug in a Yubikey, it could propose the
11019 yubikey-personalization package. The information required to do this
11020 is available, but no-one have pulled all the pieces together.
</p
>
11022 <p
>Some years ago, I proposed to
11023 <a href=
"http://lists.debian.org/debian-devel/
2010/
05/msg01206.html
">use
11024 the discover subsystem to implement this
</a
>. The idea is fairly
11029 <li
>Add a desktop entry in /usr/share/autostart/ pointing to a program
11030 starting when a user log in.
</li
>
11032 <li
>Set this program up to listen for kernel events emitted when new
11033 hardware is inserted into the computer.
</li
>
11035 <li
>When new hardware is inserted, look up the hardware ID in a
11036 database mapping to packages, and take note of any non-installed
11037 packages.
</li
>
11039 <li
>Show a message to the user proposing to install the discovered
11040 package, and make it easy to install it.
</li
>
11044 <p
>I am not sure what the best way to implement this is, but my
11045 initial idea was to use dbus events to discover new hardware, the
11046 discover database to find packages and
11047 <a href=
"http://www.packagekit.org/
">PackageKit
</a
> to install
11048 packages.
</p
>
11050 <p
>Yesterday, I found time to try to implement this idea, and the
11051 draft package is now checked into
11052 <a href=
"http://anonscm.debian.org/viewvc/debian-edu/trunk/src/hw-support-handler/
">the
11053 Debian Edu subversion repository
</a
>. In the process, I updated the
11054 <a href=
"http://packages.qa.debian.org/d/discover-data.html
">discover-data
</a
>
11055 package to map the USB ids of LEGO Mindstorms and Yubikey devices to
11056 the relevant packages in Debian, and uploaded a new version
11057 2.2013.01.09 to unstable. I also discovered that the current
11058 <a href=
"http://packages.qa.debian.org/d/discover.html
">discover
</a
>
11059 package in Debian no longer discovered any USB devices, because
11060 /proc/bus/usb/devices is no longer present. I ported it to use
11061 libusb as a fall back option to get it working. The fixed package
11062 version
2.1.2-
6 is now in experimental (didn
't upload it to unstable
11063 because of the freeze).
</p
>
11065 <p
>With this prototype in place, I can insert my Yubikey, and get this
11066 desktop notification to show up (only once, the first time it is
11067 inserted):
</p
>
11069 <p align=
"center
"><img src=
"http://www.hungry.com/~pere/blog/images/
2013-
01-
09-hw-autoinstall.png
"></p
>
11071 <p
>For this prototype to be really useful, some way to automatically
11072 install the proposed packages by pressing the
"Please install
11073 program(s)
" button should to be implemented.
</p
>
11075 <p
>If this idea seem useful to you, and you want to help make it
11076 happen, please help me update the discover-data database with mappings
11077 from hardware to Debian packages. Check if
'discover-pkginstall -l
'
11078 list the package you would like to have installed when a given
11079 hardware device is inserted into your computer, and report bugs using
11080 reportbug if it isn
't. Or, if you know of a better way to provide
11081 such mapping, please let me know.
</p
>
11083 <p
>This prototype need more work, and there are several questions that
11084 should be considered before it is ready for production use. Is dbus
11085 the correct way to detect new hardware? At the moment I look for HAL
11086 dbus events on the system bus, because that is the events I could see
11087 on my Debian Squeeze KDE desktop. Are there better events to use?
11088 How should the user be notified? Is the desktop notification
11089 mechanism the best option, or should the background daemon raise a
11090 popup instead? How should packages be installed? When should they
11091 not be installed?
</p
>
11093 <p
>If you want to help getting such feature implemented in Debian,
11094 please send me an email. :)
</p
>
11099 <title>New IRC channel for LEGO designers using Debian
</title>
11100 <link>http://www.hungry.com/~pere/blog/New_IRC_channel_for_LEGO_designers_using_Debian.html
</link>
11101 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_IRC_channel_for_LEGO_designers_using_Debian.html
</guid>
11102 <pubDate>Wed,
2 Jan
2013 15:
40:
00 +
0100</pubDate>
11103 <description><p
>During Christmas, I have worked a bit on the Debian support for
11104 <a href=
"http://mindstorms.lego.com/en-us/Default.aspx
">LEGO Mindstorm
11105 NXT
</a
>. My son and I have played a bit with my NXT set, and I
11106 discovered I had to build all the tools myself because none were
11107 already in Debian Squeeze. If Debian support for LEGO is something
11108 you care about, please join me on the IRC channel
11109 <a href=
"irc://irc.debian.org/%
23debian-lego
">#debian-lego
</a
> (server
11110 irc.debian.org). There is a lot that could be done to improve the
11111 Debian support for LEGO designers. For example both CAD software
11112 and Mindstorm compilers are missing. :)
</p
>
11114 <p
>Update
2012-
01-
03: A
11115 <a href=
"http://wiki.debian.org/LegoDesigners
">project page
</a
>
11116 including links to Lego related packages is now available.
</p
>
11121 <title>How to backport bitcoin-qt version
0.7.2-
2 to Debian Squeeze
</title>
11122 <link>http://www.hungry.com/~pere/blog/How_to_backport_bitcoin_qt_version_0_7_2_2_to_Debian_Squeeze.html
</link>
11123 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_backport_bitcoin_qt_version_0_7_2_2_to_Debian_Squeeze.html
</guid>
11124 <pubDate>Tue,
25 Dec
2012 20:
50:
00 +
0100</pubDate>
11125 <description><p
>Let me start by wishing you all marry Christmas and a happy new
11126 year! I hope next year will prove to be a good year.
</p
>
11128 <p
><a href=
"http://www.bitcoin.org/
">Bitcoin
</a
>, the digital
11129 decentralised
"currency
" that allow people to transfer bitcoins
11130 between each other with minimal overhead, is a very interesting
11131 experiment. And as I wrote a few days ago, the bitcoin situation in
11132 <a href=
"http://www.debian.org/
">Debian
</a
> is about to improve a bit.
11133 The
<a href=
"http://packages.qa.debian.org/bitcoin
">new debian source
11134 package
</a
> (version
0.7.2-
2) was uploaded yesterday, and is waiting
11135 in
<a href=
"http://ftp-master.debian.org/new.html
">the NEW queue
</A
>
11136 for one of the ftpmasters to approve the new bitcoin-qt package
11139 <p
>And thanks to the great work of Jonas and the rest of the bitcoin
11140 team in Debian, you can easily test the package in Debian Squeeze
11141 using the following steps to get a set of working packages:
</p
>
11143 <blockquote
><pre
>
11144 git clone git://git.debian.org/git/collab-maint/bitcoin
11146 DEB_MAINTAINER_MODE=
1 DEB_BUILD_OPTIONS=noupnp fakeroot debian/rules clean
11147 DEB_BUILD_OPTIONS=noupnp git-buildpackage --git-ignore-new
11148 </pre
></blockquote
>
11150 <p
>You might have to install some build dependencies as well. The
11151 list of commands should give you two packages, bitcoind and
11152 bitcoin-qt, ready for use in a Squeeze environment. Note that the
11153 client will download the complete set of bitcoin
"blocks
", which need
11154 around
5.6 GiB of data on my machine at the moment. Make sure your
11155 ~/.bitcoin/ directory have lots of spare room if you want to download
11156 all the blocks. The client will warn if the disk is getting full, so
11157 there is not really a problem if you got too little room, but you will
11158 not be able to get all the features out of the client.
</p
>
11160 <p
>As usual, if you use bitcoin and want to show your support of my
11161 activities, please send Bitcoin donations to my address
11162 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
11167 <title>A word on bitcoin support in Debian
</title>
11168 <link>http://www.hungry.com/~pere/blog/A_word_on_bitcoin_support_in_Debian.html
</link>
11169 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/A_word_on_bitcoin_support_in_Debian.html
</guid>
11170 <pubDate>Fri,
21 Dec
2012 23:
59:
00 +
0100</pubDate>
11171 <description><p
>It has been a while since I wrote about
11172 <a href=
"http://www.bitcoin.org/
">bitcoin
</a
>, the decentralised
11173 peer-to-peer based crypto-currency, and the reason is simply that I
11174 have been busy elsewhere. But two days ago, I started looking at the
11175 state of
<a href=
"http://packages.qa.debian.org/bitcoin
">bitcoin in
11176 Debian
</a
> again to try to recover my old bitcoin wallet. The package
11177 is now maintained by a
11178 <a href=
"https://alioth.debian.org/projects/pkg-bitcoin/
">team of
11179 people
</a
>, and the grunt work had already been done by this team. We
11180 owe a huge thank you to all these team members. :)
11181 But I was sad to discover that the bitcoin client is missing in
11182 Wheezy. It is only available in Sid (and an outdated client from
11183 backports). The client had several RC bugs registered in BTS blocking
11184 it from entering testing. To try to help the team and improve the
11185 situation, I spent some time providing patches and triaging the bug
11186 reports. I also had a look at the bitcoin package available from Matt
11188 <a href=
"https://launchpad.net/~bitcoin/+archive/bitcoin
">PPA for
11189 Ubuntu
</a
>, and moved the useful pieces from that version into the
11190 Debian package.
</p
>
11192 <p
>After checking with the main package maintainer Jonas Smedegaard on
11193 IRC, I pushed several patches into the collab-maint git repository to
11194 improve the package. It now contains fixes for the RC issues (not from
11195 me, but fixed by Scott Howard), build rules for a Qt GUI client
11196 package, konqueror support for the bitcoin: URI and bash completion
11197 setup. As I work on Debian Squeeze, I also created
11198 <a href=
"http://lists.alioth.debian.org/pipermail/pkg-bitcoin-devel/Week-of-Mon-
20121217/
000041.html
">a
11199 patch to backport
</a
> the latest version. Jonas is going to look at
11200 it and try to integrate it into the git repository before uploading a
11201 new version to unstable.
11203 <p
>I would very much like bitcoin to succeed, to get rid of the
11204 centralized control currently exercised in the monetary system. I
11205 find it completely unacceptable that the USA government is collecting
11206 transaction data for almost all international money transfers (most are done in USD and transaction logs shipped to the spooks), and
11207 that the major credit card companies can block legal money
11208 transactions to Wikileaks. But for bitcoin to succeed, more people
11209 need to use bitcoins, and more people need to accept bitcoins when
11210 they sell products and services. Improving the bitcoin support in
11211 Debian is a small step in the right direction, but not enough.
11212 Unfortunately the user experience when browsing the web and wanting to
11213 pay with bitcoin is still not very good. The bitcoin: URI is a step
11214 in the right direction, but need to work in most or every browser in
11215 use. Also the bitcoin-qt client is too heavy to fire up to do a
11216 quick transaction. I believe there are other clients available, but
11217 have not tested them.
</p
>
11220 <a href=
"http://www.hungry.com/~pere/blog/Now_accepting_bitcoins___anonymous_and_distributed_p2p_crypto_money.html
">experiment
11221 with bitcoins
</a
> showed that at least some of my readers use bitcoin.
11222 I received
20.15 BTC so far on the address I provided in my blog two
11223 years ago, as can be
11224 <a href=
"http://blockexplorer.com/address/
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">seen
11225 on the blockexplorer service
</a
>. Thank you everyone for your
11226 donation. The blockexplorer service demonstrates quite well that
11227 bitcoin is not quite anonymous and untracked. :) I wonder if the
11228 number of users have gone up since then. If you use bitcoin and want
11229 to show your support of my activity, please send Bitcoin donations to
11230 the same address as last time,
11231 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
11236 <title>Git repository for song book for Computer Scientists
</title>
11237 <link>http://www.hungry.com/~pere/blog/Git_repository_for_song_book_for_Computer_Scientists.html
</link>
11238 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Git_repository_for_song_book_for_Computer_Scientists.html
</guid>
11239 <pubDate>Fri,
7 Sep
2012 13:
50:
00 +
0200</pubDate>
11240 <description><p
>As I
11241 <a href=
"http://www.hungry.com/~pere/blog/Song_book_for_Computer_Scientists.html
">mentioned
11242 this summer
</a
>, I have created a Computer Science song book a few
11243 years ago, and today I finally found time to create a public
11244 <a href=
"https://gitorious.org/pere-cs-songbook/pere-cs-songbook
">Gitorious
11245 repository for the project
</a
>.
</p
>
11247 <p
>If you want to help out, please clone the source and submit patches
11248 to the HTML version. To generate the PDF and PostScript version,
11249 please use prince XML, or let me know about a useful free software
11250 processor capable of creating a good looking PDF from the HTML.
</p
>
11252 <p
>Want to sing? You can still find the song book in HTML, PDF and
11253 PostScript formats at
11254 <a href=
"http://www.hungry.com/~pere/cs-songbook/
">Petter
's Computer
11255 Science Songbook
</a
>.
</p
>
11260 <title>Gratulerer med
19-årsdagen, Debian!
</title>
11261 <link>http://www.hungry.com/~pere/blog/Gratulerer_med_19__rsdagen__Debian_.html
</link>
11262 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Gratulerer_med_19__rsdagen__Debian_.html
</guid>
11263 <pubDate>Thu,
16 Aug
2012 11:
20:
00 +
0200</pubDate>
11264 <description><p
>I dag fyller
11265 <a href=
"http://www.debian.org/News/
2012/
20120813">Debian-prosjektet
19
11266 år
</a
>. Jeg har fulgt det de siste
12 årene, og er veldig glad for å kunne
11267 si gratulerer med dagen, Debian!
</p
>
11272 <title>Song book for Computer Scientists
</title>
11273 <link>http://www.hungry.com/~pere/blog/Song_book_for_Computer_Scientists.html
</link>
11274 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Song_book_for_Computer_Scientists.html
</guid>
11275 <pubDate>Sun,
24 Jun
2012 13:
30:
00 +
0200</pubDate>
11276 <description><p
>Many years ago, while studying Computer Science at the
11277 <a href=
"http://www.uit.no/
">University of Tromsø
</a
>, I started
11278 collecting computer related songs for use at parties. The original
11279 version was written in LaTeX, but a few years ago I got help from
11280 Håkon W. Lie, one of the inventors of W3C CSS, to convert it to HTML
11281 while keeping the ability to create a nice book in PDF format. I have
11282 not had time to maintain the book for a while now, and guess I should
11283 put it up on some public version control repository where others can
11284 help me extend and update the book. If anyone is volunteering to help
11285 me with this, send me an email. Also let me know if there are songs
11286 missing in my book.
</p
>
11288 <p
>I have not mentioned the book on my blog so far, and it occured to
11289 me today that I really should let all my readers share the joys of
11290 singing out load about programming, computers and computer networks.
11291 Especially now that
<a href=
"http://debconf12.debconf.org/
">Debconf
11292 12</a
> is about to start (and I am not going). Want to sing? Check
11293 out
<a href=
"http://www.hungry.com/~pere/cs-songbook/
">Petter
's
11294 Computer Science Songbook
</a
>.
11299 <title>Automatically upgrading server firmware on Dell PowerEdge
</title>
11300 <link>http://www.hungry.com/~pere/blog/Automatically_upgrading_server_firmware_on_Dell_PowerEdge.html
</link>
11301 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Automatically_upgrading_server_firmware_on_Dell_PowerEdge.html
</guid>
11302 <pubDate>Mon,
21 Nov
2011 12:
00:
00 +
0100</pubDate>
11303 <description><p
>At work we have heaps of servers. I believe the total count is
11304 around
1000 at the moment. To be able to get help from the vendors
11305 when something go wrong, we want to keep the firmware on the servers
11306 up to date. If the firmware isn
't the latest and greatest, the
11307 vendors typically refuse to start debugging any problems until the
11308 firmware is upgraded. So before every reboot, we want to upgrade the
11309 firmware, and we would really like everyone handling servers at the
11310 university to do this themselves when they plan to reboot a machine.
11311 For that to happen we at the unix server admin group need to provide
11312 the tools to do so.
</p
>
11314 <p
>To make firmware upgrading easier, I am working on a script to
11315 fetch and install the latest firmware for the servers we got. Most of
11316 our hardware are from Dell and HP, so I have focused on these servers
11317 so far. This blog post is about the Dell part.
</P
>
11319 <p
>On the Dell FTP site I was lucky enough to find
11320 <a href=
"ftp://ftp.us.dell.com/catalog/Catalog.xml.gz
">an XML file
</a
>
11321 with firmware information for all
11th generation servers, listing
11322 which firmware should be used on a given model and where on the FTP
11323 site I can find it. Using a simple perl XML parser I can then
11324 download the shell scripts Dell provides to do firmware upgrades from
11325 within Linux and reboot when all the firmware is primed and ready to
11326 be activated on the first reboot.
</p
>
11328 <p
>This is the Dell related fragment of the perl code I am working on.
11329 Are there anyone working on similar tools for firmware upgrading all
11330 servers at a site? Please get in touch and lets share resources.
</p
>
11332 <p
><pre
>
11336 use File::Temp qw(tempdir);
11338 # Install needed RHEL packages if missing
11339 my %rhelmodules = (
11340 'XML::Simple
' =
> 'perl-XML-Simple
',
11342 for my $module (keys %rhelmodules) {
11343 eval
"use $module;
";
11345 my $pkg = $rhelmodules{$module};
11346 system(
"yum install -y $pkg
");
11347 eval
"use $module;
";
11351 my $errorsto =
'pere@hungry.com
';
11357 sub run_firmware_script {
11358 my ($opts, $script) = @_;
11360 print STDERR
"fail: missing script name\n
";
11363 print STDERR
"Running $script\n\n
";
11365 if (
0 == system(
"sh $script $opts
")) { # FIXME correct exit code handling
11366 print STDERR
"success: firmware script ran succcessfully\n
";
11368 print STDERR
"fail: firmware script returned error\n
";
11372 sub run_firmware_scripts {
11373 my ($opts, @dirs) = @_;
11374 # Run firmware packages
11375 for my $dir (@dirs) {
11376 print STDERR
"info: Running scripts in $dir\n
";
11377 opendir(my $dh, $dir) or die
"Unable to open directory $dir: $!
";
11378 while (my $s = readdir $dh) {
11379 next if $s =~ m/^\.\.?/;
11380 run_firmware_script($opts,
"$dir/$s
");
11388 print STDERR
"info: Downloading $url\n
";
11389 system(
"wget --quiet \
"$url\
"");
11394 my $product = `dmidecode -s system-product-name`;
11397 if ($product =~ m/PowerEdge/) {
11399 # on RHEL, these pacakges are needed by the firwmare upgrade scripts
11400 system(
'yum install -y compat-libstdc++-
33.i686 libstdc++.i686 libxml2.i686 procmail
');
11402 my $tmpdir = tempdir(
11406 fetch_dell_fw(
'catalog/Catalog.xml.gz
');
11407 system(
'gunzip Catalog.xml.gz
');
11408 my @paths = fetch_dell_fw_list(
'Catalog.xml
');
11409 # -q is quiet, disabling interactivity and reducing console output
11410 my $fwopts =
"-q
";
11412 for my $url (@paths) {
11413 fetch_dell_fw($url);
11415 run_firmware_scripts($fwopts, $tmpdir);
11417 print STDERR
"error: Unsupported Dell model
'$product
'.\n
";
11418 print STDERR
"error: Please report to $errorsto.\n
";
11420 chdir(
'/
');
11422 print STDERR
"error: Unsupported Dell model
'$product
'.\n
";
11423 print STDERR
"error: Please report to $errorsto.\n
";
11427 sub fetch_dell_fw {
11429 my $url =
"ftp://ftp.us.dell.com/$path
";
11433 # Using ftp://ftp.us.dell.com/catalog/Catalog.xml.gz, figure out which
11434 # firmware packages to download from Dell. Only work for Linux
11435 # machines and
11th generation Dell servers.
11436 sub fetch_dell_fw_list {
11437 my $filename = shift;
11439 my $product = `dmidecode -s system-product-name`;
11441 my ($mybrand, $mymodel) = split(/\s+/, $product);
11443 print STDERR
"Finding firmware bundles for $mybrand $mymodel\n
";
11445 my $xml = XMLin($filename);
11447 for my $bundle (@{$xml-
>{SoftwareBundle}}) {
11448 my $brand = $bundle-
>{TargetSystems}-
>{Brand}-
>{Display}-
>{content};
11449 my $model = $bundle-
>{TargetSystems}-
>{Brand}-
>{Model}-
>{Display}-
>{content};
11451 if (
"ARRAY
" eq ref $bundle-
>{TargetOSes}-
>{OperatingSystem}) {
11452 $oscode = $bundle-
>{TargetOSes}-
>{OperatingSystem}[
0]-
>{osCode};
11454 $oscode = $bundle-
>{TargetOSes}-
>{OperatingSystem}-
>{osCode};
11456 if ($mybrand eq $brand
&& $mymodel eq $model
&& "LIN
" eq $oscode)
11458 @paths = map { $_-
>{path} } @{$bundle-
>{Contents}-
>{Package}};
11461 for my $component (@{$xml-
>{SoftwareComponent}}) {
11462 my $componenttype = $component-
>{ComponentType}-
>{value};
11464 # Drop application packages, only firmware and BIOS
11465 next if
'APAC
' eq $componenttype;
11467 my $cpath = $component-
>{path};
11468 for my $path (@paths) {
11469 if ($cpath =~ m%/$path$%) {
11470 push(@paths, $cpath);
11478 <p
>The code is only tested on RedHat Enterprise Linux, but I suspect
11479 it could work on other platforms with some tweaking. Anyone know a
11480 index like Catalog.xml is available from HP for HP servers? At the
11481 moment I maintain a similar list manually and it is quickly getting
11482 outdated.
</p
>
11487 <title>How is booting into runlevel
1 different from single user boots?
</title>
11488 <link>http://www.hungry.com/~pere/blog/How_is_booting_into_runlevel_1_different_from_single_user_boots_.html
</link>
11489 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_is_booting_into_runlevel_1_different_from_single_user_boots_.html
</guid>
11490 <pubDate>Thu,
4 Aug
2011 12:
40:
00 +
0200</pubDate>
11491 <description><p
>Wouter Verhelst have some
11492 <a href=
"http://grep.be/blog/en/retorts/pere_kubuntu_boot
">interesting
11493 comments and opinions
</a
> on my blog post on
11494 <a href=
"http://www.hungry.com/~pere/blog/What_should_start_from__etc_rcS_d__in_Debian____almost_nothing.html
">the
11495 need to clean up /etc/rcS.d/ in Debian
</a
> and my blog post about
11496 <a href=
"http://www.hungry.com/~pere/blog/What_is_missing_in_the_Debian_desktop__or_why_my_parents_use_Kubuntu.html
">the
11497 default KDE desktop in Debian
</a
>. I only have time to address one
11498 small piece of his comment now, and though it best to address the
11499 misunderstanding he bring forward:
</p
>
11501 <p
><blockquote
>
11502 Currently, a system admin has four options: [...] boot to a
11503 single-user system (by adding
'single
' to the kernel command line;
11504 this runs rcS and rc1 scripts)
11505 </blockquote
></p
>
11507 <p
>This make me believe Wouter believe booting into single user mode
11508 and booting into runlevel
1 is the same. I am not surprised he
11509 believe this, because it would make sense and is a quite sensible
11510 thing to believe. But because the boot in Debian is slightly broken,
11511 runlevel
1 do not work properly and it isn
't the same as single user
11512 mode. I
'll try to explain what is actually happing, but it is a bit
11513 hard to explain.
</p
>
11515 <p
>Single user mode is defined like this in /etc/inittab:
11516 "<tt
>~~:S:wait:/sbin/sulogin
</tt
>". This means the only thing that is
11517 executed in single user mode is sulogin. Single user mode is a boot
11518 state
"between
" the runlevels, and when booting into single user mode,
11519 only the scripts in /etc/rcS.d/ are executed before the init process
11520 enters the single user state. When switching to runlevel
1, the state
11521 is in fact not ending in runlevel
1, but it passes through runlevel
1
11522 and end up in the single user mode (see /etc/rc1.d/S03single, which
11523 runs
"init -t1 S
" to switch to single user mode at the end of runlevel
11524 1. It is confusing that the
'S
' (single user) init mode is not the
11525 mode enabled by /etc/rcS.d/ (which is more like the initial boot
11528 <p
>This summary might make it clearer. When booting for the first
11529 time into single user mode, the following commands are executed:
11530 "<tt
>/etc/init.d/rc S; /sbin/sulogin
</tt
>". When booting into
11531 runlevel
1, the following commands are executed:
"<tt
>/etc/init.d/rc
11532 S; /etc/init.d/rc
1; /sbin/sulogin
</tt
>". A problem show up when
11533 trying to continue after visiting single user mode. Not all services
11534 are started again as they should, causing the machine to end up in an
11535 unpredicatble state. This is why Debian admins recommend rebooting
11536 after visiting single user mode.
</p
>
11538 <p
>A similar problem with runlevel
1 is caused by the amount of
11539 scripts executed from /etc/rcS.d/. When switching from say runlevel
2
11540 to runlevel
1, the services started from /etc/rcS.d/ are not properly
11541 stopped when passing through the scripts in /etc/rc1.d/, and not
11542 started again when switching away from runlevel
1 to the runlevels
11543 2-
5. I believe the problem is best fixed by moving all the scripts
11544 out of /etc/rcS.d/ that are not
<strong
>required
</strong
> to get a
11545 functioning single user mode during boot.
</p
>
11547 <p
>I have spent several years investigating the Debian boot system,
11548 and discovered this problem a few years ago. I suspect it originates
11549 from when sysvinit was introduced into Debian, a long time ago.
</p
>
11554 <title>What should start from /etc/rcS.d/ in Debian? - almost nothing
</title>
11555 <link>http://www.hungry.com/~pere/blog/What_should_start_from__etc_rcS_d__in_Debian____almost_nothing.html
</link>
11556 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_should_start_from__etc_rcS_d__in_Debian____almost_nothing.html
</guid>
11557 <pubDate>Sat,
30 Jul
2011 14:
00:
00 +
0200</pubDate>
11558 <description><p
>In the Debian boot system, several packages include scripts that
11559 are started from /etc/rcS.d/. In fact, there is a bite more of them
11560 than make sense, and this causes a few problems. What kind of
11561 problems, you might ask. There are at least two problems. The first
11562 is that it is not possible to recover a machine after switching to
11563 runlevel
1. One need to actually reboot to get the machine back to
11564 the expected state. The other is that single user boot will sometimes
11565 run into problems because some of the subsystems are activated before
11566 the root login is presented, causing problems when trying to recover a
11567 machine from a problem in that subsystem. A minor additional point is
11568 that moving more scripts out of rcS.d/ and into the other rc#.d/
11569 directories will increase the amount of scripts that can run in
11570 parallel during boot, and thus decrease the boot time.
</p
>
11572 <p
>So, which scripts should start from rcS.d/. In short, only the
11573 scripts that _have_ to execute before the root login prompt is
11574 presented during a single user boot should go there. Everything else
11575 should go into the numeric runlevels. This means things like
11576 lm-sensors, fuse and x11-common should not run from rcS.d, but from
11577 the numeric runlevels. Today in Debian, there are around
115 init.d
11578 scripts that are started from rcS.d/, and most of them should be moved
11579 out. Do your package have one of them? Please help us make single
11580 user and runlevel
1 better by moving it.
</p
>
11582 <p
>Scripts setting up the screen, keyboard, system partitions
11583 etc. should still be started from rcS.d/, but there is for example no
11584 need to have the network enabled before the single user login prompt
11585 is presented.
</p
>
11587 <p
>As always, things are not so easy to fix as they sound. To keep
11588 Debian systems working while scripts migrate and during upgrades, the
11589 scripts need to be moved from rcS.d/ to rc2.d/ in reverse dependency
11590 order, ie the scripts that nothing in rcS.d/ depend on can be moved,
11591 and the next ones can only be moved when their dependencies have been
11592 moved first. This migration must be done sequentially while we ensure
11593 that the package system upgrade packages in the right order to keep
11594 the system state correct. This will require some coordination when it
11595 comes to network related packages, but most of the packages with
11596 scripts that should migrate do not have anything in rcS.d/ depending
11597 on them. Some packages have already been updated, like the sudo
11598 package, while others are still left to do. I wish I had time to work
11599 on this myself, but real live constrains make it unlikely that I will
11600 find time to push this forward.
</p
>
11605 <title>What is missing in the Debian desktop, or why my parents use Kubuntu
</title>
11606 <link>http://www.hungry.com/~pere/blog/What_is_missing_in_the_Debian_desktop__or_why_my_parents_use_Kubuntu.html
</link>
11607 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_is_missing_in_the_Debian_desktop__or_why_my_parents_use_Kubuntu.html
</guid>
11608 <pubDate>Fri,
29 Jul
2011 08:
10:
00 +
0200</pubDate>
11609 <description><p
>While at Debconf11, I have several times during discussions
11610 mentioned the issues I believe should be improved in Debian for its
11611 desktop to be useful for more people. The use case for this is my
11612 parents, which are currently running Kubuntu which solve the
11615 <p
>I suspect these four missing features are not very hard to
11616 implement. After all, they are present in Ubuntu, so if we wanted to
11617 do this in Debian we would have a source.
</p
>
11621 <li
><strong
>Simple GUI based upgrade of packages.
</strong
> When there
11622 are new packages available for upgrades, a icon in the KDE status bar
11623 indicate this, and clicking on it will activate the simple upgrade
11624 tool to handle it. I have no problem guiding both of my parents
11625 through the process over the phone. If a kernel reboot is required,
11626 this too is indicated by the status bars and the upgrade tool. Last
11627 time I checked, nothing with the same features was working in KDE in
11630 <li
><strong
>Simple handling of missing Firefox browser
11631 plugins.
</strong
> When the browser encounter a MIME type it do not
11632 currently have a handler for, it will ask the user if the system
11633 should search for a package that would add support for this MIME type,
11634 and if the user say yes, the APT sources will be searched for packages
11635 advertising the MIME type in their control file (visible in the
11636 Packages file in the APT archive). If one or more packages are found,
11637 it is a simple click of the mouse to add support for the missing mime
11638 type. If the package require the user to accept some non-free
11639 license, this is explained to the user. The entire process make it
11640 more clear to the user why something do not work in the browser, and
11641 make the chances higher for the user to blame the web page authors and
11642 not the browser for any missing features.
</li
>
11644 <li
><strong
>Simple handling of missing multimedia codec/format
11645 handlers.
</strong
> When the media players encounter a format or codec
11646 it is not supporting, a dialog pop up asking the user if the system
11647 should search for a package that would add support for it. This
11648 happen with things like MP3, Windows Media or H
.264. The selection
11649 and installation procedure is very similar to the Firefox browser
11650 plugin handling. This is as far as I know implemented using a
11651 gstreamer hook. The end result is that the user easily get access to
11652 the codecs that are present from the APT archives available, while
11653 explaining more on why a given format is unsupported by Ubuntu.
</li
>
11655 <li
><strong
>Better browser handling of some MIME types.
</strong
> When
11656 displaying a text/plain file in my Debian browser, it will propose to
11657 start emacs to show it. If I remember correctly, when doing the same
11658 in Kunbutu it show the file as a text file in the browser. At least I
11659 know Opera will show text files within the browser. I much prefer the
11660 latter behaviour.
</li
>
11664 <p
>There are other nice features as well, like the simplified suite
11665 upgrader, but given that I am the one mostly doing the dist-upgrade,
11666 it do not matter much.
</p
>
11668 <p
>I really hope we could get these features in place for the next
11669 Debian release. It would require the coordinated effort of several
11670 maintainers, but would make the end user experience a lot better.
</p
>
11675 <title>Perl modules used by FixMyStreet which are missing in Debian/Squeeze
</title>
11676 <link>http://www.hungry.com/~pere/blog/Perl_modules_used_by_FixMyStreet_which_are_missing_in_Debian_Squeeze.html
</link>
11677 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Perl_modules_used_by_FixMyStreet_which_are_missing_in_Debian_Squeeze.html
</guid>
11678 <pubDate>Tue,
26 Jul
2011 12:
25:
00 +
0200</pubDate>
11679 <description><p
>The Norwegian
<a href=
"http://www.fiksgatami.no/
">FiksGataMi
</A
>
11680 site is build on Debian/Squeeze, and this platform was chosen because
11681 I am most familiar with Debian (being a Debian Developer for around
10
11682 years) because it is the latest stable Debian release which should get
11683 security support for a few years.
</p
>
11685 <p
>The web service is written in Perl, and depend on some perl modules
11686 that are missing in Debian at the moment. It would be great if these
11687 modules were added to the Debian archive, allowing anyone to set up
11688 their own
<a href=
"http://www.fixmystreet.com
">FixMyStreet
</a
> clone
11689 in their own country using only Debian packages. The list of modules
11690 missing in Debian/Squeeze isn
't very long, and I hope the perl group
11691 will find time to package the
12 modules Catalyst::Plugin::SmartURI,
11692 Catalyst::Plugin::Unicode::Encoding, Catalyst::View::TT, Devel::Hide,
11693 Sort::Key, Statistics::Distributions, Template::Plugin::Comma,
11694 Template::Plugin::DateTime::Format, Term::Size::Any, Term::Size::Perl,
11695 URI::SmartURI and Web::Scraper to make the maintenance of FixMyStreet
11696 easier in the future.
</p
>
11698 <p
>Thanks to the great tools in Debian, getting the missing modules
11699 installed on my server was a simple call to
'cpan2deb Module::Name
'
11700 and
'dpkg -i
' to install the resulting package. But this leave me
11701 with the responsibility of tracking security problems, which I really
11702 do not have time for.
</p
>
11707 <title>A Norwegian FixMyStreet have kept me busy the last few weeks
</title>
11708 <link>http://www.hungry.com/~pere/blog/A_Norwegian_FixMyStreet_have_kept_me_busy_the_last_few_weeks.html
</link>
11709 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/A_Norwegian_FixMyStreet_have_kept_me_busy_the_last_few_weeks.html
</guid>
11710 <pubDate>Sun,
3 Apr
2011 22:
50:
00 +
0200</pubDate>
11711 <description><p
>Here is a small update for my English readers. Most of my blog
11712 posts have been in Norwegian the last few weeks, so here is a short
11713 update in English.
</p
>
11715 <p
>The kids still keep me too busy to get much free software work
11716 done, but I did manage to organise a project to get a Norwegian port
11717 of the British service
11718 <a href=
"http://www.fixmystreet.com/
">FixMyStreet
</a
> up and running,
11719 and it has been running for a month now. The entire project has been
11720 organised by me and two others. Around Christmas we gathered sponsors
11721 to fund the development work. In January I drafted a contract with
11722 <a href=
"http://www.mysociety.org/
">mySociety
</a
> on what to develop,
11723 and in February the development took place. Most of it involved
11724 converting the source to use GPS coordinates instead of British
11725 easting/northing, and the resulting code should be a lot easier to get
11726 running in any country by now. The Norwegian
11727 <a href=
"http://www.fiksgatami.no/
">FiksGataMi
</a
> is using
11728 <a href=
"http://www.openstreetmap.org/
">OpenStreetmap
</a
> as the map
11729 source and the source for administrative borders in Norway, and
11730 support for this had to be added/fixed.
</p
>
11732 <p
>The Norwegian version went live March
3th, and we spent the weekend
11733 polishing the system before we announced it March
7th. The system is
11734 running on a KVM instance of Debian/Squeeze, and has seen almost
3000
11735 problem reports in a few weeks. Soon we hope to announce the Android
11736 and iPhone versions making it even easier to report problems with the
11737 public infrastructure.
</p
>
11739 <p
>Perhaps something to consider for those of you in countries without
11740 such service?
</p
>
11745 <title>Using NVD and CPE to track CVEs in locally maintained software
</title>
11746 <link>http://www.hungry.com/~pere/blog/Using_NVD_and_CPE_to_track_CVEs_in_locally_maintained_software.html
</link>
11747 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Using_NVD_and_CPE_to_track_CVEs_in_locally_maintained_software.html
</guid>
11748 <pubDate>Fri,
28 Jan
2011 15:
40:
00 +
0100</pubDate>
11749 <description><p
>The last few days I have looked at ways to track open security
11750 issues here at my work with the University of Oslo. My idea is that
11751 it should be possible to use the information about security issues
11752 available on the Internet, and check our locally
11753 maintained/distributed software against this information. It should
11754 allow us to verify that no known security issues are forgotten. The
11755 CVE database listing vulnerabilities seem like a great central point,
11756 and by using the package lists from Debian mapped to CVEs provided by
11757 the testing security team, I believed it should be possible to figure
11758 out which security holes were present in our free software
11759 collection.
</p
>
11761 <p
>After reading up on the topic, it became obvious that the first
11762 building block is to be able to name software packages in a unique and
11763 consistent way across data sources. I considered several ways to do
11764 this, for example coming up with my own naming scheme like using URLs
11765 to project home pages or URLs to the Freshmeat entries, or using some
11766 existing naming scheme. And it seem like I am not the first one to
11767 come across this problem, as MITRE already proposed and implemented a
11768 solution. Enter the
<a href=
"http://cpe.mitre.org/index.html
">Common
11769 Platform Enumeration
</a
> dictionary, a vocabulary for referring to
11770 software, hardware and other platform components. The CPE ids are
11771 mapped to CVEs in the
<a href=
"http://web.nvd.nist.gov/
">National
11772 Vulnerability Database
</a
>, allowing me to look up know security
11773 issues for any CPE name. With this in place, all I need to do is to
11774 locate the CPE id for the software packages we use at the university.
11775 This is fairly trivial (I google for
'cve cpe $package
' and check the
11776 NVD entry if a CVE for the package exist).
</p
>
11778 <p
>To give you an example. The GNU gzip source package have the CPE
11779 name cpe:/a:gnu:gzip. If the old version
1.3.3 was the package to
11780 check out, one could look up
11781 <a href=
"http://web.nvd.nist.gov/view/vuln/search?cpe=cpe%
3A%
2Fa%
3Agnu%
3Agzip:
1.3.3">cpe:/a:gnu:gzip:
1.3.3
11782 in NVD
</a
> and get a list of
6 security holes with public CVE entries.
11783 The most recent one is
11784 <a href=
"http://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-
2010-
0001">CVE-
2010-
0001</a
>,
11785 and at the bottom of the NVD page for this vulnerability the complete
11786 list of affected versions is provided.
</p
>
11788 <p
>The NVD database of CVEs is also available as a XML dump, allowing
11789 for offline processing of issues. Using this dump, I
've written a
11790 small script taking a list of CPEs as input and list all CVEs
11791 affecting the packages represented by these CPEs. One give it CPEs
11792 with version numbers as specified above and get a list of open
11793 security issues out.
</p
>
11795 <p
>Of course for this approach to be useful, the quality of the NVD
11796 information need to be high. For that to happen, I believe as many as
11797 possible need to use and contribute to the NVD database. I notice
11799 <a href=
"https://www.redhat.com/security/data/metrics/rhsamapcpe.txt
">a
11800 map from CVE to CPE
</a
>, indicating that they are using the CPE
11801 information. I
'm not aware of Debian and Ubuntu doing the same.
</p
>
11803 <p
>To get an idea about the quality for free software, I spent some
11804 time making it possible to compare the CVE database from Debian with
11805 the CVE database in NVD. The result look fairly good, but there are
11806 some inconsistencies in NVD (same software package having several
11807 CPEs), and some inaccuracies (NVD not mentioning buggy packages that
11808 Debian believe are affected by a CVE). Hope to find time to improve
11809 the quality of NVD, but that require being able to get in touch with
11810 someone maintaining it. So far my three emails with questions and
11811 corrections have not seen any reply, but I hope contact can be
11812 established soon.
</p
>
11814 <p
>An interesting application for CPEs is cross platform package
11815 mapping. It would be useful to know which packages in for example
11816 RHEL, OpenSuSe and Mandriva are missing from Debian and Ubuntu, and
11817 this would be trivial if all linux distributions provided CPE entries
11818 for their packages.
</p
>
11823 <title>Which module is loaded for a given PCI and USB device?
</title>
11824 <link>http://www.hungry.com/~pere/blog/Which_module_is_loaded_for_a_given_PCI_and_USB_device_.html
</link>
11825 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Which_module_is_loaded_for_a_given_PCI_and_USB_device_.html
</guid>
11826 <pubDate>Sun,
23 Jan
2011 00:
20:
00 +
0100</pubDate>
11827 <description><p
>In the
11828 <a href=
"http://packages.qa.debian.org/discover-data
">discover-data
</a
>
11829 package in Debian, there is a script to report useful information
11830 about the running hardware for use when people report missing
11831 information. One part of this script that I find very useful when
11832 debugging hardware problems, is the part mapping loaded kernel module
11833 to the PCI device it claims. It allow me to quickly see if the kernel
11834 module I expect is driving the hardware I am struggling with. To see
11835 the output, make sure discover-data is installed and run
11836 <tt
>/usr/share/bug/discover-data
3>&1</tt
>. The relevant output on
11837 one of my machines like this:
</p
>
11841 10de:
03eb i2c_nforce2
11844 10de:
03f0 snd_hda_intel
11849 109e:
0878 snd_bt87x
11853 <p
>The code in question look like this, slightly modified for
11854 readability and to drop the output to file descriptor
3:
</p
>
11857 if [ -d /sys/bus/pci/devices/ ] ; then
11858 echo loaded pci modules:
11860 cd /sys/bus/pci/devices/
11861 for address in * ; do
11862 if [ -d
"$address/driver/module
" ] ; then
11863 module=`cd $address/driver/module ; pwd -P | xargs basename`
11864 if grep -q
"^$module
" /proc/modules ; then
11865 address=$(echo $address |sed s/
0000://)
11866 id=`lspci -n -s $address | tail -n
1 | awk
'{print $
3}
'`
11867 echo
"$id $module
"
11876 <p
>Similar code could be used to extract USB device module
11877 mappings:
</p
>
11880 if [ -d /sys/bus/usb/devices/ ] ; then
11881 echo loaded usb modules:
11883 cd /sys/bus/usb/devices/
11884 for address in * ; do
11885 if [ -d
"$address/driver/module
" ] ; then
11886 module=`cd $address/driver/module ; pwd -P | xargs basename`
11887 if grep -q
"^$module
" /proc/modules ; then
11888 address=$(echo $address |sed s/
0000://)
11889 id=$(lsusb -s $address | tail -n
1 | awk
'{print $
6}
')
11890 if [
"$id
" ] ; then
11891 echo
"$id $module
"
11901 <p
>This might perhaps be something to include in other tools as
11907 <title>How to test if a laptop is working with Linux
</title>
11908 <link>http://www.hungry.com/~pere/blog/How_to_test_if_a_laptop_is_working_with_Linux.html
</link>
11909 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_test_if_a_laptop_is_working_with_Linux.html
</guid>
11910 <pubDate>Wed,
22 Dec
2010 14:
55:
00 +
0100</pubDate>
11911 <description><p
>The last few days I have spent at work here at the
<a
11912 href=
"http://www.uio.no/
">University of Oslo
</a
> testing if the new
11913 batch of computers will work with Linux. Every year for the last few
11914 years the university have organised shared bid of a few thousand
11915 computers, and this year HP won the bid. Two different desktops and
11916 five different laptops are on the list this year. We in the UNIX
11917 group want to know which one of these computers work well with RHEL
11918 and Ubuntu, the two Linux distributions we currently handle at the
11919 university.
</p
>
11921 <p
>My test method is simple, and I share it here to get feedback and
11922 perhaps inspire others to test hardware as well. To test, I PXE
11923 install the OS version of choice, and log in as my normal user and run
11924 a few applications and plug in selected pieces of hardware. When
11925 something fail, I make a note about this in the test matrix and move
11926 on. If I have some spare time I try to report the bug to the OS
11927 vendor, but as I only have the machines for a short time, I rarely
11928 have the time to do this for all the problems I find.
</p
>
11930 <p
>Anyway, to get to the point of this post. Here is the simple tests
11931 I perform on a new model.
</p
>
11935 <li
>Is PXE installation working? I
'm testing with RHEL6, Ubuntu Lucid
11936 and Ubuntu Maverik at the moment. If I feel like it, I also test with
11937 RHEL5 and Debian Edu/Squeeze.
</li
>
11939 <li
>Is X.org working? If the graphical login screen show up after
11940 installation, X.org is working.
</li
>
11942 <li
>Is hardware accelerated OpenGL working? Running glxgears (in
11943 package mesa-utils on Ubuntu) and writing down the frames per second
11944 reported by the program.
</li
>
11946 <li
>Is sound working? With Gnome and KDE, a sound is played when
11947 logging in, and if I can hear this the test is successful. If there
11948 are several audio exits on the machine, I try them all and check if
11949 the Gnome/KDE audio mixer can control where to send the sound. I
11950 normally test this by playing
11951 <a href=
"http://www.nuug.no/aktiviteter/
20101012-chef/
">a HTML5
11952 video
</a
> in Firefox/Iceweasel.
</li
>
11954 <li
>Is the USB subsystem working? I test this by plugging in a USB
11955 memory stick and see if Gnome/KDE notices this.
</li
>
11957 <li
>Is the CD/DVD player working? I test this by inserting any CD/DVD
11958 I have lying around, and see if Gnome/KDE notices this.
</li
>
11960 <li
>Is any built in camera working? Test using cheese, and see if a
11961 picture from the v4l device show up.
</li
>
11963 <li
>Is bluetooth working? Use the Gnome/KDE browsing tool to see if
11964 any bluetooth devices are discovered. In my office, I normally see a
11967 <li
>For laptops, is the SD or Compaq Flash reader working. I have
11968 memory modules lying around, and stick them in and see if Gnome/KDE
11969 notice this.
</li
>
11971 <li
>For laptops, is suspend/hibernate working? I
'm testing if the
11972 special button work, and if the laptop continue to work after
11975 <li
>For laptops, is the extra buttons working, like audio level,
11976 adjusting background light, switching on/off external video output,
11977 switching on/off wifi, bluetooth, etc? The set of buttons differ from
11978 laptop to laptop, so I just write down which are working and which are
11981 <li
>Some laptops have smart card readers, finger print readers,
11982 acceleration sensors etc. I rarely test these, as I do not know how
11983 to quickly test if they are working or not, so I only document their
11984 existence.
</li
>
11988 <p
>By now I suspect you are really curious what the test results are
11989 for the HP machines I am testing. I
'm not done yet, so I will report
11990 the test results later. For now I can report that HP
8100 Elite work
11991 fine, and hibernation fail with HP EliteBook
8440p on Ubuntu Lucid,
11992 and audio fail on RHEL6. Ubuntu Maverik worked with
8440p. As you
11993 can see, I have most machines left to test. One interesting
11994 observation is that Ubuntu Lucid has almost twice the frame rate than
11995 RHEL6 with glxgears. No idea why.
</p
>
12000 <title>Some thoughts on BitCoins
</title>
12001 <link>http://www.hungry.com/~pere/blog/Some_thoughts_on_BitCoins.html
</link>
12002 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Some_thoughts_on_BitCoins.html
</guid>
12003 <pubDate>Sat,
11 Dec
2010 15:
10:
00 +
0100</pubDate>
12004 <description><p
>As I continue to explore
12005 <a href=
"http://www.bitcoin.org/
">BitCoin
</a
>, I
've starting to wonder
12006 what properties the system have, and how it will be affected by laws
12007 and regulations here in Norway. Here are some random notes.
</p
>
12009 <p
>One interesting thing to note is that since the transactions are
12010 verified using a peer to peer network, all details about a transaction
12011 is known to everyone. This means that if a BitCoin address has been
12012 published like I did with mine in my initial post about BitCoin, it is
12013 possible for everyone to see how many BitCoins have been transfered to
12014 that address. There is even a web service to look at the details for
12015 all transactions. There I can see that my address
12016 <a href=
"http://blockexplorer.com/address/
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
>
12017 have received
16.06 Bitcoin, the
12018 <a href=
"http://blockexplorer.com/address/
1LfdGnGuWkpSJgbQySxxCWhv
8MHqvwst
3">1LfdGnGuWkpSJgbQySxxCWhv
8MHqvwst
3</a
>
12019 address of Simon Phipps have received
181.97 BitCoin and the address
12020 <a href=
"http://blockexplorer.com/address/
1MCwBbhNGp5hRm5rC1Aims2YFRe2SXPYKt
">1MCwBbhNGp5hRm5rC1Aims2YFRe2SXPYKt
</A
>
12021 of EFF have received
2447.38 BitCoins so far. Thank you to each and
12022 every one of you that donated bitcoins to support my activity. The
12023 fact that anyone can see how much money was transfered to a given
12024 address make it more obvious why the BitCoin community recommend to
12025 generate and hand out a new address for each transaction. I
'm told
12026 there is no way to track which addresses belong to a given person or
12027 organisation without the person or organisation revealing it
12028 themselves, as Simon, EFF and I have done.
</p
>
12030 <p
>In Norway, and in most other countries, there are laws and
12031 regulations limiting how much money one can transfer across the border
12032 without declaring it. There are money laundering, tax and accounting
12033 laws and regulations I would expect to apply to the use of BitCoin.
12034 If the Skolelinux foundation
12035 (
<a href=
"http://linuxiskolen.no/slxdebianlabs/donations.html
">SLX
12036 Debian Labs
</a
>) were to accept donations in BitCoin in addition to
12037 normal bank transfers like EFF is doing, how should this be accounted?
12038 Given that it is impossible to know if money can cross the border or
12039 not, should everything or nothing be declared? What exchange rate
12040 should be used when calculating taxes? Would receivers have to pay
12041 income tax if the foundation were to pay Skolelinux contributors in
12042 BitCoin? I have no idea, but it would be interesting to know.
</p
>
12044 <p
>For a currency to be useful and successful, it must be trusted and
12045 accepted by a lot of users. It must be possible to get easy access to
12046 the currency (as a wage or using currency exchanges), and it must be
12047 easy to spend it. At the moment BitCoin seem fairly easy to get
12048 access to, but there are very few places to spend it. I am not really
12049 a regular user of any of the vendor types currently accepting BitCoin,
12050 so I wonder when my kind of shop would start accepting BitCoins. I
12051 would like to buy electronics, travels and subway tickets, not herbs
12052 and books. :) The currency is young, and this will improve over time
12053 if it become popular, but I suspect regular banks will start to lobby
12054 to get BitCoin declared illegal if it become popular. I
'm sure they
12055 will claim it is helping fund terrorism and money laundering (which
12056 probably would be true, as is any currency in existence), but I
12057 believe the problems should be solved elsewhere and not by blaming
12058 currencies.
</p
>
12060 <p
>The process of creating new BitCoins is called mining, and it is
12061 CPU intensive process that depend on a bit of luck as well (as one is
12062 competing against all the other miners currently spending CPU cycles
12063 to see which one get the next lump of cash). The
"winner
" get
50
12064 BitCoin when this happen. Yesterday I came across the obvious way to
12065 join forces to increase ones changes of getting at least some coins,
12066 by coordinating the work on mining BitCoins across several machines
12067 and people, and sharing the result if one is lucky and get the
50
12068 BitCoins. Check out
12069 <a href=
"http://www.bluishcoder.co.nz/bitcoin-pool/
">BitCoin Pool
</a
>
12070 if this sounds interesting. I have not had time to try to set up a
12071 machine to participate there yet, but have seen that running on ones
12072 own for a few days have not yield any BitCoins througth mining
12075 <p
>Update
2010-
12-
15: Found an
<a
12076 href=
"http://inertia.posterous.com/reply-to-the-underground-economist-why-bitcoi
">interesting
12077 criticism
</a
> of bitcoin. Not quite sure how valid it is, but thought
12078 it was interesting to read. The arguments presented seem to be
12079 equally valid for gold, which was used as a currency for many years.
</p
>
12084 <title>Now accepting bitcoins - anonymous and distributed p2p crypto-money
</title>
12085 <link>http://www.hungry.com/~pere/blog/Now_accepting_bitcoins___anonymous_and_distributed_p2p_crypto_money.html
</link>
12086 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Now_accepting_bitcoins___anonymous_and_distributed_p2p_crypto_money.html
</guid>
12087 <pubDate>Fri,
10 Dec
2010 08:
20:
00 +
0100</pubDate>
12088 <description><p
>With this weeks lawless
12089 <a href=
"http://www.salon.com/news/opinion/glenn_greenwald/
2010/
12/
06/wikileaks/index.html
">governmental
12090 attacks
</a
> on Wikileak and
12091 <a href=
"http://www.salon.com/technology/dan_gillmor/
2010/
12/
06/war_on_speech
">free
12092 speech
</a
>, it has become obvious that PayPal, visa and mastercard can
12093 not be trusted to handle money transactions.
12095 <a href=
"http://webmink.com/
2010/
12/
06/now-accepting-bitcoin/
">Simon
12096 Phipps on bitcoin
</a
> reminded me about a project that a friend of
12097 mine mentioned earlier. I decided to follow Simon
's example, and get
12098 involved with
<a href=
"http://www.bitcoin.org/
">BitCoin
</a
>. I got
12099 some help from my friend to get it all running, and he even handed me
12100 some bitcoins to get started. I even donated a few bitcoins to Simon
12101 for helping me remember BitCoin.
</p
>
12103 <p
>So, what is bitcoins, you probably wonder? It is a digital
12104 crypto-currency, decentralised and handled using peer-to-peer
12105 networks. It allows anonymous transactions and prohibits central
12106 control over the transactions, making it impossible for governments
12107 and companies alike to block donations and other transactions. The
12108 source is free software, and while the key dependency wxWidgets
2.9
12109 for the graphical user interface is missing in Debian, the command
12110 line client builds just fine. Hopefully Jonas
12111 <a href=
"http://bugs.debian.org/
578157">will get the package into
12112 Debian
</a
> soon.
</p
>
12114 <p
>Bitcoins can be converted to other currencies, like USD and EUR.
12115 There are
<a href=
"http://www.bitcoin.org/trade
">companies accepting
12116 bitcoins
</a
> when selling services and goods, and there are even
12117 currency
"stock
" markets where the exchange rate is decided. There
12118 are not many users so far, but the concept seems promising. If you
12119 want to get started and lack a friend with any bitcoins to spare,
12121 <a href=
"https://freebitcoins.appspot.com/
">some for free
</a
> (
0.05
12122 bitcoin at the time of writing). Use
12123 <a href=
"http://www.bitcoinwatch.com/
">BitcoinWatch
</a
> to keep an eye
12124 on the current exchange rates.
</p
>
12126 <p
>As an experiment, I have decided to set up bitcoind on one of my
12127 machines. If you want to support my activity, please send Bitcoin
12128 donations to the address
12129 <b
>15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</b
>. Thank you!
</p
>
12134 <title>Why isn
't Debian Edu using VLC?
</title>
12135 <link>http://www.hungry.com/~pere/blog/Why_isn_t_Debian_Edu_using_VLC_.html
</link>
12136 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Why_isn_t_Debian_Edu_using_VLC_.html
</guid>
12137 <pubDate>Sat,
27 Nov
2010 11:
30:
00 +
0100</pubDate>
12138 <description><p
>In the latest issue of Linux Journal, the readers choices were
12139 presented, and the winner among the multimedia player were VLC.
12140 Personally, I like VLC, and it is my player of choice when I first try
12141 to play a video file or stream. Only if VLC fail will I drag out
12142 gmplayer to see if it can do better. The reason is mostly the failure
12143 model and trust. When VLC fail, it normally pop up a error message
12144 reporting the problem. When mplayer fail, it normally segfault or
12145 just hangs. The latter failure mode drain my trust in the program.
<p
>
12147 <p
>But even if VLC is my player of choice, we have choosen to use
12148 mplayer in
<a href=
"http://www.skolelinux.org/
">Debian
12149 Edu/Skolelinux
</a
>. The reason is simple. We need a good browser
12150 plugin to play web videos seamlessly, and the VLC browser plugin is
12151 not very good. For example, it lack in-line control buttons, so there
12152 is no way for the user to pause the video. Also, when I
12153 <a href=
"http://wiki.debian.org/DebianEdu/BrowserMultimedia
">last
12154 tested the browser plugins
</a
> available in Debian, the VLC plugin
12155 failed on several video pages where mplayer based plugins worked. If
12156 the browser plugin for VLC was as good as the gecko-mediaplayer
12157 package (which uses mplayer), we would switch.
</P
>
12159 <p
>While VLC is a good player, its user interface is slightly
12160 annoying. The most annoying feature is its inconsistent use of
12161 keyboard shortcuts. When the player is in full screen mode, its
12162 shortcuts are different from when it is playing the video in a window.
12163 For example, space only work as pause when in full screen mode. I
12164 wish it had consisten shortcuts and that space also would work when in
12165 window mode. Another nice shortcut in gmplayer is [enter] to restart
12166 the current video. It is very nice when playing short videos from the
12167 web and want to restart it when new people arrive to have a look at
12168 what is going on.
</p
>
12173 <title>Lenny-
>Squeeze upgrades of the Gnome and KDE desktop, now with apt-get autoremove
</title>
12174 <link>http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades_of_the_Gnome_and_KDE_desktop__now_with_apt_get_autoremove.html
</link>
12175 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades_of_the_Gnome_and_KDE_desktop__now_with_apt_get_autoremove.html
</guid>
12176 <pubDate>Mon,
22 Nov
2010 14:
15:
00 +
0100</pubDate>
12177 <description><p
>Michael Biebl suggested to me on IRC, that I changed my automated
12178 upgrade testing of the
12179 <a href=
"https://people.skolelinux.org/~pere/debian-upgrade-testing/
">Lenny
12180 Gnome and KDE Desktop
</a
> to do
<tt
>apt-get autoremove
</tt
> when using apt-get.
12181 This seem like a very good idea, so I adjusted by test scripts and
12182 can now present the updated result from today:
</p
>
12184 <p
>This is for Gnome:
</p
>
12186 <p
>Installed using apt-get, missing with aptitude
</p
>
12188 <blockquote
><p
>
12193 browser-plugin-gnash
12200 freedesktop-sound-theme
12202 gconf-defaults-service
12215 gnome-codec-install
12217 gnome-desktop-environment
12221 gnome-session-canberra
12223 gnome-themes-extras
12226 gstreamer0.10-fluendo-mp3
12227 gstreamer0.10-tools
12229 gtk2-engines-pixbuf
12230 gtk2-engines-smooth
12232 libapache2-mod-dnssd
12235 libaprutil1-dbd-sqlite3
12238 libboost-date-time1.42
.0
12239 libboost-python1.42
.0
12240 libboost-thread1.42
.0
12242 libchamplain-gtk-
0.4-
0
12244 libclutter-gtk-
0.10-
0
12251 libfreerdp-plugins-standard
12264 libgnome-vfs2.0-cil
12266 libgnomepanel2.24-cil
12271 libgtksourceview2.0-common
12272 libmono-addins-gui0.2-cil
12273 libmono-addins0.2-cil
12274 libmono-cairo2.0-cil
12275 libmono-corlib2.0-cil
12276 libmono-i18n-west2.0-cil
12277 libmono-posix2.0-cil
12278 libmono-security2.0-cil
12279 libmono-sharpzip2.84-cil
12280 libmono-system2.0-cil
12283 libndesk-dbus-glib1.0-cil
12284 libndesk-dbus1.0-cil
12294 libtelepathy-farsight0
12303 nautilus-sendto-empathy
12307 python-aptdaemon-gtk
12309 python-beautifulsoup
12324 python-gtksourceview2
12335 python-pkg-resources
12342 python-twisted-conch
12343 python-twisted-core
12348 python-zope.interface
12350 remmina-plugin-data
12353 rhythmbox-plugin-cdrecorder
12360 system-config-printer-udev
12362 telepathy-mission-control-
5
12369 transmission-common
12373 </p
></blockquote
>
12375 <p
>Installed using apt-get, removed with aptitude
</p
>
12377 <blockquote
><p
>
12381 epiphany-extensions
12383 fast-user-switch-applet
12402 libgtksourceview2.0-
0
12404 libsdl1.2debian-alsa
12410 system-config-printer
12415 </p
></blockquote
>
12417 <p
>Installed using aptitude, missing with apt-get
</p
>
12419 <blockquote
><p
>
12420 gstreamer0.10-gnomevfs
12421 </p
></blockquote
>
12423 <p
>Installed using aptitude, removed with apt-get
</p
>
12425 <blockquote
><p
>
12427 </p
></blockquote
>
12429 <p
>This is for KDE:
</p
>
12431 <p
>Installed using apt-get, missing with aptitude
</p
>
12433 <blockquote
><p
>
12435 </p
></blockquote
>
12437 <p
>Installed using apt-get, removed with aptitude
</p
>
12439 <blockquote
><p
>
12441 network-manager-kde
12442 </p
></blockquote
>
12444 <p
>Installed using aptitude, missing with apt-get
</p
>
12446 <blockquote
><p
>
12460 kdeartwork-emoticons
12462 kdeartwork-theme-icon
12466 kdebase-workspace-bin
12467 kdebase-workspace-data
12479 konqueror-nsplugins
12481 kscreensaver-xsavers
12496 plasma-dataengines-workspace
12498 plasma-desktopthemes-artwork
12499 plasma-runners-addons
12500 plasma-scriptengine-googlegadgets
12501 plasma-scriptengine-python
12502 plasma-scriptengine-qedje
12503 plasma-scriptengine-ruby
12504 plasma-scriptengine-webkit
12505 plasma-scriptengines
12506 plasma-wallpapers-addons
12507 plasma-widget-folderview
12508 plasma-widget-networkmanagement
12511 update-notifier-kde
12512 xscreensaver-data-extra
12514 xscreensaver-gl-extra
12515 xscreensaver-screensaver-bsod
12516 </p
></blockquote
>
12518 <p
>Installed using aptitude, removed with apt-get
</p
>
12520 <blockquote
><p
>
12522 google-gadgets-common
12540 libggadget-qt-
1.0-
0b
12545 libkonqsidebarplugin4a
12549 libkunitconversion4
12554 libplasma-geolocation-interface4
12556 libplasmagenericshell4
12570 libsmokeknewstuff2-
3
12571 libsmokeknewstuff3-
3
12573 libsmokektexteditor3
12581 libsmokeqtnetwork4-
3
12582 libsmokeqtopengl4-
3
12583 libsmokeqtscript4-
3
12587 libsmokeqtuitools4-
3
12588 libsmokeqtwebkit4-
3
12599 plasma-dataengines-addons
12600 plasma-scriptengine-superkaramba
12601 plasma-widget-lancelot
12602 plasma-widgets-addons
12603 plasma-widgets-workspace
12607 update-notifier-common
12608 </p
></blockquote
>
12610 <p
>Running apt-get autoremove made the results using apt-get and
12611 aptitude a bit more similar, but there are still quite a lott of
12612 differences. I have no idea what packages should be installed after
12613 the upgrade, but hope those that do can have a look.
</p
>
12618 <title>Migrating Xen virtual machines using LVM to KVM using disk images
</title>
12619 <link>http://www.hungry.com/~pere/blog/Migrating_Xen_virtual_machines_using_LVM_to_KVM_using_disk_images.html
</link>
12620 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Migrating_Xen_virtual_machines_using_LVM_to_KVM_using_disk_images.html
</guid>
12621 <pubDate>Mon,
22 Nov
2010 11:
20:
00 +
0100</pubDate>
12622 <description><p
>Most of the computers in use by the
12623 <a href=
"http://www.skolelinux.org/
">Debian Edu/Skolelinux project
</a
>
12624 are virtual machines. And they have been Xen machines running on a
12625 fairly old IBM eserver xseries
345 machine, and we wanted to migrate
12626 them to KVM on a newer Dell PowerEdge
2950 host machine. This was a
12627 bit harder that it could have been, because we set up the Xen virtual
12628 machines to get the virtual partitions from LVM, which as far as I
12629 know is not supported by KVM. So to migrate, we had to convert
12630 several LVM logical volumes to partitions on a virtual disk file.
</p
>
12633 <a href=
"http://searchnetworking.techtarget.com.au/articles/
35011-Six-steps-for-migrating-Xen-virtual-machines-to-KVM
">a
12634 nice recipe
</a
> to do this, and wrote the following script to do the
12635 migration. It uses qemu-img from the qemu package to make the disk
12636 image, parted to partition it, losetup and kpartx to present the disk
12637 image partions as devices, and dd to copy the data. I NFS mounted the
12638 new servers storage area on the old server to do the migration.
</p
>
12644 # http://searchnetworking.techtarget.com.au/articles/
35011-Six-steps-for-migrating-Xen-virtual-machines-to-KVM
12649 if [ -z
"$
1" ] ; then
12650 echo
"Usage: $
0 &lt;hostname
&gt;
"
12653 host=
"$
1"
12656 if [ ! -e /dev/vg_data/$host-disk ] ; then
12657 echo
"error: unable to find LVM volume for $host
"
12661 # Partitions need to be a bit bigger than the LVM LVs. not sure why.
12662 disksize=$( lvs --units m | grep $host-disk | awk
'{sum = sum + $
4} END { print int(sum *
1.05) }
')
12663 swapsize=$( lvs --units m | grep $host-swap | awk
'{sum = sum + $
4} END { print int(sum *
1.05) }
')
12664 totalsize=$(( ( $disksize + $swapsize ) ))
12667 #dd if=/dev/zero of=$img bs=
1M count=$(( $disksize + $swapsize ))
12668 qemu-img create $img ${totalsize}MMaking room on the Debian Edu/Sqeeze DVD
12670 parted $img mklabel msdos
12671 parted $img mkpart primary linux-swap
0 $disksize
12672 parted $img mkpart primary ext2 $disksize $totalsize
12673 parted $img set
1 boot on
12676 losetup /dev/loop0 $img
12677 kpartx -a /dev/loop0
12679 dd if=/dev/vg_data/$host-disk of=/dev/mapper/loop0p1 bs=
1M
12680 fsck.ext3 -f /dev/mapper/loop0p1 || true
12681 mkswap /dev/mapper/loop0p2
12683 kpartx -d /dev/loop0
12684 losetup -d /dev/loop0
12687 <p
>The script is perhaps so simple that it is not copyrightable, but
12688 if it is, it is licenced using GPL v2 or later at your discretion.
</p
>
12690 <p
>After doing this, I booted a Debian CD in rescue mode in KVM with
12691 the new disk image attached, installed grub-pc and linux-image-
686 and
12692 set up grub to boot from the disk image. After this, the KVM machines
12693 seem to work just fine.
</p
>
12698 <title>Lenny-
>Squeeze upgrades, apt vs aptitude with the Gnome and KDE desktop
</title>
12699 <link>http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades__apt_vs_aptitude_with_the_Gnome_and_KDE_desktop.html
</link>
12700 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades__apt_vs_aptitude_with_the_Gnome_and_KDE_desktop.html
</guid>
12701 <pubDate>Sat,
20 Nov
2010 22:
50:
00 +
0100</pubDate>
12702 <description><p
>I
'm still running upgrade testing of the
12703 <a href=
"https://people.skolelinux.org/~pere/debian-upgrade-testing/
">Lenny
12704 Gnome and KDE Desktop
</a
>, but have not had time to spend on reporting the
12705 status. Here is a short update based on a test I ran
20101118.
</p
>
12707 <p
>I still do not know what a correct migration should look like, so I
12708 report any differences between apt and aptitude and hope someone else
12709 can see if anything should be changed.
</p
>
12711 <p
>This is for Gnome:
</p
>
12713 <p
>Installed using apt-get, missing with aptitude
</p
>
12715 <blockquote
><p
>
12716 apache2.2-bin aptdaemon at-spi baobab binfmt-support
12717 browser-plugin-gnash cheese-common cli-common cpp-
4.3 cups-pk-helper
12718 dmz-cursor-theme empathy empathy-common finger
12719 freedesktop-sound-theme freeglut3 gconf-defaults-service gdm-themes
12720 gedit-plugins geoclue geoclue-hostip geoclue-localnet geoclue-manual
12721 geoclue-yahoo gnash gnash-common gnome gnome-backgrounds
12722 gnome-cards-data gnome-codec-install gnome-core
12723 gnome-desktop-environment gnome-disk-utility gnome-screenshot
12724 gnome-search-tool gnome-session-canberra gnome-spell
12725 gnome-system-log gnome-themes-extras gnome-themes-more
12726 gnome-user-share gs-common gstreamer0.10-fluendo-mp3
12727 gstreamer0.10-tools gtk2-engines gtk2-engines-pixbuf
12728 gtk2-engines-smooth hal-info hamster-applet libapache2-mod-dnssd
12729 libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap
12730 libart2.0-cil libatspi1.0-
0 libboost-date-time1.42
.0
12731 libboost-python1.42
.0 libboost-thread1.42
.0 libchamplain-
0.4-
0
12732 libchamplain-gtk-
0.4-
0 libcheese-gtk18 libclutter-gtk-
0.10-
0
12733 libcryptui0 libcupsys2 libdiscid0 libeel2-data libelf1 libepc-
1.0-
2
12734 libepc-common libepc-ui-
1.0-
2 libfreerdp-plugins-standard
12735 libfreerdp0 libgail-common libgconf2.0-cil libgdata-common libgdata7
12736 libgdl-
1-common libgdu-gtk0 libgee2 libgeoclue0 libgexiv2-
0 libgif4
12737 libglade2.0-cil libglib2.0-cil libgmime2.4-cil libgnome-vfs2.0-cil
12738 libgnome2.24-cil libgnomepanel2.24-cil libgnomeprint2.2-data
12739 libgnomeprintui2.2-common libgnomevfs2-bin libgpod-common libgpod4
12740 libgtk2.0-cil libgtkglext1 libgtksourceview-common
12741 libgtksourceview2.0-common libmono-addins-gui0.2-cil
12742 libmono-addins0.2-cil libmono-cairo2.0-cil libmono-corlib2.0-cil
12743 libmono-i18n-west2.0-cil libmono-posix2.0-cil
12744 libmono-security2.0-cil libmono-sharpzip2.84-cil
12745 libmono-system2.0-cil libmtp8 libmusicbrainz3-
6
12746 libndesk-dbus-glib1.0-cil libndesk-dbus1.0-cil libopal3.6
.8
12747 libpolkit-gtk-
1-
0 libpt-
1.10.10-plugins-alsa
12748 libpt-
1.10.10-plugins-v4l libpt2.6
.7 libpython2.6 librpm1 librpmio1
12749 libsdl1.2debian libservlet2.4-java libsrtp0 libssh-
4
12750 libtelepathy-farsight0 libtelepathy-glib0 libtidy-
0.99-
0
12751 libxalan2-java libxerces2-java media-player-info mesa-utils
12752 mono-
2.0-gac mono-gac mono-runtime nautilus-sendto
12753 nautilus-sendto-empathy openoffice.org-writer2latex
12754 openssl-blacklist p7zip p7zip-full pkg-config python-
4suite-xml
12755 python-aptdaemon python-aptdaemon-gtk python-axiom
12756 python-beautifulsoup python-bugbuddy python-clientform
12757 python-coherence python-configobj python-crypto python-cupshelpers
12758 python-cupsutils python-eggtrayicon python-elementtree
12759 python-epsilon python-evolution python-feedparser python-gdata
12760 python-gdbm python-gst0.10 python-gtkglext1 python-gtkmozembed
12761 python-gtksourceview2 python-httplib2 python-louie python-mako
12762 python-markupsafe python-mechanize python-nevow python-notify
12763 python-opengl python-openssl python-pam python-pkg-resources
12764 python-pyasn1 python-pysqlite2 python-rdflib python-serial
12765 python-tagpy python-twisted-bin python-twisted-conch
12766 python-twisted-core python-twisted-web python-utidylib python-webkit
12767 python-xdg python-zope.interface remmina remmina-plugin-data
12768 remmina-plugin-rdp remmina-plugin-vnc rhythmbox-plugin-cdrecorder
12769 rhythmbox-plugins rpm-common rpm2cpio seahorse-plugins shotwell
12770 software-center svgalibg1 system-config-printer-udev
12771 telepathy-gabble telepathy-mission-control-
5 telepathy-salut tomboy
12772 totem totem-coherence totem-mozilla totem-plugins
12773 transmission-common xdg-user-dirs xdg-user-dirs-gtk xserver-xephyr
12775 </p
></blockquote
>
12777 Installed using apt-get, removed with aptitude
12779 <blockquote
><p
>
12780 arj bluez-utils cheese dhcdbd djvulibre-desktop ekiga eog
12781 epiphany-extensions epiphany-gecko evolution-exchange
12782 fast-user-switch-applet file-roller gcalctool gconf-editor gdm gedit
12783 gedit-common gnome-app-install gnome-games gnome-games-data
12784 gnome-nettool gnome-system-tools gnome-themes gnome-utils
12785 gnome-vfs-obexftp gnome-volume-manager gnuchess gucharmap
12786 guile-
1.8-libs hal libavahi-compat-libdnssd1 libavahi-core5
12787 libavahi-ui0 libbind9-
50 libbluetooth2 libcamel1.2-
11 libcdio7
12788 libcucul0 libcurl3 libdirectfb-
1.0-
0 libdmx1 libdvdread3
12789 libedata-cal1.2-
6 libedataserver1.2-
9 libeel2-
2.20 libepc-
1.0-
1
12790 libepc-ui-
1.0-
1 libexchange-storage1.2-
3 libfaad0 libgadu3
12791 libgalago3 libgd2-noxpm libgda3-
3 libgda3-common libggz2 libggzcore9
12792 libggzmod4 libgksu1.2-
0 libgksuui1.0-
1 libgmyth0 libgnome-desktop-
2
12793 libgnome-pilot2 libgnomecups1.0-
1 libgnomeprint2.2-
0
12794 libgnomeprintui2.2-
0 libgpod3 libgraphviz4 libgtk-vnc-
1.0-
0
12795 libgtkhtml2-
0 libgtksourceview1.0-
0 libgtksourceview2.0-
0
12796 libgucharmap6 libhesiod0 libicu38 libisccc50 libisccfg50 libiw29
12797 libjaxp1.3-java-gcj libkpathsea4 liblircclient0 libltdl3 liblwres50
12798 libmagick++
10 libmagick10 libmalaga7 libmozjs1d libmpfr1ldbl libmtp7
12799 libmysqlclient15off libnautilus-burn4 libneon27 libnm-glib0
12800 libnm-util0 libopal-
2.2 libosp5 libparted1.8-
10 libpisock9
12801 libpisync1 libpoppler-glib3 libpoppler3 libpt-
1.10.10 libraw1394-
8
12802 libsdl1.2debian-alsa libsensors3 libsexy2 libsmbios2 libsoup2.2-
8
12803 libspeexdsp1 libssh2-
1 libsuitesparse-
3.1.0 libsvga1
12804 libswfdec-
0.6-
90 libtalloc1 libtotem-plparser10 libtrackerclient0
12805 libvoikko1 libxalan2-java-gcj libxerces2-java-gcj libxklavier12
12806 libxtrap6 libxxf86misc1 libzephyr3 mysql-common rhythmbox seahorse
12807 sound-juicer swfdec-gnome system-config-printer totem-common
12808 totem-gstreamer transmission-gtk vinagre vino w3c-dtd-xhtml wodim
12809 </p
></blockquote
>
12811 <p
>Installed using aptitude, missing with apt-get
</p
>
12813 <blockquote
><p
>
12814 gstreamer0.10-gnomevfs
12815 </p
></blockquote
>
12817 <p
>Installed using aptitude, removed with apt-get
</p
>
12819 <blockquote
><p
>
12821 </p
></blockquote
>
12823 <p
>This is for KDE:
</p
>
12825 <p
>Installed using apt-get, missing with aptitude
</p
>
12827 <blockquote
><p
>
12828 autopoint bomber bovo cantor cantor-backend-kalgebra cpp-
4.3 dcoprss
12829 edict espeak espeak-data eyesapplet fifteenapplet finger gettext
12830 ghostscript-x git gnome-audio gnugo granatier gs-common
12831 gstreamer0.10-pulseaudio indi kaddressbook-plugins kalgebra
12832 kalzium-data kanjidic kapman kate-plugins kblocks kbreakout kbstate
12833 kde-icons-mono kdeaccessibility kdeaddons-kfile-plugins
12834 kdeadmin-kfile-plugins kdeartwork-misc kdeartwork-theme-window
12835 kdeedu kdeedu-data kdeedu-kvtml-data kdegames kdegames-card-data
12836 kdegames-mahjongg-data kdegraphics-kfile-plugins kdelirc
12837 kdemultimedia-kfile-plugins kdenetwork-kfile-plugins
12838 kdepim-kfile-plugins kdepim-kio-plugins kdessh kdetoys kdewebdev
12839 kdiamond kdnssd kfilereplace kfourinline kgeography-data kigo
12840 killbots kiriki klettres-data kmoon kmrml knewsticker-scripts
12841 kollision kpf krosspython ksirk ksmserver ksquares kstars-data
12842 ksudoku kubrick kweather libasound2-plugins libboost-python1.42
.0
12843 libcfitsio3 libconvert-binhex-perl libcrypt-ssleay-perl libdb4.6++
12844 libdjvulibre-text libdotconf1.0 liberror-perl libespeak1
12845 libfinance-quote-perl libgail-common libgsl0ldbl libhtml-parser-perl
12846 libhtml-tableextract-perl libhtml-tagset-perl libhtml-tree-perl
12847 libio-stringy-perl libkdeedu4 libkdegames5 libkiten4 libkpathsea5
12848 libkrossui4 libmailtools-perl libmime-tools-perl
12849 libnews-nntpclient-perl libopenbabel3 libportaudio2 libpulse-browse0
12850 libservlet2.4-java libspeechd2 libtiff-tools libtimedate-perl
12851 libunistring0 liburi-perl libwww-perl libxalan2-java libxerces2-java
12852 lirc luatex marble networkstatus noatun-plugins
12853 openoffice.org-writer2latex palapeli palapeli-data parley
12854 parley-data poster psutils pulseaudio pulseaudio-esound-compat
12855 pulseaudio-module-x11 pulseaudio-utils quanta-data rocs rsync
12856 speech-dispatcher step svgalibg1 texlive-binaries texlive-luatex
12857 ttf-sazanami-gothic
12858 </p
></blockquote
>
12860 <p
>Installed using apt-get, removed with aptitude
</p
>
12862 <blockquote
><p
>
12863 amor artsbuilder atlantik atlantikdesigner blinken bluez-utils cvs
12864 dhcdbd djvulibre-desktop imlib-base imlib11 kalzium kanagram kandy
12865 kasteroids katomic kbackgammon kbattleship kblackbox kbounce kbruch
12866 kcron kdat kdemultimedia-kappfinder-data kdeprint kdict kdvi kedit
12867 keduca kenolaba kfax kfaxview kfouleggs kgeography kghostview
12868 kgoldrunner khangman khexedit kiconedit kig kimagemapeditor
12869 kitchensync kiten kjumpingcube klatin klettres klickety klines
12870 klinkstatus kmag kmahjongg kmailcvt kmenuedit kmid kmilo kmines
12871 kmousetool kmouth kmplot knetwalk kodo kolf kommander konquest kooka
12872 kpager kpat kpdf kpercentage kpilot kpoker kpovmodeler krec
12873 kregexpeditor kreversi ksame ksayit kshisen ksig ksim ksirc ksirtet
12874 ksmiletris ksnake ksokoban kspaceduel kstars ksvg ksysv kteatime
12875 ktip ktnef ktouch ktron kttsd ktuberling kturtle ktux kuickshow
12876 kverbos kview kviewshell kvoctrain kwifimanager kwin kwin4 kwordquiz
12877 kworldclock kxsldbg libakode2 libarts1-akode libarts1-audiofile
12878 libarts1-mpeglib libarts1-xine libavahi-compat-libdnssd1
12879 libavahi-core5 libavc1394-
0 libbind9-
50 libbluetooth2
12880 libboost-python1.34
.1 libcucul0 libcurl3 libcvsservice0
12881 libdirectfb-
1.0-
0 libdjvulibre21 libdvdread3 libfaad0 libfreebob0
12882 libgd2-noxpm libgraphviz4 libgsmme1c2a libgtkhtml2-
0 libicu38
12883 libiec61883-
0 libindex0 libisccc50 libisccfg50 libiw29
12884 libjaxp1.3-java-gcj libk3b3 libkcal2b libkcddb1 libkdeedu3
12885 libkdegames1 libkdepim1a libkgantt0 libkleopatra1 libkmime2
12886 libkpathsea4 libkpimexchange1 libkpimidentities1 libkscan1
12887 libksieve0 libktnef1 liblockdev1 libltdl3 liblwres50 libmagick10
12888 libmimelib1c2a libmodplug0c2 libmozjs1d libmpcdec3 libmpfr1ldbl
12889 libneon27 libnm-util0 libopensync0 libpisock9 libpoppler-glib3
12890 libpoppler-qt2 libpoppler3 libraw1394-
8 librss1 libsensors3
12891 libsmbios2 libssh2-
1 libsuitesparse-
3.1.0 libswfdec-
0.6-
90
12892 libtalloc1 libxalan2-java-gcj libxerces2-java-gcj libxtrap6 lskat
12893 mpeglib network-manager-kde noatun pmount tex-common texlive-base
12894 texlive-common texlive-doc-base texlive-fonts-recommended tidy
12895 ttf-dustin ttf-kochi-gothic ttf-sjfonts
12896 </p
></blockquote
>
12898 <p
>Installed using aptitude, missing with apt-get
</p
>
12900 <blockquote
><p
>
12901 dolphin kde-core kde-plasma-desktop kde-standard kde-window-manager
12902 kdeartwork kdebase kdebase-apps kdebase-workspace
12903 kdebase-workspace-bin kdebase-workspace-data kdeutils kscreensaver
12904 kscreensaver-xsavers libgle3 libkonq5 libkonq5-templates libnetpbm10
12905 netpbm plasma-widget-folderview plasma-widget-networkmanagement
12906 xscreensaver-data-extra xscreensaver-gl xscreensaver-gl-extra
12907 xscreensaver-screensaver-bsod
12908 </p
></blockquote
>
12910 <p
>Installed using aptitude, removed with apt-get
</p
>
12912 <blockquote
><p
>
12913 kdebase-bin konq-plugins konqueror
12914 </p
></blockquote
>
12919 <title>Gnash buildbot slave and Debian kfreebsd
</title>
12920 <link>http://www.hungry.com/~pere/blog/Gnash_buildbot_slave_and_Debian_kfreebsd.html
</link>
12921 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Gnash_buildbot_slave_and_Debian_kfreebsd.html
</guid>
12922 <pubDate>Sat,
20 Nov
2010 07:
20:
00 +
0100</pubDate>
12923 <description><p
>Answering
12924 <a href=
"http://www.listware.net/
201011/gnash-dev/
67431-gnash-dev-buildbot-looking-for-slaves.html
">the
12925 call from the Gnash project
</a
> for
12926 <a href=
"http://www.gnashdev.org:
8010">buildbot
</a
> slaves to test the
12927 current source, I have set up a virtual KVM machine on the Debian
12928 Edu/Skolelinux virtualization host to test the git source on
12929 Debian/Squeeze. I hope this can help the developers in getting new
12930 releases out more often.
</p
>
12932 <p
>As the developers want less main-stream build platforms tested to,
12933 I have considered setting up a
<a
12934 href=
"http://www.debian.org/ports/kfreebsd-gnu/
">Debian/kfreebsd
</a
>
12935 machine as well. I have also considered using the kfreebsd
12936 architecture in Debian as a file server in NUUG to get access to the
5
12937 TB zfs volume we currently use to store DV video. Because of this, I
12938 finally got around to do a test installation of Debian/Squeeze with
12939 kfreebsd. Installation went fairly smooth, thought I noticed some
12940 visual glitches in the cdebconf dialogs (black cursor left on the
12941 screen at random locations). Have not gotten very far with the
12942 testing. Noticed cfdisk did not work, but fdisk did so it was not a
12943 fatal problem. Have to spend some more time on it to see if it is
12944 useful as a file server for NUUG. Will try to find time to set up a
12945 gnash buildbot slave on the Debian Edu/Skolelinux this weekend.
</p
>
12950 <title>Debian in
3D
</title>
12951 <link>http://www.hungry.com/~pere/blog/Debian_in_3D.html
</link>
12952 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_in_3D.html
</guid>
12953 <pubDate>Tue,
9 Nov
2010 16:
10:
00 +
0100</pubDate>
12954 <description><p
><img src=
"http://thingiverse-production.s3.amazonaws.com/renders/
23/e0/c4/f9/
2b/debswagtdose_preview_medium.jpg
"></p
>
12956 <p
>3D printing is just great. I just came across this Debian logo in
12958 <a href=
"http://blog.thingiverse.com/
2010/
11/
09/participatory-branding/
">the
12959 thingiverse blog
</a
>.
</p
>
12964 <title>Software updates
2010-
10-
24</title>
12965 <link>http://www.hungry.com/~pere/blog/Software_updates_2010_10_24.html
</link>
12966 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Software_updates_2010_10_24.html
</guid>
12967 <pubDate>Sun,
24 Oct
2010 22:
45:
00 +
0200</pubDate>
12968 <description><p
>Some updates.
</p
>
12970 <p
>My
<a href=
"http://pledgebank.com/gnash-avm2
">gnash pledge
</a
> to
12971 raise money for the project is going well. The lower limit of
10
12972 signers was reached in
24 hours, and so far
13 people have signed it.
12973 More signers and more funding is most welcome, and I am really curious
12974 how far we can get before the time limit of December
24 is reached.
12977 <p
>On the #gnash IRC channel on irc.freenode.net, I was just tipped
12978 about what appear to be a great code coverage tool capable of
12979 generating code coverage stats without any changes to the source code.
12981 <a href=
"http://simonkagstrom.github.com/kcov/index.html
">kcov
</a
>,
12982 and can be used using
<tt
>kcov
&lt;directory
&gt;
&lt;binary
&gt;
</tt
>.
12983 It is missing in Debian, but the git source built just fine in Squeeze
12984 after I installed libelf-dev, libdwarf-dev, pkg-config and
12985 libglib2.0-dev. Failed to build in Lenny, but suspect that is
12986 solvable. I hope kcov make it into Debian soon.
</p
>
12988 <p
>Finally found time to wrap up the release notes for
<a
12989 href=
"http://lists.debian.org/debian-edu-announce/
2010/
10/msg00002.html
">a
12990 new alpha release of Debian Edu
</a
>, and just published the second
12991 alpha test release of the Squeeze based Debian Edu /
12992 <a href=
"http://www.skolelinux.org/
">Skolelinux
</a
>
12993 release. Give it a try if you need a complete linux solution for your
12994 school, including central infrastructure server, workstations, thin
12995 client servers and diskless workstations. A nice touch added
12996 yesterday is RDP support on the thin client servers, for windows
12997 clients to get a Linux desktop on request.
</p
>
13002 <title>Some notes on Flash in Debian and Debian Edu
</title>
13003 <link>http://www.hungry.com/~pere/blog/Some_notes_on_Flash_in_Debian_and_Debian_Edu.html
</link>
13004 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Some_notes_on_Flash_in_Debian_and_Debian_Edu.html
</guid>
13005 <pubDate>Sat,
4 Sep
2010 10:
10:
00 +
0200</pubDate>
13006 <description><p
>In the
<a href=
"http://popcon.debian.org/unknown/by_vote
">Debian
13007 popularity-contest numbers
</a
>, the adobe-flashplugin package the
13008 second most popular used package that is missing in Debian. The sixth
13009 most popular is flashplayer-mozilla. This is a clear indication that
13010 working flash is important for Debian users. Around
10 percent of the
13011 users submitting data to popcon.debian.org have this package
13012 installed.
</p
>
13014 <p
>In the report written by Lars Risan in August
2008
13015 («
<a href=
"http://wiki.skolelinux.no/Dokumentasjon/Rapporter?action=AttachFile
&do=view
&target=Skolelinux_i_bruk_rapport_1.0.pdf
">Skolelinux
13016 i bruk – Rapport for Hurum kommune, Universitetet i Agder og
13017 stiftelsen SLX Debian Labs
</a
>»), one of the most important problems
13018 schools experienced with
<a href=
"http://www.skolelinux.org/
">Debian
13019 Edu/Skolelinux
</a
> was the lack of working Flash. A lot of educational
13020 web sites require Flash to work, and lacking working Flash support in
13021 the web browser and the problems with installing it was perceived as a
13022 good reason to stay with Windows.
</p
>
13024 <p
>I once saw a funny and sad comment in a web forum, where Linux was
13025 said to be the retarded cousin that did not really understand
13026 everything you told him but could work fairly well. This was a
13027 comment regarding the problems Linux have with proprietary formats and
13028 non-standard web pages, and is sad because it exposes a fairly common
13029 understanding of whose fault it is if web pages that only work in for
13030 example Internet Explorer
6 fail to work on Firefox, and funny because
13031 it explain very well how annoying it is for users when Linux
13032 distributions do not work with the documents they receive or the web
13033 pages they want to visit.
</p
>
13035 <p
>This is part of the reason why I believe it is important for Debian
13036 and Debian Edu to have a well working Flash implementation in the
13037 distribution, to get at least popular sites as Youtube and Google
13038 Video to working out of the box. For Squeeze, Debian have the chance
13039 to include the latest version of Gnash that will make this happen, as
13040 the new release
0.8.8 was published a few weeks ago and is resting in
13041 unstable. The new version work with more sites that version
0.8.7.
13042 The Gnash maintainers have asked for a freeze exception, but the
13043 release team have not had time to reply to it yet. I hope they agree
13044 with me that Flash is important for the Debian desktop users, and thus
13045 accept the new package into Squeeze.
</p
>
13050 <title>Circular package dependencies harms apt recovery
</title>
13051 <link>http://www.hungry.com/~pere/blog/Circular_package_dependencies_harms_apt_recovery.html
</link>
13052 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Circular_package_dependencies_harms_apt_recovery.html
</guid>
13053 <pubDate>Tue,
27 Jul
2010 23:
50:
00 +
0200</pubDate>
13054 <description><p
>I discovered this while doing
13055 <a href=
"http://www.hungry.com/~pere/blog/Automatic_upgrade_testing_from_Lenny_to_Squeeze.html
">automated
13056 testing of upgrades from Debian Lenny to Squeeze
</a
>. A few packages
13057 in Debian still got circular dependencies, and it is often claimed
13058 that apt and aptitude should be able to handle this just fine, but
13059 some times these dependency loops causes apt to fail.
</p
>
13061 <p
>An example is from todays
13062 <a href=
"https://people.skolelinux.org/~pere/debian-upgrade-testing//test-
20100727-lenny-squeeze-kde-aptitude.txt
">upgrade
13063 of KDE using aptitude
</a
>. In it, a bug in kdebase-workspace-data
13064 causes perl-modules to fail to upgrade. The cause is simple. If a
13065 package fail to unpack, then only part of packages with the circular
13066 dependency might end up being unpacked when unpacking aborts, and the
13067 ones already unpacked will fail to configure in the recovery phase
13068 because its dependencies are unavailable.
</p
>
13070 <p
>In this log, the problem manifest itself with this error:
</p
>
13072 <blockquote
><pre
>
13073 dpkg: dependency problems prevent configuration of perl-modules:
13074 perl-modules depends on perl (
>=
5.10.1-
1); however:
13075 Version of perl on system is
5.10.0-
19lenny
2.
13076 dpkg: error processing perl-modules (--configure):
13077 dependency problems - leaving unconfigured
13078 </pre
></blockquote
>
13080 <p
>The perl/perl-modules circular dependency is already
13081 <a href=
"http://bugs.debian.org/
527917">reported as a bug
</a
>, and will
13082 hopefully be solved as soon as possible, but it is not the only one,
13083 and each one of these loops in the dependency tree can cause similar
13084 failures. Of course, they only occur when there are bugs in other
13085 packages causing the unpacking to fail, but it is rather nasty when
13086 the failure of one package causes the problem to become worse because
13087 of dependency loops.
</p
>
13090 <a href=
"http://lists.debian.org/debian-devel/
2010/
06/msg00116.html
">the
13091 tireless effort by Bill Allombert
</a
>, the number of circular
13093 <a href=
"http://debian.semistable.com/debgraph.out.html
">left in Debian
13094 is dropping
</a
>, and perhaps it will reach zero one day. :)
</p
>
13096 <p
>Todays testing also exposed a bug in
13097 <a href=
"http://bugs.debian.org/
590605">update-notifier
</a
> and
13098 <a href=
"http://bugs.debian.org/
590604">different behaviour
</a
> between
13099 apt-get and aptitude, the latter possibly caused by some circular
13100 dependency. Reported both to BTS to try to get someone to look at
13106 <title>What are they searching for - PowerDNS and ISC DHCP in LDAP
</title>
13107 <link>http://www.hungry.com/~pere/blog/What_are_they_searching_for___PowerDNS_and_ISC_DHCP_in_LDAP.html
</link>
13108 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_are_they_searching_for___PowerDNS_and_ISC_DHCP_in_LDAP.html
</guid>
13109 <pubDate>Sat,
17 Jul
2010 21:
00:
00 +
0200</pubDate>
13110 <description><p
>This is a
13111 <a href=
"http://www.hungry.com/~pere/blog/Time_for_new__LDAP_schemas_replacing_RFC_2307_.html
">followup
</a
>
13113 <a href=
"http://www.hungry.com/~pere/blog/Idea_for_a_change_to_LDAP_schemas_allowing_DNS_and_DHCP_info_to_be_combined_into_one_object.html
">previous
13115 <a href=
"http://www.hungry.com/~pere/blog/Combining_PowerDNS_and_ISC_DHCP_LDAP_objects.html
">merging
13116 all
</a
> the computer related LDAP objects in Debian Edu.
</p
>
13118 <p
>As a step to try to see if it possible to merge the DNS and DHCP
13119 LDAP objects, I have had a look at how the packages pdns-backend-ldap
13120 and dhcp3-server-ldap in Debian use the LDAP server. The two
13121 implementations are quite different in how they use LDAP.
</p
>
13123 To get this information, I started slapd with debugging enabled and
13124 dumped the debug output to a file to get the LDAP searches performed
13125 on a Debian Edu main-server. Here is a summary.
13127 <p
><strong
>powerdns
</strong
></p
>
13129 <a href=
"http://www.linuxnetworks.de/doc/index.php/PowerDNS_LDAP_Backend
">Clues
13130 on how to
</a
> set up PowerDNS to use a LDAP backend is available on
13133 <p
>PowerDNS have two modes of operation using LDAP as its backend.
13134 One
"strict
" mode where the forward and reverse DNS lookups are done
13135 using the same LDAP objects, and a
"tree
" mode where the forward and
13136 reverse entries are in two different subtrees in LDAP with a structure
13137 based on the DNS names, as in tjener.intern and
13138 2.2.0.10.in-addr.arpa.
</p
>
13140 <p
>In tree mode, the server is set up to use a LDAP subtree as its
13141 base, and uses a
"base
" scoped search for the DNS name by adding
13142 "dc=tjener,dc=intern,
" to the base with a filter for
13143 "(associateddomain=tjener.intern)
" for the forward entry and
13144 "dc=
2,dc=
2,dc=
0,dc=
10,dc=in-addr,dc=arpa,
" with a filter for
13145 "(associateddomain=
2.2.0.10.in-addr.arpa)
" for the reverse entry. For
13146 forward entries, it is looking for attributes named dnsttl, arecord,
13147 nsrecord, cnamerecord, soarecord, ptrrecord, hinforecord, mxrecord,
13148 txtrecord, rprecord, afsdbrecord, keyrecord, aaaarecord, locrecord,
13149 srvrecord, naptrrecord, kxrecord, certrecord, dsrecord, sshfprecord,
13150 ipseckeyrecord, rrsigrecord, nsecrecord, dnskeyrecord, dhcidrecord,
13151 spfrecord and modifytimestamp. For reverse entries it is looking for
13152 the attributes dnsttl, arecord, nsrecord, cnamerecord, soarecord,
13153 ptrrecord, hinforecord, mxrecord, txtrecord, rprecord, aaaarecord,
13154 locrecord, srvrecord, naptrrecord and modifytimestamp. The equivalent
13155 ldapsearch commands could look like this:
</p
>
13157 <blockquote
><pre
>
13158 ldapsearch -h ldap \
13159 -b dc=tjener,dc=intern,ou=hosts,dc=skole,dc=skolelinux,dc=no \
13160 -s base -x
'(associateddomain=tjener.intern)
' dNSTTL aRecord nSRecord \
13161 cNAMERecord sOARecord pTRRecord hInfoRecord mXRecord tXTRecord \
13162 rPRecord aFSDBRecord KeyRecord aAAARecord lOCRecord sRVRecord \
13163 nAPTRRecord kXRecord certRecord dSRecord sSHFPRecord iPSecKeyRecord \
13164 rRSIGRecord nSECRecord dNSKeyRecord dHCIDRecord sPFRecord modifyTimestamp
13166 ldapsearch -h ldap \
13167 -b dc=
2,dc=
2,dc=
0,dc=
10,dc=in-addr,dc=arpa,ou=hosts,dc=skole,dc=skolelinux,dc=no \
13168 -s base -x
'(associateddomain=
2.2.0.10.in-addr.arpa)
'
13169 dnsttl, arecord, nsrecord, cnamerecord soarecord ptrrecord \
13170 hinforecord mxrecord txtrecord rprecord aaaarecord locrecord \
13171 srvrecord naptrrecord modifytimestamp
13172 </pre
></blockquote
>
13174 <p
>In Debian Edu/Lenny, the PowerDNS tree mode is used with
13175 ou=hosts,dc=skole,dc=skolelinux,dc=no as the base, and these are two
13176 example LDAP objects used there. In addition to these objects, the
13177 parent objects all th way up to ou=hosts,dc=skole,dc=skolelinux,dc=no
13178 also exist.
</p
>
13180 <blockquote
><pre
>
13181 dn: dc=tjener,dc=intern,ou=hosts,dc=skole,dc=skolelinux,dc=no
13183 objectclass: dnsdomain
13184 objectclass: domainrelatedobject
13187 associateddomain: tjener.intern
13189 dn: dc=
2,dc=
2,dc=
0,dc=
10,dc=in-addr,dc=arpa,ou=hosts,dc=skole,dc=skolelinux,dc=no
13191 objectclass: dnsdomain2
13192 objectclass: domainrelatedobject
13194 ptrrecord: tjener.intern
13195 associateddomain:
2.2.0.10.in-addr.arpa
13196 </pre
></blockquote
>
13198 <p
>In strict mode, the server behaves differently. When looking for
13199 forward DNS entries, it is doing a
"subtree
" scoped search with the
13200 same base as in the tree mode for a object with filter
13201 "(associateddomain=tjener.intern)
" and requests the attributes dnsttl,
13202 arecord, nsrecord, cnamerecord, soarecord, ptrrecord, hinforecord,
13203 mxrecord, txtrecord, rprecord, aaaarecord, locrecord, srvrecord,
13204 naptrrecord and modifytimestamp. For reverse entires it also do a
13205 subtree scoped search but this time the filter is
"(arecord=
10.0.2.2)
"
13206 and the requested attributes are associateddomain, dnsttl and
13207 modifytimestamp. In short, in strict mode the objects with ptrrecord
13208 go away, and the arecord attribute in the forward object is used
13211 <p
>The forward and reverse searches can be simulated using ldapsearch
13212 like this:
</p
>
13214 <blockquote
><pre
>
13215 ldapsearch -h ldap -b ou=hosts,dc=skole,dc=skolelinux,dc=no -s sub -x \
13216 '(associateddomain=tjener.intern)
' dNSTTL aRecord nSRecord \
13217 cNAMERecord sOARecord pTRRecord hInfoRecord mXRecord tXTRecord \
13218 rPRecord aFSDBRecord KeyRecord aAAARecord lOCRecord sRVRecord \
13219 nAPTRRecord kXRecord certRecord dSRecord sSHFPRecord iPSecKeyRecord \
13220 rRSIGRecord nSECRecord dNSKeyRecord dHCIDRecord sPFRecord modifyTimestamp
13222 ldapsearch -h ldap -b ou=hosts,dc=skole,dc=skolelinux,dc=no -s sub -x \
13223 '(arecord=
10.0.2.2)
' associateddomain dnsttl modifytimestamp
13224 </pre
></blockquote
>
13226 <p
>In addition to the forward and reverse searches , there is also a
13227 search for SOA records, which behave similar to the forward and
13228 reverse lookups.
</p
>
13230 <p
>A thing to note with the PowerDNS behaviour is that it do not
13231 specify any objectclass names, and instead look for the attributes it
13232 need to generate a DNS reply. This make it able to work with any
13233 objectclass that provide the needed attributes.
</p
>
13235 <p
>The attributes are normally provided in the cosine (RFC
1274) and
13236 dnsdomain2 schemas. The latter is used for reverse entries like
13237 ptrrecord and recent DNS additions like aaaarecord and srvrecord.
</p
>
13239 <p
>In Debian Edu, we have created DNS objects using the object classes
13240 dcobject (for dc), dnsdomain or dnsdomain2 (structural, for the DNS
13241 attributes) and domainrelatedobject (for associatedDomain). The use
13242 of structural object classes make it impossible to combine these
13243 classes with the object classes used by DHCP.
</p
>
13245 <p
>There are other schemas that could be used too, for example the
13246 dnszone structural object class used by Gosa and bind-sdb for the DNS
13247 attributes combined with the domainrelatedobject object class, but in
13248 this case some unused attributes would have to be included as well
13249 (zonename and relativedomainname).
</p
>
13251 <p
>My proposal for Debian Edu would be to switch PowerDNS to strict
13252 mode and not use any of the existing objectclasses (dnsdomain,
13253 dnsdomain2 and dnszone) when one want to combine the DNS information
13254 with DHCP information, and instead create a auxiliary object class
13255 defined something like this (using the attributes defined for
13256 dnsdomain and dnsdomain2 or dnszone):
</p
>
13258 <blockquote
><pre
>
13259 objectclass ( some-oid NAME
'dnsDomainAux
'
13262 MAY ( ARecord $ MDRecord $ MXRecord $ NSRecord $ SOARecord $ CNAMERecord $
13263 DNSTTL $ DNSClass $ PTRRecord $ HINFORecord $ MINFORecord $
13264 TXTRecord $ SIGRecord $ KEYRecord $ AAAARecord $ LOCRecord $
13265 NXTRecord $ SRVRecord $ NAPTRRecord $ KXRecord $ CERTRecord $
13266 A6Record $ DNAMERecord
13268 </pre
></blockquote
>
13270 <p
>This will allow any object to become a DNS entry when combined with
13271 the domainrelatedobject object class, and allow any entity to include
13272 all the attributes PowerDNS wants. I
've sent an email to the PowerDNS
13273 developers asking for their view on this schema and if they are
13274 interested in providing such schema with PowerDNS, and I hope my
13275 message will be accepted into their mailing list soon.
</p
>
13277 <p
><strong
>ISC dhcp
</strong
></p
>
13279 <p
>The DHCP server searches for specific objectclass and requests all
13280 the object attributes, and then uses the attributes it want. This
13281 make it harder to figure out exactly what attributes are used, but
13282 thanks to the working example in Debian Edu I can at least get an idea
13283 what is needed without having to read the source code.
</p
>
13285 <p
>In the DHCP server configuration, the LDAP base to use and the
13286 search filter to use to locate the correct dhcpServer entity is
13287 stored. These are the relevant entries from
13288 /etc/dhcp3/dhcpd.conf:
</p
>
13290 <blockquote
><pre
>
13291 ldap-base-dn
"dc=skole,dc=skolelinux,dc=no
";
13292 ldap-dhcp-server-cn
"dhcp
";
13293 </pre
></blockquote
>
13295 <p
>The DHCP server uses this information to nest all the DHCP
13296 configuration it need. The cn
"dhcp
" is located using the given LDAP
13297 base and the filter
"(
&(objectClass=dhcpServer)(cn=dhcp))
". The
13298 search result is this entry:
</p
>
13300 <blockquote
><pre
>
13301 dn: cn=dhcp,dc=skole,dc=skolelinux,dc=no
13304 objectClass: dhcpServer
13305 dhcpServiceDN: cn=DHCP Config,dc=skole,dc=skolelinux,dc=no
13306 </pre
></blockquote
>
13308 <p
>The content of the dhcpServiceDN attribute is next used to locate the
13309 subtree with DHCP configuration. The DHCP configuration subtree base
13310 is located using a base scope search with base
"cn=DHCP
13311 Config,dc=skole,dc=skolelinux,dc=no
" and filter
13312 "(
&(objectClass=dhcpService)(|(dhcpPrimaryDN=cn=dhcp,dc=skole,dc=skolelinux,dc=no)(dhcpSecondaryDN=cn=dhcp,dc=skole,dc=skolelinux,dc=no)))
".
13313 The search result is this entry:
</p
>
13315 <blockquote
><pre
>
13316 dn: cn=DHCP Config,dc=skole,dc=skolelinux,dc=no
13319 objectClass: dhcpService
13320 objectClass: dhcpOptions
13321 dhcpPrimaryDN: cn=dhcp, dc=skole,dc=skolelinux,dc=no
13322 dhcpStatements: ddns-update-style none
13323 dhcpStatements: authoritative
13324 dhcpOption: smtp-server code
69 = array of ip-address
13325 dhcpOption: www-server code
72 = array of ip-address
13326 dhcpOption: wpad-url code
252 = text
13327 </pre
></blockquote
>
13329 <p
>Next, the entire subtree is processed, one level at the time. When
13330 all the DHCP configuration is loaded, it is ready to receive requests.
13331 The subtree in Debian Edu contain objects with object classes
13332 top/dhcpService/dhcpOptions, top/dhcpSharedNetwork/dhcpOptions,
13333 top/dhcpSubnet, top/dhcpGroup and top/dhcpHost. These provide options
13334 and information about netmasks, dynamic range etc. Leaving out the
13335 details here because it is not relevant for the focus of my
13336 investigation, which is to see if it is possible to merge dns and dhcp
13337 related computer objects.
</p
>
13339 <p
>When a DHCP request come in, LDAP is searched for the MAC address
13340 of the client (
00:
00:
00:
00:
00:
00 in this example), using a subtree
13341 scoped search with
"cn=DHCP Config,dc=skole,dc=skolelinux,dc=no
" as
13342 the base and
"(
&(objectClass=dhcpHost)(dhcpHWAddress=ethernet
13343 00:
00:
00:
00:
00:
00))
" as the filter. This is what a host object look
13346 <blockquote
><pre
>
13347 dn: cn=hostname,cn=group1,cn=THINCLIENTS,cn=DHCP Config,dc=skole,dc=skolelinux,dc=no
13350 objectClass: dhcpHost
13351 dhcpHWAddress: ethernet
00:
00:
00:
00:
00:
00
13352 dhcpStatements: fixed-address hostname
13353 </pre
></blockquote
>
13355 <p
>There is less flexiblity in the way LDAP searches are done here.
13356 The object classes need to have fixed names, and the configuration
13357 need to be stored in a fairly specific LDAP structure. On the
13358 positive side, the invidiual dhcpHost entires can be anywhere without
13359 the DN pointed to by the dhcpServer entries. The latter should make
13360 it possible to group all host entries in a subtree next to the
13361 configuration entries, and this subtree can also be shared with the
13362 DNS server if the schema proposed above is combined with the dhcpHost
13363 structural object class.
13365 <p
><strong
>Conclusion
</strong
></p
>
13367 <p
>The PowerDNS implementation seem to be very flexible when it come
13368 to which LDAP schemas to use. While its
"tree
" mode is rigid when it
13369 come to the the LDAP structure, the
"strict
" mode is very flexible,
13370 allowing DNS objects to be stored anywhere under the base cn specified
13371 in the configuration.
</p
>
13373 <p
>The DHCP implementation on the other hand is very inflexible, both
13374 regarding which LDAP schemas to use and which LDAP structure to use.
13375 I guess one could implement ones own schema, as long as the
13376 objectclasses and attributes have the names used, but this do not
13377 really help when the DHCP subtree need to have a fairly fixed
13378 structure.
</p
>
13380 <p
>Based on the observed behaviour, I suspect a LDAP structure like
13381 this might work for Debian Edu:
</p
>
13383 <blockquote
><pre
>
13385 cn=machine-info (dhcpService) - dhcpServiceDN points here
13386 cn=dhcp (dhcpServer)
13387 cn=dhcp-internal (dhcpSharedNetwork/dhcpOptions)
13388 cn=
10.0.2.0 (dhcpSubnet)
13389 cn=group1 (dhcpGroup/dhcpOptions)
13390 cn=dhcp-thinclients (dhcpSharedNetwork/dhcpOptions)
13391 cn=
192.168.0.0 (dhcpSubnet)
13392 cn=group1 (dhcpGroup/dhcpOptions)
13393 ou=machines - PowerDNS base points here
13394 cn=hostname (dhcpHost/domainrelatedobject/dnsDomainAux)
13395 </pre
></blockquote
>
13397 <P
>This is not tested yet. If the DHCP server require the dhcpHost
13398 entries to be in the dhcpGroup subtrees, the entries can be stored
13399 there instead of a common machines subtree, and the PowerDNS base
13400 would have to be moved one level up to the machine-info subtree.
</p
>
13402 <p
>The combined object under the machines subtree would look something
13403 like this:
</p
>
13405 <blockquote
><pre
>
13406 dn: dc=hostname,ou=machines,cn=machine-info,dc=skole,dc=skolelinux,dc=no
13409 objectClass: dhcpHost
13410 objectclass: domainrelatedobject
13411 objectclass: dnsDomainAux
13412 associateddomain: hostname.intern
13413 arecord:
10.11.12.13
13414 dhcpHWAddress: ethernet
00:
00:
00:
00:
00:
00
13415 dhcpStatements: fixed-address hostname.intern
13416 </pre
></blockquote
>
13418 </p
>One could even add the LTSP configuration associated with a given
13419 machine, as long as the required attributes are available in a
13420 auxiliary object class.
</p
>
13425 <title>Combining PowerDNS and ISC DHCP LDAP objects
</title>
13426 <link>http://www.hungry.com/~pere/blog/Combining_PowerDNS_and_ISC_DHCP_LDAP_objects.html
</link>
13427 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Combining_PowerDNS_and_ISC_DHCP_LDAP_objects.html
</guid>
13428 <pubDate>Wed,
14 Jul
2010 23:
45:
00 +
0200</pubDate>
13429 <description><p
>For a while now, I have wanted to find a way to change the DNS and
13430 DHCP services in Debian Edu to use the same LDAP objects for a given
13431 computer, to avoid the possibility of having a inconsistent state for
13432 a computer in LDAP (as in DHCP but no DNS entry or the other way
13433 around) and make it easier to add computers to LDAP.
</p
>
13435 <p
>I
've looked at how powerdns and dhcpd is using LDAP, and using this
13436 information finally found a solution that seem to work.
</p
>
13438 <p
>The old setup required three LDAP objects for a given computer.
13439 One forward DNS entry, one reverse DNS entry and one DHCP entry. If
13440 we switch powerdns to use its strict LDAP method (ldap-method=strict
13441 in pdns-debian-edu.conf), the forward and reverse DNS entries are
13442 merged into one while making it impossible to transfer the reverse map
13443 to a slave DNS server.
</p
>
13445 <p
>If we also replace the object class used to get the DNS related
13446 attributes to one allowing these attributes to be combined with the
13447 dhcphost object class, we can merge the DNS and DHCP entries into one.
13448 I
've written such object class in the dnsdomainaux.schema file (need
13449 proper OIDs, but that is a minor issue), and tested the setup. It
13450 seem to work.
</p
>
13452 <p
>With this test setup in place, we can get away with one LDAP object
13453 for both DNS and DHCP, and even the LTSP configuration I suggested in
13454 an earlier email. The combined LDAP object will look something like
13457 <blockquote
><pre
>
13458 dn: cn=hostname,cn=group1,cn=THINCLIENTS,cn=DHCP Config,dc=skole,dc=skolelinux,dc=no
13460 objectClass: dhcphost
13461 objectclass: domainrelatedobject
13462 objectclass: dnsdomainaux
13463 associateddomain: hostname.intern
13464 arecord:
10.11.12.13
13465 dhcphwaddress: ethernet
00:
00:
00:
00:
00:
00
13466 dhcpstatements: fixed-address hostname
13468 </pre
></blockquote
>
13470 <p
>The DNS server uses the associateddomain and arecord entries, while
13471 the DHCP server uses the dhcphwaddress and dhcpstatements entries
13472 before asking DNS to resolve the fixed-adddress. LTSP will use
13473 dhcphwaddress or associateddomain and the ldapconfig* attributes.
</p
>
13475 <p
>I am not yet sure if I can get the DHCP server to look for its
13476 dhcphost in a different location, to allow us to put the objects
13477 outside the
"DHCP Config
" subtree, but hope to figure out a way to do
13478 that. If I can
't figure out a way to do that, we can still get rid of
13479 the hosts subtree and move all its content into the DHCP Config tree
13480 (which probably should be renamed to be more related to the new
13481 content. I suspect cn=dnsdhcp,ou=services or something like that
13482 might be a good place to put it.
</p
>
13484 <p
>If you want to help out with implementing this for Debian Edu,
13485 please contact us on debian-edu@lists.debian.org.
</p
>
13490 <title>Idea for storing LTSP configuration in LDAP
</title>
13491 <link>http://www.hungry.com/~pere/blog/Idea_for_storing_LTSP_configuration_in_LDAP.html
</link>
13492 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Idea_for_storing_LTSP_configuration_in_LDAP.html
</guid>
13493 <pubDate>Sun,
11 Jul
2010 22:
00:
00 +
0200</pubDate>
13494 <description><p
>Vagrant mentioned on IRC today that ltsp_config now support
13495 sourcing files from /usr/share/ltsp/ltsp_config.d/ on the thin
13496 clients, and that this can be used to fetch configuration from LDAP if
13497 Debian Edu choose to store configuration there.
</p
>
13499 <p
>Armed with this information, I got inspired and wrote a test module
13500 to get configuration from LDAP. The idea is to look up the MAC
13501 address of the client in LDAP, and look for attributes on the form
13502 ltspconfigsetting=value, and use this to export SETTING=value to the
13503 LTSP clients.
</p
>
13505 <p
>The goal is to be able to store the LTSP configuration attributes
13506 in a
"computer
" LDAP object used by both DNS and DHCP, and thus
13507 allowing us to store all information about a computer in one place.
</p
>
13509 <p
>This is a untested draft implementation, and I welcome feedback on
13510 this approach. A real LDAP schema for the ltspClientAux objectclass
13511 need to be written. Comments, suggestions, etc?
</p
>
13513 <blockquote
><pre
>
13514 # Store in /opt/ltsp/$arch/usr/share/ltsp/ltsp_config.d/ldap-config
13516 # Fetch LTSP client settings from LDAP based on MAC address
13518 # Uses ethernet address as stored in the dhcpHost objectclass using
13519 # the dhcpHWAddress attribute or ethernet address stored in the
13520 # ieee802Device objectclass with the macAddress attribute.
13522 # This module is written to be schema agnostic, and only depend on the
13523 # existence of attribute names.
13525 # The LTSP configuration variables are saved directly using a
13526 # ltspConfig prefix and uppercasing the rest of the attribute name.
13527 # To set the SERVER variable, set the ltspConfigServer attribute.
13529 # Some LDAP schema should be created with all the relevant
13530 # configuration settings. Something like this should work:
13532 # objectclass (
1.1.2.2 NAME
'ltspClientAux
'
13535 # MAY ( ltspConfigServer $ ltsConfigSound $ ... )
13537 LDAPSERVER=$(debian-edu-ldapserver)
13538 if [
"$LDAPSERVER
" ] ; then
13539 LDAPBASE=$(debian-edu-ldapserver -b)
13540 for MAC in $(LANG=C ifconfig |grep -i hwaddr| awk
'{print $
5}
'|sort -u) ; do
13541 filter=
"(|(dhcpHWAddress=ethernet $MAC)(macAddress=$MAC))
"
13542 ldapsearch -h
"$LDAPSERVER
" -b
"$LDAPBASE
" -v -x
"$filter
" | \
13543 grep
'^ltspConfig
' | while read attr value ; do
13544 # Remove prefix and convert to upper case
13545 attr=$(echo $attr | sed
's/^ltspConfig//i
' | tr a-z A-Z)
13546 # bass value on to clients
13547 eval
"$attr=$value; export $attr
"
13551 </pre
></blockquote
>
13553 <p
>I
'm not sure this shell construction will work, because I suspect
13554 the while block might end up in a subshell causing the variables set
13555 there to not show up in ltsp-config, but if that is the case I am sure
13556 the code can be restructured to make sure the variables are passed on.
13557 I expect that can be solved with some testing. :)
</p
>
13559 <p
>If you want to help out with implementing this for Debian Edu,
13560 please contact us on debian-edu@lists.debian.org.
</p
>
13562 <p
>Update
2010-
07-
17: I am aware of another effort to store LTSP
13563 configuration in LDAP that was created around year
2000 by
13564 <a href=
"http://www.pcxperience.com/thinclient/documentation/ldap.html
">PC
13565 Xperience, Inc.,
2000</a
>. I found its
13566 <a href=
"http://people.redhat.com/alikins/ltsp/ldap/
">files
</a
> on a
13567 personal home page over at redhat.com.
</p
>
13572 <title>jXplorer, a very nice LDAP GUI
</title>
13573 <link>http://www.hungry.com/~pere/blog/jXplorer__a_very_nice_LDAP_GUI.html
</link>
13574 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/jXplorer__a_very_nice_LDAP_GUI.html
</guid>
13575 <pubDate>Fri,
9 Jul
2010 12:
55:
00 +
0200</pubDate>
13576 <description><p
>Since
13577 <a href=
"http://www.hungry.com/~pere/blog/LUMA__a_very_nice_LDAP_GUI.html
">my
13578 last post
</a
> about available LDAP tools in Debian, I was told about a
13579 LDAP GUI that is even better than luma. The java application
13580 <a href=
"http://jxplorer.org/
">jXplorer
</a
> is claimed to be capable of
13581 moving LDAP objects and subtrees using drag-and-drop, and can
13582 authenticate using Kerberos. I have only tested the Kerberos
13583 authentication, but do not have a LDAP setup allowing me to rewrite
13584 LDAP with my test user yet. It is
13585 <a href=
"http://packages.qa.debian.org/j/jxplorer.html
">available in
13586 Debian
</a
> testing and unstable at the moment. The only problem I
13587 have with it is how it handle errors. If something go wrong, its
13588 non-intuitive behaviour require me to go through some query work list
13589 and remove the failing query. Nothing big, but very annoying.
</p
>
13594 <title>Lenny-
>Squeeze upgrades, apt vs aptitude with the Gnome desktop
</title>
13595 <link>http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades__apt_vs_aptitude_with_the_Gnome_desktop.html
</link>
13596 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades__apt_vs_aptitude_with_the_Gnome_desktop.html
</guid>
13597 <pubDate>Sat,
3 Jul
2010 23:
55:
00 +
0200</pubDate>
13598 <description><p
>Here is a short update on my
<a
13599 href=
"https://people.skolelinux.org/~pere/debian-upgrade-testing/
">my
13600 Debian Lenny-
>Squeeze upgrade testing
</a
>. Here is a summary of the
13601 difference for Gnome when it is upgraded by apt-get and aptitude. I
'm
13602 not reporting the status for KDE, because the upgrade crashes when
13603 aptitude try because of missing conflicts
13604 (
<a href=
"http://bugs.debian.org/
584861">#
584861</a
> and
13605 <a href=
"http://bugs.debian.org/
585716">#
585716</a
>).
</p
>
13607 <p
>At the end of the upgrade test script, dpkg -l is executed to get a
13608 complete list of the installed packages. Based on this I see these
13609 differences when I did a test run today. As usual, I do not really
13610 know what the correct set of packages would be, but thought it best to
13611 publish the difference.
</p
>
13613 <p
>Installed using apt-get, missing with aptitude
</p
>
13615 <blockquote
><p
>
13616 at-spi cpp-
4.3 finger gnome-spell gstreamer0.10-gnomevfs
13617 libatspi1.0-
0 libcupsys2 libeel2-data libgail-common libgdl-
1-common
13618 libgnomeprint2.2-data libgnomeprintui2.2-common libgnomevfs2-bin
13619 libgtksourceview-common libpt-
1.10.10-plugins-alsa
13620 libpt-
1.10.10-plugins-v4l libservlet2.4-java libxalan2-java
13621 libxerces2-java openoffice.org-writer2latex openssl-blacklist p7zip
13622 python-
4suite-xml python-eggtrayicon python-gtkhtml2
13623 python-gtkmozembed svgalibg1 xserver-xephyr zip
13624 </p
></blockquote
>
13626 <p
>Installed using apt-get, removed with aptitude
</p
>
13628 <blockquote
><p
>
13629 bluez-utils dhcdbd djvulibre-desktop epiphany-gecko
13630 gnome-app-install gnome-mount gnome-vfs-obexftp gnome-volume-manager
13631 libao2 libavahi-compat-libdnssd1 libavahi-core5 libbind9-
50
13632 libbluetooth2 libcamel1.2-
11 libcdio7 libcucul0 libcurl3
13633 libdirectfb-
1.0-
0 libdvdread3 libedata-cal1.2-
6 libedataserver1.2-
9
13634 libeel2-
2.20 libepc-
1.0-
1 libepc-ui-
1.0-
1 libexchange-storage1.2-
3
13635 libfaad0 libgd2-noxpm libgda3-
3 libgda3-common libggz2 libggzcore9
13636 libggzmod4 libgksu1.2-
0 libgksuui1.0-
1 libgmyth0 libgnome-desktop-
2
13637 libgnome-pilot2 libgnomecups1.0-
1 libgnomeprint2.2-
0
13638 libgnomeprintui2.2-
0 libgpod3 libgraphviz4 libgtkhtml2-
0
13639 libgtksourceview1.0-
0 libgucharmap6 libhesiod0 libicu38 libisccc50
13640 libisccfg50 libiw29 libkpathsea4 libltdl3 liblwres50 libmagick++
10
13641 libmagick10 libmalaga7 libmtp7 libmysqlclient15off libnautilus-burn4
13642 libneon27 libnm-glib0 libnm-util0 libopal-
2.2 libosp5
13643 libparted1.8-
10 libpisock9 libpisync1 libpoppler-glib3 libpoppler3
13644 libpt-
1.10.10 libraw1394-
8 libsensors3 libsmbios2 libsoup2.2-
8
13645 libssh2-
1 libsuitesparse-
3.1.0 libswfdec-
0.6-
90 libtalloc1
13646 libtotem-plparser10 libtrackerclient0 libvoikko1 libxalan2-java-gcj
13647 libxerces2-java-gcj libxklavier12 libxtrap6 libxxf86misc1 libzephyr3
13648 mysql-common swfdec-gnome totem-gstreamer wodim
13649 </p
></blockquote
>
13651 <p
>Installed using aptitude, missing with apt-get
</p
>
13653 <blockquote
><p
>
13654 gnome gnome-desktop-environment hamster-applet python-gnomeapplet
13655 python-gnomekeyring python-wnck rhythmbox-plugins xorg
13656 xserver-xorg-input-all xserver-xorg-input-evdev
13657 xserver-xorg-input-kbd xserver-xorg-input-mouse
13658 xserver-xorg-input-synaptics xserver-xorg-video-all
13659 xserver-xorg-video-apm xserver-xorg-video-ark xserver-xorg-video-ati
13660 xserver-xorg-video-chips xserver-xorg-video-cirrus
13661 xserver-xorg-video-dummy xserver-xorg-video-fbdev
13662 xserver-xorg-video-glint xserver-xorg-video-i128
13663 xserver-xorg-video-i740 xserver-xorg-video-mach64
13664 xserver-xorg-video-mga xserver-xorg-video-neomagic
13665 xserver-xorg-video-nouveau xserver-xorg-video-nv
13666 xserver-xorg-video-r128 xserver-xorg-video-radeon
13667 xserver-xorg-video-radeonhd xserver-xorg-video-rendition
13668 xserver-xorg-video-s3 xserver-xorg-video-s3virge
13669 xserver-xorg-video-savage xserver-xorg-video-siliconmotion
13670 xserver-xorg-video-sis xserver-xorg-video-sisusb
13671 xserver-xorg-video-tdfx xserver-xorg-video-tga
13672 xserver-xorg-video-trident xserver-xorg-video-tseng
13673 xserver-xorg-video-vesa xserver-xorg-video-vmware
13674 xserver-xorg-video-voodoo
13675 </p
></blockquote
>
13677 <p
>Installed using aptitude, removed with apt-get
</p
>
13679 <blockquote
><p
>
13680 deskbar-applet xserver-xorg xserver-xorg-core
13681 xserver-xorg-input-wacom xserver-xorg-video-intel
13682 xserver-xorg-video-openchrome
13683 </p
></blockquote
>
13685 <p
>I was told on IRC that the xorg-xserver package was
13686 <a href=
"http://git.debian.org/?p=pkg-xorg/xserver/xorg-server.git;a=commit;h=
9c8080d06c457932d3bfec021c69ac000aa60120
">changed
13687 in git
</a
> today to try to get apt-get to not remove xorg completely.
13688 No idea when it hits Squeeze, but when it does I hope it will reduce
13689 the difference somewhat.
13694 <title>LUMA, a very nice LDAP GUI
</title>
13695 <link>http://www.hungry.com/~pere/blog/LUMA__a_very_nice_LDAP_GUI.html
</link>
13696 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/LUMA__a_very_nice_LDAP_GUI.html
</guid>
13697 <pubDate>Mon,
28 Jun
2010 00:
30:
00 +
0200</pubDate>
13698 <description><p
>The last few days I have been looking into the status of the LDAP
13699 directory in Debian Edu, and in the process I started to miss a GUI
13700 tool to browse the LDAP tree. The only one I was able to find in
13701 Debian/Squeeze and Lenny is
13702 <a href=
"http://luma.sourceforge.net/
">LUMA
</a
>, which has proved to
13703 be a great tool to get a overview of the current LDAP directory
13704 populated by default in Skolelinux. Thanks to it, I have been able to
13705 find empty and obsolete subtrees, misplaced objects and duplicate
13706 objects. It will be installed by default in Debian/Squeeze. If you
13707 are working with LDAP, give it a go. :)
</p
>
13709 <p
>I did notice one problem with it I have not had time to report to
13710 the BTS yet. There is no .desktop file in the package, so the tool do
13711 not show up in the Gnome and KDE menus, but only deep down in in the
13712 Debian submenu in KDE. I hope that can be fixed before Squeeze is
13713 released.
</p
>
13715 <p
>I have not yet been able to get it to modify the tree yet. I would
13716 like to move objects and remove subtrees directly in the GUI, but have
13717 not found a way to do that with LUMA yet. So in the mean time, I use
13718 <a href=
"http://www.lichteblau.com/ldapvi/
">ldapvi
</a
> for that.
</p
>
13720 <p
>If you have tips on other GUI tools for LDAP that might be useful
13721 in Debian Edu, please contact us on debian-edu@lists.debian.org.
</p
>
13723 <p
>Update
2010-
06-
29: Ross Reedstrom tipped us about the
13724 <a href=
"http://packages.qa.debian.org/g/gq.html
">gq
</a
> package as a
13725 useful GUI alternative. It seem like a good tool, but is unmaintained
13726 in Debian and got a RC bug keeping it out of Squeeze. Unless that
13727 changes, it will not be an option for Debian Edu based on Squeeze.
</p
>
13732 <title>Idea for a change to LDAP schemas allowing DNS and DHCP info to be combined into one object
</title>
13733 <link>http://www.hungry.com/~pere/blog/Idea_for_a_change_to_LDAP_schemas_allowing_DNS_and_DHCP_info_to_be_combined_into_one_object.html
</link>
13734 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Idea_for_a_change_to_LDAP_schemas_allowing_DNS_and_DHCP_info_to_be_combined_into_one_object.html
</guid>
13735 <pubDate>Thu,
24 Jun
2010 00:
35:
00 +
0200</pubDate>
13736 <description><p
>A while back, I
13737 <a href=
"http://www.hungry.com/~pere/blog/Time_for_new__LDAP_schemas_replacing_RFC_2307_.html
">complained
13738 about the fact
</a
> that it is not possible with the provided schemas
13739 for storing DNS and DHCP information in LDAP to combine the two sets
13740 of information into one LDAP object representing a computer.
</p
>
13742 <p
>In the mean time, I discovered that a simple fix would be to make
13743 the dhcpHost object class auxiliary, to allow it to be combined with
13744 the dNSDomain object class, and thus forming one object for one
13745 computer when storing both DHCP and DNS information in LDAP.
</p
>
13747 <p
>If I understand this correctly, it is not safe to do this change
13748 without also changing the assigned number for the object class, and I
13749 do not know enough about LDAP schema design to do that properly for
13750 Debian Edu.
</p
>
13752 <p
>Anyway, for future reference, this is how I believe we could change
13754 <a href=
"http://tools.ietf.org/html/draft-ietf-dhc-ldap-schema-
00">DHCP
13755 schema
</a
> to solve at least part of the problem with the LDAP schemas
13756 available today from IETF.
</p
>
13759 --- dhcp.schema (revision
65192)
13760 +++ dhcp.schema (working copy)
13761 @@ -
376,
7 +
376,
7 @@
13762 objectclass (
2.16.840.1.113719.1.203.6.6
13763 NAME
'dhcpHost
'
13764 DESC
'This represents information about a particular client
'
13766 + SUP top AUXILIARY
13768 MAY (dhcpLeaseDN $ dhcpHWAddress $ dhcpOptionsDN $ dhcpStatements $ dhcpComments $ dhcpOption)
13769 X-NDS_CONTAINMENT (
'dhcpService
' 'dhcpSubnet
' 'dhcpGroup
') )
13772 <p
>I very much welcome clues on how to do this properly for Debian
13773 Edu/Squeeze. We provide the DHCP schema in our debian-edu-config
13774 package, and should thus be free to rewrite it as we see fit.
</p
>
13776 <p
>If you want to help out with implementing this for Debian Edu,
13777 please contact us on debian-edu@lists.debian.org.
</p
>
13782 <title>Calling tasksel like the installer, while still getting useful output
</title>
13783 <link>http://www.hungry.com/~pere/blog/Calling_tasksel_like_the_installer__while_still_getting_useful_output.html
</link>
13784 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Calling_tasksel_like_the_installer__while_still_getting_useful_output.html
</guid>
13785 <pubDate>Wed,
16 Jun
2010 14:
55:
00 +
0200</pubDate>
13786 <description><p
>A few times I have had the need to simulate the way tasksel
13787 installs packages during the normal debian-installer run. Until now,
13788 I have ended up letting tasksel do the work, with the annoying problem
13789 of not getting any feedback at all when something fails (like a
13790 conffile question from dpkg or a download that fails), using code like
13793 <blockquote
><pre
>
13794 export DEBIAN_FRONTEND=noninteractive
13795 tasksel --new-install
13796 </pre
></blockquote
>
13798 This would invoke tasksel, let its automatic task selection pick the
13799 tasks to install, and continue to install the requested tasks without
13800 any output what so ever.
13802 Recently I revisited this problem while working on the automatic
13803 package upgrade testing, because tasksel would some times hang without
13804 any useful feedback, and I want to see what is going on when it
13805 happen. Then it occured to me, I can parse the output from tasksel
13806 when asked to run in test mode, and use that aptitude command line
13807 printed by tasksel then to simulate the tasksel run. I ended up using
13810 <blockquote
><pre
>
13811 export DEBIAN_FRONTEND=noninteractive
13812 cmd=
"$(in_target tasksel -t --new-install | sed
's/debconf-apt-progress -- //
')
"
13814 </pre
></blockquote
>
13816 <p
>The content of $cmd is typically something like
"<tt
>aptitude -q
13817 --without-recommends -o APT::Install-Recommends=no -y install
13818 ~t^desktop$ ~t^gnome-desktop$ ~t^laptop$ ~pstandard ~prequired
13819 ~pimportant
</tt
>", which will install the gnome desktop task, the
13820 laptop task and all packages with priority standard , required and
13821 important, just like tasksel would have done it during
13822 installation.
</p
>
13824 <p
>A better approach is probably to extend tasksel to be able to
13825 install packages without using debconf-apt-progress, for use cases
13826 like this.
</p
>
13831 <title>Lenny-
>Squeeze upgrades, removals by apt and aptitude
</title>
13832 <link>http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades__removals_by_apt_and_aptitude.html
</link>
13833 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades__removals_by_apt_and_aptitude.html
</guid>
13834 <pubDate>Sun,
13 Jun
2010 09:
05:
00 +
0200</pubDate>
13835 <description><p
>My
13836 <a href=
"http://www.hungry.com/~pere/blog/Automatic_upgrade_testing_from_Lenny_to_Squeeze.html
">testing
13837 of Debian upgrades
</a
> from Lenny to Squeeze continues, and I
've
13838 finally made the upgrade logs available from
13839 <a href=
"http://www.hungry.com/~pere/debian-upgrade-testing/
">http://www.hungry.com/~pere/debian-upgrade-testing/
</a
>.
13840 I am now testing dist-upgrade of Gnome and KDE in a chroot using both
13841 apt and aptitude, and found their differences interesting. This time
13842 I will only focus on their removal plans.
</p
>
13844 <p
>After installing a Gnome desktop and the laptop task, apt-get wants
13845 to remove
72 packages when dist-upgrading from Lenny to Squeeze. The
13846 surprising part is that it want to remove xorg and all
13847 xserver-xorg-video* drivers. Clearly not a good choice, but I am not
13848 sure why. When asking aptitude to do the same, it want to remove
129
13849 packages, but most of them are library packages I suspect are no
13850 longer needed. Both of them want to remove bluetooth packages, which
13851 I do not know. Perhaps these bluetooth packages are obsolete?
</p
>
13853 <p
>For KDE, apt-get want to remove
82 packages, among them kdebase
13854 which seem like a bad idea and xorg the same way as with Gnome. Asking
13855 aptitude for the same, it wants to remove
192 packages, none which are
13856 too surprising.
</p
>
13858 <p
>I guess the removal of xorg during upgrades should be investigated
13859 and avoided, and perhaps others as well. Here are the complete list
13860 of planned removals. The complete logs is available from the URL
13861 above. Note if you want to repeat these tests, that the upgrade test
13862 for kde+apt-get hung in the tasksel setup because of dpkg asking
13863 conffile questions. No idea why. I worked around it by using
13864 '<tt
>echo
>> /proc/
<em
>pidofdpkg
</em
>/fd/
0</tt
>' to tell dpkg to
13865 continue.
</p
>
13867 <p
><b
>apt-get gnome
72</b
>
13868 <br
>bluez-gnome cupsddk-drivers deskbar-applet gnome
13869 gnome-desktop-environment gnome-network-admin gtkhtml3.14
13870 iceweasel-gnome-support libavcodec51 libdatrie0 libgdl-
1-
0
13871 libgnomekbd2 libgnomekbdui2 libmetacity0 libslab0 libxcb-xlib0
13872 nautilus-cd-burner python-gnome2-desktop python-gnome2-extras
13873 serpentine swfdec-mozilla update-manager xorg xserver-xorg
13874 xserver-xorg-core xserver-xorg-input-all xserver-xorg-input-evdev
13875 xserver-xorg-input-kbd xserver-xorg-input-mouse
13876 xserver-xorg-input-synaptics xserver-xorg-input-wacom
13877 xserver-xorg-video-all xserver-xorg-video-apm xserver-xorg-video-ark
13878 xserver-xorg-video-ati xserver-xorg-video-chips
13879 xserver-xorg-video-cirrus xserver-xorg-video-cyrix
13880 xserver-xorg-video-dummy xserver-xorg-video-fbdev
13881 xserver-xorg-video-glint xserver-xorg-video-i128
13882 xserver-xorg-video-i740 xserver-xorg-video-imstt
13883 xserver-xorg-video-intel xserver-xorg-video-mach64
13884 xserver-xorg-video-mga xserver-xorg-video-neomagic
13885 xserver-xorg-video-nsc xserver-xorg-video-nv
13886 xserver-xorg-video-openchrome xserver-xorg-video-r128
13887 xserver-xorg-video-radeon xserver-xorg-video-radeonhd
13888 xserver-xorg-video-rendition xserver-xorg-video-s3
13889 xserver-xorg-video-s3virge xserver-xorg-video-savage
13890 xserver-xorg-video-siliconmotion xserver-xorg-video-sis
13891 xserver-xorg-video-sisusb xserver-xorg-video-tdfx
13892 xserver-xorg-video-tga xserver-xorg-video-trident
13893 xserver-xorg-video-tseng xserver-xorg-video-v4l
13894 xserver-xorg-video-vesa xserver-xorg-video-vga
13895 xserver-xorg-video-vmware xserver-xorg-video-voodoo xulrunner-
1.9
13896 xulrunner-
1.9-gnome-support
</p
>
13898 <p
><b
>aptitude gnome
129</b
>
13900 <br
>bluez-gnome bluez-utils cpp-
4.3 cupsddk-drivers dhcdbd
13901 djvulibre-desktop finger gnome-app-install gnome-mount
13902 gnome-network-admin gnome-spell gnome-vfs-obexftp
13903 gnome-volume-manager gstreamer0.10-gnomevfs gtkhtml3.14 libao2
13904 libavahi-compat-libdnssd1 libavahi-core5 libavcodec51 libbluetooth2
13905 libcamel1.2-
11 libcdio7 libcucul0 libcupsys2 libcurl3 libdatrie0
13906 libdirectfb-
1.0-
0 libdvdread3 libedataserver1.2-
9 libeel2-
2.20
13907 libeel2-data libepc-
1.0-
1 libepc-ui-
1.0-
1 libfaad0 libgail-common
13908 libgd2-noxpm libgda3-
3 libgda3-common libgdl-
1-
0 libgdl-
1-common
13909 libggz2 libggzcore9 libggzmod4 libgksu1.2-
0 libgksuui1.0-
1 libgmyth0
13910 libgnomecups1.0-
1 libgnomekbd2 libgnomekbdui2 libgnomeprint2.2-
0
13911 libgnomeprint2.2-data libgnomeprintui2.2-
0 libgnomeprintui2.2-common
13912 libgnomevfs2-bin libgpod3 libgraphviz4 libgtkhtml2-
0
13913 libgtksourceview-common libgtksourceview1.0-
0 libgucharmap6
13914 libhesiod0 libicu38 libiw29 libkpathsea4 libltdl3 libmagick++
10
13915 libmagick10 libmalaga7 libmetacity0 libmtp7 libmysqlclient15off
13916 libnautilus-burn4 libneon27 libnm-glib0 libnm-util0 libopal-
2.2
13917 libosp5 libparted1.8-
10 libpoppler-glib3 libpoppler3 libpt-
1.10.10
13918 libpt-
1.10.10-plugins-alsa libpt-
1.10.10-plugins-v4l libraw1394-
8
13919 libsensors3 libslab0 libsmbios2 libsoup2.2-
8 libssh2-
1
13920 libsuitesparse-
3.1.0 libswfdec-
0.6-
90 libtalloc1 libtotem-plparser10
13921 libtrackerclient0 libxalan2-java libxalan2-java-gcj libxcb-xlib0
13922 libxerces2-java libxerces2-java-gcj libxklavier12 libxtrap6
13923 libxxf86misc1 libzephyr3 mysql-common nautilus-cd-burner
13924 openoffice.org-writer2latex openssl-blacklist p7zip
13925 python-
4suite-xml python-eggtrayicon python-gnome2-desktop
13926 python-gnome2-extras python-gtkhtml2 python-gtkmozembed
13927 python-numeric python-sexy serpentine svgalibg1 swfdec-gnome
13928 swfdec-mozilla totem-gstreamer update-manager wodim
13929 xserver-xorg-video-cyrix xserver-xorg-video-imstt
13930 xserver-xorg-video-nsc xserver-xorg-video-v4l xserver-xorg-video-vga
13933 <p
><b
>apt-get kde
82</b
>
13935 <br
>cupsddk-drivers karm kaudiocreator kcoloredit kcontrol kde kde-core
13936 kdeaddons kdeartwork kdebase kdebase-bin kdebase-bin-kde3
13937 kdebase-kio-plugins kdesktop kdeutils khelpcenter kicker
13938 kicker-applets knewsticker kolourpaint konq-plugins konqueror korn
13939 kpersonalizer kscreensaver ksplash libavcodec51 libdatrie0 libkiten1
13940 libxcb-xlib0 quanta superkaramba texlive-base-bin xorg xserver-xorg
13941 xserver-xorg-core xserver-xorg-input-all xserver-xorg-input-evdev
13942 xserver-xorg-input-kbd xserver-xorg-input-mouse
13943 xserver-xorg-input-synaptics xserver-xorg-input-wacom
13944 xserver-xorg-video-all xserver-xorg-video-apm xserver-xorg-video-ark
13945 xserver-xorg-video-ati xserver-xorg-video-chips
13946 xserver-xorg-video-cirrus xserver-xorg-video-cyrix
13947 xserver-xorg-video-dummy xserver-xorg-video-fbdev
13948 xserver-xorg-video-glint xserver-xorg-video-i128
13949 xserver-xorg-video-i740 xserver-xorg-video-imstt
13950 xserver-xorg-video-intel xserver-xorg-video-mach64
13951 xserver-xorg-video-mga xserver-xorg-video-neomagic
13952 xserver-xorg-video-nsc xserver-xorg-video-nv
13953 xserver-xorg-video-openchrome xserver-xorg-video-r128
13954 xserver-xorg-video-radeon xserver-xorg-video-radeonhd
13955 xserver-xorg-video-rendition xserver-xorg-video-s3
13956 xserver-xorg-video-s3virge xserver-xorg-video-savage
13957 xserver-xorg-video-siliconmotion xserver-xorg-video-sis
13958 xserver-xorg-video-sisusb xserver-xorg-video-tdfx
13959 xserver-xorg-video-tga xserver-xorg-video-trident
13960 xserver-xorg-video-tseng xserver-xorg-video-v4l
13961 xserver-xorg-video-vesa xserver-xorg-video-vga
13962 xserver-xorg-video-vmware xserver-xorg-video-voodoo xulrunner-
1.9</p
>
13964 <p
><b
>aptitude kde
192</b
>
13965 <br
>bluez-utils cpp-
4.3 cupsddk-drivers cvs dcoprss dhcdbd
13966 djvulibre-desktop dosfstools eyesapplet fifteenapplet finger gettext
13967 ghostscript-x imlib-base imlib11 indi kandy karm kasteroids
13968 kaudiocreator kbackgammon kbstate kcoloredit kcontrol kcron kdat
13969 kdeadmin-kfile-plugins kdeartwork-misc kdeartwork-theme-window
13970 kdebase-bin-kde3 kdebase-kio-plugins kdeedu-data
13971 kdegraphics-kfile-plugins kdelirc kdemultimedia-kappfinder-data
13972 kdemultimedia-kfile-plugins kdenetwork-kfile-plugins
13973 kdepim-kfile-plugins kdepim-kio-plugins kdeprint kdesktop kdessh
13974 kdict kdnssd kdvi kedit keduca kenolaba kfax kfaxview kfouleggs
13975 kghostview khelpcenter khexedit kiconedit kitchensync klatin
13976 klickety kmailcvt kmenuedit kmid kmilo kmoon kmrml kodo kolourpaint
13977 kooka korn kpager kpdf kpercentage kpf kpilot kpoker kpovmodeler
13978 krec kregexpeditor ksayit ksim ksirc ksirtet ksmiletris ksmserver
13979 ksnake ksokoban ksplash ksvg ksysv ktip ktnef kuickshow kverbos
13980 kview kviewshell kvoctrain kwifimanager kwin kwin4 kworldclock
13981 kxsldbg libakode2 libao2 libarts1-akode libarts1-audiofile
13982 libarts1-mpeglib libarts1-xine libavahi-compat-libdnssd1
13983 libavahi-core5 libavc1394-
0 libavcodec51 libbluetooth2
13984 libboost-python1.34
.1 libcucul0 libcurl3 libcvsservice0 libdatrie0
13985 libdirectfb-
1.0-
0 libdjvulibre21 libdvdread3 libfaad0 libfreebob0
13986 libgail-common libgd2-noxpm libgraphviz4 libgsmme1c2a libgtkhtml2-
0
13987 libicu38 libiec61883-
0 libindex0 libiw29 libk3b3 libkcal2b libkcddb1
13988 libkdeedu3 libkdepim1a libkgantt0 libkiten1 libkleopatra1 libkmime2
13989 libkpathsea4 libkpimexchange1 libkpimidentities1 libkscan1
13990 libksieve0 libktnef1 liblockdev1 libltdl3 libmagick10 libmimelib1c2a
13991 libmozjs1d libmpcdec3 libneon27 libnm-util0 libopensync0 libpisock9
13992 libpoppler-glib3 libpoppler-qt2 libpoppler3 libraw1394-
8 libsmbios2
13993 libssh2-
1 libsuitesparse-
3.1.0 libtalloc1 libtiff-tools
13994 libxalan2-java libxalan2-java-gcj libxcb-xlib0 libxerces2-java
13995 libxerces2-java-gcj libxtrap6 mpeglib networkstatus
13996 openoffice.org-writer2latex pmount poster psutils quanta quanta-data
13997 superkaramba svgalibg1 tex-common texlive-base texlive-base-bin
13998 texlive-common texlive-doc-base texlive-fonts-recommended
13999 xserver-xorg-video-cyrix xserver-xorg-video-imstt
14000 xserver-xorg-video-nsc xserver-xorg-video-v4l xserver-xorg-video-vga
14001 xulrunner-
1.9</p
>
14007 <title>Automatic upgrade testing from Lenny to Squeeze
</title>
14008 <link>http://www.hungry.com/~pere/blog/Automatic_upgrade_testing_from_Lenny_to_Squeeze.html
</link>
14009 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Automatic_upgrade_testing_from_Lenny_to_Squeeze.html
</guid>
14010 <pubDate>Fri,
11 Jun
2010 22:
50:
00 +
0200</pubDate>
14011 <description><p
>The last few days I have done some upgrade testing in Debian, to
14012 see if the upgrade from Lenny to Squeeze will go smoothly. A few bugs
14013 have been discovered and reported in the process
14014 (
<a href=
"http://bugs.debian.org/
585410">#
585410</a
> in nagios3-cgi,
14015 <a href=
"http://bugs.debian.org/
584879">#
584879</a
> already fixed in
14016 enscript and
<a href=
"http://bugs.debian.org/
584861">#
584861</a
> in
14017 kdebase-workspace-data), and to get a more regular testing going on, I
14018 am working on a script to automate the test.
</p
>
14020 <p
>The idea is to create a Lenny chroot and use tasksel to install a
14021 Gnome or KDE desktop installation inside the chroot before upgrading
14022 it. To ensure no services are started in the chroot, a policy-rc.d
14023 script is inserted. To make sure tasksel believe it is to install a
14024 desktop on a laptop, the tasksel tests are replaced in the chroot
14025 (only acceptable because this is a throw-away chroot).
</p
>
14027 <p
>A naive upgrade from Lenny to Squeeze using aptitude dist-upgrade
14028 currently always fail because udev refuses to upgrade with the kernel
14029 in Lenny, so to avoid that problem the file /etc/udev/kernel-upgrade
14030 is created. The bug report
14031 <a href=
"http://bugs.debian.org/
566000">#
566000</a
> make me suspect
14032 this problem do not trigger in a chroot, but I touch the file anyway
14033 to make sure the upgrade go well. Testing on virtual and real
14034 hardware have failed me because of udev so far, and creating this file
14035 do the trick in such settings anyway. This is a
14036 <a href=
"http://www.linuxquestions.org/questions/debian-
26/failed-dist-upgrade-due-to-udev-config_sysfs_deprecated-nonsense-
804130/
">known
14037 issue
</a
> and the current udev behaviour is intended by the udev
14038 maintainer because he lack the resources to rewrite udev to keep
14039 working with old kernels or something like that. I really wish the
14040 udev upstream would keep udev backwards compatible, to avoid such
14041 upgrade problem, but given that they fail to do so, I guess
14042 documenting the way out of this mess is the best option we got for
14043 Debian Squeeze.
</p
>
14045 <p
>Anyway, back to the task at hand, testing upgrades. This test
14046 script, which I call
<tt
>upgrade-test
</tt
> for now, is doing the
14049 <blockquote
><pre
>
14053 if [
"$
1" ] ; then
14062 exec
&lt; /dev/null
14064 mirror=http://ftp.skolelinux.org/debian
14065 tmpdir=chroot-$from-upgrade-$to-$desktop
14067 debootstrap $from $tmpdir $mirror
14068 chroot $tmpdir aptitude update
14069 cat
> $tmpdir/usr/sbin/policy-rc.d
&lt;
&lt;EOF
14073 chmod a+rx $tmpdir/usr/sbin/policy-rc.d
14075 umount $tmpdir/proc
14077 mount -t proc proc $tmpdir/proc
14078 # Make sure proc is unmounted also on failure
14079 trap exit_cleanup EXIT INT
14081 chroot $tmpdir aptitude -y install debconf-utils
14083 # Make sure tasksel autoselection trigger. It need the test scripts
14084 # to return the correct answers.
14085 echo tasksel tasksel/desktop multiselect $desktop | \
14086 chroot $tmpdir debconf-set-selections
14088 # Include the desktop and laptop task
14089 for test in desktop laptop ; do
14090 echo
> $tmpdir/usr/lib/tasksel/tests/$test
&lt;
&lt;EOF
14094 chmod a+rx $tmpdir/usr/lib/tasksel/tests/$test
14097 DEBIAN_FRONTEND=noninteractive
14098 DEBIAN_PRIORITY=critical
14099 export DEBIAN_FRONTEND DEBIAN_PRIORITY
14100 chroot $tmpdir tasksel --new-install
14102 echo deb $mirror $to main
> $tmpdir/etc/apt/sources.list
14103 chroot $tmpdir aptitude update
14104 touch $tmpdir/etc/udev/kernel-upgrade
14105 chroot $tmpdir aptitude -y dist-upgrade
14107 </pre
></blockquote
>
14109 <p
>I suspect it would be useful to test upgrades with both apt-get and
14110 with aptitude, but I have not had time to look at how they behave
14111 differently so far. I hope to get a cron job running to do the test
14112 regularly and post the result on the web. The Gnome upgrade currently
14113 work, while the KDE upgrade fail because of the bug in
14114 kdebase-workspace-data
</p
>
14116 <p
>I am not quite sure what kind of extract from the huge upgrade logs
14117 (KDE
167 KiB, Gnome
516 KiB) it make sense to include in this blog
14118 post, so I will refrain from trying. I can report that for Gnome,
14119 aptitude report
760 packages upgraded,
448 newly installed,
129 to
14120 remove and
1 not upgraded and
1024MB need to be downloaded while for
14121 KDE the same numbers are
702 packages upgraded,
507 newly installed,
14122 193 to remove and
0 not upgraded and
1117MB need to be downloaded
</p
>
14124 <p
>I am very happy to notice that the Gnome desktop + laptop upgrade
14125 is able to migrate to dependency based boot sequencing and parallel
14126 booting without a hitch. Was unsure if there were still bugs with
14127 packages failing to clean up their obsolete init.d script during
14128 upgrades, and no such problem seem to affect the Gnome desktop+laptop
14129 packages.
</p
>
14134 <title>Upstart or sysvinit - as init.d scripts see it
</title>
14135 <link>http://www.hungry.com/~pere/blog/Upstart_or_sysvinit___as_init_d_scripts_see_it.html
</link>
14136 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Upstart_or_sysvinit___as_init_d_scripts_see_it.html
</guid>
14137 <pubDate>Sun,
6 Jun
2010 23:
55:
00 +
0200</pubDate>
14138 <description><p
>If Debian is to migrate to upstart on Linux, I expect some init.d
14139 scripts to migrate (some of) their operations to upstart job while
14140 keeping the init.d for hurd and kfreebsd. The packages with such
14141 needs will need a way to get their init.d scripts to behave
14142 differently when used with sysvinit and with upstart. Because of
14143 this, I had a look at the environment variables set when a init.d
14144 script is running under upstart, and when it is not.
</p
>
14146 <p
>With upstart, I notice these environment variables are set when a
14147 script is started from rcS.d/ (ignoring some irrelevant ones like
14148 COLUMNS):
</p
>
14150 <blockquote
><pre
>
14156 UPSTART_EVENTS=startup
14158 UPSTART_JOB=rc-sysinit
14159 </pre
></blockquote
>
14161 <p
>With sysvinit, these environment variables are set for the same
14164 <blockquote
><pre
>
14165 INIT_VERSION=sysvinit-
2.88
14170 </pre
></blockquote
>
14172 <p
>The RUNLEVEL and PREVLEVEL environment variables passed on from
14173 sysvinit are not set by upstart. Not sure if it is intentional or not
14174 to not be compatible with sysvinit in this regard.
</p
>
14176 <p
>For scripts needing to behave differently when upstart is used,
14177 looking for the UPSTART_JOB environment variable seem to be a good
14183 <title>A manual for standards wars...
</title>
14184 <link>http://www.hungry.com/~pere/blog/A_manual_for_standards_wars___.html
</link>
14185 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/A_manual_for_standards_wars___.html
</guid>
14186 <pubDate>Sun,
6 Jun
2010 14:
15:
00 +
0200</pubDate>
14187 <description><p
>Via the
14188 <a href=
"http://feedproxy.google.com/~r/robweir/antic-atom/~
3/QzU4RgoAGMg/weekly-links-
10.html
">blog
14189 of Rob Weir
</a
> I came across the very interesting essay named
14190 <a href=
"http://faculty.haas.berkeley.edu/shapiro/wars.pdf
">The Art of
14191 Standards Wars
</a
> (PDF
25 pages). I recommend it for everyone
14192 following the standards wars of today.
</p
>
14197 <title>Sitesummary tip: Listing computer hardware models used at site
</title>
14198 <link>http://www.hungry.com/~pere/blog/Sitesummary_tip__Listing_computer_hardware_models_used_at_site.html
</link>
14199 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Sitesummary_tip__Listing_computer_hardware_models_used_at_site.html
</guid>
14200 <pubDate>Thu,
3 Jun
2010 12:
05:
00 +
0200</pubDate>
14201 <description><p
>When using sitesummary at a site to track machines, it is possible
14202 to get a list of the machine types in use thanks to the DMI
14203 information extracted from each machine. The script to do so is
14204 included in the sitesummary package, and here is example output from
14205 the Skolelinux build servers:
</p
>
14207 <blockquote
><pre
>
14208 maintainer:~# /usr/lib/sitesummary/hardware-model-summary
14210 Dell Computer Corporation
1
14213 eserver xSeries
345 -[
8670M1X]-
1
14217 </pre
></blockquote
>
14219 <p
>The quality of the report depend on the quality of the DMI tables
14220 provided in each machine. Here there are Intel machines without model
14221 information listed with Intel as vendor and no model, and virtual Xen
14222 machines listed as [no-dmi-info]. One can add -l as a command line
14223 option to list the individual machines.
</p
>
14225 <p
>A larger list is
14226 <a href=
"http://narvikskolen.no/sitesummary/
">available from the the
14227 city of Narvik
</a
>, which uses Skolelinux on all their shools and also
14228 provide the basic sitesummary report publicly. In their report there
14229 are ~
1400 machines. I know they use both Ubuntu and Skolelinux on
14230 their machines, and as sitesummary is available in both distributions,
14231 it is trivial to get all of them to report to the same central
14232 collector.
</p
>
14237 <title>KDM fail at boot with NVidia cards - and no one try to fix it?
</title>
14238 <link>http://www.hungry.com/~pere/blog/KDM_fail_at_boot_with_NVidia_cards___and_no_one_try_to_fix_it_.html
</link>
14239 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/KDM_fail_at_boot_with_NVidia_cards___and_no_one_try_to_fix_it_.html
</guid>
14240 <pubDate>Tue,
1 Jun
2010 17:
05:
00 +
0200</pubDate>
14241 <description><p
>It is strange to watch how a bug in Debian causing KDM to fail to
14242 start at boot when an NVidia video card is used is handled. The
14243 problem seem to be that the nvidia X.org driver uses a long time to
14244 initialize, and this duration is longer than kdm is configured to
14247 <p
>I came across two bugs related to this issue,
14248 <a href=
"http://bugs.debian.org/
583312">#
583312</a
> initially filed
14249 against initscripts and passed on to nvidia-glx when it became obvious
14250 that the nvidia drivers were involved, and
14251 <a href=
"http://bugs.debian.org/
524751">#
524751</a
> initially filed against
14252 kdm and passed on to src:nvidia-graphics-drivers for unknown reasons.
</p
>
14254 <p
>To me, it seem that no-one is interested in actually solving the
14255 problem nvidia video card owners experience and make sure the Debian
14256 distribution work out of the box for these users. The nvidia driver
14257 maintainers expect kdm to be set up to wait longer, while kdm expect
14258 the nvidia driver maintainers to fix the driver to start faster, and
14259 while they wait for each other I guess the users end up switching to a
14260 distribution that work for them. I have no idea what the solution is,
14261 but I am pretty sure that waiting for each other is not it.
</p
>
14263 <p
>I wonder why we end up handling bugs this way.
</p
>
14268 <title>Parallellized boot seem to hold up well in Debian/testing
</title>
14269 <link>http://www.hungry.com/~pere/blog/Parallellized_boot_seem_to_hold_up_well_in_Debian_testing.html
</link>
14270 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Parallellized_boot_seem_to_hold_up_well_in_Debian_testing.html
</guid>
14271 <pubDate>Thu,
27 May
2010 23:
55:
00 +
0200</pubDate>
14272 <description><p
>A few days ago, parallel booting was enabled in Debian/testing.
14273 The feature seem to hold up pretty well, but three fairly serious
14274 issues are known and should be solved:
14276 <p
><ul
>
14278 <li
>The wicd package seen to
14279 <a href=
"http://bugs.debian.org/
508289">break NFS mounting
</a
> and
14280 <a href=
"http://bugs.debian.org/
581586">network setup
</a
> when
14281 parallel booting is enabled. No idea why, but the wicd maintainer
14282 seem to be on the case.
</li
>
14284 <li
>The nvidia X driver seem to
14285 <a href=
"http://bugs.debian.org/
583312">have a race condition
</a
>
14286 triggered more easily when parallel booting is in effect. The
14287 maintainer is on the case.
</li
>
14289 <li
>The sysv-rc package fail to properly enable dependency based boot
14290 sequencing (the shutdown is broken) when old file-rc users
14291 <a href=
"http://bugs.debian.org/
575080">try to switch back
</a
> to
14292 sysv-rc. One way to solve it would be for file-rc to create
14293 /etc/init.d/.legacy-bootordering, and another is to try to make
14294 sysv-rc more robust. Will investigate some more and probably upload a
14295 workaround in sysv-rc to help those trying to move from file-rc to
14296 sysv-rc get a working shutdown.
</li
>
14298 </ul
></p
>
14300 <p
>All in all not many surprising issues, and all of them seem
14301 solvable before Squeeze is released. In addition to these there are
14302 some packages with bugs in their dependencies and run level settings,
14303 which I expect will be fixed in a reasonable time span.
</p
>
14305 <p
>If you report any problems with dependencies in init.d scripts to
14306 the BTS, please usertag the report to get it to show up at
14307 <a href=
"http://bugs.debian.org/cgi-bin/pkgreport.cgi?users=initscripts-ng-devel@lists.alioth.debian.org
">the
14308 list of usertagged bugs related to this
</a
>.
</p
>
14310 <p
>Update: Correct bug number to file-rc issue.
</p
>
14315 <title>More flexible firmware handling in debian-installer
</title>
14316 <link>http://www.hungry.com/~pere/blog/More_flexible_firmware_handling_in_debian_installer.html
</link>
14317 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/More_flexible_firmware_handling_in_debian_installer.html
</guid>
14318 <pubDate>Sat,
22 May
2010 21:
30:
00 +
0200</pubDate>
14319 <description><p
>After a long break from debian-installer development, I finally
14320 found time today to return to the project. Having to spend less time
14321 working dependency based boot in debian, as it is almost complete now,
14322 definitely helped freeing some time.
</p
>
14324 <p
>A while back, I ran into a problem while working on Debian Edu. We
14325 include some firmware packages on the Debian Edu CDs, those needed to
14326 get disk and network controllers working. Without having these
14327 firmware packages available during installation, it is impossible to
14328 install Debian Edu on the given machine, and because our target group
14329 are non-technical people, asking them to provide firmware packages on
14330 an external medium is a support pain. Initially, I expected it to be
14331 enough to include the firmware packages on the CD to get
14332 debian-installer to find and use them. This proved to be wrong.
14333 Next, I hoped it was enough to symlink the relevant firmware packages
14334 to some useful location on the CD (tried /cdrom/ and
14335 /cdrom/firmware/). This also proved to not work, and at this point I
14336 found time to look at the debian-installer code to figure out what was
14337 going to work.
</p
>
14339 <p
>The firmware loading code is in the hw-detect package, and a closer
14340 look revealed that it would only look for firmware packages outside
14341 the installation media, so the CD was never checked for firmware
14342 packages. It would only check USB sticks, floppies and other
14343 "external
" media devices. Today I changed it to also look in the
14344 /cdrom/firmware/ directory on the mounted CD or DVD, which should
14345 solve the problem I ran into with Debian edu. I also changed it to
14346 look in /firmware/, to make sure the installer also find firmware
14347 provided in the initrd when booting the installer via PXE, to allow us
14348 to provide the same feature in the PXE setup included in Debian
14351 <p
>To make sure firmware deb packages with a license questions are not
14352 activated without asking if the license is accepted, I extended
14353 hw-detect to look for preinst scripts in the firmware packages, and
14354 run these before activating the firmware during installation. The
14355 license question is asked using debconf in the preinst, so this should
14356 solve the issue for the firmware packages I have looked at so far.
</p
>
14358 <p
>If you want to discuss the details of these features, please
14359 contact us on debian-boot@lists.debian.org.
</p
>
14364 <title>Parallellized boot is now the default in Debian/unstable
</title>
14365 <link>http://www.hungry.com/~pere/blog/Parallellized_boot_is_now_the_default_in_Debian_unstable.html
</link>
14366 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Parallellized_boot_is_now_the_default_in_Debian_unstable.html
</guid>
14367 <pubDate>Fri,
14 May
2010 22:
40:
00 +
0200</pubDate>
14368 <description><p
>Since this evening, parallel booting is the default in
14369 Debian/unstable for machines using dependency based boot sequencing.
14370 Apparently the testing of concurrent booting has been wider than
14371 expected, if I am to believe the
14372 <a href=
"http://lists.debian.org/debian-devel/
2010/
05/msg00122.html
">input
14373 on debian-devel@
</a
>, and I concluded a few days ago to move forward
14374 with the feature this weekend, to give us some time to detect any
14375 remaining problems before Squeeze is frozen. If serious problems are
14376 detected, it is simple to change the default back to sequential boot.
14377 The upload of the new sysvinit package also activate a new upstream
14380 More information about
14381 <a href=
"http://wiki.debian.org/LSBInitScripts/DependencyBasedBoot
">dependency
14382 based boot sequencing
</a
> is available from the Debian wiki. It is
14383 currently possible to disable parallel booting when one run into
14384 problems caused by it, by adding this line to /etc/default/rcS:
</p
>
14386 <blockquote
><pre
>
14388 </pre
></blockquote
>
14390 <p
>If you report any problems with dependencies in init.d scripts to
14391 the BTS, please usertag the report to get it to show up at
14392 <a href=
"http://bugs.debian.org/cgi-bin/pkgreport.cgi?users=initscripts-ng-devel@lists.alioth.debian.org
">the
14393 list of usertagged bugs related to this
</a
>.
</p
>
14398 <title>Sitesummary tip: Listing MAC address of all clients
</title>
14399 <link>http://www.hungry.com/~pere/blog/Sitesummary_tip__Listing_MAC_address_of_all_clients.html
</link>
14400 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Sitesummary_tip__Listing_MAC_address_of_all_clients.html
</guid>
14401 <pubDate>Fri,
14 May
2010 21:
10:
00 +
0200</pubDate>
14402 <description><p
>In the recent Debian Edu versions, the
14403 <a href=
"http://wiki.debian.org/DebianEdu/HowTo/SiteSummary
">sitesummary
14404 system
</a
> is used to keep track of the machines in the school
14405 network. Each machine will automatically report its status to the
14406 central server after boot and once per night. The network setup is
14407 also reported, and using this information it is possible to get the
14408 MAC address of all network interfaces in the machines. This is useful
14409 to update the DHCP configuration.
</p
>
14411 <p
>To give some idea how to use sitesummary, here is a one-liner to
14412 ist all MAC addresses of all machines reporting to sitesummary. Run
14413 this on the collector host:
</p
>
14415 <blockquote
><pre
>
14416 perl -MSiteSummary -e
'for_all_hosts(sub { print join(
" ", get_macaddresses(shift)),
"\n
"; });
'
14417 </pre
></blockquote
>
14419 <p
>This will list all MAC addresses assosiated with all machine, one
14420 line per machine and with space between the MAC addresses.
</p
>
14422 <p
>To allow system administrators easier job at adding static DHCP
14423 addresses for hosts, it would be possible to extend this to fetch
14424 machine information from sitesummary and update the DHCP and DNS
14425 tables in LDAP using this information. Such tool is unfortunately not
14426 written yet.
</p
>
14431 <title>systemd, an interesting alternative to upstart
</title>
14432 <link>http://www.hungry.com/~pere/blog/systemd__an_interesting_alternative_to_upstart.html
</link>
14433 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/systemd__an_interesting_alternative_to_upstart.html
</guid>
14434 <pubDate>Thu,
13 May
2010 22:
20:
00 +
0200</pubDate>
14435 <description><p
>The last few days a new boot system called
14436 <a href=
"http://www.freedesktop.org/wiki/Software/systemd
">systemd
</a
>
14438 <a href=
"http://
0pointer.de/blog/projects/systemd.html
">introduced
</a
>
14440 to the free software world. I have not yet had time to play around
14441 with it, but it seem to be a very interesting alternative to
14442 <a href=
"http://upstart.ubuntu.com/
">upstart
</a
>, and might prove to be
14443 a good alternative for Debian when we are able to switch to an event
14444 based boot system. Tollef is
14445 <a href=
"http://bugs.debian.org/
580814">in the process
</a
> of getting
14446 systemd into Debian, and I look forward to seeing how well it work. I
14447 like the fact that systemd handles init.d scripts with dependency
14448 information natively, allowing them to run in parallel where upstart
14449 at the moment do not.
</p
>
14451 <p
>Unfortunately do systemd have the same problem as upstart regarding
14452 platform support. It only work on recent Linux kernels, and also need
14453 some new kernel features enabled to function properly. This means
14454 kFreeBSD and Hurd ports of Debian will need a port or a different boot
14455 system. Not sure how that will be handled if systemd proves to be the
14456 way forward.
</p
>
14458 <p
>In the mean time, based on the
14459 <a href=
"http://lists.debian.org/debian-devel/
2010/
05/msg00122.html
">input
14460 on debian-devel@
</a
> regarding parallel booting in Debian, I have
14461 decided to enable full parallel booting as the default in Debian as
14462 soon as possible (probably this weekend or early next week), to see if
14463 there are any remaining serious bugs in the init.d dependencies. A
14464 new version of the sysvinit package implementing this change is
14465 already in experimental. If all go well, Squeeze will be released
14466 with parallel booting enabled by default.
</p
>
14471 <title>Parallellizing the boot in Debian Squeeze - ready for wider testing
</title>
14472 <link>http://www.hungry.com/~pere/blog/Parallellizing_the_boot_in_Debian_Squeeze___ready_for_wider_testing.html
</link>
14473 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Parallellizing_the_boot_in_Debian_Squeeze___ready_for_wider_testing.html
</guid>
14474 <pubDate>Thu,
6 May
2010 23:
25:
00 +
0200</pubDate>
14475 <description><p
>These days, the init.d script dependencies in Squeeze are quite
14476 complete, so complete that it is actually possible to run all the
14477 init.d scripts in parallell based on these dependencies. If you want
14478 to test your Squeeze system, make sure
14479 <a href=
"http://wiki.debian.org/LSBInitScripts/DependencyBasedBoot
">dependency
14480 based boot sequencing
</a
> is enabled, and add this line to
14481 /etc/default/rcS:
</p
>
14483 <blockquote
><pre
>
14484 CONCURRENCY=makefile
14485 </pre
></blockquote
>
14487 <p
>That is it. It will cause sysv-rc to use the startpar tool to run
14488 scripts in parallel using the dependency information stored in
14489 /etc/init.d/.depend.boot, /etc/init.d/.depend.start and
14490 /etc/init.d/.depend.stop to order the scripts. Startpar is configured
14491 to try to start the kdm and gdm scripts as early as possible, and will
14492 start the facilities required by kdm or gdm as early as possible to
14493 make this happen.
</p
>
14495 <p
>Give it a try, and see if you like the result. If some services
14496 fail to start properly, it is most likely because they have incomplete
14497 init.d script dependencies in their startup script (or some of their
14498 dependent scripts have incomplete dependencies). Report bugs and get
14499 the package maintainers to fix it. :)
</p
>
14501 <p
>Running scripts in parallel could be the default in Debian when we
14502 manage to get the init.d script dependencies complete and correct. I
14503 expect we will get there in Squeeze+
1, if we get manage to test and
14504 fix the remaining issues.
</p
>
14506 <p
>If you report any problems with dependencies in init.d scripts to
14507 the BTS, please usertag the report to get it to show up at
14508 <a href=
"http://bugs.debian.org/cgi-bin/pkgreport.cgi?users=initscripts-ng-devel@lists.alioth.debian.org
">the
14509 list of usertagged bugs related to this
</a
>.
</p
>
14514 <title>Debian has switched to dependency based boot sequencing
</title>
14515 <link>http://www.hungry.com/~pere/blog/Debian_has_switched_to_dependency_based_boot_sequencing.html
</link>
14516 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_has_switched_to_dependency_based_boot_sequencing.html
</guid>
14517 <pubDate>Mon,
27 Jul
2009 23:
50:
00 +
0200</pubDate>
14518 <description><p
>Since this evening, with the upload of sysvinit version
2.87dsf-
2,
14519 and the upload of insserv version
1.12.0-
10 yesterday, Debian unstable
14520 have been migrated to using dependency based boot sequencing. This
14521 conclude work me and others have been doing for the last three days.
14522 It feels great to see this finally part of the default Debian
14523 installation. Now we just need to weed out the last few problems that
14524 are bound to show up, to get everything ready for Squeeze.
</p
>
14526 <p
>The next step is migrating /sbin/init from sysvinit to upstart, and
14527 fixing the more fundamental problem of handing the event based
14528 non-predictable kernel in the early boot.
</p
>
14533 <title>Taking over sysvinit development
</title>
14534 <link>http://www.hungry.com/~pere/blog/Taking_over_sysvinit_development.html
</link>
14535 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Taking_over_sysvinit_development.html
</guid>
14536 <pubDate>Wed,
22 Jul
2009 23:
00:
00 +
0200</pubDate>
14537 <description><p
>After several years of frustration with the lack of activity from
14538 the existing sysvinit upstream developer, I decided a few weeks ago to
14539 take over the package and become the new upstream. The number of
14540 patches to track for the Debian package was becoming a burden, and the
14541 lack of synchronization between the distribution made it hard to keep
14542 the package up to date.
</p
>
14544 <p
>On the new sysvinit team is the SuSe maintainer Dr. Werner Fink,
14545 and my Debian co-maintainer Kel Modderman. About
10 days ago, I made
14546 a new upstream tarball with version number
2.87dsf (for Debian, SuSe
14547 and Fedora), based on the patches currently in use in these
14548 distributions. We Debian maintainers plan to move to this tarball as
14549 the new upstream as soon as we find time to do the merge. Since the
14550 new tarball was created, we agreed with Werner at SuSe to make a new
14551 upstream project at
<a href=
"http://savannah.nongnu.org/
">Savannah
</a
>, and continue
14552 development there. The project is registered and currently waiting
14553 for approval by the Savannah administrators, and as soon as it is
14554 approved, we will import the old versions from svn and continue
14555 working on the future release.
</p
>
14557 <p
>It is a bit ironic that this is done now, when some of the involved
14558 distributions are moving to upstart as a syvinit replacement.
</p
>
14563 <title>Debian boots quicker and quicker
</title>
14564 <link>http://www.hungry.com/~pere/blog/Debian_boots_quicker_and_quicker.html
</link>
14565 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_boots_quicker_and_quicker.html
</guid>
14566 <pubDate>Wed,
24 Jun
2009 21:
40:
00 +
0200</pubDate>
14567 <description><p
>I spent Monday and tuesday this week in London with a lot of the
14568 people involved in the boot system on Debian and Ubuntu, to see if we
14569 could find more ways to speed up the boot system. This was an Ubuntu
14571 <a href=
"https://wiki.ubuntu.com/FoundationsTeam/BootPerformance/DebianUbuntuSprint
">developer
14572 gathering
</a
>. It was quite productive. We also discussed the future
14573 of boot systems, and ways to handle the increasing number of boot
14574 issues introduced by the Linux kernel becoming more and more
14575 asynchronous and event base. The Ubuntu approach using udev and
14576 upstart might be a good way forward. Time will show.
</p
>
14578 <p
>Anyway, there are a few ways at the moment to speed up the boot
14579 process in Debian. All of these should be applied to get a quick
14584 <li
>Use dash as /bin/sh.
</li
>
14586 <li
>Disable the init.d/hwclock*.sh scripts and make sure the hardware
14587 clock is in UTC.
</li
>
14589 <li
>Install and activate the insserv package to enable
14590 <a href=
"http://wiki.debian.org/LSBInitScripts/DependencyBasedBoot
">dependency
14591 based boot sequencing
</a
>, and enable concurrent booting.
</li
>
14595 These points are based on the Google summer of code work done by
14596 <a href=
"http://initscripts-ng.alioth.debian.org/soc2006-bootsystem/
">Carlos
14597 Villegas
</a
>.
14599 <p
>Support for makefile-style concurrency during boot was uploaded to
14600 unstable yesterday. When we tested it, we were able to cut
6 seconds
14601 from the boot sequence. It depend on very correct dependency
14602 declaration in all init.d scripts, so I expect us to find edge cases
14603 where the dependences in some scripts are slightly wrong when we start
14604 using this.
</p
>
14606 <p
>On our IRC channel for this effort, #pkg-sysvinit, a new idea was
14607 introduced by Raphael Geissert today, one that could affect the
14608 startup speed as well. Instead of starting some scripts concurrently
14609 from rcS.d/ and another set of scripts from rc2.d/, it would be
14610 possible to run a of them in the same process. A quick way to test
14611 this would be to enable insserv and run
'mv /etc/rc2.d/S* /etc/rcS.d/;
14612 insserv
'. Will need to test if that work. :)
</p
>
14617 <title>BSAs påstander om piratkopiering møter motstand
</title>
14618 <link>http://www.hungry.com/~pere/blog/BSAs_p_stander_om_piratkopiering_m_ter_motstand.html
</link>
14619 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/BSAs_p_stander_om_piratkopiering_m_ter_motstand.html
</guid>
14620 <pubDate>Sun,
17 May
2009 23:
05:
00 +
0200</pubDate>
14621 <description><p
>Hvert år de siste årene har BSA, lobbyfronten til de store
14622 programvareselskapene som Microsoft og Apple, publisert en rapport der
14623 de gjetter på hvor mye piratkopiering påfører i tapte inntekter i
14624 ulike land rundt om i verden. Resultatene er tendensiøse. For noen
14626 <a href=
"http://global.bsa.org/globalpiracy2008/studies/globalpiracy2008.pdf
">siste
14627 rapport
</a
>, og det er flere kritiske kommentarer publisert de siste
14628 dagene. Et spesielt interessant kommentar fra Sverige,
14629 <a href=
"http://www.idg.se/
2.1085/
1.229795/bsa-hoftade-sverigesiffror
">BSA
14630 höftade Sverigesiffror
</a
>, oppsummeres slik:
</p
>
14633 I sin senaste rapport slår BSA fast att
25 procent av all mjukvara i
14634 Sverige är piratkopierad. Det utan att ha pratat med ett enda svenskt
14635 företag.
"Man bör nog kanske inte se de här siffrorna som helt
14636 exakta
", säger BSAs Sverigechef John Hugosson.
14637 </blockquote
>
14639 <p
>Mon tro om de er like metodiske når de gjetter på andelen piratkopiering i Norge? To andre kommentarer er
<a
14640 href=
"http://www.vnunet.com/vnunet/comment/
2242134/bsa-piracy-figures-shot-reality
">BSA
14641 piracy figures need a shot of reality
</a
> og
<a
14642 href=
"http://www.michaelgeist.ca/content/view/
3958/
125/
">Does The WIPO
14643 Copyright Treaty Work?
</a
></p
>
14645 <p
>Fant lenkene via
<a
14646 href=
"http://tech.slashdot.org/article.pl?sid=
09/
05/
17/
1632242">oppslag
14647 på Slashdot
</a
>.
</p
>
14652 <title>IDG mener linux i servermarkedet vil vokse med
21% i
2009</title>
14653 <link>http://www.hungry.com/~pere/blog/IDG_mener_linux_i_servermarkedet_vil_vokse_med_21__i_2009.html
</link>
14654 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/IDG_mener_linux_i_servermarkedet_vil_vokse_med_21__i_2009.html
</guid>
14655 <pubDate>Thu,
7 May
2009 22:
30:
00 +
0200</pubDate>
14656 <description><p
>Kom over
14657 <a href=
"http://news.cnet.com/
8301-
13505_3-
10216873-
16.html
">interessante
14658 tall
</a
> fra IDG om utviklingen av linuxservermarkedet. Fikk meg til
14659 å tenke på antall tjenermaskiner ved Universitetet i Oslo der jeg
14660 jobber til daglig. En rask opptelling forteller meg at vi har
490
14661 (
61%) fysiske unix-tjener (mest linux men også noen solaris) og
196
14662 (
25%) windowstjenere, samt
112 (
14%) virtuelle unix-tjenere. Med den
14663 bakgrunnskunnskapen kan jeg godt tro at IDG er inne på noe.
</p
>
14668 <title>Kryptert harddisk - naturligvis
</title>
14669 <link>http://www.hungry.com/~pere/blog/Kryptert_harddisk___naturligvis.html
</link>
14670 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Kryptert_harddisk___naturligvis.html
</guid>
14671 <pubDate>Sat,
2 May
2009 15:
30:
00 +
0200</pubDate>
14672 <description><p
><a href=
"http://www.dagensit.no/trender/article1658676.ece
">Dagens
14673 IT melder
</a
> at Intel hevder at det er dyrt å miste en datamaskin,
14674 når en tar tap av arbeidstid, fortrolige dokumenter,
14675 personopplysninger og alt annet det innebærer. Det er ingen tvil om
14676 at det er en kostbar affære å miste sin datamaskin, og det er årsaken
14677 til at jeg har kryptert harddisken på både kontormaskinen og min
14678 bærbare. Begge inneholder personopplysninger jeg ikke ønsker skal
14679 komme på avveie, den første informasjon relatert til jobben min ved
14680 Universitetet i Oslo, og den andre relatert til blant annet
14681 foreningsarbeide. Kryptering av diskene gjør at det er lite
14682 sannsynlig at dophoder som kan finne på å rappe maskinene får noe ut
14683 av dem. Maskinene låses automatisk etter noen minutter uten bruk,
14684 og en reboot vil gjøre at de ber om passord før de vil starte opp.
14685 Jeg bruker Debian på begge maskinene, og installasjonssystemet der
14686 gjør det trivielt å sette opp krypterte disker. Jeg har LVM på toppen
14687 av krypterte partisjoner, slik at alt av datapartisjoner er kryptert.
14688 Jeg anbefaler alle å kryptere diskene på sine bærbare. Kostnaden når
14689 det er gjort slik jeg gjør det er minimale, og gevinstene er
14690 betydelige. En bør dog passe på passordet. Hvis det går tapt, må
14691 maskinen reinstalleres og alt er tapt.
</p
>
14693 <p
>Krypteringen vil ikke stoppe kompetente angripere som f.eks. kjøler
14694 ned minnebrikkene før maskinen rebootes med programvare for å hente ut
14695 krypteringsnøklene. Kostnaden med å forsvare seg mot slike angripere
14696 er for min del høyere enn gevinsten. Jeg tror oddsene for at
14697 f.eks. etteretningsorganisasjoner har glede av å titte på mine
14698 maskiner er minimale, og ulempene jeg ville oppnå ved å forsøke å
14699 gjøre det vanskeligere for angripere med kompetanse og ressurser er
14700 betydelige.
</p
>
14705 <title>Two projects that have improved the quality of free software a lot
</title>
14706 <link>http://www.hungry.com/~pere/blog/Two_projects_that_have_improved_the_quality_of_free_software_a_lot.html
</link>
14707 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Two_projects_that_have_improved_the_quality_of_free_software_a_lot.html
</guid>
14708 <pubDate>Sat,
2 May
2009 15:
00:
00 +
0200</pubDate>
14709 <description><p
>There are two software projects that have had huge influence on the
14710 quality of free software, and I wanted to mention both in case someone
14711 do not yet know them.
</p
>
14713 <p
>The first one is
<a href=
"http://valgrind.org/
">valgrind
</a
>, a
14714 tool to detect and expose errors in the memory handling of programs.
14715 It is easy to use, all one need to do is to run
'valgrind program
',
14716 and it will report any problems on stdout. It is even better if the
14717 program include debug information. With debug information, it is able
14718 to report the source file name and line number where the problem
14719 occurs. It can report things like
'reading past memory block in file
14720 X line N, the memory block was allocated in file Y, line M
', and
14721 'using uninitialised value in control logic
'. This tool has made it
14722 trivial to investigate reproducible crash bugs in programs, and have
14723 reduced the number of this kind of bugs in free software a lot.
14725 <p
>The second one is
14726 <a href=
"http://en.wikipedia.org/wiki/Coverity
">Coverity
</a
> which is
14727 a source code checker. It is able to process the source of a program
14728 and find problems in the logic without running the program. It
14729 started out as the Stanford Checker and became well known when it was
14730 used to find bugs in the Linux kernel. It is now a commercial tool
14731 and the company behind it is running
14732 <a href=
"http://www.scan.coverity.com/
">a community service
</a
> for the
14733 free software community, where a lot of free software projects get
14734 their source checked for free. Several thousand defects have been
14735 found and fixed so far. It can find errors like
'lock L taken in file
14736 X line N is never released if exiting in line M
', or
'the code in file
14737 Y lines O to P can never be executed
'. The projects included in the
14738 community service project have managed to get rid of a lot of
14739 reliability problems thanks to Coverity.
</p
>
14741 <p
>I believe tools like this, that are able to automatically find
14742 errors in the source, are vital to improve the quality of software and
14743 make sure we can get rid of the crashing and failing software we are
14744 surrounded by today.
</p
>
14749 <title>No patch is not better than a useless patch
</title>
14750 <link>http://www.hungry.com/~pere/blog/No_patch_is_not_better_than_a_useless_patch.html
</link>
14751 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/No_patch_is_not_better_than_a_useless_patch.html
</guid>
14752 <pubDate>Tue,
28 Apr
2009 09:
30:
00 +
0200</pubDate>
14753 <description><p
>Julien Blache
14754 <a href=
"http://blog.technologeek.org/
2009/
04/
12/
214">claim that no
14755 patch is better than a useless patch
</a
>. I completely disagree, as a
14756 patch allow one to discuss a concrete and proposed solution, and also
14757 prove that the issue at hand is important enough for someone to spent
14758 time on fixing it. No patch do not provide any of these positive
14759 properties.
</p
>
14764 <title>Standardize on protocols and formats, not vendors and applications
</title>
14765 <link>http://www.hungry.com/~pere/blog/Standardize_on_protocols_and_formats__not_vendors_and_applications.html
</link>
14766 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Standardize_on_protocols_and_formats__not_vendors_and_applications.html
</guid>
14767 <pubDate>Mon,
30 Mar
2009 11:
50:
00 +
0200</pubDate>
14768 <description><p
>Where I work at the University of Oslo, one decision stand out as a
14769 very good one to form a long lived computer infrastructure. It is the
14770 simple one, lost by many in todays computer industry: Standardize on
14771 open network protocols and open exchange/storage formats, not applications.
14772 Applications come and go, while protocols and files tend to stay, and
14773 thus one want to make it easy to change application and vendor, while
14774 avoiding conversion costs and locking users to a specific platform or
14775 application.
</p
>
14777 <p
>This approach make it possible to replace the client applications
14778 independently of the server applications. One can even allow users to
14779 use several different applications as long as they handle the selected
14780 protocol and format. In the normal case, only one client application
14781 is recommended and users only get help if they choose to use this
14782 application, but those that want to deviate from the easy path are not
14783 blocked from doing so.
</p
>
14785 <p
>It also allow us to replace the server side without forcing the
14786 users to replace their applications, and thus allow us to select the
14787 best server implementation at any moment, when scale and resouce
14788 requirements change.
</p
>
14790 <p
>I strongly recommend standardizing - on open network protocols and
14791 open formats, but I would never recommend standardizing on a single
14792 application that do not use open network protocol or open formats.
</p
>
14797 <title>Returning from Skolelinux developer gathering
</title>
14798 <link>http://www.hungry.com/~pere/blog/Returning_from_Skolelinux_developer_gathering.html
</link>
14799 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Returning_from_Skolelinux_developer_gathering.html
</guid>
14800 <pubDate>Sun,
29 Mar
2009 21:
00:
00 +
0200</pubDate>
14801 <description><p
>I
'm sitting on the train going home from this weekends Debian
14802 Edu/Skolelinux development gathering. I got a bit done tuning the
14803 desktop, and looked into the dynamic service location protocol
14804 implementation avahi. It look like it could be useful for us. Almost
14805 30 people participated, and I believe it was a great environment to
14806 get to know the Skolelinux system. Walter Bender, involved in the
14807 development of the Sugar educational platform, presented his stuff and
14808 also helped me improve my OLPC installation. He also showed me that
14809 his Turtle Art application can be used in standalone mode, and we
14810 agreed that I would help getting it packaged for Debian. As a
14811 standalone application it would be great for Debian Edu. We also
14812 tried to get the video conferencing working with two OLPCs, but that
14813 proved to be too hard for us. The application seem to need more work
14814 before it is ready for me. I look forward to getting home and relax
14820 <title>Time for new LDAP schemas replacing RFC
2307?
</title>
14821 <link>http://www.hungry.com/~pere/blog/Time_for_new__LDAP_schemas_replacing_RFC_2307_.html
</link>
14822 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Time_for_new__LDAP_schemas_replacing_RFC_2307_.html
</guid>
14823 <pubDate>Sun,
29 Mar
2009 20:
30:
00 +
0200</pubDate>
14824 <description><p
>The state of standardized LDAP schemas on Linux is far from
14825 optimal. There is RFC
2307 documenting one way to store NIS maps in
14826 LDAP, and a modified version of this normally called RFC
2307bis, with
14827 some modifications to be compatible with Active Directory. The RFC
14828 specification handle the content of a lot of system databases, but do
14829 not handle DNS zones and DHCP configuration.
</p
>
14831 <p
>In
<a href=
"http://www.skolelinux.org/
">Debian Edu/Skolelinux
</a
>,
14832 we would like to store information about users, SMB clients/hosts,
14833 filegroups, netgroups (users and hosts), DHCP and DNS configuration,
14834 and LTSP configuration in LDAP. These objects have a lot in common,
14835 but with the current LDAP schemas it is not possible to have one
14836 object per entity. For example, one need to have at least three LDAP
14837 objects for a given computer, one with the SMB related stuff, one with
14838 DNS information and another with DHCP information. The schemas
14839 provided for DNS and DHCP are impossible to combine into one LDAP
14840 object. In addition, it is impossible to implement quick queries for
14841 netgroup membership, because of the way NIS triples are implemented.
14842 It just do not scale. I believe it is time for a few RFC
14843 specifications to cleam up this mess.
</p
>
14845 <p
>I would like to have one LDAP object representing each computer in
14846 the network, and this object can then keep the SMB (ie host key), DHCP
14847 (mac address/name) and DNS (name/IP address) settings in one place.
14848 It need to be efficently stored to make sure it scale well.
</p
>
14850 <p
>I would also like to have a quick way to map from a user or
14851 computer and to the net group this user or computer is a member.
</p
>
14853 <p
>Active Directory have done a better job than unix heads like myself
14854 in this regard, and the unix side need to catch up. Time to start a
14855 new IETF work group?
</p
>
14860 <title>Endelig er Debian Lenny gitt ut
</title>
14861 <link>http://www.hungry.com/~pere/blog/Endelig_er_Debian_Lenny_gitt_ut.html
</link>
14862 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Endelig_er_Debian_Lenny_gitt_ut.html
</guid>
14863 <pubDate>Sun,
15 Feb
2009 11:
50:
00 +
0100</pubDate>
14864 <description><p
>Endelig er
<a href=
"http://www.debian.org/
">Debian
</a
>
14865 <a href=
"http://www.debian.org/News/
2009/
20090214">Lenny
</a
> gitt ut.
14866 Et langt steg videre for Debian-prosjektet, og en rekke nye
14867 programpakker blir nå tilgjengelig for de av oss som bruker den
14868 stabile utgaven av Debian. Neste steg er nå å få
14869 <a href=
"http://www.skolelinux.org/
">Skolelinux
</a
> /
14870 <a href=
"http://wiki.debian.org/DebianEdu/
">Debian Edu
</a
> ferdig
14871 oppdatert for den nye utgaven, slik at en oppdatert versjon kan
14872 slippes løs på skolene. Takk til alle debian-utviklerne som har
14873 gjort dette mulig. Endelig er f.eks. fungerende avhengighetsstyrt
14874 bootsekvens tilgjengelig i stabil utgave, vha pakken
14875 <tt
>insserv
</tt
>.
</p
>
14880 <title>Devcamp brought us closer to the Lenny based Debian Edu release
</title>
14881 <link>http://www.hungry.com/~pere/blog/Devcamp_brought_us_closer_to_the_Lenny_based_Debian_Edu_release.html
</link>
14882 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Devcamp_brought_us_closer_to_the_Lenny_based_Debian_Edu_release.html
</guid>
14883 <pubDate>Sun,
7 Dec
2008 12:
00:
00 +
0100</pubDate>
14884 <description><p
>This weekend we had a small developer gathering for Debian Edu in
14885 Oslo. Most of Saturday was used for the general assemly for the
14886 member organization, but the rest of the weekend I used to tune the
14887 LTSP installation. LTSP now work out of the box on the
10-network.
14888 Acer Aspire One proved to be a very nice thin client, with both
14889 screen, mouse and keybard in a small box. Was working on getting the
14890 diskless workstation setup configured out of the box, but did not
14891 finish it before the weekend was up.
</p
>
14893 <p
>Did not find time to look at the
4 VGA cards in one box we got from
14894 the Brazilian group, so that will have to wait for the next
14895 development gathering. Would love to have the Debian Edu installer
14896 automatically detect and configure a multiseat setup when it find one
14897 of these cards.
</p
>
14902 <title>The sorry state of multimedia browser plugins in Debian
</title>
14903 <link>http://www.hungry.com/~pere/blog/The_sorry_state_of_multimedia_browser_plugins_in_Debian.html
</link>
14904 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_sorry_state_of_multimedia_browser_plugins_in_Debian.html
</guid>
14905 <pubDate>Tue,
25 Nov
2008 00:
10:
00 +
0100</pubDate>
14906 <description><p
>Recently I have spent some time evaluating the multimedia browser
14907 plugins available in Debian Lenny, to see which one we should use by
14908 default in Debian Edu. We need an embedded video playing plugin with
14909 control buttons to pause or stop the video, and capable of streaming
14910 all the multimedia content available on the web. The test results and
14911 notes are available on
14912 <a href=
"http://wiki.debian.org/DebianEdu/BrowserMultimedia
">the
14913 Debian wiki
</a
>. I was surprised how few of the plugins are able to
14914 fill this need. My personal video player favorite, VLC, has a really
14915 bad plugin which fail on a lot of the test pages. A lot of the MIME
14916 types I would expect to work with any free software player (like
14917 video/ogg), just do not work. And simple formats like the
14918 audio/x-mplegurl format (m3u playlists), just isn
't supported by the
14919 totem and vlc plugins. I hope the situation will improve soon. No
14920 wonder sites use the proprietary Adobe flash to play video.
</p
>
14922 <p
>For Lenny, we seem to end up with the mplayer plugin. It seem to
14923 be the only one fitting our needs. :/
</p
>