1 <?xml version=
"1.0" encoding=
"utf-8"?>
2 <rss version='
2.0' xmlns:lj='http://www.livejournal.org/rss/lj/
1.0/'
>
4 <title>Petter Reinholdtsen - Entries tagged debian
</title>
5 <description>Entries tagged debian
</description>
6 <link>http://www.hungry.com/~pere/blog/
</link>
10 <title>The
2025 LinuxCNC Norwegian developer gathering
</title>
11 <link>http://www.hungry.com/~pere/blog/The_2025_LinuxCNC_Norwegian_developer_gathering.html
</link>
12 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_2025_LinuxCNC_Norwegian_developer_gathering.html
</guid>
13 <pubDate>Sat,
11 Jan
2025 14:
30:
00 +
0100</pubDate>
14 <description><p
><a href=
"https://linuxcnc.org/
">The LinuxCNC project
</a
> is
15 trotting along. And I believe this great software system for
16 numerical control of machines such as milling machines, lathes, plasma
17 cutters, routers, cutting machines, robots and hexapods, would do even
18 better with more in-person developer gatherings, so we plan to
19 organise such gathering this summer too.
</p
>
21 <p
>This year we would like to invite to a small LinuxCNC and free
22 software fabrication workshop/gathering in Norway this summer for the
23 weekend starting July
4th
2024. New this year is the slightly larger
24 scope, and we invite people also outside the LinuxCNC community to
25 join. As earlier, we suggest to organize it as an
26 <a href=
"https://en.wikipedia.org/wiki/Unconference
">unconference
</a
>,
27 where the participants create the program upon arrival.
</p
>
29 <p
>The location is a metal workshop
15 minutes drive away from to the
30 Gardermoen airport (OSL), where there is a lot of space and a hotel only
31 5 minutes away by car. We plan to fire up the barbeque in the evenings.
</p
>
33 <p
>Please let us know if you would like to join. We track the list of
34 participants on
<a href=
"https://pad.efn.no/p/linuxcnc-
2025-norway
">a
35 simple pad
</a
>, please add yourself there if you are interested in joining.
</p
>
37 <p
><a href=
"https://www.nuugfoundation.no/
">The NUUG Foundation
</a
> has on
38 our request offered to handle any money involved with this gathering,
39 in other words holding any sponsor funds and paying any bills.
40 NUUG Foundation is a spinnoff from the NUUG member organisation here
41 in Norway with long ties to the free software and open standards
42 communities.
</p
>
44 <p
>As usual we hope to find sponsors to pay for food, lodging and travel.
</p
>
46 <p
>As usual, if you use Bitcoin and want to show your support of my
47 activities, please send Bitcoin donations to my address
48 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
53 <title>New lsdvd release
0.18 after ten years
</title>
54 <link>http://www.hungry.com/~pere/blog/New_lsdvd_release_0_18_after_ten_years.html
</link>
55 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_lsdvd_release_0_18_after_ten_years.html
</guid>
56 <pubDate>Sat,
21 Dec
2024 10:
50:
00 +
0100</pubDate>
57 <description><p
>The rumors of the death of
58 <a href=
"https://sourceforge.net/projects/lsdvd/
">the lsdvd project
</a
>
59 is slightly exaggerated. And the last few months, we have been
60 working on fixing and improving it, culminating in a new release last
61 night. This is the list of changes in the new
0.18 release, as
62 <a href=
"https://sourceforge.net/p/lsdvd/mailman/message/
59108028/
">announced
63 on the project mailing list
</a
>:
</p
>
67 <li
>Simplified autoconf setup, dropped --enable-debug option.
</li
>
68 <li
>Improved video resolution reporting (
<a href=
"https://sourceforge.net/p/lsdvd/patches/
8/
">Fixes #
8</a
>).
</li
>
69 <li
>Applied patches fetched from BSDs (
<a href=
"https://sourceforge.net/p/lsdvd/patches/
7/
">Fixes #
7</a
>).
</li
>
70 <li
>Corrected Perl output (
<a href=
"https://sourceforge.net/p/lsdvd/patches/
1/
">Fixes #
1</a
>).
</li
>
71 <li
>Adjusted Pan and Scan entries to produce valid XML.
</li
>
72 <li
>Changed --help output from stderr to stdout.
</li
>
73 <li
>Corrected aspect ratio and audio format formatting.
</li
>
74 <li
>Avoid segfault when hitting a NULL pointer in the IFO structure.
</li
>
75 <li
>Change build rules to supress compiler flags, to make it easier to
76 spot warnings.
</li
>
77 <li
>Set default DVD device based on OS (Linux, *BSD, Darwin)
</li
>
78 <li
>Added libdvdread DVDDiscID to output.
</li
>
79 <li
>Corrected typo in longest track value in XML format.
</li
>
80 <li
>Switched XML output to use libxml to avoid string encoding issues.
</li
>
81 <li
>Added simple build time test suite.
</li
>
82 <li
>Cleaned up language code handling and adding missing mapping for
83 language codes
'nb
' and
'nn
'.
</li
>
84 <li
>Added JSON output support using -Oj.
</li
>
87 <p
>The most exciting news to me is easy access to the DVDDiscID, which
88 make it a lot easier to identify DVD duplicates across a large
89 collection of DVDs. During testing it has proved to be very effective
90 ad identifying when DVDs in a DVD box (say all Star Wars movies) is
91 identical to DVDs sold individually (like the same Star Wars movies
92 packaged individually).
</p
>
94 <p
>Because none of the current developers got access to do tarball
95 releases on Sourceforge any more, the release is only available as
96 <a href=
"https://sourceforge.net/p/lsdvd/git/ci/
0.18/tree/
">a git
97 tag
</a
> in the repository. Lets hope it do not take ten years for the
98 next release. The project are discussing to move away from
99 Sourceforge, but it has not yet concluded.
</p
>
101 <p
>As usual, if you use Bitcoin and want to show your support of my
102 activities, please send Bitcoin donations to my address
103 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
108 <title>More than
200 orphaned Debian packages moved to git,
216 to go
</title>
109 <link>http://www.hungry.com/~pere/blog/More_than_200_orphaned_Debian_packages_moved_to_git__216_to_go.html
</link>
110 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/More_than_200_orphaned_Debian_packages_moved_to_git__216_to_go.html
</guid>
111 <pubDate>Thu,
11 Jul
2024 12:
30:
00 +
0200</pubDate>
112 <description><p
><a href=
"http://www.hungry.com/~pere/blog/Time_to_move_orphaned_Debian_packages_to_git.html
">In
113 April
</a
>, I started migrating orphaned Debian packages without any
114 version control system listed in debian/control to git. This morning,
115 my Debian QA page finally reached
200 QA packages migrated. In
116 reality there are a few more, as the packages uploaded by someone else
117 after my initial upload have disappeared from my QA uploads list. As
118 I am running out of steam and will most likely focus on other parts of
119 Debian moving forward, I hope someone else will find time to continue
120 the migration to bring the number of orphaned packages without any
121 version control system down to zero. Here is the updated recipe if
122 someone want to help out.
</p
>
124 <p
>To locate packages to work on, the following one-liner can be used:
</p
>
126 <blockquote
><pre
>
127 PGPASSWORD=
"udd-mirror
" psql --port=
5432 --host=udd-mirror.debian.net \
128 --username=udd-mirror udd -c
"select source from sources \
129 where release =
'sid
' and (vcs_url ilike
'%anonscm.debian.org%
' \
130 OR vcs_browser ilike
'%anonscm.debian.org%
' or vcs_url IS NULL \
131 OR vcs_browser IS NULL) AND maintainer ilike
'%packages@qa.debian.org%
' \
132 order by random() limit
10;
"
133 </pre
></blockquote
>
135 <p
>Pick a random package from the list and run the latest edition of
137 <tt
><a href=
"http://www.hungry.com/~pere/blog/images/
2024-
07-
11-debian-snap-to-salsa.sh
">debian-snap-to-salsa
</a
></tt
>
138 with the package name as the argument to prepare a git repository with
139 the existing packaging. This will download old Debian packages from
140 <tt
>snapshot.debian.org
</tt
>. Note that very recent uploads will not
141 be included, so check out the package on
<tt
>tracker.debian.org
</tt
>.
142 Next, run
<tt
>gbp buildpackage --git-ignore-new
</tt
> to verify that
143 the package build as it should, and then visit
144 <a href=
"https://salsa.debian.org/debian/
">https://salsa.debian.org/debian/
</a
>
145 and make sure there is not already a git repository for the package
146 there. I also did
<tt
>git log -p debian/control
</tt
> and look for vcs
147 entries to check if the package used to have a git repository on
148 Alioth, and see if it can be a useful starting point moving forward.
149 If all this check out, I created a new gitlab project below the Debian
150 group on salsa, push the package source there and upload a new version.
151 I tend to also ensure build hardening is enabled, if it prove to be
152 easy, and check if I can easily fix any lintian issues or bug reports.
153 If the process took more than
20 minutes, I dropped it and moved on to
154 another package.
</p
>
156 <p
>If I found patches in debian/patches/ that were not yet passed
157 upstream, I would send an email to make sure upstream know about them.
158 This has proved to be a valuable step, and caused several new releases
159 for software that initially appeared abandoned. :)
</p
>
161 <p
>As usual, if you use Bitcoin and want to show your support of my
162 activities, please send Bitcoin donations to my address
163 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
168 <title>Some notes from the
2024 LinuxCNC Norwegian developer gathering
</title>
169 <link>http://www.hungry.com/~pere/blog/Some_notes_from_the_2024_LinuxCNC_Norwegian_developer_gathering.html
</link>
170 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Some_notes_from_the_2024_LinuxCNC_Norwegian_developer_gathering.html
</guid>
171 <pubDate>Wed,
10 Jul
2024 14:
45:
00 +
0200</pubDate>
172 <description><p
>The Norwegian
<a href=
"https://linuxcnc.org/
">The LinuxCNC
</a
>
173 developer gathering
2024 is over. It was a great and productive
174 weekend, and I am sad that it is over.
</p
>
176 <p
>Regular readers probably still remember what LinuxCNC is, but her
177 is a quick summary for those that forgot? LinuxCNC is a free software
178 system for numerical control of machines such as milling machines,
179 lathes, plasma cutters, routers, cutting machines, robots and
180 hexapods. It eats G-code and produce motor movement and other changes
181 to the physical world, while reading sensor input.
</p
>
183 <p
>I am not quite sure about the total head count, as not all people
184 were present at the gathering the entire weekend, but I believe it was
185 close to
10 people showing their faces at the gathering. The
"hard
186 core
" of the group, who stayed the entire weekend, were two from
187 Norway, two from Germany and one from England. I am happy with the
188 outcome from the gathering. We managed to wrap up a new stable
189 LinuxCNC release
2.9.3 and even tested it on real hardware within
190 minutes of the release. The release notes for
2.9.3 are still being
191 written, but should show up on on the project site in the next few
192 days. We managed to go through around twenty pull requests and merge
193 then into either the stable release (
2.9) or the development branch
194 (master). There are still around thirty pull requests left to
195 process, so we are not out of work yet. We even managed to
196 fix/improve a slightly worn lathe, and experiment with running a
197 mechanical clock using G-code.
</p
>
199 <p
>The evening barbeque worked well both on Saturday and Sunday. It
200 is quite fun to light up a charcoal grill using compressed air. Sadly
201 the weather was not the best, so we stayed indoors most of the
204 <p
>This gathering was made possible partly with sponsoring from both
205 <a href=
"https://www.redpill-linpro.com/
">Redpill Linpro
</a
>,
206 <a href=
"https://debian.org/
">Debian
</a
> and
207 <a href=
"https://nuugfoundation.no/
">NUUG Foundation
</a
>, and we are
208 most grateful for the support. I would also like to thank the local
209 school for lending us some furniture, and of course the rest of the
210 members of the organizers team, Asle and Bosse, for their countless
211 contributions. The gathering was such success that we want to do it
212 again next year.
</p
>
214 <p
>We plan to organize the next Norwegian LinuxCNC developer gathering
215 at the end of June next year, the weekend Friday
27th to Sunday
29th
216 of June
2025. I recommend you reserve the dates on your calendar
217 today. Other related communities are also welcome to join in, for
218 example those working on systems like FreeCAD and opencamlib, as I am
219 sure we have much in common and sharing experiences would be very
220 useful to all involved. We are of course looking for sponsors for
221 this gathering already. The total budget for this gathering was
222 around NOK
25.000 (around EUR
2.300), so our needs are quite modest.
223 Perhaps a machine or tools company would like to help out the free
224 software manufacturing community by sponsoring food, lodging and
225 transport for such gathering?
</p
>
230 <title>The
2024 LinuxCNC Norwegian developer gathering
</title>
231 <link>http://www.hungry.com/~pere/blog/The_2024_LinuxCNC_Norwegian_developer_gathering.html
</link>
232 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_2024_LinuxCNC_Norwegian_developer_gathering.html
</guid>
233 <pubDate>Fri,
31 May
2024 07:
45:
00 +
0200</pubDate>
234 <description><p
><a href=
"https://linuxcnc.org/
">The LinuxCNC project
</a
> is still
235 going strong. And I believe this great software system for numerical control of
236 machines such as milling machines, lathes, plasma cutters, routers,
237 cutting machines, robots and hexapods, would do even better with more
238 in-person developer gatherings, so we plan to organise such gathering
239 this summer too.
</p
>
241 <p
>The Norwegian LinuxCNC developer gathering take place the weekend
242 Friday July
5th to
7th this year, and is open for everyone interested
243 in contributing to LinuxCNC and free software manufacturing. Up to
244 date information about the gathering can be found in
245 <a href=
"https://sourceforge.net/p/emc/mailman/emc-developers/thread/
123eaae0-f3b9-
4170-a251-b7d608f1e974%
40bofh.no/
">the
246 developer mailing list thread
</a
> where the gathering was announced.
247 Thanks to the good people at
249 <a href=
"https://www.debian.org/
">Debian
</a
> as well as leftover money
250 from last years gathering from
251 <a href=
"https://www.redpill-linpro.com/
">Redpill-Linpro
</a
> and
252 <a href=
"https://www.nuugfoundation.no/no/
">NUUG Foundation
</a
>, we
253 have enough sponsor funds to pay for food, and probably also shelter
254 for the people traveling from afar to join us. If you would like to
255 join the gathering, get in touch and add your details on
256 <a href=
"https://pad.efn.no/p/linuxcnc-
2024-norway
">the pad
</a
>.
</p
>
258 <p
>As usual, if you use Bitcoin and want to show your support of my
259 activities, please send Bitcoin donations to my address
260 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
265 <title>45 orphaned Debian packages moved to git,
391 to go
</title>
266 <link>http://www.hungry.com/~pere/blog/
45_orphaned_Debian_packages_moved_to_git__391_to_go.html
</link>
267 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/
45_orphaned_Debian_packages_moved_to_git__391_to_go.html
</guid>
268 <pubDate>Thu,
25 Apr
2024 22:
00:
00 +
0200</pubDate>
269 <description><p
>Nine days ago, I started migrating orphaned Debian packages with no
270 version control system listed in debian/control of the source to git.
271 At the time there were
438 such packages. Now there are
391,
272 according to the UDD. In reality it is slightly less, as there is a
273 delay between uploads and UDD updates. In the nine days since, I have
274 thus been able to work my way through ten percent of the packages. I
275 am starting to run out of steam, and hope someone else will also help
276 brushing some dust of these packages. Here is a recipe how to do it.
278 I start by picking a random package by querying the UDD for a list of
279 10 random packages from the set of remaining packages:
281 <blockquote
><pre
>
282 PGPASSWORD=
"udd-mirror
" psql --port=
5432 --host=udd-mirror.debian.net \
283 --username=udd-mirror udd -c
"select source from sources \
284 where release =
'sid
' and (vcs_url ilike
'%anonscm.debian.org%
' \
285 OR vcs_browser ilike
'%anonscm.debian.org%
' or vcs_url IS NULL \
286 OR vcs_browser IS NULL) AND maintainer ilike
'%packages@qa.debian.org%
' \
287 order by random() limit
10;
"
288 </pre
></blockquote
>
290 <p
>Next, I visit http://salsa.debian.org/debian and search for the
291 package name, to ensure no git repository already exist. If it does,
292 I clone it and try to get it to an uploadable state, and add the Vcs-*
293 entries in d/control to make the repository more widely known. These
294 packages are a minority, so I will not cover that use case here.
</p
>
296 <p
>For packages without an existing git repository, I run the
297 following script
<tt
>debian-snap-to-salsa
</tt
> to prepare a git
298 repository with the existing packaging.
</p
>
300 <blockquote
><pre
>
303 # See also https://bugs.debian.org/
804722#
31
307 # Move to this Standards-Version.
312 if [ -z
"$PKG
" ]; then
313 echo
"usage: $
0 <pkgname
>"
317 if [ -e
"${PKG}-salsa
" ]; then
318 echo
"error: ${PKG}-salsa already exist, aborting.
"
322 if [ -z
"ALLOWFAILURE
" ] ; then
326 # Fetch every snapshotted source package. Manually loop until all
327 # transfers succeed, as
'gbp import-dscs --debsnap
' do not fail on
329 until debsnap --force -v $PKG || $ALLOWFAILURE ; do sleep
1; done
330 mkdir ${PKG}-salsa; cd ${PKG}-salsa
333 # Specify branches to override any debian/gbp.conf file present in the
335 gbp import-dscs --debian-branch=master --upstream-branch=upstream \
336 --pristine-tar ../source-$PKG/*.dsc
338 # Add Vcs pointing to Salsa Debian project (must be manually created
340 if ! grep -q ^Vcs- debian/control ; then
341 awk
"BEGIN { s=
1 } /^\$/ { if (s==
1) { print \
"Vcs-Browser: https://salsa.debian.org/debian/$PKG\
"; print \
"Vcs-Git: https://salsa.debian.org/debian/$PKG.git\
" }; s=
0 } { print }
" < debian/control
> debian/control.new
&& mv debian/control.new debian/control
342 git commit -m
"Updated vcs in d/control to Salsa.
" debian/control
345 # Tell gbp to enforce the use of pristine-tar.
346 inifile +inifile debian/gbp.conf +create +section DEFAULT +key pristine-tar +value True
347 git add debian/gbp.conf
348 git commit -m
"Added d/gbp.conf to enforce the use of pristine-tar.
" debian/gbp.conf
350 # Update to latest Standards-Version.
351 SV=
"$(grep ^Standards-Version: debian/control|awk
'{print $
2}
')
"
352 if [ $SV_LATEST != $SV ]; then
353 sed -i
"s/\(Standards-Version: \)\(.*\)/\
1$SV_LATEST/
" debian/control
354 git commit -m
"Updated Standards-Version from $SV to $SV_LATEST.
" debian/control
357 if grep -q pkg-config debian/control; then
358 sed -i s/pkg-config/pkgconf/ debian/control
359 git commit -m
"Replaced obsolete pkg-config build dependency with pkgconf.
" debian/control
362 if grep -q libncurses5-dev debian/control; then
363 sed -i s/libncurses5-dev/libncurses-dev/ debian/control
364 git commit -m
"Replaced obsolete libncurses5-dev build dependency with libncurses-dev.
" debian/control
366 </pre
></blockquote
>
368 Some times the debsnap script fail to download some of the versions.
369 In those cases I investigate, and if I decide the failing versions
370 will not be missed, I call it using ALLOWFAILURE=true to ignore the
371 problem and create the git repository anyway.
</p
>
373 <p
>With the git repository in place, I do a test build (gbp
374 buildpackage) to ensure the build is actually working. If it does not
375 I pick a different package, or if the build failure is trivial to fix,
376 I fix it before continuing. At this stage I revisit
377 http://salsa.debian.org/debian and create the project under this group
378 for the package. I then follow the instructions to publish the local
379 git repository. Here is from a recent example:
</p
>
381 <blockquote
><pre
>
382 git remote add origin git@salsa.debian.org:debian/perl-byacc.git
383 git push --set-upstream origin master upstream pristine-tar
385 </pre
></blockquote
>
387 <p
>With a working build, I have a look at the build rules if I want to
388 remove some more dust. I normally try to move to debhelper compat
389 level
13, which involves removing debian/compat and modifying
390 debian/control to build depend on debhelper-compat (=
13). I also test
391 with
'Rules-Requires-Root: no
' in debian/control and verify in
392 debian/rules that hardening is enabled, and include all of these if
393 the package still build. If it fail to build with level
13, I try
394 with
12,
11,
10 and so on until I find a level where it build, as I do
395 not want to spend a lot of time fixing build issues.
</p
>
397 <p
>Some times, when I feel inspired, I make sure debian/copyright is
398 converted to the machine readable format, often by starting with
399 'debhelper -cc
' and then cleaning up the autogenerated content until
400 it matches realities. If I feel like it, I might also clean up
401 non-dh-based debian/rules files to use the short style dh build
404 <p
>Once I have removed all the dust I care to process for the package,
405 I run
'gbp dch
' to generate a debian/changelog entry based on the
406 commits done so far, run
'dch -r
' to switch from
'UNRELEASED
' to
407 'unstable
' and get an editor to make sure the
'QA upload
' marker is in
408 place and that all long commit descriptions are wrapped into sensible
409 lengths, run
'debcommit --release -a
' to commit and tag the new
410 debian/changelog entry, run
'debuild -S
' to build a source only
411 package, and
'dput ../perl-byacc_2.0-
10_source.changes
' to do the
412 upload. During the entire process, and many times per step, I run
413 'debuild
' to verify the changes done still work. I also some times
414 verify the set of built files using
'find debian
' to see if I can spot
415 any problems (like no file in usr/bin any more or empty package). I
416 also try to fix all lintian issues reported at the end of each
417 'debuild
' run.
</p
>
419 <p
>If I find Debian specific patches, I try to ensure their metadata
420 is fairly up to date and some times I even try to reach out to
421 upstream, to make the upstream project aware of the patches. Most of
422 my emails bounce, so the success rate is low. For projects with no
423 Homepage entry in debian/control I try to track down one, and for
424 packages with no debian/watch file I try to create one. But at least
425 for some of the packages I have been unable to find a functioning
426 upstream, and must skip both of these.
</p
>
428 <p
>If I could handle ten percent in nine days, twenty people could
429 complete the rest in less then five days. I use approximately twenty
430 minutes per package, when I have twenty minutes spare time to spend.
431 Perhaps you got twenty minutes to spare too?
</p
>
433 <p
>As usual, if you use Bitcoin and want to show your support of my
434 activities, please send Bitcoin donations to my address
435 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
437 <p
><strong
>Update
2024-
05-
04:
</strong
> There is
438 <a href=
"http://www.hungry.com/~pere/blog/images/
2024-
05-
04-debian-snap-to-salsa.sh
">an
439 updated edition of my migration script
</a
>, last updated
440 2024-
05-
04.
</p
>
445 <title>Time to move orphaned Debian packages to git
</title>
446 <link>http://www.hungry.com/~pere/blog/Time_to_move_orphaned_Debian_packages_to_git.html
</link>
447 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Time_to_move_orphaned_Debian_packages_to_git.html
</guid>
448 <pubDate>Sun,
14 Apr
2024 09:
30:
00 +
0200</pubDate>
449 <description><p
>There are several packages in Debian without a associated git
450 repository with the packaging history. This is unfortunate and it
451 would be nice if more of these would do so. Quote a lot of these are
452 without a maintainer, ie listed as maintained by the
453 '<a href=
"https://qa.debian.org/developer.php?email=packages%
40qa.debian.org
">Debian
454 QA Group
</a
>' place holder. In fact,
438 packages have this property
455 according to UDD (
<tt
>SELECT source FROM sources WHERE release =
'sid
'
456 AND (vcs_url ilike
'%anonscm.debian.org%
' OR vcs_browser ilike
457 '%anonscm.debian.org%
' or vcs_url IS NULL OR vcs_browser IS NULL) AND
458 maintainer ilike
'%packages@qa.debian.org%
';
</tt
>). Such packages can
459 be updated without much coordination by any Debian developer, as they
460 are considered orphaned.
</p
>
462 <p
>To try to improve the situation and reduce the number of packages
463 without associated git repository, I started a few days ago to search
464 out candiates and provide them with a git repository under the
465 'debian
' collaborative Salsa project. I started with the packages
466 pointing to obsolete Alioth git repositories, and am now working my
467 way across the ones completely without git references. In addition to
468 updating the Vcs-* debian/control fields, I try to update
469 Standards-Version, debhelper compat level, simplify d/rules, switch to
470 Rules-Requires-Root: no and fix lintian issues reported. I only
471 implement those that are trivial to fix, to avoid spending too much
472 time on each orphaned package. So far my experience is that it take
473 aproximately
20 minutes to convert a package without any git
474 references, and a lot more for packages with existing git repositories
475 incompatible with git-buildpackages.
</p
>
477 <p
>So far I have converted
10 packages, and I will keep going until I
478 run out of steam. As should be clear from the numbers, there is
479 enough packages remaining for more people to do the same without
480 stepping on each others toes. I find it useful to start by searching
481 for a git repo already on salsa, as I find that some times a git repo
482 has already been created, but no new version is uploaded to Debian
483 yet. In those cases I start with the existing git repository. I
484 convert to the git-buildpackage+pristine-tar workflow, and ensure a
485 debian/gbp.conf file with
"pristine-tar=True
" is added early, to avoid
486 uploading a orig.tar.gz with the wrong checksum by mistake. Did that
487 three times in the begin before I remembered my mistake.
</p
>
489 <p
>So, if you are a Debian Developer and got some spare time, perhaps
490 considering migrating some orphaned packages to git?
</p
>
492 <p
>As usual, if you use Bitcoin and want to show your support of my
493 activities, please send Bitcoin donations to my address
494 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
499 <title>New and improved sqlcipher in Debian for accessing Signal database
</title>
500 <link>http://www.hungry.com/~pere/blog/New_and_improved_sqlcipher_in_Debian_for_accessing_Signal_database.html
</link>
501 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_and_improved_sqlcipher_in_Debian_for_accessing_Signal_database.html
</guid>
502 <pubDate>Sun,
12 Nov
2023 12:
00:
00 +
0100</pubDate>
503 <description><p
>For a while now I wanted to have direct access to the
504 <a href=
"https://signal.org/
">Signal
</a
> database of messages and
505 channels of my Desktop edition of Signal. I prefer the enforced end
506 to end encryption of Signal these days for my communication with
507 friends and family, to increase the level of safety and privacy as
508 well as raising the cost of the mass surveillance government and
509 non-government entities practice these days. In August I came across
511 <a href=
"https://www.yoranbrondsema.com/post/the-guide-to-extracting-statistics-from-your-signal-conversations/
">recipe
512 on how to use sqlcipher to extract statistics from the Signal
513 database
</a
> explaining how to do this. Unfortunately this did not
514 work with the version of sqlcipher in Debian. The
515 <a href=
"http://tracker.debian.org/sqlcipher/
">sqlcipher
</a
>
516 package is a
"fork
" of the sqlite package with added support for
517 encrypted databases. Sadly the current Debian maintainer
518 <a href=
"https://bugs.debian.org/
961598">announced more than three
519 years ago that he did not have time to maintain sqlcipher
</a
>, so it
520 seemed unlikely to be upgraded by the maintainer. I was reluctant to
521 take on the job myself, as I have very limited experience maintaining
522 shared libraries in Debian. After waiting and hoping for a few
523 months, I gave up the last week, and set out to update the package. In
524 the process I orphaned it to make it more obvious for the next person
525 looking at it that the package need proper maintenance.
</p
>
527 <p
>The version in Debian was around five years old, and quite a lot of
528 changes had taken place upstream into the Debian maintenance git
529 repository. After spending a few days importing the new upstream
530 versions, realising that upstream did not care much for SONAME
531 versioning as I saw library symbols being both added and removed with
532 minor version number changes to the project, I concluded that I had to
533 do a SONAME bump of the library package to avoid surprising the
534 reverse dependencies. I even added a simple
535 autopkgtest script to ensure the package work as intended. Dug deep
536 into the hole of learning shared library maintenance, I set out a few
537 days ago to upload the new version to Debian experimental to see what
538 the quality assurance framework in Debian had to say about the result.
539 The feedback told me the pacakge was not too shabby, and yesterday I
540 uploaded the latest version to Debian unstable. It should enter
541 testing today or tomorrow, perhaps delayed by
542 <a href=
"https://bugs.debian.org/
1055812">a small library
543 transition
</a
>.
</p
>
545 <p
>Armed with a new version of sqlcipher, I can now have a look at the
546 SQL database in ~/.config/Signal/sql/db.sqlite. First, one need to
547 fetch the encryption key from the Signal configuration using this
548 simple JSON extraction command:
</p
>
550 <pre
>/usr/bin/jq -r
'.
"key
"' ~/.config/Signal/config.json
</pre
>
552 <p
>Assuming the result from that command is
'secretkey
', which is a
553 hexadecimal number representing the key used to encrypt the database.
554 Next, one can now connect to the database and inject the encryption
555 key for access via SQL to fetch information from the database. Here
556 is an example dumping the database structure:
</p
>
559 % sqlcipher ~/.config/Signal/sql/db.sqlite
560 sqlite
> PRAGMA key =
"x
'secretkey
'";
562 CREATE TABLE sqlite_stat1(tbl,idx,stat);
563 CREATE TABLE conversations(
564 id STRING PRIMARY KEY ASC,
572 , profileFamilyName TEXT, profileFullName TEXT, e164 TEXT, serviceId TEXT, groupId TEXT, profileLastFetchedAt INTEGER);
573 CREATE TABLE identityKeys(
574 id STRING PRIMARY KEY ASC,
578 id STRING PRIMARY KEY ASC,
581 CREATE TABLE sessions(
585 , ourServiceId STRING, serviceId STRING);
586 CREATE TABLE attachment_downloads(
587 id STRING primary key,
592 CREATE TABLE sticker_packs(
597 coverStickerId INTEGER,
599 downloadAttempts INTEGER,
603 stickerCount INTEGER,
605 , attemptedStatus STRING, position INTEGER DEFAULT
0 NOT NULL, storageID STRING, storageVersion INTEGER, storageUnknownFields BLOB, storageNeedsSync
606 INTEGER DEFAULT
0 NOT NULL);
607 CREATE TABLE stickers(
609 packId TEXT NOT NULL,
618 PRIMARY KEY (id, packId),
619 CONSTRAINT stickers_fk
621 REFERENCES sticker_packs(id)
624 CREATE TABLE sticker_references(
627 CONSTRAINT sticker_references_fk
629 REFERENCES sticker_packs(id)
633 shortName TEXT PRIMARY KEY,
636 CREATE TABLE messages(
637 rowid INTEGER PRIMARY KEY ASC,
643 schemaVersion INTEGER,
644 conversationId STRING,
647 hasAttachments INTEGER,
648 hasFileAttachments INTEGER,
649 hasVisualMediaAttachments INTEGER,
651 expirationStartTimestamp INTEGER,
654 messageTimer INTEGER,
655 messageTimerStart INTEGER,
656 messageTimerExpiresAt INTEGER,
659 sourceServiceId TEXT, serverGuid STRING NULL, sourceDevice INTEGER, storyId STRING, isStory INTEGER
660 GENERATED ALWAYS AS (type IS
'story
'), isChangeCreatedByUs INTEGER NOT NULL DEFAULT
0, isTimerChangeFromSync INTEGER
661 GENERATED ALWAYS AS (
662 json_extract(json,
'$.expirationTimerUpdate.fromSync
') IS
1
663 ), seenStatus NUMBER default
0, storyDistributionListId STRING, expiresAt INT
666 expirationStartTimestamp + (expireTimer *
1000),
668 )), shouldAffectActivity INTEGER
669 GENERATED ALWAYS AS (
673 'change-number-notification
',
674 'contact-removed-notification
',
675 'conversation-merge
',
676 'group-v1-migration
',
678 'message-history-unsynced
',
679 'profile-change
',
681 'universal-timer-notification
',
682 'verified-change
'
684 ), shouldAffectPreview INTEGER
685 GENERATED ALWAYS AS (
689 'change-number-notification
',
690 'contact-removed-notification
',
691 'conversation-merge
',
692 'group-v1-migration
',
694 'message-history-unsynced
',
695 'profile-change
',
697 'universal-timer-notification
',
698 'verified-change
'
700 ), isUserInitiatedMessage INTEGER
701 GENERATED ALWAYS AS (
705 'change-number-notification
',
706 'contact-removed-notification
',
707 'conversation-merge
',
708 'group-v1-migration
',
709 'group-v2-change
',
711 'message-history-unsynced
',
712 'profile-change
',
714 'universal-timer-notification
',
715 'verified-change
'
717 ), mentionsMe INTEGER NOT NULL DEFAULT
0, isGroupLeaveEvent INTEGER
718 GENERATED ALWAYS AS (
719 type IS
'group-v2-change
' AND
720 json_array_length(json_extract(json,
'$.groupV2Change.details
')) IS
1 AND
721 json_extract(json,
'$.groupV2Change.details[
0].type
') IS
'member-remove
' AND
722 json_extract(json,
'$.groupV2Change.from
') IS NOT NULL AND
723 json_extract(json,
'$.groupV2Change.from
') IS json_extract(json,
'$.groupV2Change.details[
0].aci
')
724 ), isGroupLeaveEventFromOther INTEGER
725 GENERATED ALWAYS AS (
726 isGroupLeaveEvent IS
1
728 isChangeCreatedByUs IS
0
730 GENERATED ALWAYS AS (
731 json_extract(json,
'$.callId
')
733 CREATE TABLE sqlite_stat4(tbl,idx,neq,nlt,ndlt,sample);
736 queueType TEXT STRING NOT NULL,
737 timestamp INTEGER NOT NULL,
740 CREATE TABLE reactions(
741 conversationId STRING,
744 messageReceivedAt INTEGER,
745 targetAuthorAci STRING,
746 targetTimestamp INTEGER,
749 CREATE TABLE senderKeys(
750 id TEXT PRIMARY KEY NOT NULL,
751 senderId TEXT NOT NULL,
752 distributionId TEXT NOT NULL,
754 lastUpdatedDate NUMBER NOT NULL
756 CREATE TABLE unprocessed(
757 id STRING PRIMARY KEY ASC,
764 serverTimestamp INTEGER,
765 sourceServiceId STRING
766 , serverGuid STRING NULL, sourceDevice INTEGER, receivedAtCounter INTEGER, urgent INTEGER, story INTEGER);
767 CREATE TABLE sendLogPayloads(
768 id INTEGER PRIMARY KEY ASC,
770 timestamp INTEGER NOT NULL,
771 contentHint INTEGER NOT NULL,
773 , urgent INTEGER, hasPniSignatureMessage INTEGER DEFAULT
0 NOT NULL);
774 CREATE TABLE sendLogRecipients(
775 payloadId INTEGER NOT NULL,
777 recipientServiceId STRING NOT NULL,
778 deviceId INTEGER NOT NULL,
780 PRIMARY KEY (payloadId, recipientServiceId, deviceId),
782 CONSTRAINT sendLogRecipientsForeignKey
783 FOREIGN KEY (payloadId)
784 REFERENCES sendLogPayloads(id)
787 CREATE TABLE sendLogMessageIds(
788 payloadId INTEGER NOT NULL,
790 messageId STRING NOT NULL,
792 PRIMARY KEY (payloadId, messageId),
794 CONSTRAINT sendLogMessageIdsForeignKey
795 FOREIGN KEY (payloadId)
796 REFERENCES sendLogPayloads(id)
799 CREATE TABLE preKeys(
800 id STRING PRIMARY KEY ASC,
802 , ourServiceId NUMBER
803 GENERATED ALWAYS AS (json_extract(json,
'$.ourServiceId
')));
804 CREATE TABLE signedPreKeys(
805 id STRING PRIMARY KEY ASC,
807 , ourServiceId NUMBER
808 GENERATED ALWAYS AS (json_extract(json,
'$.ourServiceId
')));
811 category TEXT NOT NULL,
813 descriptionTemplate TEXT NOT NULL
815 CREATE TABLE badgeImageFiles(
816 badgeId TEXT REFERENCES badges(id)
819 'order
' INTEGER NOT NULL,
824 CREATE TABLE storyReads (
825 authorId STRING NOT NULL,
826 conversationId STRING NOT NULL,
827 storyId STRING NOT NULL,
828 storyReadDate NUMBER NOT NULL,
830 PRIMARY KEY (authorId, storyId)
832 CREATE TABLE storyDistributions(
833 id STRING PRIMARY KEY NOT NULL,
836 senderKeyInfoJson STRING
837 , deletedAtTimestamp INTEGER, allowsReplies INTEGER, isBlockList INTEGER, storageID STRING, storageVersion INTEGER, storageUnknownFields BLOB, storageNeedsSync INTEGER);
838 CREATE TABLE storyDistributionMembers(
839 listId STRING NOT NULL REFERENCES storyDistributions(id)
842 serviceId STRING NOT NULL,
844 PRIMARY KEY (listId, serviceId)
846 CREATE TABLE uninstalled_sticker_packs (
847 id STRING NOT NULL PRIMARY KEY,
848 uninstalledAt NUMBER NOT NULL,
850 storageVersion NUMBER,
851 storageUnknownFields BLOB,
852 storageNeedsSync INTEGER NOT NULL
854 CREATE TABLE groupCallRingCancellations(
855 ringId INTEGER PRIMARY KEY,
856 createdAt INTEGER NOT NULL
858 CREATE TABLE IF NOT EXISTS
'messages_fts_data
'(id INTEGER PRIMARY KEY, block BLOB);
859 CREATE TABLE IF NOT EXISTS
'messages_fts_idx
'(segid, term, pgno, PRIMARY KEY(segid, term)) WITHOUT ROWID;
860 CREATE TABLE IF NOT EXISTS
'messages_fts_content
'(id INTEGER PRIMARY KEY, c0);
861 CREATE TABLE IF NOT EXISTS
'messages_fts_docsize
'(id INTEGER PRIMARY KEY, sz BLOB);
862 CREATE TABLE IF NOT EXISTS
'messages_fts_config
'(k PRIMARY KEY, v) WITHOUT ROWID;
863 CREATE TABLE edited_messages(
864 messageId STRING REFERENCES messages(id)
868 , conversationId STRING);
869 CREATE TABLE mentions (
870 messageId REFERENCES messages(id) ON DELETE CASCADE,
875 CREATE TABLE kyberPreKeys(
876 id STRING PRIMARY KEY NOT NULL,
877 json TEXT NOT NULL, ourServiceId NUMBER
878 GENERATED ALWAYS AS (json_extract(json,
'$.ourServiceId
')));
879 CREATE TABLE callsHistory (
880 callId TEXT PRIMARY KEY,
881 peerId TEXT NOT NULL, -- conversation id (legacy) | uuid | groupId | roomId
882 ringerId TEXT DEFAULT NULL, -- ringer uuid
883 mode TEXT NOT NULL, -- enum
"Direct
" |
"Group
"
884 type TEXT NOT NULL, -- enum
"Audio
" |
"Video
" |
"Group
"
885 direction TEXT NOT NULL, -- enum
"Incoming
" |
"Outgoing
886 -- Direct: enum
"Pending
" |
"Missed
" |
"Accepted
" |
"Deleted
"
887 -- Group: enum
"GenericGroupCall
" |
"OutgoingRing
" |
"Ringing
" |
"Joined
" |
"Missed
" |
"Declined
" |
"Accepted
" |
"Deleted
"
888 status TEXT NOT NULL,
889 timestamp INTEGER NOT NULL,
890 UNIQUE (callId, peerId) ON CONFLICT FAIL
892 [ dropped all indexes to save space in this blog post ]
893 CREATE TRIGGER messages_on_view_once_update AFTER UPDATE ON messages
895 new.body IS NOT NULL AND new.isViewOnce =
1
897 DELETE FROM messages_fts WHERE rowid = old.rowid;
899 CREATE TRIGGER messages_on_insert AFTER INSERT ON messages
900 WHEN new.isViewOnce IS NOT
1 AND new.storyId IS NULL
902 INSERT INTO messages_fts
905 (new.rowid, new.body);
907 CREATE TRIGGER messages_on_delete AFTER DELETE ON messages BEGIN
908 DELETE FROM messages_fts WHERE rowid = old.rowid;
909 DELETE FROM sendLogPayloads WHERE id IN (
910 SELECT payloadId FROM sendLogMessageIds
911 WHERE messageId = old.id
913 DELETE FROM reactions WHERE rowid IN (
914 SELECT rowid FROM reactions
915 WHERE messageId = old.id
917 DELETE FROM storyReads WHERE storyId = old.storyId;
919 CREATE VIRTUAL TABLE messages_fts USING fts5(
921 tokenize =
'signal_tokenizer
'
923 CREATE TRIGGER messages_on_update AFTER UPDATE ON messages
925 (new.body IS NULL OR old.body IS NOT new.body) AND
926 new.isViewOnce IS NOT
1 AND new.storyId IS NULL
928 DELETE FROM messages_fts WHERE rowid = old.rowid;
929 INSERT INTO messages_fts
932 (new.rowid, new.body);
934 CREATE TRIGGER messages_on_insert_insert_mentions AFTER INSERT ON messages
936 INSERT INTO mentions (messageId, mentionAci, start, length)
938 SELECT messages.id, bodyRanges.value -
>> 'mentionAci
' as mentionAci,
939 bodyRanges.value -
>> 'start
' as start,
940 bodyRanges.value -
>> 'length
' as length
941 FROM messages, json_each(messages.json -
>> 'bodyRanges
') as bodyRanges
942 WHERE bodyRanges.value -
>> 'mentionAci
' IS NOT NULL
944 AND messages.id = new.id;
946 CREATE TRIGGER messages_on_update_update_mentions AFTER UPDATE ON messages
948 DELETE FROM mentions WHERE messageId = new.id;
949 INSERT INTO mentions (messageId, mentionAci, start, length)
951 SELECT messages.id, bodyRanges.value -
>> 'mentionAci
' as mentionAci,
952 bodyRanges.value -
>> 'start
' as start,
953 bodyRanges.value -
>> 'length
' as length
954 FROM messages, json_each(messages.json -
>> 'bodyRanges
') as bodyRanges
955 WHERE bodyRanges.value -
>> 'mentionAci
' IS NOT NULL
957 AND messages.id = new.id;
962 <p
>Finally I have the tool needed to inspect and process Signal
963 messages that I need, without using the vendor provided client. Now
964 on to transforming it to a more useful format.
</p
>
966 <p
>As usual, if you use Bitcoin and want to show your support of my
967 activities, please send Bitcoin donations to my address
968 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
973 <title>New chrpath release
0.17</title>
974 <link>http://www.hungry.com/~pere/blog/New_chrpath_release_0_17.html
</link>
975 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_chrpath_release_0_17.html
</guid>
976 <pubDate>Fri,
10 Nov
2023 07:
30:
00 +
0100</pubDate>
977 <description><p
>The chrpath package provide a simple command line tool to remove or
978 modify the rpath or runpath of compiled ELF program. It is almost
10
979 years since I updated the code base, but I stumbled over the tool
980 today, and decided it was time to move the code base from Subversion
981 to git and find a new home for it, as the previous one (Debian Alioth)
982 has been shut down. I decided to go with
983 <a href=
"https://codeberg.org/
">Codeberg
</a
> this time, as it is my git
984 service of choice these days, did a quick and dirty migration to git
985 and updated the code with a few patches I found in the Debian bug
986 tracker. These are the release notes:
</p
>
988 <p
>New in
0.17 released
2023-
11-
10:
</p
>
991 <li
>Moved project to Codeberg, as Alioth is shut down.
</li
>
992 <li
>Add Solaris support (use
&lt;sys/byteorder.h
> instead of
&lt;byteswap.h
>).
993 Patch from Rainer Orth.
</li
>
994 <li
>Added missing newline from printf() line. Patch from Frank Dana.
</li
>
995 <li
>Corrected handling of multiple ELF sections. Patch from Frank Dana.
</li
>
996 <li
>Updated build rules for .deb. Partly based on patch from djcj.
</li
>
999 <p
>The latest edition is tagged and available from
1000 <a href=
"https://codeberg.org/pere/chrpath
">https://codeberg.org/pere/chrpath
</a
>.
1002 <p
>As usual, if you use Bitcoin and want to show your support of my
1003 activities, please send Bitcoin donations to my address
1004 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1009 <title>Test framework for DocBook processors / formatters
</title>
1010 <link>http://www.hungry.com/~pere/blog/Test_framework_for_DocBook_processors___formatters.html
</link>
1011 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Test_framework_for_DocBook_processors___formatters.html
</guid>
1012 <pubDate>Sun,
5 Nov
2023 13:
00:
00 +
0100</pubDate>
1013 <description><p
>All the books I have published so far has been using
1014 <a href=
"https://docbook.org/
">DocBook
</a
> somewhere in the process.
1015 For the first book, the source format was DocBook, while for every
1016 later book it was an intermediate format used as the stepping stone to
1017 be able to present the same manuscript in several formats, on paper,
1018 as ebook in ePub format, as a HTML page and as a PDF file either for
1019 paper production or for Internet consumption. This is made possible
1020 with a wide variety of free software tools with DocBook support in
1021 Debian. The source format of later books have been docx via rst,
1022 Markdown, Filemaker and Asciidoc, and for all of these I was able to
1023 generate a suitable DocBook file for further processing using
1024 <a href=
"https://tracker.debian.org/pkg/pandoc
">pandoc
</a
>,
1025 <a href=
"https://tracker.debian.org/pkg/asciidoc
">a2x
</a
> and
1026 <a href=
"https://tracker.debian.org/pkg/asciidoctor
">asciidoctor
</a
>,
1027 as well as rendering using
1028 <a href=
"https://tracker.debian.org/pkg/xmlto
">xmlto
</a
>,
1029 <a href=
"https://tracker.debian.org/pkg/dbtoepub
">dbtoepub
</a
>,
1030 <a href=
"https://tracker.debian.org/pkg/dblatex
">dblatex
</a
>,
1031 <a href=
"https://tracker.debian.org/pkg/docbook-xsl
">docbook-xsl
</a
> and
1032 <a href=
"https://tracker.debian.org/pkg/fop
">fop
</a
>.
</p
>
1034 <p
>Most of the
<a href=
"http://www.hungry.com/~pere/publisher/
">books I
1035 have published
</a
> are translated books, with English as the source
1036 language. The use of
1037 <a href=
"https://tracker.debian.org/pkg/po4a
">po4a
</a
> to
1038 handle translations using the gettext PO format has been a blessing,
1039 but publishing translated books had triggered the need to ensure the
1040 DocBook tools handle relevant languages correctly. For every new
1041 language I have published, I had to submit patches dblatex, dbtoepub
1042 and docbook-xsl fixing incorrect language and country specific issues
1043 in the framework themselves. Typically this has been missing keywords
1044 like
'figure
' or sort ordering of index entries. After a while it
1045 became tiresome to only discover issues like this by accident, and I
1046 decided to write a DocBook
"test framework
" exercising various
1047 features of DocBook and allowing me to see all features exercised for
1048 a given language. It consist of a set of DocBook files, a version
4
1049 book, a version
5 book, a v4 book set, a v4 selection of problematic
1050 tables, one v4 testing sidefloat and finally one v4 testing a book of
1051 articles. The DocBook files are accompanied with a set of build rules
1052 for building PDF using dblatex and docbook-xsl/fop, HTML using xmlto
1053 or docbook-xsl and epub using dbtoepub. The result is a set of files
1054 visualizing footnotes, indexes, table of content list, figures,
1055 formulas and other DocBook features, allowing for a quick review on
1056 the completeness of the given locale settings. To build with a
1057 different language setting, all one need to do is edit the lang= value
1058 in the .xml file to pick a different ISO
639 code value and run
1059 'make
'.
</p
>
1061 <p
>The
<a href=
"https://codeberg.org/pere/docbook-example/
">test framework
1062 source code
</a
> is available from Codeberg, and a generated set of
1063 presentations of the various examples is available as Codeberg static
1065 <a href=
"https://pere.codeberg.page/docbook-example/
">https://pere.codeberg.page/docbook-example/
</a
>.
1066 Using this test framework I have been able to discover and report
1067 several bugs and missing features in various tools, and got a lot of
1068 them fixed. For example I got Northern Sami keywords added to both
1069 docbook-xsl and dblatex, fixed several typos in Norwegian bokmål and
1070 Norwegian Nynorsk, support for non-ascii title IDs added to pandoc,
1071 Norwegian index sorting support fixed in xindy and initial Norwegian
1072 Bokmål support added to dblatex. Some issues still remains, though.
1073 Default index sorting rules are still broken in several tools, so the
1074 Norwegian letters æ, ø and å are more often than not sorted properly
1075 in the book index.
</p
>
1077 <p
>The test framework recently received some more polish, as part of
1078 publishing my latest book. This book contained a lot of fairly
1079 complex tables, which exposed bugs in some of the tools. This made me
1080 add a new test file with various tables, as well as spend some time to
1081 brush up the build rules. My goal is for the test framework to
1082 exercise all DocBook features to make it easier to see which features
1083 work with different processors, and hopefully get them all to support
1084 the full set of DocBook features. Feel free to send patches to extend
1085 the test set, and test it with your favorite DocBook processor.
1086 Please visit these two URLs to learn more:
</p
>
1089 <li
><a href=
"https://codeberg.org/pere/docbook-example/
">https://codeberg.org/pere/docbook-example/
</a
></li
>
1090 <li
><a href=
"https://pere.codeberg.page/docbook-example/
">https://pere.codeberg.page/docbook-example/
</a
></li
>
1093 <p
>If you want to learn more on Docbook and translations, I recommend
1094 having a look at the
<a href=
"https://docbook.org/
">the DocBook
1096 <a href=
"https://doccookbook.sourceforge.net/html/en/
">the DoCookBook
1097 site
<a/
> and my earlier blog post on
1098 <a href=
"http://www.hungry.com/~pere/blog/From_English_wiki_to_translated_PDF_and_epub_via_Docbook.html
">how
1099 the Skolelinux project process and translate documentation
</a
>, a talk I gave earlier this year on
1100 <a href=
"https://www.nuug.no/aktiviteter/
20230314-oversetting-og-publisering-av-b%c3%b8ker-med-fri-programvare/
">how
1101 to translate and publish books using free software
</a
> (Norwegian
1106 https://github.com/docbook/xslt10-stylesheets/issues/
205 (docbook-xsl: sme support)
1107 https://bugs.debian.org/
968437 (xindy: index sorting rules for nb/nn)
1108 https://bugs.debian.org/
856123 (pandoc: markdown to docbook with non-english titles)
1109 https://bugs.debian.org/
864813 (dblatex: missing nb words)
1110 https://bugs.debian.org/
756386 (dblatex: index sorting rules for nb/nn)
1111 https://bugs.debian.org/
796871 (dbtoepub: index sorting rules for nb/nn)
1112 https://bugs.debian.org/
792616 (dblatex: PDF metadata)
1113 https://bugs.debian.org/
686908 (docbook-xsl: index sorting rules for nb/nn)
1114 https://sourceforge.net/tracker/?func=detail
&atid=
373747&aid=
3556630&group_id=
21935 (docbook-xsl: nb/nn support)
1115 https://bugs.debian.org/
684391 (dblatex: initial nb support)
1119 <p
>As usual, if you use Bitcoin and want to show your support of my
1120 activities, please send Bitcoin donations to my address
1121 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1126 <title>What did I learn from OpenSnitch this summer?
</title>
1127 <link>http://www.hungry.com/~pere/blog/What_did_I_learn_from_OpenSnitch_this_summer_.html
</link>
1128 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_did_I_learn_from_OpenSnitch_this_summer_.html
</guid>
1129 <pubDate>Sun,
11 Jun
2023 08:
30:
00 +
0200</pubDate>
1130 <description><p
>With yesterdays
1131 <a href=
"https://www.debian.org/News/
2023/
20230610">release of Debian
1132 12 Bookworm
</a
>, I am happy to know the
1133 <a href=
"https://tracker.debian.org/pkg/opensnitch
">the interactive
1134 application firewall OpenSnitch
</a
> is available for a wider audience.
1135 I have been running it for a few weeks now, and have been surprised
1136 about some of the programs connecting to the Internet. Some programs
1137 are obviously calling out from my machine, like the NTP network based
1138 clock adjusting system and Tor to reach other Tor clients, but others
1139 were more dubious. For example, the KDE Window manager try to look up
1140 the host name in DNS, for no apparent reason, but if this lookup is
1141 blocked the KDE desktop get periodically stuck when I use it. Another
1142 surprise was how much Firefox call home directly to mozilla.com,
1143 mozilla.net and googleapis.com, to mention a few, when I visit other
1144 web pages. This direct connection happen even if I told Firefox to
1145 always use a proxy, and the proxy setting is ignored for this traffic.
1146 Other surprising connections come from audacity and dirmngr (I do not
1147 use Gnome). It took some trial and error to get a good default set of
1148 permissions. Without it, I would get popups asking for permissions at
1149 any time, also the most inconvenient ones where I am in the middle of
1150 a time sensitive gaming session.
</p
>
1152 <p
>I suspect some application developers should rethink when then need
1153 to use network connections or DNS lookups, and recommend testing
1154 OpenSnitch (only
<tt
>apt install opensnitch
</tt
> away in Debian
1155 Bookworm) to locate and report any surprising Internet connections on
1156 your desktop machine.
</p
>
1158 <p
>At the moment the upstream developer and Debian package maintainer
1159 is working on making the system more reliable in Debian, by enabling
1160 the eBPF kernel module to track processes and connections instead of
1161 depending in content in /proc/. This should enter unstable fairly
1164 <p
>As usual, if you use Bitcoin and want to show your support of my
1165 activities, please send Bitcoin donations to my address
1166 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1168 <p
><strong
>Update
2023-
06-
12</strong
>: I got a tip about
1169 <a href=
"https://wiki.debian.org/PrivacyIssues
">a list of privacy
1170 issues in Free Software
</a
> and the
1171 <a href=
"irc://irc.debian.org/%
23debian-privacy
">#debian-privacy IRC
1172 channel
</a
> discussing these topics.
</p
>
1178 <title>wmbusmeters, parse data from your utility meter - nice free software
</title>
1179 <link>http://www.hungry.com/~pere/blog/wmbusmeters__parse_data_from_your_utility_meter___nice_free_software.html
</link>
1180 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/wmbusmeters__parse_data_from_your_utility_meter___nice_free_software.html
</guid>
1181 <pubDate>Fri,
19 May
2023 21:
50:
00 +
0200</pubDate>
1182 <description><p
>There is a European standard for reading utility meters like water,
1183 gas, electricity or heat distribution meters. The
1184 <a href=
"https://en.wikipedia.org/wiki/Meter-Bus
">Meter-Bus standard
1185 (EN
13757-
2, EN
13757-
3 and EN
13757–
4)
</a
> provide a cross vendor way
1186 to talk to and collect meter data. I ran into this standard when I
1187 wanted to monitor some heat distribution meters, and managed to find
1188 free software that could do the job. The meters in question broadcast
1189 encrypted messages with meter information via radio, and the hardest
1190 part was to track down the encryption keys from the vendor. With this
1191 in place I could set up a MQTT gateway to submit the meter data for
1194 <p
>The free software systems in question,
1195 <a href=
"https://tracker.debian.org/pkg/rtl-wmbus
">rtl-wmbus
</a
> to
1196 read the messages from a software defined radio, and
1197 <a href=
"https://tracker.debian.org/pkg/wmbusmeters
">wmbusmeters
</a
> to
1198 decrypt and decode the content of the messages, is working very well
1199 and allowe me to get frequent updates from my meters. I got in touch
1200 with upstream last year to see if there was any interest in publishing
1201 the packages via Debian. I was very happy to learn that Fredrik
1202 Öhrström volunteered to maintain the packages, and I have since
1203 assisted him in getting Debian package build rules in place as well as
1204 sponsoring the packages into the Debian archive. Sadly we completed
1205 it too late for them to become part of the next stable Debian release
1206 (Bookworm). The wmbusmeters package just cleared the NEW queue. It
1207 will need some work to fix a built problem, but I expect Fredrik will
1208 find a solution soon.
</p
>
1210 <p
>If you got a infrastructure meter supporting the Meter Bus
1211 standard, I strongly recommend having a look at these nice
1214 <p
>As usual, if you use Bitcoin and want to show your support of my
1215 activities, please send Bitcoin donations to my address
1216 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1221 <title>The
2023 LinuxCNC Norwegian developer gathering
</title>
1222 <link>http://www.hungry.com/~pere/blog/The_2023_LinuxCNC_Norwegian_developer_gathering.html
</link>
1223 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_2023_LinuxCNC_Norwegian_developer_gathering.html
</guid>
1224 <pubDate>Sun,
14 May
2023 20:
30:
00 +
0200</pubDate>
1225 <description><p
>The LinuxCNC project is making headway these days. A lot of
1226 patches and issues have seen activity on
1227 <a href=
"https://github.com/LinuxCNC/linuxcnc/
">the project github
1228 pages
</a
> recently. A few weeks ago there was a developer gathering
1229 over at the
<a href=
"https://tormach.com/
">Tormach
</a
> headquarter in
1230 Wisconsin, and now we are planning a new gathering in Norway. If you
1231 wonder what LinuxCNC is, lets quote Wikipedia:
</p
>
1234 "LinuxCNC is a software system for numerical control of
1235 machines such as milling machines, lathes, plasma cutters, routers,
1236 cutting machines, robots and hexapods. It can control up to
9 axes or
1237 joints of a CNC machine using G-code (RS-
274NGC) as input. It has
1238 several GUIs suited to specific kinds of usage (touch screen,
1239 interactive development).
"
1242 <p
>The Norwegian developer gathering take place the weekend June
16th
1243 to
18th this year, and is open for everyone interested in contributing
1244 to LinuxCNC. Up to date information about the gathering can be found
1246 <a href=
"https://sourceforge.net/p/emc/mailman/emc-developers/thread/sa64jp06nob.fsf%
40hjemme.reinholdtsen.name/#msg37837251
">the
1247 developer mailing list thread
</a
> where the gathering was announced.
1248 Thanks to the good people at
1249 <a href=
"https://www.debian.org/
">Debian
</a
>,
1250 <a href=
"https://www.redpill-linpro.com/
">Redpill-Linpro
</a
> and
1251 <a href=
"https://www.nuugfoundation.no/no/
">NUUG Foundation
</a
>, we
1252 have enough sponsor funds to pay for food, and shelter for the people
1253 traveling from afar to join us. If you would like to join the
1254 gathering, get in touch.
</p
>
1256 <p
>As usual, if you use Bitcoin and want to show your support of my
1257 activities, please send Bitcoin donations to my address
1258 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1263 <title>OpenSnitch in Debian ready for prime time
</title>
1264 <link>http://www.hungry.com/~pere/blog/OpenSnitch_in_Debian_ready_for_prime_time.html
</link>
1265 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/OpenSnitch_in_Debian_ready_for_prime_time.html
</guid>
1266 <pubDate>Sat,
13 May
2023 12:
10:
00 +
0200</pubDate>
1267 <description><p
>A bit delayed,
1268 <a href=
"https://tracker.debian.org/pkg/opensnitch
">the interactive
1269 application firewall OpenSnitch
</a
> package in Debian now got the
1270 latest fixes ready for Debian Bookworm. Because it depend on a
1271 package missing on some architectures, the autopkgtest check of the
1272 testing migration script did not understand that the tests were
1273 actually working, so the migration was delayed. A bug in the package
1274 dependencies is also fixed, so those installing the firewall package
1275 (opensnitch) now also get the GUI admin tool (python3-opensnitch-ui)
1276 installed by default. I am very grateful to Gustavo Iñiguez Goya for
1277 his work on getting the package ready for Debian Bookworm.
</p
>
1279 <p
>Armed with this package I have discovered some surprising
1280 connections from programs I believed were able to work completly
1281 offline, and it has already proven its worth, at least to me. If you
1282 too want to get more familiar with the kind of programs using
1283 Internett connections on your machine, I recommend testing
<tt
>apt
1284 install opensnitch
</tt
> in Bookworm and see what you think.
</p
>
1286 <p
>The package is still not able to build its eBPF module within
1287 Debian. Not sure how much work it would be to get it working, but
1288 suspect some kernel related packages need to be extended with more
1289 header files to get it working.
</p
>
1291 <p
>As usual, if you use Bitcoin and want to show your support of my
1292 activities, please send Bitcoin donations to my address
1293 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1298 <title>Speech to text, she APTly whispered, how hard can it be?
</title>
1299 <link>http://www.hungry.com/~pere/blog/Speech_to_text__she_APTly_whispered__how_hard_can_it_be_.html
</link>
1300 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Speech_to_text__she_APTly_whispered__how_hard_can_it_be_.html
</guid>
1301 <pubDate>Sun,
23 Apr
2023 09:
40:
00 +
0200</pubDate>
1302 <description><p
>While visiting a convention during Easter, it occurred to me that
1303 it would be great if I could have a digital Dictaphone with
1304 transcribing capabilities, providing me with texts to cut-n-paste into
1305 stuff I need to write. The background is that long drives often bring
1306 up the urge to write on texts I am working on, which of course is out
1307 of the question while driving. With the release of
1308 <a href=
"https://github.com/openai/whisper/
">OpenAI Whisper
</a
>, this
1309 seem to be within reach with Free Software, so I decided to give it a
1310 go. OpenAI Whisper is a Linux based neural network system to read in
1311 audio files and provide text representation of the speech in that
1312 audio recording. It handle multiple languages and according to its
1313 creators even can translate into a different language than the spoken
1314 one. I have not tested the latter feature. It can either use the CPU
1315 or a GPU with CUDA support. As far as I can tell, CUDA in practice
1316 limit that feature to NVidia graphics cards. I have few of those, as
1317 they do not work great with free software drivers, and have not tested
1318 the GPU option. While looking into the matter, I did discover some
1319 work to provide CUDA support on non-NVidia GPUs, and some work with
1320 the library used by Whisper to port it to other GPUs, but have not
1321 spent much time looking into GPU support yet. I
've so far used an old
1322 X220 laptop as my test machine, and only transcribed using its
1325 <p
>As it from a privacy standpoint is unthinkable to use computers
1326 under control of someone else (aka a
"cloud
" service) to transcribe
1327 ones thoughts and personal notes, I want to run the transcribing
1328 system locally on my own computers. The only sensible approach to me
1329 is to make the effort I put into this available for any Linux user and
1330 to upload the needed packages into Debian. Looking at Debian Bookworm, I
1331 discovered that only three packages were missing,
1332 <a href=
"https://bugs.debian.org/
1034307">tiktoken
</a
>,
1333 <a href=
"https://bugs.debian.org/
1034144">triton
</a
>, and
1334 <a href=
"https://bugs.debian.org/
1034091">openai-whisper
</a
>. For a while
1336 <a href=
"https://bugs.debian.org/
1034286">ffmpeg-python
</a
> was
1338 <a href=
"https://github.com/kkroening/ffmpeg-python/issues/
760">upstream
1339 seem to have vanished
</a
> I found it safer
1340 <a href=
"https://github.com/openai/whisper/pull/
1242">to rewrite
1341 whisper
</a
> to stop depending on in than to introduce ffmpeg-python
1342 into Debian. I decided to place these packages under the umbrella of
1343 <a href=
"https://salsa.debian.org/deeplearning-team
">the Debian Deep
1344 Learning Team
</a
>, which seem like the best team to look after such
1345 packages. Discussing the topic within the group also made me aware
1346 that the triton package was already a future dependency of newer
1347 versions of the torch package being planned, and would be needed after
1348 Bookworm is released.
</p
>
1350 <p
>All required code packages have been now waiting in
1351 <a href=
"https://ftp-master.debian.org/new.html
">the Debian NEW
1352 queue
</a
> since Wednesday, heading for Debian Experimental until
1353 Bookworm is released. An unsolved issue is how to handle the neural
1354 network models used by Whisper. The default behaviour of Whisper is
1355 to require Internet connectivity and download the model requested to
1356 <tt
>~/.cache/whisper/
</tt
> on first invocation. This obviously would
1357 fail
<a href=
"https://people.debian.org/~bap/dfsg-faq.html
">the
1358 deserted island test of free software
</a
> as the Debian packages would
1359 be unusable for someone stranded with only the Debian archive and solar
1360 powered computer on a deserted island.
</p
>
1362 <p
>Because of this, I would love to include the models in the Debian
1363 mirror system. This is problematic, as the models are very large
1364 files, which would put a heavy strain on the Debian mirror
1365 infrastructure around the globe. The strain would be even higher if
1366 the models change often, which luckily as far as I can tell they do
1367 not. The small model, which according to its creator is most useful
1368 for English and in my experience is not doing a great job there
1369 either, is
462 MiB (deb is
414 MiB). The medium model, which to me
1370 seem to handle English speech fairly well is
1.5 GiB (deb is
1.3 GiB)
1371 and the large model is
2.9 GiB (deb is
2.6 GiB). I would assume
1372 everyone with enough resources would prefer to use the large model for
1373 highest quality. I believe the models themselves would have to go
1374 into the non-free part of the Debian archive, as they are not really
1375 including any useful source code for updating the models. The
1376 "source
", aka the model training set, according to the creators
1377 consist of
"680,
000 hours of multilingual and multitask supervised
1378 data collected from the web
", which to me reads material with both
1379 unknown copyright terms, unavailable to the general public. In other
1380 words, the source is not available according to the Debian Free
1381 Software Guidelines and the model should be considered non-free.
</p
>
1383 <p
>I asked the Debian FTP masters for advice regarding uploading a
1384 model package on their IRC channel, and based on the feedback there it
1385 is still unclear to me if such package would be accepted into the
1386 archive. In any case I wrote build rules for a
1387 <a href=
"https://salsa.debian.org/deeplearning-team/openai-whisper-model
">OpenAI
1388 Whisper model package
</a
> and
1389 <a href=
"https://github.com/openai/whisper/pull/
1257">modified the
1390 Whisper code base
</a
> to prefer shared files under
<tt
>/usr/
</tt
> and
1391 <tt
>/var/
</tt
> over user specific files in
<tt
>~/.cache/whisper/
</tt
>
1392 to be able to use these model packages, to prepare for such
1393 possibility. One solution might be to include only one of the models
1394 (small or medium, I guess) in the Debian archive, and ask people to
1395 download the others from the Internet. Not quite sure what to do
1396 here, and advice is most welcome (use the debian-ai mailing list).
</p
>
1398 <p
>To make it easier to test the new packages while I wait for them to
1399 clear the NEW queue, I created an APT source targeting bookworm. I
1400 selected Bookworm instead of Bullseye, even though I know the latter
1401 would reach more users, is that some of the required dependencies are
1402 missing from Bullseye and I during this phase of testing did not want
1403 to backport a lot of packages just to get up and running.
</p
>
1405 <p
>Here is a recipe to run as user root if you want to test OpenAI
1406 Whisper using Debian packages on your Debian Bookworm installation,
1407 first adding the APT repository GPG key to the list of trusted keys,
1408 then setting up the APT repository and finally installing the packages
1409 and one of the models:
</p
>
1411 <p
><pre
>
1412 curl https://geekbay.nuug.no/~pere/openai-whisper/D78F5C4796F353D211B119E28200D9B589641240.asc \
1413 -o /etc/apt/trusted.gpg.d/pere-whisper.asc
1414 mkdir -p /etc/apt/sources.list.d
1415 cat
> /etc/apt/sources.list.d/pere-whisper.list
&lt;
&lt;EOF
1416 deb https://geekbay.nuug.no/~pere/openai-whisper/ bookworm main
1417 deb-src https://geekbay.nuug.no/~pere/openai-whisper/ bookworm main
1420 apt install openai-whisper
1421 </pre
></p
>
1423 <p
>The package work for me, but have not yet been tested on any other
1424 computer than my own. With it, I have been able to (badly) transcribe
1425 a
2 minute
40 second Norwegian audio clip to test using the small
1426 model. This took
11 minutes and around
2.2 GiB of RAM. Transcribing
1427 the same file with the medium model gave a accurate text in
77 minutes
1428 using around
5.2 GiB of RAM. My test machine had too little memory to
1429 test the large model, which I believe require
11 GiB of RAM. In
1430 short, this now work for me using Debian packages, and I hope it will
1431 for you and everyone else once the packages enter Debian.
</p
>
1433 <p
>Now I can start on the audio recording part of this project.
</p
>
1435 <p
>As usual, if you use Bitcoin and want to show your support of my
1436 activities, please send Bitcoin donations to my address
1437 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1442 <title>rtlsdr-scanner, software defined radio frequency scanner for Linux - nice free software
</title>
1443 <link>http://www.hungry.com/~pere/blog/rtlsdr_scanner__software_defined_radio_frequency_scanner_for_Linux____nice_free_software.html
</link>
1444 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/rtlsdr_scanner__software_defined_radio_frequency_scanner_for_Linux____nice_free_software.html
</guid>
1445 <pubDate>Fri,
7 Apr
2023 23:
10:
00 +
0200</pubDate>
1446 <description><p
>Today I finally found time to track down a useful radio frequency
1447 scanner for my software defined radio. Just for fun I tried to locate
1448 the radios used in the areas, and a good start would be to scan all
1449 the frequencies to see what is in use. I
've tried to find a useful
1450 program earlier, but ran out of time before I managed to find a useful
1451 tool. This time I was more successful, and after a few false leads I
1452 found a description of
1453 <a href=
"https://www.kali.org/tools/rtlsdr-scanner/
">rtlsdr-scanner
1454 over at the Kali site
</a
>, and was able to track down
1455 <a href=
"https://gitlab.com/kalilinux/packages/rtlsdr-scanner.git
">the
1456 Kali package git repository
</a
> to build a deb package for the
1457 scanner. Sadly the package is missing from the Debian project itself,
1458 at least in Debian Bullseye. Two runtime dependencies,
1459 <a href=
"https://gitlab.com/kalilinux/packages/python-visvis.git
">python-visvis
</a
>
1461 <a href=
"https://gitlab.com/kalilinux/packages/python-rtlsdr.git
">python-rtlsdr
</a
>
1462 had to be built and installed separately. Luckily
'<tt
>gbp
1463 buildpackage
</tt
>' handled them just fine and no further packages had
1464 to be manually built. The end result worked out of the box after
1465 installation.
</p
>
1467 <p
>My initial scans for FM channels worked just fine, so I knew the
1468 scanner was functioning. But when I tried to scan every frequency
1469 from
100 to
1000 MHz, the program stopped unexpectedly near the
1470 completion. After some debugging I discovered USB software radio I
1471 used rejected frequencies above
948 MHz, triggering a unreported
1472 exception breaking the scan. Changing the scan to end at
957 worked
1473 better. I similarly found the lower limit to be around
15, and ended
1474 up with the following full scan:
</p
>
1476 <p
><a href=
"http://www.hungry.com/~pere/blog/images/
2023-
04-
07-radio-freq-scanning.png
"><img src=
"http://www.hungry.com/~pere/blog/images/
2023-
04-
07-radio-freq-scanning.png
" width=
"100%
"></a
></p
>
1478 <p
>Saving the scan did not work, but exporting it as a CSV file worked
1479 just fine. I ended up with around
477k CVS lines with dB level for
1480 the given frequency.
</p
>
1482 <p
>The save failure seem to be a missing UTF-
8 encoding issue in the
1483 python code. Will see if I can find time to send a patch
1484 <a href=
"https://github.com/CdeMills/RTLSDR-Scanner/
">upstream
</a
>
1485 later to fix this exception:
</p
>
1488 Traceback (most recent call last):
1489 File
"/usr/lib/python3/dist-packages/rtlsdr_scanner/main_window.py
", line
485, in __on_save
1490 save_plot(fullName, self.scanInfo, self.spectrum, self.locations)
1491 File
"/usr/lib/python3/dist-packages/rtlsdr_scanner/file.py
", line
408, in save_plot
1492 handle.write(json.dumps(data, indent=
4))
1493 TypeError: a bytes-like object is required, not
'str
'
1494 Traceback (most recent call last):
1495 File
"/usr/lib/python3/dist-packages/rtlsdr_scanner/main_window.py
", line
485, in __on_save
1496 save_plot(fullName, self.scanInfo, self.spectrum, self.locations)
1497 File
"/usr/lib/python3/dist-packages/rtlsdr_scanner/file.py
", line
408, in save_plot
1498 handle.write(json.dumps(data, indent=
4))
1499 TypeError: a bytes-like object is required, not
'str
'
1502 <p
>As usual, if you use Bitcoin and want to show your support of my
1503 activities, please send Bitcoin donations to my address
1504 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1509 <title>OpenSnitch available in Debian Sid and Bookworm
</title>
1510 <link>http://www.hungry.com/~pere/blog/OpenSnitch_available_in_Debian_Sid_and_Bookworm.html
</link>
1511 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/OpenSnitch_available_in_Debian_Sid_and_Bookworm.html
</guid>
1512 <pubDate>Sat,
25 Feb
2023 20:
30:
00 +
0100</pubDate>
1513 <description><p
>Thanks to the efforts of the OpenSnitch lead developer Gustavo
1514 Iñiguez Goya allowing me to sponsor the upload,
1515 <a href=
"https://tracker.debian.org/pkg/opensnitch
">the interactive
1516 application firewall OpenSnitch
</a
> is now available in Debian
1517 Testing, soon to become the next stable release of Debian.
</p
>
1519 <p
>This is a package which set up a network firewall on one or more
1520 machines, which is controlled by a graphical user interface that will
1521 ask the user if a program should be allowed to connect to the local
1522 network or the Internet. If some background daemon is trying to dial
1523 home, it can be blocked from doing so with a simple mouse click, or by
1524 default simply by not doing anything when the GUI question dialog pop
1525 up. A list of all programs discovered using the network is provided
1526 in the GUI, giving the user an overview of how the machine(s) programs
1527 use the network.
</p
>
1529 <p
>OpenSnitch was uploaded for NEW processing about a month ago, and I
1530 had little hope of it getting accepted and shaping up in time for the
1531 package freeze, but the Debian ftpmasters proved to be amazingly quick
1532 at checking out the package and it was accepted into the archive about
1533 week after the first upload. It is now team maintained under the Go
1534 language team umbrella. A few fixes to the default setup is only in
1535 Sid, and should migrate to Testing/Bookworm in a week.
</p
>
1537 <p
>During testing I ran into an
1538 <a href=
"https://github.com/evilsocket/opensnitch/issues/
813">issue
1539 with Minecraft server broadcasts disappearing
</a
>, which was quickly
1540 resolved by the developer with a patch and a proposed configuration
1541 change. I
've been told this was caused by the Debian packages default
1542 use if /proc/ information to track down kernel status, instead of the
1543 newer eBPF module that can be used. The reason is simply that
1544 upstream and I have failed to find a way to build the eBPF modules for
1545 OpenSnitch without a complete configured Linux kernel source tree,
1546 which as far as we can tell is unavailable as a build dependency in
1547 Debian. We tried unsuccessfully so far to use the kernel-headers
1548 package. It would be great if someone could provide some clues how to
1549 build eBPF modules on build daemons in Debian, possibly without the full
1550 kernel source.
</p
>
1552 <p
>As usual, if you use Bitcoin and want to show your support of my
1553 activities, please send Bitcoin donations to my address
1554 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1559 <title>Is the desktop recommending your program for opening its files?
</title>
1560 <link>http://www.hungry.com/~pere/blog/Is_the_desktop_recommending_your_program_for_opening_its_files_.html
</link>
1561 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Is_the_desktop_recommending_your_program_for_opening_its_files_.html
</guid>
1562 <pubDate>Sun,
29 Jan
2023 11:
00:
00 +
0100</pubDate>
1563 <description><p
>Linux desktop systems
1564 <a href=
"https://specifications.freedesktop.org/basedir-spec/basedir-spec-latest.html
">have
1565 standardized
</a
> how programs present themselves to the desktop
1566 system. If a package include a .desktop file in
1567 /usr/share/applications/, Gnome, KDE, LXDE, Xfce and the other desktop
1568 environments will pick up the file and use its content to generate the
1569 menu of available programs in the system. A lesser known fact is that
1570 a package can also explain to the desktop system how to recognize the
1571 files created by the program in question, and use it to open these
1572 files on request, for example via a GUI file browser.
</p
>
1574 <p
>A while back I ran into a package that did not tell the desktop
1575 system how to recognize its files and was not used to open its files
1576 in the file browser and fixed it. In the process I wrote a simple
1577 debian/tests/ script to ensure the setup keep working. It might be
1578 useful for other packages too, to ensure any future version of the
1579 package keep handling its own files.
</p
>
1581 <p
>For this to work the file format need a useful MIME type that can
1582 be used to identify the format. If the file format do not yet have a
1583 MIME type, it should define one and preferably also
1584 <a href=
"https://www.iana.org/assignments/media-types/media-types.xhtml
">register
1585 it with IANA
</a
> to ensure the MIME type string is reserved.
</p
>
1587 <p
>The script uses the
<tt
>xdg-mime
</tt
> program from xdg-utils to
1588 query the database of standardized package information and ensure it
1589 return sensible values. It also need the location of an example file
1590 for xdg-mime to guess the format of.
</p
>
1595 # Author: Petter Reinholdtsen
1596 # License: GPL v2 or later at your choice.
1598 # Validate the MIME setup, making sure motor types have
1599 # application/vnd.openmotor+yaml associated with them and is connected
1600 # to the openmotor desktop file.
1604 mimetype=
"application/vnd.openmotor+yaml
"
1605 testfile=
"test/data/real/o3100/motor.ric
"
1606 mydesktopfile=
"openmotor.desktop
"
1608 filemime=
"$(xdg-mime query filetype
"$testfile
")
"
1610 if [
"$mimetype
" !=
"$filemime
" ] ; then
1612 echo
"error: xdg-mime claim motor file MIME type is $filemine, not $mimetype
"
1614 echo
"success: xdg-mime report correct mime type $mimetype for motor file
"
1617 desktop=$(xdg-mime query default
"$mimetype
")
1619 if [
"$mydesktopfile
" !=
"$desktop
" ]; then
1621 echo
"error: xdg-mime claim motor file should be handled by $desktop, not $mydesktopfile
"
1623 echo
"success: xdg-mime agree motor file should be handled by $mydesktopfile
"
1629 <p
>It is a simple way to ensure your users are not very surprised when
1630 they try to open one of your file formats in their file browser.
</p
>
1632 <p
>As usual, if you use Bitcoin and want to show your support of my
1633 activities, please send Bitcoin donations to my address
1634 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1639 <title>Opensnitch, the application level interactive firewall, heading into the Debian archive
</title>
1640 <link>http://www.hungry.com/~pere/blog/Opensnitch__the_application_level_interactive_firewall__heading_into_the_Debian_archive.html
</link>
1641 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Opensnitch__the_application_level_interactive_firewall__heading_into_the_Debian_archive.html
</guid>
1642 <pubDate>Sun,
22 Jan
2023 23:
55:
00 +
0100</pubDate>
1643 <description><p
>While reading a
1644 <a href=
"https://sneak.berlin/
20230115/macos-scans-your-local-files-now/
">blog
1645 post claiming MacOS X recently started scanning local files and
1646 reporting information about them to Apple
</a
>, even on a machine where
1647 all such callback features had been disabled, I came across a
1648 description of the Little Snitch application for MacOS X. It seemed
1649 like a very nice tool to have in the tool box, and I decided to see if
1650 something similar was available for Linux.
</p
>
1652 <p
>It did not take long to find
1653 <a href=
"https://github.com/evilsocket/opensnitch
">the OpenSnitch
1654 package
</a
>, which has been in development since
2017, and now is in
1655 version
1.5.0. It has had a
1656 <a href=
"https://bugs.debian.org/
909567">request for Debian
1657 packaging
</a
> since
2018, but no-one completed the job so far. Just
1658 for fun, I decided to see if I could help, and I was very happy to
1660 <a href=
"https://github.com/evilsocket/opensnitch/issues/
304">upstream
1661 want a Debian package too
</a
>.
</p
>
1663 <p
>After struggling a bit with getting the program to run, figuring
1664 out building Go programs (and a little failed detour to look at eBPF
1665 builds too - help needed), I am very happy to report that I am
1666 sponsoring upstream to maintain the package in Debian, and it has
1667 since this morning been waiting in NEW for the ftpmasters to have a
1668 look. Perhaps it can get into the archive in time for the Bookworm
1671 <p
>As usual, if you use Bitcoin and want to show your support of my
1672 activities, please send Bitcoin donations to my address
1673 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1678 <title>LinuxCNC MQTT publisher component
</title>
1679 <link>http://www.hungry.com/~pere/blog/LinuxCNC_MQTT_publisher_component.html
</link>
1680 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/LinuxCNC_MQTT_publisher_component.html
</guid>
1681 <pubDate>Sun,
8 Jan
2023 19:
30:
00 +
0100</pubDate>
1682 <description><p
>I watched
<a href=
"https://yewtu.be/watch?v=jmKUV3aNLjk
">a
2015
1683 video from Andreas Schiffler
</a
> the other day, where he set up
1684 <a href=
"https://linuxcnc.org/
">LinuxCNC
</a
> to send status
1685 information to the MQTT broker IBM Bluemix. As I also use MQTT for
1686 graphing, it occured to me that a generic MQTT LinuxCNC component
1687 would be useful and I set out to implement it. Today I got the first
1688 draft limping along and submitted as
1689 <a href=
"https://github.com/LinuxCNC/linuxcnc/pull/
2253">a patch to the
1690 LinuxCNC project
</a
>.
</p
>
1692 <p
>The simple part was setting up the MQTT publishing code in Python.
1693 I already have set up other parts submitting data to my Mosquito MQTT
1694 broker, so I could reuse that code. Writing a LinuxCNC component in
1695 Python as new to me, but using existing examples in the code
1696 repository and the extensive documentation, this was fairly straight
1697 forward. The hardest part was creating a automated test for the
1698 component to ensure it was working. Testing it in a simulated
1699 LinuxCNC machine proved very useful, as I discovered features I needed
1700 that I had not thought of yet, and adjusted the code quite a bit to
1701 make it easier to test without a operational MQTT broker
1702 available.
</p
>
1704 <p
>The draft is ready and working, but I am unsure which LinuxCNC HAL
1705 pins I should collect and publish by default (in other words, the
1706 default set of information pieces published), and how to get the
1707 machine name from the LinuxCNC INI file. The latter is a minor
1708 detail, but I expect it would be useful in a setup with several
1709 machines available. I am hoping for feedback from the experienced
1710 LinuxCNC developers and users, to make the component even better
1711 before it can go into the mainland LinuxCNC code base.
</p
>
1713 <p
>Since I started on the MQTT component, I came across
1714 <a href=
"https://yewtu.be/watch?v=Bqa2grG0XtA
">another video from Kent
1715 VanderVelden
</a
> where he combine LinuxCNC with a set of screen glasses
1716 controlled by a Raspberry Pi, and it occured to me that it would
1717 be useful for such use cases if LinuxCNC also provided a REST API for
1718 querying its status. I hope to start on such component once the MQTT
1719 component is working well.
</p
>
1721 <p
>As usual, if you use Bitcoin and want to show your support of my
1722 activities, please send Bitcoin donations to my address
1723 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1728 <title>ONVIF IP camera management tool finally in Debian
</title>
1729 <link>http://www.hungry.com/~pere/blog/ONVIF_IP_camera_management_tool_finally_in_Debian.html
</link>
1730 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/ONVIF_IP_camera_management_tool_finally_in_Debian.html
</guid>
1731 <pubDate>Sat,
24 Dec
2022 08:
00:
00 +
0100</pubDate>
1732 <description><p
>Merry Christmas to you all. Here is a small gift to all those with
1733 IP cameras following the
<a href=
"https://www.onvif.org/
">ONVIF
1734 specification
</a
>. There is finally a nice command line and GUI tool
1735 in Debian to manage ONVIF IP cameras. After working with upstream for
1736 a few months and sponsoring the upload, I am very happy to report that
1737 the
<a href=
"https://tracker.debian.org/libonvif
">libonvif package
</a
>
1738 entered Debian Sid last night.
</p
>
1740 <p
>The package provide a C library to communicate with such cameras, a
1741 command line tool to locate and update settings of (like password) the
1742 cameras and a GUI tool to configure and control the units as well as
1743 preview the video from the camera. Libonvif is available on Both
1744 Linux and Windows and the GUI tool uses the Qt library. The main
1745 competitors are non-free software, while libonvif is GNU GPL licensed.
1746 I am very glad Debian users in the future can control their cameras
1747 using a free software system provided by Debian. But the ONVIF world
1748 is full of slightly broken firmware, where the cameras pretend to
1749 follow the ONVIF specification but fail to set some configuration
1750 values or refuse to provide video to more than one recipient at the
1751 time, and the onvif project is quite young and might take a while
1752 before it completely work with your camera. Upstream seem eager to
1753 improve the library, so handling any broken camera might be just
<a
1754 href=
"https://github.com/sr99622/libonvif/
">a bug report away
</a
>.
</p
>
1756 <p
>The package just cleared NEW, and need a new source only upload
1757 before it can enter testing. This will happen in the next few
1760 <p
>As usual, if you use Bitcoin and want to show your support of my
1761 activities, please send Bitcoin donations to my address
1762 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1767 <title>Managing and using ONVIF IP cameras with Linux
</title>
1768 <link>http://www.hungry.com/~pere/blog/Managing_and_using_ONVIF_IP_cameras_with_Linux.html
</link>
1769 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Managing_and_using_ONVIF_IP_cameras_with_Linux.html
</guid>
1770 <pubDate>Wed,
19 Oct
2022 12:
30:
00 +
0200</pubDate>
1771 <description><p
>Recently I have been looking at how to control and collect data
1772 from a handful IP cameras using Linux. I both wanted to change their
1773 settings and to make their imagery available via a free software
1774 service under my control. Here is a summary of the tools I found.
</p
>
1776 <p
>First I had to identify the cameras and their protocols. As far as
1777 I could tell, they were using some SOAP looking protocol and their
1778 internal web server seem to only work with Microsoft Internet Explorer
1779 with some proprietary binary plugin, which in these days of course is
1780 a security disaster and also made it impossible for me to use the
1781 camera web interface. Luckily I discovered that the SOAP looking
1782 protocol is actually following
<a href=
"https://www.onvif.org/
">the
1783 ONVIF specification
</a
>, which seem to be supported by a lot of IP
1784 cameras these days.
</p
>
1786 <p
>Once the protocol was identified, I was able to find what appear to
1787 be the most popular way to configure ONVIF cameras, the free software
1789 <a href=
"https://sourceforge.net/projects/onvifdm/
">ONVIF Device
1790 Manager
</a
>. Lacking any other options at the time, I tried
1791 unsuccessfully to get it running using Wine, but was missing a dotnet
1792 40 library and I found no way around it to run it on Linux.
</p
>
1794 <p
>The next tool I found to configure the cameras were a non-free Linux Qt
1795 client
<a href=
"https://www.lingodigit.com/onvif_nvcdemo.html
">ONVIF
1796 Device Tool
</a
>. I did not like its terms of use, so did not spend
1797 much time on it.
</p
>
1799 <p
>To collect the video and make it available in a web interface, I
1800 found the Zoneminder tool in Debian. A recent version was able to
1801 automatically detect and configure ONVIF devices, so I could use it to
1802 set up motion detection in and collection of the camera output. I had
1803 initial problems getting the ONVIF autodetection to work, as both
1804 Firefox and Chromium
<a href=
"https://bugs.debian.org/
1001188">refused
1805 the inter-tab communication
</a
> being used by the Zoneminder web
1806 pages, but managed to get konqueror to work. Apparently the
"Enhanced
1807 Tracking Protection
" in Firefox cause the problem. I ended up
1808 upgrading to the Bookworm edition of Zoneminder in the process to try
1809 to fix the issue, and believe the problem might be solved now.
</p
>
1811 <p
>In the process I came across the nice Linux GUI tool
1812 <a href=
"https://gitlab.com/caspermeijn/onvifviewer/
">ONVIF Viewer
</a
>
1813 allowing me to preview the camera output and validate the login
1814 passwords required. Sadly its author has grown tired of maintaining
1815 the software, so it might not see any future updates. Which is sad,
1816 as the viewer is sightly unstable and the picture tend to lock up.
1817 Note, this lockup might be due to limitations in the cameras and not
1818 the viewer implementation. I suspect the camera is only able to
1819 provide pictures to one client at the time, and the Zoneminder feed
1820 might interfere with the GUI viewer. I have
1821 <a href=
"https://bugs.debian.org/
1000820">asked for the tool to be
1822 included in Debian
</a
>.
</p
>
1824 <p
>Finally, I found what appear to be very nice Linux free software
1825 replacement for the Windows tool, named
1826 <a href=
"https://github.com/sr99622/libonvif/
">libonvif
</a
>. It
1827 provide a C library to talk to ONVIF devices as well as a command line
1828 and GUI tool using the library. Using the GUI tool I was able to change
1829 the admin passwords and update other settings of the cameras. I have
1830 <a href=
"https://bugs.debian.org/
1021980">asked for the package to be
1831 included in Debian
</a
>.
</p
>
1833 <p
>As usual, if you use Bitcoin and want to show your support of my
1834 activities, please send Bitcoin donations to my address
1835 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1837 <p
><strong
>Update
2022-
10-
20</strong
>: Since my initial publication of
1838 this text, I got several suggestions for more free software Linux
1839 tools. There is
<a href=
"https://github.com/quatanium/python-onvif
">a
1840 ONVIF python library
</a
> (already
1841 <a href=
"https://bugs.debian.org/
824240">requested into Debian
</a
>) and
1842 <a href=
"https://github.com/FalkTannhaeuser/python-onvif-zeep
">a python
3
1843 fork
</a
> using a different SOAP dependency. There is also
1844 <a href=
"https://www.home-assistant.io/integrations/onvif/
">support for
1845 ONVIF in Home Assistant
</a
>, and there is an alternative to Zoneminder
1846 called
<a href=
"https://www.shinobi.video/
">Shinobi
</a
>. The latter
1847 two are not included in Debian either. I have not tested any of these
1853 <title>Time to translate the Bullseye edition of the Debian Administrator
's Handbook
</title>
1854 <link>http://www.hungry.com/~pere/blog/Time_to_translate_the_Bullseye_edition_of_the_Debian_Administrator_s_Handbook.html
</link>
1855 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Time_to_translate_the_Bullseye_edition_of_the_Debian_Administrator_s_Handbook.html
</guid>
1856 <pubDate>Mon,
12 Sep
2022 15:
45:
00 +
0200</pubDate>
1857 <description><p align=
"center
"><img align=
"center
" src=
"http://www.hungry.com/~pere/blog/images/
2020-
10-
20-debian-handbook-nb-testprint.jpeg
" width=
"60%
"/
></p
>
1859 <p
>(The picture is of the previous edition.)
</p
>
1861 <p
>Almost two years after the previous Norwegian Bokmål translation of
1862 the
"<a href=
"https://debian-handbook.info/
">The Debian Administrator
's
1863 Handbook
</a
>" was published, a new edition is finally being prepared. The
1864 english text is updated, and it is time to start working on the
1865 translations. Around
37 percent of the strings have been updated, one
1866 way or another, and the translations starting from a complete Debian Buster
1867 edition now need to bring their translation up from
63% to
100%. The
1868 complete book is licensed using a Creative Commons license, and has
1869 been published in several languages over the years. The translations
1870 are done by volunteers to bring Linux in their native tongue. The
1871 last time I checked, it complete text was available in English,
1872 Norwegian Bokmål, German, Indonesian, Brazil Portuguese and Spanish.
1873 In addition, work has been started for Arabic (Morocco), Catalan,
1874 Chinese (Simplified), Chinese (Traditional), Croatian, Czech, Danish,
1875 Dutch, French, Greek, Italian, Japanese, Korean, Persian, Polish,
1876 Romanian, Russian, Swedish, Turkish and Vietnamese.
</p
>
1878 <p
>The translation is conducted on
1879 <a href=
"https://hosted.weblate.org/projects/debian-handbook/
">the
1880 hosted weblate project page
</a
>. Prospective translators are
1881 recommeded to subscribe to
1882 <a href=
"http://lists.alioth.debian.org/mailman/listinfo/debian-handbook-translators
">the
1883 translators mailing list
</a
> and should also check out
1884 <a href=
"https://debian-handbook.info/contribute/
">the instructions for
1885 contributors
</a
>.
</p
>
1887 <p
>I am one of the Norwegian Bokmål translators of this book, and we
1888 have just started. Your contribution is most welcome.
</p
>
1890 <p
>As usual, if you use Bitcoin and want to show your support of my
1891 activities, please send Bitcoin donations to my address
1892 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
1897 <title>Automatic LinuxCNC servo PID tuning?
</title>
1898 <link>http://www.hungry.com/~pere/blog/Automatic_LinuxCNC_servo_PID_tuning_.html
</link>
1899 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Automatic_LinuxCNC_servo_PID_tuning_.html
</guid>
1900 <pubDate>Sat,
16 Jul
2022 22:
30:
00 +
0200</pubDate>
1901 <description><p
>While working on a CNC with servo motors controlled by the
1902 <a href=
"https://en.wikipedia.org/wiki/LinuxCNC
">LinuxCNC
</a
>
1903 <a href=
"https://en.wikipedia.org/wiki/PID_controller
">PID
1904 controller
</a
>, I recently had to learn how to tune the collection of values
1905 that control such mathematical machinery that a PID controller is. It
1906 proved to be a lot harder than I hoped, and I still have not succeeded
1907 in getting the Z PID controller to successfully defy gravity, nor X
1908 and Y to move accurately and reliably. But while climbing up this
1909 rather steep learning curve, I discovered that some motor control
1910 systems are able to tune their PID controllers. I got the impression
1911 from the documentation that LinuxCNC were not. This proved to be not
1914 <p
>The LinuxCNC
1915 <a href=
"http://linuxcnc.org/docs/html/man/man9/pid
.9.html
">pid
1916 component
</a
> is the recommended PID controller to use. It uses eight
1917 constants
<tt
>Pgain
</tt
>,
<tt
>Igain
</tt
>,
<tt
>Dgain
</tt
>,
1918 <tt
>bias
</tt
>,
<tt
>FF0
</tt
>,
<tt
>FF1
</tt
>,
<tt
>FF2
</tt
> and
1919 <tt
>FF3
</tt
> to calculate the output value based on current and wanted
1920 state, and all of these need to have a sensible value for the
1921 controller to behave properly. Note, there are even more values
1922 involved, theser are just the most important ones. In my case I need
1923 the X, Y and Z axes to follow the requested path with little error.
1924 This has proved quite a challenge for someone who have never tuned a
1925 PID controller before, but there is at least some help to be found.
1927 <p
>I discovered that included in LinuxCNC was this old PID component
1928 at_pid claiming to have auto tuning capabilities. Sadly it had been
1929 neglected since
2011, and could not be used as a plug in replacement
1930 for the default pid component. One would have to rewriting the
1931 LinuxCNC HAL setup to test at_pid. This was rather sad, when I wanted
1932 to quickly test auto tuning to see if it did a better job than me at
1933 figuring out good P, I and D values to use.
</p
>
1935 <p
>I decided to have a look if the situation could be improved. This
1936 involved trying to understand the code and history of the pid and
1937 at_pid components. Apparently they had a common ancestor, as code
1938 structure, comments and variable names were quite close to each other.
1939 Sadly this was not reflected in the git history, making it hard to
1940 figure out what really happened. My guess is that the author of
1941 <a href=
"https://github.com/LinuxCNC/linuxcnc/blob/master/src/hal/components/at_pid.c
">at_pid.c
</a
>
1943 <a href=
"https://github.com/LinuxCNC/linuxcnc/blob/master/src/hal/components/pid.c
">pid.c
</a
>,
1944 rewrote it to follow the structure he wished pid.c to have, then added
1945 support for auto tuning and finally got it included into the LinuxCNC
1946 repository. The restructuring and lack of early history made it
1947 harder to figure out which part of the code were relevant to the auto
1948 tuning, and which part of the code needed to be updated to work the
1949 same way as the current pid.c implementation. I started by trying to
1950 isolate relevant changes in pid.c, and applying them to at_pid.c. My
1951 aim was to make sure the at_pid component could replace the pid
1952 component with a simple change in the HAL setup loadrt line, without
1953 having to
"rewire
" the rest of the HAL configuration. After a few
1954 hours following this approach, I had learned quite a lot about the
1955 code structure of both components, while concluding I was heading down
1956 the wrong rabbit hole, and should get back to the surface and find a
1957 different path.
</p
>
1959 <p
>For the second attempt, I decided to throw away all the PID control
1960 related part of the original at_pid.c, and instead isolate and lift
1961 the auto tuning part of the code and inject it into a copy of pid.c.
1962 This ensured compatibility with the current pid component, while
1963 adding auto tuning as a run time option. To make it easier to identify
1964 the relevant parts in the future, I wrapped all the auto tuning code
1965 with
'#ifdef AUTO_TUNER
'. The end result behave just like the current
1966 pid component by default, as that part of the code is identical. The
1967 <a href=
"https://github.com/LinuxCNC/linuxcnc/pull/
1820">end result
1968 entered the LinuxCNC master branch
</a
> a few days ago.
</p
>
1970 <p
>To enable auto tuning, one need to set a few HAL pins in the PID
1971 component. The most important ones are
<tt
>tune-effort
</tt
>,
1972 <tt
>tune-mode
</tt
> and
<tt
>tune-start
</tt
>. But lets take a step
1973 back, and see what the auto tuning code will do. I do not know the
1974 mathematical foundation of the at_pid algorithm, but from observation
1975 I can tell that the algorithm will, when enabled, produce a square
1976 wave pattern centered around the
<tt
>bias
</tt
> value on the output pin
1977 of the PID controller. This can be seen using the HAL Scope provided
1978 by LinuxCNC. In my case, this is translated into voltage (+-
10V) sent
1979 to the motor controller, which in turn is translated into motor speed.
1980 So at_pid will ask the motor to move the axis back and forth. The
1981 number of cycles in the pattern is controlled by the
1982 <tt
>tune-cycles
</tt
> pin, and the extremes of the wave pattern is
1983 controlled by the
<tt
>tune-effort
</tt
> pin. Of course, trying to
1984 change the direction of a physical object instantly (as in going
1985 directly from a positive voltage to the equivalent negative voltage)
1986 do not change velocity instantly, and it take some time for the object
1987 to slow down and move in the opposite direction. This result in a
1988 more smooth movement wave form, as the axis in question were vibrating
1989 back and forth. When the axis reached the target speed in the
1990 opposing direction, the auto tuner change direction again. After
1991 several of these changes, the average time delay between the
'peaks
'
1992 and
'valleys
' of this movement graph is then used to calculate
1993 proposed values for Pgain, Igain and Dgain, and insert them into the
1994 HAL model to use by the pid controller. The auto tuned settings are
1995 not great, but htye work a lot better than the values I had been able
1996 to cook up on my own, at least for the horizontal X and Y axis. But I
1997 had to use very small
<tt
>tune-effort
<tt
> values, as my motor
1998 controllers error out if the voltage change too quickly. I
've been
1999 less lucky with the Z axis, which is moving a heavy object up and
2000 down, and seem to confuse the algorithm. The Z axis movement became a
2001 lot better when I introduced a
<tt
>bias
</tt
> value to counter the
2002 gravitational drag, but I will have to work a lot more on the Z axis
2003 PID values.
</p
>
2005 <p
>Armed with this knowledge, it is time to look at how to do the
2006 tuning. Lets say the HAL configuration in question load the PID
2007 component for X, Y and Z like this:
</p
>
2009 <blockquote
><pre
>
2010 loadrt pid names=pid.x,pid.y,pid.z
2011 </pre
></blockquote
>
2013 <p
>Armed with the new and improved at_pid component, the new line will
2014 look like this:
</p
>
2016 <blockquote
><pre
>
2017 loadrt at_pid names=pid.x,pid.y,pid.z
2018 </pre
></blockquote
>
2020 <p
>The rest of the HAL setup can stay the same. This work because the
2021 components are referenced by name. If the component had used count=
3
2022 instead, all use of pid.# had to be changed to at_pid.#.
</p
>
2024 <p
>To start tuning the X axis, move the axis to the middle of its
2025 range, to make sure it do not hit anything when it start moving back
2026 and forth. Next, set the
<tt
>tune-effort
</tt
> to a low number in the
2027 output range. I used
0.1 as my initial value. Next, assign
1 to the
2028 <tt
>tune-mode
</tt
> value. Note, this will disable the pid controlling
2029 part and feed
0 to the output pin, which in my case initially caused a
2030 lot of drift. In my case it proved to be a good idea with X and Y to
2031 tune the motor driver to make sure
0 voltage stopped the motor
2032 rotation. On the other hand, for the Z axis this proved to be a bad
2033 idea, so it will depend on your setup. It might help to set the
2034 <tt
>bias
</tt
> value to a output value that reduce or eliminate the
2035 axis drift. Finally, after setting
<tt
>tune-mode
</tt
>, set
2036 <tt
>tune-start
</tt
> to
1 to activate the auto tuning. If all go well,
2037 your axis will vibrate for a few seconds and when it is done, new
2038 values for Pgain, Igain and Dgain will be active. To test them,
2039 change
<tt
>tune-mode
</tt
> back to
0. Note that this might cause the
2040 machine to suddenly jerk as it bring the axis back to its commanded
2041 position, which it might have drifted away from during tuning. To
2042 summarize with some halcmd lines:
</p
>
2044 <blockquote
><pre
>
2045 setp pid.x.tune-effort
0.1
2046 setp pid.x.tune-mode
1
2047 setp pid.x.tune-start
1
2048 # wait for the tuning to complete
2049 setp pid.x.tune-mode
0
2050 </pre
></blockquote
>
2052 <p
>After doing this task quite a few times while trying to figure out
2053 how to properly tune the PID controllers on the machine in, I decided
2054 to figure out if this process could be automated, and wrote a script
2055 to do the entire tuning process from power on. The end result will
2056 ensure the machine is powered on and ready to run, home all axis if it
2057 is not already done, check that the extra tuning pins are available,
2058 move the axis to its mid point, run the auto tuning and re-enable the
2059 pid controller when it is done. It can be run several times. Check
2061 <a href=
"https://github.com/SebKuzminsky/MazakVQC1540/blob/bon-dev/scripts/run-auto-pid-tuner
">run-auto-pid-tuner
</a
>
2062 script on github if you want to learn how it is done.
</p
>
2064 <p
>My hope is that this little adventure can inspire someone who know
2065 more about motor PID controller tuning can implement even better
2066 algorithms for automatic PID tuning in LinuxCNC, making life easier
2067 for both me and all the others that want to use LinuxCNC but lack the
2068 in depth knowledge needed to tune PID controllers well.
</p
>
2070 <p
>As usual, if you use Bitcoin and want to show your support of my
2071 activities, please send Bitcoin donations to my address
2072 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2077 <title>LinuxCNC translators life just got a bit easier
</title>
2078 <link>http://www.hungry.com/~pere/blog/LinuxCNC_translators_life_just_got_a_bit_easier.html
</link>
2079 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/LinuxCNC_translators_life_just_got_a_bit_easier.html
</guid>
2080 <pubDate>Fri,
3 Jun
2022 21:
10:
00 +
0200</pubDate>
2081 <description><p
>Back in oktober last year, when I started looking at the
2082 <a href=
"https://en.wikipedia.org/wiki/LinuxCNC
">LinuxCNC
</a
> system, I
2083 proposed to change the documentation build system make life easier for
2084 translators. The original system consisted of independently written
2085 documentation files for each language, with no automated way to track
2086 changes done in other translations and no help for the translators to
2087 know how much was left to translated. By using
2088 <a href=
"https://po4a.org/
">the po4a system
</a
> to generate POT and PO
2089 files from the English documentation, this can be improved. A small
2090 team of LinuxCNC contributors got together and today our labour
2091 finally payed off. Since a few hours ago, it is now possible to
2092 translate
<a href=
"https://hosted.weblate.org/projects/linuxcnc/
">the
2093 LinuxCNC documentation on Weblate
</a
>, alongside the program itself.
</p
>
2095 <p
>The effort to migrate the documentation to use po4a has been both
2096 slow and frustrating. I am very happy we finally made it.
</p
>
2098 <p
>As usual, if you use Bitcoin and want to show your support of my
2099 activities, please send Bitcoin donations to my address
2100 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2105 <title>geteltorito make CD firmware upgrades a breeze
</title>
2106 <link>http://www.hungry.com/~pere/blog/geteltorito_make_CD_firmware_upgrades_a_breeze.html
</link>
2107 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/geteltorito_make_CD_firmware_upgrades_a_breeze.html
</guid>
2108 <pubDate>Wed,
20 Apr
2022 11:
50:
00 +
0200</pubDate>
2109 <description><p
>Recently I wanted to upgrade the firmware of my thinkpad, and
2110 located the firmware download page from Lenovo (which annoyingly do
2111 not allow access via Tor, forcing me to hand them more personal
2112 information that I would like). The
2113 <a href=
"https://support.lenovo.com/no/en/search?query=thinkpad firmware bios upgrade iso
&SearchType=Customer search
&searchLocation=Masthead
">download
2114 from Lenovo
</a
> is a bootable ISO image, which is a bit of a problem
2115 when all I got available is a USB memory stick. I tried booting the
2116 ISO as a USB stick, but this did not work. But genisoimage came to
2117 the rescue.
</p
>
2119 <P
>The geteltorito program in
2120 <a href=
"http://tracker.debian.org/cdrkit
">the genisoimage binary
2121 package
</a
> is able to convert the bootable ISO image to a bootable
2122 USB stick using a simple command line recipe, which I then can write
2123 to the most recently inserted USB stick:
</p
>
2125 <blockquote
><pre
>
2126 geteltorito -o usbstick.img lenovo-firmware.iso
2127 sudo dd bs=
10M if=usbstick.img of=$(ls -tr /dev/sd?|tail -
1)
2128 </pre
></blockquote
>
2130 <p
>This USB stick booted the firmware upgrader just fine, and in a few
2131 minutes my machine had the latest and greatest BIOS firmware in place.
</p
>
2136 <title>Run your industrial metal working machine using Debian?
</title>
2137 <link>http://www.hungry.com/~pere/blog/Run_your_industrial_metal_working_machine_using_Debian_.html
</link>
2138 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Run_your_industrial_metal_working_machine_using_Debian_.html
</guid>
2139 <pubDate>Wed,
2 Mar
2022 18:
40:
00 +
0100</pubDate>
2140 <description><p
>After many months of hard work by the good people involved in
2141 <a href=
"https://en.wikipedia.org/wiki/LinuxCNC
">LinuxCNC
</a
>, the
2142 system was accepted Sunday
2143 <a href=
"https://tracker.debian.org/pkg/linuxcnc
">into Debian
</a
>.
2144 Once it was available from Debian, I was surprised to discover from
2145 <a href=
"https://qa.debian.org/popcon.php?package=linuxcnc
">its
2146 popularity-contest numbers
</a
> that people have been reporting its use
2147 since
2012.
<a href=
"http://linuxcnc.org/
">Its project site
</a
> might
2148 be a good place to check out, but sadly is not working when visiting
2151 <p
>But what is LinuxCNC, you are probably wondering? Perhaps a
2152 Wikipedia quote is in place?
</p
>
2155 "LinuxCNC is a software system for numerical control of
2156 machines such as milling machines, lathes, plasma cutters, routers,
2157 cutting machines, robots and hexapods. It can control up to
9 axes or
2158 joints of a CNC machine using G-code (RS-
274NGC) as input. It has
2159 several GUIs suited to specific kinds of usage (touch screen,
2160 interactive development).
"
2163 <p
>It can even control
3D printers. And even though the Wikipedia
2164 page indicate that it can only work with hard real time kernel
2165 features, it can also work with the user space soft real time features
2166 provided by the Debian kernel.
2167 <a href=
"https://github.com/linuxcnc/linuxcnc
">The source code
</a
> is
2168 available from Github. The last few months I
've been involved in the
2169 translation setup for the program and documentation. Translators are
2171 <a href=
"https://hosted.weblate.org/engage/linuxcnc/
">join the
2172 effort
</a
> using Weblate.
</p
>
2174 <p
>As usual, if you use Bitcoin and want to show your support of my
2175 activities, please send Bitcoin donations to my address
2176 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2181 <title>Debian still an excellent choice for Lego builders
</title>
2182 <link>http://www.hungry.com/~pere/blog/Debian_still_an_excellent_choice_for_Lego_builders.html
</link>
2183 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_still_an_excellent_choice_for_Lego_builders.html
</guid>
2184 <pubDate>Sun,
24 Oct
2021 07:
10:
00 +
0200</pubDate>
2185 <description><p
>The Debian Lego team saw a lot of activity the last few weeks. All
2186 the packages under the team umbrella has been updated to fix
2187 packaging, lintian issues and BTS reports. In addition, a new and
2188 inspiring team member appeared on both the
2189 <a href=
"https://alioth-lists.debian.net/cgi-bin/mailman/listinfo/debian-lego-team
">debian-lego-team
2190 Team mailing list
</a
> and
2191 <a href=
"irc://irc.debian.org/%
23debian-lego
">IRC channel
2192 #debian-lego
</a
>. If you are interested in Lego CAD design and LEGO
2193 Mindstorms programming, check out the
2194 <a href=
"http://wiki.debian.org/LegoDesigners
">team wiki page
</a
> to
2195 see what Debian can offer the Lego enthusiast.
</p
>
2197 <p
>Patches has been sent upstream, causing new upstream releases, one
2198 even the first one in more than ten years, and old upstreams was
2199 released with new ones. There are still a lot of work left, and the
2200 team welcome more members to help us make sure Debian is the Linux
2201 distribution of choice for Lego builders. If you want to contribute,
2202 join us in the IRC channel and become part of
2203 <a href=
"https://salsa.debian.org/debian-lego-team/
">the team on
2204 Salsa
</a
>.
</p
>
2206 <p
>As usual, if you use Bitcoin and want to show your support of my
2207 activities, please send Bitcoin donations to my address
2208 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2213 <title>Six complete translations of The Debian Administrator
's Handbook for Buster
</title>
2214 <link>http://www.hungry.com/~pere/blog/Six_complete_translations_of_The_Debian_Administrator_s_Handbook_for_Buster.html
</link>
2215 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Six_complete_translations_of_The_Debian_Administrator_s_Handbook_for_Buster.html
</guid>
2216 <pubDate>Mon,
5 Jul
2021 19:
20:
00 +
0200</pubDate>
2217 <description><p
>I am happy observe that the
<a href=
"https://debian-handbook.info/
">The
2218 Debian Administrator
's Handbook
</a
> is available in six languages now.
2219 I am not sure which one of these are completely proof read, but the
2220 complete book is available in these languages:
2224 <li
>English
</li
>
2225 <li
>Norwegian Bokmål
</li
>
2226 <li
>German
</li
>
2227 <li
>Indonesian
</li
>
2228 <li
>Brazil Portuguese
</li
>
2229 <li
>Spanish
</li
>
2233 <p
>This is the list of languages more than
70% complete, in other
2234 words with not too much left to do:
</p
>
2238 <li
>Chinese (Simplified) -
90%
</li
>
2239 <li
>French -
79%
</li
>
2240 <li
>Italian -
79%
</li
>
2241 <li
>Japanese -
77%
</li
>
2242 <li
>Arabic (Morocco) -
75%
</li
>
2243 <li
>Persian -
71%
</li
>
2247 <p
>I wonder how long it will take to bring these to
100%.
</p
>
2249 <p
>Then there is the list of languages about halfway done:
</p
>
2253 <li
>Russian -
63%
</li
>
2254 <li
>Swedish -
53%
</li
>
2255 <li
>Chinese (Traditional) -
46%
</li
>
2256 <li
>Catalan -
45%
</li
>
2260 <p
>Several are on to a good start:
</p
>
2264 <li
>Dutch -
26%
</li
>
2265 <li
>Vietnamese -
25%
</li
>
2266 <li
>Polish -
23%
</li
>
2267 <li
>Czech -
22%
</li
>
2268 <li
>Turkish -
18%
</li
>
2272 <p
>Finally, there are the ones just getting started:
</p
>
2276 <li
>Korean -
4%
</li
>
2277 <li
>Croatian -
2%
</li
>
2278 <li
>Greek -
2%
</li
>
2279 <li
>Danish -
1%
</li
>
2280 <li
>Romanian -
1%
</li
>
2284 <p
>If you want to help provide a Debian instruction book in your own
2286 <a href=
"https://hosted.weblate.org/projects/debian-handbook/#languages
">Weblate
</a
>
2287 to contribute to the translations.
</p
>
2289 <p
>As usual, if you use Bitcoin and want to show your support of my
2290 activities, please send Bitcoin donations to my address
2291 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2296 <title>Latest Jami back in Debian Testing, and scriptable using dbus
</title>
2297 <link>http://www.hungry.com/~pere/blog/Latest_Jami_back_in_Debian_Testing__and_scriptable_using_dbus.html
</link>
2298 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Latest_Jami_back_in_Debian_Testing__and_scriptable_using_dbus.html
</guid>
2299 <pubDate>Tue,
12 Jan
2021 17:
00:
00 +
0100</pubDate>
2300 <description><p
>After a lot of hard work by its maintainer Alexandre Viau and
2301 others, the decentralized communication platform
2302 <a href=
"https://en.wikipedia.org/wiki/Jami_(software)
">Jami
</a
>
2303 (earlier known as Ring), managed to get
2304 <a href=
"https://tracker.debian.org/pkg/ring
">its latest version
</a
>
2305 into Debian Testing. Several of its dependencies has caused build and
2306 propagation problems, which all seem to be solved now.
</p
>
2308 <p
>In addition to the fact that Jami is decentralized, similar to how
2309 bittorrent is decentralized, I first of all like how it is not
2310 connected to external IDs like phone numbers. This allow me to set up
2311 computers to send me notifications using Jami without having to find
2312 get a phone number for each computer. Automatic notification via Jami
2313 is also made trivial thanks to the provided client side API (as a DBus
2314 service). Here is my bourne shell script demonstrating how to let any
2315 system send a message to any Jami address. It will create a new
2316 identity before sending the message, if no Jami identity exist
2319 <p
><pre
>
2322 # Usage: $
0 <jami-address
> <message
>
2324 # Send
<message
> to
<jami-address
>, create local jami account if
2327 # License: GPL v2 or later at your choice
2328 # Author: Petter Reinholdtsen
2331 if [ -z
"$HOME
" ] ; then
2332 echo
"error: missing \$HOME, required for dbus to work
"
2336 # First, get dbus running if not already running
2337 DBUSLAUNCH=/usr/bin/dbus-launch
2338 PIDFILE=/run/asterisk/dbus-session.pid
2339 if [ -e $PIDFILE ] ; then
2341 if ! kill -
0 $DBUS_SESSION_BUS_PID
2>/dev/null ; then
2342 unset DBUS_SESSION_BUS_ADDRESS
2345 if [ -z
"$DBUS_SESSION_BUS_ADDRESS
" ]
&& [ -x
"$DBUSLAUNCH
" ]; then
2346 DBUS_SESSION_BUS_ADDRESS=
"unix:path=$HOME/.dbus
"
2347 dbus-daemon --session --address=
"$DBUS_SESSION_BUS_ADDRESS
" --nofork --nopidfile --syslog-only
< /dev/null
> /dev/null
2>&1 3>&1 &
2348 DBUS_SESSION_BUS_PID=$!
2350 echo DBUS_SESSION_BUS_PID=$DBUS_SESSION_BUS_PID
2351 echo DBUS_SESSION_BUS_ADDRESS=\
""$DBUS_SESSION_BUS_ADDRESS
"\
"
2352 echo export DBUS_SESSION_BUS_ADDRESS
2358 part=
"$
1"; shift
2359 op=
"$
1"; shift
2360 dbus-send --session \
2361 --dest=
"cx.ring.Ring
" /cx/ring/Ring/$part cx.ring.Ring.$part.$op $*
2365 part=
"$
1"; shift
2366 op=
"$
1"; shift
2367 dbus-send --session --print-reply \
2368 --dest=
"cx.ring.Ring
" /cx/ring/Ring/$part cx.ring.Ring.$part.$op $*
2372 dringopreply ConfigurationManager getAccountList | \
2373 grep string | awk -F
'"' '{print $
2}
' | head -n
1
2376 account=$(firstaccount)
2378 if [ -z
"$account
" ] ; then
2379 echo
"Missing local account, trying to create it
"
2380 dringop ConfigurationManager addAccount \
2381 dict:string:string:
"Account.type
",
"RING
",
"Account.videoEnabled
",
"false
"
2382 account=$(firstaccount)
2383 if [ -z
"$account
" ] ; then
2384 echo
"unable to create local account
"
2389 # Not using dringopreply to ensure $
2 can contain spaces
2390 dbus-send --print-reply --session \
2391 --dest=cx.ring.Ring \
2392 /cx/ring/Ring/ConfigurationManager \
2393 cx.ring.Ring.ConfigurationManager.sendTextMessage \
2394 string:
"$account
" string:
"$
1" \
2395 dict:string:string:
"text/plain
",
"$
2"
2396 </pre
></p
>
2398 <p
>If you want to check it out yourself, visit the
2399 <a href=
"https://jami.net/
">the Jami system project page
</a
> to learn
2400 more, and install the latest Jami client from Debian Unstable or
2403 <p
>As usual, if you use Bitcoin and want to show your support of my
2404 activities, please send Bitcoin donations to my address
2405 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2410 <title>Buster based Bokmål edition of Debian Administrator
's Handbook
</title>
2411 <link>http://www.hungry.com/~pere/blog/Buster_based_Bokm_l_edition_of_Debian_Administrator_s_Handbook.html
</link>
2412 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Buster_based_Bokm_l_edition_of_Debian_Administrator_s_Handbook.html
</guid>
2413 <pubDate>Tue,
20 Oct
2020 18:
35:
00 +
0200</pubDate>
2414 <description><p align=
"center
"><img align=
"center
" src=
"http://www.hungry.com/~pere/blog/images/
2020-
10-
20-debian-handbook-nb-testprint.jpeg
" width=
"60%
"/
></p
>
2416 <p
>I am happy to report that we finally made it! Norwegian Bokmål
2417 became the first translation published on paper of the new Buster
2418 based edition of
"<a href=
"https://debian-handbook.info/
">The Debian
2419 Administrator
's Handbook
</a
>". The print proof reading copy arrived
2420 some days ago, and it looked good, so now the book is approved for
2421 general distribution. This updated paperback edition
<a
2422 href=
"https://debian-handbook.info/get/#norwegian
">is available from
2423 lulu.com
</a
>. The book is also available for download in electronic
2424 form as PDF, EPUB and Mobipocket, and can also be
2425 <a href=
"https://debian-handbook.info/browse/nb-NO/stable/
">read online
</a
>.
</p
>
2427 <p
>I am very happy to wrap up this Creative Common licensed project,
2428 which concludes several months of work by several volunteers. The
2429 number of Linux related books published in Norwegian are few, and I
2430 really hope this one will gain many readers, as it is packed with deep
2431 knowledge on Linux and the Debian ecosystem. The book will be
2432 available for various Internet book stores like Amazon and Barnes
&
2433 Noble soon, but I recommend buying
2434 "<a href=
"https://www.lulu.com/en/us/shop/roland-mas-and-rapha%C3%ABl-hertzog/h%C3%A5ndbok-for-debian-administratoren/paperback/product-
9j7qwq.html
">Håndbok
2435 for Debian-administratoren
</a
>" directly from the source at Lulu.
2437 <p
>As usual, if you use Bitcoin and want to show your support of my
2438 activities, please send Bitcoin donations to my address
2439 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2444 <title>Buster update of Norwegian Bokmål edition of Debian Administrator
's Handbook almost done
</title>
2445 <link>http://www.hungry.com/~pere/blog/Buster_update_of_Norwegian_Bokm_l_edition_of_Debian_Administrator_s_Handbook_almost_done.html
</link>
2446 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Buster_update_of_Norwegian_Bokm_l_edition_of_Debian_Administrator_s_Handbook_almost_done.html
</guid>
2447 <pubDate>Fri,
11 Sep
2020 09:
45:
00 +
0200</pubDate>
2448 <description><p
>Thanks to the good work of several volunteers, the updated edition
2449 of the Norwegian translation for
2450 "<a href=
"https://debian-handbook.info/
">The Debian Administrator
's
2451 Handbook
</a
>" is now almost completed. After many months of proof
2452 reading, I consider the proof reading complete enough for us to move
2453 to the next step, and have asked for the print version to be prepared
2454 and sent of to the print on demand service lulu.com. While it is
2455 still not to late if you find any incorrect translations on
2456 <a href=
"https://hosted.weblate.org/languages/nb_NO/debian-handbook/
">the
2457 hosted Weblate service
</a
>, but it will be soon. :) You can check out
2458 <a href=
" https://debian-handbook.info/browse/nb-NO/stable/
">the Buster
2459 edition on the web
</a
> until the print edition is ready.
</p
>
2461 <p
>The book will be for sale on lulu.com and various web book stores,
2462 with links available from the web site for the book linked to above.
2463 I hope a lot of readers find it useful.
</p
>
2465 <p
>As usual, if you use Bitcoin and want to show your support of my
2466 activities, please send Bitcoin donations to my address
2467 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2472 <title>Working on updated Norwegian Bokmål edition of Debian Administrator
's Handbook
</title>
2473 <link>http://www.hungry.com/~pere/blog/Working_on_updated_Norwegian_Bokm_l_edition_of_Debian_Administrator_s_Handbook.html
</link>
2474 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Working_on_updated_Norwegian_Bokm_l_edition_of_Debian_Administrator_s_Handbook.html
</guid>
2475 <pubDate>Sat,
4 Jul
2020 23:
55:
00 +
0200</pubDate>
2476 <description><p
>Three years ago, the first Norwegian Bokmål edition of
2477 "<a href=
"https://debian-handbook.info/
">The Debian Administrator
's
2478 Handbook
</a
>" was published. This was based on Debian Jessie. Now a
2479 new and updated version based on Buster is getting ready. Work on the
2480 updated Norwegian Bokmål edition has been going on for a few months
2481 now, and yesterday, we reached the first mile stone, with
100% of the
2482 texts being translated. A lot of proof reading remains, of course,
2483 but a major step towards a new edition has been taken.
</p
>
2485 <p
>The book is translated by volunteers, and we would love to get some
2486 help with the proof reading. The translation uses
2487 <a href=
"https://hosted.weblate.org/languages/nb_NO/debian-handbook/
">the
2488 hosted Weblate service
</a
>, and we welcome everyone to have a look and
2489 submit improvements and suggestions. There is also a proof readers
2490 PDF available on request, get in touch if you want to help out that
2493 <p
>As usual, if you use Bitcoin and want to show your support of my
2494 activities, please send Bitcoin donations to my address
2495 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2500 <title>Secure Socket API - a simple and powerful approach for TLS support in software
</title>
2501 <link>http://www.hungry.com/~pere/blog/Secure_Socket_API___a_simple_and_powerful_approach_for_TLS_support_in_software.html
</link>
2502 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Secure_Socket_API___a_simple_and_powerful_approach_for_TLS_support_in_software.html
</guid>
2503 <pubDate>Sat,
6 Jun
2020 12:
40:
00 +
0200</pubDate>
2504 <description><p
>As a member of the
<a href=
"https://www.nuug.no/
">Norwegian Unix
2505 User Group
</a
>, I have the pleasure of receiving the
2506 <a href=
"https://www.usenix.org/
">USENIX
</a
> magazine
2507 <a href=
"https://www.usenix.org/publications/login/
">;login:
</a
>
2508 several times a year. I rarely have time to read all the articles,
2509 but try to at least skim through them all as there is a lot of nice
2510 knowledge passed on there. I even carry the latest issue with me most
2511 of the time to try to get through all the articles when I have a few
2512 spare minutes.
</p
>
2514 <p
>The other day I came across a nice article titled
2515 "<a href=
"https://www.usenix.org/publications/login/winter2018/oneill
">The
2516 Secure Socket API: TLS as an Operating System Service
</a
>" with a
2517 marvellous idea I hope can make it all the way into the POSIX standard.
2518 The idea is as simple as it is powerful. By introducing a new
2519 socket() option IPPROTO_TLS to use TLS, and a system wide service to
2520 handle setting up TLS connections, one both make it trivial to add TLS
2521 support to any program currently using the POSIX socket API, and gain
2522 system wide control over certificates, TLS versions and encryption
2523 systems used. Instead of doing this:
</p
>
2525 <p
><blockquote
><pre
>
2526 int socket = socket(PF_INET, SOCK_STREAM, IPPROTO_TCP);
2527 </pre
></blockquote
></p
>
2529 <p
>the program code would be doing this:
<p
>
2531 <p
><blockquote
><pre
>
2532 int socket = socket(PF_INET, SOCK_STREAM, IPPROTO_TLS);
2533 </pre
></blockquote
></p
>
2535 <p
>According to the ;login: article, converting a C program to use TLS
2536 would normally modify only
5-
10 lines in the code, which is amazing
2537 when compared to using for example the OpenSSL API.
</p
>
2539 <p
>The project has set up the
2540 <a href=
"https://securesocketapi.org/
">https://securesocketapi.org/
</a
>
2541 web site to spread the idea, and the code for a kernel module and the
2542 associated system daemon is available from two github repositories:
2543 <a href=
"https://github.com/markoneill/ssa
">ssa
</a
> and
2544 <a href=
"https://github.com/markoneill/ssa-daemon
">ssa-daemon
</a
>.
2545 Unfortunately there is no explicit license information with the code,
2546 so its copyright status is unclear. A
2547 <a href=
"https://github.com/markoneill/ssa/issues/
2">request to solve
2548 this
</a
> about it has been unsolved since
2018-
08-
17.
</p
>
2550 <p
>I love the idea of extending socket() to gain TLS support, and
2551 understand why it is an advantage to implement this as a kernel module
2552 and system wide service daemon, but can not help to think that it
2553 would be a lot easier to get projects to move to this way of setting
2554 up TLS if it was done with a user space approach where programs
2555 wanting to use this API approach could just link with a wrapper
2558 <p
>I recommend you check out this simple and powerful approach to more
2559 secure network connections. :)
</p
>
2561 <p
>As usual, if you use Bitcoin and want to show your support of my
2562 activities, please send Bitcoin donations to my address
2563 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2568 <title>Jami as a Zoom client, a trick for password protected rooms...
</title>
2569 <link>http://www.hungry.com/~pere/blog/Jami_as_a_Zoom_client__a_trick_for_password_protected_rooms___.html
</link>
2570 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Jami_as_a_Zoom_client__a_trick_for_password_protected_rooms___.html
</guid>
2571 <pubDate>Fri,
8 May
2020 13:
30:
00 +
0200</pubDate>
2572 <description><p
>Half a year ago,
2573 <a href=
"http://www.hungry.com/~pere/blog/Jami_Ring__finally_functioning_peer_to_peer_communication_client.html
">I
2574 wrote
</a
> about
<a href=
"https://jami.net/
">the Jami communication
2575 client
</a
>, capable of peer-to-peer encrypted communication. It
2576 handle both messages, audio and video. It uses distributed hash
2577 tables instead of central infrastructure to connect its users to each
2578 other, which in my book is a plus. I mentioned briefly that it could
2579 also work as a SIP client, which came in handy when the higher
2580 educational sector in Norway started to promote Zoom as its video
2581 conferencing solution. I am reluctant to use the official Zoom client
2582 software, due to their
<a href=
"https://zoom.us/terms
">copyright
2583 license clauses
</a
> prohibiting users to reverse engineer (for example
2584 to check the security) and benchmark it, and thus prefer to connect to
2585 Zoom meetings with free software clients.
</p
>
2587 <p
>Jami worked OK as a SIP client to Zoom as long as there was no
2588 password set on the room. The Jami daemon leak memory like crazy
2589 (approximately
1 GiB a minute) when I am connected to the video
2590 conference, so I had to restart the client every
7-
10 minutes, which
2591 is not great. I tried to get other SIP Linux clients to work
2592 without success, so I decided I would have to live with this wart
2593 until someone managed to fix the leak in the dring code base. But
2594 another problem showed up once the rooms were password protected. I
2595 could not get my dial tone signaling through from Jami to Zoom, and
2596 dial tone signaling is used to enter the password when connecting to
2597 Zoom. I tried a lot of different permutations with my Jami and
2598 Asterisk setup to try to figure out why the signaling did not get
2599 through, only to finally discover that the fundamental problem seem to
2600 be that Zoom is simply not able to receive dial tone signaling when
2601 connecting via SIP. There seem to be nothing wrong with the Jami and
2602 Asterisk end, it is simply broken in the Zoom end. I got help from a
2603 very skilled VoIP engineer figuring out this last part. And being a
2604 very skilled engineer, he was also able to locate a solution for me.
2605 Or to be exact, a workaround that solve my initial problem of
2606 connecting to password protected Zoom rooms using Jami.
</p
>
2608 <p
>So, how do you do this, I am sure you are wondering by now. The
2610 <a href=
"https://support.zoom.us/hc/en-us/articles/
202405539-H-
323-SIP-Room-Connector-Dial-Strings#sip
">documented
2611 from Zoom
</a
>, and it is to modify the SIP address to include the room
2612 password. What is most surprising about this is that the
2613 automatically generated email from Zoom with instructions on how to
2614 connect via SIP do not mention this. The SIP address to use normally
2615 consist of the room ID (a number), an @ character and the IP address
2616 of the Zoom SIP gateway. But Zoom understand a lot more than just the
2617 room ID in front of the at sign. The format is
"<tt
>[Meeting
2618 ID].[Password].[Layout].[Host Key]
</tt
>", and you can here see how you
2619 can both enter password, control the layout (full screen, active
2620 presence and gallery) and specify the host key to start the meeting.
2621 The full SIP address entered into Jami to provide the password will
2622 then look like this (all using made up numbers):
</p
>
2624 <p
><blockquote
>
2625 <tt
>sip:
657837644.522827@
192.168.169.170</tt
>
2626 </blockquote
></p
>
2628 <p
>Now if only jami would reduce its memory usage, I could even
2629 recommend this setup to others. :)
</p
>
2631 <p
>As usual, if you use Bitcoin and want to show your support of my
2632 activities, please send Bitcoin donations to my address
2633 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2638 <title>GnuCOBOL, a free platform to learn and use COBOL - nice free software
</title>
2639 <link>http://www.hungry.com/~pere/blog/GnuCOBOL__a_free_platform_to_learn_and_use_COBOL___nice_free_software.html
</link>
2640 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/GnuCOBOL__a_free_platform_to_learn_and_use_COBOL___nice_free_software.html
</guid>
2641 <pubDate>Wed,
29 Apr
2020 13:
10:
00 +
0200</pubDate>
2642 <description><p
>The curiosity got the better of me when
2643 <a href=
"https://developers.slashdot.org/story/
20/
04/
06/
1424246/new-jersey-desperately-needs-cobol-programmers
">Slashdot
2644 reported
</a
> that New Jersey was desperately looking for
2645 <a href=
"https://en.wikipedia.org/wiki/COBOL
">COBOL
</a
> programmers,
2646 and a few days later it was reported that
2647 <a href=
"https://onezero.medium.com/ibm-rallies-cobol-engineers-to-save-overloaded-unemployment-systems-eeadf13eddce
">IBM
2648 tried to locate COBOL programmers
</a
>.
</p
>
2650 <p
>I thus decided to have a look at free software alternatives to
2651 learn COBOL, and had the pleasure to find
2652 <a href=
"https://sourceforge.net/projects/open-cobol/
">GnuCOBOL
</a
> was
2653 already
<a href=
"https://tracker.debian.org/pkg/gnucobol
">in
2654 Debian
</a
>. It used to be called Open Cobol, and is a
"compiler
"
2655 transforming COBOL code to C or C++ before giving it to GCC or Visual
2656 Studio to build binaries.
</p
>
2658 <p
>I managed to get in touch with upstream, and was impressed with the
2659 quick response, and also was happy to see a new Debian maintainer
2660 taking over when the original one recently asked to be replaced. A
2661 new Debian upload was done as recently as yesterday.
</p
>
2663 <p
>Using the Debian package, I was able to follow a simple COBOL
2664 introduction and make and run simple COBOL programs. It was fun to
2665 learn a new programming language. If you want to test for yourself,
2666 <a href=
"https://en.wikipedia.org/wiki/GnuCOBOL
">the GnuCOBOL Wikipedia
2667 page
</a
> have a few simple examples to get you startet.
</p
>
2669 <p
>As I do not have much experience with COBOL, I do not know how
2670 standard compliant it is, but it claim to pass most tests from COBOL
2671 test suite, which sound good to me. It is nice to know it is possible
2672 to learn COBOL using software without any usage restrictions, and I am
2673 very happy such nice free software project as this is available. If
2674 you as me is curious about COBOL, check it out.
</p
>
2676 <p
>As usual, if you use Bitcoin and want to show your support of my
2677 activities, please send Bitcoin donations to my address
2678 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2683 <title>Jami/Ring, finally functioning peer to peer communication client
</title>
2684 <link>http://www.hungry.com/~pere/blog/Jami_Ring__finally_functioning_peer_to_peer_communication_client.html
</link>
2685 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Jami_Ring__finally_functioning_peer_to_peer_communication_client.html
</guid>
2686 <pubDate>Wed,
19 Jun
2019 08:
50:
00 +
0200</pubDate>
2687 <description><p
>Some years ago, in
2016, I
2688 <a href=
"http://www.hungry.com/~pere/blog/Experience_and_updated_recipe_for_using_the_Signal_app_without_a_mobile_phone.html
">wrote
2689 for the first time about
</a
> the Ring peer to peer messaging system.
2690 It would provide messaging without any central server coordinating the
2691 system and without requiring all users to register a phone number or
2692 own a mobile phone. Back then, I could not get it to work, and put it
2693 aside until it had seen more development. A few days ago I decided to
2694 give it another try, and am happy to report that this time I am able
2695 to not only send and receive messages, but also place audio and video
2696 calls. But only if UDP is not blocked into your network.
</p
>
2698 <p
>The Ring system changed name earlier this year to
2699 <a href=
"https://en.wikipedia.org/wiki/Jami_(software)
">Jami
</a
>. I
2700 tried doing web search for
'ring
' when I discovered it for the first
2701 time, and can only applaud this change as it is impossible to find
2702 something called Ring among the noise of other uses of that word. Now
2703 you can search for
'jami
' and this client and
2704 <a href=
"https://jami.net/
">the Jami system
</a
> is the first hit at
2705 least on duckduckgo.
</p
>
2707 <p
>Jami will by default encrypt messages as well as audio and video
2708 calls, and try to send them directly between the communicating parties
2709 if possible. If this proves impossible (for example if both ends are
2710 behind NAT), it will use a central SIP TURN server maintained by the
2711 Jami project. Jami can also be a normal SIP client. If the SIP
2712 server is unencrypted, the audio and video calls will also be
2713 unencrypted. This is as far as I know the only case where Jami will
2714 do anything without encryption.
</p
>
2716 <p
>Jami is available for several platforms: Linux, Windows, MacOSX,
2717 Android, iOS, and Android TV. It is included in Debian already. Jami
2718 also work for those using F-Droid without any Google connections,
2719 while Signal do not.
2720 <a href=
"https://git.jami.net/savoirfairelinux/ring-project/wikis/technical/Protocol
">The
2721 protocol
</a
> is described in the Ring project wiki. The system uses a
2722 distributed hash table (DHT) system (similar to BitTorrent) running
2723 over UDP. On one of the networks I use, I discovered Jami failed to
2724 work. I tracked this down to the fact that incoming UDP packages
2725 going to ports
1-
49999 were blocked, and the DHT would pick a random
2726 port and end up in the low range most of the time. After talking to
2727 the developers, I solved this by enabling the dhtproxy in the
2728 settings, thus using TCP to talk to a central DHT proxy instead of
2730 peering directly with others. I
've been told the developers are
2731 working on allowing DHT to use TCP to avoid this problem. I also ran
2732 into a problem when trying to talk to the version of Ring included in
2733 Debian Stable (Stretch). Apparently the protocol changed between
2734 beta2 and the current version, making these clients incompatible.
2735 Hopefully the protocol will not be made incompatible in the
2738 <p
>It is worth noting that while looking at Jami and its features, I
2739 came across another communication platform I have not tested yet. The
2740 <a href=
"https://en.wikipedia.org/wiki/Tox_(protocol)
">Tox protocol
</a
>
2741 and
<a href=
"https://tox.chat/
">family of Tox clients
</a
>. It might
2742 become the topic of a future blog post.
</p
>
2744 <p
>As usual, if you use Bitcoin and want to show your support of my
2745 activities, please send Bitcoin donations to my address
2746 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2751 <title>Strategispillet Unknown Horizons nå tilgjengelig på bokmål
</title>
2752 <link>http://www.hungry.com/~pere/blog/Strategispillet_Unknown_Horizons_n__tilgjengelig_p__bokm_l.html
</link>
2753 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Strategispillet_Unknown_Horizons_n__tilgjengelig_p__bokm_l.html
</guid>
2754 <pubDate>Wed,
23 Jan
2019 07:
50:
00 +
0100</pubDate>
2755 <description><p
>I høst ble jeg inspirert til å bidra til oversettelsen av
2756 <a href=
"http://unknown-horizons.org/
">strategispillet Unknown
2757 Horizons
</a
>, og oversatte de nesten
200 strengene i prosjektet til
2758 bokmål. Deretter har jeg gått å ventet på at det kom en ny utgave som
2759 inneholdt disse oversettelsene. Nå er endelig ventetiden over. Den
2760 nye versjonen kom på nyåret, og ble
2761 <a href=
"https://tracker.debian.org/pkg/unknown-horizons
">lastet opp i
2762 Debian
</a
> for noen få dager siden. I går kveld fikk jeg testet det ut, og
2763 må innrømme at oversettelsene fungerer fint. Fant noen få tekster som
2764 måtte justeres, men ikke noe alvorlig. Har oppdatert
2765 <a href=
"https://hosted.weblate.org/projects/uh/
">oversettelsen på
2766 Weblate
</a
>, slik at neste utgave vil være enda bedre. :)
</p
>
2768 <p
>Spillet er et ressursstyringsspill ala Civilization, og er morsomt
2769 å spille for oss som liker slikt. :)
</p
>
2771 <p
>Som vanlig, hvis du bruker Bitcoin og ønsker å vise din støtte til
2772 det jeg driver med, setter jeg pris på om du sender Bitcoin-donasjoner
2774 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
2775 Merk, betaling med bitcoin er ikke anonymt. :)
</p
>
2780 <title>Debian now got everything you need to program Micro:bit
</title>
2781 <link>http://www.hungry.com/~pere/blog/Debian_now_got_everything_you_need_to_program_Micro_bit.html
</link>
2782 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_now_got_everything_you_need_to_program_Micro_bit.html
</guid>
2783 <pubDate>Tue,
22 Jan
2019 17:
20:
00 +
0100</pubDate>
2784 <description><p
>I am amazed and very pleased to discover that since a few days ago,
2785 everything you need to program the
<a href=
"https://microbit.org/
">BBC
2786 micro:bit
</a
> is available from the Debian archive. All this is
2787 thanks to the hard work of Nick Morrott and the Debian python
2788 packaging team. The micro:bit project recommend the mu-editor to
2789 program the microcomputer, as this editor will take care of all the
2790 machinery required to injekt/flash micropython alongside the program
2791 into the micro:bit, as long as the pieces are available.
</p
>
2793 <p
>There are three main pieces involved. The first to enter Debian
2795 <a href=
"https://tracker.debian.org/pkg/python-uflash
">python-uflash
</a
>,
2796 which was accepted into the archive
2019-
01-
12. The next one was
2797 <a href=
"https://tracker.debian.org/pkg/mu-editor
">mu-editor
</a
>, which
2798 showed up
2019-
01-
13. The final and hardest part to to into the
2800 <a href=
"https://tracker.debian.org/pkg/firmware-microbit-micropython
">firmware-microbit-micropython
</a
>,
2801 which needed to get its build system and dependencies into Debian
2802 before it was accepted
2019-
01-
20. The last one is already in Debian
2803 Unstable and should enter Debian Testing / Buster in three days. This
2804 all allow any user of the micro:bit to get going by simply running
2805 'apt install mu-editor
' when using Testing or Unstable, and once
2806 Buster is released as stable, all the users of Debian stable will be
2807 catered for.
</p
>
2809 <p
>As a minor final touch, I added rules to
2810 <a href=
"https://tracker.debian.org/pkg/isenkram
">the isenkram
2811 package
</a
> for recognizing micro:bit and recommend the mu-editor
2812 package. This make sure any user of the isenkram desktop daemon will
2813 get a popup suggesting to install mu-editor then the USB cable from
2814 the micro:bit is inserted for the first time.
</p
>
2816 <p
>This should make it easier to have fun.
</p
>
2818 <p
>As usual, if you use Bitcoin and want to show your support of my
2819 activities, please send Bitcoin donations to my address
2820 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2825 <title>Learn to program with Minetest on Debian
</title>
2826 <link>http://www.hungry.com/~pere/blog/Learn_to_program_with_Minetest_on_Debian.html
</link>
2827 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Learn_to_program_with_Minetest_on_Debian.html
</guid>
2828 <pubDate>Sat,
15 Dec
2018 15:
30:
00 +
0100</pubDate>
2829 <description><p
>A fun way to learn how to program
2830 <a href=
"https://www.python.org/
">Python
</a
> is to follow the
2831 instructions in the book
2832 "<a href=
"https://nostarch.com/programwithminecraft
">Learn to program
2833 with Minecraft
</a
>", which introduces programming in Python to people
2834 who like to play with Minecraft. The book uses a Python library to
2835 talk to a TCP/IP socket with an API accepting build instructions and
2836 providing information about the current players in a Minecraft world.
2837 The TCP/IP API was first created for the Minecraft implementation for
2838 Raspberry Pi, and has since been ported to some server versions of
2839 Minecraft. The book contain recipes for those using Windows, MacOSX
2840 and Raspian. But a little known fact is that you can follow the same
2841 recipes using the free software construction game
2842 <a href=
"https://minetest.net/
">Minetest
</a
>.
</p
>
2844 <p
>There is
<a href=
"https://github.com/sprintingkiwi/pycraft_mod
">a
2845 Minetest module implementing the same API
</a
>, making it possible to
2846 use the Python programs coded to talk to Minecraft with Minetest too.
2848 <a href=
"https://ftp-master.debian.org/new/minetest-mod-pycraft_0.20%
2Bgit20180331.0376a0a%
2Bdfsg-
1.html
">uploaded
2849 this module
</a
> to Debian two weeks ago, and as soon as it clears the
2850 FTP masters NEW queue, learning to program Python with Minetest on
2851 Debian will be a simple
'apt install
' away. The Debian package is
2852 maintained as part of the Debian Games team, and
2853 <a href=
"https://salsa.debian.org/games-team/unfinished/minetest-mod-pycraft
">the
2854 packaging rules
</a
> are currently located under
'unfinished
' on
2857 <p
>You will most likely need to install several of the Minetest
2858 modules in Debian for the examples included with the library to work
2859 well, as there are several blocks used by the example scripts that are
2860 provided via modules in Minetest. Without the required blocks, a
2861 simple stone block is used instead. My initial testing with a analog
2862 clock did not get gold arms as instructed in the python library, but
2863 instead used stone arms.
</p
>
2865 <p
>I tried to find a way to add the API to the desktop version of
2866 Minecraft, but were unable to find any working recipes. The
2867 <a href=
"https://www.epiphanydigest.com/tag/minecraft-python-api/
">recipes
</a
>
2868 I
<a href=
"https://github.com/kbsriram/mcpiapi
">found
</a
> are only
2869 working with a standalone Minecraft server setup. Are there any
2870 options to use with the normal desktop version?
</p
>
2872 <p
>As usual, if you use Bitcoin and want to show your support of my
2873 activities, please send Bitcoin donations to my address
2874 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2879 <title>Time for an official MIME type for patches?
</title>
2880 <link>http://www.hungry.com/~pere/blog/Time_for_an_official_MIME_type_for_patches_.html
</link>
2881 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Time_for_an_official_MIME_type_for_patches_.html
</guid>
2882 <pubDate>Thu,
1 Nov
2018 08:
15:
00 +
0100</pubDate>
2883 <description><p
>As part of my involvement in
2884 <a href=
"https://gitlab.com/OsloMet-ABI/nikita-noark5-core
">the Nikita
2885 archive API project
</a
>, I
've been importing a fairly large lump of
2886 emails into a test instance of the archive to see how well this would
2887 go. I picked a subset of
<a href=
"https://notmuchmail.org/
">my
2888 notmuch email database
</a
>, all public emails sent to me via
2889 @lists.debian.org, giving me a set of around
216 000 emails to import.
2890 In the process, I had a look at the various attachments included in
2891 these emails, to figure out what to do with attachments, and noticed
2892 that one of the most common attachment formats do not have
2893 <a href=
"https://www.iana.org/assignments/media-types/media-types.xhtml
">an
2894 official MIME type
</a
> registered with IANA/IETF. The output from
2895 diff, ie the input for patch, is on the top
10 list of formats
2896 included in these emails. At the moment people seem to use either
2897 text/x-patch or text/x-diff, but neither is officially registered. It
2898 would be better if one official MIME type were registered and used
2899 everywhere.
</p
>
2901 <p
>To try to get one official MIME type for these files, I
've brought
2903 <a href=
"https://www.ietf.org/mailman/listinfo/media-types
">the
2904 media-types mailing list
</a
>. If you are interested in discussion
2905 which MIME type to use as the official for patch files, or involved in
2906 making software using a MIME type for patches, perhaps you would like
2907 to join the discussion?
</p
>
2909 <p
>As usual, if you use Bitcoin and want to show your support of my
2910 activities, please send Bitcoin donations to my address
2911 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2916 <title>Automatic Google Drive sync using grive in Debian
</title>
2917 <link>http://www.hungry.com/~pere/blog/Automatic_Google_Drive_sync_using_grive_in_Debian.html
</link>
2918 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Automatic_Google_Drive_sync_using_grive_in_Debian.html
</guid>
2919 <pubDate>Thu,
4 Oct
2018 15:
20:
00 +
0200</pubDate>
2920 <description><p
>A few days, I rescued a Windows victim over to Debian. To try to
2921 rescue the remains, I helped set up automatic sync with Google Drive.
2922 I did not find any sensible Debian package handling this
2923 automatically, so I rebuild the grive2 source from
2924 <a href=
"http://www.webupd8.org/
">the Ubuntu UPD8 PPA
</a
> to do the
2925 task and added a autostart desktop entry and a small shell script to
2926 run in the background while the user is logged in to do the sync.
2927 Here is a sketch of the setup for future reference.
</p
>
2929 <p
>I first created
<tt
>~/googledrive
</tt
>, entered the directory and
2930 ran
'<tt
>grive -a
</tt
>' to authenticate the machine/user. Next, I
2931 created a autostart hook in
<tt
>~/.config/autostart/grive.desktop
</tt
>
2932 to start the sync when the user log in:
</p
>
2934 <p
><blockquote
><pre
>
2936 Name=Google drive autosync
2938 Exec=/home/user/bin/grive-sync
2939 </pre
></blockquote
></p
>
2941 <p
>Finally, I wrote the
<tt
>~/bin/grive-sync
</tt
> script to sync
2942 ~/googledrive/ with the files in Google Drive.
</p
>
2944 <p
><blockquote
><pre
>
2949 if [
"$syncpid
" ] ; then
2953 trap cleanup EXIT INT QUIT
2954 /usr/lib/grive/grive-sync.sh listen googledrive
2>&1 | sed
"s%^%$
0:%
" &
2957 if ! xhost
>/dev/null
2>&1 ; then
2958 echo
"no DISPLAY, exiting as the user probably logged out
"
2961 if [ ! -e /run/user/
1000/grive-sync.sh_googledrive ] ; then
2962 /usr/lib/grive/grive-sync.sh sync googledrive
2965 done
2>&1 | sed
"s%^%$
0:%
"
2966 </pre
></blockquote
></p
>
2968 <p
>Feel free to use the setup if you want. It can be assumed to be
2969 GNU GPL v2 licensed (or any later version, at your leisure), but I
2970 doubt this code is possible to claim copyright on.
</p
>
2972 <p
>As usual, if you use Bitcoin and want to show your support of my
2973 activities, please send Bitcoin donations to my address
2974 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
2979 <title>Using the Kodi API to play Youtube videos
</title>
2980 <link>http://www.hungry.com/~pere/blog/Using_the_Kodi_API_to_play_Youtube_videos.html
</link>
2981 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Using_the_Kodi_API_to_play_Youtube_videos.html
</guid>
2982 <pubDate>Sun,
2 Sep
2018 23:
40:
00 +
0200</pubDate>
2983 <description><p
>I continue to explore my Kodi installation, and today I wanted to
2984 tell it to play a youtube URL I received in a chat, without having to
2985 insert search terms using the on-screen keyboard. After searching the
2986 web for API access to the Youtube plugin and testing a bit, I managed
2987 to find a recipe that worked. If you got a kodi instance with its API
2988 available from http://kodihost/jsonrpc, you can try the following to
2989 have check out a nice cover band.
</p
>
2991 <p
><blockquote
><pre
>curl --silent --header
'Content-Type: application/json
' \
2992 --data-binary
'{
"id
":
1,
"jsonrpc
":
"2.0",
"method
":
"Player.Open
",
2993 "params
": {
"item
": {
"file
":
2994 "plugin://plugin.video.youtube/play/?video_id=LuRGVM9O0qg
" } } }
' \
2995 http://projector.local/jsonrpc
</pre
></blockquote
></p
>
2997 <p
>I
've extended kodi-stream program to take a video source as its
2998 first argument. It can now handle direct video links, youtube links
2999 and
'desktop
' to stream my desktop to Kodi. It is almost like a
3000 Chromecast. :)
</p
>
3002 <p
>As usual, if you use Bitcoin and want to show your support of my
3003 activities, please send Bitcoin donations to my address
3004 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3009 <title>Sharing images with friends and family using RSS and EXIF/XMP metadata
</title>
3010 <link>http://www.hungry.com/~pere/blog/Sharing_images_with_friends_and_family_using_RSS_and_EXIF_XMP_metadata.html
</link>
3011 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Sharing_images_with_friends_and_family_using_RSS_and_EXIF_XMP_metadata.html
</guid>
3012 <pubDate>Tue,
31 Jul
2018 23:
30:
00 +
0200</pubDate>
3013 <description><p
>For a while now, I have looked for a sensible way to share images
3014 with my family using a self hosted solution, as it is unacceptable to
3015 place images from my personal life under the control of strangers
3016 working for data hoarders like Google or Dropbox. The last few days I
3017 have drafted an approach that might work out, and I would like to
3018 share it with you. I would like to publish images on a server under
3019 my control, and point some Internet connected display units using some
3020 free and open standard to the images I published. As my primary
3021 language is not limited to ASCII, I need to store metadata using
3022 UTF-
8. Many years ago, I hoped to find a digital photo frame capable
3023 of reading a RSS feed with image references (aka using the
3024 &lt;enclosure
&gt; RSS tag), but was unable to find a current supplier
3025 of such frames. In the end I gave up that approach.
</p
>
3027 <p
>Some months ago, I discovered that
3028 <a href=
"https://www.jwz.org/xscreensaver/
">XScreensaver
</a
> is able to
3029 read images from a RSS feed, and used it to set up a screen saver on
3030 my home info screen, showing images from the Daily images feed from
3031 NASA. This proved to work well. More recently I discovered that
3032 <a href=
"https://kodi.tv
">Kodi
</a
> (both using
3033 <a href=
"https://www.openelec.tv/
">OpenELEC
</a
> and
3034 <a href=
"https://libreelec.tv
">LibreELEC
</a
>) provide the
3035 <a href=
"https://github.com/grinsted/script.screensaver.feedreader
">Feedreader
</a
>
3036 screen saver capable of reading a RSS feed with images and news. For
3037 fun, I used it this summer to test Kodi on my parents TV by hooking up
3038 a Raspberry PI unit with LibreELEC, and wanted to provide them with a
3039 screen saver showing selected pictures from my selection.
</p
>
3041 <p
>Armed with motivation and a test photo frame, I set out to generate
3042 a RSS feed for the Kodi instance. I adjusted my
<a
3043 href=
"https://freedombox.org/
">Freedombox
</a
> instance, created
3044 /var/www/html/privatepictures/, wrote a small Perl script to extract
3045 title and description metadata from the photo files and generate the
3046 RSS file. I ended up using Perl instead of python, as the
3047 libimage-exiftool-perl Debian package seemed to handle the EXIF/XMP
3048 tags I ended up using, while python3-exif did not. The relevant EXIF
3049 tags only support ASCII, so I had to find better alternatives. XMP
3050 seem to have the support I need.
</p
>
3052 <p
>I am a bit unsure which EXIF/XMP tags to use, as I would like to
3053 use tags that can be easily added/updated using normal free software
3054 photo managing software. I ended up using the tags set using this
3055 exiftool command, as these tags can also be set using digiKam:
</p
>
3057 <blockquote
><pre
>
3058 exiftool -headline=
'The RSS image title
' \
3059 -description=
'The RSS image description.
' \
3060 -subject+=for-family photo.jpeg
3061 </pre
></blockquote
>
3063 <p
>I initially tried the
"-title
" and
"keyword
" tags, but they were
3064 invisible in digiKam, so I changed to
"-headline
" and
"-subject
". I
3065 use the keyword/subject
'for-family
' to flag that the photo should be
3066 shared with my family. Images with this keyword set are located and
3067 copied into my Freedombox for the RSS generating script to find.
</p
>
3069 <p
>Are there better ways to do this? Get in touch if you have better
3070 suggestions.
</p
>
3072 <p
>As usual, if you use Bitcoin and want to show your support of my
3073 activities, please send Bitcoin donations to my address
3074 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3079 <title>Simple streaming the Linux desktop to Kodi using GStreamer and RTP
</title>
3080 <link>http://www.hungry.com/~pere/blog/Simple_streaming_the_Linux_desktop_to_Kodi_using_GStreamer_and_RTP.html
</link>
3081 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Simple_streaming_the_Linux_desktop_to_Kodi_using_GStreamer_and_RTP.html
</guid>
3082 <pubDate>Thu,
12 Jul
2018 17:
55:
00 +
0200</pubDate>
3083 <description><p
>Last night, I wrote
3084 <a href=
"http://www.hungry.com/~pere/blog/Streaming_the_Linux_desktop_to_Kodi_using_VLC_and_RTSP.html
">a
3085 recipe to stream a Linux desktop using VLC to a instance of Kodi
</a
>.
3086 During the day I received valuable feedback, and thanks to the
3087 suggestions I have been able to rewrite the recipe into a much simpler
3088 approach requiring no setup at all. It is a single script that take
3089 care of it all.
</p
>
3091 <p
>This new script uses GStreamer instead of VLC to capture the
3092 desktop and stream it to Kodi. This fixed the video quality issue I
3093 saw initially. It further removes the need to add a m3u file on the
3094 Kodi machine, as it instead connects to
3095 <a href=
"https://kodi.wiki/view/JSON-RPC_API/v8
">the JSON-RPC API in
3096 Kodi
</a
> and simply ask Kodi to play from the stream created using
3097 GStreamer. Streaming the desktop to Kodi now become trivial. Copy
3098 the script below, run it with the DNS name or IP address of the kodi
3099 server to stream to as the only argument, and watch your screen show
3100 up on the Kodi screen. Note, it depend on multicast on the local
3101 network, so if you need to stream outside the local network, the
3102 script must be modified. Also note, I have no idea if audio work, as
3103 I only care about the picture part.
</p
>
3105 <blockquote
><pre
>
3108 # Stream the Linux desktop view to Kodi. See
3109 # http://www.hungry.com/~pere/blog/Streaming_the_Linux_desktop_to_Kodi_using_VLC_and_RTSP.html
3110 # for backgorund information.
3112 # Make sure the stream is stopped in Kodi and the gstreamer process is
3113 # killed if something go wrong (for example if curl is unable to find the
3114 # kodi server). Do the same when interrupting this script.
3118 params=
"$
3"
3119 curl --silent --header
'Content-Type: application/json
' \
3120 --data-binary
"{ \
"id\
":
1, \
"jsonrpc\
": \
"2.0\
", \
"method\
": \
"$cmd\
", \
"params\
": $params }
" \
3121 "http://$host/jsonrpc
"
3124 if [ -n
"$kodihost
" ] ; then
3125 # Stop the playing when we end
3126 playerid=$(kodicmd
"$kodihost
" Player.GetActivePlayers
"{}
" |
3127 jq .result[].playerid)
3128 kodicmd
"$kodihost
" Player.Stop
"{ \
"playerid\
" : $playerid }
" > /dev/null
3130 if [
"$gstpid
" ]
&& kill -
0 "$gstpid
" >/dev/null
2>&1; then
3131 kill
"$gstpid
"
3134 trap cleanup EXIT INT
3136 if [ -n
"$
1" ]; then
3147 pasrc=$(pactl list | grep -A2
'Source #
' | grep
'Name: .*\.monitor$
' | \
3148 cut -d
" " -f2|head -
1)
3149 gst-launch-
1.0 ximagesrc use-damage=
0 ! video/x-raw,framerate=
30/
1 ! \
3150 videoconvert ! queue2 ! \
3151 x264enc bitrate=
8000 speed-preset=superfast tune=zerolatency qp-min=
30 \
3152 key-int-max=
15 bframes=
2 ! video/x-h264,profile=high ! queue2 ! \
3153 mpegtsmux alignment=
7 name=mux ! rndbuffersize max=
1316 min=
1316 ! \
3154 udpsink host=$mcast port=$mcastport ttl-mc=$mcastttl auto-multicast=
1 sync=
0 \
3155 pulsesrc device=$pasrc ! audioconvert ! queue2 ! avenc_aac ! queue2 ! mux. \
3156 > /dev/null
2>&1 &
3159 # Give stream a second to get going
3162 # Ask kodi to start streaming using its JSON-RPC API
3163 kodicmd
"$kodihost
" Player.Open \
3164 "{\
"item\
": { \
"file\
": \
"udp://@$mcast:$mcastport\
" } }
" > /dev/null
3166 # wait for gst to end
3167 wait
"$gstpid
"
3168 </pre
></blockquote
>
3170 <p
>I hope you find the approach useful. I know I do.
</p
>
3172 <p
>As usual, if you use Bitcoin and want to show your support of my
3173 activities, please send Bitcoin donations to my address
3174 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3179 <title>Streaming the Linux desktop to Kodi using VLC and RTSP
</title>
3180 <link>http://www.hungry.com/~pere/blog/Streaming_the_Linux_desktop_to_Kodi_using_VLC_and_RTSP.html
</link>
3181 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Streaming_the_Linux_desktop_to_Kodi_using_VLC_and_RTSP.html
</guid>
3182 <pubDate>Thu,
12 Jul
2018 02:
00:
00 +
0200</pubDate>
3183 <description><p
>PS: See
3184 <ahref=
"http://www.hungry.com/~pere/blog/Simple_streaming_the_Linux_desktop_to_Kodi_using_GStreamer_and_RTP.html
">the
3185 followup post
</a
> for a even better approach.
</p
>
3187 <p
>A while back, I was asked by a friend how to stream the desktop to
3188 my projector connected to Kodi. I sadly had to admit that I had no
3189 idea, as it was a task I never had tried. Since then, I have been
3190 looking for a way to do so, preferable without much extra software to
3191 install on either side. Today I found a way that seem to kind of
3192 work. Not great, but it is a start.
</p
>
3194 <p
>I had a look at several approaches, for example
3195 <a href=
"https://github.com/mfoetsch/dlna_live_streaming
">using uPnP
3196 DLNA as described in
2011</a
>, but it required a uPnP server, fuse and
3197 local storage enough to store the stream locally. This is not going
3198 to work well for me, lacking enough free space, and it would
3199 impossible for my friend to get working.
</p
>
3201 <p
>Next, it occurred to me that perhaps I could use VLC to create a
3202 video stream that Kodi could play. Preferably using
3203 broadcast/multicast, to avoid having to change any setup on the Kodi
3204 side when starting such stream. Unfortunately, the only recipe I
3205 could find using multicast used the rtp protocol, and this protocol
3206 seem to not be supported by Kodi.
</p
>
3208 <p
>On the other hand, the rtsp protocol is working! Unfortunately I
3209 have to specify the IP address of the streaming machine in both the
3210 sending command and the file on the Kodi server. But it is showing my
3211 desktop, and thus allow us to have a shared look on the big screen at
3212 the programs I work on.
</p
>
3214 <p
>I did not spend much time investigating codeces. I combined the
3215 rtp and rtsp recipes from
3216 <a href=
"https://wiki.videolan.org/Documentation:Streaming_HowTo/Command_Line_Examples/
">the
3217 VLC Streaming HowTo/Command Line Examples
</a
>, and was able to get
3218 this working on the desktop/streaming end.
</p
>
3220 <blockquote
><pre
>
3221 vlc screen:// --sout \
3222 '#transcode{vcodec=mp4v,acodec=mpga,vb=
800,ab=
128}:rtp{dst=projector.local,port=
1234,sdp=rtsp://
192.168.11.4:
8080/test.sdp}
'
3223 </pre
></blockquote
>
3225 <p
>I ssh-ed into my Kodi box and created a file like this with the
3226 same IP address:
</p
>
3228 <blockquote
><pre
>
3229 echo rtsp://
192.168.11.4:
8080/test.sdp \
3230 > /storage/videos/screenstream.m3u
3231 </pre
></blockquote
>
3233 <p
>Note the
192.168.11.4 IP address is my desktops IP address. As far
3234 as I can tell the IP must be hardcoded for this to work. In other
3235 words, if someone elses machine is going to do the steaming, you have
3236 to update screenstream.m3u on the Kodi machine and adjust the vlc
3237 recipe. To get started, locate the file in Kodi and select the m3u
3238 file while the VLC stream is running. The desktop then show up in my
3239 big screen. :)
</p
>
3241 <p
>When using the same technique to stream a video file with audio,
3242 the audio quality is really bad. No idea if the problem is package
3243 loss or bad parameters for the transcode. I do not know VLC nor Kodi
3244 enough to tell.
</p
>
3246 <p
><strong
>Update
2018-
07-
12</strong
>: Johannes Schauer send me a few
3247 succestions and reminded me about an important step. The
"screen:
"
3248 input source is only available once the vlc-plugin-access-extra
3249 package is installed on Debian. Without it, you will see this error
3250 message:
"VLC is unable to open the MRL
'screen://
'. Check the log
3251 for details.
" He further found that it is possible to drop some parts
3252 of the VLC command line to reduce the amount of hardcoded information.
3253 It is also useful to consider using cvlc to avoid having the VLC
3254 window in the desktop view. In sum, this give us this command line on
3257 <blockquote
><pre
>
3258 cvlc screen:// --sout \
3259 '#transcode{vcodec=mp4v,acodec=mpga,vb=
800,ab=
128}:rtp{sdp=rtsp://:
8080/}
'
3260 </pre
></blockquote
>
3262 <p
>and this on the Kodi end
<p
>
3264 <blockquote
><pre
>
3265 echo rtsp://
192.168.11.4:
8080/ \
3266 > /storage/videos/screenstream.m3u
3267 </pre
></blockquote
>
3269 <p
>Still bad image quality, though. But I did discover that streaming
3270 a DVD using dvdsimple:///dev/dvd as the source had excellent video and
3271 audio quality, so I guess the issue is in the input or transcoding
3272 parts, not the rtsp part. I
've tried to change the vb and ab
3273 parameters to use more bandwidth, but it did not make a
3274 difference.
</p
>
3276 <p
>I further received a suggestion from Einar Haraldseid to try using
3277 gstreamer instead of VLC, and this proved to work great! He also
3278 provided me with the trick to get Kodi to use a multicast stream as
3279 its source. By using this monstrous oneliner, I can stream my desktop
3280 with good video quality in reasonable framerate to the
239.255.0.1
3281 multicast address on port
1234:
3283 <blockquote
><pre
>
3284 gst-launch-
1.0 ximagesrc use-damage=
0 ! video/x-raw,framerate=
30/
1 ! \
3285 videoconvert ! queue2 ! \
3286 x264enc bitrate=
8000 speed-preset=superfast tune=zerolatency qp-min=
30 \
3287 key-int-max=
15 bframes=
2 ! video/x-h264,profile=high ! queue2 ! \
3288 mpegtsmux alignment=
7 name=mux ! rndbuffersize max=
1316 min=
1316 ! \
3289 udpsink host=
239.255.0.1 port=
1234 ttl-mc=
1 auto-multicast=
1 sync=
0 \
3290 pulsesrc device=$(pactl list | grep -A2
'Source #
' | \
3291 grep
'Name: .*\.monitor$
' | cut -d
" " -f2|head -
1) ! \
3292 audioconvert ! queue2 ! avenc_aac ! queue2 ! mux.
3293 </pre
></blockquote
>
3295 <p
>and this on the Kodi end
<p
>
3297 <blockquote
><pre
>
3298 echo udp://@
239.255.0.1:
1234 \
3299 > /storage/videos/screenstream.m3u
3300 </pre
></blockquote
>
3302 <p
>Note the trick to pick a valid pulseaudio source. It might not
3303 pick the one you need. This approach will of course lead to trouble
3304 if more than one source uses the same multicast port and address.
3305 Note the ttl-mc=
1 setting, which limit the multicast packages to the
3306 local network. If the value is increased, your screen will be
3307 broadcasted further, one network
"hop
" for each increase (read up on
3308 multicast to learn more. :)!
</p
>
3310 <p
>Having cracked how to get Kodi to receive multicast streams, I
3311 could use this VLC command to stream to the same multicast address.
3312 The image quality is way better than the rtsp approach, but gstreamer
3313 seem to be doing a better job.
</p
>
3315 <blockquote
><pre
>
3316 cvlc screen:// --sout
'#transcode{vcodec=mp4v,acodec=mpga,vb=
800,ab=
128}:rtp{mux=ts,dst=
239.255.0.1,port=
1234,sdp=sap}
'
3317 </pre
></blockquote
>
3319 <p
>As usual, if you use Bitcoin and want to show your support of my
3320 activities, please send Bitcoin donations to my address
3321 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3326 <title>What is the most supported MIME type in Debian in
2018?
</title>
3327 <link>http://www.hungry.com/~pere/blog/What_is_the_most_supported_MIME_type_in_Debian_in_2018_.html
</link>
3328 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_is_the_most_supported_MIME_type_in_Debian_in_2018_.html
</guid>
3329 <pubDate>Mon,
9 Jul
2018 08:
05:
00 +
0200</pubDate>
3330 <description><p
>Five years ago,
3331 <a href=
"http://www.hungry.com/~pere/blog/What_is_the_most_supported_MIME_type_in_Debian_.html
">I
3332 measured what the most supported MIME type in Debian was
</a
>, by
3333 analysing the desktop files in all packages in the archive. Since
3334 then, the DEP-
11 AppStream system has been put into production, making
3335 the task a lot easier. This made me want to repeat the measurement,
3336 to see how much things changed. Here are the new numbers, for
3337 unstable only this time:
3339 <p
><strong
>Debian Unstable:
</strong
></p
>
3343 ----- -----------------------
3355 30 audio/x-vorbis+ogg
3356 29 image/x-portable-pixmap
3358 27 image/x-portable-bitmap
3360 26 application/x-ogg
3366 <p
>The list was created like this using a sid chroot:
"cat
3367 /var/lib/apt/lists/*sid*_dep11_Components-amd64.yml.gz| zcat | awk
'/^
3368 - \S+\/\S+$/ {print $
2 }
' | sort | uniq -c | sort -nr | head -
20"</p
>
3370 <p
>It is interesting to see how image formats have passed text/plain
3371 as the most announced supported MIME type. These days, thanks to the
3372 AppStream system, if you run into a file format you do not know, and
3373 want to figure out which packages support the format, you can find the
3374 MIME type of the file using
"file --mime
&lt;filename
&gt;
", and then
3375 look up all packages announcing support for this format in their
3376 AppStream metadata (XML or .desktop file) using
"appstreamcli
3377 what-provides mimetype
&lt;mime-type
&gt;. For example if you, like
3378 me, want to know which packages support inode/directory, you can get a
3379 list like this:
</p
>
3381 <p
><blockquote
><pre
>
3382 % appstreamcli what-provides mimetype inode/directory | grep Package: | sort
3389 Package: doublecmd-common
3391 Package: enlightenment
3411 </pre
></blockquote
></p
>
3413 <p
>Using the same method, I can quickly discover that the Sketchup file
3414 format is not yet supported by any package in Debian:
</p
>
3416 <p
><blockquote
><pre
>
3417 % appstreamcli what-provides mimetype application/vnd.sketchup.skp
3418 Could not find component providing
'mimetype::application/vnd.sketchup.skp
'.
3420 </pre
></blockquote
></p
>
3422 <p
>Yesterday I used it to figure out which packages support the STL
3D
3425 <p
><blockquote
><pre
>
3426 % appstreamcli what-provides mimetype application/sla|grep Package
3431 </pre
></blockquote
></p
>
3433 <p
>PS: A new version of Cura was uploaded to Debian yesterday.
</p
>
3435 <p
>As usual, if you use Bitcoin and want to show your support of my
3436 activities, please send Bitcoin donations to my address
3437 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3442 <title>Debian APT upgrade without enough free space on the disk...
</title>
3443 <link>http://www.hungry.com/~pere/blog/Debian_APT_upgrade_without_enough_free_space_on_the_disk___.html
</link>
3444 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_APT_upgrade_without_enough_free_space_on_the_disk___.html
</guid>
3445 <pubDate>Sun,
8 Jul
2018 12:
10:
00 +
0200</pubDate>
3446 <description><p
>Quite regularly, I let my Debian Sid/Unstable chroot stay untouch
3447 for a while, and when I need to update it there is not enough free
3448 space on the disk for apt to do a normal
'apt upgrade
'. I normally
3449 would resolve the issue by doing
'apt install
&lt;somepackages
&gt;
' to
3450 upgrade only some of the packages in one batch, until the amount of
3451 packages to download fall below the amount of free space available.
3452 Today, I had about
500 packages to upgrade, and after a while I got
3453 tired of trying to install chunks of packages manually. I concluded
3454 that I did not have the spare hours required to complete the task, and
3455 decided to see if I could automate it. I came up with this small
3456 script which I call
'apt-in-chunks
':
</p
>
3458 <p
><blockquote
><pre
>
3461 # Upgrade packages when the disk is too full to upgrade every
3462 # upgradable package in one lump. Fetching packages to upgrade using
3463 # apt, and then installing using dpkg, to avoid changing the package
3464 # flag for manual/automatic.
3469 if [
"$
1" ]; then
3470 grep -v
"$
1"
3476 for p in $(apt list --upgradable | ignore
"$@
" |cut -d/ -f1 | grep -v
'^Listing...
'); do
3477 echo
"Upgrading $p
"
3479 apt install --download-only -y $p
3480 for f in /var/cache/apt/archives/*.deb; do
3481 if [ -e
"$f
" ]; then
3482 dpkg -i /var/cache/apt/archives/*.deb
3487 </pre
></blockquote
></p
>
3489 <p
>The script will extract the list of packages to upgrade, try to
3490 download the packages needed to upgrade one package, install the
3491 downloaded packages using dpkg. The idea is to upgrade packages
3492 without changing the APT mark for the package (ie the one recording of
3493 the package was manually requested or pulled in as a dependency). To
3494 use it, simply run it as root from the command line. If it fail, try
3495 'apt install -f
' to clean up the mess and run the script again. This
3496 might happen if the new packages conflict with one of the old
3497 packages. dpkg is unable to remove, while apt can do this.
</p
>
3499 <p
>It take one option, a package to ignore in the list of packages to
3500 upgrade. The option to ignore a package is there to be able to skip
3501 the packages that are simply too large to unpack. Today this was
3502 'ghc
', but I have run into other large packages causing similar
3503 problems earlier (like TeX).
</p
>
3505 <p
>Update
2018-
07-
08: Thanks to Paul Wise, I am aware of two
3506 alternative ways to handle this. The
"unattended-upgrades
3507 --minimal-upgrade-steps
" option will try to calculate upgrade sets for
3508 each package to upgrade, and then upgrade them in order, smallest set
3509 first. It might be a better option than my above mentioned script.
3510 Also,
"aptutude upgrade
" can upgrade single packages, thus avoiding
3511 the need for using
"dpkg -i
" in the script above.
</p
>
3513 <p
>As usual, if you use Bitcoin and want to show your support of my
3514 activities, please send Bitcoin donations to my address
3515 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3520 <title>Version
3.1 of Cura, the
3D print slicer, is now in Debian
</title>
3521 <link>http://www.hungry.com/~pere/blog/Version_3_1_of_Cura__the_3D_print_slicer__is_now_in_Debian.html
</link>
3522 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Version_3_1_of_Cura__the_3D_print_slicer__is_now_in_Debian.html
</guid>
3523 <pubDate>Tue,
13 Feb
2018 06:
20:
00 +
0100</pubDate>
3524 <description><p
>A new version of the
3525 <a href=
"https://tracker.debian.org/pkg/cura
">3D printer slicer
3526 software Cura
</a
>, version
3.1.0, is now available in Debian Testing
3527 (aka Buster) and Debian Unstable (aka Sid). I hope you find it
3528 useful. It was uploaded the last few days, and the last update will
3529 enter testing tomorrow. See the
3530 <a href=
"https://ultimaker.com/en/products/cura-software/release-notes
">release
3531 notes
</a
> for the list of bug fixes and new features. Version
3.2
3532 was announced
6 days ago. We will try to get it into Debian as
3535 <p
>More information related to
3D printing is available on the
3536 <a href=
"https://wiki.debian.org/
3DPrinting
">3D printing
</a
> and
3537 <a href=
"https://wiki.debian.org/
3D-printer
">3D printer
</a
> wiki pages
3538 in Debian.
</p
>
3540 <p
>As usual, if you use Bitcoin and want to show your support of my
3541 activities, please send Bitcoin donations to my address
3542 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3547 <title>Cura, the nice
3D print slicer, is now in Debian Unstable
</title>
3548 <link>http://www.hungry.com/~pere/blog/Cura__the_nice_3D_print_slicer__is_now_in_Debian_Unstable.html
</link>
3549 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Cura__the_nice_3D_print_slicer__is_now_in_Debian_Unstable.html
</guid>
3550 <pubDate>Sun,
17 Dec
2017 07:
00:
00 +
0100</pubDate>
3551 <description><p
>After several months of working and waiting, I am happy to report
3552 that the nice and user friendly
3D printer slicer software Cura just
3553 entered Debian Unstable. It consist of five packages,
3554 <a href=
"https://tracker.debian.org/pkg/cura
">cura
</a
>,
3555 <a href=
"https://tracker.debian.org/pkg/cura-engine
">cura-engine
</a
>,
3556 <a href=
"https://tracker.debian.org/pkg/libarcus
">libarcus
</a
>,
3557 <a href=
"https://tracker.debian.org/pkg/fdm-materials
">fdm-materials
</a
>,
3558 <a href=
"https://tracker.debian.org/pkg/libsavitar
">libsavitar
</a
> and
3559 <a href=
"https://tracker.debian.org/pkg/uranium
">uranium
</a
>. The last
3560 two, uranium and cura, entered Unstable yesterday. This should make
3561 it easier for Debian users to print on at least the Ultimaker class of
3562 3D printers. My nearest
3D printer is an Ultimaker
2+, so it will
3563 make life easier for at least me. :)
</p
>
3565 <p
>The work to make this happen was done by Gregor Riepl, and I was
3566 happy to assist him in sponsoring the packages. With the introduction
3567 of Cura, Debian is up to three
3D printer slicers at your service,
3568 Cura, Slic3r and Slic3r Prusa. If you own or have access to a
3D
3569 printer, give it a go. :)
</p
>
3571 <p
>The
3D printer software is maintained by the
3D printer Debian
3572 team, flocking together on the
3573 <a href=
"http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/
3dprinter-general
">3dprinter-general
</a
>
3574 mailing list and the
3575 <a href=
"irc://irc.debian.org/#debian-
3dprinting
">#debian-
3dprinting
</a
>
3576 IRC channel.
</p
>
3578 <p
>The next step for Cura in Debian is to update the cura package to
3579 version
3.0.3 and then update the entire set of packages to version
3580 3.1.0 which showed up the last few days.
</p
>
3585 <title>Generating
3D prints in Debian using Cura and Slic3r(-prusa)
</title>
3586 <link>http://www.hungry.com/~pere/blog/Generating_3D_prints_in_Debian_using_Cura_and_Slic3r__prusa_.html
</link>
3587 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Generating_3D_prints_in_Debian_using_Cura_and_Slic3r__prusa_.html
</guid>
3588 <pubDate>Mon,
9 Oct
2017 10:
50:
00 +
0200</pubDate>
3589 <description><p
>At my nearby maker space,
3590 <a href=
"http://sonen.ifi.uio.no/
">Sonen
</a
>, I heard the story that it
3591 was easier to generate gcode files for theyr
3D printers (Ultimake
2+)
3592 on Windows and MacOS X than Linux, because the software involved had
3593 to be manually compiled and set up on Linux while premade packages
3594 worked out of the box on Windows and MacOS X. I found this annoying,
3595 as the software involved,
3596 <a href=
"https://github.com/Ultimaker/Cura
">Cura
</a
>, is free software
3597 and should be trivial to get up and running on Linux if someone took
3598 the time to package it for the relevant distributions. I even found
3599 <a href=
"https://bugs.debian.org/
706656">a request for adding into
3600 Debian
</a
> from
2013, which had seem some activity over the years but
3601 never resulted in the software showing up in Debian. So a few days
3602 ago I offered my help to try to improve the situation.
</p
>
3604 <p
>Now I am very happy to see that all the packages required by a
3605 working Cura in Debian are uploaded into Debian and waiting in the NEW
3606 queue for the ftpmasters to have a look. You can track the progress
3608 <a href=
"https://qa.debian.org/developer.php?email=
3dprinter-general%
40lists.alioth.debian.org
">the
3609 status page for the
3D printer team
</a
>.
</p
>
3611 <p
>The uploaded packages are a bit behind upstream, and was uploaded
3612 now to get slots in
<a href=
"https://ftp-master.debian.org/new.html
">the NEW
3613 queue
</a
> while we work up updating the packages to the latest
3614 upstream version.
</p
>
3616 <p
>On a related note, two competitors for Cura, which I found harder
3617 to use and was unable to configure correctly for Ultimaker
2+ in the
3618 short time I spent on it, are already in Debian. If you are looking
3619 for
3D printer
"slicers
" and want something already available in
3621 <a href=
"https://tracker.debian.org/pkg/slic3r
">slic3r
</a
> and
3622 <a href=
"https://tracker.debian.org/pkg/slic3r-prusa
">slic3r-prusa
</a
>.
3623 The latter is a fork of the former.
</p
>
3625 <p
>As usual, if you use Bitcoin and want to show your support of my
3626 activities, please send Bitcoin donations to my address
3627 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
3632 <title>Visualizing GSM radio chatter using gr-gsm and Hopglass
</title>
3633 <link>http://www.hungry.com/~pere/blog/Visualizing_GSM_radio_chatter_using_gr_gsm_and_Hopglass.html
</link>
3634 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Visualizing_GSM_radio_chatter_using_gr_gsm_and_Hopglass.html
</guid>
3635 <pubDate>Fri,
29 Sep
2017 10:
30:
00 +
0200</pubDate>
3636 <description><p
>Every mobile phone announce its existence over radio to the nearby
3637 mobile cell towers. And this radio chatter is available for anyone
3638 with a radio receiver capable of receiving them. Details about the
3639 mobile phones with very good accuracy is of course collected by the
3640 phone companies, but this is not the topic of this blog post. The
3641 mobile phone radio chatter make it possible to figure out when a cell
3642 phone is nearby, as it include the SIM card ID (IMSI). By paying
3643 attention over time, one can see when a phone arrive and when it leave
3644 an area. I believe it would be nice to make this information more
3645 available to the general public, to make more people aware of how
3646 their phones are announcing their whereabouts to anyone that care to
3649 <p
>I am very happy to report that we managed to get something
3650 visualizing this information up and running for
3651 <a href=
"http://norwaymakers.org/osf17
">Oslo Skaperfestival
2017</a
>
3652 (Oslo Makers Festival) taking place today and tomorrow at Deichmanske
3653 library. The solution is based on the
3654 <a href=
"http://www.hungry.com/~pere/blog/Easier_recipe_to_observe_the_cell_phones_around_you.html
">simple
3655 recipe for listening to GSM chatter
</a
> I posted a few days ago, and
3656 will show up at the stand of
<a href=
"http://sonen.ifi.uio.no/
">Åpen
3657 Sone from the Computer Science department of the University of
3658 Oslo
</a
>. The presentation will show the nearby mobile phones (aka
3659 IMSIs) as dots in a web browser graph, with lines to the dot
3660 representing mobile base station it is talking to. It was working in
3661 the lab yesterday, and was moved into place this morning.
</p
>
3663 <p
>We set up a fairly powerful desktop machine using Debian
3664 Buster/Testing with several (five, I believe) RTL2838 DVB-T receivers
3665 connected and visualize the visible cell phone towers using an
3666 <a href=
"https://github.com/marlow925/hopglass
">English version of
3667 Hopglass
</a
>. A fairly powerfull machine is needed as the
3668 grgsm_livemon_headless processes from
3669 <a href=
"https://tracker.debian.org/pkg/gr-gsm
">gr-gsm
</a
> converting
3670 the radio signal to data packages is quite CPU intensive.
</p
>
3672 <p
>The frequencies to listen to, are identified using a slightly
3673 patched scan-and-livemon (to set the --args values for each receiver),
3674 and the Hopglass data is generated using the
3675 <a href=
"https://github.com/petterreinholdtsen/IMSI-catcher/tree/meshviewer-output
">patches
3676 in my meshviewer-output branch
</a
>. For some reason we could not get
3677 more than four SDRs working. There is also a geographical map trying
3678 to show the location of the base stations, but I believe their
3679 coordinates are hardcoded to some random location in Germany, I
3680 believe. The code should be replaced with code to look up location in
3681 a text file, a sqlite database or one of the online databases
3683 <a href=
"https://github.com/Oros42/IMSI-catcher/issues/
14">the github
3684 issue for the topic
</a
>.
3686 <p
>If this sound interesting, visit the stand at the festival!
</p
>
3691 <title>Easier recipe to observe the cell phones around you
</title>
3692 <link>http://www.hungry.com/~pere/blog/Easier_recipe_to_observe_the_cell_phones_around_you.html
</link>
3693 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Easier_recipe_to_observe_the_cell_phones_around_you.html
</guid>
3694 <pubDate>Sun,
24 Sep
2017 08:
30:
00 +
0200</pubDate>
3695 <description><p
>A little more than a month ago I wrote
3696 <a href=
"http://www.hungry.com/~pere/blog/Simpler_recipe_on_how_to_make_a_simple__7_IMSI_Catcher_using_Debian.html
">how
3697 to observe the SIM card ID (aka IMSI number) of mobile phones talking
3698 to nearby mobile phone base stations using Debian GNU/Linux and a
3699 cheap USB software defined radio
</a
>, and thus being able to pinpoint
3700 the location of people and equipment (like cars and trains) with an
3701 accuracy of a few kilometer. Since then we have worked to make the
3702 procedure even simpler, and it is now possible to do this without any
3703 manual frequency tuning and without building your own packages.
</p
>
3705 <p
>The
<a href=
"https://tracker.debian.org/pkg/gr-gsm
">gr-gsm
</a
>
3706 package is now included in Debian testing and unstable, and the
3707 IMSI-catcher code no longer require root access to fetch and decode
3708 the GSM data collected using gr-gsm.
</p
>
3710 <p
>Here is an updated recipe, using packages built by Debian and a git
3711 clone of two python scripts:
</p
>
3715 <li
>Start with a Debian machine running the Buster version (aka
3716 testing).
</li
>
3718 <li
>Run
'<tt
>apt install gr-gsm python-numpy python-scipy
3719 python-scapy
</tt
>' as root to install required packages.
</li
>
3721 <li
>Fetch the code decoding GSM packages using
'<tt
>git clone
3722 github.com/Oros42/IMSI-catcher.git
</tt
>'.
</li
>
3724 <li
>Insert USB software defined radio supported by GNU Radio.
</li
>
3726 <li
>Enter the IMSI-catcher directory and run
'<tt
>python
3727 scan-and-livemon
</tt
>' to locate the frequency of nearby base
3728 stations and start listening for GSM packages on one of them.
</li
>
3730 <li
>Enter the IMSI-catcher directory and run
'<tt
>python
3731 simple_IMSI-catcher.py
</tt
>' to display the collected information.
</li
>
3735 <p
>Note, due to a bug somewhere the scan-and-livemon program (actually
3736 <a href=
"https://github.com/ptrkrysik/gr-gsm/issues/
336">its underlying
3737 program grgsm_scanner
</a
>) do not work with the HackRF radio. It does
3738 work with RTL
8232 and other similar USB radio receivers you can get
3740 (
<a href=
"https://www.ebay.com/sch/items/?_nkw=rtl+
2832">for example
3741 from ebay
</a
>), so for now the solution is to scan using the RTL radio
3742 and only use HackRF for fetching GSM data.
</p
>
3744 <p
>As far as I can tell, a cell phone only show up on one of the
3745 frequencies at the time, so if you are going to track and count every
3746 cell phone around you, you need to listen to all the frequencies used.
3747 To listen to several frequencies, use the --numrecv argument to
3748 scan-and-livemon to use several receivers. Further, I am not sure if
3749 phones using
3G or
4G will show as talking GSM to base stations, so
3750 this approach might not see all phones around you. I typically see
3751 0-
400 IMSI numbers an hour when looking around where I live.
</p
>
3753 <p
>I
've tried to run the scanner on a
3754 <a href=
"https://wiki.debian.org/RaspberryPi
">Raspberry Pi
2 and
3
3755 running Debian Buster
</a
>, but the grgsm_livemon_headless process seem
3756 to be too CPU intensive to keep up. When GNU Radio print
'O
' to
3757 stdout, I am told there it is caused by a buffer overflow between the
3758 radio and GNU Radio, caused by the program being unable to read the
3759 GSM data fast enough. If you see a stream of
'O
's from the terminal
3760 where you started scan-and-livemon, you need a give the process more
3761 CPU power. Perhaps someone are able to optimize the code to a point
3762 where it become possible to set up RPi3 based GSM sniffers? I tried
3763 using Raspbian instead of Debian, but there seem to be something wrong
3764 with GNU Radio on raspbian, causing glibc to abort().
</p
>
3769 <title>Simpler recipe on how to make a simple $
7 IMSI Catcher using Debian
</title>
3770 <link>http://www.hungry.com/~pere/blog/Simpler_recipe_on_how_to_make_a_simple__7_IMSI_Catcher_using_Debian.html
</link>
3771 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Simpler_recipe_on_how_to_make_a_simple__7_IMSI_Catcher_using_Debian.html
</guid>
3772 <pubDate>Wed,
9 Aug
2017 23:
59:
00 +
0200</pubDate>
3773 <description><p
>On friday, I came across an interesting article in the Norwegian
3774 web based ICT news magazine digi.no on
3775 <a href=
"https://www.digi.no/artikler/sikkerhetsforsker-lagde-enkel-imsi-catcher-for-
60-kroner-na-kan-mobiler-kartlegges-av-alle/
398588">how
3776 to collect the IMSI numbers of nearby cell phones
</a
> using the cheap
3777 DVB-T software defined radios. The article refered to instructions
3778 and
<a href=
"https://www.youtube.com/watch?v=UjwgNd_as30
">a recipe by
3779 Keld Norman on Youtube on how to make a simple $
7 IMSI Catcher
</a
>, and I decided to test them out.
</p
>
3781 <p
>The instructions said to use Ubuntu, install pip using apt (to
3782 bypass apt), use pip to install pybombs (to bypass both apt and pip),
3783 and the ask pybombs to fetch and build everything you need from
3784 scratch. I wanted to see if I could do the same on the most recent
3785 Debian packages, but this did not work because pybombs tried to build
3786 stuff that no longer build with the most recent openssl library or
3787 some other version skew problem. While trying to get this recipe
3788 working, I learned that the apt-
>pip-
>pybombs route was a long detour,
3789 and the only piece of software dependency missing in Debian was the
3790 gr-gsm package. I also found out that the lead upstream developer of
3791 gr-gsm (the name stand for GNU Radio GSM) project already had a set of
3792 Debian packages provided in an Ubuntu PPA repository. All I needed to
3793 do was to dget the Debian source package and built it.
</p
>
3795 <p
>The IMSI collector is a python script listening for packages on the
3796 loopback network device and printing to the terminal some specific GSM
3797 packages with IMSI numbers in them. The code is fairly short and easy
3798 to understand. The reason this work is because gr-gsm include a tool
3799 to read GSM data from a software defined radio like a DVB-T USB stick
3800 and other software defined radios, decode them and inject them into a
3801 network device on your Linux machine (using the loopback device by
3802 default). This proved to work just fine, and I
've been testing the
3803 collector for a few days now.
</p
>
3805 <p
>The updated and simpler recipe is thus to
</p
>
3809 <li
>start with a Debian machine running Stretch or newer,
</li
>
3811 <li
>build and install the gr-gsm package available from
3812 <a href=
"http://ppa.launchpad.net/ptrkrysik/gr-gsm/ubuntu/pool/main/g/gr-gsm/
">http://ppa.launchpad.net/ptrkrysik/gr-gsm/ubuntu/pool/main/g/gr-gsm/
</a
>,
</li
>
3814 <li
>clone the git repostory from
<a href=
"https://github.com/Oros42/IMSI-catcher
">https://github.com/Oros42/IMSI-catcher
</a
>,
</li
>
3816 <li
>run grgsm_livemon and adjust the frequency until the terminal
3817 where it was started is filled with a stream of text (meaning you
3818 found a GSM station).
</li
>
3820 <li
>go into the IMSI-catcher directory and run
'sudo python simple_IMSI-catcher.py
' to extract the IMSI numbers.
</li
>
3824 <p
>To make it even easier in the future to get this sniffer up and
3825 running, I decided to package
3826 <a href=
"https://github.com/ptrkrysik/gr-gsm/
">the gr-gsm project
</a
>
3827 for Debian (
<a href=
"https://bugs.debian.org/
871055">WNPP
3828 #
871055</a
>), and the package was uploaded into the NEW queue today.
3829 Luckily the gnuradio maintainer has promised to help me, as I do not
3830 know much about gnuradio stuff yet.
</p
>
3832 <p
>I doubt this
"IMSI cacher
" is anywhere near as powerfull as
3833 commercial tools like
3834 <a href=
"https://www.thespyphone.com/portable-imsi-imei-catcher/
">The
3835 Spy Phone Portable IMSI / IMEI Catcher
</a
> or the
3836 <a href=
"https://en.wikipedia.org/wiki/Stingray_phone_tracker
">Harris
3837 Stingray
</a
>, but I hope the existance of cheap alternatives can make
3838 more people realise how their whereabouts when carrying a cell phone
3839 is easily tracked. Seeing the data flow on the screen, realizing that
3840 I live close to a police station and knowing that the police is also
3841 wearing cell phones, I wonder how hard it would be for criminals to
3842 track the position of the police officers to discover when there are
3843 police near by, or for foreign military forces to track the location
3844 of the Norwegian military forces, or for anyone to track the location
3845 of government officials...
</p
>
3847 <p
>It is worth noting that the data reported by the IMSI-catcher
3848 script mentioned above is only a fraction of the data broadcasted on
3849 the GSM network. It will only collect one frequency at the time,
3850 while a typical phone will be using several frequencies, and not all
3851 phones will be using the frequencies tracked by the grgsm_livemod
3852 program. Also, there is a lot of radio chatter being ignored by the
3853 simple_IMSI-catcher script, which would be collected by extending the
3854 parser code. I wonder if gr-gsm can be set up to listen to more than
3855 one frequency?
</p
>
3860 <title>Norwegian Bokmål edition of Debian Administrator
's Handbook is now available
</title>
3861 <link>http://www.hungry.com/~pere/blog/Norwegian_Bokm_l_edition_of_Debian_Administrator_s_Handbook_is_now_available.html
</link>
3862 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Norwegian_Bokm_l_edition_of_Debian_Administrator_s_Handbook_is_now_available.html
</guid>
3863 <pubDate>Tue,
25 Jul
2017 21:
10:
00 +
0200</pubDate>
3864 <description><p align=
"center
"><img align=
"center
" src=
"http://www.hungry.com/~pere/blog/images/
2017-
07-
25-debian-handbook-nb-testprint.png
"/
></p
>
3866 <p
>I finally received a copy of the Norwegian Bokmål edition of
3867 "<a href=
"https://debian-handbook.info/
">The Debian Administrator
's
3868 Handbook
</a
>". This test copy arrived in the mail a few days ago, and
3869 I am very happy to hold the result in my hand. We spent around one and a half year translating it. This paperbook edition
3870 <a href=
"https://debian-handbook.info/get/#norwegian
">is available
3871 from lulu.com
</a
>. If you buy it quickly, you save
25% on the list
3872 price. The book is also available for download in electronic form as
3873 PDF, EPUB and Mobipocket, as can be
3874 <a href=
"https://debian-handbook.info/browse/nb-NO/stable/
">read online
3875 as a web page
</a
>.
</p
>
3877 <p
>This is the second book I publish (the first was the book
3878 "<a href=
"http://free-culture.cc/
">Free Culture
</a
>" by Lawrence Lessig
3880 <a href=
"http://www.lulu.com/shop/lawrence-lessig/free-culture/paperback/product-
22440520.html
">English
</a
>,
3881 <a href=
"http://www.lulu.com/shop/lawrence-lessig/culture-libre/paperback/product-
22645082.html
">French
</a
>
3883 <a href=
"http://www.lulu.com/shop/lawrence-lessig/fri-kultur/paperback/product-
22441576.html
">Norwegian
3884 Bokmål
</a
>), and I am very excited to finally wrap up this
3886 "<a href=
"http://www.lulu.com/shop/rapha%C3%ABl-hertzog-and-roland-mas/h%C3%A5ndbok-for-debian-administratoren/paperback/product-
23262290.html
">Håndbok
3887 for Debian-administratoren
</a
>" will be well received.
</p
>
3892 <title>Når nynorskoversettelsen svikter til eksamen...
</title>
3893 <link>http://www.hungry.com/~pere/blog/N_r_nynorskoversettelsen_svikter_til_eksamen___.html
</link>
3894 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/N_r_nynorskoversettelsen_svikter_til_eksamen___.html
</guid>
3895 <pubDate>Sat,
3 Jun
2017 08:
20:
00 +
0200</pubDate>
3896 <description><p
><a href=
"http://www.aftenposten.no/norge/Krever-at-elever-ma-fa-annullert-eksamen-etter-rot-med-oppgavetekster-
622459b.html
">Aftenposten
3897 melder i dag
</a
> om feil i eksamensoppgavene for eksamen i politikk og
3898 menneskerettigheter, der teksten i bokmåls og nynorskutgaven ikke var
3899 like. Oppgaveteksten er gjengitt i artikkelen, og jeg ble nysgjerring
3900 på om den fri oversetterløsningen
3901 <a href=
"https://www.apertium.org/
">Apertium
</a
> ville gjort en bedre
3902 jobb enn Utdanningsdirektoratet. Det kan se slik ut.
</p
>
3904 <p
>Her er bokmålsoppgaven fra eksamenen:
</p
>
3907 <p
>Drøft utfordringene knyttet til nasjonalstatenes og andre aktørers
3908 rolle og muligheter til å håndtere internasjonale utfordringer, som
3909 for eksempel flykningekrisen.
</p
>
3911 <p
>Vedlegge er eksempler på tekster som kan gi relevante perspektiver
3912 på temaet:
</p
>
3914 <li
>Flykningeregnskapet
2016, UNHCR og IDMC
3915 <li
>«Grenseløst Europa for fall» A-Magasinet,
26. november
2015
3920 <p
>Dette oversetter Apertium slik:
</p
>
3923 <p
>Drøft utfordringane knytte til nasjonalstatane sine og rolla til
3924 andre aktørar og høve til å handtera internasjonale utfordringar, som
3925 til dømes *flykningekrisen.
</p
>
3927 <p
>Vedleggja er døme på tekster som kan gje relevante perspektiv på
3931 <li
>*Flykningeregnskapet
2016, *UNHCR og *IDMC
</li
>
3932 <li
>«*Grenseløst Europa for fall» A-Magasinet,
26. november
2015</li
>
3937 <p
>Ord som ikke ble forstått er markert med stjerne (*), og trenger
3938 ekstra språksjekk. Men ingen ord er forsvunnet, slik det var i
3939 oppgaven elevene fikk presentert på eksamen. Jeg mistenker dog at
3940 "andre aktørers rolle og muligheter til ...
" burde vært oversatt til
3941 "rolla til andre aktørar og deira høve til ...
" eller noe slikt, men
3942 det er kanskje flisespikking. Det understreker vel bare at det alltid
3943 trengs korrekturlesning etter automatisk oversettelse.
</p
>
3948 <title>Detecting NFS hangs on Linux without hanging yourself...
</title>
3949 <link>http://www.hungry.com/~pere/blog/Detecting_NFS_hangs_on_Linux_without_hanging_yourself___.html
</link>
3950 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Detecting_NFS_hangs_on_Linux_without_hanging_yourself___.html
</guid>
3951 <pubDate>Thu,
9 Mar
2017 15:
20:
00 +
0100</pubDate>
3952 <description><p
>Over the years, administrating thousand of NFS mounting linux
3953 computers at the time, I often needed a way to detect if the machine
3954 was experiencing NFS hang. If you try to use
<tt
>df
</tt
> or look at a
3955 file or directory affected by the hang, the process (and possibly the
3956 shell) will hang too. So you want to be able to detect this without
3957 risking the detection process getting stuck too. It has not been
3958 obvious how to do this. When the hang has lasted a while, it is
3959 possible to find messages like these in dmesg:
</p
>
3961 <p
><blockquote
>
3962 nfs: server nfsserver not responding, still trying
3963 <br
>nfs: server nfsserver OK
3964 </blockquote
></p
>
3966 <p
>It is hard to know if the hang is still going on, and it is hard to
3967 be sure looking in dmesg is going to work. If there are lots of other
3968 messages in dmesg the lines might have rotated out of site before they
3969 are noticed.
</p
>
3971 <p
>While reading through the nfs client implementation in linux kernel
3972 code, I came across some statistics that seem to give a way to detect
3973 it. The om_timeouts sunrpc value in the kernel will increase every
3974 time the above log entry is inserted into dmesg. And after digging a
3975 bit further, I discovered that this value show up in
3976 /proc/self/mountstats on Linux.
</p
>
3978 <p
>The mountstats content seem to be shared between files using the
3979 same file system context, so it is enough to check one of the
3980 mountstats files to get the state of the mount point for the machine.
3981 I assume this will not show lazy umounted NFS points, nor NFS mount
3982 points in a different process context (ie with a different filesystem
3983 view), but that does not worry me.
</p
>
3985 <p
>The content for a NFS mount point look similar to this:
</p
>
3987 <p
><blockquote
><pre
>
3989 device /dev/mapper/Debian-var mounted on /var with fstype ext3
3990 device nfsserver:/mnt/nfsserver/home0 mounted on /mnt/nfsserver/home0 with fstype nfs statvers=
1.1
3991 opts: rw,vers=
3,rsize=
65536,wsize=
65536,namlen=
255,acregmin=
3,acregmax=
60,acdirmin=
30,acdirmax=
60,soft,nolock,proto=tcp,timeo=
600,retrans=
2,sec=sys,mountaddr=
129.240.3.145,mountvers=
3,mountport=
4048,mountproto=udp,local_lock=all
3993 caps: caps=
0x3fe7,wtmult=
4096,dtsize=
8192,bsize=
0,namlen=
255
3994 sec: flavor=
1,pseudoflavor=
1
3995 events:
61063112 732346265 1028140 35486205 16220064 8162542 761447191 71714012 37189 3891185 45561809 110486139 4850138 420353 15449177 296502 52736725 13523379 0 52182 9016896 1231 0 0 0 0 0
3996 bytes:
166253035039 219519120027 0 0 40783504807 185466229638 11677877 45561809
3997 RPC iostats version:
1.0 p/v:
100003/
3 (nfs)
3998 xprt: tcp
925 1 6810 0 0 111505412 111480497 109 2672418560317 0 248 53869103 22481820
4000 NULL:
0 0 0 0 0 0 0 0
4001 GETATTR:
61063106 61063108 0 9621383060 6839064400 453650 77291321 78926132
4002 SETATTR:
463469 463470 0 92005440 66739536 63787 603235 687943
4003 LOOKUP:
17021657 17021657 0 3354097764 4013442928 57216 35125459 35566511
4004 ACCESS:
14281703 14290009 5 2318400592 1713803640 1709282 4865144 7130140
4005 READLINK:
125 125 0 20472 18620 0 1112 1118
4006 READ:
4214236 4214237 0 715608524 41328653212 89884 22622768 22806693
4007 WRITE:
8479010 8494376 22 187695798568 1356087148 178264904 51506907 231671771
4008 CREATE:
171708 171708 0 38084748 46702272 873 1041833 1050398
4009 MKDIR:
3680 3680 0 773980 993920 26 23990 24245
4010 SYMLINK:
903 903 0 233428 245488 6 5865 5917
4011 MKNOD:
80 80 0 20148 21760 0 299 304
4012 REMOVE:
429921 429921 0 79796004 61908192 3313 2710416 2741636
4013 RMDIR:
3367 3367 0 645112 484848 22 5782 6002
4014 RENAME:
466201 466201 0 130026184 121212260 7075 5935207 5961288
4015 LINK:
289155 289155 0 72775556 67083960 2199 2565060 2585579
4016 READDIR:
2933237 2933237 0 516506204 13973833412 10385 3190199 3297917
4017 READDIRPLUS:
1652839 1652839 0 298640972 6895997744 84735 14307895 14448937
4018 FSSTAT:
6144 6144 0 1010516 1032192 51 9654 10022
4019 FSINFO:
2 2 0 232 328 0 1 1
4020 PATHCONF:
1 1 0 116 140 0 0 0
4021 COMMIT:
0 0 0 0 0 0 0 0
4023 device binfmt_misc mounted on /proc/sys/fs/binfmt_misc with fstype binfmt_misc
4025 </pre
></blockquote
></p
>
4027 <p
>The key number to look at is the third number in the per-op list.
4028 It is the number of NFS timeouts experiences per file system
4029 operation. Here
22 write timeouts and
5 access timeouts. If these
4030 numbers are increasing, I believe the machine is experiencing NFS
4031 hang. Unfortunately the timeout value do not start to increase right
4032 away. The NFS operations need to time out first, and this can take a
4033 while. The exact timeout value depend on the setup. For example the
4034 defaults for TCP and UDP mount points are quite different, and the
4035 timeout value is affected by the soft, hard, timeo and retrans NFS
4036 mount options.
</p
>
4038 <p
>The only way I have been able to get working on Debian and RedHat
4039 Enterprise Linux for getting the timeout count is to peek in /proc/.
4041 <ahref=
"http://docs.oracle.com/cd/E19253-
01/
816-
4555/netmonitor-
12/index.html
">Solaris
4042 10 System Administration Guide: Network Services
</a
>, the
'nfsstat -c
'
4043 command can be used to get these timeout values. But this do not work
4044 on Linux, as far as I can tell. I
4045 <ahref=
"http://bugs.debian.org/
857043">asked Debian about this
</a
>,
4046 but have not seen any replies yet.
</p
>
4048 <p
>Is there a better way to figure out if a Linux NFS client is
4049 experiencing NFS hangs? Is there a way to detect which processes are
4050 affected? Is there a way to get the NFS mount going quickly once the
4051 network problem causing the NFS hang has been cleared? I would very
4052 much welcome some clues, as we regularly run into NFS hangs.
</p
>
4057 <title>Norwegian Bokmål translation of The Debian Administrator
's Handbook complete, proofreading in progress
</title>
4058 <link>http://www.hungry.com/~pere/blog/Norwegian_Bokm_l_translation_of_The_Debian_Administrator_s_Handbook_complete__proofreading_in_progress.html
</link>
4059 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Norwegian_Bokm_l_translation_of_The_Debian_Administrator_s_Handbook_complete__proofreading_in_progress.html
</guid>
4060 <pubDate>Fri,
3 Mar
2017 14:
50:
00 +
0100</pubDate>
4061 <description><p
>For almost a year now, we have been working on making a Norwegian
4062 Bokmål edition of
<a href=
"https://debian-handbook.info/
">The Debian
4063 Administrator
's Handbook
</a
>. Now, thanks to the tireless effort of
4064 Ole-Erik, Ingrid and Andreas, the initial translation is complete, and
4065 we are working on the proof reading to ensure consistent language and
4066 use of correct computer science terms. The plan is to make the book
4067 available on paper, as well as in electronic form. For that to
4068 happen, the proof reading must be completed and all the figures need
4069 to be translated. If you want to help out, get in touch.
</p
>
4071 <p
><a href=
"http://www.hungry.com/~pere/debian-handbook/debian-handbook-nb-NO.pdf
">A
4073 fresh PDF edition
</a
> in A4 format (the final book will have smaller
4074 pages) of the book created every morning is available for
4075 proofreading. If you find any errors, please
4076 <a href=
"https://hosted.weblate.org/projects/debian-handbook/
">visit
4077 Weblate and correct the error
</a
>. The
4078 <a href=
"http://l.github.io/debian-handbook/stat/nb-NO/index.html
">state
4079 of the translation including figures
</a
> is a useful source for those
4080 provide Norwegian bokmål screen shots and figures.
</p
>
4085 <title>Unlimited randomness with the ChaosKey?
</title>
4086 <link>http://www.hungry.com/~pere/blog/Unlimited_randomness_with_the_ChaosKey_.html
</link>
4087 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Unlimited_randomness_with_the_ChaosKey_.html
</guid>
4088 <pubDate>Wed,
1 Mar
2017 20:
50:
00 +
0100</pubDate>
4089 <description><p
>A few days ago I ordered a small batch of
4090 <a href=
"http://altusmetrum.org/ChaosKey/
">the ChaosKey
</a
>, a small
4091 USB dongle for generating entropy created by Bdale Garbee and Keith
4092 Packard. Yesterday it arrived, and I am very happy to report that it
4093 work great! According to its designers, to get it to work out of the
4094 box, you need the Linux kernel version
4.1 or later. I tested on a
4095 Debian Stretch machine (kernel version
4.9), and there it worked just
4096 fine, increasing the available entropy very quickly. I wrote a small
4097 test oneliner to test. It first print the current entropy level,
4098 drain /dev/random, and then print the entropy level for five seconds.
4099 Here is the situation without the ChaosKey inserted:
</p
>
4101 <blockquote
><pre
>
4102 % cat /proc/sys/kernel/random/entropy_avail; \
4103 dd bs=
1M if=/dev/random of=/dev/null count=
1; \
4104 for n in $(seq
1 5); do \
4105 cat /proc/sys/kernel/random/entropy_avail; \
4111 28 byte kopiert,
0,
000264565 s,
106 kB/s
4118 </pre
></blockquote
>
4120 <p
>The entropy level increases by
3-
4 every second. In such case any
4121 application requiring random bits (like a HTTPS enabled web server)
4122 will halt and wait for more entrpy. And here is the situation with
4123 the ChaosKey inserted:
</p
>
4125 <blockquote
><pre
>
4126 % cat /proc/sys/kernel/random/entropy_avail; \
4127 dd bs=
1M if=/dev/random of=/dev/null count=
1; \
4128 for n in $(seq
1 5); do \
4129 cat /proc/sys/kernel/random/entropy_avail; \
4135 104 byte kopiert,
0,
000487647 s,
213 kB/s
4142 </pre
></blockquote
>
4144 <p
>Quite the difference. :) I bought a few more than I need, in case
4145 someone want to buy one here in Norway. :)
</p
>
4147 <p
>Update: The dongle was presented at Debconf last year. You might
4148 find
<a href=
"https://debconf16.debconf.org/talks/
94/
">the talk
4149 recording illuminating
</a
>. It explains exactly what the source of
4150 randomness is, if you are unable to spot it from the schema drawing
4151 available from the ChaosKey web site linked at the start of this blog
4157 <title>Where did that package go?
&mdash; geolocated IP traceroute
</title>
4158 <link>http://www.hungry.com/~pere/blog/Where_did_that_package_go___mdash__geolocated_IP_traceroute.html
</link>
4159 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Where_did_that_package_go___mdash__geolocated_IP_traceroute.html
</guid>
4160 <pubDate>Mon,
9 Jan
2017 12:
20:
00 +
0100</pubDate>
4161 <description><p
>Did you ever wonder where the web trafic really flow to reach the
4162 web servers, and who own the network equipment it is flowing through?
4163 It is possible to get a glimpse of this from using traceroute, but it
4164 is hard to find all the details. Many years ago, I wrote a system to
4165 map the Norwegian Internet (trying to figure out if our plans for a
4166 network game service would get low enough latency, and who we needed
4167 to talk to about setting up game servers close to the users. Back
4168 then I used traceroute output from many locations (I asked my friends
4169 to run a script and send me their traceroute output) to create the
4170 graph and the map. The output from traceroute typically look like
4173 <p
><pre
>
4174 traceroute to www.stortinget.no (
85.88.67.10),
30 hops max,
60 byte packets
4175 1 uio-gw10.uio.no (
129.240.202.1)
0.447 ms
0.486 ms
0.621 ms
4176 2 uio-gw8.uio.no (
129.240.24.229)
0.467 ms
0.578 ms
0.675 ms
4177 3 oslo-gw1.uninett.no (
128.39.65.17)
0.385 ms
0.373 ms
0.358 ms
4178 4 te3-
1-
2.br1.fn3.as2116.net (
193.156.90.3)
1.174 ms
1.172 ms
1.153 ms
4179 5 he16-
1-
1.cr1.san110.as2116.net (
195.0.244.234)
2.627 ms he16-
1-
1.cr2.oslosda310.as2116.net (
195.0.244.48)
3.172 ms he16-
1-
1.cr1.san110.as2116.net (
195.0.244.234)
2.857 ms
4180 6 ae1.ar8.oslosda310.as2116.net (
195.0.242.39)
0.662 ms
0.637 ms ae0.ar8.oslosda310.as2116.net (
195.0.242.23)
0.622 ms
4181 7 89.191.10.146 (
89.191.10.146)
0.931 ms
0.917 ms
0.955 ms
4185 </pre
></p
>
4187 <p
>This show the DNS names and IP addresses of (at least some of the)
4188 network equipment involved in getting the data traffic from me to the
4189 www.stortinget.no server, and how long it took in milliseconds for a
4190 package to reach the equipment and return to me. Three packages are
4191 sent, and some times the packages do not follow the same path. This
4192 is shown for hop
5, where three different IP addresses replied to the
4193 traceroute request.
</p
>
4195 <p
>There are many ways to measure trace routes. Other good traceroute
4196 implementations I use are traceroute (using ICMP packages) mtr (can do
4197 both ICMP, UDP and TCP) and scapy (python library with ICMP, UDP, TCP
4198 traceroute and a lot of other capabilities). All of them are easily
4199 available in
<a href=
"https://www.debian.org/
">Debian
</a
>.
</p
>
4201 <p
>This time around, I wanted to know the geographic location of
4202 different route points, to visualize how visiting a web page spread
4203 information about the visit to a lot of servers around the globe. The
4204 background is that a web site today often will ask the browser to get
4205 from many servers the parts (for example HTML, JSON, fonts,
4206 JavaScript, CSS, video) required to display the content. This will
4207 leak information about the visit to those controlling these servers
4208 and anyone able to peek at the data traffic passing by (like your ISP,
4209 the ISPs backbone provider, FRA, GCHQ, NSA and others).
</p
>
4211 <p
>Lets pick an example, the Norwegian parliament web site
4212 www.stortinget.no. It is read daily by all members of parliament and
4213 their staff, as well as political journalists, activits and many other
4214 citizens of Norway. A visit to the www.stortinget.no web site will
4215 ask your browser to contact
8 other servers: ajax.googleapis.com,
4216 insights.hotjar.com, script.hotjar.com, static.hotjar.com,
4217 stats.g.doubleclick.net, www.google-analytics.com,
4218 www.googletagmanager.com and www.netigate.se. I extracted this by
4219 asking
<a href=
"http://phantomjs.org/
">PhantomJS
</a
> to visit the
4220 Stortinget web page and tell me all the URLs PhantomJS downloaded to
4221 render the page (in HAR format using
4222 <a href=
"https://github.com/ariya/phantomjs/blob/master/examples/netsniff.js
">their
4223 netsniff example
</a
>. I am very grateful to Gorm for showing me how
4224 to do this). My goal is to visualize network traces to all IP
4225 addresses behind these DNS names, do show where visitors personal
4226 information is spread when visiting the page.
</p
>
4228 <p align=
"center
"><a href=
"www.stortinget.no-geoip.kml
"><img
4229 src=
"http://www.hungry.com/~pere/blog/images/
2017-
01-
09-www.stortinget.no-geoip-small.png
" alt=
"map of combined traces for URLs used by www.stortinget.no using GeoIP
"/
></a
></p
>
4231 <p
>When I had a look around for options, I could not find any good
4232 free software tools to do this, and decided I needed my own traceroute
4233 wrapper outputting KML based on locations looked up using GeoIP. KML
4234 is easy to work with and easy to generate, and understood by several
4235 of the GIS tools I have available. I got good help from by NUUG
4236 colleague Anders Einar with this, and the result can be seen in
4237 <a href=
"https://github.com/petterreinholdtsen/kmltraceroute
">my
4238 kmltraceroute git repository
</a
>. Unfortunately, the quality of the
4239 free GeoIP databases I could find (and the for-pay databases my
4240 friends had access to) is not up to the task. The IP addresses of
4241 central Internet infrastructure would typically be placed near the
4242 controlling companies main office, and not where the router is really
4243 located, as you can see from
<a href=
"www.stortinget.no-geoip.kml
">the
4244 KML file I created
</a
> using the GeoLite City dataset from MaxMind.
4246 <p align=
"center
"><a href=
"http://www.hungry.com/~pere/blog/images/
2017-
01-
09-www.stortinget.no-scapy.svg
"><img
4247 src=
"http://www.hungry.com/~pere/blog/images/
2017-
01-
09-www.stortinget.no-scapy-small.png
" alt=
"scapy traceroute graph for URLs used by www.stortinget.no
"/
></a
></p
>
4249 <p
>I also had a look at the visual traceroute graph created by
4250 <a href=
"http://www.secdev.org/projects/scapy/
">the scrapy project
</a
>,
4251 showing IP network ownership (aka AS owner) for the IP address in
4253 <a href=
"http://www.hungry.com/~pere/blog/images/
2017-
01-
09-www.stortinget.no-scapy.svg
">The
4254 graph display a lot of useful information about the traceroute in SVG
4255 format
</a
>, and give a good indication on who control the network
4256 equipment involved, but it do not include geolocation. This graph
4257 make it possible to see the information is made available at least for
4258 UNINETT, Catchcom, Stortinget, Nordunet, Google, Amazon, Telia, Level
4259 3 Communications and NetDNA.
</p
>
4261 <p align=
"center
"><a href=
"https://geotraceroute.com/index.php?node=
4&host=www.stortinget.no
"><img
4262 src=
"http://www.hungry.com/~pere/blog/images/
2017-
01-
09-www.stortinget.no-geotraceroute-small.png
" alt=
"example geotraceroute view for www.stortinget.no
"/
></a
></p
>
4264 <p
>In the process, I came across the
4265 <a href=
"https://geotraceroute.com/
">web service GeoTraceroute
</a
> by
4266 Salim Gasmi. Its methology of combining guesses based on DNS names,
4267 various location databases and finally use latecy times to rule out
4268 candidate locations seemed to do a very good job of guessing correct
4269 geolocation. But it could only do one trace at the time, did not have
4270 a sensor in Norway and did not make the geolocations easily available
4271 for postprocessing. So I contacted the developer and asked if he
4272 would be willing to share the code (he refused until he had time to
4273 clean it up), but he was interested in providing the geolocations in a
4274 machine readable format, and willing to set up a sensor in Norway. So
4275 since yesterday, it is possible to run traces from Norway in this
4276 service thanks to a sensor node set up by
4277 <a href=
"https://www.nuug.no/
">the NUUG assosiation
</a
>, and get the
4278 trace in KML format for further processing.
</p
>
4280 <p align=
"center
"><a href=
"http://www.hungry.com/~pere/blog/images/
2017-
01-
09-www.stortinget.no-geotraceroute-kml-join.kml
"><img
4281 src=
"http://www.hungry.com/~pere/blog/images/
2017-
01-
09-www.stortinget.no-geotraceroute-kml-join.png
" alt=
"map of combined traces for URLs used by www.stortinget.no using geotraceroute
"/
></a
></p
>
4283 <p
>Here we can see a lot of trafic passes Sweden on its way to
4284 Denmark, Germany, Holland and Ireland. Plenty of places where the
4285 Snowden confirmations verified the traffic is read by various actors
4286 without your best interest as their top priority.
</p
>
4288 <p
>Combining KML files is trivial using a text editor, so I could loop
4289 over all the hosts behind the urls imported by www.stortinget.no and
4290 ask for the KML file from GeoTraceroute, and create a combined KML
4291 file with all the traces (unfortunately only one of the IP addresses
4292 behind the DNS name is traced this time. To get them all, one would
4293 have to request traces using IP number instead of DNS names from
4294 GeoTraceroute). That might be the next step in this project.
</p
>
4296 <p
>Armed with these tools, I find it a lot easier to figure out where
4297 the IP traffic moves and who control the boxes involved in moving it.
4298 And every time the link crosses for example the Swedish border, we can
4299 be sure Swedish Signal Intelligence (FRA) is listening, as GCHQ do in
4300 Britain and NSA in USA and cables around the globe. (Hm, what should
4301 we tell them? :) Keep that in mind if you ever send anything
4302 unencrypted over the Internet.
</p
>
4304 <p
>PS: KML files are drawn using
4305 <a href=
"http://ivanrublev.me/kml/
">the KML viewer from Ivan
4306 Rublev
<a/
>, as it was less cluttered than the local Linux application
4307 Marble. There are heaps of other options too.
</p
>
4309 <p
>As usual, if you use Bitcoin and want to show your support of my
4310 activities, please send Bitcoin donations to my address
4311 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
4316 <title>Appstream just learned how to map hardware to packages too!
</title>
4317 <link>http://www.hungry.com/~pere/blog/Appstream_just_learned_how_to_map_hardware_to_packages_too_.html
</link>
4318 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Appstream_just_learned_how_to_map_hardware_to_packages_too_.html
</guid>
4319 <pubDate>Fri,
23 Dec
2016 10:
30:
00 +
0100</pubDate>
4320 <description><p
>I received a very nice Christmas present today. As my regular
4321 readers probably know, I have been working on the
4322 <a href=
"http://packages.qa.debian.org/isenkram
">the Isenkram
4323 system
</a
> for many years. The goal of the Isenkram system is to make
4324 it easier for users to figure out what to install to get a given piece
4325 of hardware to work in Debian, and a key part of this system is a way
4326 to map hardware to packages. Isenkram have its own mapping database,
4327 and also uses data provided by each package using the AppStream
4328 metadata format. And today,
4329 <a href=
"https://tracker.debian.org/pkg/appstream
">AppStream
</a
> in
4330 Debian learned to look up hardware the same way Isenkram is doing it,
4331 ie using fnmatch():
</p
>
4333 <p
><pre
>
4334 % appstreamcli what-provides modalias \
4335 usb:v1130p0202d0100dc00dsc00dp00ic03isc00ip00in00
4336 Identifier: pymissile [generic]
4338 Summary: Control original Striker USB Missile Launcher
4340 % appstreamcli what-provides modalias usb:v0694p0002d0000
4341 Identifier: libnxt [generic]
4343 Summary: utility library for talking to the LEGO Mindstorms NXT brick
4346 Identifier: t2n [generic]
4348 Summary: Simple command-line tool for Lego NXT
4351 Identifier: python-nxt [generic]
4353 Summary: Python driver/interface/wrapper for the Lego Mindstorms NXT robot
4356 Identifier: nbc [generic]
4358 Summary: C compiler for LEGO Mindstorms NXT bricks
4361 </pre
></p
>
4363 <p
>A similar query can be done using the combined AppStream and
4364 Isenkram databases using the isenkram-lookup tool:
</p
>
4366 <p
><pre
>
4367 % isenkram-lookup usb:v1130p0202d0100dc00dsc00dp00ic03isc00ip00in00
4369 % isenkram-lookup usb:v0694p0002d0000
4375 </pre
></p
>
4377 <p
>You can find modalias values relevant for your machine using
4378 <tt
>cat $(find /sys/devices/ -name modalias)
</tt
>.
4380 <p
>If you want to make this system a success and help Debian users
4381 make the most of the hardware they have, please help
4382 <a href=
"https://wiki.debian.org/AppStream/Guidelines
">add AppStream
4383 metadata for your package following the guidelines
</a
> documented in
4384 the wiki. So far only
11 packages provide such information, among the
4385 several hundred hardware specific packages in Debian. The Isenkram
4386 database on the other hand contain
101 packages, mostly related to USB
4387 dongles. Most of the packages with hardware mapping in AppStream are
4388 LEGO Mindstorms related, because I have, as part of my involvement in
4389 <a href=
"https://wiki.debian.org/LegoDesigners
">the Debian LEGO
4390 team
</a
> given priority to making sure LEGO users get proposed the
4391 complete set of packages in Debian for that particular hardware. The
4392 team also got a nice Christmas present today. The
4393 <a href=
"https://tracker.debian.org/pkg/nxt-firmware
">nxt-firmware
4394 package
</a
> made it into Debian. With this package in place, it is
4395 now possible to use the LEGO Mindstorms NXT unit with only free
4396 software, as the nxt-firmware package contain the source and firmware
4397 binaries for the NXT brick.
</p
>
4399 <p
>As usual, if you use Bitcoin and want to show your support of my
4400 activities, please send Bitcoin donations to my address
4401 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
4406 <title>Isenkram updated with a lot more hardware-package mappings
</title>
4407 <link>http://www.hungry.com/~pere/blog/Isenkram_updated_with_a_lot_more_hardware_package_mappings.html
</link>
4408 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Isenkram_updated_with_a_lot_more_hardware_package_mappings.html
</guid>
4409 <pubDate>Tue,
20 Dec
2016 11:
55:
00 +
0100</pubDate>
4410 <description><p
><a href=
"http://packages.qa.debian.org/isenkram
">The Isenkram
4411 system
</a
> I wrote two years ago to make it easier in Debian to find
4412 and install packages to get your hardware dongles to work, is still
4413 going strong. It is a system to look up the hardware present on or
4414 connected to the current system, and map the hardware to Debian
4415 packages. It can either be done using the tools in isenkram-cli or
4416 using the user space daemon in the isenkram package. The latter will
4417 notify you, when inserting new hardware, about what packages to
4418 install to get the dongle working. It will even provide a button to
4419 click on to ask packagekit to install the packages.
</p
>
4421 <p
>Here is an command line example from my Thinkpad laptop:
</p
>
4423 <p
><pre
>
4440 </pre
></p
>
4442 <p
>It can also list the firware package providing firmware requested
4443 by the load kernel modules, which in my case is an empty list because
4444 I have all the firmware my machine need:
4446 <p
><pre
>
4447 % /usr/sbin/isenkram-autoinstall-firmware -l
4448 info: did not find any firmware files requested by loaded kernel modules. exiting
4450 </pre
></p
>
4452 <p
>The last few days I had a look at several of the around
250
4453 packages in Debian with udev rules. These seem like good candidates
4454 to install when a given hardware dongle is inserted, and I found
4455 several that should be proposed by isenkram. I have not had time to
4456 check all of them, but am happy to report that now there are
97
4457 packages packages mapped to hardware by Isenkram.
11 of these
4458 packages provide hardware mapping using AppStream, while the rest are
4459 listed in the modaliases file provided in isenkram.
</p
>
4461 <p
>These are the packages with hardware mappings at the moment. The
4462 <strong
>marked packages
</strong
> are also announcing their hardware
4463 support using AppStream, for everyone to use:
</p
>
4465 <p
>air-quality-sensor, alsa-firmware-loaders, argyll,
4466 <strong
>array-info
</strong
>, avarice, avrdude, b43-fwcutter,
4467 bit-babbler, bluez, bluez-firmware,
<strong
>brltty
</strong
>,
4468 <strong
>broadcom-sta-dkms
</strong
>, calibre, cgminer, cheese, colord,
4469 <strong
>colorhug-client
</strong
>, dahdi-firmware-nonfree, dahdi-linux,
4470 dfu-util, dolphin-emu, ekeyd, ethtool, firmware-ipw2x00, fprintd,
4471 fprintd-demo,
<strong
>galileo
</strong
>, gkrellm-thinkbat, gphoto2,
4472 gpsbabel, gpsbabel-gui, gpsman, gpstrans, gqrx-sdr, gr-fcdproplus,
4473 gr-osmosdr, gtkpod, hackrf, hdapsd, hdmi2usb-udev, hpijs-ppds, hplip,
4474 ipw3945-source, ipw3945d, kde-config-tablet, kinect-audio-setup,
4475 <strong
>libnxt
</strong
>, libpam-fprintd,
<strong
>lomoco
</strong
>,
4476 madwimax, minidisc-utils, mkgmap, msi-keyboard, mtkbabel,
4477 <strong
>nbc
</strong
>,
<strong
>nqc
</strong
>, nut-hal-drivers, ola,
4478 open-vm-toolbox, open-vm-tools, openambit, pcgminer, pcmciautils,
4479 pcscd, pidgin-blinklight, printer-driver-splix,
4480 <strong
>pymissile
</strong
>, python-nxt, qlandkartegt,
4481 qlandkartegt-garmin, rosegarden, rt2x00-source, sispmctl,
4482 soapysdr-module-hackrf, solaar, squeak-plugins-scratch, sunxi-tools,
4483 <strong
>t2n
</strong
>, thinkfan, thinkfinger-tools, tlp, tp-smapi-dkms,
4484 tp-smapi-source, tpb, tucnak, uhd-host, usbmuxd, viking,
4485 virtualbox-ose-guest-x11, w1retap, xawtv, xserver-xorg-input-vmmouse,
4486 xserver-xorg-input-wacom, xserver-xorg-video-qxl,
4487 xserver-xorg-video-vmware, yubikey-personalization and
4488 zd1211-firmware
</p
>
4490 <p
>If you know of other packages, please let me know with a wishlist
4491 bug report against the isenkram-cli package, and ask the package
4493 <a href=
"https://wiki.debian.org/AppStream/Guidelines
">add AppStream
4494 metadata according to the guidelines
</a
> to provide the information
4495 for everyone. In time, I hope to get rid of the isenkram specific
4496 hardware mapping and depend exclusively on AppStream.
</p
>
4498 <p
>Note, the AppStream metadata for broadcom-sta-dkms is matching too
4499 much hardware, and suggest that the package with with any ethernet
4500 card. See
<a href=
"http://bugs.debian.org/
838735">bug #
838735</a
> for
4501 the details. I hope the maintainer find time to address it soon. In
4502 the mean time I provide an override in isenkram.
</p
>
4507 <title>Oolite, a life in space as vagabond and mercenary - nice free software
</title>
4508 <link>http://www.hungry.com/~pere/blog/Oolite__a_life_in_space_as_vagabond_and_mercenary___nice_free_software.html
</link>
4509 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Oolite__a_life_in_space_as_vagabond_and_mercenary___nice_free_software.html
</guid>
4510 <pubDate>Sun,
11 Dec
2016 11:
40:
00 +
0100</pubDate>
4511 <description><p align=
"center
"><img width=
"70%
" src=
"http://www.hungry.com/~pere/blog/images/
2016-
12-
11-nice-oolite.png
"/
></p
>
4513 <p
>In my early years, I played
4514 <a href=
"http://wiki.alioth.net/index.php/Classic_Elite
">the epic game
4515 Elite
</a
> on my PC. I spent many months trading and fighting in
4516 space, and reached the
'elite
' fighting status before I moved on. The
4517 original Elite game was available on Commodore
64 and the IBM PC
4518 edition I played had a
64 KB executable. I am still impressed today
4519 that the authors managed to squeeze both a
3D engine and details about
4520 more than
2000 planet systems across
7 galaxies into a binary so
4523 <p
>I have known about
<a href=
"http://www.oolite.org/
">the free
4524 software game Oolite inspired by Elite
</a
> for a while, but did not
4525 really have time to test it properly until a few days ago. It was
4526 great to discover that my old knowledge about trading routes were
4527 still valid. But my fighting and flying abilities were gone, so I had
4528 to retrain to be able to dock on a space station. And I am still not
4529 able to make much resistance when I am attacked by pirates, so I
4530 bougth and mounted the most powerful laser in the rear to be able to
4531 put up at least some resistance while fleeing for my life. :)
</p
>
4533 <p
>When playing Elite in the late eighties, I had to discover
4534 everything on my own, and I had long lists of prices seen on different
4535 planets to be able to decide where to trade what. This time I had the
4537 <a href=
"http://wiki.alioth.net/index.php/Main_Page
">Elite wiki
</a
>,
4538 where information about each planet is easily available with common
4539 price ranges and suggested trading routes. This improved my ability
4540 to earn money and I have been able to earn enough to buy a lot of
4541 useful equipent in a few days. I believe I originally played for
4542 months before I could get a docking computer, while now I could get it
4543 after less then a week.
</p
>
4545 <p
>If you like science fiction and dreamed of a life as a vagabond in
4546 space, you should try out Oolite. It is available for Linux, MacOSX
4547 and Windows, and is included in Debian and derivatives since
2011.
</p
>
4549 <p
>As usual, if you use Bitcoin and want to show your support of my
4550 activities, please send Bitcoin donations to my address
4551 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
4556 <title>Quicker Debian installations using eatmydata
</title>
4557 <link>http://www.hungry.com/~pere/blog/Quicker_Debian_installations_using_eatmydata.html
</link>
4558 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Quicker_Debian_installations_using_eatmydata.html
</guid>
4559 <pubDate>Fri,
25 Nov
2016 14:
50:
00 +
0100</pubDate>
4560 <description><p
>Two years ago, I did some experiments with eatmydata and the Debian
4561 installation system, observing how using
4562 <a href=
"http://www.hungry.com/~pere/blog/Speeding_up_the_Debian_installer_using_eatmydata_and_dpkg_divert.html
">eatmydata
4563 could speed up the installation
</a
> quite a bit. My testing measured
4564 speedup around
20-
40 percent for Debian Edu, where we install around
4565 1000 packages from within the installer. The eatmydata package
4566 provide a way to disable/delay file system flushing. This is a bit
4567 risky in the general case, as files that should be stored on disk will
4568 stay only in memory a bit longer than expected, causing problems if a
4569 machine crashes at an inconvenient time. But for an installation, if
4570 the machine crashes during installation the process is normally
4571 restarted, and avoiding disk operations as much as possible to speed
4572 up the process make perfect sense.
4574 <p
>I added code in the Debian Edu specific installation code to enable
4575 <a href=
"https://tracker.debian.org/pkg/libeatmydata
">eatmydata
</a
>,
4576 but did not have time to push it any further. But a few months ago I
4577 picked it up again and worked with the libeatmydata package maintainer
4578 Mattia Rizzolo to make it easier for everyone to get this installation
4579 speedup in Debian. Thanks to our cooperation There is now an
4580 eatmydata-udeb package in Debian testing and unstable, and simply
4581 enabling/installing it in debian-installer (d-i) is enough to get the
4582 quicker installations. It can be enabled using preseeding. The
4583 following untested kernel argument should do the trick:
</p
>
4585 <blockquote
><pre
>
4586 preseed/early_command=
"anna-install eatmydata-udeb
"
4587 </pre
></blockquote
>
4589 <p
>This should ask d-i to install the package inside the d-i
4590 environment early in the installation sequence. Having it installed
4591 in d-i in turn will make sure the relevant scripts are called just
4592 after debootstrap filled /target/ with the freshly installed Debian
4593 system to configure apt to run dpkg with eatmydata. This is enough to
4594 speed up the installation process. There is a proposal to
4595 <a href=
"https://bugs.debian.org/
841153">extend the idea a bit further
4596 by using /etc/ld.so.preload instead of apt.conf
</a
>, but I have not
4597 tested its impact.
</p
>
4603 <title>Oversette bokmål til nynorsk, enklere enn du tror takket være Apertium
</title>
4604 <link>http://www.hungry.com/~pere/blog/Oversette_bokm_l_til_nynorsk__enklere_enn_du_tror_takket_v_re_Apertium.html
</link>
4605 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Oversette_bokm_l_til_nynorsk__enklere_enn_du_tror_takket_v_re_Apertium.html
</guid>
4606 <pubDate>Thu,
24 Nov
2016 10:
50:
00 +
0100</pubDate>
4607 <description><p
>I Norge er det mange som trenger å skrive både bokmål og nynorsk.
4608 Eksamensoppgaver, offentlige brev og nyheter er eksempler på tekster
4609 der det er krav om skriftspråk. I tillegg til alle skoleoppgavene som
4610 elever over det ganske land skal levere inn hvert år. Det mange ikke
4611 vet er at selv om de kommersielle alternativene
4612 <a href=
"https://translate.google.com/
">Google Translate
</a
> og
4613 <a href=
"https://www.bing.com/translator/
">Bing Translator
</a
> ikke kan
4614 bidra med å oversette mellom bokmål og nynorsk, så finnes det et
4615 utmerket fri programvarealternativ som kan. Oversetterverktøyet
4616 Apertium har støtte for en rekke språkkombinasjoner, og takket være
4617 den utrettelige innsatsen til blant annet Kevin Brubeck Unhammer, kan
4618 en bruke webtjenesten til å fylle inn en tekst på bokmål eller
4619 nynorsk, og få den automatoversatt til det andre skriftspråket.
4620 Resultatet er ikke perfekt, men et svært godt utgangspunkt. Av og til
4621 er resultatet så bra at det kan benyttes uten endringer. Jeg vet
4622 f.eks. at store deler av Joomla ble oversatt til nynorsk ved hjelp
4623 Apertium. Høres det ut som noe du kan ha bruk for? Besøk i så fall
4624 <a href=
"https://www.apertium.org/
">Apertium.org
</a
> og fyll inn
4625 teksten din i webskjemaet der.
4627 <p
>Hvis du trenger maskinell tilgang til den bakenforliggende
4628 teknologien kan du enten installere pakken
4629 <a href=
"https://tracker.debian.org/apertium-nno-nob
">apertium-nno-nob
</a
>
4630 på en Debian-maskin eller bruke web-API-et tilgjengelig fra
4631 api.apertium.org. Se
4632 <a href=
"http://wiki.apertium.org/wiki/Apertium-apy
">API-dokumentasjonen
</a
>
4633 for detaljer om web-API-et. Her kan du se hvordan resultatet blir for
4634 denne teksten som ble skrevet på bokmål over maskinoversatt til
4639 <p
>I Noreg er det mange som treng å skriva både bokmål og nynorsk.
4640 Eksamensoppgåver, offentlege brev og nyhende er døme på tekster der
4641 det er krav om skriftspråk. I tillegg til alle skuleoppgåvene som
4642 elevar over det ganske land skal levera inn kvart år. Det mange ikkje
4643 veit er at sjølv om dei kommersielle alternativa
4644 <a href=
"https://translate.google.com/
">Google *Translate
</a
> og
4645 <a href=
"https://www.bing.com/translator/
">Bing *Translator
</a
> ikkje
4646 kan bidra med å omsetja mellom bokmål og nynorsk, så finst det eit
4647 utmerka fri programvarealternativ som kan. Omsetjarverktøyet
4648 *Apertium har støtte for ei rekkje språkkombinasjonar, og takka vera
4649 den utrøyttelege innsatsen til blant anna Kevin Brubeck Unhammer, kan
4650 ein bruka *webtjenesten til å fylla inn ei tekst på bokmål eller
4651 nynorsk, og få den *automatoversatt til det andre skriftspråket.
4652 Resultatet er ikkje perfekt, men eit svært godt utgangspunkt. Av og
4653 til er resultatet så bra at det kan nyttast utan endringar. Eg veit
4654 t.d. at store delar av *Joomla vart omsett til nynorsk ved hjelp
4655 *Apertium. Høyrast det ut som noko du kan ha bruk for? Besøk i så
4656 fall
<a href=
"https://www.apertium.org/
">*Apertium.org
</a
> og fyll inn
4657 teksta di i *webskjemaet der.
4659 <p
>Viss du treng *maskinell tilgjenge til den *bakenforliggende
4660 teknologien kan du anten installera pakken
4661 <a href=
"https://tracker.debian.org/apertium-nno-nob
">*apertium-*nno-*nob
</a
>
4662 på ein *Debian-maskin eller bruka *web-*API-eit tilgjengeleg frå
4663 *api.*apertium.org. Sjå
4664 <a href=
"http://wiki.apertium.org/wiki/Apertium-apy
">*API-dokumentasjonen
</a
>
4665 for detaljar om *web-*API-eit. Her kan du sjå korleis resultatet vert
4666 for denne teksta som vart skreva på bokmål over *maskinoversatt til
4672 <title>Coz profiler for multi-threaded software is now in Debian
</title>
4673 <link>http://www.hungry.com/~pere/blog/Coz_profiler_for_multi_threaded_software_is_now_in_Debian.html
</link>
4674 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Coz_profiler_for_multi_threaded_software_is_now_in_Debian.html
</guid>
4675 <pubDate>Sun,
13 Nov
2016 12:
30:
00 +
0100</pubDate>
4676 <description><p
><a href=
"http://coz-profiler.org/
">The Coz profiler
</a
>, a nice
4677 profiler able to run benchmarking experiments on the instrumented
4678 multi-threaded program, finally
4679 <a href=
"https://tracker.debian.org/pkg/coz-profiler
">made it into
4680 Debian unstable yesterday
</A
>. Lluís Vilanova and I have spent many
4682 <a href=
"http://www.hungry.com/~pere/blog/Coz_can_help_you_find_bottlenecks_in_multi_threaded_software___nice_free_software.html
">I
4683 blogged about the coz tool
</a
> in August working with upstream to make
4684 it suitable for Debian. There are still issues with clang
4685 compatibility, inline assembly only working x86 and minimized
4686 JavaScript libraries.
</p
>
4688 <p
>To test it, install
'coz-profiler
' using apt and run it like this:
</p
>
4690 <p
><blockquote
>
4691 <tt
>coz run --- /path/to/binary-with-debug-info
</tt
>
4692 </blockquote
></p
>
4694 <p
>This will produce a profile.coz file in the current working
4695 directory with the profiling information. This is then given to a
4696 JavaScript application provided in the package and available from
4697 <a href=
"http://plasma-umass.github.io/coz/
">a project web page
</a
>.
4698 To start the local copy, invoke it in a browser like this:
</p
>
4700 <p
><blockquote
>
4701 <tt
>sensible-browser /usr/share/coz-profiler/viewer/index.htm
</tt
>
4702 </blockquote
></p
>
4704 <p
>See the project home page and the
4705 <a href=
"https://www.usenix.org/publications/login/summer2016/curtsinger
">USENIX
4706 ;login: article on Coz
</a
> for more information on how it is
4712 <title>My own self balancing Lego Segway
</title>
4713 <link>http://www.hungry.com/~pere/blog/My_own_self_balancing_Lego_Segway.html
</link>
4714 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/My_own_self_balancing_Lego_Segway.html
</guid>
4715 <pubDate>Fri,
4 Nov
2016 10:
15:
00 +
0100</pubDate>
4716 <description><p
>A while back I received a Gyro sensor for the NXT
4717 <a href=
"mindstorms.lego.com
">Mindstorms
</a
> controller as a birthday
4718 present. It had been on my wishlist for a while, because I wanted to
4719 build a Segway like balancing lego robot. I had already built
4720 <a href=
"http://www.nxtprograms.com/NXT2/segway/
">a simple balancing
4721 robot
</a
> with the kids, using the light/color sensor included in the
4722 NXT kit as the balance sensor, but it was not working very well. It
4723 could balance for a while, but was very sensitive to the light
4724 condition in the room and the reflective properties of the surface and
4725 would fall over after a short while. I wanted something more robust,
4727 <a href=
"https://www.hitechnic.com/cgi-bin/commerce.cgi?preadd=action
&key=NGY1044
">the
4728 gyro sensor from HiTechnic
</a
> I believed would solve it on my
4729 wishlist for some years before it suddenly showed up as a gift from my
4730 loved ones. :)
</p
>
4732 <p
>Unfortunately I have not had time to sit down and play with it
4733 since then. But that changed some days ago, when I was searching for
4734 lego segway information and came across a recipe from HiTechnic for
4736 <a href=
"http://www.hitechnic.com/blog/gyro-sensor/htway/
">the
4737 HTWay
</a
>, a segway like balancing robot. Build instructions and
4738 <a href=
"https://www.hitechnic.com/upload/
786-HTWayC.nxc
">source
4739 code
</a
> was included, so it was just a question of putting it all
4740 together. And thanks to the great work of many Debian developers, the
4741 compiler needed to build the source for the NXT is already included in
4742 Debian, so I was read to go in less than an hour. The resulting robot
4743 do not look very impressive in its simplicity:
</p
>
4745 <p align=
"center
"><img width=
"70%
" src=
"http://www.hungry.com/~pere/blog/images/
2016-
11-
04-lego-htway-robot.jpeg
"></p
>
4747 <p
>Because I lack the infrared sensor used to control the robot in the
4748 design from HiTechnic, I had to comment out the last task
4749 (taskControl). I simply placed /* and */ around it get the program
4750 working without that sensor present. Now it balances just fine until
4751 the battery status run low:
</p
>
4753 <p align=
"center
"><video width=
"70%
" controls=
"true
">
4754 <source src=
"http://www.hungry.com/~pere/blog/images/
2016-
11-
04-lego-htway-balancing.ogv
" type=
"video/ogg
">
4755 </video
></p
>
4757 <p
>Now we would like to teach it how to follow a line and take remote
4758 control instructions using the included Bluetooth receiver in the NXT.
</p
>
4760 <p
>If you, like me, love LEGO and want to make sure we find the tools
4761 they need to work with LEGO in Debian and all our derivative
4762 distributions like Ubuntu, check out
4763 <a href=
"http://wiki.debian.org/LegoDesigners
">the LEGO designers
4764 project page
</a
> and join the Debian LEGO team. Personally I own a
4765 RCX and NXT controller (no EV3), and would like to make sure the
4766 Debian tools needed to program the systems I own work as they
4772 <title>Experience and updated recipe for using the Signal app without a mobile phone
</title>
4773 <link>http://www.hungry.com/~pere/blog/Experience_and_updated_recipe_for_using_the_Signal_app_without_a_mobile_phone.html
</link>
4774 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Experience_and_updated_recipe_for_using_the_Signal_app_without_a_mobile_phone.html
</guid>
4775 <pubDate>Mon,
10 Oct
2016 11:
30:
00 +
0200</pubDate>
4776 <description><p
>In July
4777 <a href=
"http://www.hungry.com/~pere/blog/How_to_use_the_Signal_app_if_you_only_have_a_land_line__ie_no_mobile_phone_.html
">I
4778 wrote how to get the Signal Chrome/Chromium app working
</a
> without
4779 the ability to receive SMS messages (aka without a cell phone). It is
4780 time to share some experiences and provide an updated setup.
</p
>
4782 <p
>The Signal app have worked fine for several months now, and I use
4783 it regularly to chat with my loved ones. I had a major snag at the
4784 end of my summer vacation, when the the app completely forgot my
4785 setup, identity and keys. The reason behind this major mess was
4786 running out of disk space. To avoid that ever happening again I have
4787 started storing everything in
<tt
>userdata/
</tt
> in git, to be able to
4788 roll back to an earlier version if the files are wiped by mistake. I
4789 had to use it once after introducing the git backup. When rolling
4790 back to an earlier version, one need to use the
'reset session
' option
4791 in Signal to get going, and notify the people you talk with about the
4792 problem. I assume there is some sequence number tracking in the
4793 protocol to detect rollback attacks. The git repository is rather big
4794 (
674 MiB so far), but I have not tried to figure out if some of the
4795 content can be added to a .gitignore file due to lack of spare
4798 <p
>I
've also hit the
90 days timeout blocking, and noticed that this
4799 make it impossible to send messages using Signal. I could still
4800 receive them, but had to patch the code with a new timestamp to send.
4801 I believe the timeout is added by the developers to force people to
4802 upgrade to the latest version of the app, even when there is no
4803 protocol changes, to reduce the version skew among the user base and
4804 thus try to keep the number of support requests down.
</p
>
4806 <p
>Since my original recipe, the Signal source code changed slightly,
4807 making the old patch fail to apply cleanly. Below is an updated
4808 patch, including the shell wrapper I use to start Signal. The
4809 original version required a new user to locate the JavaScript console
4810 and call a function from there. I got help from a friend with more
4811 JavaScript knowledge than me to modify the code to provide a GUI
4812 button instead. This mean that to get started you just need to run
4813 the wrapper and click the
'Register without mobile phone
' to get going
4814 now. I
've also modified the timeout code to always set it to
90 days
4815 in the future, to avoid having to patch the code regularly.
</p
>
4817 <p
>So, the updated recipe for Debian Jessie:
</p
>
4821 <li
>First, install required packages to get the source code and the
4822 browser you need. Signal only work with Chrome/Chromium, as far as I
4823 know, so you need to install it.
4826 apt install git tor chromium
4827 git clone https://github.com/WhisperSystems/Signal-Desktop.git
4828 </pre
></li
>
4830 <li
>Modify the source code using command listed in the the patch
4831 block below.
</li
>
4833 <li
>Start Signal using the run-signal-app wrapper (for example using
4834 <tt
>`pwd`/run-signal-app
</tt
>).
4836 <li
>Click on the
'Register without mobile phone
', will in a phone
4837 number you can receive calls to the next minute, receive the
4838 verification code and enter it into the form field and press
4839 'Register
'. Note, the phone number you use will be user Signal
4840 username, ie the way others can find you on Signal.
</li
>
4842 <li
>You can now use Signal to contact others. Note, new contacts do
4843 not show up in the contact list until you restart Signal, and there is
4844 no way to assign names to Contacts. There is also no way to create or
4845 update chat groups. I suspect this is because the web app do not have
4846 a associated contact database.
</li
>
4850 <p
>I am still a bit uneasy about using Signal, because of the way its
4851 main author moxie0 reject federation and accept dependencies to major
4852 corporations like Google (part of the code is fetched from Google) and
4853 Amazon (the central coordination point is owned by Amazon). See for
4855 <a href=
"https://github.com/LibreSignal/LibreSignal/issues/
37">the
4856 LibreSignal issue tracker
</a
> for a thread documenting the authors
4857 view on these issues. But the network effect is strong in this case,
4858 and several of the people I want to communicate with already use
4859 Signal. Perhaps we can all move to
<a href=
"https://ring.cx/
">Ring
</a
>
4860 once it
<a href=
"https://bugs.debian.org/
830265">work on my
4861 laptop
</a
>? It already work on Windows and Android, and is included
4862 in
<a href=
"https://tracker.debian.org/pkg/ring
">Debian
</a
> and
4863 <a href=
"https://launchpad.net/ubuntu/+source/ring
">Ubuntu
</a
>, but not
4864 working on Debian Stable.
</p
>
4866 <p
>Anyway, this is the patch I apply to the Signal code to get it
4867 working. It switch to the production servers, disable to timeout,
4868 make registration easier and add the shell wrapper:
</p
>
4871 cd Signal-Desktop; cat
&lt;
&lt;EOF | patch -p1
4872 diff --git a/js/background.js b/js/background.js
4873 index
24b4c1d.
.579345f
100644
4874 --- a/js/background.js
4875 +++ b/js/background.js
4880 - var SERVER_URL =
'https://textsecure-service-staging.whispersystems.org
';
4881 + var SERVER_URL =
'https://textsecure-service-ca.whispersystems.org
';
4882 var SERVER_PORTS = [
80,
4433,
8443];
4883 - var ATTACHMENT_SERVER_URL =
'https://whispersystems-textsecure-attachments-staging.s3.amazonaws.com
';
4884 + var ATTACHMENT_SERVER_URL =
'https://whispersystems-textsecure-attachments.s3.amazonaws.com
';
4885 var messageReceiver;
4886 window.getSocketStatus = function() {
4887 if (messageReceiver) {
4888 diff --git a/js/expire.js b/js/expire.js
4889 index
639aeae..beb91c3
100644
4894 'use strict
';
4895 - var BUILD_EXPIRATION =
0;
4896 + var BUILD_EXPIRATION = Date.now() + (
90 *
24 *
60 *
60 *
1000);
4898 window.extension = window.extension || {};
4900 diff --git a/js/views/install_view.js b/js/views/install_view.js
4901 index
7816f4f.
.1d6233b
100644
4902 --- a/js/views/install_view.js
4903 +++ b/js/views/install_view.js
4906 'click .step1
': this.selectStep.bind(this,
1),
4907 'click .step2
': this.selectStep.bind(this,
2),
4908 -
'click .step3
': this.selectStep.bind(this,
3)
4909 +
'click .step3
': this.selectStep.bind(this,
3),
4910 +
'click .callreg
': function() { extension.install(
'standalone
') },
4913 clearQR: function() {
4914 diff --git a/options.html b/options.html
4915 index dc0f28e.
.8d709f6
100644
4919 &lt;div class=
'nav
'>
4920 &lt;h1
>{{ installWelcome }}
&lt;/h1
>
4921 &lt;p
>{{ installTagline }}
&lt;/p
>
4922 -
&lt;div
> &lt;a class=
'button step2
'>{{ installGetStartedButton }}
&lt;/a
> &lt;/div
>
4923 +
&lt;div
> &lt;a class=
'button step2
'>{{ installGetStartedButton }}
&lt;/a
>
4924 +
&lt;br
> &lt;a class=
"button callreg
">Register without mobile phone
&lt;/a
>
4927 &lt;span class=
'dot step1 selected
'>&lt;/span
>
4928 &lt;span class=
'dot step2
'>&lt;/span
>
4929 &lt;span class=
'dot step3
'>&lt;/span
>
4930 --- /dev/null
2016-
10-
07 09:
55:
13.730181472 +
0200
4931 +++ b/run-signal-app
2016-
10-
10 08:
54:
09.434172391 +
0200
4937 +userdata=
"`pwd`/userdata
"
4938 +if [ -d
"$userdata
" ]
&& [ ! -d
"$userdata/.git
" ] ; then
4939 + (cd $userdata
&& git init)
4941 +(cd $userdata
&& git add .
&& git commit -m
"Current status.
" || true)
4943 + --proxy-server=
"socks://localhost:
9050" \
4944 + --user-data-dir=$userdata --load-and-launch-app=`pwd`
4946 chmod a+rx run-signal-app
4949 <p
>As usual, if you use Bitcoin and want to show your support of my
4950 activities, please send Bitcoin donations to my address
4951 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
4956 <title>Isenkram, Appstream and udev make life as a LEGO builder easier
</title>
4957 <link>http://www.hungry.com/~pere/blog/Isenkram__Appstream_and_udev_make_life_as_a_LEGO_builder_easier.html
</link>
4958 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Isenkram__Appstream_and_udev_make_life_as_a_LEGO_builder_easier.html
</guid>
4959 <pubDate>Fri,
7 Oct
2016 09:
50:
00 +
0200</pubDate>
4960 <description><p
><a href=
"http://packages.qa.debian.org/isenkram
">The Isenkram
4961 system
</a
> provide a practical and easy way to figure out which
4962 packages support the hardware in a given machine. The command line
4963 tool
<tt
>isenkram-lookup
</tt
> and the tasksel options provide a
4964 convenient way to list and install packages relevant for the current
4965 hardware during system installation, both user space packages and
4966 firmware packages. The GUI background daemon on the other hand provide
4967 a pop-up proposing to install packages when a new dongle is inserted
4968 while using the computer. For example, if you plug in a smart card
4969 reader, the system will ask if you want to install
<tt
>pcscd
</tt
> if
4970 that package isn
't already installed, and if you plug in a USB video
4971 camera the system will ask if you want to install
<tt
>cheese
</tt
> if
4972 cheese is currently missing. This already work just fine.
</p
>
4974 <p
>But Isenkram depend on a database mapping from hardware IDs to
4975 package names. When I started no such database existed in Debian, so
4976 I made my own data set and included it with the isenkram package and
4977 made isenkram fetch the latest version of this database from git using
4978 http. This way the isenkram users would get updated package proposals
4979 as soon as I learned more about hardware related packages.
</p
>
4981 <p
>The hardware is identified using modalias strings. The modalias
4982 design is from the Linux kernel where most hardware descriptors are
4983 made available as a strings that can be matched using filename style
4984 globbing. It handle USB, PCI, DMI and a lot of other hardware related
4985 identifiers.
</p
>
4987 <p
>The downside to the Isenkram specific database is that there is no
4988 information about relevant distribution / Debian version, making
4989 isenkram propose obsolete packages too. But along came AppStream, a
4990 cross distribution mechanism to store and collect metadata about
4991 software packages. When I heard about the proposal, I contacted the
4992 people involved and suggested to add a hardware matching rule using
4993 modalias strings in the specification, to be able to use AppStream for
4994 mapping hardware to packages. This idea was accepted and AppStream is
4995 now a great way for a package to announce the hardware it support in a
4996 distribution neutral way. I wrote
4997 <a href=
"http://www.hungry.com/~pere/blog/Using_appstream_with_isenkram_to_install_hardware_related_packages_in_Debian.html
">a
4998 recipe on how to add such meta-information
</a
> in a blog post last
4999 December. If you have a hardware related package in Debian, please
5000 announce the relevant hardware IDs using AppStream.
</p
>
5002 <p
>In Debian, almost all packages that can talk to a LEGO Mindestorms
5003 RCX or NXT unit, announce this support using AppStream. The effect is
5004 that when you insert such LEGO robot controller into your Debian
5005 machine, Isenkram will propose to install the packages needed to get
5006 it working. The intention is that this should allow the local user to
5007 start programming his robot controller right away without having to
5008 guess what packages to use or which permissions to fix.
</p
>
5010 <p
>But when I sat down with my son the other day to program our NXT
5011 unit using his Debian Stretch computer, I discovered something
5012 annoying. The local console user (ie my son) did not get access to
5013 the USB device for programming the unit. This used to work, but no
5014 longer in Jessie and Stretch. After some investigation and asking
5015 around on #debian-devel, I discovered that this was because udev had
5016 changed the mechanism used to grant access to local devices. The
5017 ConsoleKit mechanism from
<tt
>/lib/udev/rules.d/
70-udev-acl.rules
</tt
>
5018 no longer applied, because LDAP users no longer was added to the
5019 plugdev group during login. Michael Biebl told me that this method
5020 was obsolete and the new method used ACLs instead. This was good
5021 news, as the plugdev mechanism is a mess when using a remote user
5022 directory like LDAP. Using ACLs would make sure a user lost device
5023 access when she logged out, even if the user left behind a background
5024 process which would retain the plugdev membership with the ConsoleKit
5025 setup. Armed with this knowledge I moved on to fix the access problem
5026 for the LEGO Mindstorms related packages.
</p
>
5028 <p
>The new system uses a udev tag,
'uaccess
'. It can either be
5029 applied directly for a device, or is applied in
5030 /lib/udev/rules.d/
70-uaccess.rules for classes of devices. As the
5031 LEGO Mindstorms udev rules did not have a class, I decided to add the
5032 tag directly in the udev rules files included in the packages. Here
5033 is one example. For the nqc C compiler for the RCX, the
5034 <tt
>/lib/udev/rules.d/
60-nqc.rules
</tt
> file now look like this:
5036 <p
><pre
>
5037 SUBSYSTEM==
"usb
", ACTION==
"add
", ATTR{idVendor}==
"0694", ATTR{idProduct}==
"0001", \
5038 SYMLINK+=
"rcx-%k
", TAG+=
"uaccess
"
5039 </pre
></p
>
5041 <p
>The key part is the
'TAG+=
"uaccess
"' at the end. I suspect all
5042 packages using plugdev in their /lib/udev/rules.d/ files should be
5043 changed to use this tag (either directly or indirectly via
5044 <tt
>70-uaccess.rules
</tt
>). Perhaps a lintian check should be created
5045 to detect this?
</p
>
5047 <p
>I
've been unable to find good documentation on the uaccess feature.
5048 It is unclear to me if the uaccess tag is an internal implementation
5049 detail like the udev-acl tag used by
5050 <tt
>/lib/udev/rules.d/
70-udev-acl.rules
</tt
>. If it is, I guess the
5051 indirect method is the preferred way. Michael
5052 <a href=
"https://github.com/systemd/systemd/issues/
4288">asked for more
5053 documentation from the systemd project
</a
> and I hope it will make
5054 this clearer. For now I use the generic classes when they exist and
5055 is already handled by
<tt
>70-uaccess.rules
</tt
>, and add the tag
5056 directly if no such class exist.
</p
>
5058 <p
>To learn more about the isenkram system, please check out
5059 <a href=
"http://www.hungry.com/~pere/blog/tags/isenkram/
">my
5060 blog posts tagged isenkram
</a
>.
</p
>
5062 <p
>To help out making life for LEGO constructors in Debian easier,
5063 please join us on our IRC channel
5064 <a href=
"irc://irc.debian.org/%
23debian-lego
">#debian-lego
</a
> and join
5065 the
<a href=
"https://alioth.debian.org/projects/debian-lego/
">Debian
5066 LEGO team
</a
> in the Alioth project we created yesterday. A mailing
5067 list is not yet created, but we are working on it. :)
</p
>
5069 <p
>As usual, if you use Bitcoin and want to show your support of my
5070 activities, please send Bitcoin donations to my address
5071 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
5076 <title>First draft Norwegian Bokmål edition of The Debian Administrator
's Handbook now public
</title>
5077 <link>http://www.hungry.com/~pere/blog/First_draft_Norwegian_Bokm_l_edition_of_The_Debian_Administrator_s_Handbook_now_public.html
</link>
5078 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/First_draft_Norwegian_Bokm_l_edition_of_The_Debian_Administrator_s_Handbook_now_public.html
</guid>
5079 <pubDate>Tue,
30 Aug
2016 10:
10:
00 +
0200</pubDate>
5080 <description><p
>In April we
5081 <a href=
"http://www.hungry.com/~pere/blog/Lets_make_a_Norwegian_Bokm_l_edition_of_The_Debian_Administrator_s_Handbook.html
">started
5082 to work
</a
> on a Norwegian Bokmål edition of the
"open access
" book on
5083 how to set up and administrate a Debian system. Today I am happy to
5084 report that the first draft is now publicly available. You can find
5085 it on
<a href=
"https://debian-handbook.info/get/
">get the Debian
5086 Administrator
's Handbook page
</a
> (under Other languages). The first
5087 eight chapters have a first draft translation, and we are working on
5088 proofreading the content. If you want to help out, please start
5090 <a href=
"https://hosted.weblate.org/projects/debian-handbook/
">the
5091 hosted weblate project page
</a
>, and get in touch using
5092 <a href=
"http://lists.alioth.debian.org/mailman/listinfo/debian-handbook-translators
">the
5093 translators mailing list
</a
>. Please also check out
5094 <a href=
"https://debian-handbook.info/contribute/
">the instructions for
5095 contributors
</a
>. A good way to contribute is to proofread the text
5096 and update weblate if you find errors.
</p
>
5098 <p
>Our goal is still to make the Norwegian book available on paper as well as
5099 electronic form.
</p
>
5104 <title>Coz can help you find bottlenecks in multi-threaded software - nice free software
</title>
5105 <link>http://www.hungry.com/~pere/blog/Coz_can_help_you_find_bottlenecks_in_multi_threaded_software___nice_free_software.html
</link>
5106 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Coz_can_help_you_find_bottlenecks_in_multi_threaded_software___nice_free_software.html
</guid>
5107 <pubDate>Thu,
11 Aug
2016 12:
00:
00 +
0200</pubDate>
5108 <description><p
>This summer, I read a great article
5109 "<a href=
"https://www.usenix.org/publications/login/summer2016/curtsinger
">coz:
5110 This Is the Profiler You
're Looking For
</a
>" in USENIX ;login: about
5111 how to profile multi-threaded programs. It presented a system for
5112 profiling software by running experiences in the running program,
5113 testing how run time performance is affected by
"speeding up
" parts of
5114 the code to various degrees compared to a normal run. It does this by
5115 slowing down parallel threads while the
"faster up
" code is running
5116 and measure how this affect processing time. The processing time is
5117 measured using probes inserted into the code, either using progress
5118 counters (COZ_PROGRESS) or as latency meters (COZ_BEGIN/COZ_END). It
5119 can also measure unmodified code by measuring complete the program
5120 runtime and running the program several times instead.
</p
>
5122 <p
>The project and presentation was so inspiring that I would like to
5123 get the system into Debian. I
5124 <a href=
"https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=
830708">created
5125 a WNPP request for it
</a
> and contacted upstream to try to make the
5126 system ready for Debian by sending patches. The build process need to
5127 be changed a bit to avoid running
'git clone
' to get dependencies, and
5128 to include the JavaScript web page used to visualize the collected
5129 profiling information included in the source package.
5130 But I expect that should work out fairly soon.
</p
>
5132 <p
>The way the system work is fairly simple. To run an coz experiment
5133 on a binary with debug symbols available, start the program like this:
5135 <p
><blockquote
><pre
>
5136 coz run --- program-to-run
5137 </pre
></blockquote
></p
>
5139 <p
>This will create a text file profile.coz with the instrumentation
5140 information. To show what part of the code affect the performance
5141 most, use a web browser and either point it to
5142 <a href=
"http://plasma-umass.github.io/coz/
">http://plasma-umass.github.io/coz/
</a
>
5143 or use the copy from git (in the gh-pages branch). Check out this web
5144 site to have a look at several example profiling runs and get an idea what the end result from the profile runs look like. To make the
5145 profiling more useful you include
&lt;coz.h
&gt; and insert the
5146 COZ_PROGRESS or COZ_BEGIN and COZ_END at appropriate places in the
5147 code, rebuild and run the profiler. This allow coz to do more
5148 targeted experiments.
</p
>
5150 <p
>A video published by ACM
5151 <a href=
"https://www.youtube.com/watch?v=jE0V-p1odPg
">presenting the
5152 Coz profiler
</a
> is available from Youtube. There is also a paper
5153 from the
25th Symposium on Operating Systems Principles available
5155 <a href=
"https://www.usenix.org/conference/atc16/technical-sessions/presentation/curtsinger
">Coz:
5156 finding code that counts with causal profiling
</a
>.
</p
>
5158 <p
><a href=
"https://github.com/plasma-umass/coz
">The source code
</a
>
5159 for Coz is available from github. It will only build with clang
5161 <a href=
"https://gcc.gnu.org/bugzilla/show_bug.cgi?id=
55606">C++
5162 feature missing in GCC
</a
>, but I
've submitted
5163 <a href=
"https://github.com/plasma-umass/coz/pull/
67">a patch to solve
5164 it
</a
> and hope it will be included in the upstream source soon.
</p
>
5166 <p
>Please get in touch if you, like me, would like to see this piece
5167 of software in Debian. I would very much like some help with the
5168 packaging effort, as I lack the in depth knowledge on how to package
5169 C++ libraries.
</p
>
5174 <title>Unlocking HTC Desire HD on Linux using unruu and fastboot
</title>
5175 <link>http://www.hungry.com/~pere/blog/Unlocking_HTC_Desire_HD_on_Linux_using_unruu_and_fastboot.html
</link>
5176 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Unlocking_HTC_Desire_HD_on_Linux_using_unruu_and_fastboot.html
</guid>
5177 <pubDate>Thu,
7 Jul
2016 11:
30:
00 +
0200</pubDate>
5178 <description><p
>Yesterday, I tried to unlock a HTC Desire HD phone, and it proved
5179 to be a slight challenge. Here is the recipe if I ever need to do it
5180 again. It all started by me wanting to try the recipe to set up
5181 <a href=
"https://blog.torproject.org/blog/mission-impossible-hardening-android-security-and-privacy
">an
5182 hardened Android installation
</a
> from the Tor project blog on a
5183 device I had access to. It is a old mobile phone with a broken
5184 microphone The initial idea had been to just
5185 <a href=
"http://wiki.cyanogenmod.org/w/Install_CM_for_ace
">install
5186 CyanogenMod on it
</a
>, but did not quite find time to start on it
5187 until a few days ago.
</p
>
5189 <p
>The unlock process is supposed to be simple: (
1) Boot into the boot
5190 loader (press volume down and power at the same time), (
2) select
5191 'fastboot
' before (
3) connecting the device via USB to a Linux
5192 machine, (
4) request the device identifier token by running
'fastboot
5193 oem get_identifier_token
', (
5) request the device unlocking key using
5194 the
<a href=
"http://www.htcdev.com/bootloader/
">HTC developer web
5195 site
</a
> and unlock the phone using the key file emailed to you.
</p
>
5197 <p
>Unfortunately, this only work fi you have hboot version
2.00.0029
5198 or newer, and the device I was working on had
2.00.0027. This
5199 apparently can be easily fixed by downloading a Windows program and
5200 running it on your Windows machine, if you accept the terms Microsoft
5201 require you to accept to use Windows - which I do not. So I had to
5202 come up with a different approach. I got a lot of help from AndyCap
5203 on #nuug, and would not have been able to get this working without
5206 <p
>First I needed to extract the hboot firmware from
5207 <a href=
"http://www.htcdev.com/ruu/PD9810000_Ace_Sense30_S_hboot_2.00
.0029.exe
">the
5208 windows binary for HTC Desire HD
</a
> downloaded as
'the RUU
' from HTC.
5209 For this there is is
<a href=
"https://github.com/kmdm/unruu/
">a github
5210 project named unruu
</a
> using libunshield. The unshield tool did not
5211 recognise the file format, but unruu worked and extracted rom.zip,
5212 containing the new hboot firmware and a text file describing which
5213 devices it would work for.
</p
>
5215 <p
>Next, I needed to get the new firmware into the device. For this I
5216 followed some instructions
5217 <a href=
"http://www.htc1guru.com/
2013/
09/new-ruu-zips-posted/
">available
5218 from HTC1Guru.com
</a
>, and ran these commands as root on a Linux
5219 machine with Debian testing:
</p
>
5221 <p
><pre
>
5222 adb reboot-bootloader
5223 fastboot oem rebootRUU
5224 fastboot flash zip rom.zip
5225 fastboot flash zip rom.zip
5227 </pre
></p
>
5229 <p
>The flash command apparently need to be done twice to take effect,
5230 as the first is just preparations and the second one do the flashing.
5231 The adb command is just to get to the boot loader menu, so turning the
5232 device on while holding volume down and the power button should work
5235 <p
>With the new hboot version in place I could start following the
5236 instructions on the HTC developer web site. I got the device token
5237 like this:
</p
>
5239 <p
><pre
>
5240 fastboot oem get_identifier_token
2>&1 | sed
's/(bootloader) //
'
5243 <p
>And once I got the unlock code via email, I could use it like
5246 <p
><pre
>
5247 fastboot flash unlocktoken Unlock_code.bin
5248 </pre
></p
>
5250 <p
>And with that final step in place, the phone was unlocked and I
5251 could start stuffing the software of my own choosing into the device.
5252 So far I only inserted a replacement recovery image to wipe the phone
5253 before I start. We will see what happen next. Perhaps I should
5254 install
<a href=
"https://www.debian.org/
">Debian
</a
> on it. :)
</p
>
5259 <title>How to use the Signal app if you only have a land line (ie no mobile phone)
</title>
5260 <link>http://www.hungry.com/~pere/blog/How_to_use_the_Signal_app_if_you_only_have_a_land_line__ie_no_mobile_phone_.html
</link>
5261 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_use_the_Signal_app_if_you_only_have_a_land_line__ie_no_mobile_phone_.html
</guid>
5262 <pubDate>Sun,
3 Jul
2016 14:
20:
00 +
0200</pubDate>
5263 <description><p
>For a while now, I have wanted to test
5264 <a href=
"https://whispersystems.org/
">the Signal app
</a
>, as it is
5265 said to provide end to end encrypted communication and several of my
5266 friends and family are already using it. As I by choice do not own a
5267 mobile phone, this proved to be harder than expected. And I wanted to
5268 have the source of the client and know that it was the code used on my
5269 machine. But yesterday I managed to get it working. I used the
5270 Github source, compared it to the source in
5271 <a href=
"https://chrome.google.com/webstore/detail/signal-private-messenger/bikioccmkafdpakkkcpdbppfkghcmihk?hl=en-US
">the
5272 Signal Chrome app
</a
> available from the Chrome web store, applied
5273 patches to use the production Signal servers, started the app and
5274 asked for the hidden
"register without a smart phone
" form. Here is
5275 the recipe how I did it.
</p
>
5277 <p
>First, I fetched the Signal desktop source from Github, using
5280 git clone https://github.com/WhisperSystems/Signal-Desktop.git
5283 <p
>Next, I patched the source to use the production servers, to be
5284 able to talk to other Signal users:
</p
>
5287 cat
&lt;
&lt;EOF | patch -p0
5288 diff -ur ./js/background.js userdata/Default/Extensions/bikioccmkafdpakkkcpdbppfkghcmihk/
0.15.0_0/js/background.js
5289 --- ./js/background.js
2016-
06-
29 13:
43:
15.630344628 +
0200
5290 +++ userdata/Default/Extensions/bikioccmkafdpakkkcpdbppfkghcmihk/
0.15.0_0/js/background.js
2016-
06-
29 14:
06:
29.530300934 +
0200
5295 - var SERVER_URL =
'https://textsecure-service-staging.whispersystems.org
';
5296 - var ATTACHMENT_SERVER_URL =
'https://whispersystems-textsecure-attachments-staging.s3.amazonaws.com
';
5297 + var SERVER_URL =
'https://textsecure-service-ca.whispersystems.org:
4433';
5298 + var ATTACHMENT_SERVER_URL =
'https://whispersystems-textsecure-attachments.s3.amazonaws.com
';
5299 var messageReceiver;
5300 window.getSocketStatus = function() {
5301 if (messageReceiver) {
5302 diff -ur ./js/expire.js userdata/Default/Extensions/bikioccmkafdpakkkcpdbppfkghcmihk/
0.15.0_0/js/expire.js
5303 --- ./js/expire.js
2016-
06-
29 13:
43:
15.630344628 +
0200
5304 +++ userdata/Default/Extensions/bikioccmkafdpakkkcpdbppfkghcmihk/
0.15.0_0/js/expire.js2016-
06-
29 14:
06:
29.530300934 +
0200
5307 'use strict
';
5308 - var BUILD_EXPIRATION =
0;
5309 + var BUILD_EXPIRATION =
1474492690000;
5311 window.extension = window.extension || {};
5316 <p
>The first part is changing the servers, and the second is updating
5317 an expiration timestamp. This timestamp need to be updated regularly.
5318 It is set
90 days in the future by the build process (Gruntfile.js).
5319 The value is seconds since
1970 times
1000, as far as I can tell.
</p
>
5321 <p
>Based on a tip and good help from the #nuug IRC channel, I wrote a
5322 script to launch Signal in Chromium.
</p
>
5329 --proxy-server=
"socks://localhost:
9050" \
5330 --user-data-dir=`pwd`/userdata --load-and-launch-app=`pwd`
5333 <p
> The script start the app and configure Chromium to use the Tor
5334 SOCKS5 proxy to make sure those controlling the Signal servers (today
5335 Amazon and Whisper Systems) as well as those listening on the lines
5336 will have a harder time location my laptop based on the Signal
5337 connections if they use source IP address.
</p
>
5339 <p
>When the script starts, one need to follow the instructions under
5340 "Standalone Registration
" in the CONTRIBUTING.md file in the git
5341 repository. I right clicked on the Signal window to get up the
5342 Chromium debugging tool, visited the
'Console
' tab and wrote
5343 'extension.install(
"standalone
")
' on the console prompt to get the
5344 registration form. Then I entered by land line phone number and
5345 pressed
'Call
'.
5 seconds later the phone rang and a robot voice
5346 repeated the verification code three times. After entering the number
5347 into the verification code field in the form, I could start using
5348 Signal from my laptop.
5350 <p
>As far as I can tell, The Signal app will leak who is talking to
5351 whom and thus who know who to those controlling the central server,
5352 but such leakage is hard to avoid with a centrally controlled server
5353 setup. It is something to keep in mind when using Signal - the
5354 content of your chats are harder to intercept, but the meta data
5355 exposing your contact network is available to people you do not know.
5356 So better than many options, but not great. And sadly the usage is
5357 connected to my land line, thus allowing those controlling the server
5358 to associate it to my home and person. I would prefer it if only
5359 those I knew could tell who I was on Signal. There are options
5360 avoiding such information leakage, but most of my friends are not
5361 using them, so I am stuck with Signal for now.
</p
>
5363 <p
><strong
>Update
2017-
01-
10</strong
>: There is an updated blog post
5365 <a href=
"http://www.hungry.com/~pere/blog/Experience_and_updated_recipe_for_using_the_Signal_app_without_a_mobile_phone.html
">Experience
5366 and updated recipe for using the Signal app without a mobile
5367 phone
</a
>.
</p
>
5372 <title>The new
"best
" multimedia player in Debian?
</title>
5373 <link>http://www.hungry.com/~pere/blog/The_new__best__multimedia_player_in_Debian_.html
</link>
5374 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_new__best__multimedia_player_in_Debian_.html
</guid>
5375 <pubDate>Mon,
6 Jun
2016 12:
50:
00 +
0200</pubDate>
5376 <description><p
>When I set out a few weeks ago to figure out
5377 <a href=
"http://www.hungry.com/~pere/blog/What_is_the_best_multimedia_player_in_Debian_.html
">which
5378 multimedia player in Debian claimed to support most file formats /
5379 MIME types
</a
>, I was a bit surprised how varied the sets of MIME types
5380 the various players claimed support for. The range was from
55 to
130
5381 MIME types. I suspect most media formats are supported by all
5382 players, but this is not really reflected in the MimeTypes values in
5383 their desktop files. There are probably also some bogus MIME types
5384 listed, but it is hard to identify which one this is.
</p
>
5386 <p
>Anyway, in the mean time I got in touch with upstream for some of
5387 the players suggesting to add more MIME types to their desktop files,
5388 and decided to spend some time myself improving the situation for my
5389 favorite media player VLC. The fixes for VLC entered Debian unstable
5390 yesterday. The complete list of MIME types can be seen on the
5391 <a href=
"https://wiki.debian.org/DebianMultimedia/PlayerSupport
">Multimedia
5392 player MIME type support status
</a
> Debian wiki page.
</p
>
5394 <p
>The new
"best
" multimedia player in Debian? It is VLC, followed by
5395 totem, parole, kplayer, gnome-mpv, mpv, smplayer, mplayer-gui and
5396 kmplayer. I am sure some of the other players desktop files support
5397 several of the formats currently listed as working only with vlc,
5398 toten and parole.
</p
>
5400 <p
>A sad observation is that only
14 MIME types are listed as
5401 supported by all the tested multimedia players in Debian in their
5402 desktop files: audio/mpeg, audio/vnd.rn-realaudio, audio/x-mpegurl,
5403 audio/x-ms-wma, audio/x-scpls, audio/x-wav, video/mp4, video/mpeg,
5404 video/quicktime, video/vnd.rn-realvideo, video/x-matroska,
5405 video/x-ms-asf, video/x-ms-wmv and video/x-msvideo. Personally I find
5406 it sad that video/ogg and video/webm is not supported by all the media
5407 players in Debian. As far as I can tell, all of them can handle both
5413 <title>A program should be able to open its own files on Linux
</title>
5414 <link>http://www.hungry.com/~pere/blog/A_program_should_be_able_to_open_its_own_files_on_Linux.html
</link>
5415 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/A_program_should_be_able_to_open_its_own_files_on_Linux.html
</guid>
5416 <pubDate>Sun,
5 Jun
2016 08:
30:
00 +
0200</pubDate>
5417 <description><p
>Many years ago, when koffice was fresh and with few users, I
5418 decided to test its presentation tool when making the slides for a
5419 talk I was giving for NUUG on Japhar, a free Java virtual machine. I
5420 wrote the first draft of the slides, saved the result and went to bed
5421 the day before I would give the talk. The next day I took a plane to
5422 the location where the meeting should take place, and on the plane I
5423 started up koffice again to polish the talk a bit, only to discover
5424 that kpresenter refused to load its own data file. I cursed a bit and
5425 started making the slides again from memory, to have something to
5426 present when I arrived. I tested that the saved files could be
5427 loaded, and the day seemed to be rescued. I continued to polish the
5428 slides until I suddenly discovered that the saved file could no longer
5429 be loaded into kpresenter. In the end I had to rewrite the slides
5430 three times, condensing the content until the talk became shorter and
5431 shorter. After the talk I was able to pinpoint the problem
&ndash;
5432 kpresenter wrote inline images in a way itself could not understand.
5433 Eventually that bug was fixed and kpresenter ended up being a great
5434 program to make slides. The point I
'm trying to make is that we
5435 expect a program to be able to load its own data files, and it is
5436 embarrassing to its developers if it can
't.
</p
>
5438 <p
>Did you ever experience a program failing to load its own data
5439 files from the desktop file browser? It is not a uncommon problem. A
5440 while back I discovered that the screencast recorder
5441 gtk-recordmydesktop would save an Ogg Theora video file the KDE file
5442 browser would refuse to open. No video player claimed to understand
5443 such file. I tracked down the cause being
<tt
>file --mime-type
</tt
>
5444 returning the application/ogg MIME type, which no video player I had
5445 installed listed as a MIME type they would understand. I asked for
5446 <a href=
"http://bugs.gw.com/view.php?id=
382">file to change its
5447 behavour
</a
> and use the MIME type video/ogg instead. I also asked
5448 several video players to add video/ogg to their desktop files, to give
5449 the file browser an idea what to do about Ogg Theora files. After a
5450 while, the desktop file browsers in Debian started to handle the
5451 output from gtk-recordmydesktop properly.
</p
>
5453 <p
>But history repeats itself. A few days ago I tested the music
5454 system Rosegarden again, and I discovered that the KDE and xfce file
5455 browsers did not know what to do with the Rosegarden project files
5456 (*.rg). I
've reported
<a href=
"http://bugs.debian.org/
825993">the
5457 rosegarden problem to BTS
</a
> and a fix is commited to git and will be
5458 included in the next upload. To increase the chance of me remembering
5459 how to fix the problem next time some program fail to load its files
5460 from the file browser, here are some notes on how to fix it.
</p
>
5462 <p
>The file browsers in Debian in general operates on MIME types.
5463 There are two sources for the MIME type of a given file. The output from
5464 <tt
>file --mime-type
</tt
> mentioned above, and the content of the
5465 shared MIME type registry (under /usr/share/mime/). The file MIME
5466 type is mapped to programs supporting the MIME type, and this
5467 information is collected from
5468 <a href=
"https://www.freedesktop.org/wiki/Specifications/desktop-entry-spec/
">the
5469 desktop files
</a
> available in /usr/share/applications/. If there is
5470 one desktop file claiming support for the MIME type of the file, it is
5471 activated when asking to open a given file. If there are more, one
5472 can normally select which one to use by right-clicking on the file and
5473 selecting the wanted one using
'Open with
' or similar. In general
5474 this work well. But it depend on each program picking a good MIME
5476 <a href=
"http://www.iana.org/assignments/media-types/media-types.xhtml
">a
5477 MIME type registered with IANA
</a
>), file and/or the shared MIME
5478 registry recognizing the file and the desktop file to list the MIME
5479 type in its list of supported MIME types.
</p
>
5481 <p
>The
<tt
>/usr/share/mime/packages/rosegarden.xml
</tt
> entry for
5482 <a href=
"http://www.freedesktop.org/wiki/Specifications/shared-mime-info-spec
">the
5483 Shared MIME database
</a
> look like this:
</p
>
5485 <p
><blockquote
><pre
>
5486 &lt;?xml version=
"1.0" encoding=
"UTF-
8"?
&gt;
5487 &lt;mime-info xmlns=
"http://www.freedesktop.org/standards/shared-mime-info
"&gt;
5488 &lt;mime-type type=
"audio/x-rosegarden
"&gt;
5489 &lt;sub-class-of type=
"application/x-gzip
"/
&gt;
5490 &lt;comment
&gt;Rosegarden project file
&lt;/comment
&gt;
5491 &lt;glob pattern=
"*.rg
"/
&gt;
5492 &lt;/mime-type
&gt;
5493 &lt;/mime-info
&gt;
5494 </pre
></blockquote
></p
>
5496 <p
>This states that audio/x-rosegarden is a kind of application/x-gzip
5497 (it is a gzipped XML file). Note, it is much better to use an
5498 official MIME type registered with IANA than it is to make up ones own
5499 unofficial ones like the x-rosegarden type used by rosegarden.
</p
>
5501 <p
>The desktop file of the rosegarden program failed to list
5502 audio/x-rosegarden in its list of supported MIME types, causing the
5503 file browsers to have no idea what to do with *.rg files:
</p
>
5505 <p
><blockquote
><pre
>
5506 % grep Mime /usr/share/applications/rosegarden.desktop
5507 MimeType=audio/x-rosegarden-composition;audio/x-rosegarden-device;audio/x-rosegarden-project;audio/x-rosegarden-template;audio/midi;
5508 X-KDE-NativeMimeType=audio/x-rosegarden-composition
5510 </pre
></blockquote
></p
>
5512 <p
>The fix was to add
"audio/x-rosegarden;
" at the end of the
5513 MimeType= line.
</p
>
5515 <p
>If you run into a file which fail to open the correct program when
5516 selected from the file browser, please check out the output from
5517 <tt
>file --mime-type
</tt
> for the file, ensure the file ending and
5518 MIME type is registered somewhere under /usr/share/mime/ and check
5519 that some desktop file under /usr/share/applications/ is claiming
5520 support for this MIME type. If not, please report a bug to have it
5526 <title>Isenkram with PackageKit support - new version
0.23 available in Debian unstable
</title>
5527 <link>http://www.hungry.com/~pere/blog/Isenkram_with_PackageKit_support___new_version_0_23_available_in_Debian_unstable.html
</link>
5528 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Isenkram_with_PackageKit_support___new_version_0_23_available_in_Debian_unstable.html
</guid>
5529 <pubDate>Wed,
25 May
2016 10:
20:
00 +
0200</pubDate>
5530 <description><p
><a href=
"https://tracker.debian.org/pkg/isenkram
">The isenkram
5531 system
</a
> is a user-focused solution in Debian for handling hardware
5532 related packages. The idea is to have a database of mappings between
5533 hardware and packages, and pop up a dialog suggesting for the user to
5534 install the packages to use a given hardware dongle. Some use cases
5535 are when you insert a Yubikey, it proposes to install the software
5536 needed to control it; when you insert a braille reader list it
5537 proposes to install the packages needed to send text to the reader;
5538 and when you insert a ColorHug screen calibrator it suggests to
5539 install the driver for it. The system work well, and even have a few
5540 command line tools to install firmware packages and packages for the
5541 hardware already in the machine (as opposed to hotpluggable hardware).
</p
>
5543 <p
>The system was initially written using aptdaemon, because I found
5544 good documentation and example code on how to use it. But aptdaemon
5545 is going away and is generally being replaced by
5546 <a href=
"http://www.freedesktop.org/software/PackageKit/
">PackageKit
</a
>,
5547 so Isenkram needed a rewrite. And today, thanks to the great patch
5548 from my college Sunil Mohan Adapa in the FreedomBox project, the
5549 rewrite finally took place. I
've just uploaded a new version of
5550 Isenkram into Debian Unstable with the patch included, and the default
5551 for the background daemon is now to use PackageKit. To check it out,
5552 install the
<tt
>isenkram
</tt
> package and insert some hardware dongle
5553 and see if it is recognised.
</p
>
5555 <p
>If you want to know what kind of packages isenkram would propose for
5556 the machine it is running on, you can check out the isenkram-lookup
5557 program. This is what it look like on a Thinkpad X230:
</p
>
5559 <p
><blockquote
><pre
>
5575 </pre
></blockquote
></p
>
5577 <p
>The hardware mappings come from several places. The preferred way
5578 is for packages to announce their hardware support using
5579 <a href=
"https://www.freedesktop.org/software/appstream/docs/
">the
5580 cross distribution appstream system
</a
>.
5582 <a href=
"http://www.hungry.com/~pere/blog/tags/isenkram/
">previous
5583 blog posts about isenkram
</a
> to learn how to do that.
</p
>
5588 <title>Discharge rate estimate in new battery statistics collector for Debian
</title>
5589 <link>http://www.hungry.com/~pere/blog/Discharge_rate_estimate_in_new_battery_statistics_collector_for_Debian.html
</link>
5590 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Discharge_rate_estimate_in_new_battery_statistics_collector_for_Debian.html
</guid>
5591 <pubDate>Mon,
23 May
2016 09:
35:
00 +
0200</pubDate>
5592 <description><p
>Yesterday I updated the
5593 <a href=
"https://tracker.debian.org/pkg/battery-stats
">battery-stats
5594 package in Debian
</a
> with a few patches sent to me by skilled and
5595 enterprising users. There were some nice user and visible changes.
5596 First of all, both desktop menu entries now work. A design flaw in
5597 one of the script made the history graph fail to show up (its PNG was
5598 dumped in ~/.xsession-errors) if no controlling TTY was available.
5599 The script worked when called from the command line, but not when
5600 called from the desktop menu. I changed this to look for a DISPLAY
5601 variable or a TTY before deciding where to draw the graph, and now the
5602 graph window pop up as expected.
</p
>
5604 <p
>The next new feature is a discharge rate estimator in one of the
5605 graphs (the one showing the last few hours). New is also the user of
5606 colours showing charging in blue and discharge in red. The percentages
5607 of this graph is relative to last full charge, not battery design
5610 <p align=
"center
"><img src=
"http://www.hungry.com/~pere/blog/images/
2016-
05-
23-battery-stats-rate.png
"/
></p
>
5612 <p
>The other graph show the entire history of the collected battery
5613 statistics, comparing it to the design capacity of the battery to
5614 visualise how the battery life time get shorter over time. The red
5615 line in this graph is what the previous graph considers
100 percent:
5617 <p align=
"center
"><img src=
"http://www.hungry.com/~pere/blog/images/
2016-
05-
23-battery-stats-history.png
"/
></p
>
5619 <p
>In this graph you can see that I only charge the battery to
80
5620 percent of last full capacity, and how the capacity of the battery is
5621 shrinking. :(
</p
>
5623 <p
>The last new feature is in the collector, which now will handle
5624 more hardware models. On some hardware, Linux power supply
5625 information is stored in /sys/class/power_supply/ACAD/, while the
5626 collector previously only looked in /sys/class/power_supply/AC/. Now
5627 both are checked to figure if there is power connected to the
5630 <p
>If you are interested in how your laptop battery is doing, please
5632 <a href=
"https://tracker.debian.org/pkg/battery-stats
">battery-stats
</a
>
5633 in Debian unstable, or rebuild it on Jessie to get it working on
5634 Debian stable. :) The upstream source is available from
<a
5635 href=
"https://github.com/petterreinholdtsen/battery-stats
">github
</a
>.
5636 Patches are very welcome.
</p
>
5638 <p
>As usual, if you use Bitcoin and want to show your support of my
5639 activities, please send Bitcoin donations to my address
5640 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
5645 <title>Debian now with ZFS on Linux included
</title>
5646 <link>http://www.hungry.com/~pere/blog/Debian_now_with_ZFS_on_Linux_included.html
</link>
5647 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_now_with_ZFS_on_Linux_included.html
</guid>
5648 <pubDate>Thu,
12 May
2016 07:
30:
00 +
0200</pubDate>
5649 <description><p
>Today, after many years of hard work from many people,
5650 <a href=
"http://zfsonlinux.org/
">ZFS for Linux
</a
> finally entered
5651 Debian. The package status can be seen on
5652 <a href=
"https://tracker.debian.org/pkg/zfs-linux
">the package tracker
5653 for zfs-linux
</a
>. and
5654 <a href=
"https://qa.debian.org/developer.php?login=pkg-zfsonlinux-devel@lists.alioth.debian.org
">the
5655 team status page
</a
>. If you want to help out, please join us.
5656 <a href=
"http://anonscm.debian.org/gitweb/?p=pkg-zfsonlinux/zfs.git
">The
5657 source code
</a
> is available via git on Alioth. It would also be
5658 great if you could help out with
5659 <a href=
"https://tracker.debian.org/pkg/dkms
">the dkms package
</a
>, as
5660 it is an important piece of the puzzle to get ZFS working.
</p
>
5665 <title>What is the best multimedia player in Debian?
</title>
5666 <link>http://www.hungry.com/~pere/blog/What_is_the_best_multimedia_player_in_Debian_.html
</link>
5667 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_is_the_best_multimedia_player_in_Debian_.html
</guid>
5668 <pubDate>Sun,
8 May
2016 09:
40:
00 +
0200</pubDate>
5669 <description><p
><strong
>Where I set out to figure out which multimedia player in
5670 Debian claim support for most file formats.
</strong
></p
>
5672 <p
>A few years ago, I had a look at the media support for Browser
5673 plugins in Debian, to get an idea which plugins to include in Debian
5674 Edu. I created a script to extract the set of supported MIME types
5675 for each plugin, and used this to find out which multimedia browser
5676 plugin supported most file formats / media types.
5677 <a href=
"https://wiki.debian.org/DebianEdu/BrowserMultimedia
">The
5678 result
</a
> can still be seen on the Debian wiki, even though it have
5679 not been updated for a while. But browser plugins are less relevant
5680 these days, so I thought it was time to look at standalone
5683 <p
>A few days ago I was tired of VLC not being listed as a viable
5684 player when I wanted to play videos from the Norwegian National
5685 Broadcasting Company, and decided to investigate why. The cause is a
5686 <a href=
"https://bugs.debian.org/
822245">missing MIME type in the VLC
5687 desktop file
</a
>. In the process I wrote a script to compare the set
5688 of MIME types announced in the desktop file and the browser plugin,
5689 only to discover that there is quite a large difference between the
5690 two for VLC. This discovery made me dig up the script I used to
5691 compare browser plugins, and adjust it to compare desktop files
5692 instead, to try to figure out which multimedia player in Debian
5693 support most file formats.
</p
>
5695 <p
>The result can be seen on the Debian Wiki, as
5696 <a href=
"https://wiki.debian.org/DebianMultimedia/PlayerSupport
">a
5697 table listing all MIME types supported by one of the packages included
5698 in the table
</a
>, with the package supporting most MIME types being
5699 listed first in the table.
</p
>
5701 </p
>The best multimedia player in Debian? It is totem, followed by
5702 parole, kplayer, mpv, vlc, smplayer mplayer-gui gnome-mpv and
5703 kmplayer. Time for the other players to update their announced MIME
5709 <title>The Pyra - handheld computer with Debian preinstalled
</title>
5710 <link>http://www.hungry.com/~pere/blog/The_Pyra___handheld_computer_with_Debian_preinstalled.html
</link>
5711 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_Pyra___handheld_computer_with_Debian_preinstalled.html
</guid>
5712 <pubDate>Wed,
4 May
2016 10:
00:
00 +
0200</pubDate>
5713 <description>A friend of mine made me aware of
5714 <a href=
"https://pyra-handheld.com/boards/pages/pyra/
">The Pyra
</a
>, a
5715 handheld computer which will be delivered with Debian preinstalled. I
5716 would love to get one of those for my birthday. :)
</p
>
5718 <p
>The machine is a complete ARM-based PC with micro HDMI, SATA, USB
5719 plugs and many others connectors, and include a full keyboard and a
5"
5720 LCD touch screen. The
6000mAh battery is claimed to provide a whole
5721 day of battery life time, but I have not seen any independent tests
5722 confirming this. The vendor is still collecting preorders, and the
5723 last I heard last night was that
22 more orders were needed before
5724 production started.
</p
>
5726 <p
>As far as I know, this is the first handheld preinstalled with
5727 Debian. Please let me know if you know of any others. Is it the
5728 first computer being sold with Debian preinstalled?
</p
>
5733 <title>Lets make a Norwegian Bokmål edition of The Debian Administrator
's Handbook
</title>
5734 <link>http://www.hungry.com/~pere/blog/Lets_make_a_Norwegian_Bokm_l_edition_of_The_Debian_Administrator_s_Handbook.html
</link>
5735 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Lets_make_a_Norwegian_Bokm_l_edition_of_The_Debian_Administrator_s_Handbook.html
</guid>
5736 <pubDate>Sun,
10 Apr
2016 23:
20:
00 +
0200</pubDate>
5737 <description><p
>During this weekends
5738 <a href=
"http://www.nuug.no/news/Oslo__Takk_for_feilfiksingsfesten.shtml
">bug
5739 squashing party and developer gathering
</a
>, we decided to do our part
5740 to make sure there are good books about Debian available in Norwegian
5741 Bokmål, and got in touch with the people behind the
5742 <a href=
"http://debian-handbook.info/
">Debian Administrator
's Handbook
5743 project
</a
> to get started. If you want to help out, please start
5745 <a href=
"https://hosted.weblate.org/projects/debian-handbook/
">the
5746 hosted weblate project page
</a
>, and get in touch using
5747 <a href=
"http://lists.alioth.debian.org/mailman/listinfo/debian-handbook-translators
">the
5748 translators mailing list
</a
>. Please also check out
5749 <a href=
"https://debian-handbook.info/contribute/
">the instructions for
5750 contributors
</a
>.
</p
>
5752 <p
>The book is already available on paper in English, French and
5753 Japanese, and our goal is to get it available on paper in Norwegian
5754 Bokmål too. In addition to the paper edition, there are also EPUB and
5755 Mobi versions available. And there are incomplete translations
5756 available for many more languages.
</p
>
5761 <title>One in two hundred Debian users using ZFS on Linux?
</title>
5762 <link>http://www.hungry.com/~pere/blog/One_in_two_hundred_Debian_users_using_ZFS_on_Linux_.html
</link>
5763 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/One_in_two_hundred_Debian_users_using_ZFS_on_Linux_.html
</guid>
5764 <pubDate>Thu,
7 Apr
2016 22:
30:
00 +
0200</pubDate>
5765 <description><p
>Just for fun I had a look at the popcon number of ZFS related
5766 packages in Debian, and was quite surprised with what I found. I use
5767 ZFS myself at home, but did not really expect many others to do so.
5768 But I might be wrong.
</p
>
5770 <p
>According to
5771 <a href=
"https://qa.debian.org/popcon.php?package=spl-linux
">the popcon
5772 results for spl-linux
</a
>, there are
1019 Debian installations, or
5773 0.53% of the population, with the package installed. As far as I know
5774 the only use of the spl-linux package is as a support library for ZFS
5775 on Linux, so I use it here as proxy for measuring the number of ZFS
5776 installation on Linux in Debian. In the kFreeBSD variant of Debian
5777 the ZFS feature is already available, and there
5778 <a href=
"https://qa.debian.org/popcon.php?package=zfsutils
">the popcon
5779 results for zfsutils
</a
> show
1625 Debian installations or
0.84% of
5780 the population. So I guess I am not alone in using ZFS on Debian.
</p
>
5782 <p
>But even though the Debian project leader Lucas Nussbaum
5783 <a href=
"https://lists.debian.org/debian-devel-announce/
2015/
04/msg00006.html
">announced
5784 in April
2015</a
> that the legal obstacles blocking ZFS on Debian were
5785 cleared, the package is still not in Debian. The package is again in
5786 the NEW queue. Several uploads have been rejected so far because the
5787 debian/copyright file was incomplete or wrong, but there is no reason
5788 to give up. The current status can be seen on
5789 <a href=
"https://qa.debian.org/developer.php?login=pkg-zfsonlinux-devel@lists.alioth.debian.org
">the
5790 team status page
</a
>, and
5791 <a href=
"http://anonscm.debian.org/gitweb/?p=pkg-zfsonlinux/zfs.git
">the
5792 source code
</a
> is available on Alioth.
</p
>
5794 <p
>As I want ZFS to be included in next version of Debian to make sure
5795 my home server can function in the future using only official Debian
5796 packages, and the current blocker is to get the debian/copyright file
5797 accepted by the FTP masters in Debian, I decided a while back to try
5798 to help out the team. This was the background for my blog post about
5799 <a href=
"http://www.hungry.com/~pere/blog/Creating__updating_and_checking_debian_copyright_semi_automatically.html
">creating,
5800 updating and checking debian/copyright semi-automatically
</a
>, and I
5801 used the techniques I explored there to try to find any errors in the
5802 copyright file. It is not very easy to check every one of the around
5803 2000 files in the source package, but I hope we this time got it
5804 right. If you want to help out, check out the git source and try to
5805 find missing entries in the debian/copyright file.
</p
>
5810 <title>Full battery stats collector is now available in Debian
</title>
5811 <link>http://www.hungry.com/~pere/blog/Full_battery_stats_collector_is_now_available_in_Debian.html
</link>
5812 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Full_battery_stats_collector_is_now_available_in_Debian.html
</guid>
5813 <pubDate>Wed,
23 Mar
2016 22:
10:
00 +
0100</pubDate>
5814 <description><p
>Since this morning, the battery-stats package in Debian include an
5815 extended collector that will collect the complete battery history for
5816 later processing and graphing. The original collector store the
5817 battery level as percentage of last full level, while the new
5818 collector also record battery vendor, model, serial number, design
5819 full level, last full level and current battery level. This make it
5820 possible to predict the lifetime of the battery as well as visualise
5821 the energy flow when the battery is charging or discharging.
</p
>
5823 <p
>The new tools are available in
<tt
>/usr/share/battery-stats/
</tt
>
5824 in the version
0.5.1 package in unstable. Get the new battery level graph
5825 and lifetime prediction by running:
5827 <p
><pre
>
5828 /usr/share/battery-stats/battery-stats-graph /var/log/battery-stats.csv
5829 </pre
></p
>
5831 <p
>Or select the
'Battery Level Graph
' from your application menu.
</p
>
5833 <p
>The flow in/out of the battery can be seen by running (no menu
5834 entry yet):
</p
>
5836 <p
><pre
>
5837 /usr/share/battery-stats/battery-stats-graph-flow
5838 </pre
></p
>
5840 <p
>I
'm not quite happy with the way the data is visualised, at least
5841 when there are few data points. The graphs look a bit better with a
5842 few years of data.
</p
>
5844 <p
>A while back one important feature I use in the battery stats
5845 collector broke in Debian. The scripts in
5846 <tt
>/usr/lib/pm-utils/power.d/
</tt
> were no longer executed. I
5847 suspect it happened when Jessie started using systemd, but I do not
5848 know. The issue is reported as
5849 <a href=
"https://bugs.debian.org/
818649">bug #
818649</a
> against
5850 pm-utils. I managed to work around it by adding an udev rule to call
5851 the collector script every time the power connector is connected and
5852 disconnected. With this fix in place it was finally time to make a
5853 new release of the package, and get it into Debian.
</p
>
5855 <p
>If you are interested in how your laptop battery is doing, please
5857 <a href=
"https://tracker.debian.org/pkg/battery-stats
">battery-stats
</a
>
5858 in Debian unstable, or rebuild it on Jessie to get it working on
5859 Debian stable. :) The upstream source is available from
5860 <a href=
"https://github.com/petterreinholdtsen/battery-stats
">github
</a
>.
5861 As always, patches are very welcome.
</p
>
5866 <title>Making battery measurements a little easier in Debian
</title>
5867 <link>http://www.hungry.com/~pere/blog/Making_battery_measurements_a_little_easier_in_Debian.html
</link>
5868 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Making_battery_measurements_a_little_easier_in_Debian.html
</guid>
5869 <pubDate>Tue,
15 Mar
2016 15:
00:
00 +
0100</pubDate>
5870 <description><p
>Back in September, I blogged about
5871 <a href=
"http://www.hungry.com/~pere/blog/The_life_and_death_of_a_laptop_battery.html
">the
5872 system I wrote to collect statistics about my laptop battery
</a
>, and
5873 how it showed the decay and death of this battery (now replaced). I
5874 created a simple deb package to handle the collection and graphing,
5875 but did not want to upload it to Debian as there were already
5876 <a href=
"https://tracker.debian.org/pkg/battery-stats
">a battery-stats
5877 package in Debian
</a
> that should do the same thing, and I did not see
5878 a point of uploading a competing package when battery-stats could be
5879 fixed instead. I reported a few bugs about its non-function, and
5880 hoped someone would step in and fix it. But no-one did.
</p
>
5882 <p
>I got tired of waiting a few days ago, and took matters in my own
5883 hands. The end result is that I am now the new upstream developer of
5884 battery stats (
<a href=
"https://github.com/petterreinholdtsen/battery-stats
">available from github
</a
>) and part of the team maintaining
5885 battery-stats in Debian, and the package in Debian unstable is finally
5886 able to collect battery status using the
<tt
>/sys/class/power_supply/
</tt
>
5887 information provided by the Linux kernel. If you install the
5888 battery-stats package from unstable now, you will be able to get a
5889 graph of the current battery fill level, to get some idea about the
5890 status of the battery. The source package build and work just fine in
5891 Debian testing and stable (and probably oldstable too, but I have not
5892 tested). The default graph you get for that system look like this:
</p
>
5894 <p align=
"center
"><img src=
"http://www.hungry.com/~pere/blog/images/
2016-
03-
15-battery-stats-graph-example.png
" width=
"70%
" align=
"center
"></p
>
5896 <p
>My plans for the future is to merge my old scripts into the
5897 battery-stats package, as my old scripts collected a lot more details
5898 about the battery. The scripts are merged into the upstream
5899 battery-stats git repository already, but I am not convinced they work
5900 yet, as I changed a lot of paths along the way. Will have to test a
5901 bit more before I make a new release.
</p
>
5903 <p
>I will also consider changing the file format slightly, as I
5904 suspect the way I combine several values into one field might make it
5905 impossible to know the type of the value when using it for processing
5906 and graphing.
</p
>
5908 <p
>If you would like I would like to keep an close eye on your laptop
5909 battery, check out the battery-stats package in
5910 <a href=
"https://tracker.debian.org/pkg/battery-stats
">Debian
</a
> and
5912 <a href=
"https://github.com/petterreinholdtsen/battery-stats
">github
</a
>.
5913 I would love some help to improve the system further.
</p
>
5918 <title>Creating, updating and checking debian/copyright semi-automatically
</title>
5919 <link>http://www.hungry.com/~pere/blog/Creating__updating_and_checking_debian_copyright_semi_automatically.html
</link>
5920 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Creating__updating_and_checking_debian_copyright_semi_automatically.html
</guid>
5921 <pubDate>Fri,
19 Feb
2016 15:
00:
00 +
0100</pubDate>
5922 <description><p
>Making packages for Debian requires quite a lot of attention to
5923 details. And one of the details is the content of the
5924 debian/copyright file, which should list all relevant licenses used by
5925 the code in the package in question, preferably in
5926 <a href=
"https://www.debian.org/doc/packaging-manuals/copyright-format/
1.0/
">machine
5927 readable DEP5 format
</a
>.
</p
>
5929 <p
>For large packages with lots of contributors it is hard to write
5930 and update this file manually, and if you get some detail wrong, the
5931 package is normally rejected by the ftpmasters. So getting it right
5932 the first time around get the package into Debian faster, and save
5933 both you and the ftpmasters some work.. Today, while trying to figure
5934 out what was wrong with
5935 <a href=
"https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=
686447">the
5936 zfsonlinux copyright file
</a
>, I decided to spend some time on
5937 figuring out the options for doing this job automatically, or at least
5938 semi-automatically.
</p
>
5940 <p
>Lucikly, there are at least two tools available for generating the
5941 file based on the code in the source package,
5942 <tt
><a href=
"https://tracker.debian.org/pkg/debmake
">debmake
</a
></tt
>
5943 and
<tt
><a href=
"https://tracker.debian.org/pkg/cme
">cme
</a
></tt
>. I
'm
5944 not sure which one of them came first, but both seem to be able to
5945 create a sensible draft file. As far as I can tell, none of them can
5946 be trusted to get the result just right, so the content need to be
5947 polished a bit before the file is OK to upload. I found the debmake
5949 <a href=
"http://goofying-with-debian.blogspot.com/
2014/
07/debmake-checking-source-against-dep-
5.html
">a
5950 blog posts from
2014</a
>.
5952 <p
>To generate using debmake, use the -cc option:
5954 <p
><pre
>
5955 debmake -cc
> debian/copyright
5956 </pre
></p
>
5958 <p
>Note there are some problems with python and non-ASCII names, so
5959 this might not be the best option.
</p
>
5961 <p
>The cme option is based on a config parsing library, and I found
5963 <a href=
"https://ddumont.wordpress.com/
2015/
04/
05/improving-creation-of-debian-copyright-file/
">a
5964 blog post from
2015</a
>. To generate using cme, use the
'update
5965 dpkg-copyright
' option:
5967 <p
><pre
>
5968 cme update dpkg-copyright
5969 </pre
></p
>
5971 <p
>This will create or update debian/copyright. The cme tool seem to
5972 handle UTF-
8 names better than debmake.
</p
>
5974 <p
>When the copyright file is created, I would also like some help to
5975 check if the file is correct. For this I found two good options,
5976 <tt
>debmake -k
</tt
> and
<tt
>license-reconcile
</tt
>. The former seem
5977 to focus on license types and file matching, and is able to detect
5978 ineffective blocks in the copyright file. The latter reports missing
5979 copyright holders and years, but was confused by inconsistent license
5980 names (like CDDL vs. CDDL-
1.0). I suspect it is good to use both and
5981 fix all issues reported by them before uploading. But I do not know
5982 if the tools and the ftpmasters agree on what is important to fix in a
5983 copyright file, so the package might still be rejected.
</p
>
5985 <p
>The devscripts tool
<tt
>licensecheck
</tt
> deserve mentioning. It
5986 will read through the source and try to find all copyright statements.
5987 It is not comparing the result to the content of debian/copyright, but
5988 can be useful when verifying the content of the copyright file.
</p
>
5990 <p
>Are you aware of better tools in Debian to create and update
5991 debian/copyright file. Please let me know, or blog about it on
5992 planet.debian.org.
</p
>
5994 <p
>As usual, if you use Bitcoin and want to show your support of my
5995 activities, please send Bitcoin donations to my address
5996 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
5998 <p
><strong
>Update
2016-
02-
20</strong
>: I got a tip from Mike Gabriel
5999 on how to use licensecheck and cdbs to create a draft copyright file
6001 <p
><pre
>
6002 licensecheck --copyright -r `find * -type f` | \
6003 /usr/lib/cdbs/licensecheck2dep5
> debian/copyright.auto
6004 </pre
></p
>
6006 <p
>He mentioned that he normally check the generated file into the
6007 version control system to make it easier to discover license and
6008 copyright changes in the upstream source. I will try to do the same
6009 with my packages in the future.
</p
>
6011 <p
><strong
>Update
2016-
02-
21</strong
>: The cme author recommended
6012 against using -quiet for new users, so I removed it from the proposed
6013 command line.
</p
>
6018 <title>Using appstream in Debian to locate packages with firmware and mime type support
</title>
6019 <link>http://www.hungry.com/~pere/blog/Using_appstream_in_Debian_to_locate_packages_with_firmware_and_mime_type_support.html
</link>
6020 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Using_appstream_in_Debian_to_locate_packages_with_firmware_and_mime_type_support.html
</guid>
6021 <pubDate>Thu,
4 Feb
2016 16:
40:
00 +
0100</pubDate>
6022 <description><p
>The
<a href=
"https://wiki.debian.org/DEP-
11">appstream system
</a
>
6023 is taking shape in Debian, and one provided feature is a very
6024 convenient way to tell you which package to install to make a given
6025 firmware file available when the kernel is looking for it. This can
6026 be done using apt-file too, but that is for someone else to blog
6029 <p
>Here is a small recipe to find the package with a given firmware
6030 file, in this example I am looking for ctfw-
3.2.3.0.bin, randomly
6031 picked from the set of firmware announced using appstream in Debian
6032 unstable. In general you would be looking for the firmware requested
6033 by the kernel during kernel module loading. To find the package
6034 providing the example file, do like this:
</p
>
6036 <blockquote
><pre
>
6037 % apt install appstream
6041 % appstreamcli what-provides firmware:runtime ctfw-
3.2.3.0.bin | \
6042 awk
'/Package:/ {print $
2}
'
6045 </pre
></blockquote
>
6047 <p
>See
<a href=
"https://wiki.debian.org/AppStream/Guidelines
">the
6048 appstream wiki
</a
> page to learn how to embed the package metadata in
6049 a way appstream can use.
</p
>
6051 <p
>This same approach can be used to find any package supporting a
6052 given MIME type. This is very useful when you get a file you do not
6053 know how to handle. First find the mime type using
<tt
>file
6054 --mime-type
</tt
>, and next look up the package providing support for
6055 it. Lets say you got an SVG file. Its MIME type is image/svg+xml,
6056 and you can find all packages handling this type like this:
</p
>
6058 <blockquote
><pre
>
6059 % apt install appstream
6063 % appstreamcli what-provides mimetype image/svg+xml | \
6064 awk
'/Package:/ {print $
2}
'
6086 </pre
></blockquote
>
6088 <p
>I believe the MIME types are fetched from the desktop file for
6089 packages providing appstream metadata.
</p
>
6094 <title>Creepy, visualise geotagged social media information - nice free software
</title>
6095 <link>http://www.hungry.com/~pere/blog/Creepy__visualise_geotagged_social_media_information___nice_free_software.html
</link>
6096 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Creepy__visualise_geotagged_social_media_information___nice_free_software.html
</guid>
6097 <pubDate>Sun,
24 Jan
2016 10:
50:
00 +
0100</pubDate>
6098 <description><p
>Most people seem not to realise that every time they walk around
6099 with the computerised radio beacon known as a mobile phone their
6100 position is tracked by the phone company and often stored for a long
6101 time (like every time a SMS is received or sent). And if their
6102 computerised radio beacon is capable of running programs (often called
6103 mobile apps) downloaded from the Internet, these programs are often
6104 also capable of tracking their location (if the app requested access
6105 during installation). And when these programs send out information to
6106 central collection points, the location is often included, unless
6107 extra care is taken to not send the location. The provided
6108 information is used by several entities, for good and bad (what is
6109 good and bad, depend on your point of view). What is certain, is that
6110 the private sphere and the right to free movement is challenged and
6111 perhaps even eradicated for those announcing their location this way,
6112 when they share their whereabouts with private and public
6115 <p align=
"center
"><img width=
"70%
" src=
"http://www.hungry.com/~pere/blog/images/
2016-
01-
24-nice-creepy-desktop-window.png
"></p
>
6117 <p
>The phone company logs provide a register of locations to check out
6118 when one want to figure out what the tracked person was doing. It is
6119 unavailable for most of us, but provided to selected government
6120 officials, company staff, those illegally buying information from
6121 unfaithful servants and crackers stealing the information. But the
6122 public information can be collected and analysed, and a free software
6123 tool to do so is called
6124 <a href=
"http://www.geocreepy.com/
">Creepy or Cree.py
</a
>. I
6125 discovered it when I read
6126 <a href=
"http://www.aftenposten.no/kultur/Slik-kan-du-bli-overvaket-pa-Twitter-og-Instagram-uten-a-ane-det-
7787884.html
">an
6127 article about Creepy
</a
> in the Norwegian newspaper Aftenposten i
6128 November
2014, and decided to check if it was available in Debian.
6129 The python program was in Debian, but
6130 <a href=
"https://tracker.debian.org/pkg/creepy
">the version in
6131 Debian
</a
> was completely broken and practically unmaintained. I
6132 uploaded a new version which did not work quite right, but did not
6133 have time to fix it then. This Christmas I decided to finally try to
6134 get Creepy operational in Debian. Now a fixed version is available in
6135 Debian unstable and testing, and almost all Debian specific patches
6137 <a href=
"https://github.com/jkakavas/creepy
">upstream
</a
>.
</p
>
6139 <p
>The Creepy program visualises geolocation information fetched from
6140 Twitter, Instagram, Flickr and Google+, and allow one to get a
6141 complete picture of every social media message posted recently in a
6142 given area, or track the movement of a given individual across all
6143 these services. Earlier it was possible to use the search API of at
6144 least some of these services without identifying oneself, but these
6145 days it is impossible. This mean that to use Creepy, you need to
6146 configure it to log in as yourself on these services, and provide
6147 information to them about your search interests. This should be taken
6148 into account when using Creepy, as it will also share information
6149 about yourself with the services.
</p
>
6151 <p
>The picture above show the twitter messages sent from (or at least
6152 geotagged with a position from) the city centre of Oslo, the capital
6153 of Norway. One useful way to use Creepy is to first look at
6154 information tagged with an area of interest, and next look at all the
6155 information provided by one or more individuals who was in the area.
6156 I tested it by checking out which celebrity provide their location in
6157 twitter messages by checkout out who sent twitter messages near a
6158 Norwegian TV station, and next could track their position over time,
6159 making it possible to locate their home and work place, among other
6160 things. A similar technique have been
6161 <a href=
"http://www.buzzfeed.com/maxseddon/does-this-soldiers-instagram-account-prove-russia-is-covertl
">used
6162 to locate Russian soldiers in Ukraine
</a
>, and it is both a powerful
6163 tool to discover lying governments, and a useful tool to help people
6164 understand the value of the private information they provide to the
6167 <p
>The package is not trivial to backport to Debian Stable/Jessie, as
6168 it depend on several python modules currently missing in Jessie (at
6169 least python-instagram, python-flickrapi and
6170 python-requests-toolbelt).
</p
>
6172 <p
>(I have uploaded
6173 <a href=
"https://screenshots.debian.net/package/creepy
">the image to
6174 screenshots.debian.net
</a
> and licensed it under the same terms as the
6175 Creepy program in Debian.)
</p
>
6180 <title>Always download Debian packages using Tor - the simple recipe
</title>
6181 <link>http://www.hungry.com/~pere/blog/Always_download_Debian_packages_using_Tor___the_simple_recipe.html
</link>
6182 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Always_download_Debian_packages_using_Tor___the_simple_recipe.html
</guid>
6183 <pubDate>Fri,
15 Jan
2016 00:
30:
00 +
0100</pubDate>
6184 <description><p
>During his DebConf15 keynote, Jacob Appelbaum
6185 <a href=
"https://summit.debconf.org/debconf15/meeting/
331/what-is-to-be-done/
">observed
6186 that those listening on the Internet lines would have good reason to
6187 believe a computer have a given security hole
</a
> if it download a
6188 security fix from a Debian mirror. This is a good reason to always
6189 use encrypted connections to the Debian mirror, to make sure those
6190 listening do not know which IP address to attack. In August, Richard
6191 Hartmann observed that encryption was not enough, when it was possible
6192 to interfere download size to security patches or the fact that
6193 download took place shortly after a security fix was released, and
6194 <a href=
"http://richardhartmann.de/blog/posts/
2015/
08/
24-Tor-enabled_Debian_mirror/
">proposed
6195 to always use Tor to download packages from the Debian mirror
</a
>. He
6196 was not the first to propose this, as the
6197 <tt
><a href=
"https://tracker.debian.org/pkg/apt-transport-tor
">apt-transport-tor
</a
></tt
>
6198 package by Tim Retout already existed to make it easy to convince apt
6199 to use
<a href=
"https://www.torproject.org/
">Tor
</a
>, but I was not
6200 aware of that package when I read the blog post from Richard.
</p
>
6202 <p
>Richard discussed the idea with Peter Palfrader, one of the Debian
6203 sysadmins, and he set up a Tor hidden service on one of the central
6204 Debian mirrors using the address vwakviie2ienjx6t.onion, thus making
6205 it possible to download packages directly between two tor nodes,
6206 making sure the network traffic always were encrypted.
</p
>
6208 <p
>Here is a short recipe for enabling this on your machine, by
6209 installing
<tt
>apt-transport-tor
</tt
> and replacing http and https
6210 urls with tor+http and tor+https, and using the hidden service instead
6211 of the official Debian mirror site. I recommend installing
6212 <tt
>etckeeper
</tt
> before you start to have a history of the changes
6213 done in /etc/.
</p
>
6215 <blockquote
><pre
>
6216 apt install apt-transport-tor
6217 sed -i
's% http://ftp.debian.org/% tor+http://vwakviie2ienjx6t.onion/%
' /etc/apt/sources.list
6218 sed -i
's% http% tor+http%
' /etc/apt/sources.list
6219 </pre
></blockquote
>
6221 <p
>If you have more sources listed in /etc/apt/sources.list.d/, run
6222 the sed commands for these too. The sed command is assuming your are
6223 using the ftp.debian.org Debian mirror. Adjust the command (or just
6224 edit the file manually) to match your mirror.
</p
>
6226 <p
>This work in Debian Jessie and later. Note that tools like
6227 <tt
>apt-file
</tt
> only recently started using the apt transport
6228 system, and do not work with these tor+http URLs. For
6229 <tt
>apt-file
</tt
> you need the version currently in experimental,
6230 which need a recent apt version currently only in unstable. So if you
6231 need a working
<tt
>apt-file
</tt
>, this is not for you.
</p
>
6233 <p
>Another advantage from this change is that your machine will start
6234 using Tor regularly and at fairly random intervals (every time you
6235 update the package lists or upgrade or install a new package), thus
6236 masking other Tor traffic done from the same machine. Using Tor will
6237 become normal for the machine in question.
</p
>
6239 <p
>On
<a href=
"https://wiki.debian.org/FreedomBox
">Freedombox
</a
>, APT
6240 is set up by default to use
<tt
>apt-transport-tor
</tt
> when Tor is
6241 enabled. It would be great if it was the default on any Debian
6247 <title>OpenALPR, find car license plates in video streams - nice free software
</title>
6248 <link>http://www.hungry.com/~pere/blog/OpenALPR__find_car_license_plates_in_video_streams___nice_free_software.html
</link>
6249 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/OpenALPR__find_car_license_plates_in_video_streams___nice_free_software.html
</guid>
6250 <pubDate>Wed,
23 Dec
2015 01:
00:
00 +
0100</pubDate>
6251 <description><p
>When I was a kid, we used to collect
"car numbers
", as we used to
6252 call the car license plate numbers in those days. I would write the
6253 numbers down in my little book and compare notes with the other kids
6254 to see how many region codes we had seen and if we had seen some
6255 exotic or special region codes and numbers. It was a fun game to pass
6256 time, as we kids have plenty of it.
</p
>
6258 <p
>A few days I came across
6259 <a href=
"https://github.com/openalpr/openalpr
">the OpenALPR
6260 project
</a
>, a free software project to automatically discover and
6261 report license plates in images and video streams, and provide the
6262 "car numbers
" in a machine readable format. I
've been looking for
6263 such system for a while now, because I believe it is a bad idea that the
6264 <a href=
"https://en.wikipedia.org/wiki/Automatic_number_plate_recognition
">automatic
6265 number plate recognition
</a
> tool only is available in the hands of
6266 the powerful, and want it to be available also for the powerless to
6267 even the score when it comes to surveillance and sousveillance. I
6268 discovered the developer
6269 <a href=
"https://bugs.debian.org/
747509">wanted to get the tool into
6270 Debian
</a
>, and as I too wanted it to be in Debian, I volunteered to
6271 help him get it into shape to get the package uploaded into the Debian
6274 <p
>Today we finally managed to get the package into shape and uploaded
6275 it into Debian, where it currently
6276 <a href=
"https://ftp-master.debian.org//new/openalpr_2.2
.1-
1.html
">waits
6277 in the NEW queue
</a
> for review by the Debian ftpmasters.
</p
>
6279 <p
>I guess you are wondering why on earth such tool would be useful
6280 for the common folks, ie those not running a large government
6281 surveillance system? Well, I plan to put it in a computer on my bike
6282 and in my car, tracking the cars nearby and allowing me to be notified
6283 when number plates on my watch list are discovered. Another use case
6284 was suggested by a friend of mine, who wanted to set it up at his home
6285 to open the car port automatically when it discovered the plate on his
6286 car. When I mentioned it perhaps was a bit foolhardy to allow anyone
6287 capable of placing his license plate number of a piece of cardboard to
6288 open his car port, men replied that it was always unlocked anyway. I
6289 guess for such use case it make sense. I am sure there are other use
6290 cases too, for those with imagination and a vision.
</p
>
6292 <p
>If you want to build your own version of the Debian package, check
6293 out the upstream git source and symlink ./distros/debian to ./debian/
6294 before running
"debuild
" to build the source. Or wait a bit until the
6295 package show up in unstable.
</p
>
6300 <title>Using appstream with isenkram to install hardware related packages in Debian
</title>
6301 <link>http://www.hungry.com/~pere/blog/Using_appstream_with_isenkram_to_install_hardware_related_packages_in_Debian.html
</link>
6302 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Using_appstream_with_isenkram_to_install_hardware_related_packages_in_Debian.html
</guid>
6303 <pubDate>Sun,
20 Dec
2015 12:
20:
00 +
0100</pubDate>
6304 <description><p
>Around three years ago, I created
6305 <a href=
"http://packages.qa.debian.org/isenkram
">the isenkram
6306 system
</a
> to get a more practical solution in Debian for handing
6307 hardware related packages. A GUI system in the isenkram package will
6308 present a pop-up dialog when some hardware dongle supported by
6309 relevant packages in Debian is inserted into the machine. The same
6310 lookup mechanism to detect packages is available as command line
6311 tools in the isenkram-cli package. In addition to mapping hardware,
6312 it will also map kernel firmware files to packages and make it easy to
6313 install needed firmware packages automatically. The key for this
6314 system to work is a good way to map hardware to packages, in other
6315 words, allow packages to announce what hardware they will work
6318 <p
>I started by providing data files in the isenkram source, and
6319 adding code to download the latest version of these data files at run
6320 time, to ensure every user had the most up to date mapping available.
6321 I also added support for storing the mapping in the Packages file in
6322 the apt repositories, but did not push this approach because while I
6323 was trying to figure out how to best store hardware/package mappings,
6324 <a href=
"http://www.freedesktop.org/software/appstream/docs/
">the
6325 appstream system
</a
> was announced. I got in touch and suggested to
6326 add the hardware mapping into that data set to be able to use
6327 appstream as a data source, and this was accepted at least for the
6328 Debian version of appstream.
</p
>
6330 <p
>A few days ago using appstream in Debian for this became possible,
6331 and today I uploaded a new version
0.20 of isenkram adding support for
6332 appstream as a data source for mapping hardware to packages. The only
6333 package so far using appstream to announce its hardware support is my
6334 pymissile package. I got help from Matthias Klumpp with figuring out
6335 how do add the required
6336 <a href=
"https://appstream.debian.org/html/sid/main/metainfo/pymissile.html
">metadata
6337 in pymissile
</a
>. I added a file debian/pymissile.metainfo.xml with
6338 this content:
</p
>
6340 <blockquote
><pre
>
6341 &lt;?xml version=
"1.0" encoding=
"UTF-
8"?
&gt;
6342 &lt;component
&gt;
6343 &lt;id
&gt;pymissile
&lt;/id
&gt;
6344 &lt;metadata_license
&gt;MIT
&lt;/metadata_license
&gt;
6345 &lt;name
&gt;pymissile
&lt;/name
&gt;
6346 &lt;summary
&gt;Control original Striker USB Missile Launcher
&lt;/summary
&gt;
6347 &lt;description
&gt;
6349 Pymissile provides a curses interface to control an original
6350 Marks and Spencer / Striker USB Missile Launcher, as well as a
6351 motion control script to allow a webcamera to control the
6354 &lt;/description
&gt;
6355 &lt;provides
&gt;
6356 &lt;modalias
&gt;usb:v1130p0202d*
&lt;/modalias
&gt;
6357 &lt;/provides
&gt;
6358 &lt;/component
&gt;
6359 </pre
></blockquote
>
6361 <p
>The key for isenkram is the component/provides/modalias value,
6362 which is a glob style match rule for hardware specific strings
6363 (modalias strings) provided by the Linux kernel. In this case, it
6364 will map to all USB devices with vendor code
1130 and product code
6367 <p
>Note, it is important that the license of all the metadata files
6368 are compatible to have permissions to aggregate them into archive wide
6369 appstream files. Matthias suggested to use MIT or BSD licenses for
6370 these files. A challenge is figuring out a good id for the data, as
6371 it is supposed to be globally unique and shared across distributions
6372 (in other words, best to coordinate with upstream what to use). But
6373 it can be changed later or, so we went with the package name as
6374 upstream for this project is dormant.
</p
>
6376 <p
>To get the metadata file installed in the correct location for the
6377 mirror update scripts to pick it up and include its content the
6378 appstream data source, the file must be installed in the binary
6379 package under /usr/share/appdata/. I did this by adding the following
6380 line to debian/pymissile.install:
</p
>
6382 <blockquote
><pre
>
6383 debian/pymissile.metainfo.xml usr/share/appdata
6384 </pre
></blockquote
>
6386 <p
>With that in place, the command line tool isenkram-lookup will list
6387 all packages useful on the current computer automatically, and the GUI
6388 pop-up handler will propose to install the package not already
6389 installed if a hardware dongle is inserted into the machine in
6392 <p
>Details of the modalias field in appstream is available from the
6393 <a href=
"https://wiki.debian.org/DEP-
11">DEP-
11</a
> proposal.
</p
>
6395 <p
>To locate the modalias values of all hardware present in a machine,
6396 try running this command on the command line:
</p
>
6398 <blockquote
><pre
>
6399 cat $(find /sys/devices/|grep modalias)
6400 </pre
></blockquote
>
6402 <p
>To learn more about the isenkram system, please check out
6403 <a href=
"http://www.hungry.com/~pere/blog/tags/isenkram/
">my
6404 blog posts tagged isenkram
</a
>.
</p
>
6409 <title>The GNU General Public License is not magic pixie dust
</title>
6410 <link>http://www.hungry.com/~pere/blog/The_GNU_General_Public_License_is_not_magic_pixie_dust.html
</link>
6411 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_GNU_General_Public_License_is_not_magic_pixie_dust.html
</guid>
6412 <pubDate>Mon,
30 Nov
2015 09:
55:
00 +
0100</pubDate>
6413 <description><p
>A blog post from my fellow Debian developer Paul Wise titled
6414 "<a href=
"http://bonedaddy.net/pabs3/log/
2015/
11/
27/sfc-supporter/
">The
6415 GPL is not magic pixie dust
</a
>" explain the importance of making sure
6416 the
<a href=
"http://www.gnu.org/copyleft/gpl.html
">GPL
</a
> is enforced.
6417 I quote the blog post from Paul in full here with his permission:
<p
>
6421 <p
><a href=
"https://sfconservancy.org/supporter/
"><img src=
"https://sfconservancy.org/img/supporter-badge.png
" width=
"194" height=
"90" alt=
"Become a Software Freedom Conservancy Supporter!
" align=
"right
" border=
"0" /
></a
></p
>
6424 The GPL is not magic pixie dust. It does not work by itself.
<br/
>
6426 The first step is to choose a
6427 <a href=
"https://copyleft.org/
">copyleft
</a
> license for your
6430 The next step is, when someone fails to follow that copyleft license,
6431 <b
>it must be enforced
</b
><br/
>
6433 and its a simple fact of our modern society that such type of
6436 is incredibly expensive to do and incredibly difficult to do.
6439 <p
><small
>--
<a href=
"http://ebb.org/bkuhn/
">Bradley Kuhn
</a
>, in
6440 <a href=
"http://faif.us/
" title=
"Free as in Freedom
">FaiF
</a
>
6441 <a href=
"http://faif.us/cast/
2015/nov/
24/
0x57/
">episode
6442 0x57</a
></small
></p
>
6444 <p
>As the Debian Website
6445 <a href=
"https://bugs.debian.org/
794116">used
</a
>
6446 <a href=
"https://anonscm.debian.org/viewvc/webwml/webwml/english/intro/free.wml?r1=
1.24&amp;r2=
1.25">to
</a
>
6447 imply, public domain and permissively licensed software can lead to
6448 the production of more proprietary software as people discover useful
6449 software, extend it and or incorporate it into their hardware or
6450 software products. Copyleft licenses such as the GNU GPL were created
6451 to close off this avenue to the production of proprietary software but
6452 such licenses are not enough. With the ongoing adoption of Free
6453 Software by individuals and groups, inevitably the community
's
6454 expectations of license compliance are violated, usually out of
6455 ignorance of the way Free Software works, but not always. As Karen
6456 and Bradley explained in
<a href=
"http://faif.us/
" title=
"Free as in
6457 Freedom
">FaiF
</a
>
6458 <a href=
"http://faif.us/cast/
2015/nov/
24/
0x57/
">episode
0x57</a
>,
6459 copyleft is nothing if no-one is willing and able to stand up in court
6460 to protect it. The reality of today
's world is that legal
6461 representation is expensive, difficult and time consuming. With
6462 <a href=
"http://gpl-violations.org/
">gpl-violations.org
</a
> in hiatus
6463 <a href=
"http://gpl-violations.org/news/
20151027-homepage-recovers/
">until
</a
>
6464 some time in
2016, the
<a href=
"https://sfconservancy.org/
">Software
6465 Freedom Conservancy
</a
> (a tax-exempt charity) is the major defender
6466 of the Linux project, Debian and other groups against GPL violations.
6467 In March the SFC supported a
6468 <a href=
"https://sfconservancy.org/news/
2015/mar/
05/vmware-lawsuit/
">lawsuit
6469 by Christoph Hellwig
</a
> against VMware for refusing to
6470 <a href=
"https://sfconservancy.org/linux-compliance/vmware-lawsuit-faq.html
">comply
6471 with the GPL
</a
> in relation to their use of parts of the Linux
6472 kernel. Since then two of their sponsors pulled corporate funding and
6474 <a href=
"https://sfconservancy.org/blog/
2015/nov/
24/faif-carols-fundraiser/
">blocked
6475 or cancelled their talks
</a
>. As a result they have decided to rely
6476 less on corporate funding and more on the broad community of
6477 individuals who support Free Software and copyleft. So the SFC has
6478 <a href=
"https://sfconservancy.org/news/
2015/nov/
23/
2015fundraiser/
">launched
</a
>
6479 a
<a href=
"https://sfconservancy.org/supporter/
">campaign
</a
> to create
6480 a community of folks who stand up for copyleft and the GPL by
6481 supporting their work on promoting and supporting copyleft and Free
6484 <p
>If you support Free Software,
6485 <a href=
"https://sfconservancy.org/blog/
2015/nov/
26/like-what-I-do/
">like
</a
>
6486 what the SFC do, agree with their
6487 <a href=
"https://sfconservancy.org/linux-compliance/principles.html
">compliance
6488 principles
</a
>, are happy about their
6489 <a href=
"https://sfconservancy.org/supporter/
">successes
</a
> in
2015,
6490 work on a project that is an SFC
6491 <a href=
"https://sfconservancy.org/members/current/
">member
</a
> and or
6492 just want to stand up for copyleft, please join
6493 <a href=
"https://identi.ca/cwebber/image/JQGPA4qbTyyp3-MY8QpvuA
">Christopher
6494 Allan Webber
</a
>,
6495 <a href=
"https://sfconservancy.org/blog/
2015/nov/
24/faif-carols-fundraiser/
">Carol
6497 <a href=
"http://www.jonobacon.org/
2015/
11/
25/supporting-software-freedom-conservancy/
">Jono
6498 Bacon
</a
>, myself and
6499 <a href=
"https://sfconservancy.org/sponsors/#supporters
">others
</a
> in
6501 <a href=
"https://sfconservancy.org/supporter/
">supporter
</a
>. For the
6502 next week your donation will be
6503 <a href=
"https://sfconservancy.org/news/
2015/nov/
27/black-friday/
">matched
</a
>
6504 by an anonymous donor. Please also consider asking your employer to
6505 match your donation or become a sponsor of SFC. Don
't forget to
6506 spread the word about your support for SFC via email, your blog and or
6507 social media accounts.
</p
>
6511 <p
>I agree with Paul on this topic and just signed up as a Supporter
6512 of Software Freedom Conservancy myself. Perhaps you should be a
6513 supporter too?
</p
>
6518 <title>PGP key transition statement for key EE4E02F9
</title>
6519 <link>http://www.hungry.com/~pere/blog/PGP_key_transition_statement_for_key_EE4E02F9.html
</link>
6520 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/PGP_key_transition_statement_for_key_EE4E02F9.html
</guid>
6521 <pubDate>Tue,
17 Nov
2015 10:
50:
00 +
0100</pubDate>
6522 <description><p
>I
've needed a new OpenPGP key for a while, but have not had time to
6523 set it up properly. I wanted to generate it offline and have it
6524 available on
<a href=
"http://shop.kernelconcepts.de/#openpgp
">a OpenPGP
6525 smart card
</a
> for daily use, and learning how to do it and finding
6526 time to sit down with an offline machine almost took forever. But
6527 finally I
've been able to complete the process, and have now moved
6528 from my old GPG key to a new GPG key. See
6529 <a href=
"http://www.hungry.com/~pere/blog/images/
2015-
11-
17-new-gpg-key-transition.txt
">the
6530 full transition statement, signed with both my old and new key
</a
> for
6531 the details. This is my new key:
</p
>
6534 pub
3936R/
<a href=
"http://pgp.cs.uu.nl/stats/
111D6B29EE4E02F9.html
">111D6B29EE4E02F9
</a
> 2015-
11-
03 [expires:
2019-
11-
14]
6535 Key fingerprint =
3AC7 B2E3 ACA5 DF87
78F1 D827
111D
6B29 EE4E
02F9
6536 uid Petter Reinholdtsen
&lt;pere@hungry.com
&gt;
6537 uid Petter Reinholdtsen
&lt;pere@debian.org
&gt;
6538 sub
4096R/
87BAFB0E
2015-
11-
03 [expires:
2019-
11-
02]
6539 sub
4096R/F91E6DE9
2015-
11-
03 [expires:
2019-
11-
02]
6540 sub
4096R/A0439BAB
2015-
11-
03 [expires:
2019-
11-
02]
6543 <p
>The key can be downloaded from the OpenPGP key servers, signed by
6544 my old key.
</p
>
6546 <p
>If you signed my old key
6547 (
<a href=
"http://pgp.cs.uu.nl/stats/DB4CCC4B2A30D729.html
">DB4CCC4B2A30D729
</a
>),
6548 I
'd very much appreciate a signature on my new key, details and
6549 instructions in the transition statement. I m happy to reciprocate if
6550 you have a similarly signed transition statement to present.
</p
>
6555 <title>The life and death of a laptop battery
</title>
6556 <link>http://www.hungry.com/~pere/blog/The_life_and_death_of_a_laptop_battery.html
</link>
6557 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_life_and_death_of_a_laptop_battery.html
</guid>
6558 <pubDate>Thu,
24 Sep
2015 16:
00:
00 +
0200</pubDate>
6559 <description><p
>When I get a new laptop, the battery life time at the start is OK.
6560 But this do not last. The last few laptops gave me a feeling that
6561 within a year, the life time is just a fraction of what it used to be,
6562 and it slowly become painful to use the laptop without power connected
6563 all the time. Because of this, when I got a new Thinkpad X230 laptop
6564 about two years ago, I decided to monitor its battery state to have
6565 more hard facts when the battery started to fail.
</p
>
6567 <img src=
"http://www.hungry.com/~pere/blog/images/
2015-
09-
24-laptop-battery-graph.png
"/
>
6569 <p
>First I tried to find a sensible Debian package to record the
6570 battery status, assuming that this must be a problem already handled
6571 by someone else. I found
6572 <a href=
"https://tracker.debian.org/pkg/battery-stats
">battery-stats
</a
>,
6573 which collects statistics from the battery, but it was completely
6574 broken. I sent a few suggestions to the maintainer, but decided to
6575 write my own collector as a shell script while I waited for feedback
6577 <a href=
"http://www.ifweassume.com/
2013/
08/the-de-evolution-of-my-laptop-battery.html
">a
6578 blog post about the battery development on a MacBook Air
</a
> I also
6580 <a href=
"https://github.com/jradavenport/batlog.git
">batlog
</a
>, not
6581 available in Debian.
</p
>
6583 <p
>I started my collector
2013-
07-
15, and it has been collecting
6584 battery stats ever since. Now my
6585 /var/log/hjemmenett-battery-status.log file contain around
115,
000
6586 measurements, from the time the battery was working great until now,
6587 when it is unable to charge above
7% of original capacity. My
6588 collector shell script is quite simple and look like this:
</p
>
6593 # http://www.ifweassume.com/
2013/
08/the-de-evolution-of-my-laptop-battery.html
6595 # http://blog.sleeplessbeastie.eu/
2013/
01/
02/debian-how-to-monitor-battery-capacity/
6596 logfile=/var/log/hjemmenett-battery-status.log
6598 files=
"manufacturer model_name technology serial_number \
6599 energy_full energy_full_design energy_now cycle_count status
"
6601 if [ ! -e
"$logfile
" ] ; then
6603 printf
"timestamp,
"
6605 printf
"%s,
" $f
6608 )
> "$logfile
"
6612 # Print complete message in one echo call, to avoid race condition
6613 # when several log processes run in parallel.
6614 msg=$(printf
"%s,
" $(date +%s); \
6615 for f in $files; do \
6616 printf
"%s,
" $(cat $f); \
6618 echo
"$msg
"
6621 cd /sys/class/power_supply
6624 (cd $bat
&& log_battery
>> "$logfile
")
6628 <p
>The script is called when the power management system detect a
6629 change in the power status (power plug in or out), and when going into
6630 and out of hibernation and suspend. In addition, it collect a value
6631 every
10 minutes. This make it possible for me know when the battery
6632 is discharging, charging and how the maximum charge change over time.
6633 The code for the Debian package
6634 <a href=
"https://github.com/petterreinholdtsen/battery-status
">is now
6635 available on github
</a
>.
</p
>
6637 <p
>The collected log file look like this:
</p
>
6640 timestamp,manufacturer,model_name,technology,serial_number,energy_full,energy_full_design,energy_now,cycle_count,status,
6641 1376591133,LGC,
45N1025,Li-ion,
974,
62800000,
62160000,
39050000,
0,Discharging,
6643 1443090528,LGC,
45N1025,Li-ion,
974,
4900000,
62160000,
4900000,
0,Full,
6644 1443090601,LGC,
45N1025,Li-ion,
974,
4900000,
62160000,
4900000,
0,Full,
6647 <p
>I wrote a small script to create a graph of the charge development
6648 over time. This graph depicted above show the slow death of my laptop
6651 <p
>But why is this happening? Why are my laptop batteries always
6652 dying in a year or two, while the batteries of space probes and
6653 satellites keep working year after year. If we are to believe
6654 <a href=
"http://batteryuniversity.com/learn/article/how_to_prolong_lithium_based_batteries
">Battery
6655 University
</a
>, the cause is me charging the battery whenever I have a
6656 chance, and the fix is to not charge the Lithium-ion batteries to
100%
6657 all the time, but to stay below
90% of full charge most of the time.
6658 I
've been told that the Tesla electric cars
6659 <a href=
"http://my.teslamotors.com/de_CH/forum/forums/battery-charge-limit
">limit
6660 the charge of their batteries to
80%
</a
>, with the option to charge to
6661 100% when preparing for a longer trip (not that I would want a car
6662 like Tesla where rights to privacy is abandoned, but that is another
6663 story), which I guess is the option we should have for laptops on
6664 Linux too.
</p
>
6666 <p
>Is there a good and generic way with Linux to tell the battery to
6667 stop charging at
80%, unless requested to charge to
100% once in
6668 preparation for a longer trip? I found
6669 <a href=
"http://askubuntu.com/questions/
34452/how-can-i-limit-battery-charging-to-
80-capacity
">one
6670 recipe on askubuntu for Ubuntu to limit charging on Thinkpad to
6671 80%
</a
>, but could not get it to work (kernel module refused to
6674 <p
>I wonder why the battery capacity was reported to be more than
100%
6675 at the start. I also wonder why the
"full capacity
" increases some
6676 times, and if it is possible to repeat the process to get the battery
6677 back to design capacity. And I wonder if the discharge and charge
6678 speed change over time, or if this stay the same. I did not yet try
6679 to write a tool to calculate the derivative values of the battery
6680 level, but suspect some interesting insights might be learned from
6683 <p
>Update
2015-
09-
24: I got a tip to install the packages
6684 acpi-call-dkms and tlp (unfortunately missing in Debian stable)
6685 packages instead of the tp-smapi-dkms package I had tried to use
6686 initially, and use
'tlp setcharge
40 80' to change when charging start
6687 and stop. I
've done so now, but expect my existing battery is toast
6688 and need to be replaced. The proposal is unfortunately Thinkpad
6694 <title>New laptop - some more clues and ideas based on feedback
</title>
6695 <link>http://www.hungry.com/~pere/blog/New_laptop___some_more_clues_and_ideas_based_on_feedback.html
</link>
6696 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_laptop___some_more_clues_and_ideas_based_on_feedback.html
</guid>
6697 <pubDate>Sun,
5 Jul
2015 21:
40:
00 +
0200</pubDate>
6698 <description><p
>Several people contacted me after my previous blog post about my
6699 need for a new laptop, and provided very useful feedback. I wish to
6700 thank every one of these. Several pointed me to the possibility of
6701 fixing my X230, and I am already in the process of getting Lenovo to
6702 do so thanks to the on site, next day support contract covering the
6703 machine. But the battery is almost useless (I expect to replace it
6704 with a non-official battery) and I do not expect the machine to live
6705 for many more years, so it is time to plan its replacement. If I did
6706 not have a support contract, it was suggested to find replacement parts
6707 using
<a href=
"http://www.francecrans.com/
">FrancEcrans
</a
>, but it
6708 might present a language barrier as I do not understand French.
</p
>
6710 <p
>One tip I got was to use the
6711 <a href=
"https://skinflint.co.uk/?cat=nb
">Skinflint
</a
> web service to
6712 compare laptop models. It seem to have more models available than
6713 prisjakt.no. Another tip I got from someone I know have similar
6714 keyboard preferences was that the HP EliteBook
840 keyboard is not
6715 very good, and this matches my experience with earlier EliteBook
6716 keyboards I tested. Because of this, I will not consider it any further.
6718 <p
>When I wrote my blog post, I was not aware of Thinkpad X250, the
6719 newest Thinkpad X model. The keyboard reintroduces mouse buttons
6720 (which is missing from the X240), and is working fairly well with
6721 Debian Sid/Unstable according to
6722 <a href=
"http://www.corsac.net/X250/
">Corsac.net
</a
>. The reports I
6723 got on the keyboard quality are not consistent. Some say the keyboard
6724 is good, others say it is ok, while others say it is not very good.
6725 Those with experience from X41 and and X60 agree that the X250
6726 keyboard is not as good as those trusty old laptops, and suggest I
6727 keep and fix my X230 instead of upgrading, or get a used X230 to
6728 replace it. I
'm also told that the X250 lack leds for caps lock, disk
6729 activity and battery status, which is very convenient on my X230. I
'm
6730 also told that the CPU fan is running very often, making it a bit
6731 noisy. In any case, the X250 do not work out of the box with Debian
6732 Stable/Jessie, one of my requirements.
</p
>
6734 <p
>I have also gotten a few vendor proposals, one was
6735 <a href=
"http://pro-star.com
">Pro-Star
</a
>, another was
6736 <a href=
"http://shop.gluglug.org.uk/product/libreboot-x200/
">Libreboot
</a
>.
6737 The latter look very attractive to me.
</p
>
6739 <p
>Again, thank you all for the very useful feedback. It help a lot
6740 as I keep looking for a replacement.
</p
>
6742 <p
>Update
2015-
07-
06: I was recommended to check out the
6743 <a href=
"">lapstore.de
</a
> web shop for used laptops. They got several
6745 <a href=
"http://www.lapstore.de/f.php/shop/lapstore/f/
411/lang/x/kw/Lenovo_ThinkPad_X_Serie/
">old
6746 thinkpad X models
</a
>, and provide one year warranty.
</p
>
6751 <title>Time to find a new laptop, as the old one is broken after only two years
</title>
6752 <link>http://www.hungry.com/~pere/blog/Time_to_find_a_new_laptop__as_the_old_one_is_broken_after_only_two_years.html
</link>
6753 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Time_to_find_a_new_laptop__as_the_old_one_is_broken_after_only_two_years.html
</guid>
6754 <pubDate>Fri,
3 Jul
2015 07:
10:
00 +
0200</pubDate>
6755 <description><p
>My primary work horse laptop is failing, and will need a
6756 replacement soon. The left
5 cm of the screen on my Thinkpad X230
6757 started flickering yesterday, and I suspect the cause is a broken
6758 cable, as changing the angle of the screen some times get rid of the
6759 flickering.
</p
>
6761 <p
>My requirements have not really changed since I bought it, and is
6763 <a href=
"http://www.hungry.com/~pere/blog/Thank_you_Thinkpad_X41__for_your_long_and_trustworthy_service.html
">I
6764 described them in
2013</a
>. The last time I bought a laptop, I had
6766 <a href=
"http://www.prisjakt.no/category.php?k=
353">prisjakt.no
</a
>
6767 where I could select at least a few of the requirements (mouse pin,
6768 wifi, weight) and go through the rest manually. Three button mouse
6769 and a good keyboard is not available as an option, and all the three
6770 laptop models proposed today (Thinkpad X240, HP EliteBook
820 G1 and
6771 G2) lack three mouse buttons). It is also unclear to me how good the
6772 keyboard on the HP EliteBooks are. I hope Lenovo have not messed up
6773 the keyboard, even if the quality and robustness in the X series have
6774 deteriorated since X41.
</p
>
6776 <p
>I wonder how I can find a sensible laptop when none of the options
6777 seem sensible to me? Are there better services around to search the
6778 set of available laptops for features? Please send me an email if you
6779 have suggestions.
</p
>
6781 <p
>Update
2015-
07-
23: I got a suggestion to check out the FSF
6782 <a href=
"http://www.fsf.org/resources/hw/endorsement/respects-your-freedom
">list
6783 of endorsed hardware
</a
>, which is useful background information.
</p
>
6788 <title>How to stay with sysvinit in Debian Jessie
</title>
6789 <link>http://www.hungry.com/~pere/blog/How_to_stay_with_sysvinit_in_Debian_Jessie.html
</link>
6790 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_stay_with_sysvinit_in_Debian_Jessie.html
</guid>
6791 <pubDate>Sat,
22 Nov
2014 01:
00:
00 +
0100</pubDate>
6792 <description><p
>By now, it is well known that Debian Jessie will not be using
6793 sysvinit as its boot system by default. But how can one keep using
6794 sysvinit in Jessie? It is fairly easy, and here are a few recipes,
6796 <a href=
"http://www.vitavonni.de/blog/
201410/
2014102101-avoiding-systemd.html
">Erich
6797 Schubert
</a
> and
6798 <a href=
"http://smcv.pseudorandom.co.uk/
2014/still_universal/
">Simon
6801 <p
>If you already are using Wheezy and want to upgrade to Jessie and
6802 keep sysvinit as your boot system, create a file
6803 <tt
>/etc/apt/preferences.d/use-sysvinit
</tt
> with this content before
6804 you upgrade:
</p
>
6806 <p
><blockquote
><pre
>
6807 Package: systemd-sysv
6808 Pin: release o=Debian
6810 </pre
></blockquote
><p
>
6812 <p
>This file content will tell apt and aptitude to not consider
6813 installing systemd-sysv as part of any installation and upgrade
6814 solution when resolving dependencies, and thus tell it to avoid
6815 systemd as a default boot system. The end result should be that the
6816 upgraded system keep using sysvinit.
</p
>
6818 <p
>If you are installing Jessie for the first time, there is no way to
6819 get sysvinit installed by default (debootstrap used by
6820 debian-installer have no option for this), but one can tell the
6821 installer to switch to sysvinit before the first boot. Either by
6822 using a kernel argument to the installer, or by adding a line to the
6823 preseed file used. First, the kernel command line argument:
6825 <p
><blockquote
><pre
>
6826 preseed/late_command=
"in-target apt-get install --purge -y sysvinit-core
"
6827 </pre
></blockquote
><p
>
6829 <p
>Next, the line to use in a preseed file:
</p
>
6831 <p
><blockquote
><pre
>
6832 d-i preseed/late_command string in-target apt-get install -y sysvinit-core
6833 </pre
></blockquote
><p
>
6835 <p
>One can of course also do this after the first boot by installing
6836 the sysvinit-core package.
</p
>
6838 <p
>I recommend only using sysvinit if you really need it, as the
6839 sysvinit boot sequence in Debian have several hardware specific bugs
6840 on Linux caused by the fact that it is unpredictable when hardware
6841 devices show up during boot. But on the other hand, the new default
6842 boot system still have a few rough edges I hope will be fixed before
6843 Jessie is released.
</p
>
6845 <p
>Update
2014-
11-
26: Inspired by
6846 <ahref=
"https://www.mirbsd.org/permalinks/wlog-
10-tg_e20141125-tg.htm#e20141125-tg_wlog-
10-tg
">a
6847 blog post by Torsten Glaser
</a
>, added --purge to the preseed
6853 <title>A Debian package for SMTP via Tor (aka SMTorP) using exim4
</title>
6854 <link>http://www.hungry.com/~pere/blog/A_Debian_package_for_SMTP_via_Tor__aka_SMTorP__using_exim4.html
</link>
6855 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/A_Debian_package_for_SMTP_via_Tor__aka_SMTorP__using_exim4.html
</guid>
6856 <pubDate>Mon,
10 Nov
2014 13:
40:
00 +
0100</pubDate>
6857 <description><p
>The right to communicate with your friends and family in private,
6858 without anyone snooping, is a right every citicen have in a liberal
6859 democracy. But this right is under serious attack these days.
</p
>
6861 <p
>A while back it occurred to me that one way to make the dragnet
6862 surveillance conducted by NSA, GCHQ, FRA and others (and confirmed by
6863 the whisleblower Snowden) more expensive for Internet email,
6864 is to deliver all email using SMTP via Tor. Such SMTP option would be
6865 a nice addition to the FreedomBox project if we could send email
6866 between FreedomBox machines without leaking metadata about the emails
6867 to the people peeking on the wire. I
6868 <a href=
"http://lists.alioth.debian.org/pipermail/freedombox-discuss/
2014-October/
006493.html
">proposed
6869 this on the FreedomBox project mailing list in October
</a
> and got a
6870 lot of useful feedback and suggestions. It also became obvious to me
6871 that this was not a novel idea, as the same idea was tested and
6872 documented by Johannes Berg as early as
2006, and both
6873 <a href=
"https://github.com/pagekite/Mailpile/wiki/SMTorP
">the
6874 Mailpile
</a
> and
<a href=
"http://dee.su/cables
">the Cables
</a
> systems
6875 propose a similar method / protocol to pass emails between users.
</p
>
6877 <p
>To implement such system one need to set up a Tor hidden service
6878 providing the SMTP protocol on port
25, and use email addresses
6879 looking like username@hidden-service-name.onion. With such addresses
6880 the connections to port
25 on hidden-service-name.onion using Tor will
6881 go to the correct SMTP server. To do this, one need to configure the
6882 Tor daemon to provide the hidden service and the mail server to accept
6883 emails for this .onion domain. To learn more about Exim configuration
6884 in Debian and test the design provided by Johannes Berg in his FAQ, I
6885 set out yesterday to create a Debian package for making it trivial to
6886 set up such SMTP over Tor service based on Debian. Getting it to work
6887 were fairly easy, and
6888 <a href=
"https://github.com/petterreinholdtsen/exim4-smtorp
">the
6889 source code for the Debian package
</a
> is available from github. I
6890 plan to move it into Debian if further testing prove this to be a
6891 useful approach.
</p
>
6893 <p
>If you want to test this, set up a blank Debian machine without any
6894 mail system installed (or run
<tt
>apt-get purge exim4-config
</tt
> to
6895 get rid of exim4). Install tor, clone the git repository mentioned
6896 above, build the deb and install it on the machine. Next, run
6897 <tt
>/usr/lib/exim4-smtorp/setup-exim-hidden-service
</tt
> and follow
6898 the instructions to get the service up and running. Restart tor and
6899 exim when it is done, and test mail delivery using swaks like
6902 <p
><blockquote
><pre
>
6903 torsocks swaks --server dutlqrrmjhtfa3vp.onion \
6904 --to fbx@dutlqrrmjhtfa3vp.onion
6905 </pre
></blockquote
></p
>
6907 <p
>This will test the SMTP delivery using tor. Replace the email
6908 address with your own address to test your server. :)
</p
>
6910 <p
>The setup procedure is still to complex, and I hope it can be made
6911 easier and more automatic. Especially the tor setup need more work.
6912 Also, the package include a tor-smtp tool written in C, but its task
6913 should probably be rewritten in some script language to make the deb
6914 architecture independent. It would probably also make the code easier
6915 to review. The tor-smtp tool currently need to listen on a socket for
6916 exim to talk to it and is started using xinetd. It would be better if
6917 no daemon and no socket is needed. I suspect it is possible to get
6918 exim to run a command line tool for delivery instead of talking to a
6919 socket, and hope to figure out how in a future version of this
6922 <p
>Until I wipe my test machine, I can be reached using the
6923 <tt
>fbx@dutlqrrmjhtfa3vp.onion
</tt
> mail address, deliverable over
6924 SMTorP. :)
</p
>
6929 <title>listadmin, the quick way to moderate mailman lists - nice free software
</title>
6930 <link>http://www.hungry.com/~pere/blog/listadmin__the_quick_way_to_moderate_mailman_lists___nice_free_software.html
</link>
6931 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/listadmin__the_quick_way_to_moderate_mailman_lists___nice_free_software.html
</guid>
6932 <pubDate>Wed,
22 Oct
2014 20:
00:
00 +
0200</pubDate>
6933 <description><p
>If you ever had to moderate a mailman list, like the ones on
6934 alioth.debian.org, you know the web interface is fairly slow to
6935 operate. First you visit one web page, enter the moderation password
6936 and get a new page shown with a list of all the messages to moderate
6937 and various options for each email address. This take a while for
6938 every list you moderate, and you need to do it regularly to do a good
6939 job as a list moderator. But there is a quick alternative,
6940 <a href=
"http://heim.ifi.uio.no/kjetilho/hacks/#listadmin
">the
6941 listadmin program
</a
>. It allow you to check lists for new messages
6942 to moderate in a fraction of a second. Here is a test run on two
6943 lists I recently took over:
</p
>
6945 <p
><blockquote
><pre
>
6946 % time listadmin xiph
6947 fetching data for pkg-xiph-commits@lists.alioth.debian.org ... nothing in queue
6948 fetching data for pkg-xiph-maint@lists.alioth.debian.org ... nothing in queue
6954 </pre
></blockquote
></p
>
6956 <p
>In
1.7 seconds I had checked two mailing lists and confirmed that
6957 there are no message in the moderation queue. Every morning I
6958 currently moderate
68 mailman lists, and it normally take around two
6959 minutes. When I took over the two pkg-xiph lists above a few days
6960 ago, there were
400 emails waiting in the moderator queue. It took me
6961 less than
15 minutes to process them all using the listadmin
6964 <p
>If you install
6965 <a href=
"https://tracker.debian.org/pkg/listadmin
">the listadmin
6966 package
</a
> from Debian and create a file
<tt
>~/.listadmin.ini
</tt
>
6967 with content like this, the moderation task is a breeze:
</p
>
6969 <p
><blockquote
><pre
>
6970 username username@example.org
6973 discard_if_reason
"Posting restricted to members only. Remove us from your mail list.
"
6976 adminurl https://{domain}/mailman/admindb/{list}
6977 mailman-list@lists.example.com
6980 other-list@otherserver.example.org
6981 </pre
></blockquote
></p
>
6983 <p
>There are other options to set as well. Check the manual page to
6984 learn the details.
</p
>
6986 <p
>If you are forced to moderate lists on a mailman installation where
6987 the SSL certificate is self signed or not properly signed by a
6988 generally accepted signing authority, you can set a environment
6989 variable when calling listadmin to disable SSL verification:
</p
>
6991 <p
><blockquote
><pre
>
6992 PERL_LWP_SSL_VERIFY_HOSTNAME=
0 listadmin
6993 </pre
></blockquote
></p
>
6995 <p
>If you want to moderate a subset of the lists you take care of, you
6996 can provide an argument to the listadmin script like I do in the
6997 initial screen dump (the xiph argument). Using an argument, only
6998 lists matching the argument string will be processed. This make it
6999 quick to accept messages if you notice the moderation request in your
7002 <p
>Without the listadmin program, I would never be the moderator of
68
7003 mailing lists, as I simply do not have time to spend on that if the
7004 process was any slower. The listadmin program have saved me hours of
7005 time I could spend elsewhere over the years. It truly is nice free
7008 <p
>As usual, if you use Bitcoin and want to show your support of my
7009 activities, please send Bitcoin donations to my address
7010 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
7012 <p
>Update
2014-
10-
27: Added missing
'username
' statement in
7013 configuration example. Also, I
've been told that the
7014 PERL_LWP_SSL_VERIFY_HOSTNAME=
0 setting do not work for everyone. Not
7020 <title>Debian Jessie, PXE and automatic firmware installation
</title>
7021 <link>http://www.hungry.com/~pere/blog/Debian_Jessie__PXE_and_automatic_firmware_installation.html
</link>
7022 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_Jessie__PXE_and_automatic_firmware_installation.html
</guid>
7023 <pubDate>Fri,
17 Oct
2014 14:
10:
00 +
0200</pubDate>
7024 <description><p
>When PXE installing laptops with Debian, I often run into the
7025 problem that the WiFi card require some firmware to work properly.
7026 And it has been a pain to fix this using preseeding in Debian.
7027 Normally something more is needed. But thanks to
7028 <a href=
"https://packages.qa.debian.org/i/isenkram.html
">my isenkram
7029 package
</a
> and its recent tasksel extension, it has now become easy
7030 to do this using simple preseeding.
</p
>
7032 <p
>The isenkram-cli package provide tasksel tasks which will install
7033 firmware for the hardware found in the machine (actually, requested by
7034 the kernel modules for the hardware). (It can also install user space
7035 programs supporting the hardware detected, but that is not the focus
7036 of this story.)
</p
>
7038 <p
>To get this working in the default installation, two preeseding
7039 values are needed. First, the isenkram-cli package must be installed
7040 into the target chroot (aka the hard drive) before tasksel is executed
7041 in the pkgsel step of the debian-installer system. This is done by
7042 preseeding the base-installer/includes debconf value to include the
7043 isenkram-cli package. The package name is next passed to debootstrap
7044 for installation. With the isenkram-cli package in place, tasksel
7045 will automatically use the isenkram tasks to detect hardware specific
7046 packages for the machine being installed and install them, because
7047 isenkram-cli contain tasksel tasks.
</p
>
7049 <p
>Second, one need to enable the non-free APT repository, because
7050 most firmware unfortunately is non-free. This is done by preseeding
7051 the apt-mirror-setup step. This is unfortunate, but for a lot of
7052 hardware it is the only option in Debian.
</p
>
7054 <p
>The end result is two lines needed in your preseeding file to get
7055 firmware installed automatically by the installer:
</p
>
7057 <p
><blockquote
><pre
>
7058 base-installer base-installer/includes string isenkram-cli
7059 apt-mirror-setup apt-setup/non-free boolean true
7060 </pre
></blockquote
></p
>
7062 <p
>The current version of isenkram-cli in testing/jessie will install
7063 both firmware and user space packages when using this method. It also
7064 do not work well, so use version
0.15 or later. Installing both
7065 firmware and user space packages might give you a bit more than you
7066 want, so I decided to split the tasksel task in two, one for firmware
7067 and one for user space programs. The firmware task is enabled by
7068 default, while the one for user space programs is not. This split is
7069 implemented in the package currently in unstable.
</p
>
7071 <p
>If you decide to give this a go, please let me know (via email) how
7072 this recipe work for you. :)
</p
>
7074 <p
>So, I bet you are wondering, how can this work. First and
7075 foremost, it work because tasksel is modular, and driven by whatever
7076 files it find in /usr/lib/tasksel/ and /usr/share/tasksel/. So the
7077 isenkram-cli package place two files for tasksel to find. First there
7078 is the task description file (/usr/share/tasksel/descs/isenkram.desc):
</p
>
7080 <p
><blockquote
><pre
>
7081 Task: isenkram-packages
7083 Description: Hardware specific packages (autodetected by isenkram)
7084 Based on the detected hardware various hardware specific packages are
7086 Test-new-install: show show
7088 Packages: for-current-hardware
7090 Task: isenkram-firmware
7092 Description: Hardware specific firmware packages (autodetected by isenkram)
7093 Based on the detected hardware various hardware specific firmware
7094 packages are proposed.
7095 Test-new-install: mark show
7097 Packages: for-current-hardware-firmware
7098 </pre
></blockquote
></p
>
7100 <p
>The key parts are Test-new-install which indicate how the task
7101 should be handled and the Packages line referencing to a script in
7102 /usr/lib/tasksel/packages/. The scripts use other scripts to get a
7103 list of packages to install. The for-current-hardware-firmware script
7104 look like this to list relevant firmware for the machine:
7106 <p
><blockquote
><pre
>
7109 PATH=/usr/sbin:$PATH
7111 isenkram-autoinstall-firmware -l
7112 </pre
></blockquote
></p
>
7114 <p
>With those two pieces in place, the firmware is installed by
7115 tasksel during the normal d-i run. :)
</p
>
7117 <p
>If you want to test what tasksel will install when isenkram-cli is
7118 installed, run
<tt
>DEBIAN_PRIORITY=critical tasksel --test
7119 --new-install
</tt
> to get the list of packages that tasksel would
7122 <p
><a href=
"https://wiki.debian.org/DebianEdu/
">Debian Edu
</a
> will be
7123 pilots in testing this feature, as isenkram is used there now to
7124 install firmware, replacing the earlier scripts.
</p
>
7129 <title>Ubuntu used to show the bread prizes at ICA Storo
</title>
7130 <link>http://www.hungry.com/~pere/blog/Ubuntu_used_to_show_the_bread_prizes_at_ICA_Storo.html
</link>
7131 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Ubuntu_used_to_show_the_bread_prizes_at_ICA_Storo.html
</guid>
7132 <pubDate>Sat,
4 Oct
2014 15:
20:
00 +
0200</pubDate>
7133 <description><p
>Today I came across an unexpected Ubuntu boot screen. Above the
7134 bread shelf on the ICA shop at Storo in Oslo, the grub menu of Ubuntu
7135 with Linux kernel
3.2.0-
23 (ie probably version
12.04 LTS) was stuck
7136 on a screen normally showing the bread types and prizes:
</p
>
7138 <p align=
"center
"><img width=
"70%
" src=
"http://www.hungry.com/~pere/blog/images/
2014-
10-
04-ubuntu-ica-storo-crop.jpeg
"></p
>
7140 <p
>If it had booted as it was supposed to, I would never had known
7141 about this hidden Linux installation. It is interesting what
7142 <a href=
"http://revealingerrors.com/
">errors can reveal
</a
>.
</p
>
7147 <title>New lsdvd release version
0.17 is ready
</title>
7148 <link>http://www.hungry.com/~pere/blog/New_lsdvd_release_version_0_17_is_ready.html
</link>
7149 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_lsdvd_release_version_0_17_is_ready.html
</guid>
7150 <pubDate>Sat,
4 Oct
2014 08:
40:
00 +
0200</pubDate>
7151 <description><p
>The
<a href=
"https://sourceforge.net/p/lsdvd/
">lsdvd project
</a
>
7152 got a new set of developers a few weeks ago, after the original
7153 developer decided to step down and pass the project to fresh blood.
7154 This project is now maintained by Petter Reinholdtsen and Steve
7157 <p
>I just wrapped up
7158 <a href=
"https://sourceforge.net/p/lsdvd/mailman/message/
32896061/
">a
7159 new lsdvd release
</a
>, available in git or from
7160 <a href=
"https://sourceforge.net/projects/lsdvd/files/lsdvd/
">the
7161 download page
</a
>. This is the changelog dated
2014-
10-
03 for version
7166 <li
>Ignore
'phantom
' audio, subtitle tracks
</li
>
7167 <li
>Check for garbage in the program chains, which indicate that a track is
7168 non-existant, to work around additional copy protection
</li
>
7169 <li
>Fix displaying content type for audio tracks, subtitles
</li
>
7170 <li
>Fix pallete display of first entry
</li
>
7171 <li
>Fix include orders
</li
>
7172 <li
>Ignore read errors in titles that would not be displayed anyway
</li
>
7173 <li
>Fix the chapter count
</li
>
7174 <li
>Make sure the array size and the array limit used when initialising
7175 the palette size is the same.
</li
>
7176 <li
>Fix array printing.
</li
>
7177 <li
>Correct subsecond calculations.
</li
>
7178 <li
>Add sector information to the output format.
</li
>
7179 <li
>Clean up code to be closer to ANSI C and compile without warnings
7180 with more GCC compiler warnings.
</li
>
7184 <p
>This change bring together patches for lsdvd in use in various
7185 Linux and Unix distributions, as well as patches submitted to the
7186 project the last nine years. Please check it out. :)
</p
>
7191 <title>How to test Debian Edu Jessie despite some fatal problems with the installer
</title>
7192 <link>http://www.hungry.com/~pere/blog/How_to_test_Debian_Edu_Jessie_despite_some_fatal_problems_with_the_installer.html
</link>
7193 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_test_Debian_Edu_Jessie_despite_some_fatal_problems_with_the_installer.html
</guid>
7194 <pubDate>Fri,
26 Sep
2014 12:
20:
00 +
0200</pubDate>
7195 <description><p
>The
<a href=
"http://www.skolelinux.org/
">Debian Edu / Skolelinux
7196 project
</a
> provide a Linux solution for schools, including a
7197 powerful desktop with education software, a central server providing
7198 web pages, user database, user home directories, central login and PXE
7199 boot of both clients without disk and the installation to install Debian
7200 Edu on machines with disk (and a few other services perhaps to small
7201 to mention here). We in the Debian Edu team are currently working on
7202 the Jessie based version, trying to get everything in shape before the
7203 freeze, to avoid having to maintain our own package repository in the
7205 <a href=
"https://wiki.debian.org/DebianEdu/Status/Jessie
">current
7206 status
</a
> can be seen on the Debian wiki, and there is still heaps of
7207 work left. Some fatal problems block testing, breaking the installer,
7208 but it is possible to work around these to get anyway. Here is a
7209 recipe on how to get the installation limping along.
</p
>
7211 <p
>First, download the test ISO via
7212 <a href=
"ftp://ftp.skolelinux.no/cd-edu-testing-nolocal-netinst/debian-edu-amd64-i386-NETINST-
1.iso
">ftp
</a
>,
7213 <a href=
"http://ftp.skolelinux.no/cd-edu-testing-nolocal-netinst/debian-edu-amd64-i386-NETINST-
1.iso
">http
</a
>
7215 ftp.skolelinux.org::cd-edu-testing-nolocal-netinst/debian-edu-amd64-i386-NETINST-
1.iso).
7216 The ISO build was broken on Tuesday, so we do not get a new ISO every
7217 12 hours or so, but thankfully the ISO we already got we are able to
7218 install with some tweaking.
</p
>
7220 <p
>When you get to the Debian Edu profile question, go to tty2
7221 (use Alt-Ctrl-F2), run
</p
>
7223 <p
><blockquote
><pre
>
7224 nano /usr/bin/edu-eatmydata-install
7225 </pre
></blockquote
></p
>
7227 <p
>and add
'exit
0' as the second line, disabling the eatmydata
7228 optimization. Return to the installation, select the profile you want
7229 and continue. Without this change, exim4-config will fail to install
7230 due to a known bug in eatmydata.
</p
>
7232 <p
>When you get the grub question at the end, answer /dev/sda (or if
7233 this do not work, figure out what your correct value would be. All my
7234 test machines need /dev/sda, so I have no advice if it do not fit
7235 your need.
</p
>
7237 <p
>If you installed a profile including a graphical desktop, log in as
7238 root after the initial boot from hard drive, and install the
7239 education-desktop-XXX metapackage. XXX can be kde, gnome, lxde, xfce
7240 or mate. If you want several desktop options, install more than one
7241 metapackage. Once this is done, reboot and you should have a working
7242 graphical login screen. This workaround should no longer be needed
7243 once the education-tasks package version
1.801 enter testing in two
7246 <p
>I believe the ISO build will start working on two days when the new
7247 tasksel package enter testing and Steve McIntyre get a chance to
7248 update the debian-cd git repository. The eatmydata, grub and desktop
7249 issues are already fixed in unstable and testing, and should show up
7250 on the ISO as soon as the ISO build start working again. Well the
7251 eatmydata optimization is really just disabled. The proper fix
7252 require an upload by the eatmydata maintainer applying the patch
7253 provided in bug
<a href=
"https://bugs.debian.org/
702711">#
702711</a
>.
7254 The rest have proper fixes in unstable.
</p
>
7256 <p
>I hope this get you going with the installation testing, as we are
7257 quickly running out of time trying to get our Jessie based
7258 installation ready before the distribution freeze in a month.
</p
>
7263 <title>Suddenly I am the new upstream of the lsdvd command line tool
</title>
7264 <link>http://www.hungry.com/~pere/blog/Suddenly_I_am_the_new_upstream_of_the_lsdvd_command_line_tool.html
</link>
7265 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Suddenly_I_am_the_new_upstream_of_the_lsdvd_command_line_tool.html
</guid>
7266 <pubDate>Thu,
25 Sep
2014 11:
20:
00 +
0200</pubDate>
7267 <description><p
>I use the
<a href=
"https://sourceforge.net/p/lsdvd/
">lsdvd tool
</a
>
7268 to handle my fairly large DVD collection. It is a nice command line
7269 tool to get details about a DVD, like title, tracks, track length,
7270 etc, in XML, Perl or human readable format. But lsdvd have not seen
7271 any new development since
2006 and had a few irritating bugs affecting
7272 its use with some DVDs. Upstream seemed to be dead, and in January I
7273 sent a small probe asking for a version control repository for the
7274 project, without any reply. But I use it regularly and would like to
7275 get
<a href=
"https://packages.qa.debian.org/lsdvd
">an updated version
7276 into Debian
</a
>. So two weeks ago I tried harder to get in touch with
7277 the project admin, and after getting a reply from him explaining that
7278 he was no longer interested in the project, I asked if I could take
7279 over. And yesterday, I became project admin.
</p
>
7281 <p
>I
've been in touch with a Gentoo developer and the Debian
7282 maintainer interested in joining forces to maintain the upstream
7283 project, and I hope we can get a new release out fairly quickly,
7284 collecting the patches spread around on the internet into on place.
7285 I
've added the relevant Debian patches to the freshly created git
7286 repository, and expect the Gentoo patches to make it too. If you got
7287 a DVD collection and care about command line tools, check out
7288 <a href=
"https://sourceforge.net/p/lsdvd/git/ci/master/tree/
">the git source
</a
> and join
7289 <a href=
"https://sourceforge.net/p/lsdvd/mailman/
">the project mailing
7290 list
</a
>. :)
</p
>
7295 <title>Speeding up the Debian installer using eatmydata and dpkg-divert
</title>
7296 <link>http://www.hungry.com/~pere/blog/Speeding_up_the_Debian_installer_using_eatmydata_and_dpkg_divert.html
</link>
7297 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Speeding_up_the_Debian_installer_using_eatmydata_and_dpkg_divert.html
</guid>
7298 <pubDate>Tue,
16 Sep
2014 14:
00:
00 +
0200</pubDate>
7299 <description><p
>The
<a href=
"https://www.debian.org/
">Debian
</a
> installer could be
7300 a lot quicker. When we install more than
2000 packages in
7301 <a href=
"http://www.skolelinux.org/
">Skolelinux / Debian Edu
</a
> using
7302 tasksel in the installer, unpacking the binary packages take forever.
7303 A part of the slow I/O issue was discussed in
7304 <a href=
"https://bugs.debian.org/
613428">bug #
613428</a
> about too
7305 much file system sync-ing done by dpkg, which is the package
7306 responsible for unpacking the binary packages. Other parts (like code
7307 executed by postinst scripts) might also sync to disk during
7308 installation. All this sync-ing to disk do not really make sense to
7309 me. If the machine crash half-way through, I start over, I do not try
7310 to salvage the half installed system. So the failure sync-ing is
7311 supposed to protect against, hardware or system crash, is not really
7312 relevant while the installer is running.
</p
>
7314 <p
>A few days ago, I thought of a way to get rid of all the file
7315 system sync()-ing in a fairly non-intrusive way, without the need to
7316 change the code in several packages. The idea is not new, but I have
7317 not heard anyone propose the approach using dpkg-divert before. It
7318 depend on the small and clever package
7319 <a href=
"https://packages.qa.debian.org/eatmydata
">eatmydata
</a
>, which
7320 uses LD_PRELOAD to replace the system functions for syncing data to
7321 disk with functions doing nothing, thus allowing programs to live
7322 dangerous while speeding up disk I/O significantly. Instead of
7323 modifying the implementation of dpkg, apt and tasksel (which are the
7324 packages responsible for selecting, fetching and installing packages),
7325 it occurred to me that we could just divert the programs away, replace
7326 them with a simple shell wrapper calling
7327 "eatmydata
&nbsp;$program
&nbsp;$@
", to get the same effect.
7328 Two days ago I decided to test the idea, and wrapped up a simple
7329 implementation for the Debian Edu udeb.
</p
>
7331 <p
>The effect was stunning. In my first test it reduced the running
7332 time of the pkgsel step (installing tasks) from
64 to less than
44
7333 minutes (
20 minutes shaved off the installation) on an old Dell
7334 Latitude D505 machine. I am not quite sure what the optimised time
7335 would have been, as I messed up the testing a bit, causing the debconf
7336 priority to get low enough for two questions to pop up during
7337 installation. As soon as I saw the questions I moved the installation
7338 along, but do not know how long the question were holding up the
7339 installation. I did some more measurements using Debian Edu Jessie,
7340 and got these results. The time measured is the time stamp in
7341 /var/log/syslog between the
"pkgsel: starting tasksel
" and the
7342 "pkgsel: finishing up
" lines, if you want to do the same measurement
7343 yourself. In Debian Edu, the tasksel dialog do not show up, and the
7344 timing thus do not depend on how quickly the user handle the tasksel
7347 <p
><table
>
7350 <th
>Machine/setup
</th
>
7351 <th
>Original tasksel
</th
>
7352 <th
>Optimised tasksel
</th
>
7353 <th
>Reduction
</th
>
7357 <td
>Latitude D505 Main+LTSP LXDE
</td
>
7358 <td
>64 min (
07:
46-
08:
50)
</td
>
7359 <td
><44 min (
11:
27-
12:
11)
</td
>
7360 <td
>>20 min
18%
</td
>
7364 <td
>Latitude D505 Roaming LXDE
</td
>
7365 <td
>57 min (
08:
48-
09:
45)
</td
>
7366 <td
>34 min (
07:
43-
08:
17)
</td
>
7367 <td
>23 min
40%
</td
>
7371 <td
>Latitude D505 Minimal
</td
>
7372 <td
>22 min (
10:
37-
10:
59)
</td
>
7373 <td
>11 min (
11:
16-
11:
27)
</td
>
7374 <td
>11 min
50%
</td
>
7378 <td
>Thinkpad X200 Minimal
</td
>
7379 <td
>6 min (
08:
19-
08:
25)
</td
>
7380 <td
>4 min (
08:
04-
08:
08)
</td
>
7381 <td
>2 min
33%
</td
>
7385 <td
>Thinkpad X200 Roaming KDE
</td
>
7386 <td
>19 min (
09:
21-
09:
40)
</td
>
7387 <td
>15 min (
10:
25-
10:
40)
</td
>
7388 <td
>4 min
21%
</td
>
7391 </table
></p
>
7393 <p
>The test is done using a netinst ISO on a USB stick, so some of the
7394 time is spent downloading packages. The connection to the Internet
7395 was
100Mbit/s during testing, so downloading should not be a
7396 significant factor in the measurement. Download typically took a few
7397 seconds to a few minutes, depending on the amount of packages being
7398 installed.
</p
>
7400 <p
>The speedup is implemented by using two hooks in
7401 <a href=
"https://www.debian.org/devel/debian-installer/
">Debian
7402 Installer
</a
>, the pre-pkgsel.d hook to set up the diverts, and the
7403 finish-install.d hook to remove the divert at the end of the
7404 installation. I picked the pre-pkgsel.d hook instead of the
7405 post-base-installer.d hook because I test using an ISO without the
7406 eatmydata package included, and the post-base-installer.d hook in
7407 Debian Edu can only operate on packages included in the ISO. The
7408 negative effect of this is that I am unable to activate this
7409 optimization for the kernel installation step in d-i. If the code is
7410 moved to the post-base-installer.d hook, the speedup would be larger
7411 for the entire installation.
</p
>
7413 <p
>I
've implemented this in the
7414 <a href=
"https://packages.qa.debian.org/debian-edu-install
">debian-edu-install
</a
>
7415 git repository, and plan to provide the optimization as part of the
7416 Debian Edu installation. If you want to test this yourself, you can
7417 create two files in the installer (or in an udeb). One shell script
7418 need do go into /usr/lib/pre-pkgsel.d/, with content like this:
</p
>
7420 <p
><blockquote
><pre
>
7423 . /usr/share/debconf/confmodule
7425 logger -t my-pkgsel
"info: $*
"
7428 logger -t my-pkgsel
"error: $*
"
7430 override_install() {
7431 apt-install eatmydata || true
7432 if [ -x /target/usr/bin/eatmydata ] ; then
7433 for bin in dpkg apt-get aptitude tasksel ; do
7435 # Test that the file exist and have not been diverted already.
7436 if [ -f /target$file ] ; then
7437 info
"diverting $file using eatmydata
"
7438 printf
"#!/bin/sh\neatmydata $bin.distrib \
"\$@\
"\n
" \
7439 > /target$file.edu
7440 chmod
755 /target$file.edu
7441 in-target dpkg-divert --package debian-edu-config \
7442 --rename --quiet --add $file
7443 ln -sf ./$bin.edu /target$file
7445 error
"unable to divert $file, as it is missing.
"
7449 error
"unable to find /usr/bin/eatmydata after installing the eatmydata pacage
"
7454 </pre
></blockquote
></p
>
7456 <p
>To clean up, another shell script should go into
7457 /usr/lib/finish-install.d/ with code like this:
7459 <p
><blockquote
><pre
>
7461 . /usr/share/debconf/confmodule
7463 logger -t my-finish-install
"error: $@
"
7465 remove_install_override() {
7466 for bin in dpkg apt-get aptitude tasksel ; do
7468 if [ -x /target$file.edu ] ; then
7470 in-target dpkg-divert --package debian-edu-config \
7471 --rename --quiet --remove $file
7474 error
"Missing divert for $file.
"
7477 sync # Flush file buffers before continuing
7480 remove_install_override
7481 </pre
></blockquote
></p
>
7483 <p
>In Debian Edu, I placed both code fragments in a separate script
7484 edu-eatmydata-install and call it from the pre-pkgsel.d and
7485 finish-install.d scripts.
</p
>
7487 <p
>By now you might ask if this change should get into the normal
7488 Debian installer too? I suspect it should, but am not sure the
7489 current debian-installer coordinators find it useful enough. It also
7490 depend on the side effects of the change. I
'm not aware of any, but I
7491 guess we will see if the change is safe after some more testing.
7492 Perhaps there is some package in Debian depending on sync() and
7493 fsync() having effect? Perhaps it should go into its own udeb, to
7494 allow those of us wanting to enable it to do so without affecting
7497 <p
>Update
2014-
09-
24: Since a few days ago, enabling this optimization
7498 will break installation of all programs using gnutls because of
7499 <a href=
"https://bugs.debian.org/
702711">bug #
702711</a
>. An updated
7500 eatmydata package in Debian will solve it.
</p
>
7502 <p
>Update
2014-
10-
17: The bug mentioned above is fixed in testing and
7503 the optimization work again. And I have discovered that the
7504 dpkg-divert trick is not really needed and implemented a slightly
7505 simpler approach as part of the debian-edu-install package. See
7506 tools/edu-eatmydata-install in the source package.
</p
>
7508 <p
>Update
2014-
11-
11: Unfortunately, a new
7509 <a href=
"http://bugs.debian.org/
765738">bug #
765738</a
> in eatmydata only
7510 triggering on i386 made it into testing, and broke this installation
7511 optimization again. If
<a href=
"http://bugs.debian.org/
768893">unblock
7512 request
768893</a
> is accepted, it should be working again.
</p
>
7517 <title>Good bye subkeys.pgp.net, welcome pool.sks-keyservers.net
</title>
7518 <link>http://www.hungry.com/~pere/blog/Good_bye_subkeys_pgp_net__welcome_pool_sks_keyservers_net.html
</link>
7519 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Good_bye_subkeys_pgp_net__welcome_pool_sks_keyservers_net.html
</guid>
7520 <pubDate>Wed,
10 Sep
2014 13:
10:
00 +
0200</pubDate>
7521 <description><p
>Yesterday, I had the pleasure of attending a talk with the
7522 <a href=
"http://www.nuug.no/
">Norwegian Unix User Group
</a
> about
7523 <a href=
"http://www.nuug.no/aktiviteter/
20140909-sks-keyservers/
">the
7524 OpenPGP keyserver pool sks-keyservers.net
</a
>, and was very happy to
7525 learn that there is a large set of publicly available key servers to
7526 use when looking for peoples public key. So far I have used
7527 subkeys.pgp.net, and some times wwwkeys.nl.pgp.net when the former
7528 were misbehaving, but those days are ended. The servers I have used
7529 up until yesterday have been slow and some times unavailable. I hope
7530 those problems are gone now.
</p
>
7532 <p
>Behind the round robin DNS entry of the
7533 <a href=
"https://sks-keyservers.net/
">sks-keyservers.net
</a
> service
7534 there is a pool of more than
100 keyservers which are checked every
7535 day to ensure they are well connected and up to date. It must be
7536 better than what I have used so far. :)
</p
>
7538 <p
>Yesterdays speaker told me that the service is the default
7539 keyserver provided by the default configuration in GnuPG, but this do
7540 not seem to be used in Debian. Perhaps it should?
</p
>
7542 <p
>Anyway, I
've updated my ~/.gnupg/options file to now include this
7545 <p
><blockquote
><pre
>
7546 keyserver pool.sks-keyservers.net
7547 </pre
></blockquote
></p
>
7549 <p
>With GnuPG version
2 one can also locate the keyserver using SRV
7550 entries in DNS. Just for fun, I did just that at work, so now every
7551 user of GnuPG at the University of Oslo should find a OpenGPG
7552 keyserver automatically should their need it:
</p
>
7554 <p
><blockquote
><pre
>
7555 % host -t srv _pgpkey-http._tcp.uio.no
7556 _pgpkey-http._tcp.uio.no has SRV record
0 100 11371 pool.sks-keyservers.net.
7558 </pre
></blockquote
></p
>
7560 <p
>Now if only
7561 <a href=
"http://ietfreport.isoc.org/idref/draft-shaw-openpgp-hkp/
">the
7562 HKP lookup protocol
</a
> supported finding signature paths, I would be
7563 very happy. It can look up a given key or search for a user ID, but I
7564 normally do not want that, but to find a trust path from my key to
7565 another key. Given a user ID or key ID, I would like to find (and
7566 download) the keys representing a signature path from my key to the
7567 key in question, to be able to get a trust path between the two keys.
7568 This is as far as I can tell not possible today. Perhaps something
7569 for a future version of the protocol?
</p
>
7574 <title>From English wiki to translated PDF and epub via Docbook
</title>
7575 <link>http://www.hungry.com/~pere/blog/From_English_wiki_to_translated_PDF_and_epub_via_Docbook.html
</link>
7576 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/From_English_wiki_to_translated_PDF_and_epub_via_Docbook.html
</guid>
7577 <pubDate>Tue,
17 Jun
2014 11:
30:
00 +
0200</pubDate>
7578 <description><p
>The
<a href=
"http://www.skolelinux.org/
">Debian Edu / Skolelinux
7579 project
</a
> provide an instruction manual for teachers, system
7580 administrators and other users that contain useful tips for setting up
7581 and maintaining a Debian Edu installation. This text is about how the
7582 text processing of this manual is handled in the project.
</p
>
7584 <p
>One goal of the project is to provide information in the native
7585 language of its users, and for this we need to handle translations.
7586 But we also want to make sure each language contain the same
7587 information, so for this we need a good way to keep the translations
7588 in sync. And we want it to be easy for our users to improve the
7589 documentation, avoiding the need to learn special formats or tools to
7590 contribute, and the obvious way to do this is to make it possible to
7591 edit the documentation using a web browser. We also want it to be
7592 easy for translators to keep the translation up to date, and give them
7593 help in figuring out what need to be translated. Here is the list of
7594 tools and the process we have found trying to reach all these
7597 <p
>We maintain the authoritative source of our manual in the
7598 <a href=
"https://wiki.debian.org/DebianEdu/Documentation/Wheezy/
">Debian
7599 wiki
</a
>, as several wiki pages written in English. It consist of one
7600 front page with references to the different chapters, several pages
7601 for each chapter, and finally one
"collection page
" gluing all the
7602 chapters together into one large web page (aka
7603 <a href=
"https://wiki.debian.org/DebianEdu/Documentation/Wheezy/AllInOne
">the
7604 AllInOne page
</a
>). The AllInOne page is the one used for further
7605 processing and translations. Thanks to the fact that the
7606 <a href=
"http://moinmo.in/
">MoinMoin
</a
> installation on
7607 wiki.debian.org support exporting pages in
7608 <a href=
"http://www.docbook.org/
">the Docbook format
</a
>, we can fetch
7609 the list of pages to export using the raw version of the AllInOne
7610 page, loop over each of them to generate a Docbook XML version of the
7611 manual. This process also download images and transform image
7612 references to use the locally downloaded images. The generated
7613 Docbook XML files are slightly broken, so some post-processing is done
7614 using the
<tt
>documentation/scripts/get_manual
</tt
> program, and the
7615 result is a nice Docbook XML file (debian-edu-wheezy-manual.xml) and
7616 a handfull of images. The XML file can now be used to generate PDF, HTML
7617 and epub versions of the English manual. This is the basic step of
7618 our process, making PDF (using dblatex), HTML (using xsltproc) and
7619 epub (using dbtoepub) version from Docbook XML, and the resulting files
7620 are placed in the debian-edu-doc-en binary package.
</p
>
7622 <p
>But English documentation is not enough for us. We want translated
7623 documentation too, and we want to make it easy for translators to
7624 track the English original. For this we use the
7625 <a href=
"http://packages.qa.debian.org/p/poxml.html
">poxml
</a
> package,
7626 which allow us to transform the English Docbook XML file into a
7627 translation file (a .pot file), usable with the normal gettext based
7628 translation tools used by those translating free software. The pot
7629 file is used to create and maintain translation files (several .po
7630 files), which the translations update with the native language
7631 translations of all titles, paragraphs and blocks of text in the
7632 original. The next step is combining the original English Docbook XML
7633 and the translation file (say debian-edu-wheezy-manual.nb.po), to
7634 create a translated Docbook XML file (in this case
7635 debian-edu-wheezy-manual.nb.xml). This translated (or partly
7636 translated, if the translation is not complete) Docbook XML file can
7637 then be used like the original to create a PDF, HTML and epub version
7638 of the documentation.
</p
>
7640 <p
>The translators use different tools to edit the .po files. We
7642 <a href=
"http://www.kde.org/applications/development/lokalize/
">lokalize
</a
>,
7643 while some use emacs and vi, others can use web based editors like
7644 <a href=
"http://pootle.translatehouse.org/
">Poodle
</a
> or
7645 <a href=
"https://www.transifex.com/
">Transifex
</a
>. All we care about
7646 is where the .po file end up, in our git repository. Updated
7647 translations can either be committed directly to git, or submitted as
7648 <a href=
"https://bugs.debian.org/src:debian-edu-doc
">bug reports
7649 against the debian-edu-doc package
</a
>.
</p
>
7651 <p
>One challenge is images, which both might need to be translated (if
7652 they show translated user applications), and are needed in different
7653 formats when creating PDF and HTML versions (epub is a HTML version in
7654 this regard). For this we transform the original PNG images to the
7655 needed density and format during build, and have a way to provide
7656 translated images by storing translated versions in
7657 images/$LANGUAGECODE/. I am a bit unsure about the details here. The
7658 package maintainers know more.
</p
>
7660 <p
>If you wonder what the result look like, we provide
7661 <a href=
"http://maintainer.skolelinux.org/debian-edu-doc/
">the content
7662 of the documentation packages on the web
</a
>. See for example the
7663 <a href=
"http://maintainer.skolelinux.org/debian-edu-doc/it/debian-edu-wheezy-manual.pdf
">Italian
7664 PDF version
</a
> or the
7665 <a href=
"http://maintainer.skolelinux.org/debian-edu-doc/de/debian-edu-wheezy-manual.html
">German
7666 HTML version
</a
>. We do not yet build the epub version by default,
7667 but perhaps it will be done in the future.
</p
>
7669 <p
>To learn more, check out
7670 <a href=
"http://packages.qa.debian.org/d/debian-edu-doc.html
">the
7671 debian-edu-doc package
</a
>,
7672 <a href=
"https://wiki.debian.org/DebianEdu/Documentation/Wheezy/
">the
7673 manual on the wiki
</a
> and
7674 <a href=
"https://wiki.debian.org/DebianEdu/Documentation/Wheezy/Translations
">the
7675 translation instructions
</a
> in the manual.
</p
>
7680 <title>Install hardware dependent packages using tasksel (Isenkram
0.7)
</title>
7681 <link>http://www.hungry.com/~pere/blog/Install_hardware_dependent_packages_using_tasksel__Isenkram_0_7_.html
</link>
7682 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Install_hardware_dependent_packages_using_tasksel__Isenkram_0_7_.html
</guid>
7683 <pubDate>Wed,
23 Apr
2014 14:
50:
00 +
0200</pubDate>
7684 <description><p
>It would be nice if it was easier in Debian to get all the hardware
7685 related packages relevant for the computer installed automatically.
7686 So I implemented one, using
7687 <a href=
"http://packages.qa.debian.org/isenkram
">my Isenkram
7688 package
</a
>. To use it, install the tasksel and isenkram packages and
7689 run tasksel as user root. You should be presented with a new option,
7690 "Hardware specific packages (autodetected by isenkram)
". When you
7691 select it, tasksel will install the packages isenkram claim is fit for
7692 the current hardware, hot pluggable or not.
<p
>
7694 <p
>The implementation is in two files, one is the tasksel menu entry
7695 description, and the other is the script used to extract the list of
7696 packages to install. The first part is in
7697 <tt
>/usr/share/tasksel/descs/isenkram.desc
</tt
> and look like
7700 <p
><blockquote
><pre
>
7703 Description: Hardware specific packages (autodetected by isenkram)
7704 Based on the detected hardware various hardware specific packages are
7706 Test-new-install: mark show
7708 Packages: for-current-hardware
7709 </pre
></blockquote
></p
>
7711 <p
>The second part is in
7712 <tt
>/usr/lib/tasksel/packages/for-current-hardware
</tt
> and look like
7715 <p
><blockquote
><pre
>
7720 isenkram-autoinstall-firmware -l
7722 </pre
></blockquote
></p
>
7724 <p
>All in all, a very short and simple implementation making it
7725 trivial to install the hardware dependent package we all may want to
7726 have installed on our machines. I
've not been able to find a way to
7727 get tasksel to tell you exactly which packages it plan to install
7728 before doing the installation. So if you are curious or careful,
7729 check the output from the isenkram-* command line tools first.
</p
>
7731 <p
>The information about which packages are handling which hardware is
7732 fetched either from the isenkram package itself in
7733 /usr/share/isenkram/, from git.debian.org or from the APT package
7734 database (using the Modaliases header). The APT package database
7735 parsing have caused a nasty resource leak in the isenkram daemon (bugs
7736 <a href=
"http://bugs.debian.org/
719837">#
719837</a
> and
7737 <a href=
"http://bugs.debian.org/
730704">#
730704</a
>). The cause is in
7738 the python-apt code (bug
7739 <a href=
"http://bugs.debian.org/
745487">#
745487</a
>), but using a
7740 workaround I was able to get rid of the file descriptor leak and
7741 reduce the memory leak from ~
30 MiB per hardware detection down to
7742 around
2 MiB per hardware detection. It should make the desktop
7743 daemon a lot more useful. The fix is in version
0.7 uploaded to
7744 unstable today.
</p
>
7746 <p
>I believe the current way of mapping hardware to packages in
7747 Isenkram is is a good draft, but in the future I expect isenkram to
7748 use the AppStream data source for this. A proposal for getting proper
7749 AppStream support into Debian is floating around as
7750 <a href=
"https://wiki.debian.org/DEP-
11">DEP-
11</a
>, and
7751 <a href=
"https://wiki.debian.org/SummerOfCode2014/Projects#SummerOfCode2014.2FProjects
.2FAppStreamDEP11Implementation.AppStream
.2FDEP-
11_for_the_Debian_Archive
">GSoC
7752 project
</a
> will take place this summer to improve the situation. I
7753 look forward to seeing the result, and welcome patches for isenkram to
7754 start using the information when it is ready.
</p
>
7756 <p
>If you want your package to map to some specific hardware, either
7757 add a
"Xb-Modaliases
" header to your control file like I did in
7758 <a href=
"http://packages.qa.debian.org/pymissile
">the pymissile
7759 package
</a
> or submit a bug report with the details to the isenkram
7761 <a href=
"http://www.hungry.com/~pere/blog/tags/isenkram/
">all my
7762 blog posts tagged isenkram
</a
> for details on the notation. I expect
7763 the information will be migrated to AppStream eventually, but for the
7764 moment I got no better place to store it.
</p
>
7769 <title>FreedomBox milestone - all packages now in Debian Sid
</title>
7770 <link>http://www.hungry.com/~pere/blog/FreedomBox_milestone___all_packages_now_in_Debian_Sid.html
</link>
7771 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/FreedomBox_milestone___all_packages_now_in_Debian_Sid.html
</guid>
7772 <pubDate>Tue,
15 Apr
2014 22:
10:
00 +
0200</pubDate>
7773 <description><p
>The
<a href=
"https://wiki.debian.org/FreedomBox
">Freedombox
7774 project
</a
> is working on providing the software and hardware to make
7775 it easy for non-technical people to host their data and communication
7776 at home, and being able to communicate with their friends and family
7777 encrypted and away from prying eyes. It is still going strong, and
7778 today a major mile stone was reached.
</p
>
7780 <p
>Today, the last of the packages currently used by the project to
7781 created the system images were accepted into Debian Unstable. It was
7782 the freedombox-setup package, which is used to configure the images
7783 during build and on the first boot. Now all one need to get going is
7784 the build code from the freedom-maker git repository and packages from
7785 Debian. And once the freedombox-setup package enter testing, we can
7786 build everything directly from Debian. :)
</p
>
7788 <p
>Some key packages used by Freedombox are
7789 <a href=
"http://packages.qa.debian.org/freedombox-setup
">freedombox-setup
</a
>,
7790 <a href=
"http://packages.qa.debian.org/plinth
">plinth
</a
>,
7791 <a href=
"http://packages.qa.debian.org/pagekite
">pagekite
</a
>,
7792 <a href=
"http://packages.qa.debian.org/tor
">tor
</a
>,
7793 <a href=
"http://packages.qa.debian.org/privoxy
">privoxy
</a
>,
7794 <a href=
"http://packages.qa.debian.org/owncloud
">owncloud
</a
> and
7795 <a href=
"http://packages.qa.debian.org/dnsmasq
">dnsmasq
</a
>. There
7796 are plans to integrate more packages into the setup. User
7797 documentation is maintained on the Debian wiki. Please
7798 <a href=
"https://wiki.debian.org/FreedomBox/Manual/Jessie
">check out
7799 the manual
</a
> and help us improve it.
</p
>
7801 <p
>To test for yourself and create boot images with the FreedomBox
7802 setup, run this on a Debian machine using a user with sudo rights to
7803 become root:
</p
>
7805 <p
><pre
>
7806 sudo apt-get install git vmdebootstrap mercurial python-docutils \
7807 mktorrent extlinux virtualbox qemu-user-static binfmt-support \
7809 git clone http://anonscm.debian.org/git/freedombox/freedom-maker.git \
7811 make -C freedom-maker dreamplug-image raspberry-image virtualbox-image
7812 </pre
></p
>
7814 <p
>Root access is needed to run debootstrap and mount loopback
7815 devices. See the README in the freedom-maker git repo for more
7816 details on the build. If you do not want all three images, trim the
7817 make line. Note that the virtualbox-image target is not really
7818 virtualbox specific. It create a x86 image usable in kvm, qemu,
7819 vmware and any other x86 virtual machine environment. You might need
7820 the version of vmdebootstrap in Jessie to get the build working, as it
7821 include fixes for a race condition with kpartx.
</p
>
7823 <p
>If you instead want to install using a Debian CD and the preseed
7824 method, boot a Debian Wheezy ISO and use this boot argument to load
7825 the preseed values:
</p
>
7827 <p
><pre
>
7828 url=
<a href=
"http://www.reinholdtsen.name/freedombox/preseed-jessie.dat
">http://www.reinholdtsen.name/freedombox/preseed-jessie.dat
</a
>
7829 </pre
></p
>
7831 <p
>I have not tested it myself the last few weeks, so I do not know if
7832 it still work.
</p
>
7834 <p
>If you wonder how to help, one task you could look at is using
7835 systemd as the boot system. It will become the default for Linux in
7836 Jessie, so we need to make sure it is usable on the Freedombox. I did
7837 a simple test a few weeks ago, and noticed dnsmasq failed to start
7838 during boot when using systemd. I suspect there are other problems
7839 too. :) To detect problems, there is a test suite included, which can
7840 be run from the plinth web interface.
</p
>
7842 <p
>Give it a go and let us know how it goes on the mailing list, and help
7843 us get the new release published. :) Please join us on
7844 <a href=
"irc://irc.debian.org:
6667/%
23freedombox
">IRC (#freedombox on
7845 irc.debian.org)
</a
> and
7846 <a href=
"http://lists.alioth.debian.org/mailman/listinfo/freedombox-discuss
">the
7847 mailing list
</a
> if you want to help make this vision come true.
</p
>
7852 <title>S3QL, a locally mounted cloud file system - nice free software
</title>
7853 <link>http://www.hungry.com/~pere/blog/S3QL__a_locally_mounted_cloud_file_system___nice_free_software.html
</link>
7854 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/S3QL__a_locally_mounted_cloud_file_system___nice_free_software.html
</guid>
7855 <pubDate>Wed,
9 Apr
2014 11:
30:
00 +
0200</pubDate>
7856 <description><p
>For a while now, I have been looking for a sensible offsite backup
7857 solution for use at home. My requirements are simple, it must be
7858 cheap and locally encrypted (in other words, I keep the encryption
7859 keys, the storage provider do not have access to my private files).
7860 One idea me and my friends had many years ago, before the cloud
7861 storage providers showed up, was to use Google mail as storage,
7862 writing a Linux block device storing blocks as emails in the mail
7863 service provided by Google, and thus get heaps of free space. On top
7864 of this one can add encryption, RAID and volume management to have
7865 lots of (fairly slow, I admit that) cheap and encrypted storage. But
7866 I never found time to implement such system. But the last few weeks I
7867 have looked at a system called
7868 <a href=
"https://bitbucket.org/nikratio/s3ql/
">S3QL
</a
>, a locally
7869 mounted network backed file system with the features I need.
</p
>
7871 <p
>S3QL is a fuse file system with a local cache and cloud storage,
7872 handling several different storage providers, any with Amazon S3,
7873 Google Drive or OpenStack API. There are heaps of such storage
7874 providers. S3QL can also use a local directory as storage, which
7875 combined with sshfs allow for file storage on any ssh server. S3QL
7876 include support for encryption, compression, de-duplication, snapshots
7877 and immutable file systems, allowing me to mount the remote storage as
7878 a local mount point, look at and use the files as if they were local,
7879 while the content is stored in the cloud as well. This allow me to
7880 have a backup that should survive fire. The file system can not be
7881 shared between several machines at the same time, as only one can
7882 mount it at the time, but any machine with the encryption key and
7883 access to the storage service can mount it if it is unmounted.
</p
>
7885 <p
>It is simple to use. I
'm using it on Debian Wheezy, where the
7886 package is included already. So to get started, run
<tt
>apt-get
7887 install s3ql
</tt
>. Next, pick a storage provider. I ended up picking
7888 Greenqloud, after reading their nice recipe on
7889 <a href=
"https://greenqloud.zendesk.com/entries/
44611757-How-To-Use-S3QL-to-mount-a-StorageQloud-bucket-on-Debian-Wheezy
">how
7890 to use S3QL with their Amazon S3 service
</a
>, because I trust the laws
7891 in Iceland more than those in USA when it come to keeping my personal
7892 data safe and private, and thus would rather spend money on a company
7893 in Iceland. Another nice recipe is available from the article
7894 <a href=
"http://www.admin-magazine.com/HPC/Articles/HPC-Cloud-Storage
">S3QL
7895 Filesystem for HPC Storage
</a
> by Jeff Layton in the HPC section of
7896 Admin magazine. When the provider is picked, figure out how to get
7897 the API key needed to connect to the storage API. With Greencloud,
7898 the key did not show up until I had added payment details to my
7901 <p
>Armed with the API access details, it is time to create the file
7902 system. First, create a new bucket in the cloud. This bucket is the
7903 file system storage area. I picked a bucket name reflecting the
7904 machine that was going to store data there, but any name will do.
7905 I
'll refer to it as
<tt
>bucket-name
</tt
> below. In addition, one need
7906 the API login and password, and a locally created password. Store it
7907 all in ~root/.s3ql/authinfo2 like this:
7909 <p
><blockquote
><pre
>
7911 storage-url: s3c://s.greenqloud.com:
443/bucket-name
7912 backend-login: API-login
7913 backend-password: API-password
7914 fs-passphrase: local-password
7915 </pre
></blockquote
></p
>
7917 <p
>I create my local passphrase using
<tt
>pwget
50</tt
> or similar,
7918 but any sensible way to create a fairly random password should do it.
7919 Armed with these details, it is now time to run mkfs, entering the API
7920 details and password to create it:
</p
>
7922 <p
><blockquote
><pre
>
7923 # mkdir -m
700 /var/lib/s3ql-cache
7924 # mkfs.s3ql --cachedir /var/lib/s3ql-cache --authfile /root/.s3ql/authinfo2 \
7925 --ssl s3c://s.greenqloud.com:
443/bucket-name
7926 Enter backend login:
7927 Enter backend password:
7928 Before using S3QL, make sure to read the user
's guide, especially
7929 the
'Important Rules to Avoid Loosing Data
' section.
7930 Enter encryption password:
7931 Confirm encryption password:
7932 Generating random encryption key...
7933 Creating metadata tables...
7943 Compressing and uploading metadata...
7944 Wrote
0.00 MB of compressed metadata.
7945 #
</pre
></blockquote
></p
>
7947 <p
>The next step is mounting the file system to make the storage available.
7949 <p
><blockquote
><pre
>
7950 # mount.s3ql --cachedir /var/lib/s3ql-cache --authfile /root/.s3ql/authinfo2 \
7951 --ssl --allow-root s3c://s.greenqloud.com:
443/bucket-name /s3ql
7952 Using
4 upload threads.
7953 Downloading and decompressing metadata...
7963 Mounting filesystem...
7965 Filesystem Size Used Avail Use% Mounted on
7966 s3c://s.greenqloud.com:
443/bucket-name
1.0T
0 1.0T
0% /s3ql
7968 </pre
></blockquote
></p
>
7970 <p
>The file system is now ready for use. I use rsync to store my
7971 backups in it, and as the metadata used by rsync is downloaded at
7972 mount time, no network traffic (and storage cost) is triggered by
7973 running rsync. To unmount, one should not use the normal umount
7974 command, as this will not flush the cache to the cloud storage, but
7975 instead running the umount.s3ql command like this:
7977 <p
><blockquote
><pre
>
7980 </pre
></blockquote
></p
>
7982 <p
>There is a fsck command available to check the file system and
7983 correct any problems detected. This can be used if the local server
7984 crashes while the file system is mounted, to reset the
"already
7985 mounted
" flag. This is what it look like when processing a working
7986 file system:
</p
>
7988 <p
><blockquote
><pre
>
7989 # fsck.s3ql --force --ssl s3c://s.greenqloud.com:
443/bucket-name
7990 Using cached metadata.
7991 File system seems clean, checking anyway.
7992 Checking DB integrity...
7993 Creating temporary extra indices...
7994 Checking lost+found...
7995 Checking cached objects...
7996 Checking names (refcounts)...
7997 Checking contents (names)...
7998 Checking contents (inodes)...
7999 Checking contents (parent inodes)...
8000 Checking objects (reference counts)...
8001 Checking objects (backend)...
8002 ..processed
5000 objects so far..
8003 ..processed
10000 objects so far..
8004 ..processed
15000 objects so far..
8005 Checking objects (sizes)...
8006 Checking blocks (referenced objects)...
8007 Checking blocks (refcounts)...
8008 Checking inode-block mapping (blocks)...
8009 Checking inode-block mapping (inodes)...
8010 Checking inodes (refcounts)...
8011 Checking inodes (sizes)...
8012 Checking extended attributes (names)...
8013 Checking extended attributes (inodes)...
8014 Checking symlinks (inodes)...
8015 Checking directory reachability...
8016 Checking unix conventions...
8017 Checking referential integrity...
8018 Dropping temporary indices...
8019 Backing up old metadata...
8029 Compressing and uploading metadata...
8030 Wrote
0.89 MB of compressed metadata.
8032 </pre
></blockquote
></p
>
8034 <p
>Thanks to the cache, working on files that fit in the cache is very
8035 quick, about the same speed as local file access. Uploading large
8036 amount of data is to me limited by the bandwidth out of and into my
8037 house. Uploading
685 MiB with a
100 MiB cache gave me
305 kiB/s,
8038 which is very close to my upload speed, and downloading the same
8039 Debian installation ISO gave me
610 kiB/s, close to my download speed.
8040 Both were measured using
<tt
>dd
</tt
>. So for me, the bottleneck is my
8041 network, not the file system code. I do not know what a good cache
8042 size would be, but suspect that the cache should e larger than your
8043 working set.
</p
>
8045 <p
>I mentioned that only one machine can mount the file system at the
8046 time. If another machine try, it is told that the file system is
8049 <p
><blockquote
><pre
>
8050 # mount.s3ql --cachedir /var/lib/s3ql-cache --authfile /root/.s3ql/authinfo2 \
8051 --ssl --allow-root s3c://s.greenqloud.com:
443/bucket-name /s3ql
8052 Using
8 upload threads.
8053 Backend reports that fs is still mounted elsewhere, aborting.
8055 </pre
></blockquote
></p
>
8057 <p
>The file content is uploaded when the cache is full, while the
8058 metadata is uploaded once every
24 hour by default. To ensure the
8059 file system content is flushed to the cloud, one can either umount the
8060 file system, or ask S3QL to flush the cache and metadata using
8063 <p
><blockquote
><pre
>
8064 # s3qlctrl upload-meta /s3ql
8065 # s3qlctrl flushcache /s3ql
8067 </pre
></blockquote
></p
>
8069 <p
>If you are curious about how much space your data uses in the
8070 cloud, and how much compression and deduplication cut down on the
8071 storage usage, you can use s3qlstat on the mounted file system to get
8074 <p
><blockquote
><pre
>
8076 Directory entries:
9141
8079 Total data size:
22049.38 MB
8080 After de-duplication:
21955.46 MB (
99.57% of total)
8081 After compression:
21877.28 MB (
99.22% of total,
99.64% of de-duplicated)
8082 Database size:
2.39 MB (uncompressed)
8083 (some values do not take into account not-yet-uploaded dirty blocks in cache)
8085 </pre
></blockquote
></p
>
8087 <p
>I mentioned earlier that there are several possible suppliers of
8088 storage. I did not try to locate them all, but am aware of at least
8089 <a href=
"https://www.greenqloud.com/
">Greenqloud
</a
>,
8090 <a href=
"http://drive.google.com/
">Google Drive
</a
>,
8091 <a href=
"http://aws.amazon.com/s3/
">Amazon S3 web serivces
</a
>,
8092 <a href=
"http://www.rackspace.com/
">Rackspace
</a
> and
8093 <a href=
"http://crowncloud.net/
">Crowncloud
</A
>. The latter even
8094 accept payment in Bitcoin. Pick one that suit your need. Some of
8095 them provide several GiB of free storage, but the prize models are
8096 quite different and you will have to figure out what suits you
8099 <p
>While researching this blog post, I had a look at research papers
8100 and posters discussing the S3QL file system. There are several, which
8101 told me that the file system is getting a critical check by the
8102 science community and increased my confidence in using it. One nice
8104 "<a href=
"http://www.lanl.gov/orgs/adtsc/publications/science_highlights_2013/docs/pg68_69.pdf
">An
8105 Innovative Parallel Cloud Storage System using OpenStack’s SwiftObject
8106 Store and Transformative Parallel I/O Approach
</a
>" by Hsing-Bung
8107 Chen, Benjamin McClelland, David Sherrill, Alfred Torrez, Parks Fields
8108 and Pamela Smith. Please have a look.
</p
>
8110 <p
>Given my problems with different file systems earlier, I decided to
8111 check out the mounted S3QL file system to see if it would be usable as
8112 a home directory (in other word, that it provided POSIX semantics when
8113 it come to locking and umask handling etc). Running
8114 <a href=
"http://www.hungry.com/~pere/blog/Testing_if_a_file_system_can_be_used_for_home_directories___.html
">my
8115 test code to check file system semantics
</a
>, I was happy to discover that
8116 no error was found. So the file system can be used for home
8117 directories, if one chooses to do so.
</p
>
8119 <p
>If you do not want a locally file system, and want something that
8120 work without the Linux fuse file system, I would like to mention the
8121 <a href=
"http://www.tarsnap.com/
">Tarsnap service
</a
>, which also
8122 provide locally encrypted backup using a command line client. It have
8123 a nicer access control system, where one can split out read and write
8124 access, allowing some systems to write to the backup and others to
8125 only read from it.
</p
>
8127 <p
>As usual, if you use Bitcoin and want to show your support of my
8128 activities, please send Bitcoin donations to my address
8129 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
8134 <title>Freedombox on Dreamplug, Raspberry Pi and virtual x86 machine
</title>
8135 <link>http://www.hungry.com/~pere/blog/Freedombox_on_Dreamplug__Raspberry_Pi_and_virtual_x86_machine.html
</link>
8136 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Freedombox_on_Dreamplug__Raspberry_Pi_and_virtual_x86_machine.html
</guid>
8137 <pubDate>Fri,
14 Mar
2014 11:
00:
00 +
0100</pubDate>
8138 <description><p
>The
<a href=
"https://wiki.debian.org/FreedomBox
">Freedombox
8139 project
</a
> is working on providing the software and hardware for
8140 making it easy for non-technical people to host their data and
8141 communication at home, and being able to communicate with their
8142 friends and family encrypted and away from prying eyes. It has been
8143 going on for a while, and is slowly progressing towards a new test
8144 release (
0.2).
</p
>
8146 <p
>And what day could be better than the Pi day to announce that the
8147 new version will provide
"hard drive
" / SD card / USB stick images for
8148 Dreamplug, Raspberry Pi and VirtualBox (or any other virtualization
8149 system), and can also be installed using a Debian installer preseed
8150 file. The Debian based Freedombox is now based on Debian Jessie,
8151 where most of the needed packages used are already present. Only one,
8152 the freedombox-setup package, is missing. To try to build your own
8153 boot image to test the current status, fetch the freedom-maker scripts
8155 <a href=
"http://packages.qa.debian.org/vmdebootstrap
">vmdebootstrap
</a
>
8156 with a user with sudo access to become root:
8159 git clone http://anonscm.debian.org/git/freedombox/freedom-maker.git \
8161 sudo apt-get install git vmdebootstrap mercurial python-docutils \
8162 mktorrent extlinux virtualbox qemu-user-static binfmt-support \
8164 make -C freedom-maker dreamplug-image raspberry-image virtualbox-image
8167 <p
>Root access is needed to run debootstrap and mount loopback
8168 devices. See the README for more details on the build. If you do not
8169 want all three images, trim the make line. But note that thanks to
<a
8170 href=
"https://bugs.debian.org/
741407">a race condition in
8171 vmdebootstrap
</a
>, the build might fail without the patch to the
8172 kpartx call.
</p
>
8174 <p
>If you instead want to install using a Debian CD and the preseed
8175 method, boot a Debian Wheezy ISO and use this boot argument to load
8176 the preseed values:
</p
>
8179 url=
<a href=
"http://www.reinholdtsen.name/freedombox/preseed-jessie.dat
">http://www.reinholdtsen.name/freedombox/preseed-jessie.dat
</a
>
8182 <p
>But note that due to
<a href=
"https://bugs.debian.org/
740673">a
8183 recently introduced bug in apt in Jessie
</a
>, the installer will
8184 currently hang while setting up APT sources. Killing the
8185 '<tt
>apt-cdrom ident
</tt
>' process when it hang a few times during the
8186 installation will get the installation going. This affect all
8187 installations in Jessie, and I expect it will be fixed soon.
</p
>
8189 <p
>Give it a go and let us know how it goes on the mailing list, and help
8190 us get the new release published. :) Please join us on
8191 <a href=
"irc://irc.debian.org:
6667/%
23freedombox
">IRC (#freedombox on
8192 irc.debian.org)
</a
> and
8193 <a href=
"http://lists.alioth.debian.org/mailman/listinfo/freedombox-discuss
">the
8194 mailing list
</a
> if you want to help make this vision come true.
</p
>
8199 <title>New home and release
1.0 for netgroup and innetgr (aka ng-utils)
</title>
8200 <link>http://www.hungry.com/~pere/blog/New_home_and_release_1_0_for_netgroup_and_innetgr__aka_ng_utils_.html
</link>
8201 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_home_and_release_1_0_for_netgroup_and_innetgr__aka_ng_utils_.html
</guid>
8202 <pubDate>Sat,
22 Feb
2014 21:
45:
00 +
0100</pubDate>
8203 <description><p
>Many years ago, I wrote a GPL licensed version of the netgroup and
8204 innetgr tools, because I needed them in
8205 <a href=
"http://www.skolelinux.org/
">Skolelinux
</a
>. I called the project
8206 ng-utils, and it has served me well. I placed the project under the
8207 <a href=
"http://www.hungry.com/
">Hungry Programmer
</a
> umbrella, and it was maintained in our CVS
8208 repository. But many years ago, the CVS repository was dropped (lost,
8209 not migrated to new hardware, not sure), and the project have lacked a
8210 proper home since then.
</p
>
8212 <p
>Last summer, I had a look at the package and made a new release
8213 fixing a irritating crash bug, but was unable to store the changes in
8214 a proper source control system. I applied for a project on
8215 <a href=
"https://alioth.debian.org/
">Alioth
</a
>, but did not have time
8216 to follow up on it. Until today. :)
</p
>
8218 <p
>After many hours of cleaning and migration, the ng-utils project
8219 now have a new home, and a git repository with the highlight of the
8220 history of the project. I published all release tarballs and imported
8221 them into the git repository. As the project is really stable and not
8222 expected to gain new features any time soon, I decided to make a new
8223 release and call it
1.0. Visit the new project home on
8224 <a href=
"https://alioth.debian.org/projects/ng-utils/
">https://alioth.debian.org/projects/ng-utils/
</a
>
8225 if you want to check it out. The new version is also uploaded into
8226 <a href=
"http://packages.qa.debian.org/n/ng-utils.html
">Debian Unstable
</a
>.
</p
>
8231 <title>Testing sysvinit from experimental in Debian Hurd
</title>
8232 <link>http://www.hungry.com/~pere/blog/Testing_sysvinit_from_experimental_in_Debian_Hurd.html
</link>
8233 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Testing_sysvinit_from_experimental_in_Debian_Hurd.html
</guid>
8234 <pubDate>Mon,
3 Feb
2014 13:
40:
00 +
0100</pubDate>
8235 <description><p
>A few days ago I decided to try to help the Hurd people to get
8236 their changes into sysvinit, to allow them to use the normal sysvinit
8237 boot system instead of their old one. This follow up on the
8238 <a href=
"https://teythoon.cryptobitch.de//categories/gsoc.html
">great
8239 Google Summer of Code work
</a
> done last summer by Justus Winter to
8240 get Debian on Hurd working more like Debian on Linux. To get started,
8241 I downloaded a prebuilt hard disk image from
8242 <a href=
"http://ftp.debian-ports.org/debian-cd/hurd-i386/current/debian-hurd.img.tar.gz
">http://ftp.debian-ports.org/debian-cd/hurd-i386/current/debian-hurd.img.tar.gz
</a
>,
8243 and started it using virt-manager.
</p
>
8245 <p
>The first think I had to do after logging in (root without any
8246 password) was to get the network operational. I followed
8247 <a href=
"https://www.debian.org/ports/hurd/hurd-install
">the
8248 instructions on the Debian GNU/Hurd ports page
</a
> and ran these
8249 commands as root to get the machine to accept a IP address from the
8250 kvm internal DHCP server:
</p
>
8252 <p
><blockquote
><pre
>
8253 settrans -fgap /dev/netdde /hurd/netdde
8254 kill $(ps -ef|awk
'/[p]finet/ { print $
2}
')
8255 kill $(ps -ef|awk
'/[d]evnode/ { print $
2}
')
8257 </pre
></blockquote
></p
>
8259 <p
>After this, the machine had internet connectivity, and I could
8260 upgrade it and install the sysvinit packages from experimental and
8261 enable it as the default boot system in Hurd.
</p
>
8263 <p
>But before I did that, I set a password on the root user, as ssh is
8264 running on the machine it for ssh login to work a password need to be
8265 set. Also, note that a bug somewhere in openssh on Hurd block
8266 compression from working. Remember to turn that off on the client
8269 <p
>Run these commands as root to upgrade and test the new sysvinit
8272 <p
><blockquote
><pre
>
8273 cat
> /etc/apt/sources.list.d/experimental.list
&lt;
&lt;EOF
8274 deb http://http.debian.net/debian/ experimental main
8277 apt-get dist-upgrade
8278 apt-get install -t experimental initscripts sysv-rc sysvinit \
8279 sysvinit-core sysvinit-utils
8280 update-alternatives --config runsystem
8281 </pre
></blockquote
></p
>
8283 <p
>To reboot after switching boot system, you have to use
8284 <tt
>reboot-hurd
</tt
> instead of just
<tt
>reboot
</tt
>, as there is not
8285 yet a sysvinit process able to receive the signals from the normal
8286 'reboot
' command. After switching to sysvinit as the boot system,
8287 upgrading every package and rebooting, the network come up with DHCP
8288 after boot as it should, and the settrans/pkill hack mentioned at the
8289 start is no longer needed. But for some strange reason, there are no
8290 longer any login prompt in the virtual console, so I logged in using
8293 <p
>Note that there are some race conditions in Hurd making the boot
8294 fail some times. No idea what the cause is, but hope the Hurd porters
8295 figure it out. At least Justus said on IRC (#debian-hurd on
8296 irc.debian.org) that they are aware of the problem. A way to reduce
8297 the impact is to upgrade to the Hurd packages built by Justus by
8298 adding this repository to the machine:
</p
>
8300 <p
><blockquote
><pre
>
8301 cat
> /etc/apt/sources.list.d/hurd-ci.list
&lt;
&lt;EOF
8302 deb http://darnassus.sceen.net/~teythoon/hurd-ci/ sid main
8304 </pre
></blockquote
></p
>
8306 <p
>At the moment the prebuilt virtual machine get some packages from
8307 http://ftp.debian-ports.org/debian, because some of the packages in
8308 unstable do not yet include the required patches that are lingering in
8309 BTS. This is the completely list of
"unofficial
" packages installed:
</p
>
8311 <p
><blockquote
><pre
>
8312 # aptitude search
'?narrow(?version(CURRENT),?origin(Debian Ports))
'
8313 i emacs - GNU Emacs editor (metapackage)
8314 i gdb - GNU Debugger
8315 i hurd-recommended - Miscellaneous translators
8316 i isc-dhcp-client - ISC DHCP client
8317 i isc-dhcp-common - common files used by all the isc-dhcp* packages
8318 i libc-bin - Embedded GNU C Library: Binaries
8319 i libc-dev-bin - Embedded GNU C Library: Development binaries
8320 i libc0.3 - Embedded GNU C Library: Shared libraries
8321 i A libc0.3-dbg - Embedded GNU C Library: detached debugging symbols
8322 i libc0.3-dev - Embedded GNU C Library: Development Libraries and Hea
8323 i multiarch-support - Transitional package to ensure multiarch compatibilit
8324 i A x11-common - X Window System (X.Org) infrastructure
8325 i xorg - X.Org X Window System
8326 i A xserver-xorg - X.Org X server
8327 i A xserver-xorg-input-all - X.Org X server -- input driver metapackage
8329 </pre
></blockquote
></p
>
8331 <p
>All in all, testing hurd has been an interesting experience. :)
8332 X.org did not work out of the box and I never took the time to follow
8333 the porters instructions to fix it. This time I was interested in the
8334 command line stuff.
<p
>
8339 <title>New chrpath release
0.16</title>
8340 <link>http://www.hungry.com/~pere/blog/New_chrpath_release_0_16.html
</link>
8341 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_chrpath_release_0_16.html
</guid>
8342 <pubDate>Tue,
14 Jan
2014 11:
00:
00 +
0100</pubDate>
8343 <description><p
><a href=
"http://www.coverity.com/
">Coverity
</a
> is a nice tool to
8344 find problems in C, C++ and Java code using static source code
8345 analysis. It can detect a lot of different problems, and is very
8346 useful to find memory and locking bugs in the error handling part of
8347 the source. The company behind it provide
8348 <a href=
"https://scan.coverity.com/
">check of free software projects as
8349 a community service
</a
>, and many hundred free software projects are
8350 already checked. A few days ago I decided to have a closer look at
8351 the Coverity system, and discovered that the
8352 <a href=
"http://www.gnu.org/software/gnash/
">gnash
</a
> and
8353 <a href=
"http://sourceforge.net/projects/ipmitool/
">ipmitool
</a
>
8354 projects I am involved with was already registered. But these are
8355 fairly big, and I would also like to have a small and easy project to
8356 check, and decided to
<a href=
"http://scan.coverity.com/projects/
1179">request
8357 checking of the chrpath project
</a
>. It was
8358 added to the checker and discovered seven potential defects. Six of
8359 these were real, mostly resource
"leak
" when the program detected an
8360 error. Nothing serious, as the resources would be released a fraction
8361 of a second later when the program exited because of the error, but it
8362 is nice to do it right in case the source of the program some time in
8363 the future end up in a library. Having fixed all defects and added
8364 <a href=
"https://lists.alioth.debian.org/mailman/listinfo/chrpath-devel
">a
8365 mailing list for the chrpath developers
</a
>, I decided it was time to
8366 publish a new release. These are the release notes:
</p
>
8368 <p
>New in
0.16 released
2014-
01-
14:
</p
>
8372 <li
>Fixed all minor bugs discovered by Coverity.
</li
>
8373 <li
>Updated config.sub and config.guess from the GNU project.
</li
>
8374 <li
>Mention new project mailing list in the documentation.
</li
>
8379 <a href=
"https://alioth.debian.org/frs/?group_id=
31052">download the
8380 new version
0.16 from alioth
</a
>. Please let us know via the Alioth
8381 project if something is wrong with the new release. The test suite
8382 did not discover any old errors, so if you find a new one, please also
8383 include a test suite check.
</p
>
8388 <title>New chrpath release
0.15</title>
8389 <link>http://www.hungry.com/~pere/blog/New_chrpath_release_0_15.html
</link>
8390 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_chrpath_release_0_15.html
</guid>
8391 <pubDate>Sun,
24 Nov
2013 09:
30:
00 +
0100</pubDate>
8392 <description><p
>After many years break from the package and a vain hope that
8393 development would be continued by someone else, I finally pulled my
8394 acts together this morning and wrapped up a new release of chrpath,
8395 the command line tool to modify the rpath and runpath of already
8396 compiled ELF programs. The update was triggered by the persistence of
8397 Isha Vishnoi at IBM, which needed a new config.guess file to get
8398 support for the ppc64le architecture (powerpc
64-bit Little Endian) he
8399 is working on. I checked the
8400 <a href=
"http://packages.qa.debian.org/chrpath
">Debian
</a
>,
8401 <a href=
"https://launchpad.net/ubuntu/+source/chrpath
">Ubuntu
</a
> and
8402 <a href=
"https://admin.fedoraproject.org/pkgdb/acls/name/chrpath
">Fedora
</a
>
8403 packages for interesting patches (failed to find the source from
8404 OpenSUSE and Mandriva packages), and found quite a few nice fixes.
8405 These are the release notes:
</p
>
8407 <p
>New in
0.15 released
2013-
11-
24:
</p
>
8411 <li
>Updated config.sub and config.guess from the GNU project to work
8412 with newer architectures. Thanks to isha vishnoi for the heads
8415 <li
>Updated README with current URLs.
</li
>
8417 <li
>Added byteswap fix found in Ubuntu, credited Jeremy Kerr and
8418 Matthias Klose.
</li
>
8420 <li
>Added missing help for -k|--keepgoing option, using patch by
8421 Petr Machata found in Fedora.
</li
>
8423 <li
>Rewrite removal of RPATH/RUNPATH to make sure the entry in
8424 .dynamic is a NULL terminated string. Based on patch found in
8425 Fedora credited Axel Thimm and Christian Krause.
</li
>
8430 <a href=
"https://alioth.debian.org/frs/?group_id=
31052">download the
8431 new version
0.15 from alioth
</a
>. Please let us know via the Alioth
8432 project if something is wrong with the new release. The test suite
8433 did not discover any old errors, so if you find a new one, please also
8434 include a testsuite check.
</p
>
8439 <title>Debian init.d boot script example for rsyslog
</title>
8440 <link>http://www.hungry.com/~pere/blog/Debian_init_d_boot_script_example_for_rsyslog.html
</link>
8441 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_init_d_boot_script_example_for_rsyslog.html
</guid>
8442 <pubDate>Sat,
2 Nov
2013 22:
40:
00 +
0100</pubDate>
8443 <description><p
>If one of the points of switching to a new init system in Debian is
8444 <a href=
"http://thomas.goirand.fr/blog/?p=
147">to get rid of huge
8445 init.d scripts
</a
>, I doubt we need to switch away from sysvinit and
8446 init.d scripts at all. Here is an example init.d script, ie a rewrite
8447 of /etc/init.d/rsyslog:
</p
>
8449 <p
><pre
>
8450 #!/lib/init/init-d-script
8453 # Required-Start: $remote_fs $time
8454 # Required-Stop: umountnfs $time
8455 # X-Stop-After: sendsigs
8456 # Default-Start:
2 3 4 5
8457 # Default-Stop:
0 1 6
8458 # Short-Description: enhanced syslogd
8459 # Description: Rsyslog is an enhanced multi-threaded syslogd.
8460 # It is quite compatible to stock sysklogd and can be
8461 # used as a drop-in replacement.
8463 DESC=
"enhanced syslogd
"
8464 DAEMON=/usr/sbin/rsyslogd
8465 </pre
></p
>
8467 <p
>Pretty minimalistic to me... For the record, the original sysv-rc
8468 script was
137 lines, and the above is just
15 lines, most of it meta
8469 info/comments.
</p
>
8471 <p
>How to do this, you ask? Well, one create a new script
8472 /lib/init/init-d-script looking something like this:
8474 <p
><pre
>
8477 # Define LSB log_* functions.
8478 # Depend on lsb-base (
>=
3.2-
14) to ensure that this file is present
8479 # and status_of_proc is working.
8480 . /lib/lsb/init-functions
8483 # Function that starts the daemon/service
8489 #
0 if daemon has been started
8490 #
1 if daemon was already running
8491 #
2 if daemon could not be started
8492 start-stop-daemon --start --quiet --pidfile $PIDFILE --exec $DAEMON --test
> /dev/null \
8494 start-stop-daemon --start --quiet --pidfile $PIDFILE --exec $DAEMON -- \
8497 # Add code here, if necessary, that waits for the process to be ready
8498 # to handle requests from services started subsequently which depend
8499 # on this one. As a last resort, sleep for some time.
8503 # Function that stops the daemon/service
8508 #
0 if daemon has been stopped
8509 #
1 if daemon was already stopped
8510 #
2 if daemon could not be stopped
8511 # other if a failure occurred
8512 start-stop-daemon --stop --quiet --retry=TERM/
30/KILL/
5 --pidfile $PIDFILE --name $NAME
8513 RETVAL=
"$?
"
8514 [
"$RETVAL
" =
2 ]
&& return
2
8515 # Wait for children to finish too if this is a daemon that forks
8516 # and if the daemon is only ever run from this initscript.
8517 # If the above conditions are not satisfied then add some other code
8518 # that waits for the process to drop all resources that could be
8519 # needed by services started subsequently. A last resort is to
8520 # sleep for some time.
8521 start-stop-daemon --stop --quiet --oknodo --retry=
0/
30/KILL/
5 --exec $DAEMON
8522 [
"$?
" =
2 ]
&& return
2
8523 # Many daemons don
't delete their pidfiles when they exit.
8525 return
"$RETVAL
"
8529 # Function that sends a SIGHUP to the daemon/service
8533 # If the daemon can reload its configuration without
8534 # restarting (for example, when it is sent a SIGHUP),
8535 # then implement that here.
8537 start-stop-daemon --stop --signal
1 --quiet --pidfile $PIDFILE --name $NAME
8542 scriptbasename=
"$(basename $
1)
"
8543 echo
"SN: $scriptbasename
"
8544 if [
"$scriptbasename
" !=
"init-d-library
" ] ; then
8545 script=
"$
1"
8552 NAME=$(basename $DAEMON)
8553 PIDFILE=/var/run/$NAME.pid
8555 # Exit if the package is not installed
8556 #[ -x
"$DAEMON
" ] || exit
0
8558 # Read configuration variable file if it is present
8559 [ -r /etc/default/$NAME ]
&& . /etc/default/$NAME
8561 # Load the VERBOSE setting and other rcS variables
8564 case
"$
1" in
8566 [
"$VERBOSE
" != no ]
&& log_daemon_msg
"Starting $DESC
" "$NAME
"
8568 case
"$?
" in
8569 0|
1) [
"$VERBOSE
" != no ]
&& log_end_msg
0 ;;
8570 2) [
"$VERBOSE
" != no ]
&& log_end_msg
1 ;;
8574 [
"$VERBOSE
" != no ]
&& log_daemon_msg
"Stopping $DESC
" "$NAME
"
8576 case
"$?
" in
8577 0|
1) [
"$VERBOSE
" != no ]
&& log_end_msg
0 ;;
8578 2) [
"$VERBOSE
" != no ]
&& log_end_msg
1 ;;
8582 status_of_proc
"$DAEMON
" "$NAME
" && exit
0 || exit $?
8584 #reload|force-reload)
8586 # If do_reload() is not implemented then leave this commented out
8587 # and leave
'force-reload
' as an alias for
'restart
'.
8589 #log_daemon_msg
"Reloading $DESC
" "$NAME
"
8593 restart|force-reload)
8595 # If the
"reload
" option is implemented then remove the
8596 #
'force-reload
' alias
8598 log_daemon_msg
"Restarting $DESC
" "$NAME
"
8600 case
"$?
" in
8603 case
"$?
" in
8605 1) log_end_msg
1 ;; # Old process is still running
8606 *) log_end_msg
1 ;; # Failed to start
8616 echo
"Usage: $SCRIPTNAME {start|stop|status|restart|force-reload}
" >&2
8622 </pre
></p
>
8624 <p
>It is based on /etc/init.d/skeleton, and could be improved quite a
8625 lot. I did not really polish the approach, so it might not always
8626 work out of the box, but you get the idea. I did not try very hard to
8627 optimize it nor make it more robust either.
</p
>
8629 <p
>A better argument for switching init system in Debian than reducing
8630 the size of init scripts (which is a good thing to do anyway), is to
8631 get boot system that is able to handle the kernel events sensibly and
8632 robustly, and do not depend on the boot to run sequentially. The boot
8633 and the kernel have not behaved sequentially in years.
</p
>
8638 <title>Browser plugin for SPICE (spice-xpi) uploaded to Debian
</title>
8639 <link>http://www.hungry.com/~pere/blog/Browser_plugin_for_SPICE__spice_xpi__uploaded_to_Debian.html
</link>
8640 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Browser_plugin_for_SPICE__spice_xpi__uploaded_to_Debian.html
</guid>
8641 <pubDate>Fri,
1 Nov
2013 11:
00:
00 +
0100</pubDate>
8642 <description><p
><a href=
"http://www.spice-space.org/
">The SPICE protocol
</a
> for
8643 remote display access is the preferred solution with oVirt and RedHat
8644 Enterprise Virtualization, and I was sad to discover the other day
8645 that the browser plugin needed to use these systems seamlessly was
8646 missing in Debian. The
<a href=
"http://bugs.debian.org/
668284">request
8647 for a package
</a
> was from
2012-
04-
10 with no progress since
8648 2013-
04-
01, so I decided to wrap up a package based on the great work
8649 from Cajus Pollmeier and put it in a collab-maint maintained git
8650 repository to get a package I could use. I would very much like
8651 others to help me maintain the package (or just take over, I do not
8652 mind), but as no-one had volunteered so far, I just uploaded it to
8653 NEW. I hope it will be available in Debian in a few days.
</p
>
8655 <p
>The source is now available from
8656 <a href=
"http://anonscm.debian.org/gitweb/?p=collab-maint/spice-xpi.git;a=summary
">http://anonscm.debian.org/gitweb/?p=collab-maint/spice-xpi.git;a=summary
</a
>.
</p
>
8661 <title>Teaching vmdebootstrap to create Raspberry Pi SD card images
</title>
8662 <link>http://www.hungry.com/~pere/blog/Teaching_vmdebootstrap_to_create_Raspberry_Pi_SD_card_images.html
</link>
8663 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Teaching_vmdebootstrap_to_create_Raspberry_Pi_SD_card_images.html
</guid>
8664 <pubDate>Sun,
27 Oct
2013 17:
00:
00 +
0100</pubDate>
8665 <description><p
>The
8666 <a href=
"http://packages.qa.debian.org/v/vmdebootstrap.html
">vmdebootstrap
</a
>
8667 program is a a very nice system to create virtual machine images. It
8668 create a image file, add a partition table, mount it and run
8669 debootstrap in the mounted directory to create a Debian system on a
8670 stick. Yesterday, I decided to try to teach it how to make images for
8671 <a href=
"https://wiki.debian.org/RaspberryPi
">Raspberry Pi
</a
>, as part
8672 of a plan to simplify the build system for
8673 <a href=
"https://wiki.debian.org/FreedomBox
">the FreedomBox
8674 project
</a
>. The FreedomBox project already uses vmdebootstrap for
8675 the virtualbox images, but its current build system made multistrap
8676 based system for Dreamplug images, and it is lacking support for
8677 Raspberry Pi.
</p
>
8679 <p
>Armed with the knowledge on how to build
"foreign
" (aka non-native
8680 architecture) chroots for Raspberry Pi, I dived into the vmdebootstrap
8681 code and adjusted it to be able to build armel images on my amd64
8682 Debian laptop. I ended up giving vmdebootstrap five new options,
8683 allowing me to replicate the image creation process I use to make
8684 <a href=
"http://www.hungry.com/~pere/blog/A_Raspberry_Pi_based_batman_adv_Mesh_network_node.html
">Debian
8685 Jessie based mesh node images for the Raspberry Pi
</a
>. First, the
8686 <tt
>--foreign /path/to/binfm_handler
</tt
> option tell vmdebootstrap to
8687 call debootstrap with --foreign and to copy the handler into the
8688 generated chroot before running the second stage. This allow
8689 vmdebootstrap to create armel images on an amd64 host. Next I added
8690 two new options
<tt
>--bootsize size
</tt
> and
<tt
>--boottype
8691 fstype
</tt
> to teach it to create a separate /boot/ partition with the
8692 given file system type, allowing me to create an image with a vfat
8693 partition for the /boot/ stuff. I also added a
<tt
>--variant
8694 variant
</tt
> option to allow me to create smaller images without the
8695 Debian base system packages installed. Finally, I added an option
8696 <tt
>--no-extlinux
</tt
> to tell vmdebootstrap to not install extlinux
8697 as a boot loader. It is not needed on the Raspberry Pi and probably
8698 most other non-x86 architectures. The changes were accepted by the
8699 upstream author of vmdebootstrap yesterday and today, and is now
8701 <a href=
"http://git.liw.fi/cgi-bin/cgit/cgit.cgi/vmdebootstrap/
">the
8702 upstream project page
</a
>.
</p
>
8704 <p
>To use it to build a Raspberry Pi image using Debian Jessie, first
8705 create a small script (the customize script) to add the non-free
8706 binary blob needed to boot the Raspberry Pi and the APT source
8709 <p
><pre
>
8711 set -e # Exit on first error
8712 rootdir=
"$
1"
8713 cd
"$rootdir
"
8714 cat
&lt;
&lt;EOF
> etc/apt/sources.list
8715 deb http://http.debian.net/debian/ jessie main contrib non-free
8717 # Install non-free binary blob needed to boot Raspberry Pi. This
8718 # install a kernel somewhere too.
8719 wget https://raw.github.com/Hexxeh/rpi-update/master/rpi-update \
8720 -O $rootdir/usr/bin/rpi-update
8721 chmod a+x $rootdir/usr/bin/rpi-update
8722 mkdir -p $rootdir/lib/modules
8723 touch $rootdir/boot/start.elf
8724 chroot $rootdir rpi-update
8725 </pre
></p
>
8727 <p
>Next, fetch the latest vmdebootstrap script and call it like this
8728 to build the image:
</p
>
8731 sudo ./vmdebootstrap \
8734 --distribution jessie \
8735 --mirror http://http.debian.net/debian \
8744 --root-password raspberry \
8745 --hostname raspberrypi \
8746 --foreign /usr/bin/qemu-arm-static \
8747 --customize `pwd`/customize \
8749 --package git-core \
8750 --package binutils \
8751 --package ca-certificates \
8754 </pre
></p
>
8756 <p
>The list of packages being installed are the ones needed by
8757 rpi-update to make the image bootable on the Raspberry Pi, with the
8758 exception of netbase, which is needed by debootstrap to find
8759 /etc/hosts with the minbase variant. I really wish there was a way to
8760 set up an Raspberry Pi using only packages in the Debian archive, but
8761 that is not possible as far as I know, because it boots from the GPU
8762 using a non-free binary blob.
</p
>
8764 <p
>The build host need debootstrap, kpartx and qemu-user-static and
8765 probably a few others installed. I have not checked the complete
8766 build dependency list.
</p
>
8768 <p
>The resulting image will not use the hardware floating point unit
8769 on the Raspberry PI, because the armel architecture in Debian is not
8770 optimized for that use. So the images created will be a bit slower
8771 than
<a href=
"http://www.raspbian.org/
">Raspbian
</a
> based images.
</p
>
8776 <title>Good causes: Debian Outreach Program for Women, EFF documenting the spying and Open access in Norway
</title>
8777 <link>http://www.hungry.com/~pere/blog/Good_causes__Debian_Outreach_Program_for_Women__EFF_documenting_the_spying_and_Open_access_in_Norway.html
</link>
8778 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Good_causes__Debian_Outreach_Program_for_Women__EFF_documenting_the_spying_and_Open_access_in_Norway.html
</guid>
8779 <pubDate>Tue,
15 Oct
2013 21:
30:
00 +
0200</pubDate>
8780 <description><p
>The last few days I came across a few good causes that should get
8781 wider attention. I recommend signing and donating to each one of
8784 <p
>Via
<a href=
"http://www.debian.org/News/weekly/
2013/
18/
">Debian
8785 Project News for
2013-
10-
14</a
> I came across the Outreach Program for
8786 Women program which is a Google Summer of Code like initiative to get
8787 more women involved in free software. One debian sponsor has offered
8788 to match
<a href=
"http://debian.ch/opw2013
">any donation done to Debian
8789 earmarked
</a
> for this initiative. I donated a few minutes ago, and
8790 hope you will to. :)
</p
>
8792 <p
>And the Electronic Frontier Foundation just announced plans to
8793 create
<a href=
"https://supporters.eff.org/donate/nsa-videos
">video
8794 documentaries about the excessive spying
</a
> on every Internet user that
8795 take place these days, and their need to fund the work. I
've already
8796 donated. Are you next?
</p
>
8798 <p
>For my Norwegian audience, the organisation Studentenes og
8799 Akademikernes Internasjonale Hjelpefond is collecting signatures for a
8800 statement under the heading
8801 <a href=
"http://saih.no/Bloggers_United/
">Bloggers United for Open
8802 Access
</a
> for those of us asking for more focus on open access in the
8803 Norwegian government. So far
499 signatures. I hope you will sign it
8809 <title>Videos about the Freedombox project - for inspiration and learning
</title>
8810 <link>http://www.hungry.com/~pere/blog/Videos_about_the_Freedombox_project___for_inspiration_and_learning.html
</link>
8811 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Videos_about_the_Freedombox_project___for_inspiration_and_learning.html
</guid>
8812 <pubDate>Fri,
27 Sep
2013 14:
10:
00 +
0200</pubDate>
8813 <description><p
>The
<a href=
"http://www.freedomboxfoundation.org/
">Freedombox
8814 project
</a
> have been going on for a while, and have presented the
8815 vision, ideas and solution several places. Here is a little
8816 collection of videos of talks and presentation of the project.
</p
>
8820 <li
><a href=
"http://www.youtube.com/watch?v=ukvUz5taxvA
">FreedomBox -
8821 2,
5 minute marketing film
</a
> (Youtube)
</li
>
8823 <li
><a href=
"http://www.youtube.com/watch?v=SzW25QTVWsE
">Eben Moglen
8824 discusses the Freedombox on CBS news
2011</a
> (Youtube)
</li
>
8826 <li
><a href=
"http://www.youtube.com/watch?v=Ae8SZbxfE0g
">Eben Moglen -
8827 Freedom in the Cloud - Software Freedom, Privacy and and Security for
8828 Web
2.0 and Cloud computing at ISOC-NY Public Meeting
2010</a
>
8829 (Youtube)
</li
>
8831 <li
><a href=
"http://www.youtube.com/watch?v=vNaIji_3xBE
">Fosdem
2011
8832 Keynote by Eben Moglen presenting the Freedombox
</a
> (Youtube)
</li
>
8834 <li
><a href=
"http://www.youtube.com/watch?v=
9bDDUyJSQ9s
">Presentation of
8835 the Freedombox by James Vasile at Elevate in Gratz
2011</a
> (Youtube)
</li
>
8837 <li
><a href=
"http://www.youtube.com/watch?v=zQTmnk27g9s
"> Freedombox -
8838 Discovery, Identity, and Trust by Nick Daly at Freedombox Hackfest New
8839 York City in
2012</a
> (Youtube)
</li
>
8841 <li
><a href=
"http://www.youtube.com/watch?v=tkbSB4Ba7Ck
">Introduction
8842 to the Freedombox at Freedombox Hackfest New York City in
2012</a
>
8843 (Youtube)
</li
>
8845 <li
><a href=
"http://www.youtube.com/watch?v=z-P2Jaeg0aQ
">Freedom, Out
8846 of the Box! by Bdale Garbee at linux.conf.au Ballarat,
2012</a
> (Youtube)
</li
>
8848 <li
><a href=
"https://archive.fosdem.org/
2013/schedule/event/freedombox/
">Freedombox
8849 1.0 by Eben Moglen and Bdale Garbee at Fosdem
2013</a
> (FOSDEM)
</li
>
8851 <li
><a href=
"http://www.youtube.com/watch?v=e1LpYX2zVYg
">What is the
8852 FreedomBox today by Bdale Garbee at Debconf13 in Vaumarcus
8853 2013</a
> (Youtube)
</li
>
8857 <p
>A larger list is available from
8858 <a href=
"https://wiki.debian.org/FreedomBox/TalksAndPresentations
">the
8859 Freedombox Wiki
</a
>.
</p
>
8861 <p
>On other news, I am happy to report that Freedombox based on Debian
8862 Jessie is coming along quite well, and soon both Owncloud and using
8863 Tor should be available for testers of the Freedombox solution. :) In
8864 a few weeks I hope everything needed to test it is included in Debian.
8865 The withsqlite package is already in Debian, and the plinth package is
8866 pending in NEW. The third and vital part of that puzzle is the
8867 metapackage/setup framework, which is still pending an upload. Join
8868 us on
<a href=
"irc://irc.debian.org:
6667/%
23freedombox
">IRC
8869 (#freedombox on irc.debian.org)
</a
> and
8870 <a href=
"http://lists.alioth.debian.org/mailman/listinfo/freedombox-discuss
">the
8871 mailing list
</a
> if you want to help make this vision come true.
</p
>
8876 <title>Recipe to test the Freedombox project on amd64 or Raspberry Pi
</title>
8877 <link>http://www.hungry.com/~pere/blog/Recipe_to_test_the_Freedombox_project_on_amd64_or_Raspberry_Pi.html
</link>
8878 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Recipe_to_test_the_Freedombox_project_on_amd64_or_Raspberry_Pi.html
</guid>
8879 <pubDate>Tue,
10 Sep
2013 14:
20:
00 +
0200</pubDate>
8880 <description><p
>I was introduced to the
8881 <a href=
"http://www.freedomboxfoundation.org/
">Freedombox project
</a
>
8882 in
2010, when Eben Moglen presented his vision about serving the need
8883 of non-technical people to keep their personal information private and
8884 within the legal protection of their own homes. The idea is to give
8885 people back the power over their network and machines, and return
8886 Internet back to its intended peer-to-peer architecture. Instead of
8887 depending on a central service, the Freedombox will give everyone
8888 control over their own basic infrastructure.
</p
>
8890 <p
>I
've intended to join the effort since then, but other tasks have
8891 taken priority. But this summers nasty news about the misuse of trust
8892 and privilege exercised by the
"western
" intelligence gathering
8893 communities increased my eagerness to contribute to a point where I
8894 actually started working on the project a while back.
</p
>
8896 <p
>The
<a href=
"https://alioth.debian.org/projects/freedombox/
">initial
8897 Debian initiative
</a
> based on the vision from Eben Moglen, is to
8898 create a simple and cheap Debian based appliance that anyone can hook
8899 up in their home and get access to secure and private services and
8900 communication. The initial deployment platform have been the
8901 <a href=
"http://www.globalscaletechnologies.com/t-dreamplugdetails.aspx
">Dreamplug
</a
>,
8902 which is a piece of hardware I do not own. So to be able to test what
8903 the current Freedombox setup look like, I had to come up with a way to install
8904 it on some hardware I do have access to. I have rewritten the
8905 <a href=
"https://github.com/NickDaly/freedom-maker
">freedom-maker
</a
>
8906 image build framework to use .deb packages instead of only copying
8907 setup into the boot images, and thanks to this rewrite I am able to
8908 set up any machine supported by Debian Wheezy as a Freedombox, using
8909 the previously mentioned deb (and a few support debs for packages
8910 missing in Debian).
</p
>
8912 <p
>The current Freedombox setup consist of a set of bootstrapping
8914 (
<a href=
"https://github.com/petterreinholdtsen/freedombox-setup
">freedombox-setup
</a
>),
8915 and a administrative web interface
8916 (
<a href=
"https://github.com/NickDaly/Plinth
">plinth
</a
> + exmachina +
8917 withsqlite), as well as a privacy enhancing proxy based on
8918 <a href=
"http://packages.qa.debian.org/privoxy
">privoxy
</a
>
8919 (freedombox-privoxy). There is also a web/javascript based XMPP
8920 client (
<a href=
"http://packages.qa.debian.org/jwchat
">jwchat
</a
>)
8921 trying (unsuccessfully so far) to talk to the XMPP server
8922 (
<a href=
"http://packages.qa.debian.org/ejabberd
">ejabberd
</a
>). The
8923 web interface is pluggable, and the goal is to use it to enable OpenID
8924 services, mesh network connectivity, use of TOR, etc, etc. Not much of
8925 this is really working yet, see
8926 <a href=
"https://github.com/NickDaly/freedombox-todos/blob/master/TODO
">the
8927 project TODO
</a
> for links to GIT repositories. Most of the code is
8928 on github at the moment. The HTTP proxy is operational out of the
8929 box, and the admin web interface can be used to add/remove plinth
8930 users. I
've not been able to do anything else with it so far, but
8931 know there are several branches spread around github and other places
8932 with lots of half baked features.
</p
>
8934 <p
>Anyway, if you want to have a look at the current state, the
8935 following recipes should work to give you a test machine to poke
8938 <p
><strong
>Debian Wheezy amd64
</strong
></p
>
8942 <li
>Fetch normal Debian Wheezy installation ISO.
</li
>
8943 <li
>Boot from it, either as CD or USB stick.
</li
>
8944 <li
><p
>Press [tab] on the boot prompt and add this as a boot argument
8945 to the Debian installer:
<p
>
8946 <pre
>url=
<a href=
"http://www.reinholdtsen.name/freedombox/preseed-wheezy.dat
">http://www.reinholdtsen.name/freedombox/preseed-wheezy.dat
</a
></pre
></li
>
8948 <li
>Answer the few language/region/password questions and pick disk to
8949 install on.
</li
>
8951 <li
>When the installation is finished and the machine have rebooted a
8952 few times, your Freedombox is ready for testing.
</li
>
8956 <p
><strong
>Raspberry Pi Raspbian
</strong
></p
>
8960 <li
>Fetch a Raspbian SD card image, create SD card.
</li
>
8961 <li
>Boot from SD card, extend file system to fill the card completely.
</li
>
8962 <li
><p
>Log in and add this to /etc/sources.list:
</p
>
8964 deb
<a href=
"http://www.reinholdtsen.name/freedombox/
">http://www.reinholdtsen.name/freedombox
</a
> wheezy main
8965 </pre
></li
>
8966 <li
><p
>Run this as root:
</p
>
8968 wget -O - http://www.reinholdtsen.name/freedombox/BE1A583D.asc | \
8971 apt-get install freedombox-setup
8972 /usr/lib/freedombox/setup
8973 </pre
></li
>
8974 <li
>Reboot into your freshly created Freedombox.
</li
>
8978 <p
>You can test it on other architectures too, but because the
8979 freedombox-privoxy package is binary, it will only work as intended on
8980 the architectures where I have had time to build the binary and put it
8981 in my APT repository. But do not let this stop you. It is only a
8982 short
"<tt
>apt-get source -b freedombox-privoxy
</tt
>" away. :)
</p
>
8984 <p
>Note that by default Freedombox is a DHCP server on the
8985 192.168.1.0/
24 subnet, so if this is your subnet be careful and turn
8986 off the DHCP server by running
"<tt
>update-rc.d isc-dhcp-server
8987 disable
</tt
>" as root.
</p
>
8989 <p
>Please let me know if this works for you, or if you have any
8990 problems. We gather on the IRC channel
8991 <a href=
"irc://irc.debian.org:
6667/%
23freedombox
">#freedombox
</a
> on
8992 irc.debian.org and the
8993 <a href=
"http://lists.alioth.debian.org/cgi-bin/mailman/listinfo/freedombox-discuss
">project
8994 mailing list
</a
>.
</p
>
8996 <p
>Once you get your freedombox operational, you can visit
8997 <tt
>http://your-host-name:
8001/
</tt
> to see the state of the plint
8998 welcome screen (dead end - do not be surprised if you are unable to
8999 get past it), and next visit
<tt
>http://your-host-name:
8001/help/
</tt
>
9000 to look at the rest of plinth. The default user is
'admin
' and the
9001 default password is
'secret
'.
</p
>
9006 <title>Intel
180 SSD disk with Lenovo firmware can not use Intel firmware
</title>
9007 <link>http://www.hungry.com/~pere/blog/Intel_180_SSD_disk_with_Lenovo_firmware_can_not_use_Intel_firmware.html
</link>
9008 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Intel_180_SSD_disk_with_Lenovo_firmware_can_not_use_Intel_firmware.html
</guid>
9009 <pubDate>Sun,
18 Aug
2013 14:
00:
00 +
0200</pubDate>
9010 <description><p
>Earlier, I reported about
9011 <a href=
"http://www.hungry.com/~pere/blog/How_to_fix_a_Thinkpad_X230_with_a_broken_180_GB_SSD_disk.html
">my
9012 problems using an Intel SSD
520 Series
180 GB disk
</a
>. Friday I was
9013 told by IBM that the original disk should be thrown away. And as
9014 there no longer was a problem if I bricked the firmware, I decided
9015 today to try to install Intel firmware to replace the Lenovo firmware
9016 currently on the disk.
</p
>
9018 <p
>I searched the Intel site for firmware, and found
9019 <a href=
"https://downloadcenter.intel.com/Detail_Desc.aspx?agr=Y
&ProdId=
3472&DwnldID=
18363&ProductFamily=Solid-State+Drives+and+Caching
&ProductLine=Intel%c2%ae+High+Performance+Solid-State+Drive
&ProductProduct=Intel%c2%ae+SSD+
520+Series+(
180GB%
2c+
2.5in+SATA+
6Gb%
2fs%
2c+
25nm%
2c+MLC)
&lang=eng
">issdfut_2.0
.4.iso
</a
>
9020 (aka Intel SATA Solid-State Drive Firmware Update Tool) which
9021 according to the site should contain the latest firmware for SSD
9022 disks. I inserted the broken disk in one of my spare laptops and
9023 booted the ISO from a USB stick. The disk was recognized, but the
9024 program claimed the newest firmware already were installed and refused
9025 to insert any Intel firmware. So no change, and the disk is still
9026 unable to handle write load. :( I guess the only way to get them
9027 working would be if Lenovo releases new firmware. No idea how likely
9028 that is. Anyway, just blogging about this test for completeness. I
9029 got a working Samsung disk, and see no point in spending more time on
9030 the broken disks.
</p
>
9035 <title>How to fix a Thinkpad X230 with a broken
180 GB SSD disk
</title>
9036 <link>http://www.hungry.com/~pere/blog/How_to_fix_a_Thinkpad_X230_with_a_broken_180_GB_SSD_disk.html
</link>
9037 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_fix_a_Thinkpad_X230_with_a_broken_180_GB_SSD_disk.html
</guid>
9038 <pubDate>Wed,
17 Jul
2013 23:
50:
00 +
0200</pubDate>
9039 <description><p
>Today I switched to
9040 <a href=
"http://www.hungry.com/~pere/blog/The_Thinkpad_is_dead__long_live_the_Thinkpad_X230_.html
">my
9041 new laptop
</a
>. I
've previously written about the problems I had with
9042 my new Thinkpad X230, which was delivered with an
9043 <a href=
"http://www.hungry.com/~pere/blog/Intel_SSD_520_Series_180_GB_with_Lenovo_firmware_still_lock_up_from_sustained_writes.html
">180
9044 GB Intel SSD disk with Lenovo firmware
</a
> that did not handle
9045 sustained writes. My hardware supplier have been very forthcoming in
9046 trying to find a solution, and after first trying with another
9047 identical
180 GB disks they decided to send me a
256 GB Samsung SSD
9048 disk instead to fix it once and for all. The Samsung disk survived
9049 the installation of Debian with encrypted disks (filling the disk with
9050 random data during installation killed the first two), and I thus
9051 decided to trust it with my data. I have installed it as a Debian Edu
9052 Wheezy roaming workstation hooked up with my Debian Edu Squeeze main
9053 server at home using Kerberos and LDAP, and will use it as my work
9054 station from now on.
</p
>
9056 <p
>As this is a solid state disk with no moving parts, I believe the
9057 Debian Wheezy default installation need to be tuned a bit to increase
9058 performance and increase life time of the disk. The Linux kernel and
9059 user space applications do not yet adjust automatically to such
9060 environment. To make it easier for my self, I created a draft Debian
9061 package
<tt
>ssd-setup
</tt
> to handle this tuning. The
9062 <a href=
"http://anonscm.debian.org/gitweb/?p=collab-maint/ssd-setup.git
">source
9063 for the ssd-setup package
</a
> is available from collab-maint, and it
9064 is set up to adjust the setup of the machine by just installing the
9065 package. If there is any non-SSD disk in the machine, the package
9066 will refuse to install, as I did not try to write any logic to sort
9067 file systems in SSD and non-SSD file systems.
</p
>
9069 <p
>I consider the package a draft, as I am a bit unsure how to best
9070 set up Debian Wheezy with an SSD. It is adjusted to my use case,
9071 where I set up the machine with one large encrypted partition (in
9072 addition to /boot), put LVM on top of this and set up partitions on
9073 top of this again. See the README file in the package source for the
9074 references I used to pick the settings. At the moment these
9075 parameters are tuned:
</p
>
9079 <li
>Set up cryptsetup to pass TRIM commands to the physical disk
9080 (adding discard to /etc/crypttab)
</li
>
9082 <li
>Set up LVM to pass on TRIM commands to the underlying device (in
9083 this case a cryptsetup partition) by changing issue_discards from
9084 0 to
1 in /etc/lvm/lvm.conf.
</li
>
9086 <li
>Set relatime as a file system option for ext3 and ext4 file
9089 <li
>Tell swap to use TRIM commands by adding
'discard
' to
9090 /etc/fstab.
</li
>
9092 <li
>Change I/O scheduler from cfq to deadline using a udev rule.
</li
>
9094 <li
>Run fstrim on every ext3 and ext4 file system every night (from
9095 cron.daily).
</li
>
9097 <li
>Adjust sysctl values vm.swappiness to
1 and vm.vfs_cache_pressure
9098 to
50 to reduce the kernel eagerness to swap out processes.
</li
>
9102 <p
>During installation, I cancelled the part where the installer fill
9103 the disk with random data, as this would kill the SSD performance for
9104 little gain. My goal with the encrypted file system is to ensure
9105 those stealing my laptop end up with a brick and not a working
9106 computer. I have no hope in keeping the really resourceful people
9107 from getting the data on the disk (see
9108 <a href=
"http://xkcd.com/
538/
">XKCD #
538</a
> for an explanation why).
9109 Thus I concluded that adding the discard option to crypttab is the
9110 right thing to do.
</p
>
9112 <p
>I considered using the noop I/O scheduler, as several recommended
9113 it for SSD, but others recommended deadline and a benchmark I found
9114 indicated that deadline might be better for interactive use.
</p
>
9116 <p
>I also considered using the
'discard
' file system option for ext3
9117 and ext4, but read that it would give a performance hit ever time a
9118 file is removed, and thought it best to that that slowdown once a day
9119 instead of during my work.
</p
>
9121 <p
>My package do not set up tmpfs on /var/run, /var/lock and /tmp, as
9122 this is already done by Debian Edu.
</p
>
9124 <p
>I have not yet started on the user space tuning. I expect
9125 iceweasel need some tuning, and perhaps other applications too, but
9126 have not yet had time to investigate those parts.
</p
>
9128 <p
>The package should work on Ubuntu too, but I have not yet tested it
9131 <p
>As for the answer to the question in the title of this blog post,
9132 as far as I know, the only solution I know about is to replace the
9133 disk. It might be possible to flash it with Intel firmware instead of
9134 the Lenovo firmware. But I have not tried and did not want to do so
9135 without approval from Lenovo as I wanted to keep the warranty on the
9136 disk until a solution was found and they wanted the broken disks
9142 <title>Intel SSD
520 Series
180 GB with Lenovo firmware still lock up from sustained writes
</title>
9143 <link>http://www.hungry.com/~pere/blog/Intel_SSD_520_Series_180_GB_with_Lenovo_firmware_still_lock_up_from_sustained_writes.html
</link>
9144 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Intel_SSD_520_Series_180_GB_with_Lenovo_firmware_still_lock_up_from_sustained_writes.html
</guid>
9145 <pubDate>Wed,
10 Jul
2013 13:
30:
00 +
0200</pubDate>
9146 <description><p
>A few days ago, I wrote about
9147 <a href=
"http://www.hungry.com/~pere/blog/The_Thinkpad_is_dead__long_live_the_Thinkpad_X230_.html
">the
9148 problems I experienced with my new X230 and its SSD disk
</a
>, which
9149 was dying during installation because it is unable to cope with
9150 sustained write. My supplier is in contact with
9151 <a href=
"http://www.lenovo.com/
">Lenovo
</a
>, and they wanted to send a
9152 replacement disk to try to fix the problem. They decided to send an
9153 identical model, so my hopes for a permanent fix was slim.
</p
>
9155 <p
>Anyway, today I got the replacement disk and tried to install
9156 Debian Edu Wheezy with encrypted disk on it. The new disk have the
9157 same firmware version as the original. This time my hope raised
9158 slightly as the installation progressed, as the original disk used to
9159 die after
4-
7% of the disk was written to, while this time it kept
9160 going past
10%,
20%,
40% and even past
50%. But around
60%, the disk
9161 died again and I was back on square one. I still do not have a new
9162 laptop with a disk I can trust. I can not live with a disk that might
9163 lock up when I download a new
9164 <a href=
"http://www.skolelinux.org/
">Debian Edu / Skolelinux
</a
> ISO or
9165 other large files. I look forward to hearing from my supplier with
9166 the next proposal from Lenovo.
</p
>
9168 <p
>The original disk is marked Intel SSD
520 Series
180 GB,
9169 11S0C38722Z1ZNME35X1TR, ISN: CVCV321407HB180EGN, SA: G57560302, FW:
9170 LF1i,
29MAY2013, PBA: G39779-
300, LBA
351,
651,
888, LI P/N:
0C38722,
9171 Pb-free
2LI, LC P/N:
16-
200366, WWN:
55CD2E40002756C4, Model:
9172 SSDSC2BW180A3L
2.5" 6Gb/s SATA SSD
180G
5V
1A, ASM P/N
0C38732, FRU
9173 P/N
45N8295, P0C38732.
</p
>
9175 <p
>The replacement disk is marked Intel SSD
520 Series
180 GB,
9176 11S0C38722Z1ZNDE34N0L0, ISN: CVCV315306RK180EGN, SA: G57560-
302, FW:
9177 LF1i,
22APR2013, PBA: G39779-
300, LBA
351,
651,
888, LI P/N:
0C38722,
9178 Pb-free
2LI, LC P/N:
16-
200366, WWN:
55CD2E40000AB69E, Model:
9179 SSDSC2BW180A3L
2.5" 6Gb/s SATA SSD
180G
5V
1A, ASM P/N
0C38732, FRU
9180 P/N
45N8295, P0C38732.
</p
>
9182 <p
>The only difference is in the first number (serial number?), ISN,
9183 SA, date and WNPP values. Mentioning all the details here in case
9184 someone is able to use the information to find a way to identify the
9185 failing disk among working ones (if any such working disk actually
9191 <title>July
13th: Debian/Ubuntu BSP and Skolelinux/Debian Edu developer gathering in Oslo
</title>
9192 <link>http://www.hungry.com/~pere/blog/July_13th__Debian_Ubuntu_BSP_and_Skolelinux_Debian_Edu_developer_gathering_in_Oslo.html
</link>
9193 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/July_13th__Debian_Ubuntu_BSP_and_Skolelinux_Debian_Edu_developer_gathering_in_Oslo.html
</guid>
9194 <pubDate>Tue,
9 Jul
2013 10:
40:
00 +
0200</pubDate>
9195 <description><p
>The upcoming Saturday,
2013-
07-
13, we are organising a combined
9196 Debian Edu developer gathering and Debian and Ubuntu bug squashing
9197 party in Oslo. It is organised by
<a href=
"http://www.nuug.no/
">the
9198 member assosiation NUUG
</a
> and
9199 <a href=
"http://www.skolelinux.org/
">the Debian Edu / Skolelinux
9200 project
</a
> together with
<a href=
"http://bitraf.no/
">the hack space
9201 Bitraf
</a
>.
</p
>
9203 <p
>It starts
10:
00 and continue until late evening. Everyone is
9204 welcome, and there is no fee to participate. There is on the other
9205 hand limited space, and only room for
30 people. Please put your name
9206 on
<a href=
"http://wiki.debian.org/BSP/
2013/
07/
13/no/Oslo
">the event
9207 wiki page
</a
> if you plan to join us.
</p
>
9212 <title>The Thinkpad is dead, long live the Thinkpad X230?
</title>
9213 <link>http://www.hungry.com/~pere/blog/The_Thinkpad_is_dead__long_live_the_Thinkpad_X230_.html
</link>
9214 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_Thinkpad_is_dead__long_live_the_Thinkpad_X230_.html
</guid>
9215 <pubDate>Fri,
5 Jul
2013 08:
30:
00 +
0200</pubDate>
9216 <description><p
>Half a year ago, I reported that I had to find a
9217 <a href=
"http://www.hungry.com/~pere/blog/Thank_you_Thinkpad_X41__for_your_long_and_trustworthy_service.html
">replacement
9218 for my trusty old Thinkpad X41
</a
>. Unfortunately I did not have much
9219 time to spend on it, and it took a while to find a model I believe
9220 will do the job, but two days ago the replacement finally arrived. I
9222 <a href=
"http://www.linlap.com/lenovo_thinkpad_x230
">Thinkpad X230
</a
>
9223 with SSD disk (NZDAJMN). I first test installed Debian Edu Wheezy as
9224 a roaming workstation, and it seemed to work flawlessly. But my
9225 second installation with encrypted disk was not as successful. More
9226 on that below.
</p
>
9228 <p
>I had a hard time trying to track down a good laptop, as my most
9229 important requirements (robust and with a good keyboard) are never
9230 listed in the feature list. But I did get good help from the search
9231 feature at
<a href=
"http://www.prisjakt.no/
">Prisjakt
</a
>, which
9232 allowed me to limit the list of interesting laptops based on my other
9233 requirements. A bit surprising that SSD disk are not disks according
9234 to that search interface, so I had to drop specifying the number of
9235 disks from my search parameters. I also asked around among friends to
9236 get their impression on keyboards and robustness.
</p
>
9238 <p
>So the new laptop arrived, and it is quite a lot wider than the
9239 X41. I am not quite convinced about the keyboard, as it is
9240 significantly wider than my old keyboard, and I have to stretch my
9241 hand a lot more to reach the edges. But the key response is fairly
9242 good and the individual key shape is fairly easy to handle, so I hope
9243 I will get used to it. My old X40 was starting to fail, and I really
9244 needed a new laptop now. :)
</p
>
9246 <p
>Turning off the touch pad was simple. All it took was a quick
9247 visit to the BIOS during boot it disable it.
</p
>
9249 <p
>But there is a fatal problem with the laptop. The
180 GB SSD disk
9250 lock up during load. And this happen when installing Debian Wheezy
9251 with encrypted disk, while the disk is being filled with random data.
9252 I also tested to install Ubuntu Raring, and it happen there too if I
9253 reenable the code to fill the disk with random data (it is disabled by
9254 default in Ubuntu). And the bug with is already known. It was
9255 reported to Debian as
<a href=
"http://bugs.debian.org/
691427">BTS
9256 report #
691427 2012-
10-
25</a
> (journal commit I/O error on brand-new
9257 Thinkpad T430s ext4 on lvm on SSD). It is also reported to the Linux
9258 kernel developers as
9259 <a href=
"https://bugzilla.kernel.org/show_bug.cgi?id=
51861">Kernel bugzilla
9260 report #
51861 2012-
12-
20</a
> (Intel SSD
520 stops working under load
9261 (SSDSC2BW180A3L in Lenovo ThinkPad T430s)). It is also reported on the
9262 Lenovo forums, both for
9263 <a href=
"http://forums.lenovo.com/t5/T400-T500-and-newer-T-series/T430s-Intel-SSD-
520-
180GB-issue/m-p/
1070549">T430
9264 2012-
11-
10</a
> and for
9265 <a href=
"http://forums.lenovo.com/t5/X-Series-ThinkPad-Laptops/x230-SATA-errors-with-
180GB-Intel-
520-SSD-under-heavy-write-load/m-p/
1068147">X230
9266 03-
20-
2013</a
>. The problem do not only affect installation. The
9267 reports state that the disk lock up during use if many writes are done
9268 on the disk, so it is much no use to work around the installation
9269 problem and end up with a computer that can lock up at any moment.
9271 <a href=
"https://git.efficios.com/?p=test-ssd.git
">small C program
9272 available
</a
> that will lock up the hard drive after running a few
9273 minutes by writing to a file.
</p
>
9275 <p
>I
've contacted my supplier and asked how to handle this, and after
9276 contacting PCHELP Norway (request
01D1FDP) which handle support
9277 requests for Lenovo, his first suggestion was to upgrade the disk
9278 firmware. Unfortunately there is no newer firmware available from
9279 Lenovo, as my disk already have the most recent one (version LF1i). I
9280 hope to hear more from him today and hope the problem can be
9286 <title>The Thinkpad is dead, long live the Thinkpad X230
</title>
9287 <link>http://www.hungry.com/~pere/blog/The_Thinkpad_is_dead__long_live_the_Thinkpad_X230.html
</link>
9288 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_Thinkpad_is_dead__long_live_the_Thinkpad_X230.html
</guid>
9289 <pubDate>Thu,
4 Jul
2013 09:
20:
00 +
0200</pubDate>
9290 <description><p
>Half a year ago, I reported that I had to find a replacement for my
9291 trusty old Thinkpad X41. Unfortunately I did not have much time to
9292 spend on it, but today the replacement finally arrived. I ended up
9293 picking a
<a href=
"http://www.linlap.com/lenovo_thinkpad_x230
">Thinkpad
9294 X230
</a
> with SSD disk (NZDAJMN). I first test installed Debian Edu
9295 Wheezy as a roaming workstation, and it worked flawlessly. As I write
9296 this, it is installing what I hope will be a more final installation,
9297 with a encrypted hard drive to ensure any dope head stealing it end up
9298 with an expencive door stop.
</p
>
9300 <p
>I had a hard time trying to track down a good laptop, as my most
9301 important requirements (robust and with a good keyboard) are never
9302 listed in the feature list. But I did get good help from the search
9303 feature at
<ahref=
"http://www.prisjakt.no/
">Prisjakt
</a
>, which
9304 allowed me to limit the list of interesting laptops based on my other
9305 requirements. A bit surprising that SSD disk are not disks, so I had
9306 to drop number of disks from my search parameters.
</p
>
9308 <p
>I am not quite convinced about the keyboard, as it is significantly
9309 wider than my old keyboard, and I have to stretch my hand a lot more
9310 to reach the edges. But the key response is fairly good and the
9311 individual key shape is fairly easy to handle, so I hope I will get
9312 used to it. My old X40 was starting to fail, and I really needed a
9313 new laptop now. :)
</p
>
9315 <p
>I look forward to figuring out how to turn off the touch pad.
</p
>
9320 <title>Automatically locate and install required firmware packages on Debian (Isenkram
0.4)
</title>
9321 <link>http://www.hungry.com/~pere/blog/Automatically_locate_and_install_required_firmware_packages_on_Debian__Isenkram_0_4_.html
</link>
9322 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Automatically_locate_and_install_required_firmware_packages_on_Debian__Isenkram_0_4_.html
</guid>
9323 <pubDate>Tue,
25 Jun
2013 11:
50:
00 +
0200</pubDate>
9324 <description><p
>It annoys me when the computer fail to do automatically what it is
9325 perfectly capable of, and I have to do it manually to get things
9326 working. One such task is to find out what firmware packages are
9327 needed to get the hardware on my computer working. Most often this
9328 affect the wifi card, but some times it even affect the RAID
9329 controller or the ethernet card. Today I pushed version
0.4 of the
9330 <a href=
"http://packages.qa.debian.org/isenkram
">Isenkram package
</a
>
9331 including a new script isenkram-autoinstall-firmware handling the
9332 process of asking all the loaded kernel modules what firmware files
9333 they want, find debian packages providing these files and install the
9334 debian packages. Here is a test run on my laptop:
</p
>
9336 <p
><pre
>
9337 # isenkram-autoinstall-firmware
9338 info: kernel drivers requested extra firmware: ipw2200-bss.fw ipw2200-ibss.fw ipw2200-sniffer.fw
9339 info: fetching http://http.debian.net/debian/dists/squeeze/Contents-i386.gz
9340 info: locating packages with the requested firmware files
9341 info: Updating APT sources after adding non-free APT source
9342 info: trying to install firmware-ipw2x00
9345 Preconfiguring packages ...
9346 Selecting previously deselected package firmware-ipw2x00.
9347 (Reading database ...
259727 files and directories currently installed.)
9348 Unpacking firmware-ipw2x00 (from .../firmware-ipw2x00_0.28+squeeze1_all.deb) ...
9349 Setting up firmware-ipw2x00 (
0.28+squeeze1) ...
9351 </pre
></p
>
9353 <p
>When all the requested firmware is present, a simple message is
9354 printed instead:
</p
>
9356 <p
><pre
>
9357 # isenkram-autoinstall-firmware
9358 info: did not find any firmware files requested by loaded kernel modules. exiting
9360 </pre
></p
>
9362 <p
>It could use some polish, but it is already working well and saving
9363 me some time when setting up new machines. :)
</p
>
9365 <p
>So, how does it work? It look at the set of currently loaded
9366 kernel modules, and look up each one of them using modinfo, to find
9367 the firmware files listed in the module meta-information. Next, it
9368 download the Contents file from a nearby APT mirror, and search for
9369 the firmware files in this file to locate the package with the
9370 requested firmware file. If the package is in the non-free section, a
9371 non-free APT source is added and the package is installed using
9372 <tt
>apt-get install
</tt
>. The end result is a slightly better working
9375 <p
>I hope someone find time to implement a more polished version of
9376 this script as part of the hw-detect debian-installer module, to
9377 finally fix
<a href=
"http://bugs.debian.org/
655507">BTS report
9378 #
655507</a
>. There really is no need to insert USB sticks with
9379 firmware during a PXE install when the packages already are available
9380 from the nearby Debian mirror.
</p
>
9385 <title>Fixing the Linux black screen of death on machines with Intel HD video
</title>
9386 <link>http://www.hungry.com/~pere/blog/Fixing_the_Linux_black_screen_of_death_on_machines_with_Intel_HD_video.html
</link>
9387 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Fixing_the_Linux_black_screen_of_death_on_machines_with_Intel_HD_video.html
</guid>
9388 <pubDate>Tue,
11 Jun
2013 11:
00:
00 +
0200</pubDate>
9389 <description><p
>When installing RedHat, Fedora, Debian and Ubuntu on some machines,
9390 the screen just turn black when Linux boot, either during installation
9391 or on first boot from the hard disk. I
've seen it once in a while the
9392 last few years, but only recently understood the cause. I
've seen it
9393 on HP laptops, and on my latest acquaintance the Packard Bell laptop.
9394 The reason seem to be in the wiring of some laptops. The system to
9395 control the screen background light is inverted, so when Linux try to
9396 turn the brightness fully on, it end up turning it off instead. I do
9397 not know which Linux drivers are affected, but this post is about the
9398 i915 driver used by the
9399 <a href=
"http://www.linlap.com/packard_bell_easynote_lv
">Packard Bell
9400 EasyNote LV
</a
>, Thinkpad X40 and many other laptops.
</p
>
9402 <p
>The problem can be worked around two ways. Either by adding
9403 i915.invert_brightness=
1 as a kernel option, or by adding a file in
9404 /etc/modprobe.d/ to tell modprobe to add the invert_brightness=
1
9405 option when it load the i915 kernel module. On Debian and Ubuntu, it
9406 can be done by running these commands as root:
</p
>
9409 echo options i915 invert_brightness=
1 | tee /etc/modprobe.d/i915.conf
9410 update-initramfs -u -k all
9413 <p
>Since March
2012 there is
9414 <a href=
"http://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/?id=
4dca20efb1a9c2efefc28ad2867e5d6c3f5e1955
">a
9415 mechanism in the Linux kernel
</a
> to tell the i915 driver which
9416 hardware have this problem, and get the driver to invert the
9417 brightness setting automatically. To use it, one need to add a row in
9418 <a href=
"http://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/tree/drivers/gpu/drm/i915/intel_display.c
">the
9419 intel_quirks array
</a
> in the driver source
9420 <tt
>drivers/gpu/drm/i915/intel_display.c
</tt
> (look for
"<tt
>static
9421 struct intel_quirk intel_quirks
</tt
>"), specifying the PCI device
9422 number (vendor number
8086 is assumed) and subdevice vendor and device
9425 <p
>My Packard Bell EasyNote LV got this output from
<tt
>lspci
9426 -vvnn
</tt
> for the video card in question:
</p
>
9428 <p
><pre
>
9429 00:
02.0 VGA compatible controller [
0300]: Intel Corporation \
9430 3rd Gen Core processor Graphics Controller [
8086:
0156] \
9431 (rev
09) (prog-if
00 [VGA controller])
9432 Subsystem: Acer Incorporated [ALI] Device [
1025:
0688]
9433 Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- \
9434 ParErr- Stepping- SE RR- FastB2B- DisINTx+
9435 Status: Cap+
66MHz- UDF- FastB2B+ ParErr- DEVSEL=fast
>TAbort- \
9436 <TAbort-
<MAbort-
>SERR-
<PERR- INTx-
9438 Interrupt: pin A routed to IRQ
42
9439 Region
0: Memory at c2000000 (
64-bit, non-prefetchable) [size=
4M]
9440 Region
2: Memory at b0000000 (
64-bit, prefetchable) [size=
256M]
9441 Region
4: I/O ports at
4000 [size=
64]
9442 Expansion ROM at
<unassigned
> [disabled]
9443 Capabilities:
<access denied
>
9444 Kernel driver in use: i915
9445 </pre
></p
>
9447 <p
>The resulting intel_quirks entry would then look like this:
</p
>
9449 <p
><pre
>
9450 struct intel_quirk intel_quirks[] = {
9452 /* Packard Bell EasyNote LV11HC needs invert brightness quirk */
9453 {
0x0156,
0x1025,
0x0688, quirk_invert_brightness },
9456 </pre
></p
>
9458 <p
>According to the kernel module instructions (as seen using
9459 <tt
>modinfo i915
</tt
>), information about hardware needing the
9460 invert_brightness flag should be sent to the
9461 <a href=
"http://lists.freedesktop.org/mailman/listinfo/dri-devel
">dri-devel
9462 (at) lists.freedesktop.org
</a
> mailing list to reach the kernel
9463 developers. But my email about the laptop sent
2013-
06-
03 have not
9465 <a href=
"http://lists.freedesktop.org/archives/dri-devel/
2013-June/thread.html
">the
9466 web archive for the mailing list
</a
>, so I suspect they do not accept
9467 emails from non-subscribers. Because of this, I sent my patch also to
9468 the Debian bug tracking system instead as
9469 <a href=
"http://bugs.debian.org/
710938">BTS report #
710938</a
>, to make
9470 sure the patch is not lost.
</p
>
9472 <p
>Unfortunately, it is not enough to fix the kernel to get Laptops
9473 with this problem working properly with Linux. If you use Gnome, your
9474 worries should be over at this point. But if you use KDE, there is
9475 something in KDE ignoring the invert_brightness setting and turning on
9476 the screen during login. I
've reported it to Debian as
9477 <a href=
"http://bugs.debian.org/
711237">BTS report #
711237</a
>, and
9478 have no idea yet how to figure out exactly what subsystem is doing
9479 this. Perhaps you can help? Perhaps you know what the Gnome
9480 developers did to handle this, and this can give a clue to the KDE
9481 developers? Or you know where in KDE the screen brightness is changed
9482 during login? If so, please update the BTS report (or get in touch if
9483 you do not know how to update BTS).
</p
>
9485 <p
>Update
2013-
07-
19: The correct fix for this machine seem to be
9486 acpi_backlight=vendor, to disable ACPI backlight support completely,
9487 as the ACPI information on the machine is trash and it is better to
9488 leave it to the intel video driver to control the screen
9489 backlight.
</p
>
9494 <title>How to install Linux on a Packard Bell Easynote LV preinstalled with Windows
8</title>
9495 <link>http://www.hungry.com/~pere/blog/How_to_install_Linux_on_a_Packard_Bell_Easynote_LV_preinstalled_with_Windows_8.html
</link>
9496 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_install_Linux_on_a_Packard_Bell_Easynote_LV_preinstalled_with_Windows_8.html
</guid>
9497 <pubDate>Mon,
27 May
2013 15:
20:
00 +
0200</pubDate>
9498 <description><p
>Two days ago, I asked
9499 <a href=
"http://www.hungry.com/~pere/blog/How_can_I_install_Linux_on_a_Packard_Bell_Easynote_LV_preinstalled_with_Windows_8_.html
">how
9500 I could install Linux on a Packard Bell EasyNote LV computer
9501 preinstalled with Windows
8</a
>. I found a solution, but am horrified
9502 with the obstacles put in the way of Linux users on a laptop with UEFI
9503 and Windows
8.
</p
>
9505 <p
>I never found out if the cause of my problems were the use of UEFI
9506 secure booting or fast boot. I suspect fast boot was the problem,
9507 causing the firmware to boot directly from HD without considering any
9508 key presses and alternative devices, but do not know UEFI settings
9509 enough to tell.
</p
>
9511 <p
>There is no way to install Linux on the machine in question without
9512 opening the box and disconnecting the hard drive! This is as far as I
9513 can tell, the only way to get access to the firmware setup menu
9514 without accepting the Windows
8 license agreement. I am told (and
9515 found description on how to) that it is possible to configure the
9516 firmware setup once booted into Windows
8. But as I believe the terms
9517 of that agreement are completely unacceptable, accepting the license
9518 was never an alternative. I do not enter agreements I do not intend
9519 to follow.
</p
>
9521 <p
>I feared I had to return the laptops and ask for a refund, and
9522 waste many hours on this, but luckily there was a way to get it to
9523 work. But I would not recommend it to anyone planning to run Linux on
9524 it, and I have become sceptical to Windows
8 certified laptops. Is
9525 this the way Linux will be forced out of the market place, by making
9526 it close to impossible for
"normal
" users to install Linux without
9527 accepting the Microsoft Windows license terms? Or at least not
9528 without risking to loose the warranty?
</p
>
9530 <p
>I
've updated the
9531 <a href=
"http://www.linlap.com/packard_bell_easynote_lv
">Linux Laptop
9532 wiki page for Packard Bell EasyNote LV
</a
>, to ensure the next person
9533 do not have to struggle as much as I did to get Linux into the
9536 <p
>Thanks to Bob Rosbag, Florian Weimer, Philipp Kern, Ben Hutching,
9537 Michael Tokarev and others for feedback and ideas.
</p
>
9542 <title>How can I install Linux on a Packard Bell Easynote LV preinstalled with Windows
8?
</title>
9543 <link>http://www.hungry.com/~pere/blog/How_can_I_install_Linux_on_a_Packard_Bell_Easynote_LV_preinstalled_with_Windows_8_.html
</link>
9544 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_can_I_install_Linux_on_a_Packard_Bell_Easynote_LV_preinstalled_with_Windows_8_.html
</guid>
9545 <pubDate>Sat,
25 May
2013 18:
20:
00 +
0200</pubDate>
9546 <description><p
>I
've run into quite a problem the last few days. I bought three
9547 new laptops for my parents and a few others. I bought Packard Bell
9548 Easynote LV to run Kubuntu on and use as their home computer. But I
9549 am completely unable to figure out how to install Linux on it. The
9550 computer is preinstalled with Windows
8, and I suspect it uses UEFI
9551 instead of a BIOS to boot.
</p
>
9553 <p
>The problem is that I am unable to get it to PXE boot, and unable
9554 to get it to boot the Linux installer from my USB stick. I have yet
9555 to try the DVD install, and still hope it will work. when I turn on
9556 the computer, there is no information on what buttons to press to get
9557 the normal boot menu. I expect to get some boot menu to select PXE or
9558 USB stick booting. When booting, it first ask for the language to
9559 use, then for some regional settings, and finally if I will accept the
9560 Windows
8 terms of use. As these terms are completely unacceptable to
9561 me, I have no other choice but to turn off the computer and try again
9562 to get it to boot the Linux installer.
</p
>
9564 <p
>I have gathered my findings so far on a Linlap page about the
9565 <a href=
"http://www.linlap.com/packard_bell_easynote_lv
">Packard Bell
9566 EasyNote LV
</a
> model. If you have any idea how to get Linux
9567 installed on this machine, please get in touch or update that wiki
9568 page. If I can
't find a way to install Linux, I will have to return
9569 the laptop to the seller and find another machine for my parents.
</p
>
9571 <p
>I wonder, is this the way Linux will be forced out of the market
9572 using UEFI and
"secure boot
" by making it impossible to install Linux
9573 on new Laptops?
</p
>
9578 <title>How to transform a Debian based system to a Debian Edu installation
</title>
9579 <link>http://www.hungry.com/~pere/blog/How_to_transform_a_Debian_based_system_to_a_Debian_Edu_installation.html
</link>
9580 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_transform_a_Debian_based_system_to_a_Debian_Edu_installation.html
</guid>
9581 <pubDate>Fri,
17 May
2013 11:
50:
00 +
0200</pubDate>
9582 <description><p
><a href=
"http://www.skolelinux.org/
">Debian Edu / Skolelinux
</a
> is
9583 an operating system based on Debian intended for use in schools. It
9584 contain a turn-key solution for the computer network provided to
9585 pupils in the primary schools. It provide both the central server,
9586 network boot servers and desktop environments with heaps of
9587 educational software. The project was founded almost
12 years ago,
9588 2001-
07-
02. If you want to support the project, which is in need for
9589 cash to fund developer gatherings and other project related activity,
9590 <a href=
"http://www.linuxiskolen.no/slxdebianlabs/donations.html
">please
9591 donate some money
</a
>.
9593 <p
>A topic that come up again and again on the Debian Edu mailing
9594 lists and elsewhere, is the question on how to transform a Debian or
9595 Ubuntu installation into a Debian Edu installation. It isn
't very
9596 hard, and last week I wrote a script to replicate the steps done by
9597 the Debian Edu installer.
</p
>
9599 <p
>The script,
9600 <a href=
"http://anonscm.debian.org/viewvc/debian-edu/branches/wheezy/debian-edu-config/share/debian-edu-config/tools/debian-edu-bless?view=markup
">debian-edu-bless
<a/
>
9601 in the debian-edu-config package, will go through these six steps and
9602 transform an existing Debian Wheezy or Ubuntu (untested) installation
9603 into a Debian Edu Workstation:
</p
>
9607 <li
>Add skolelinux related APT sources.
</li
>
9608 <li
>Create /etc/debian-edu/config with the wanted configuration.
</li
>
9609 <li
>Install debian-edu-install to load preseeding values and pull in
9610 our configuration.
</li
>
9611 <li
>Preseed debconf database with profile setup in
9612 /etc/debian-edu/config, and run tasksel to install packages
9613 according to the profile specified in the config above,
9614 overriding some of the Debian automation machinery.
</li
>
9615 <li
>Run debian-edu-cfengine-D installation to configure everything
9616 that could not be done using preseeding.
</li
>
9617 <li
>Ask for a reboot to enable all the configuration changes.
</li
>
9621 <p
>There are some steps in the Debian Edu installation that can not be
9622 replicated like this. Disk partitioning and LVM setup, for example.
9623 So this script just assume there is enough disk space to install all
9624 the needed packages.
</p
>
9626 <p
>The script was created to help a Debian Edu student working on
9627 setting up
<a href=
"http://www.raspberrypi.org
">Raspberry Pi
</a
> as a
9628 Debian Edu client, and using it he can take the existing
9629 <a href=
"http://www.raspbian.org/FrontPage
">Raspbian
</a
> installation and
9630 transform it into a fully functioning Debian Edu Workstation (or
9631 Roaming Workstation, or whatever :).
</p
>
9633 <p
>The default setting in the script is to create a KDE Workstation.
9634 If a LXDE based Roaming workstation is wanted instead, modify the
9635 PROFILE and DESKTOP values at the top to look like this instead:
</p
>
9637 <p
><pre
>
9638 PROFILE=
"Roaming-Workstation
"
9639 DESKTOP=
"lxde
"
9640 </pre
></p
>
9642 <p
>The script could even become useful to set up Debian Edu servers in
9643 the cloud, by starting with a virtual Debian installation at some
9644 virtual hosting service and setting up all the services on first
9650 <title>Debian, the Linux distribution of choice for LEGO designers?
</title>
9651 <link>http://www.hungry.com/~pere/blog/Debian__the_Linux_distribution_of_choice_for_LEGO_designers_.html
</link>
9652 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian__the_Linux_distribution_of_choice_for_LEGO_designers_.html
</guid>
9653 <pubDate>Sat,
11 May
2013 20:
30:
00 +
0200</pubDate>
9654 <description><P
>In January,
9655 <a href=
"http://www.hungry.com/~pere/blog/New_IRC_channel_for_LEGO_designers_using_Debian.html
">I
9656 announced a
</a
> new
<a href=
"irc://irc.debian.org/%
23debian-lego
">IRC
9657 channel #debian-lego
</a
>, for those of us in the Debian and Linux
9658 community interested in
<a href=
"http://www.lego.com/
">LEGO
</a
>, the
9659 marvellous construction system from Denmark. We also created
9660 <a href=
"http://wiki.debian.org/LegoDesigners
">a wiki page
</a
> to have
9661 a place to take notes and write down our plans and hopes. And several
9662 people showed up to help. I was very happy to see the effect of my
9663 call. Since the small start, we have a debtags tag
9664 <a href=
"http://debtags.debian.net/search/bytag?wl=hardware::hobby:lego
">hardware::hobby:lego
</a
>
9665 tag for LEGO related packages, and now count
10 packages related to
9666 LEGO and
<a href=
"http://mindstorms.lego.com/
">Mindstorms
</a
>:
</p
>
9668 <p
><table
>
9669 <tr
><td
><a href=
"http://packages.qa.debian.org/brickos
">brickos
</a
></td
><td
>alternative OS for LEGO Mindstorms RCX. Supports development in C/C++
</td
></tr
>
9670 <tr
><td
><a href=
"http://packages.qa.debian.org/leocad
">leocad
</a
></td
><td
>virtual brick CAD software
</td
></tr
>
9671 <tr
><td
><a href=
"http://packages.qa.debian.org/libnxt
">libnxt
</a
></td
><td
>utility library for talking to the LEGO Mindstorms NX
</td
></tr
>
9672 <tr
><td
><a href=
"http://packages.qa.debian.org/lnpd
">lnpd
</a
></td
><td
>daemon for LNP communication with BrickOS
</td
></tr
>
9673 <tr
><td
><a href=
"http://packages.qa.debian.org/nbc
">nbc
</a
></td
><td
>compiler for LEGO Mindstorms NXT bricks
</td
></tr
>
9674 <tr
><td
><a href=
"http://packages.qa.debian.org/nqc
">nqc
</a
></td
><td
>Not Quite C compiler for LEGO Mindstorms RCX
</td
></tr
>
9675 <tr
><td
><a href=
"http://packages.qa.debian.org/python-nxt
">python-nxt
</a
></td
><td
>python driver/interface/wrapper for the Lego Mindstorms NXT robot
</td
></tr
>
9676 <tr
><td
><a href=
"http://packages.qa.debian.org/python-nxt-filer
">python-nxt-filer
</a
></td
><td
>simple GUI to manage files on a LEGO Mindstorms NXT
</td
></tr
>
9677 <tr
><td
><a href=
"http://packages.qa.debian.org/scratch
">scratch
</a
></td
><td
>easy to use programming environment for ages
8 and up
</td
></tr
>
9678 <tr
><td
><a href=
"http://packages.qa.debian.org/t2n
">t2n
</a
></td
><td
>simple command-line tool for Lego NXT
</td
></tr
>
9679 </table
></p
>
9681 <p
>Some of these are available in Wheezy, and all but one are
9682 currently available in Jessie/testing. leocad is so far only
9683 available in experimental.
</p
>
9685 <p
>If you care about LEGO in Debian, please join us on IRC and help
9686 adding the rest of the great free software tools available on Linux
9687 for LEGO designers.
</p
>
9692 <title>Debian Wheezy is out - and Debian Edu / Skolelinux should soon follow! #newinwheezy
</title>
9693 <link>http://www.hungry.com/~pere/blog/Debian_Wheezy_is_out___and_Debian_Edu___Skolelinux_should_soon_follow___newinwheezy.html
</link>
9694 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_Wheezy_is_out___and_Debian_Edu___Skolelinux_should_soon_follow___newinwheezy.html
</guid>
9695 <pubDate>Sun,
5 May
2013 07:
40:
00 +
0200</pubDate>
9696 <description><p
>When I woke up this morning, I was very happy to see that the
9697 <a href=
"http://www.debian.org/News/
2013/
20130504">release announcement
9698 for Debian Wheezy
</a
> was waiting in my mail box. This is a great
9699 Debian release, and I expect to move my machines at home over to it fairly
9702 <p
>The new debian release contain heaps of new stuff, and one program
9703 in particular make me very happy to see included. The
9704 <a href=
"http://scratch.mit.edu/
">Scratch
</a
> program, made famous by
9705 the
<a href=
"http://www.code.org/
">Teach kids code
</a
> movement, is
9706 included for the first time. Alongside similar programs like
9707 <a href=
"http://edu.kde.org/kturtle/
">kturtle
</a
> and
9708 <a href=
"http://wiki.sugarlabs.org/go/Activities/Turtle_Art
">turtleart
</a
>,
9709 it allow for visual programming where syntax errors can not happen,
9710 and a friendly programming environment for learning to control the
9711 computer. Scratch will also be included in the next release of Debian
9714 <p
>And now that Wheezy is wrapped up, we can wrap up the next Debian
9715 Edu/Skolelinux release too. The
9716 <a href=
"http://lists.debian.org/debian-edu/
2013/
04/msg00132.html
">first
9717 alpha release
</a
> went out last week, and the next should soon
9723 <title>Isenkram
0.2 finally in the Debian archive
</title>
9724 <link>http://www.hungry.com/~pere/blog/Isenkram_0_2_finally_in_the_Debian_archive.html
</link>
9725 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Isenkram_0_2_finally_in_the_Debian_archive.html
</guid>
9726 <pubDate>Wed,
3 Apr
2013 23:
40:
00 +
0200</pubDate>
9727 <description><p
>Today the
<a href=
"http://packages.qa.debian.org/isenkram
">Isenkram
9728 package
</a
> finally made it into the archive, after lingering in NEW
9729 for many months. I uploaded it to the Debian experimental suite
9730 2013-
01-
27, and today it was accepted into the archive.
</p
>
9732 <p
>Isenkram is a system for suggesting to users what packages to
9733 install to work with a pluggable hardware device. The suggestion pop
9734 up when the device is plugged in. For example if a Lego Mindstorm NXT
9735 is inserted, it will suggest to install the program needed to program
9736 the NXT controller. Give it a go, and report bugs and suggestions to
9742 <title>Bitcoin GUI now available from Debian/unstable (and Ubuntu/raring)
</title>
9743 <link>http://www.hungry.com/~pere/blog/Bitcoin_GUI_now_available_from_Debian_unstable__and_Ubuntu_raring_.html
</link>
9744 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Bitcoin_GUI_now_available_from_Debian_unstable__and_Ubuntu_raring_.html
</guid>
9745 <pubDate>Sat,
2 Feb
2013 09:
00:
00 +
0100</pubDate>
9746 <description><p
>My
9747 <a href=
"http://www.hungry.com/~pere/blog/How_to_backport_bitcoin_qt_version_0_7_2_2_to_Debian_Squeeze.html
">last
9748 bitcoin related blog post
</a
> mentioned that the new
9749 <a href=
"http://packages.qa.debian.org/bitcoin
">bitcoin package
</a
> for
9750 Debian was waiting in NEW. It was accepted by the Debian ftp-masters
9751 2013-
01-
19, and have been available in unstable since then. It was
9752 automatically copied to Ubuntu, and is available in their Raring
9753 version too.
</p
>
9755 <p
>But there is a strange problem with the build that block this new
9756 version from being available on the i386 and kfreebsd-i386
9757 architectures. For some strange reason, the autobuilders in Debian
9758 for these architectures fail to run the test suite on these
9759 architectures (
<a href=
"http://bugs.debian.org/
672524">BTS #
672524</a
>).
9760 We are so far unable to reproduce it when building it manually, and
9761 no-one have been able to propose a fix. If you got an idea what is
9762 failing, please let us know via the BTS.
</p
>
9764 <p
>One feature that is annoying me with of the bitcoin client, because
9765 I often run low on disk space, is the fact that the client will exit
9766 if it run short on space (
<a href=
"http://bugs.debian.org/
696715">BTS
9767 #
696715</a
>). So make sure you have enough disk space when you run
9770 <p
>As usual, if you use bitcoin and want to show your support of my
9771 activities, please send Bitcoin donations to my address
9772 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
9777 <title>Welcome to the world, Isenkram!
</title>
9778 <link>http://www.hungry.com/~pere/blog/Welcome_to_the_world__Isenkram_.html
</link>
9779 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Welcome_to_the_world__Isenkram_.html
</guid>
9780 <pubDate>Tue,
22 Jan
2013 22:
00:
00 +
0100</pubDate>
9781 <description><p
>Yesterday, I
9782 <a href=
"http://www.hungry.com/~pere/blog/First_prototype_ready_making_hardware_easier_to_use_in_Debian.html
">asked
9783 for testers
</a
> for my prototype for making Debian better at handling
9784 pluggable hardware devices, which I
9785 <a href=
"http://www.hungry.com/~pere/blog/Lets_make_hardware_dongles_easier_to_use_in_Debian.html
">set
9786 out to create
</a
> earlier this month. Several valuable testers showed
9787 up, and caused me to really want to to open up the development to more
9788 people. But before I did this, I want to come up with a sensible name
9789 for this project. Today I finally decided on a new name, and I have
9790 renamed the project from hw-support-handler to this new name. In the
9791 process, I moved the source to git and made it available as a
9792 <a href=
"http://anonscm.debian.org/gitweb/?p=collab-maint/isenkram.git
">collab-maint
</a
>
9793 repository in Debian. The new name? It is
<strong
>Isenkram
</strong
>.
9794 To fetch and build the latest version of the source, use
</p
>
9797 git clone http://anonscm.debian.org/git/collab-maint/isenkram.git
9798 cd isenkram
&& git-buildpackage -us -uc
9801 <p
>I have not yet adjusted all files to use the new name yet. If you
9802 want to hack on the source or improve the package, please go ahead.
9803 But please talk to me first on IRC or via email before you do major
9804 changes, to make sure we do not step on each others toes. :)
</p
>
9806 <p
>If you wonder what
'isenkram
' is, it is a Norwegian word for iron
9807 stuff, typically meaning tools, nails, screws, etc. Typical hardware
9808 stuff, in other words. I
've been told it is the Norwegian variant of
9809 the German word eisenkram, for those that are familiar with that
9812 <p
><strong
>Update
2013-
01-
26</strong
>: Added -us -us to build
9813 instructions, to avoid confusing people with an error from the signing
9816 <p
><strong
>Update
2013-
01-
27</strong
>: Switch to HTTP URL for the git
9817 clone argument to avoid the need for authentication.
</p
>
9822 <title>First prototype ready making hardware easier to use in Debian
</title>
9823 <link>http://www.hungry.com/~pere/blog/First_prototype_ready_making_hardware_easier_to_use_in_Debian.html
</link>
9824 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/First_prototype_ready_making_hardware_easier_to_use_in_Debian.html
</guid>
9825 <pubDate>Mon,
21 Jan
2013 12:
00:
00 +
0100</pubDate>
9826 <description><p
>Early this month I set out to try to
9827 <a href=
"http://www.hungry.com/~pere/blog/Lets_make_hardware_dongles_easier_to_use_in_Debian.html
">improve
9828 the Debian support for pluggable hardware devices
</a
>. Now my
9829 prototype is working, and it is ready for a larger audience. To test
9831 <a href=
"http://anonscm.debian.org/viewvc/debian-edu/trunk/src/hw-support-handler/
">source
9832 from the Debian Edu subversion repository
</a
>, build and install the
9833 package. You might have to log out and in again activate the
9834 autostart script.
</p
>
9836 <p
>The design is simple:
</p
>
9840 <li
>Add desktop entry in /usr/share/autostart/ causing a program
9841 hw-support-handlerd to start when the user log in.
</li
>
9843 <li
>This program listen for kernel events about new hardware (directly
9844 from the kernel like udev does), not using HAL dbus events as I
9845 initially did.
</li
>
9847 <li
>When new hardware is inserted, look up the hardware modalias in
9848 the APT database, a database
9849 <a href=
"http://anonscm.debian.org/viewvc/debian-edu/trunk/src/hw-support-handler/modaliases?view=markup
">available
9850 via HTTP
</a
> and a database available as part of the package.
</li
>
9852 <li
>If a package is mapped to the hardware in question, the package
9853 isn
't installed yet and this is the first time the hardware was
9854 plugged in, show a desktop notification suggesting to install the
9855 package or packages.
</li
>
9857 <li
>If the user click on the
'install package now
' button, ask
9858 aptdaemon via the PackageKit API to install the requrired package.
</li
>
9860 <li
>aptdaemon ask for root password or sudo password, and install the
9861 package while showing progress information in a window.
</li
>
9865 <p
>I still need to come up with a better name for the system. Here
9866 are some screen shots showing the prototype in action. First the
9867 notification, then the password request, and finally the request to
9868 approve all the dependencies. Sorry for the Norwegian Bokmål GUI.
</p
>
9870 <p
><img src=
"http://www.hungry.com/~pere/blog/images/
2013-
01-
21-hw-support-
1-notification.png
">
9871 <br
><img src=
"http://www.hungry.com/~pere/blog/images/
2013-
01-
21-hw-support-
2-password.png
">
9872 <br
><img src=
"http://www.hungry.com/~pere/blog/images/
2013-
01-
21-hw-support-
3-dependencies.png
">
9873 <br
><img src=
"http://www.hungry.com/~pere/blog/images/
2013-
01-
21-hw-support-
4-installing.png
">
9874 <br
><img src=
"http://www.hungry.com/~pere/blog/images/
2013-
01-
21-hw-support-
5-installing-details.png
" width=
"70%
"></p
>
9876 <p
>The prototype still need to be improved with longer timeouts, but
9877 is already useful. The database of hardware to package mappings also
9878 need more work. It is currently compatible with the Ubuntu way of
9879 storing such information in the package control file, but could be
9880 changed to use other formats instead or in addition to the current
9881 method. I
've dropped the use of discover for this mapping, as the
9882 modalias approach is more flexible and easier to use on Linux as long
9883 as the Linux kernel expose its modalias strings directly.
</p
>
9885 <p
><strong
>Update
2013-
01-
21 16:
50</strong
>: Due to popular demand,
9886 here is the command required to check out and build the source: Use
9887 '<tt
>svn checkout
9888 svn://svn.debian.org/debian-edu/trunk/src/hw-support-handler/; cd
9889 hw-support-handler; debuild
</tt
>'. If you lack debuild, install the
9890 devscripts package.
</p
>
9892 <p
><strong
>Update
2013-
01-
23 12:
00</strong
>: The project is now
9893 renamed to Isenkram and the source moved from the Debian Edu
9894 subversion repository to a Debian collab-maint git repository. See
9895 <a href=
"http://www.hungry.com/~pere/blog/Welcome_to_the_world__Isenkram_.html
">build
9896 instructions
</a
> for details.
</p
>
9901 <title>Thank you Thinkpad X41, for your long and trustworthy service
</title>
9902 <link>http://www.hungry.com/~pere/blog/Thank_you_Thinkpad_X41__for_your_long_and_trustworthy_service.html
</link>
9903 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Thank_you_Thinkpad_X41__for_your_long_and_trustworthy_service.html
</guid>
9904 <pubDate>Sat,
19 Jan
2013 09:
20:
00 +
0100</pubDate>
9905 <description><p
>This Christmas my trusty old laptop died. It died quietly and
9906 suddenly in bed. With a quiet whimper, it went completely quiet and
9907 black. The power button was no longer able to turn it on. It was a
9908 IBM Thinkpad X41, and the best laptop I ever had. Better than both
9909 Thinkpads X30, X31, X40, X60, X61 and X61S. Far better than the
9910 Compaq I had before that. Now I need to find a replacement. To keep
9911 going during Christmas, I moved the one year old SSD disk to my old
9912 X40 where it fitted (only one I had left that could use it), but it is
9913 not a durable solution.
9915 <p
>My laptop needs are fairly modest. This is my wishlist from when I
9916 got a new one more than
10 years ago. It still holds true.:)
</p
>
9920 <li
>Lightweight (around
1 kg) and small volume (preferably smaller
9921 than A4).
</li
>
9922 <li
>Robust, it will be in my backpack every day.
</li
>
9923 <li
>Three button mouse and a mouse pin instead of touch pad.
</li
>
9924 <li
>Long battery life time. Preferable a week.
</li
>
9925 <li
>Internal WIFI network card.
</li
>
9926 <li
>Internal Twisted Pair network card.
</li
>
9927 <li
>Some USB slots (
2-
3 is plenty)
</li
>
9928 <li
>Good keyboard - similar to the Thinkpad.
</li
>
9929 <li
>Video resolution at least
1024x768, with size around
12" (A4 paper
9931 <li
>Hardware supported by Debian Stable, ie the default kernel and
9932 X.org packages.
</li
>
9933 <li
>Quiet, preferably fan free (or at least not using the fan most of
9938 <p
>You will notice that there are no RAM and CPU requirements in the
9939 list. The reason is simply that the specifications on laptops the
9940 last
10-
15 years have been sufficient for my needs, and I have to look
9941 at other features to choose my laptop. But are there still made as
9942 robust laptops as my X41? The Thinkpad X60/X61 proved to be less
9943 robust, and Thinkpads seem to be heading in the wrong direction since
9944 Lenovo took over. But I
've been told that X220 and X1 Carbon might
9945 still be useful.
</p
>
9947 <p
>Perhaps I should rethink my needs, and look for a pad with an
9948 external keyboard? I
'll have to check the
9949 <a href=
"http://www.linux-laptop.net/
">Linux Laptops site
</a
> for
9950 well-supported laptops, or perhaps just buy one preinstalled from one
9951 of the vendors listed on the
<a href=
"http://linuxpreloaded.com/
">Linux
9952 Pre-loaded site
</a
>.
</p
>
9957 <title>How to find a browser plugin supporting a given MIME type
</title>
9958 <link>http://www.hungry.com/~pere/blog/How_to_find_a_browser_plugin_supporting_a_given_MIME_type.html
</link>
9959 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_find_a_browser_plugin_supporting_a_given_MIME_type.html
</guid>
9960 <pubDate>Fri,
18 Jan
2013 10:
40:
00 +
0100</pubDate>
9961 <description><p
>Some times I try to figure out which Iceweasel browser plugin to
9962 install to get support for a given MIME type. Thanks to
9963 <a href=
"https://wiki.ubuntu.com/MozillaTeam/Plugins
">specifications
9964 done by Ubuntu
</a
> and Mozilla, it is possible to do this in Debian.
9965 Unfortunately, not very many packages provide the needed meta
9966 information, Anyway, here is a small script to look up all browser
9967 plugin packages announcing ther MIME support using this specification:
</p
>
9973 def pkgs_handling_mimetype(mimetype):
9978 version = pkg.candidate
9980 version = pkg.installed
9983 record = version.record
9984 if not record.has_key(
'Npp-MimeType
'):
9986 mime_types = record[
'Npp-MimeType
'].split(
',
')
9987 for t in mime_types:
9988 t = t.rstrip().strip()
9990 thepkgs.append(pkg.name)
9992 mimetype =
"audio/ogg
"
9993 if
1 < len(sys.argv):
9994 mimetype = sys.argv[
1]
9995 print
"Browser plugin packages supporting %s:
" % mimetype
9996 for pkg in pkgs_handling_mimetype(mimetype):
9997 print
" %s
" %pkg
10000 <p
>It can be used like this to look up a given MIME type:
</p
>
10003 % ./apt-find-browserplug-for-mimetype
10004 Browser plugin packages supporting audio/ogg:
10006 % ./apt-find-browserplug-for-mimetype application/x-shockwave-flash
10007 Browser plugin packages supporting application/x-shockwave-flash:
10008 browser-plugin-gnash
10012 <p
>In Ubuntu this mechanism is combined with support in the browser
10013 itself to query for plugins and propose to install the needed
10014 packages. It would be great if Debian supported such feature too. Is
10015 anyone working on adding it?
</p
>
10017 <p
><strong
>Update
2013-
01-
18 14:
20</strong
>: The Debian BTS
10018 request for icweasel support for this feature is
10019 <a href=
"http://bugs.debian.org/
484010">#
484010</a
> from
2008 (and
10020 <a href=
"http://bugs.debian.org/
698426">#
698426</a
> from today). Lack
10021 of manpower and wish for a different design is the reason thus feature
10022 is not yet in iceweasel from Debian.
</p
>
10027 <title>What is the most supported MIME type in Debian?
</title>
10028 <link>http://www.hungry.com/~pere/blog/What_is_the_most_supported_MIME_type_in_Debian_.html
</link>
10029 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_is_the_most_supported_MIME_type_in_Debian_.html
</guid>
10030 <pubDate>Wed,
16 Jan
2013 10:
10:
00 +
0100</pubDate>
10031 <description><p
>The
<a href=
"http://wiki.debian.org/AppStreamDebianProposal
">DEP-
11
10032 proposal to add AppStream information to the Debian archive
</a
>, is a
10033 proposal to make it possible for a Desktop application to propose to
10034 the user some package to install to gain support for a given MIME
10035 type, font, library etc. that is currently missing. With such
10036 mechanism in place, it would be possible for the desktop to
10037 automatically propose and install leocad if some LDraw file is
10038 downloaded by the browser.
</p
>
10040 <p
>To get some idea about the current content of the archive, I decided
10041 to write a simple program to extract all .desktop files from the
10042 Debian archive and look up the claimed MIME support there. The result
10043 can be found on the
10044 <a href=
"http://ftp.skolelinux.org/pub/AppStreamTest
">Skolelinux FTP
10045 site
</a
>. Using the collected information, it become possible to
10046 answer the question in the title. Here are the
20 most supported MIME
10047 types in Debian stable (Squeeze), testing (Wheezy) and unstable (Sid).
10048 The complete list is available from the link above.
</p
>
10050 <p
><strong
>Debian Stable:
</strong
></p
>
10054 ----- -----------------------
10068 18 audio/x-musepack
10070 18 application/x-ogg
10077 <p
><strong
>Debian Testing:
</strong
></p
>
10081 ----- -----------------------
10097 18 application/x-ogg
10100 17 audio/x-musepack
10104 <p
><strong
>Debian Unstable:
</strong
></p
>
10108 ----- -----------------------
10125 18 application/x-ogg
10126 17 audio/x-musepack
10131 <p
>I am told that PackageKit can provide an API to access the kind of
10132 information mentioned in DEP-
11. I have not yet had time to look at
10133 it, but hope the PackageKit people in Debian are on top of these
10136 <p
><strong
>Update
2013-
01-
16 13:
35</strong
>: Updated numbers after
10137 discovering a typo in my script.
</p
>
10142 <title>Using modalias info to find packages handling my hardware
</title>
10143 <link>http://www.hungry.com/~pere/blog/Using_modalias_info_to_find_packages_handling_my_hardware.html
</link>
10144 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Using_modalias_info_to_find_packages_handling_my_hardware.html
</guid>
10145 <pubDate>Tue,
15 Jan
2013 08:
00:
00 +
0100</pubDate>
10146 <description><p
>Yesterday, I wrote about the
10147 <a href=
"http://www.hungry.com/~pere/blog/Modalias_strings___a_practical_way_to_map__stuff__to_hardware.html
">modalias
10148 values provided by the Linux kernel
</a
> following my hope for
10149 <a href=
"http://www.hungry.com/~pere/blog/Lets_make_hardware_dongles_easier_to_use_in_Debian.html
">better
10150 dongle support in Debian
</a
>. Using this knowledge, I have tested how
10151 modalias values attached to package names can be used to map packages
10152 to hardware. This allow the system to look up and suggest relevant
10153 packages when I plug in some new hardware into my machine, and replace
10154 discover and discover-data as the database used to map hardware to
10155 packages.
</p
>
10157 <p
>I create a modaliases file with entries like the following,
10158 containing package name, kernel module name (if relevant, otherwise
10159 the package name) and globs matching the relevant hardware
10160 modalias.
</p
>
10162 <p
><blockquote
>
10163 Package: package-name
10164 <br
>Modaliases: module(modaliasglob, modaliasglob, modaliasglob)
</p
>
10165 </blockquote
></p
>
10167 <p
>It is fairly trivial to write code to find the relevant packages
10168 for a given modalias value using this file.
</p
>
10170 <p
>An entry like this would suggest the video and picture application
10171 cheese for many USB web cameras (interface bus class
0E01):
</p
>
10173 <p
><blockquote
>
10175 <br
>Modaliases: cheese(usb:v*p*d*dc*dsc*dp*ic0Eisc01ip*)
</p
>
10176 </blockquote
></p
>
10178 <p
>An entry like this would suggest the pcmciautils package when a
10179 CardBus bridge (bus class
0607) PCI device is present:
</p
>
10181 <p
><blockquote
>
10182 Package: pcmciautils
10183 <br
>Modaliases: pcmciautils(pci:v*d*sv*sd*bc06sc07i*)
10184 </blockquote
></p
>
10186 <p
>An entry like this would suggest the package colorhug-client when
10187 plugging in a ColorHug with USB IDs
04D8:F8DA:
</p
>
10189 <p
><blockquote
>
10190 Package: colorhug-client
10191 <br
>Modaliases: colorhug-client(usb:v04D8pF8DAd*)
</p
>
10192 </blockquote
></p
>
10194 <p
>I believe the format is compatible with the format of the Packages
10195 file in the Debian archive. Ubuntu already uses their Packages file
10196 to store their mappings from packages to hardware.
</p
>
10198 <p
>By adding a XB-Modaliases: header in debian/control, any .deb can
10199 announce the hardware it support in a way my prototype understand.
10200 This allow those publishing packages in an APT source outside the
10201 Debian archive as well as those backporting packages to make sure the
10202 hardware mapping are included in the package meta information. I
've
10203 tested such header in the pymissile package, and its modalias mapping
10204 is working as it should with my prototype. It even made it to Ubuntu
10207 <p
>To test if it was possible to look up supported hardware using only
10208 the shell tools available in the Debian installer, I wrote a shell
10209 implementation of the lookup code. The idea is to create files for
10210 each modalias and let the shell do the matching. Please check out and
10212 <a href=
"http://anonscm.debian.org/viewvc/debian-edu/trunk/src/hw-support-handler/hw-support-lookup?view=co
">hw-support-lookup
</a
>
10213 shell script. It run without any extra dependencies and fetch the
10214 hardware mappings from the Debian archive and the subversion
10215 repository where I currently work on my prototype.
</p
>
10217 <p
>When I use it on a machine with a yubikey inserted, it suggest to
10218 install yubikey-personalization:
</p
>
10220 <p
><blockquote
>
10221 % ./hw-support-lookup
10222 <br
>yubikey-personalization
10224 </blockquote
></p
>
10226 <p
>When I run it on my Thinkpad X40 with a PCMCIA/CardBus slot, it
10227 propose to install the pcmciautils package:
</p
>
10229 <p
><blockquote
>
10230 % ./hw-support-lookup
10231 <br
>pcmciautils
10233 </blockquote
></p
>
10235 <p
>If you know of any hardware-package mapping that should be added to
10236 <a href=
"http://anonscm.debian.org/viewvc/debian-edu/trunk/src/hw-support-handler/modaliases?view=co
">my
10237 database
</a
>, please tell me about it.
</p
>
10239 <p
>It could be possible to generate several of the mappings between
10240 packages and hardware. One source would be to look at packages with
10241 kernel modules, ie packages with *.ko files in /lib/modules/, and
10242 extract their modalias information. Another would be to look at
10243 packages with udev rules, ie packages with files in
10244 /lib/udev/rules.d/, and extract their vendor/model information to
10245 generate a modalias matching rule. I have not tested any of these to
10246 see if it work.
</p
>
10248 <p
>If you want to help implementing a system to let us propose what
10249 packages to install when new hardware is plugged into a Debian
10250 machine, please send me an email or talk to me on
10251 <a href=
"irc://irc.debian.org/%
23debian-devel
">#debian-devel
</a
>.
</p
>
10256 <title>Modalias strings - a practical way to map
"stuff
" to hardware
</title>
10257 <link>http://www.hungry.com/~pere/blog/Modalias_strings___a_practical_way_to_map__stuff__to_hardware.html
</link>
10258 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Modalias_strings___a_practical_way_to_map__stuff__to_hardware.html
</guid>
10259 <pubDate>Mon,
14 Jan
2013 11:
20:
00 +
0100</pubDate>
10260 <description><p
>While looking into how to look up Debian packages based on hardware
10261 information, to find the packages that support a given piece of
10262 hardware, I refreshed my memory regarding modalias values, and decided
10263 to document the details. Here are my findings so far, also available
10265 <a href=
"http://anonscm.debian.org/viewvc/debian-edu/trunk/src/hw-support-handler/
">the
10266 Debian Edu subversion repository
</a
>:
10268 <p
><strong
>Modalias decoded
</strong
></p
>
10270 <p
>This document try to explain what the different types of modalias
10271 values stands for. It is in part based on information from
10272 &lt;URL:
<a href=
"https://wiki.archlinux.org/index.php/Modalias
">https://wiki.archlinux.org/index.php/Modalias
</a
> &gt;,
10273 &lt;URL:
<a href=
"http://unix.stackexchange.com/questions/
26132/how-to-assign-usb-driver-to-device
">http://unix.stackexchange.com/questions/
26132/how-to-assign-usb-driver-to-device
</a
> &gt;,
10274 &lt;URL:
<a href=
"http://code.metager.de/source/history/linux/stable/scripts/mod/file2alias.c
">http://code.metager.de/source/history/linux/stable/scripts/mod/file2alias.c
</a
> &gt; and
10275 &lt;URL:
<a href=
"http://cvs.savannah.gnu.org/viewvc/dmidecode/dmidecode.c?root=dmidecode
&view=markup
">http://cvs.savannah.gnu.org/viewvc/dmidecode/dmidecode.c?root=dmidecode
&view=markup
</a
> &gt;.
10277 <p
>The modalias entries for a given Linux machine can be found using
10278 this shell script:
</p
>
10281 find /sys -name modalias -print0 | xargs -
0 cat | sort -u
10284 <p
>The supported modalias globs for a given kernel module can be found
10285 using modinfo:
</p
>
10288 % /sbin/modinfo psmouse | grep alias:
10289 alias: serio:ty05pr*id*ex*
10290 alias: serio:ty01pr*id*ex*
10294 <p
><strong
>PCI subtype
</strong
></p
>
10296 <p
>A typical PCI entry can look like this. This is an Intel Host
10297 Bridge memory controller:
</p
>
10299 <p
><blockquote
>
10300 pci:v00008086d00002770sv00001028sd000001ADbc06sc00i00
10301 </blockquote
></p
>
10303 <p
>This represent these values:
</p
>
10306 v
00008086 (vendor)
10307 d
00002770 (device)
10308 sv
00001028 (subvendor)
10309 sd
000001AD (subdevice)
10311 sc
00 (bus subclass)
10315 <p
>The vendor/device values are the same values outputted from
'lspci
10316 -n
' as
8086:
2770. The bus class/subclass is also shown by lspci as
10317 0600. The
0600 class is a host bridge. Other useful bus values are
10318 0300 (VGA compatible card) and
0200 (Ethernet controller).
</p
>
10320 <p
>Not sure how to figure out the interface value, nor what it
10323 <p
><strong
>USB subtype
</strong
></p
>
10325 <p
>Some typical USB entries can look like this. This is an internal
10326 USB hub in a laptop:
</p
>
10328 <p
><blockquote
>
10329 usb:v1D6Bp0001d0206dc09dsc00dp00ic09isc00ip00
10330 </blockquote
></p
>
10332 <p
>Here is the values included in this alias:
</p
>
10335 v
1D6B (device vendor)
10336 p
0001 (device product)
10338 dc
09 (device class)
10339 dsc
00 (device subclass)
10340 dp
00 (device protocol)
10341 ic
09 (interface class)
10342 isc
00 (interface subclass)
10343 ip
00 (interface protocol)
10346 <p
>The
0900 device class/subclass means hub. Some times the relevant
10347 class is in the interface class section. For a simple USB web camera,
10348 these alias entries show up:
</p
>
10350 <p
><blockquote
>
10351 usb:v0AC8p3420d5000dcEFdsc02dp01ic01isc01ip00
10352 <br
>usb:v0AC8p3420d5000dcEFdsc02dp01ic01isc02ip00
10353 <br
>usb:v0AC8p3420d5000dcEFdsc02dp01ic0Eisc01ip00
10354 <br
>usb:v0AC8p3420d5000dcEFdsc02dp01ic0Eisc02ip00
10355 </blockquote
></p
>
10357 <p
>Interface class
0E01 is video control,
0E02 is video streaming (aka
10358 camera),
0101 is audio control device and
0102 is audio streaming (aka
10359 microphone). Thus this is a camera with microphone included.
</p
>
10361 <p
><strong
>ACPI subtype
</strong
></p
>
10363 <p
>The ACPI type is used for several non-PCI/USB stuff. This is an IR
10364 receiver in a Thinkpad X40:
</p
>
10366 <p
><blockquote
>
10367 acpi:IBM0071:PNP0511:
10368 </blockquote
></p
>
10370 <p
>The values between the colons are IDs.
</p
>
10372 <p
><strong
>DMI subtype
</strong
></p
>
10374 <p
>The DMI table contain lots of information about the computer case
10375 and model. This is an entry for a IBM Thinkpad X40, fetched from
10376 /sys/devices/virtual/dmi/id/modalias:
</p
>
10378 <p
><blockquote
>
10379 dmi:bvnIBM:bvr1UETB6WW(
1.66):bd06/
15/
2005:svnIBM:pn2371H4G:pvrThinkPadX40:rvnIBM:rn2371H4G:rvrNotAvailable:cvnIBM:ct10:cvrNotAvailable:
10380 </blockquote
></p
>
10382 <p
>The values present are
</p
>
10385 bvn IBM (BIOS vendor)
10386 bvr
1UETB
6WW(
1.66) (BIOS version)
10387 bd
06/
15/
2005 (BIOS date)
10388 svn IBM (system vendor)
10389 pn
2371H4G (product name)
10390 pvr ThinkPadX40 (product version)
10391 rvn IBM (board vendor)
10392 rn
2371H4G (board name)
10393 rvr NotAvailable (board version)
10394 cvn IBM (chassis vendor)
10395 ct
10 (chassis type)
10396 cvr NotAvailable (chassis version)
10399 <p
>The chassis type
10 is Notebook. Other interesting values can be
10400 found in the dmidecode source:
</p
>
10404 4 Low Profile Desktop
10417 17 Main Server Chassis
10418 18 Expansion Chassis
10420 20 Bus Expansion Chassis
10421 21 Peripheral Chassis
10423 23 Rack Mount Chassis
10432 <p
>The chassis type values are not always accurately set in the DMI
10433 table. For example my home server is a tower, but the DMI modalias
10434 claim it is a desktop.
</p
>
10436 <p
><strong
>SerIO subtype
</strong
></p
>
10438 <p
>This type is used for PS/
2 mouse plugs. One example is from my
10439 test machine:
</p
>
10441 <p
><blockquote
>
10442 serio:ty01pr00id00ex00
10443 </blockquote
></p
>
10445 <p
>The values present are
</p
>
10454 <p
>This type is supported by the psmouse driver. I am not sure what
10455 the valid values are.
</p
>
10457 <p
><strong
>Other subtypes
</strong
></p
>
10459 <p
>There are heaps of other modalias subtypes according to
10460 file2alias.c. There is the rest of the list from that source: amba,
10461 ap, bcma, ccw, css, eisa, hid, i2c, ieee1394, input, ipack, isapnp,
10462 mdio, of, parisc, pcmcia, platform, scsi, sdio, spi, ssb, vio, virtio,
10463 vmbus, x86cpu and zorro. I did not spend time documenting all of
10464 these, as they do not seem relevant for my intended use with mapping
10465 hardware to packages when new stuff is inserted during run time.
</p
>
10467 <p
><strong
>Looking up kernel modules using modalias values
</strong
></p
>
10469 <p
>To check which kernel modules provide support for a given modalias,
10470 one can use the following shell script:
</p
>
10473 for id in $(find /sys -name modalias -print0 | xargs -
0 cat | sort -u); do \
10474 echo
"$id
" ; \
10475 /sbin/modprobe --show-depends
"$id
"|sed
's/^/ /
' ; \
10479 <p
>The output can look like this (only the first few entries as the
10480 list is very long on my test machine):
</p
>
10484 insmod /lib/modules/
2.6.32-
5-
686/kernel/drivers/acpi/ac.ko
10486 FATAL: Module acpi:device: not found.
10488 insmod /lib/modules/
2.6.32-
5-
686/kernel/drivers/char/nvram.ko
10489 insmod /lib/modules/
2.6.32-
5-
686/kernel/drivers/leds/led-class.ko
10490 insmod /lib/modules/
2.6.32-
5-
686/kernel/net/rfkill/rfkill.ko
10491 insmod /lib/modules/
2.6.32-
5-
686/kernel/drivers/platform/x86/thinkpad_acpi.ko
10492 acpi:IBM0071:PNP0511:
10493 insmod /lib/modules/
2.6.32-
5-
686/kernel/lib/crc-ccitt.ko
10494 insmod /lib/modules/
2.6.32-
5-
686/kernel/net/irda/irda.ko
10495 insmod /lib/modules/
2.6.32-
5-
686/kernel/drivers/net/irda/nsc-ircc.ko
10499 <p
>If you want to help implementing a system to let us propose what
10500 packages to install when new hardware is plugged into a Debian
10501 machine, please send me an email or talk to me on
10502 <a href=
"irc://irc.debian.org/%
23debian-devel
">#debian-devel
</a
>.
</p
>
10504 <p
><strong
>Update
2013-
01-
15:
</strong
> Rewrite
"cat $(find ...)
" to
10505 "find ... -print0 | xargs -
0 cat
" to make sure it handle directories
10506 in /sys/ with space in them.
</p
>
10511 <title>Moved the pymissile Debian packaging to collab-maint
</title>
10512 <link>http://www.hungry.com/~pere/blog/Moved_the_pymissile_Debian_packaging_to_collab_maint.html
</link>
10513 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Moved_the_pymissile_Debian_packaging_to_collab_maint.html
</guid>
10514 <pubDate>Thu,
10 Jan
2013 20:
40:
00 +
0100</pubDate>
10515 <description><p
>As part of my investigation on how to improve the support in Debian
10516 for hardware dongles, I dug up my old Mark and Spencer USB Rocket
10517 Launcher and updated the Debian package
10518 <a href=
"http://packages.qa.debian.org/pymissile
">pymissile
</a
> to make
10519 sure udev will fix the device permissions when it is plugged in. I
10520 also added a
"Modaliases
" header to test it in the Debian archive and
10521 hopefully make the package be proposed by jockey in Ubuntu when a user
10522 plug in his rocket launcher. In the process I moved the source to a
10523 git repository under collab-maint, to make it easier for any DD to
10524 contribute.
<a href=
"http://code.google.com/p/pymissile/
">Upstream
</a
>
10525 is not very active, but the software still work for me even after five
10526 years of relative silence. The new git repository is not listed in
10527 the uploaded package yet, because I want to test the other changes a
10528 bit more before I upload the new version. If you want to check out
10529 the new version with a .desktop file included, visit the
10530 <a href=
"http://anonscm.debian.org/gitweb/?p=collab-maint/pymissile.git
">gitweb
10531 view
</a
> or use
"<tt
>git clone
10532 git://anonscm.debian.org/collab-maint/pymissile.git
</tt
>".
</p
>
10537 <title>Lets make hardware dongles easier to use in Debian
</title>
10538 <link>http://www.hungry.com/~pere/blog/Lets_make_hardware_dongles_easier_to_use_in_Debian.html
</link>
10539 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Lets_make_hardware_dongles_easier_to_use_in_Debian.html
</guid>
10540 <pubDate>Wed,
9 Jan
2013 15:
40:
00 +
0100</pubDate>
10541 <description><p
>One thing that annoys me with Debian and Linux distributions in
10542 general, is that there is a great package management system with the
10543 ability to automatically install software packages by downloading them
10544 from the distribution mirrors, but no way to get it to automatically
10545 install the packages I need to use the hardware I plug into my
10546 machine. Even if the package to use it is easily available from the
10547 Linux distribution. When I plug in a LEGO Mindstorms NXT, it could
10548 suggest to automatically install the python-nxt, nbc and t2n packages
10549 I need to talk to it. When I plug in a Yubikey, it could propose the
10550 yubikey-personalization package. The information required to do this
10551 is available, but no-one have pulled all the pieces together.
</p
>
10553 <p
>Some years ago, I proposed to
10554 <a href=
"http://lists.debian.org/debian-devel/
2010/
05/msg01206.html
">use
10555 the discover subsystem to implement this
</a
>. The idea is fairly
10560 <li
>Add a desktop entry in /usr/share/autostart/ pointing to a program
10561 starting when a user log in.
</li
>
10563 <li
>Set this program up to listen for kernel events emitted when new
10564 hardware is inserted into the computer.
</li
>
10566 <li
>When new hardware is inserted, look up the hardware ID in a
10567 database mapping to packages, and take note of any non-installed
10568 packages.
</li
>
10570 <li
>Show a message to the user proposing to install the discovered
10571 package, and make it easy to install it.
</li
>
10575 <p
>I am not sure what the best way to implement this is, but my
10576 initial idea was to use dbus events to discover new hardware, the
10577 discover database to find packages and
10578 <a href=
"http://www.packagekit.org/
">PackageKit
</a
> to install
10579 packages.
</p
>
10581 <p
>Yesterday, I found time to try to implement this idea, and the
10582 draft package is now checked into
10583 <a href=
"http://anonscm.debian.org/viewvc/debian-edu/trunk/src/hw-support-handler/
">the
10584 Debian Edu subversion repository
</a
>. In the process, I updated the
10585 <a href=
"http://packages.qa.debian.org/d/discover-data.html
">discover-data
</a
>
10586 package to map the USB ids of LEGO Mindstorms and Yubikey devices to
10587 the relevant packages in Debian, and uploaded a new version
10588 2.2013.01.09 to unstable. I also discovered that the current
10589 <a href=
"http://packages.qa.debian.org/d/discover.html
">discover
</a
>
10590 package in Debian no longer discovered any USB devices, because
10591 /proc/bus/usb/devices is no longer present. I ported it to use
10592 libusb as a fall back option to get it working. The fixed package
10593 version
2.1.2-
6 is now in experimental (didn
't upload it to unstable
10594 because of the freeze).
</p
>
10596 <p
>With this prototype in place, I can insert my Yubikey, and get this
10597 desktop notification to show up (only once, the first time it is
10598 inserted):
</p
>
10600 <p align=
"center
"><img src=
"http://www.hungry.com/~pere/blog/images/
2013-
01-
09-hw-autoinstall.png
"></p
>
10602 <p
>For this prototype to be really useful, some way to automatically
10603 install the proposed packages by pressing the
"Please install
10604 program(s)
" button should to be implemented.
</p
>
10606 <p
>If this idea seem useful to you, and you want to help make it
10607 happen, please help me update the discover-data database with mappings
10608 from hardware to Debian packages. Check if
'discover-pkginstall -l
'
10609 list the package you would like to have installed when a given
10610 hardware device is inserted into your computer, and report bugs using
10611 reportbug if it isn
't. Or, if you know of a better way to provide
10612 such mapping, please let me know.
</p
>
10614 <p
>This prototype need more work, and there are several questions that
10615 should be considered before it is ready for production use. Is dbus
10616 the correct way to detect new hardware? At the moment I look for HAL
10617 dbus events on the system bus, because that is the events I could see
10618 on my Debian Squeeze KDE desktop. Are there better events to use?
10619 How should the user be notified? Is the desktop notification
10620 mechanism the best option, or should the background daemon raise a
10621 popup instead? How should packages be installed? When should they
10622 not be installed?
</p
>
10624 <p
>If you want to help getting such feature implemented in Debian,
10625 please send me an email. :)
</p
>
10630 <title>New IRC channel for LEGO designers using Debian
</title>
10631 <link>http://www.hungry.com/~pere/blog/New_IRC_channel_for_LEGO_designers_using_Debian.html
</link>
10632 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/New_IRC_channel_for_LEGO_designers_using_Debian.html
</guid>
10633 <pubDate>Wed,
2 Jan
2013 15:
40:
00 +
0100</pubDate>
10634 <description><p
>During Christmas, I have worked a bit on the Debian support for
10635 <a href=
"http://mindstorms.lego.com/en-us/Default.aspx
">LEGO Mindstorm
10636 NXT
</a
>. My son and I have played a bit with my NXT set, and I
10637 discovered I had to build all the tools myself because none were
10638 already in Debian Squeeze. If Debian support for LEGO is something
10639 you care about, please join me on the IRC channel
10640 <a href=
"irc://irc.debian.org/%
23debian-lego
">#debian-lego
</a
> (server
10641 irc.debian.org). There is a lot that could be done to improve the
10642 Debian support for LEGO designers. For example both CAD software
10643 and Mindstorm compilers are missing. :)
</p
>
10645 <p
>Update
2012-
01-
03: A
10646 <a href=
"http://wiki.debian.org/LegoDesigners
">project page
</a
>
10647 including links to Lego related packages is now available.
</p
>
10652 <title>How to backport bitcoin-qt version
0.7.2-
2 to Debian Squeeze
</title>
10653 <link>http://www.hungry.com/~pere/blog/How_to_backport_bitcoin_qt_version_0_7_2_2_to_Debian_Squeeze.html
</link>
10654 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_backport_bitcoin_qt_version_0_7_2_2_to_Debian_Squeeze.html
</guid>
10655 <pubDate>Tue,
25 Dec
2012 20:
50:
00 +
0100</pubDate>
10656 <description><p
>Let me start by wishing you all marry Christmas and a happy new
10657 year! I hope next year will prove to be a good year.
</p
>
10659 <p
><a href=
"http://www.bitcoin.org/
">Bitcoin
</a
>, the digital
10660 decentralised
"currency
" that allow people to transfer bitcoins
10661 between each other with minimal overhead, is a very interesting
10662 experiment. And as I wrote a few days ago, the bitcoin situation in
10663 <a href=
"http://www.debian.org/
">Debian
</a
> is about to improve a bit.
10664 The
<a href=
"http://packages.qa.debian.org/bitcoin
">new debian source
10665 package
</a
> (version
0.7.2-
2) was uploaded yesterday, and is waiting
10666 in
<a href=
"http://ftp-master.debian.org/new.html
">the NEW queue
</A
>
10667 for one of the ftpmasters to approve the new bitcoin-qt package
10670 <p
>And thanks to the great work of Jonas and the rest of the bitcoin
10671 team in Debian, you can easily test the package in Debian Squeeze
10672 using the following steps to get a set of working packages:
</p
>
10674 <blockquote
><pre
>
10675 git clone git://git.debian.org/git/collab-maint/bitcoin
10677 DEB_MAINTAINER_MODE=
1 DEB_BUILD_OPTIONS=noupnp fakeroot debian/rules clean
10678 DEB_BUILD_OPTIONS=noupnp git-buildpackage --git-ignore-new
10679 </pre
></blockquote
>
10681 <p
>You might have to install some build dependencies as well. The
10682 list of commands should give you two packages, bitcoind and
10683 bitcoin-qt, ready for use in a Squeeze environment. Note that the
10684 client will download the complete set of bitcoin
"blocks
", which need
10685 around
5.6 GiB of data on my machine at the moment. Make sure your
10686 ~/.bitcoin/ directory have lots of spare room if you want to download
10687 all the blocks. The client will warn if the disk is getting full, so
10688 there is not really a problem if you got too little room, but you will
10689 not be able to get all the features out of the client.
</p
>
10691 <p
>As usual, if you use bitcoin and want to show your support of my
10692 activities, please send Bitcoin donations to my address
10693 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
10698 <title>A word on bitcoin support in Debian
</title>
10699 <link>http://www.hungry.com/~pere/blog/A_word_on_bitcoin_support_in_Debian.html
</link>
10700 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/A_word_on_bitcoin_support_in_Debian.html
</guid>
10701 <pubDate>Fri,
21 Dec
2012 23:
59:
00 +
0100</pubDate>
10702 <description><p
>It has been a while since I wrote about
10703 <a href=
"http://www.bitcoin.org/
">bitcoin
</a
>, the decentralised
10704 peer-to-peer based crypto-currency, and the reason is simply that I
10705 have been busy elsewhere. But two days ago, I started looking at the
10706 state of
<a href=
"http://packages.qa.debian.org/bitcoin
">bitcoin in
10707 Debian
</a
> again to try to recover my old bitcoin wallet. The package
10708 is now maintained by a
10709 <a href=
"https://alioth.debian.org/projects/pkg-bitcoin/
">team of
10710 people
</a
>, and the grunt work had already been done by this team. We
10711 owe a huge thank you to all these team members. :)
10712 But I was sad to discover that the bitcoin client is missing in
10713 Wheezy. It is only available in Sid (and an outdated client from
10714 backports). The client had several RC bugs registered in BTS blocking
10715 it from entering testing. To try to help the team and improve the
10716 situation, I spent some time providing patches and triaging the bug
10717 reports. I also had a look at the bitcoin package available from Matt
10719 <a href=
"https://launchpad.net/~bitcoin/+archive/bitcoin
">PPA for
10720 Ubuntu
</a
>, and moved the useful pieces from that version into the
10721 Debian package.
</p
>
10723 <p
>After checking with the main package maintainer Jonas Smedegaard on
10724 IRC, I pushed several patches into the collab-maint git repository to
10725 improve the package. It now contains fixes for the RC issues (not from
10726 me, but fixed by Scott Howard), build rules for a Qt GUI client
10727 package, konqueror support for the bitcoin: URI and bash completion
10728 setup. As I work on Debian Squeeze, I also created
10729 <a href=
"http://lists.alioth.debian.org/pipermail/pkg-bitcoin-devel/Week-of-Mon-
20121217/
000041.html
">a
10730 patch to backport
</a
> the latest version. Jonas is going to look at
10731 it and try to integrate it into the git repository before uploading a
10732 new version to unstable.
10734 <p
>I would very much like bitcoin to succeed, to get rid of the
10735 centralized control currently exercised in the monetary system. I
10736 find it completely unacceptable that the USA government is collecting
10737 transaction data for almost all international money transfers (most are done in USD and transaction logs shipped to the spooks), and
10738 that the major credit card companies can block legal money
10739 transactions to Wikileaks. But for bitcoin to succeed, more people
10740 need to use bitcoins, and more people need to accept bitcoins when
10741 they sell products and services. Improving the bitcoin support in
10742 Debian is a small step in the right direction, but not enough.
10743 Unfortunately the user experience when browsing the web and wanting to
10744 pay with bitcoin is still not very good. The bitcoin: URI is a step
10745 in the right direction, but need to work in most or every browser in
10746 use. Also the bitcoin-qt client is too heavy to fire up to do a
10747 quick transaction. I believe there are other clients available, but
10748 have not tested them.
</p
>
10751 <a href=
"http://www.hungry.com/~pere/blog/Now_accepting_bitcoins___anonymous_and_distributed_p2p_crypto_money.html
">experiment
10752 with bitcoins
</a
> showed that at least some of my readers use bitcoin.
10753 I received
20.15 BTC so far on the address I provided in my blog two
10754 years ago, as can be
10755 <a href=
"http://blockexplorer.com/address/
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">seen
10756 on the blockexplorer service
</a
>. Thank you everyone for your
10757 donation. The blockexplorer service demonstrates quite well that
10758 bitcoin is not quite anonymous and untracked. :) I wonder if the
10759 number of users have gone up since then. If you use bitcoin and want
10760 to show your support of my activity, please send Bitcoin donations to
10761 the same address as last time,
10762 <b
><a href=
"bitcoin:
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
></b
>.
</p
>
10767 <title>Git repository for song book for Computer Scientists
</title>
10768 <link>http://www.hungry.com/~pere/blog/Git_repository_for_song_book_for_Computer_Scientists.html
</link>
10769 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Git_repository_for_song_book_for_Computer_Scientists.html
</guid>
10770 <pubDate>Fri,
7 Sep
2012 13:
50:
00 +
0200</pubDate>
10771 <description><p
>As I
10772 <a href=
"http://www.hungry.com/~pere/blog/Song_book_for_Computer_Scientists.html
">mentioned
10773 this summer
</a
>, I have created a Computer Science song book a few
10774 years ago, and today I finally found time to create a public
10775 <a href=
"https://gitorious.org/pere-cs-songbook/pere-cs-songbook
">Gitorious
10776 repository for the project
</a
>.
</p
>
10778 <p
>If you want to help out, please clone the source and submit patches
10779 to the HTML version. To generate the PDF and PostScript version,
10780 please use prince XML, or let me know about a useful free software
10781 processor capable of creating a good looking PDF from the HTML.
</p
>
10783 <p
>Want to sing? You can still find the song book in HTML, PDF and
10784 PostScript formats at
10785 <a href=
"http://www.hungry.com/~pere/cs-songbook/
">Petter
's Computer
10786 Science Songbook
</a
>.
</p
>
10791 <title>Gratulerer med
19-årsdagen, Debian!
</title>
10792 <link>http://www.hungry.com/~pere/blog/Gratulerer_med_19__rsdagen__Debian_.html
</link>
10793 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Gratulerer_med_19__rsdagen__Debian_.html
</guid>
10794 <pubDate>Thu,
16 Aug
2012 11:
20:
00 +
0200</pubDate>
10795 <description><p
>I dag fyller
10796 <a href=
"http://www.debian.org/News/
2012/
20120813">Debian-prosjektet
19
10797 år
</a
>. Jeg har fulgt det de siste
12 årene, og er veldig glad for å kunne
10798 si gratulerer med dagen, Debian!
</p
>
10803 <title>Song book for Computer Scientists
</title>
10804 <link>http://www.hungry.com/~pere/blog/Song_book_for_Computer_Scientists.html
</link>
10805 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Song_book_for_Computer_Scientists.html
</guid>
10806 <pubDate>Sun,
24 Jun
2012 13:
30:
00 +
0200</pubDate>
10807 <description><p
>Many years ago, while studying Computer Science at the
10808 <a href=
"http://www.uit.no/
">University of Tromsø
</a
>, I started
10809 collecting computer related songs for use at parties. The original
10810 version was written in LaTeX, but a few years ago I got help from
10811 Håkon W. Lie, one of the inventors of W3C CSS, to convert it to HTML
10812 while keeping the ability to create a nice book in PDF format. I have
10813 not had time to maintain the book for a while now, and guess I should
10814 put it up on some public version control repository where others can
10815 help me extend and update the book. If anyone is volunteering to help
10816 me with this, send me an email. Also let me know if there are songs
10817 missing in my book.
</p
>
10819 <p
>I have not mentioned the book on my blog so far, and it occured to
10820 me today that I really should let all my readers share the joys of
10821 singing out load about programming, computers and computer networks.
10822 Especially now that
<a href=
"http://debconf12.debconf.org/
">Debconf
10823 12</a
> is about to start (and I am not going). Want to sing? Check
10824 out
<a href=
"http://www.hungry.com/~pere/cs-songbook/
">Petter
's
10825 Computer Science Songbook
</a
>.
10830 <title>Automatically upgrading server firmware on Dell PowerEdge
</title>
10831 <link>http://www.hungry.com/~pere/blog/Automatically_upgrading_server_firmware_on_Dell_PowerEdge.html
</link>
10832 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Automatically_upgrading_server_firmware_on_Dell_PowerEdge.html
</guid>
10833 <pubDate>Mon,
21 Nov
2011 12:
00:
00 +
0100</pubDate>
10834 <description><p
>At work we have heaps of servers. I believe the total count is
10835 around
1000 at the moment. To be able to get help from the vendors
10836 when something go wrong, we want to keep the firmware on the servers
10837 up to date. If the firmware isn
't the latest and greatest, the
10838 vendors typically refuse to start debugging any problems until the
10839 firmware is upgraded. So before every reboot, we want to upgrade the
10840 firmware, and we would really like everyone handling servers at the
10841 university to do this themselves when they plan to reboot a machine.
10842 For that to happen we at the unix server admin group need to provide
10843 the tools to do so.
</p
>
10845 <p
>To make firmware upgrading easier, I am working on a script to
10846 fetch and install the latest firmware for the servers we got. Most of
10847 our hardware are from Dell and HP, so I have focused on these servers
10848 so far. This blog post is about the Dell part.
</P
>
10850 <p
>On the Dell FTP site I was lucky enough to find
10851 <a href=
"ftp://ftp.us.dell.com/catalog/Catalog.xml.gz
">an XML file
</a
>
10852 with firmware information for all
11th generation servers, listing
10853 which firmware should be used on a given model and where on the FTP
10854 site I can find it. Using a simple perl XML parser I can then
10855 download the shell scripts Dell provides to do firmware upgrades from
10856 within Linux and reboot when all the firmware is primed and ready to
10857 be activated on the first reboot.
</p
>
10859 <p
>This is the Dell related fragment of the perl code I am working on.
10860 Are there anyone working on similar tools for firmware upgrading all
10861 servers at a site? Please get in touch and lets share resources.
</p
>
10863 <p
><pre
>
10867 use File::Temp qw(tempdir);
10869 # Install needed RHEL packages if missing
10870 my %rhelmodules = (
10871 'XML::Simple
' =
> 'perl-XML-Simple
',
10873 for my $module (keys %rhelmodules) {
10874 eval
"use $module;
";
10876 my $pkg = $rhelmodules{$module};
10877 system(
"yum install -y $pkg
");
10878 eval
"use $module;
";
10882 my $errorsto =
'pere@hungry.com
';
10888 sub run_firmware_script {
10889 my ($opts, $script) = @_;
10891 print STDERR
"fail: missing script name\n
";
10894 print STDERR
"Running $script\n\n
";
10896 if (
0 == system(
"sh $script $opts
")) { # FIXME correct exit code handling
10897 print STDERR
"success: firmware script ran succcessfully\n
";
10899 print STDERR
"fail: firmware script returned error\n
";
10903 sub run_firmware_scripts {
10904 my ($opts, @dirs) = @_;
10905 # Run firmware packages
10906 for my $dir (@dirs) {
10907 print STDERR
"info: Running scripts in $dir\n
";
10908 opendir(my $dh, $dir) or die
"Unable to open directory $dir: $!
";
10909 while (my $s = readdir $dh) {
10910 next if $s =~ m/^\.\.?/;
10911 run_firmware_script($opts,
"$dir/$s
");
10919 print STDERR
"info: Downloading $url\n
";
10920 system(
"wget --quiet \
"$url\
"");
10925 my $product = `dmidecode -s system-product-name`;
10928 if ($product =~ m/PowerEdge/) {
10930 # on RHEL, these pacakges are needed by the firwmare upgrade scripts
10931 system(
'yum install -y compat-libstdc++-
33.i686 libstdc++.i686 libxml2.i686 procmail
');
10933 my $tmpdir = tempdir(
10937 fetch_dell_fw(
'catalog/Catalog.xml.gz
');
10938 system(
'gunzip Catalog.xml.gz
');
10939 my @paths = fetch_dell_fw_list(
'Catalog.xml
');
10940 # -q is quiet, disabling interactivity and reducing console output
10941 my $fwopts =
"-q
";
10943 for my $url (@paths) {
10944 fetch_dell_fw($url);
10946 run_firmware_scripts($fwopts, $tmpdir);
10948 print STDERR
"error: Unsupported Dell model
'$product
'.\n
";
10949 print STDERR
"error: Please report to $errorsto.\n
";
10951 chdir(
'/
');
10953 print STDERR
"error: Unsupported Dell model
'$product
'.\n
";
10954 print STDERR
"error: Please report to $errorsto.\n
";
10958 sub fetch_dell_fw {
10960 my $url =
"ftp://ftp.us.dell.com/$path
";
10964 # Using ftp://ftp.us.dell.com/catalog/Catalog.xml.gz, figure out which
10965 # firmware packages to download from Dell. Only work for Linux
10966 # machines and
11th generation Dell servers.
10967 sub fetch_dell_fw_list {
10968 my $filename = shift;
10970 my $product = `dmidecode -s system-product-name`;
10972 my ($mybrand, $mymodel) = split(/\s+/, $product);
10974 print STDERR
"Finding firmware bundles for $mybrand $mymodel\n
";
10976 my $xml = XMLin($filename);
10978 for my $bundle (@{$xml-
>{SoftwareBundle}}) {
10979 my $brand = $bundle-
>{TargetSystems}-
>{Brand}-
>{Display}-
>{content};
10980 my $model = $bundle-
>{TargetSystems}-
>{Brand}-
>{Model}-
>{Display}-
>{content};
10982 if (
"ARRAY
" eq ref $bundle-
>{TargetOSes}-
>{OperatingSystem}) {
10983 $oscode = $bundle-
>{TargetOSes}-
>{OperatingSystem}[
0]-
>{osCode};
10985 $oscode = $bundle-
>{TargetOSes}-
>{OperatingSystem}-
>{osCode};
10987 if ($mybrand eq $brand
&& $mymodel eq $model
&& "LIN
" eq $oscode)
10989 @paths = map { $_-
>{path} } @{$bundle-
>{Contents}-
>{Package}};
10992 for my $component (@{$xml-
>{SoftwareComponent}}) {
10993 my $componenttype = $component-
>{ComponentType}-
>{value};
10995 # Drop application packages, only firmware and BIOS
10996 next if
'APAC
' eq $componenttype;
10998 my $cpath = $component-
>{path};
10999 for my $path (@paths) {
11000 if ($cpath =~ m%/$path$%) {
11001 push(@paths, $cpath);
11009 <p
>The code is only tested on RedHat Enterprise Linux, but I suspect
11010 it could work on other platforms with some tweaking. Anyone know a
11011 index like Catalog.xml is available from HP for HP servers? At the
11012 moment I maintain a similar list manually and it is quickly getting
11013 outdated.
</p
>
11018 <title>How is booting into runlevel
1 different from single user boots?
</title>
11019 <link>http://www.hungry.com/~pere/blog/How_is_booting_into_runlevel_1_different_from_single_user_boots_.html
</link>
11020 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_is_booting_into_runlevel_1_different_from_single_user_boots_.html
</guid>
11021 <pubDate>Thu,
4 Aug
2011 12:
40:
00 +
0200</pubDate>
11022 <description><p
>Wouter Verhelst have some
11023 <a href=
"http://grep.be/blog/en/retorts/pere_kubuntu_boot
">interesting
11024 comments and opinions
</a
> on my blog post on
11025 <a href=
"http://www.hungry.com/~pere/blog/What_should_start_from__etc_rcS_d__in_Debian____almost_nothing.html
">the
11026 need to clean up /etc/rcS.d/ in Debian
</a
> and my blog post about
11027 <a href=
"http://www.hungry.com/~pere/blog/What_is_missing_in_the_Debian_desktop__or_why_my_parents_use_Kubuntu.html
">the
11028 default KDE desktop in Debian
</a
>. I only have time to address one
11029 small piece of his comment now, and though it best to address the
11030 misunderstanding he bring forward:
</p
>
11032 <p
><blockquote
>
11033 Currently, a system admin has four options: [...] boot to a
11034 single-user system (by adding
'single
' to the kernel command line;
11035 this runs rcS and rc1 scripts)
11036 </blockquote
></p
>
11038 <p
>This make me believe Wouter believe booting into single user mode
11039 and booting into runlevel
1 is the same. I am not surprised he
11040 believe this, because it would make sense and is a quite sensible
11041 thing to believe. But because the boot in Debian is slightly broken,
11042 runlevel
1 do not work properly and it isn
't the same as single user
11043 mode. I
'll try to explain what is actually happing, but it is a bit
11044 hard to explain.
</p
>
11046 <p
>Single user mode is defined like this in /etc/inittab:
11047 "<tt
>~~:S:wait:/sbin/sulogin
</tt
>". This means the only thing that is
11048 executed in single user mode is sulogin. Single user mode is a boot
11049 state
"between
" the runlevels, and when booting into single user mode,
11050 only the scripts in /etc/rcS.d/ are executed before the init process
11051 enters the single user state. When switching to runlevel
1, the state
11052 is in fact not ending in runlevel
1, but it passes through runlevel
1
11053 and end up in the single user mode (see /etc/rc1.d/S03single, which
11054 runs
"init -t1 S
" to switch to single user mode at the end of runlevel
11055 1. It is confusing that the
'S
' (single user) init mode is not the
11056 mode enabled by /etc/rcS.d/ (which is more like the initial boot
11059 <p
>This summary might make it clearer. When booting for the first
11060 time into single user mode, the following commands are executed:
11061 "<tt
>/etc/init.d/rc S; /sbin/sulogin
</tt
>". When booting into
11062 runlevel
1, the following commands are executed:
"<tt
>/etc/init.d/rc
11063 S; /etc/init.d/rc
1; /sbin/sulogin
</tt
>". A problem show up when
11064 trying to continue after visiting single user mode. Not all services
11065 are started again as they should, causing the machine to end up in an
11066 unpredicatble state. This is why Debian admins recommend rebooting
11067 after visiting single user mode.
</p
>
11069 <p
>A similar problem with runlevel
1 is caused by the amount of
11070 scripts executed from /etc/rcS.d/. When switching from say runlevel
2
11071 to runlevel
1, the services started from /etc/rcS.d/ are not properly
11072 stopped when passing through the scripts in /etc/rc1.d/, and not
11073 started again when switching away from runlevel
1 to the runlevels
11074 2-
5. I believe the problem is best fixed by moving all the scripts
11075 out of /etc/rcS.d/ that are not
<strong
>required
</strong
> to get a
11076 functioning single user mode during boot.
</p
>
11078 <p
>I have spent several years investigating the Debian boot system,
11079 and discovered this problem a few years ago. I suspect it originates
11080 from when sysvinit was introduced into Debian, a long time ago.
</p
>
11085 <title>What should start from /etc/rcS.d/ in Debian? - almost nothing
</title>
11086 <link>http://www.hungry.com/~pere/blog/What_should_start_from__etc_rcS_d__in_Debian____almost_nothing.html
</link>
11087 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_should_start_from__etc_rcS_d__in_Debian____almost_nothing.html
</guid>
11088 <pubDate>Sat,
30 Jul
2011 14:
00:
00 +
0200</pubDate>
11089 <description><p
>In the Debian boot system, several packages include scripts that
11090 are started from /etc/rcS.d/. In fact, there is a bite more of them
11091 than make sense, and this causes a few problems. What kind of
11092 problems, you might ask. There are at least two problems. The first
11093 is that it is not possible to recover a machine after switching to
11094 runlevel
1. One need to actually reboot to get the machine back to
11095 the expected state. The other is that single user boot will sometimes
11096 run into problems because some of the subsystems are activated before
11097 the root login is presented, causing problems when trying to recover a
11098 machine from a problem in that subsystem. A minor additional point is
11099 that moving more scripts out of rcS.d/ and into the other rc#.d/
11100 directories will increase the amount of scripts that can run in
11101 parallel during boot, and thus decrease the boot time.
</p
>
11103 <p
>So, which scripts should start from rcS.d/. In short, only the
11104 scripts that _have_ to execute before the root login prompt is
11105 presented during a single user boot should go there. Everything else
11106 should go into the numeric runlevels. This means things like
11107 lm-sensors, fuse and x11-common should not run from rcS.d, but from
11108 the numeric runlevels. Today in Debian, there are around
115 init.d
11109 scripts that are started from rcS.d/, and most of them should be moved
11110 out. Do your package have one of them? Please help us make single
11111 user and runlevel
1 better by moving it.
</p
>
11113 <p
>Scripts setting up the screen, keyboard, system partitions
11114 etc. should still be started from rcS.d/, but there is for example no
11115 need to have the network enabled before the single user login prompt
11116 is presented.
</p
>
11118 <p
>As always, things are not so easy to fix as they sound. To keep
11119 Debian systems working while scripts migrate and during upgrades, the
11120 scripts need to be moved from rcS.d/ to rc2.d/ in reverse dependency
11121 order, ie the scripts that nothing in rcS.d/ depend on can be moved,
11122 and the next ones can only be moved when their dependencies have been
11123 moved first. This migration must be done sequentially while we ensure
11124 that the package system upgrade packages in the right order to keep
11125 the system state correct. This will require some coordination when it
11126 comes to network related packages, but most of the packages with
11127 scripts that should migrate do not have anything in rcS.d/ depending
11128 on them. Some packages have already been updated, like the sudo
11129 package, while others are still left to do. I wish I had time to work
11130 on this myself, but real live constrains make it unlikely that I will
11131 find time to push this forward.
</p
>
11136 <title>What is missing in the Debian desktop, or why my parents use Kubuntu
</title>
11137 <link>http://www.hungry.com/~pere/blog/What_is_missing_in_the_Debian_desktop__or_why_my_parents_use_Kubuntu.html
</link>
11138 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_is_missing_in_the_Debian_desktop__or_why_my_parents_use_Kubuntu.html
</guid>
11139 <pubDate>Fri,
29 Jul
2011 08:
10:
00 +
0200</pubDate>
11140 <description><p
>While at Debconf11, I have several times during discussions
11141 mentioned the issues I believe should be improved in Debian for its
11142 desktop to be useful for more people. The use case for this is my
11143 parents, which are currently running Kubuntu which solve the
11146 <p
>I suspect these four missing features are not very hard to
11147 implement. After all, they are present in Ubuntu, so if we wanted to
11148 do this in Debian we would have a source.
</p
>
11152 <li
><strong
>Simple GUI based upgrade of packages.
</strong
> When there
11153 are new packages available for upgrades, a icon in the KDE status bar
11154 indicate this, and clicking on it will activate the simple upgrade
11155 tool to handle it. I have no problem guiding both of my parents
11156 through the process over the phone. If a kernel reboot is required,
11157 this too is indicated by the status bars and the upgrade tool. Last
11158 time I checked, nothing with the same features was working in KDE in
11161 <li
><strong
>Simple handling of missing Firefox browser
11162 plugins.
</strong
> When the browser encounter a MIME type it do not
11163 currently have a handler for, it will ask the user if the system
11164 should search for a package that would add support for this MIME type,
11165 and if the user say yes, the APT sources will be searched for packages
11166 advertising the MIME type in their control file (visible in the
11167 Packages file in the APT archive). If one or more packages are found,
11168 it is a simple click of the mouse to add support for the missing mime
11169 type. If the package require the user to accept some non-free
11170 license, this is explained to the user. The entire process make it
11171 more clear to the user why something do not work in the browser, and
11172 make the chances higher for the user to blame the web page authors and
11173 not the browser for any missing features.
</li
>
11175 <li
><strong
>Simple handling of missing multimedia codec/format
11176 handlers.
</strong
> When the media players encounter a format or codec
11177 it is not supporting, a dialog pop up asking the user if the system
11178 should search for a package that would add support for it. This
11179 happen with things like MP3, Windows Media or H
.264. The selection
11180 and installation procedure is very similar to the Firefox browser
11181 plugin handling. This is as far as I know implemented using a
11182 gstreamer hook. The end result is that the user easily get access to
11183 the codecs that are present from the APT archives available, while
11184 explaining more on why a given format is unsupported by Ubuntu.
</li
>
11186 <li
><strong
>Better browser handling of some MIME types.
</strong
> When
11187 displaying a text/plain file in my Debian browser, it will propose to
11188 start emacs to show it. If I remember correctly, when doing the same
11189 in Kunbutu it show the file as a text file in the browser. At least I
11190 know Opera will show text files within the browser. I much prefer the
11191 latter behaviour.
</li
>
11195 <p
>There are other nice features as well, like the simplified suite
11196 upgrader, but given that I am the one mostly doing the dist-upgrade,
11197 it do not matter much.
</p
>
11199 <p
>I really hope we could get these features in place for the next
11200 Debian release. It would require the coordinated effort of several
11201 maintainers, but would make the end user experience a lot better.
</p
>
11206 <title>Perl modules used by FixMyStreet which are missing in Debian/Squeeze
</title>
11207 <link>http://www.hungry.com/~pere/blog/Perl_modules_used_by_FixMyStreet_which_are_missing_in_Debian_Squeeze.html
</link>
11208 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Perl_modules_used_by_FixMyStreet_which_are_missing_in_Debian_Squeeze.html
</guid>
11209 <pubDate>Tue,
26 Jul
2011 12:
25:
00 +
0200</pubDate>
11210 <description><p
>The Norwegian
<a href=
"http://www.fiksgatami.no/
">FiksGataMi
</A
>
11211 site is build on Debian/Squeeze, and this platform was chosen because
11212 I am most familiar with Debian (being a Debian Developer for around
10
11213 years) because it is the latest stable Debian release which should get
11214 security support for a few years.
</p
>
11216 <p
>The web service is written in Perl, and depend on some perl modules
11217 that are missing in Debian at the moment. It would be great if these
11218 modules were added to the Debian archive, allowing anyone to set up
11219 their own
<a href=
"http://www.fixmystreet.com
">FixMyStreet
</a
> clone
11220 in their own country using only Debian packages. The list of modules
11221 missing in Debian/Squeeze isn
't very long, and I hope the perl group
11222 will find time to package the
12 modules Catalyst::Plugin::SmartURI,
11223 Catalyst::Plugin::Unicode::Encoding, Catalyst::View::TT, Devel::Hide,
11224 Sort::Key, Statistics::Distributions, Template::Plugin::Comma,
11225 Template::Plugin::DateTime::Format, Term::Size::Any, Term::Size::Perl,
11226 URI::SmartURI and Web::Scraper to make the maintenance of FixMyStreet
11227 easier in the future.
</p
>
11229 <p
>Thanks to the great tools in Debian, getting the missing modules
11230 installed on my server was a simple call to
'cpan2deb Module::Name
'
11231 and
'dpkg -i
' to install the resulting package. But this leave me
11232 with the responsibility of tracking security problems, which I really
11233 do not have time for.
</p
>
11238 <title>A Norwegian FixMyStreet have kept me busy the last few weeks
</title>
11239 <link>http://www.hungry.com/~pere/blog/A_Norwegian_FixMyStreet_have_kept_me_busy_the_last_few_weeks.html
</link>
11240 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/A_Norwegian_FixMyStreet_have_kept_me_busy_the_last_few_weeks.html
</guid>
11241 <pubDate>Sun,
3 Apr
2011 22:
50:
00 +
0200</pubDate>
11242 <description><p
>Here is a small update for my English readers. Most of my blog
11243 posts have been in Norwegian the last few weeks, so here is a short
11244 update in English.
</p
>
11246 <p
>The kids still keep me too busy to get much free software work
11247 done, but I did manage to organise a project to get a Norwegian port
11248 of the British service
11249 <a href=
"http://www.fixmystreet.com/
">FixMyStreet
</a
> up and running,
11250 and it has been running for a month now. The entire project has been
11251 organised by me and two others. Around Christmas we gathered sponsors
11252 to fund the development work. In January I drafted a contract with
11253 <a href=
"http://www.mysociety.org/
">mySociety
</a
> on what to develop,
11254 and in February the development took place. Most of it involved
11255 converting the source to use GPS coordinates instead of British
11256 easting/northing, and the resulting code should be a lot easier to get
11257 running in any country by now. The Norwegian
11258 <a href=
"http://www.fiksgatami.no/
">FiksGataMi
</a
> is using
11259 <a href=
"http://www.openstreetmap.org/
">OpenStreetmap
</a
> as the map
11260 source and the source for administrative borders in Norway, and
11261 support for this had to be added/fixed.
</p
>
11263 <p
>The Norwegian version went live March
3th, and we spent the weekend
11264 polishing the system before we announced it March
7th. The system is
11265 running on a KVM instance of Debian/Squeeze, and has seen almost
3000
11266 problem reports in a few weeks. Soon we hope to announce the Android
11267 and iPhone versions making it even easier to report problems with the
11268 public infrastructure.
</p
>
11270 <p
>Perhaps something to consider for those of you in countries without
11271 such service?
</p
>
11276 <title>Using NVD and CPE to track CVEs in locally maintained software
</title>
11277 <link>http://www.hungry.com/~pere/blog/Using_NVD_and_CPE_to_track_CVEs_in_locally_maintained_software.html
</link>
11278 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Using_NVD_and_CPE_to_track_CVEs_in_locally_maintained_software.html
</guid>
11279 <pubDate>Fri,
28 Jan
2011 15:
40:
00 +
0100</pubDate>
11280 <description><p
>The last few days I have looked at ways to track open security
11281 issues here at my work with the University of Oslo. My idea is that
11282 it should be possible to use the information about security issues
11283 available on the Internet, and check our locally
11284 maintained/distributed software against this information. It should
11285 allow us to verify that no known security issues are forgotten. The
11286 CVE database listing vulnerabilities seem like a great central point,
11287 and by using the package lists from Debian mapped to CVEs provided by
11288 the testing security team, I believed it should be possible to figure
11289 out which security holes were present in our free software
11290 collection.
</p
>
11292 <p
>After reading up on the topic, it became obvious that the first
11293 building block is to be able to name software packages in a unique and
11294 consistent way across data sources. I considered several ways to do
11295 this, for example coming up with my own naming scheme like using URLs
11296 to project home pages or URLs to the Freshmeat entries, or using some
11297 existing naming scheme. And it seem like I am not the first one to
11298 come across this problem, as MITRE already proposed and implemented a
11299 solution. Enter the
<a href=
"http://cpe.mitre.org/index.html
">Common
11300 Platform Enumeration
</a
> dictionary, a vocabulary for referring to
11301 software, hardware and other platform components. The CPE ids are
11302 mapped to CVEs in the
<a href=
"http://web.nvd.nist.gov/
">National
11303 Vulnerability Database
</a
>, allowing me to look up know security
11304 issues for any CPE name. With this in place, all I need to do is to
11305 locate the CPE id for the software packages we use at the university.
11306 This is fairly trivial (I google for
'cve cpe $package
' and check the
11307 NVD entry if a CVE for the package exist).
</p
>
11309 <p
>To give you an example. The GNU gzip source package have the CPE
11310 name cpe:/a:gnu:gzip. If the old version
1.3.3 was the package to
11311 check out, one could look up
11312 <a href=
"http://web.nvd.nist.gov/view/vuln/search?cpe=cpe%
3A%
2Fa%
3Agnu%
3Agzip:
1.3.3">cpe:/a:gnu:gzip:
1.3.3
11313 in NVD
</a
> and get a list of
6 security holes with public CVE entries.
11314 The most recent one is
11315 <a href=
"http://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-
2010-
0001">CVE-
2010-
0001</a
>,
11316 and at the bottom of the NVD page for this vulnerability the complete
11317 list of affected versions is provided.
</p
>
11319 <p
>The NVD database of CVEs is also available as a XML dump, allowing
11320 for offline processing of issues. Using this dump, I
've written a
11321 small script taking a list of CPEs as input and list all CVEs
11322 affecting the packages represented by these CPEs. One give it CPEs
11323 with version numbers as specified above and get a list of open
11324 security issues out.
</p
>
11326 <p
>Of course for this approach to be useful, the quality of the NVD
11327 information need to be high. For that to happen, I believe as many as
11328 possible need to use and contribute to the NVD database. I notice
11330 <a href=
"https://www.redhat.com/security/data/metrics/rhsamapcpe.txt
">a
11331 map from CVE to CPE
</a
>, indicating that they are using the CPE
11332 information. I
'm not aware of Debian and Ubuntu doing the same.
</p
>
11334 <p
>To get an idea about the quality for free software, I spent some
11335 time making it possible to compare the CVE database from Debian with
11336 the CVE database in NVD. The result look fairly good, but there are
11337 some inconsistencies in NVD (same software package having several
11338 CPEs), and some inaccuracies (NVD not mentioning buggy packages that
11339 Debian believe are affected by a CVE). Hope to find time to improve
11340 the quality of NVD, but that require being able to get in touch with
11341 someone maintaining it. So far my three emails with questions and
11342 corrections have not seen any reply, but I hope contact can be
11343 established soon.
</p
>
11345 <p
>An interesting application for CPEs is cross platform package
11346 mapping. It would be useful to know which packages in for example
11347 RHEL, OpenSuSe and Mandriva are missing from Debian and Ubuntu, and
11348 this would be trivial if all linux distributions provided CPE entries
11349 for their packages.
</p
>
11354 <title>Which module is loaded for a given PCI and USB device?
</title>
11355 <link>http://www.hungry.com/~pere/blog/Which_module_is_loaded_for_a_given_PCI_and_USB_device_.html
</link>
11356 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Which_module_is_loaded_for_a_given_PCI_and_USB_device_.html
</guid>
11357 <pubDate>Sun,
23 Jan
2011 00:
20:
00 +
0100</pubDate>
11358 <description><p
>In the
11359 <a href=
"http://packages.qa.debian.org/discover-data
">discover-data
</a
>
11360 package in Debian, there is a script to report useful information
11361 about the running hardware for use when people report missing
11362 information. One part of this script that I find very useful when
11363 debugging hardware problems, is the part mapping loaded kernel module
11364 to the PCI device it claims. It allow me to quickly see if the kernel
11365 module I expect is driving the hardware I am struggling with. To see
11366 the output, make sure discover-data is installed and run
11367 <tt
>/usr/share/bug/discover-data
3>&1</tt
>. The relevant output on
11368 one of my machines like this:
</p
>
11372 10de:
03eb i2c_nforce2
11375 10de:
03f0 snd_hda_intel
11380 109e:
0878 snd_bt87x
11384 <p
>The code in question look like this, slightly modified for
11385 readability and to drop the output to file descriptor
3:
</p
>
11388 if [ -d /sys/bus/pci/devices/ ] ; then
11389 echo loaded pci modules:
11391 cd /sys/bus/pci/devices/
11392 for address in * ; do
11393 if [ -d
"$address/driver/module
" ] ; then
11394 module=`cd $address/driver/module ; pwd -P | xargs basename`
11395 if grep -q
"^$module
" /proc/modules ; then
11396 address=$(echo $address |sed s/
0000://)
11397 id=`lspci -n -s $address | tail -n
1 | awk
'{print $
3}
'`
11398 echo
"$id $module
"
11407 <p
>Similar code could be used to extract USB device module
11408 mappings:
</p
>
11411 if [ -d /sys/bus/usb/devices/ ] ; then
11412 echo loaded usb modules:
11414 cd /sys/bus/usb/devices/
11415 for address in * ; do
11416 if [ -d
"$address/driver/module
" ] ; then
11417 module=`cd $address/driver/module ; pwd -P | xargs basename`
11418 if grep -q
"^$module
" /proc/modules ; then
11419 address=$(echo $address |sed s/
0000://)
11420 id=$(lsusb -s $address | tail -n
1 | awk
'{print $
6}
')
11421 if [
"$id
" ] ; then
11422 echo
"$id $module
"
11432 <p
>This might perhaps be something to include in other tools as
11438 <title>How to test if a laptop is working with Linux
</title>
11439 <link>http://www.hungry.com/~pere/blog/How_to_test_if_a_laptop_is_working_with_Linux.html
</link>
11440 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/How_to_test_if_a_laptop_is_working_with_Linux.html
</guid>
11441 <pubDate>Wed,
22 Dec
2010 14:
55:
00 +
0100</pubDate>
11442 <description><p
>The last few days I have spent at work here at the
<a
11443 href=
"http://www.uio.no/
">University of Oslo
</a
> testing if the new
11444 batch of computers will work with Linux. Every year for the last few
11445 years the university have organised shared bid of a few thousand
11446 computers, and this year HP won the bid. Two different desktops and
11447 five different laptops are on the list this year. We in the UNIX
11448 group want to know which one of these computers work well with RHEL
11449 and Ubuntu, the two Linux distributions we currently handle at the
11450 university.
</p
>
11452 <p
>My test method is simple, and I share it here to get feedback and
11453 perhaps inspire others to test hardware as well. To test, I PXE
11454 install the OS version of choice, and log in as my normal user and run
11455 a few applications and plug in selected pieces of hardware. When
11456 something fail, I make a note about this in the test matrix and move
11457 on. If I have some spare time I try to report the bug to the OS
11458 vendor, but as I only have the machines for a short time, I rarely
11459 have the time to do this for all the problems I find.
</p
>
11461 <p
>Anyway, to get to the point of this post. Here is the simple tests
11462 I perform on a new model.
</p
>
11466 <li
>Is PXE installation working? I
'm testing with RHEL6, Ubuntu Lucid
11467 and Ubuntu Maverik at the moment. If I feel like it, I also test with
11468 RHEL5 and Debian Edu/Squeeze.
</li
>
11470 <li
>Is X.org working? If the graphical login screen show up after
11471 installation, X.org is working.
</li
>
11473 <li
>Is hardware accelerated OpenGL working? Running glxgears (in
11474 package mesa-utils on Ubuntu) and writing down the frames per second
11475 reported by the program.
</li
>
11477 <li
>Is sound working? With Gnome and KDE, a sound is played when
11478 logging in, and if I can hear this the test is successful. If there
11479 are several audio exits on the machine, I try them all and check if
11480 the Gnome/KDE audio mixer can control where to send the sound. I
11481 normally test this by playing
11482 <a href=
"http://www.nuug.no/aktiviteter/
20101012-chef/
">a HTML5
11483 video
</a
> in Firefox/Iceweasel.
</li
>
11485 <li
>Is the USB subsystem working? I test this by plugging in a USB
11486 memory stick and see if Gnome/KDE notices this.
</li
>
11488 <li
>Is the CD/DVD player working? I test this by inserting any CD/DVD
11489 I have lying around, and see if Gnome/KDE notices this.
</li
>
11491 <li
>Is any built in camera working? Test using cheese, and see if a
11492 picture from the v4l device show up.
</li
>
11494 <li
>Is bluetooth working? Use the Gnome/KDE browsing tool to see if
11495 any bluetooth devices are discovered. In my office, I normally see a
11498 <li
>For laptops, is the SD or Compaq Flash reader working. I have
11499 memory modules lying around, and stick them in and see if Gnome/KDE
11500 notice this.
</li
>
11502 <li
>For laptops, is suspend/hibernate working? I
'm testing if the
11503 special button work, and if the laptop continue to work after
11506 <li
>For laptops, is the extra buttons working, like audio level,
11507 adjusting background light, switching on/off external video output,
11508 switching on/off wifi, bluetooth, etc? The set of buttons differ from
11509 laptop to laptop, so I just write down which are working and which are
11512 <li
>Some laptops have smart card readers, finger print readers,
11513 acceleration sensors etc. I rarely test these, as I do not know how
11514 to quickly test if they are working or not, so I only document their
11515 existence.
</li
>
11519 <p
>By now I suspect you are really curious what the test results are
11520 for the HP machines I am testing. I
'm not done yet, so I will report
11521 the test results later. For now I can report that HP
8100 Elite work
11522 fine, and hibernation fail with HP EliteBook
8440p on Ubuntu Lucid,
11523 and audio fail on RHEL6. Ubuntu Maverik worked with
8440p. As you
11524 can see, I have most machines left to test. One interesting
11525 observation is that Ubuntu Lucid has almost twice the frame rate than
11526 RHEL6 with glxgears. No idea why.
</p
>
11531 <title>Some thoughts on BitCoins
</title>
11532 <link>http://www.hungry.com/~pere/blog/Some_thoughts_on_BitCoins.html
</link>
11533 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Some_thoughts_on_BitCoins.html
</guid>
11534 <pubDate>Sat,
11 Dec
2010 15:
10:
00 +
0100</pubDate>
11535 <description><p
>As I continue to explore
11536 <a href=
"http://www.bitcoin.org/
">BitCoin
</a
>, I
've starting to wonder
11537 what properties the system have, and how it will be affected by laws
11538 and regulations here in Norway. Here are some random notes.
</p
>
11540 <p
>One interesting thing to note is that since the transactions are
11541 verified using a peer to peer network, all details about a transaction
11542 is known to everyone. This means that if a BitCoin address has been
11543 published like I did with mine in my initial post about BitCoin, it is
11544 possible for everyone to see how many BitCoins have been transfered to
11545 that address. There is even a web service to look at the details for
11546 all transactions. There I can see that my address
11547 <a href=
"http://blockexplorer.com/address/
15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a
>
11548 have received
16.06 Bitcoin, the
11549 <a href=
"http://blockexplorer.com/address/
1LfdGnGuWkpSJgbQySxxCWhv
8MHqvwst
3">1LfdGnGuWkpSJgbQySxxCWhv
8MHqvwst
3</a
>
11550 address of Simon Phipps have received
181.97 BitCoin and the address
11551 <a href=
"http://blockexplorer.com/address/
1MCwBbhNGp5hRm5rC1Aims2YFRe2SXPYKt
">1MCwBbhNGp5hRm5rC1Aims2YFRe2SXPYKt
</A
>
11552 of EFF have received
2447.38 BitCoins so far. Thank you to each and
11553 every one of you that donated bitcoins to support my activity. The
11554 fact that anyone can see how much money was transfered to a given
11555 address make it more obvious why the BitCoin community recommend to
11556 generate and hand out a new address for each transaction. I
'm told
11557 there is no way to track which addresses belong to a given person or
11558 organisation without the person or organisation revealing it
11559 themselves, as Simon, EFF and I have done.
</p
>
11561 <p
>In Norway, and in most other countries, there are laws and
11562 regulations limiting how much money one can transfer across the border
11563 without declaring it. There are money laundering, tax and accounting
11564 laws and regulations I would expect to apply to the use of BitCoin.
11565 If the Skolelinux foundation
11566 (
<a href=
"http://linuxiskolen.no/slxdebianlabs/donations.html
">SLX
11567 Debian Labs
</a
>) were to accept donations in BitCoin in addition to
11568 normal bank transfers like EFF is doing, how should this be accounted?
11569 Given that it is impossible to know if money can cross the border or
11570 not, should everything or nothing be declared? What exchange rate
11571 should be used when calculating taxes? Would receivers have to pay
11572 income tax if the foundation were to pay Skolelinux contributors in
11573 BitCoin? I have no idea, but it would be interesting to know.
</p
>
11575 <p
>For a currency to be useful and successful, it must be trusted and
11576 accepted by a lot of users. It must be possible to get easy access to
11577 the currency (as a wage or using currency exchanges), and it must be
11578 easy to spend it. At the moment BitCoin seem fairly easy to get
11579 access to, but there are very few places to spend it. I am not really
11580 a regular user of any of the vendor types currently accepting BitCoin,
11581 so I wonder when my kind of shop would start accepting BitCoins. I
11582 would like to buy electronics, travels and subway tickets, not herbs
11583 and books. :) The currency is young, and this will improve over time
11584 if it become popular, but I suspect regular banks will start to lobby
11585 to get BitCoin declared illegal if it become popular. I
'm sure they
11586 will claim it is helping fund terrorism and money laundering (which
11587 probably would be true, as is any currency in existence), but I
11588 believe the problems should be solved elsewhere and not by blaming
11589 currencies.
</p
>
11591 <p
>The process of creating new BitCoins is called mining, and it is
11592 CPU intensive process that depend on a bit of luck as well (as one is
11593 competing against all the other miners currently spending CPU cycles
11594 to see which one get the next lump of cash). The
"winner
" get
50
11595 BitCoin when this happen. Yesterday I came across the obvious way to
11596 join forces to increase ones changes of getting at least some coins,
11597 by coordinating the work on mining BitCoins across several machines
11598 and people, and sharing the result if one is lucky and get the
50
11599 BitCoins. Check out
11600 <a href=
"http://www.bluishcoder.co.nz/bitcoin-pool/
">BitCoin Pool
</a
>
11601 if this sounds interesting. I have not had time to try to set up a
11602 machine to participate there yet, but have seen that running on ones
11603 own for a few days have not yield any BitCoins througth mining
11606 <p
>Update
2010-
12-
15: Found an
<a
11607 href=
"http://inertia.posterous.com/reply-to-the-underground-economist-why-bitcoi
">interesting
11608 criticism
</a
> of bitcoin. Not quite sure how valid it is, but thought
11609 it was interesting to read. The arguments presented seem to be
11610 equally valid for gold, which was used as a currency for many years.
</p
>
11615 <title>Now accepting bitcoins - anonymous and distributed p2p crypto-money
</title>
11616 <link>http://www.hungry.com/~pere/blog/Now_accepting_bitcoins___anonymous_and_distributed_p2p_crypto_money.html
</link>
11617 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Now_accepting_bitcoins___anonymous_and_distributed_p2p_crypto_money.html
</guid>
11618 <pubDate>Fri,
10 Dec
2010 08:
20:
00 +
0100</pubDate>
11619 <description><p
>With this weeks lawless
11620 <a href=
"http://www.salon.com/news/opinion/glenn_greenwald/
2010/
12/
06/wikileaks/index.html
">governmental
11621 attacks
</a
> on Wikileak and
11622 <a href=
"http://www.salon.com/technology/dan_gillmor/
2010/
12/
06/war_on_speech
">free
11623 speech
</a
>, it has become obvious that PayPal, visa and mastercard can
11624 not be trusted to handle money transactions.
11626 <a href=
"http://webmink.com/
2010/
12/
06/now-accepting-bitcoin/
">Simon
11627 Phipps on bitcoin
</a
> reminded me about a project that a friend of
11628 mine mentioned earlier. I decided to follow Simon
's example, and get
11629 involved with
<a href=
"http://www.bitcoin.org/
">BitCoin
</a
>. I got
11630 some help from my friend to get it all running, and he even handed me
11631 some bitcoins to get started. I even donated a few bitcoins to Simon
11632 for helping me remember BitCoin.
</p
>
11634 <p
>So, what is bitcoins, you probably wonder? It is a digital
11635 crypto-currency, decentralised and handled using peer-to-peer
11636 networks. It allows anonymous transactions and prohibits central
11637 control over the transactions, making it impossible for governments
11638 and companies alike to block donations and other transactions. The
11639 source is free software, and while the key dependency wxWidgets
2.9
11640 for the graphical user interface is missing in Debian, the command
11641 line client builds just fine. Hopefully Jonas
11642 <a href=
"http://bugs.debian.org/
578157">will get the package into
11643 Debian
</a
> soon.
</p
>
11645 <p
>Bitcoins can be converted to other currencies, like USD and EUR.
11646 There are
<a href=
"http://www.bitcoin.org/trade
">companies accepting
11647 bitcoins
</a
> when selling services and goods, and there are even
11648 currency
"stock
" markets where the exchange rate is decided. There
11649 are not many users so far, but the concept seems promising. If you
11650 want to get started and lack a friend with any bitcoins to spare,
11652 <a href=
"https://freebitcoins.appspot.com/
">some for free
</a
> (
0.05
11653 bitcoin at the time of writing). Use
11654 <a href=
"http://www.bitcoinwatch.com/
">BitcoinWatch
</a
> to keep an eye
11655 on the current exchange rates.
</p
>
11657 <p
>As an experiment, I have decided to set up bitcoind on one of my
11658 machines. If you want to support my activity, please send Bitcoin
11659 donations to the address
11660 <b
>15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</b
>. Thank you!
</p
>
11665 <title>Why isn
't Debian Edu using VLC?
</title>
11666 <link>http://www.hungry.com/~pere/blog/Why_isn_t_Debian_Edu_using_VLC_.html
</link>
11667 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Why_isn_t_Debian_Edu_using_VLC_.html
</guid>
11668 <pubDate>Sat,
27 Nov
2010 11:
30:
00 +
0100</pubDate>
11669 <description><p
>In the latest issue of Linux Journal, the readers choices were
11670 presented, and the winner among the multimedia player were VLC.
11671 Personally, I like VLC, and it is my player of choice when I first try
11672 to play a video file or stream. Only if VLC fail will I drag out
11673 gmplayer to see if it can do better. The reason is mostly the failure
11674 model and trust. When VLC fail, it normally pop up a error message
11675 reporting the problem. When mplayer fail, it normally segfault or
11676 just hangs. The latter failure mode drain my trust in the program.
<p
>
11678 <p
>But even if VLC is my player of choice, we have choosen to use
11679 mplayer in
<a href=
"http://www.skolelinux.org/
">Debian
11680 Edu/Skolelinux
</a
>. The reason is simple. We need a good browser
11681 plugin to play web videos seamlessly, and the VLC browser plugin is
11682 not very good. For example, it lack in-line control buttons, so there
11683 is no way for the user to pause the video. Also, when I
11684 <a href=
"http://wiki.debian.org/DebianEdu/BrowserMultimedia
">last
11685 tested the browser plugins
</a
> available in Debian, the VLC plugin
11686 failed on several video pages where mplayer based plugins worked. If
11687 the browser plugin for VLC was as good as the gecko-mediaplayer
11688 package (which uses mplayer), we would switch.
</P
>
11690 <p
>While VLC is a good player, its user interface is slightly
11691 annoying. The most annoying feature is its inconsistent use of
11692 keyboard shortcuts. When the player is in full screen mode, its
11693 shortcuts are different from when it is playing the video in a window.
11694 For example, space only work as pause when in full screen mode. I
11695 wish it had consisten shortcuts and that space also would work when in
11696 window mode. Another nice shortcut in gmplayer is [enter] to restart
11697 the current video. It is very nice when playing short videos from the
11698 web and want to restart it when new people arrive to have a look at
11699 what is going on.
</p
>
11704 <title>Lenny-
>Squeeze upgrades of the Gnome and KDE desktop, now with apt-get autoremove
</title>
11705 <link>http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades_of_the_Gnome_and_KDE_desktop__now_with_apt_get_autoremove.html
</link>
11706 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades_of_the_Gnome_and_KDE_desktop__now_with_apt_get_autoremove.html
</guid>
11707 <pubDate>Mon,
22 Nov
2010 14:
15:
00 +
0100</pubDate>
11708 <description><p
>Michael Biebl suggested to me on IRC, that I changed my automated
11709 upgrade testing of the
11710 <a href=
"https://people.skolelinux.org/~pere/debian-upgrade-testing/
">Lenny
11711 Gnome and KDE Desktop
</a
> to do
<tt
>apt-get autoremove
</tt
> when using apt-get.
11712 This seem like a very good idea, so I adjusted by test scripts and
11713 can now present the updated result from today:
</p
>
11715 <p
>This is for Gnome:
</p
>
11717 <p
>Installed using apt-get, missing with aptitude
</p
>
11719 <blockquote
><p
>
11724 browser-plugin-gnash
11731 freedesktop-sound-theme
11733 gconf-defaults-service
11746 gnome-codec-install
11748 gnome-desktop-environment
11752 gnome-session-canberra
11754 gnome-themes-extras
11757 gstreamer0.10-fluendo-mp3
11758 gstreamer0.10-tools
11760 gtk2-engines-pixbuf
11761 gtk2-engines-smooth
11763 libapache2-mod-dnssd
11766 libaprutil1-dbd-sqlite3
11769 libboost-date-time1.42
.0
11770 libboost-python1.42
.0
11771 libboost-thread1.42
.0
11773 libchamplain-gtk-
0.4-
0
11775 libclutter-gtk-
0.10-
0
11782 libfreerdp-plugins-standard
11795 libgnome-vfs2.0-cil
11797 libgnomepanel2.24-cil
11802 libgtksourceview2.0-common
11803 libmono-addins-gui0.2-cil
11804 libmono-addins0.2-cil
11805 libmono-cairo2.0-cil
11806 libmono-corlib2.0-cil
11807 libmono-i18n-west2.0-cil
11808 libmono-posix2.0-cil
11809 libmono-security2.0-cil
11810 libmono-sharpzip2.84-cil
11811 libmono-system2.0-cil
11814 libndesk-dbus-glib1.0-cil
11815 libndesk-dbus1.0-cil
11825 libtelepathy-farsight0
11834 nautilus-sendto-empathy
11838 python-aptdaemon-gtk
11840 python-beautifulsoup
11855 python-gtksourceview2
11866 python-pkg-resources
11873 python-twisted-conch
11874 python-twisted-core
11879 python-zope.interface
11881 remmina-plugin-data
11884 rhythmbox-plugin-cdrecorder
11891 system-config-printer-udev
11893 telepathy-mission-control-
5
11900 transmission-common
11904 </p
></blockquote
>
11906 <p
>Installed using apt-get, removed with aptitude
</p
>
11908 <blockquote
><p
>
11912 epiphany-extensions
11914 fast-user-switch-applet
11933 libgtksourceview2.0-
0
11935 libsdl1.2debian-alsa
11941 system-config-printer
11946 </p
></blockquote
>
11948 <p
>Installed using aptitude, missing with apt-get
</p
>
11950 <blockquote
><p
>
11951 gstreamer0.10-gnomevfs
11952 </p
></blockquote
>
11954 <p
>Installed using aptitude, removed with apt-get
</p
>
11956 <blockquote
><p
>
11958 </p
></blockquote
>
11960 <p
>This is for KDE:
</p
>
11962 <p
>Installed using apt-get, missing with aptitude
</p
>
11964 <blockquote
><p
>
11966 </p
></blockquote
>
11968 <p
>Installed using apt-get, removed with aptitude
</p
>
11970 <blockquote
><p
>
11972 network-manager-kde
11973 </p
></blockquote
>
11975 <p
>Installed using aptitude, missing with apt-get
</p
>
11977 <blockquote
><p
>
11991 kdeartwork-emoticons
11993 kdeartwork-theme-icon
11997 kdebase-workspace-bin
11998 kdebase-workspace-data
12010 konqueror-nsplugins
12012 kscreensaver-xsavers
12027 plasma-dataengines-workspace
12029 plasma-desktopthemes-artwork
12030 plasma-runners-addons
12031 plasma-scriptengine-googlegadgets
12032 plasma-scriptengine-python
12033 plasma-scriptengine-qedje
12034 plasma-scriptengine-ruby
12035 plasma-scriptengine-webkit
12036 plasma-scriptengines
12037 plasma-wallpapers-addons
12038 plasma-widget-folderview
12039 plasma-widget-networkmanagement
12042 update-notifier-kde
12043 xscreensaver-data-extra
12045 xscreensaver-gl-extra
12046 xscreensaver-screensaver-bsod
12047 </p
></blockquote
>
12049 <p
>Installed using aptitude, removed with apt-get
</p
>
12051 <blockquote
><p
>
12053 google-gadgets-common
12071 libggadget-qt-
1.0-
0b
12076 libkonqsidebarplugin4a
12080 libkunitconversion4
12085 libplasma-geolocation-interface4
12087 libplasmagenericshell4
12101 libsmokeknewstuff2-
3
12102 libsmokeknewstuff3-
3
12104 libsmokektexteditor3
12112 libsmokeqtnetwork4-
3
12113 libsmokeqtopengl4-
3
12114 libsmokeqtscript4-
3
12118 libsmokeqtuitools4-
3
12119 libsmokeqtwebkit4-
3
12130 plasma-dataengines-addons
12131 plasma-scriptengine-superkaramba
12132 plasma-widget-lancelot
12133 plasma-widgets-addons
12134 plasma-widgets-workspace
12138 update-notifier-common
12139 </p
></blockquote
>
12141 <p
>Running apt-get autoremove made the results using apt-get and
12142 aptitude a bit more similar, but there are still quite a lott of
12143 differences. I have no idea what packages should be installed after
12144 the upgrade, but hope those that do can have a look.
</p
>
12149 <title>Migrating Xen virtual machines using LVM to KVM using disk images
</title>
12150 <link>http://www.hungry.com/~pere/blog/Migrating_Xen_virtual_machines_using_LVM_to_KVM_using_disk_images.html
</link>
12151 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Migrating_Xen_virtual_machines_using_LVM_to_KVM_using_disk_images.html
</guid>
12152 <pubDate>Mon,
22 Nov
2010 11:
20:
00 +
0100</pubDate>
12153 <description><p
>Most of the computers in use by the
12154 <a href=
"http://www.skolelinux.org/
">Debian Edu/Skolelinux project
</a
>
12155 are virtual machines. And they have been Xen machines running on a
12156 fairly old IBM eserver xseries
345 machine, and we wanted to migrate
12157 them to KVM on a newer Dell PowerEdge
2950 host machine. This was a
12158 bit harder that it could have been, because we set up the Xen virtual
12159 machines to get the virtual partitions from LVM, which as far as I
12160 know is not supported by KVM. So to migrate, we had to convert
12161 several LVM logical volumes to partitions on a virtual disk file.
</p
>
12164 <a href=
"http://searchnetworking.techtarget.com.au/articles/
35011-Six-steps-for-migrating-Xen-virtual-machines-to-KVM
">a
12165 nice recipe
</a
> to do this, and wrote the following script to do the
12166 migration. It uses qemu-img from the qemu package to make the disk
12167 image, parted to partition it, losetup and kpartx to present the disk
12168 image partions as devices, and dd to copy the data. I NFS mounted the
12169 new servers storage area on the old server to do the migration.
</p
>
12175 # http://searchnetworking.techtarget.com.au/articles/
35011-Six-steps-for-migrating-Xen-virtual-machines-to-KVM
12180 if [ -z
"$
1" ] ; then
12181 echo
"Usage: $
0 &lt;hostname
&gt;
"
12184 host=
"$
1"
12187 if [ ! -e /dev/vg_data/$host-disk ] ; then
12188 echo
"error: unable to find LVM volume for $host
"
12192 # Partitions need to be a bit bigger than the LVM LVs. not sure why.
12193 disksize=$( lvs --units m | grep $host-disk | awk
'{sum = sum + $
4} END { print int(sum *
1.05) }
')
12194 swapsize=$( lvs --units m | grep $host-swap | awk
'{sum = sum + $
4} END { print int(sum *
1.05) }
')
12195 totalsize=$(( ( $disksize + $swapsize ) ))
12198 #dd if=/dev/zero of=$img bs=
1M count=$(( $disksize + $swapsize ))
12199 qemu-img create $img ${totalsize}MMaking room on the Debian Edu/Sqeeze DVD
12201 parted $img mklabel msdos
12202 parted $img mkpart primary linux-swap
0 $disksize
12203 parted $img mkpart primary ext2 $disksize $totalsize
12204 parted $img set
1 boot on
12207 losetup /dev/loop0 $img
12208 kpartx -a /dev/loop0
12210 dd if=/dev/vg_data/$host-disk of=/dev/mapper/loop0p1 bs=
1M
12211 fsck.ext3 -f /dev/mapper/loop0p1 || true
12212 mkswap /dev/mapper/loop0p2
12214 kpartx -d /dev/loop0
12215 losetup -d /dev/loop0
12218 <p
>The script is perhaps so simple that it is not copyrightable, but
12219 if it is, it is licenced using GPL v2 or later at your discretion.
</p
>
12221 <p
>After doing this, I booted a Debian CD in rescue mode in KVM with
12222 the new disk image attached, installed grub-pc and linux-image-
686 and
12223 set up grub to boot from the disk image. After this, the KVM machines
12224 seem to work just fine.
</p
>
12229 <title>Lenny-
>Squeeze upgrades, apt vs aptitude with the Gnome and KDE desktop
</title>
12230 <link>http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades__apt_vs_aptitude_with_the_Gnome_and_KDE_desktop.html
</link>
12231 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades__apt_vs_aptitude_with_the_Gnome_and_KDE_desktop.html
</guid>
12232 <pubDate>Sat,
20 Nov
2010 22:
50:
00 +
0100</pubDate>
12233 <description><p
>I
'm still running upgrade testing of the
12234 <a href=
"https://people.skolelinux.org/~pere/debian-upgrade-testing/
">Lenny
12235 Gnome and KDE Desktop
</a
>, but have not had time to spend on reporting the
12236 status. Here is a short update based on a test I ran
20101118.
</p
>
12238 <p
>I still do not know what a correct migration should look like, so I
12239 report any differences between apt and aptitude and hope someone else
12240 can see if anything should be changed.
</p
>
12242 <p
>This is for Gnome:
</p
>
12244 <p
>Installed using apt-get, missing with aptitude
</p
>
12246 <blockquote
><p
>
12247 apache2.2-bin aptdaemon at-spi baobab binfmt-support
12248 browser-plugin-gnash cheese-common cli-common cpp-
4.3 cups-pk-helper
12249 dmz-cursor-theme empathy empathy-common finger
12250 freedesktop-sound-theme freeglut3 gconf-defaults-service gdm-themes
12251 gedit-plugins geoclue geoclue-hostip geoclue-localnet geoclue-manual
12252 geoclue-yahoo gnash gnash-common gnome gnome-backgrounds
12253 gnome-cards-data gnome-codec-install gnome-core
12254 gnome-desktop-environment gnome-disk-utility gnome-screenshot
12255 gnome-search-tool gnome-session-canberra gnome-spell
12256 gnome-system-log gnome-themes-extras gnome-themes-more
12257 gnome-user-share gs-common gstreamer0.10-fluendo-mp3
12258 gstreamer0.10-tools gtk2-engines gtk2-engines-pixbuf
12259 gtk2-engines-smooth hal-info hamster-applet libapache2-mod-dnssd
12260 libapr1 libaprutil1 libaprutil1-dbd-sqlite3 libaprutil1-ldap
12261 libart2.0-cil libatspi1.0-
0 libboost-date-time1.42
.0
12262 libboost-python1.42
.0 libboost-thread1.42
.0 libchamplain-
0.4-
0
12263 libchamplain-gtk-
0.4-
0 libcheese-gtk18 libclutter-gtk-
0.10-
0
12264 libcryptui0 libcupsys2 libdiscid0 libeel2-data libelf1 libepc-
1.0-
2
12265 libepc-common libepc-ui-
1.0-
2 libfreerdp-plugins-standard
12266 libfreerdp0 libgail-common libgconf2.0-cil libgdata-common libgdata7
12267 libgdl-
1-common libgdu-gtk0 libgee2 libgeoclue0 libgexiv2-
0 libgif4
12268 libglade2.0-cil libglib2.0-cil libgmime2.4-cil libgnome-vfs2.0-cil
12269 libgnome2.24-cil libgnomepanel2.24-cil libgnomeprint2.2-data
12270 libgnomeprintui2.2-common libgnomevfs2-bin libgpod-common libgpod4
12271 libgtk2.0-cil libgtkglext1 libgtksourceview-common
12272 libgtksourceview2.0-common libmono-addins-gui0.2-cil
12273 libmono-addins0.2-cil libmono-cairo2.0-cil libmono-corlib2.0-cil
12274 libmono-i18n-west2.0-cil libmono-posix2.0-cil
12275 libmono-security2.0-cil libmono-sharpzip2.84-cil
12276 libmono-system2.0-cil libmtp8 libmusicbrainz3-
6
12277 libndesk-dbus-glib1.0-cil libndesk-dbus1.0-cil libopal3.6
.8
12278 libpolkit-gtk-
1-
0 libpt-
1.10.10-plugins-alsa
12279 libpt-
1.10.10-plugins-v4l libpt2.6
.7 libpython2.6 librpm1 librpmio1
12280 libsdl1.2debian libservlet2.4-java libsrtp0 libssh-
4
12281 libtelepathy-farsight0 libtelepathy-glib0 libtidy-
0.99-
0
12282 libxalan2-java libxerces2-java media-player-info mesa-utils
12283 mono-
2.0-gac mono-gac mono-runtime nautilus-sendto
12284 nautilus-sendto-empathy openoffice.org-writer2latex
12285 openssl-blacklist p7zip p7zip-full pkg-config python-
4suite-xml
12286 python-aptdaemon python-aptdaemon-gtk python-axiom
12287 python-beautifulsoup python-bugbuddy python-clientform
12288 python-coherence python-configobj python-crypto python-cupshelpers
12289 python-cupsutils python-eggtrayicon python-elementtree
12290 python-epsilon python-evolution python-feedparser python-gdata
12291 python-gdbm python-gst0.10 python-gtkglext1 python-gtkmozembed
12292 python-gtksourceview2 python-httplib2 python-louie python-mako
12293 python-markupsafe python-mechanize python-nevow python-notify
12294 python-opengl python-openssl python-pam python-pkg-resources
12295 python-pyasn1 python-pysqlite2 python-rdflib python-serial
12296 python-tagpy python-twisted-bin python-twisted-conch
12297 python-twisted-core python-twisted-web python-utidylib python-webkit
12298 python-xdg python-zope.interface remmina remmina-plugin-data
12299 remmina-plugin-rdp remmina-plugin-vnc rhythmbox-plugin-cdrecorder
12300 rhythmbox-plugins rpm-common rpm2cpio seahorse-plugins shotwell
12301 software-center svgalibg1 system-config-printer-udev
12302 telepathy-gabble telepathy-mission-control-
5 telepathy-salut tomboy
12303 totem totem-coherence totem-mozilla totem-plugins
12304 transmission-common xdg-user-dirs xdg-user-dirs-gtk xserver-xephyr
12306 </p
></blockquote
>
12308 Installed using apt-get, removed with aptitude
12310 <blockquote
><p
>
12311 arj bluez-utils cheese dhcdbd djvulibre-desktop ekiga eog
12312 epiphany-extensions epiphany-gecko evolution-exchange
12313 fast-user-switch-applet file-roller gcalctool gconf-editor gdm gedit
12314 gedit-common gnome-app-install gnome-games gnome-games-data
12315 gnome-nettool gnome-system-tools gnome-themes gnome-utils
12316 gnome-vfs-obexftp gnome-volume-manager gnuchess gucharmap
12317 guile-
1.8-libs hal libavahi-compat-libdnssd1 libavahi-core5
12318 libavahi-ui0 libbind9-
50 libbluetooth2 libcamel1.2-
11 libcdio7
12319 libcucul0 libcurl3 libdirectfb-
1.0-
0 libdmx1 libdvdread3
12320 libedata-cal1.2-
6 libedataserver1.2-
9 libeel2-
2.20 libepc-
1.0-
1
12321 libepc-ui-
1.0-
1 libexchange-storage1.2-
3 libfaad0 libgadu3
12322 libgalago3 libgd2-noxpm libgda3-
3 libgda3-common libggz2 libggzcore9
12323 libggzmod4 libgksu1.2-
0 libgksuui1.0-
1 libgmyth0 libgnome-desktop-
2
12324 libgnome-pilot2 libgnomecups1.0-
1 libgnomeprint2.2-
0
12325 libgnomeprintui2.2-
0 libgpod3 libgraphviz4 libgtk-vnc-
1.0-
0
12326 libgtkhtml2-
0 libgtksourceview1.0-
0 libgtksourceview2.0-
0
12327 libgucharmap6 libhesiod0 libicu38 libisccc50 libisccfg50 libiw29
12328 libjaxp1.3-java-gcj libkpathsea4 liblircclient0 libltdl3 liblwres50
12329 libmagick++
10 libmagick10 libmalaga7 libmozjs1d libmpfr1ldbl libmtp7
12330 libmysqlclient15off libnautilus-burn4 libneon27 libnm-glib0
12331 libnm-util0 libopal-
2.2 libosp5 libparted1.8-
10 libpisock9
12332 libpisync1 libpoppler-glib3 libpoppler3 libpt-
1.10.10 libraw1394-
8
12333 libsdl1.2debian-alsa libsensors3 libsexy2 libsmbios2 libsoup2.2-
8
12334 libspeexdsp1 libssh2-
1 libsuitesparse-
3.1.0 libsvga1
12335 libswfdec-
0.6-
90 libtalloc1 libtotem-plparser10 libtrackerclient0
12336 libvoikko1 libxalan2-java-gcj libxerces2-java-gcj libxklavier12
12337 libxtrap6 libxxf86misc1 libzephyr3 mysql-common rhythmbox seahorse
12338 sound-juicer swfdec-gnome system-config-printer totem-common
12339 totem-gstreamer transmission-gtk vinagre vino w3c-dtd-xhtml wodim
12340 </p
></blockquote
>
12342 <p
>Installed using aptitude, missing with apt-get
</p
>
12344 <blockquote
><p
>
12345 gstreamer0.10-gnomevfs
12346 </p
></blockquote
>
12348 <p
>Installed using aptitude, removed with apt-get
</p
>
12350 <blockquote
><p
>
12352 </p
></blockquote
>
12354 <p
>This is for KDE:
</p
>
12356 <p
>Installed using apt-get, missing with aptitude
</p
>
12358 <blockquote
><p
>
12359 autopoint bomber bovo cantor cantor-backend-kalgebra cpp-
4.3 dcoprss
12360 edict espeak espeak-data eyesapplet fifteenapplet finger gettext
12361 ghostscript-x git gnome-audio gnugo granatier gs-common
12362 gstreamer0.10-pulseaudio indi kaddressbook-plugins kalgebra
12363 kalzium-data kanjidic kapman kate-plugins kblocks kbreakout kbstate
12364 kde-icons-mono kdeaccessibility kdeaddons-kfile-plugins
12365 kdeadmin-kfile-plugins kdeartwork-misc kdeartwork-theme-window
12366 kdeedu kdeedu-data kdeedu-kvtml-data kdegames kdegames-card-data
12367 kdegames-mahjongg-data kdegraphics-kfile-plugins kdelirc
12368 kdemultimedia-kfile-plugins kdenetwork-kfile-plugins
12369 kdepim-kfile-plugins kdepim-kio-plugins kdessh kdetoys kdewebdev
12370 kdiamond kdnssd kfilereplace kfourinline kgeography-data kigo
12371 killbots kiriki klettres-data kmoon kmrml knewsticker-scripts
12372 kollision kpf krosspython ksirk ksmserver ksquares kstars-data
12373 ksudoku kubrick kweather libasound2-plugins libboost-python1.42
.0
12374 libcfitsio3 libconvert-binhex-perl libcrypt-ssleay-perl libdb4.6++
12375 libdjvulibre-text libdotconf1.0 liberror-perl libespeak1
12376 libfinance-quote-perl libgail-common libgsl0ldbl libhtml-parser-perl
12377 libhtml-tableextract-perl libhtml-tagset-perl libhtml-tree-perl
12378 libio-stringy-perl libkdeedu4 libkdegames5 libkiten4 libkpathsea5
12379 libkrossui4 libmailtools-perl libmime-tools-perl
12380 libnews-nntpclient-perl libopenbabel3 libportaudio2 libpulse-browse0
12381 libservlet2.4-java libspeechd2 libtiff-tools libtimedate-perl
12382 libunistring0 liburi-perl libwww-perl libxalan2-java libxerces2-java
12383 lirc luatex marble networkstatus noatun-plugins
12384 openoffice.org-writer2latex palapeli palapeli-data parley
12385 parley-data poster psutils pulseaudio pulseaudio-esound-compat
12386 pulseaudio-module-x11 pulseaudio-utils quanta-data rocs rsync
12387 speech-dispatcher step svgalibg1 texlive-binaries texlive-luatex
12388 ttf-sazanami-gothic
12389 </p
></blockquote
>
12391 <p
>Installed using apt-get, removed with aptitude
</p
>
12393 <blockquote
><p
>
12394 amor artsbuilder atlantik atlantikdesigner blinken bluez-utils cvs
12395 dhcdbd djvulibre-desktop imlib-base imlib11 kalzium kanagram kandy
12396 kasteroids katomic kbackgammon kbattleship kblackbox kbounce kbruch
12397 kcron kdat kdemultimedia-kappfinder-data kdeprint kdict kdvi kedit
12398 keduca kenolaba kfax kfaxview kfouleggs kgeography kghostview
12399 kgoldrunner khangman khexedit kiconedit kig kimagemapeditor
12400 kitchensync kiten kjumpingcube klatin klettres klickety klines
12401 klinkstatus kmag kmahjongg kmailcvt kmenuedit kmid kmilo kmines
12402 kmousetool kmouth kmplot knetwalk kodo kolf kommander konquest kooka
12403 kpager kpat kpdf kpercentage kpilot kpoker kpovmodeler krec
12404 kregexpeditor kreversi ksame ksayit kshisen ksig ksim ksirc ksirtet
12405 ksmiletris ksnake ksokoban kspaceduel kstars ksvg ksysv kteatime
12406 ktip ktnef ktouch ktron kttsd ktuberling kturtle ktux kuickshow
12407 kverbos kview kviewshell kvoctrain kwifimanager kwin kwin4 kwordquiz
12408 kworldclock kxsldbg libakode2 libarts1-akode libarts1-audiofile
12409 libarts1-mpeglib libarts1-xine libavahi-compat-libdnssd1
12410 libavahi-core5 libavc1394-
0 libbind9-
50 libbluetooth2
12411 libboost-python1.34
.1 libcucul0 libcurl3 libcvsservice0
12412 libdirectfb-
1.0-
0 libdjvulibre21 libdvdread3 libfaad0 libfreebob0
12413 libgd2-noxpm libgraphviz4 libgsmme1c2a libgtkhtml2-
0 libicu38
12414 libiec61883-
0 libindex0 libisccc50 libisccfg50 libiw29
12415 libjaxp1.3-java-gcj libk3b3 libkcal2b libkcddb1 libkdeedu3
12416 libkdegames1 libkdepim1a libkgantt0 libkleopatra1 libkmime2
12417 libkpathsea4 libkpimexchange1 libkpimidentities1 libkscan1
12418 libksieve0 libktnef1 liblockdev1 libltdl3 liblwres50 libmagick10
12419 libmimelib1c2a libmodplug0c2 libmozjs1d libmpcdec3 libmpfr1ldbl
12420 libneon27 libnm-util0 libopensync0 libpisock9 libpoppler-glib3
12421 libpoppler-qt2 libpoppler3 libraw1394-
8 librss1 libsensors3
12422 libsmbios2 libssh2-
1 libsuitesparse-
3.1.0 libswfdec-
0.6-
90
12423 libtalloc1 libxalan2-java-gcj libxerces2-java-gcj libxtrap6 lskat
12424 mpeglib network-manager-kde noatun pmount tex-common texlive-base
12425 texlive-common texlive-doc-base texlive-fonts-recommended tidy
12426 ttf-dustin ttf-kochi-gothic ttf-sjfonts
12427 </p
></blockquote
>
12429 <p
>Installed using aptitude, missing with apt-get
</p
>
12431 <blockquote
><p
>
12432 dolphin kde-core kde-plasma-desktop kde-standard kde-window-manager
12433 kdeartwork kdebase kdebase-apps kdebase-workspace
12434 kdebase-workspace-bin kdebase-workspace-data kdeutils kscreensaver
12435 kscreensaver-xsavers libgle3 libkonq5 libkonq5-templates libnetpbm10
12436 netpbm plasma-widget-folderview plasma-widget-networkmanagement
12437 xscreensaver-data-extra xscreensaver-gl xscreensaver-gl-extra
12438 xscreensaver-screensaver-bsod
12439 </p
></blockquote
>
12441 <p
>Installed using aptitude, removed with apt-get
</p
>
12443 <blockquote
><p
>
12444 kdebase-bin konq-plugins konqueror
12445 </p
></blockquote
>
12450 <title>Gnash buildbot slave and Debian kfreebsd
</title>
12451 <link>http://www.hungry.com/~pere/blog/Gnash_buildbot_slave_and_Debian_kfreebsd.html
</link>
12452 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Gnash_buildbot_slave_and_Debian_kfreebsd.html
</guid>
12453 <pubDate>Sat,
20 Nov
2010 07:
20:
00 +
0100</pubDate>
12454 <description><p
>Answering
12455 <a href=
"http://www.listware.net/
201011/gnash-dev/
67431-gnash-dev-buildbot-looking-for-slaves.html
">the
12456 call from the Gnash project
</a
> for
12457 <a href=
"http://www.gnashdev.org:
8010">buildbot
</a
> slaves to test the
12458 current source, I have set up a virtual KVM machine on the Debian
12459 Edu/Skolelinux virtualization host to test the git source on
12460 Debian/Squeeze. I hope this can help the developers in getting new
12461 releases out more often.
</p
>
12463 <p
>As the developers want less main-stream build platforms tested to,
12464 I have considered setting up a
<a
12465 href=
"http://www.debian.org/ports/kfreebsd-gnu/
">Debian/kfreebsd
</a
>
12466 machine as well. I have also considered using the kfreebsd
12467 architecture in Debian as a file server in NUUG to get access to the
5
12468 TB zfs volume we currently use to store DV video. Because of this, I
12469 finally got around to do a test installation of Debian/Squeeze with
12470 kfreebsd. Installation went fairly smooth, thought I noticed some
12471 visual glitches in the cdebconf dialogs (black cursor left on the
12472 screen at random locations). Have not gotten very far with the
12473 testing. Noticed cfdisk did not work, but fdisk did so it was not a
12474 fatal problem. Have to spend some more time on it to see if it is
12475 useful as a file server for NUUG. Will try to find time to set up a
12476 gnash buildbot slave on the Debian Edu/Skolelinux this weekend.
</p
>
12481 <title>Debian in
3D
</title>
12482 <link>http://www.hungry.com/~pere/blog/Debian_in_3D.html
</link>
12483 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_in_3D.html
</guid>
12484 <pubDate>Tue,
9 Nov
2010 16:
10:
00 +
0100</pubDate>
12485 <description><p
><img src=
"http://thingiverse-production.s3.amazonaws.com/renders/
23/e0/c4/f9/
2b/debswagtdose_preview_medium.jpg
"></p
>
12487 <p
>3D printing is just great. I just came across this Debian logo in
12489 <a href=
"http://blog.thingiverse.com/
2010/
11/
09/participatory-branding/
">the
12490 thingiverse blog
</a
>.
</p
>
12495 <title>Software updates
2010-
10-
24</title>
12496 <link>http://www.hungry.com/~pere/blog/Software_updates_2010_10_24.html
</link>
12497 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Software_updates_2010_10_24.html
</guid>
12498 <pubDate>Sun,
24 Oct
2010 22:
45:
00 +
0200</pubDate>
12499 <description><p
>Some updates.
</p
>
12501 <p
>My
<a href=
"http://pledgebank.com/gnash-avm2
">gnash pledge
</a
> to
12502 raise money for the project is going well. The lower limit of
10
12503 signers was reached in
24 hours, and so far
13 people have signed it.
12504 More signers and more funding is most welcome, and I am really curious
12505 how far we can get before the time limit of December
24 is reached.
12508 <p
>On the #gnash IRC channel on irc.freenode.net, I was just tipped
12509 about what appear to be a great code coverage tool capable of
12510 generating code coverage stats without any changes to the source code.
12512 <a href=
"http://simonkagstrom.github.com/kcov/index.html
">kcov
</a
>,
12513 and can be used using
<tt
>kcov
&lt;directory
&gt;
&lt;binary
&gt;
</tt
>.
12514 It is missing in Debian, but the git source built just fine in Squeeze
12515 after I installed libelf-dev, libdwarf-dev, pkg-config and
12516 libglib2.0-dev. Failed to build in Lenny, but suspect that is
12517 solvable. I hope kcov make it into Debian soon.
</p
>
12519 <p
>Finally found time to wrap up the release notes for
<a
12520 href=
"http://lists.debian.org/debian-edu-announce/
2010/
10/msg00002.html
">a
12521 new alpha release of Debian Edu
</a
>, and just published the second
12522 alpha test release of the Squeeze based Debian Edu /
12523 <a href=
"http://www.skolelinux.org/
">Skolelinux
</a
>
12524 release. Give it a try if you need a complete linux solution for your
12525 school, including central infrastructure server, workstations, thin
12526 client servers and diskless workstations. A nice touch added
12527 yesterday is RDP support on the thin client servers, for windows
12528 clients to get a Linux desktop on request.
</p
>
12533 <title>Some notes on Flash in Debian and Debian Edu
</title>
12534 <link>http://www.hungry.com/~pere/blog/Some_notes_on_Flash_in_Debian_and_Debian_Edu.html
</link>
12535 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Some_notes_on_Flash_in_Debian_and_Debian_Edu.html
</guid>
12536 <pubDate>Sat,
4 Sep
2010 10:
10:
00 +
0200</pubDate>
12537 <description><p
>In the
<a href=
"http://popcon.debian.org/unknown/by_vote
">Debian
12538 popularity-contest numbers
</a
>, the adobe-flashplugin package the
12539 second most popular used package that is missing in Debian. The sixth
12540 most popular is flashplayer-mozilla. This is a clear indication that
12541 working flash is important for Debian users. Around
10 percent of the
12542 users submitting data to popcon.debian.org have this package
12543 installed.
</p
>
12545 <p
>In the report written by Lars Risan in August
2008
12546 («
<a href=
"http://wiki.skolelinux.no/Dokumentasjon/Rapporter?action=AttachFile
&do=view
&target=Skolelinux_i_bruk_rapport_1.0.pdf
">Skolelinux
12547 i bruk – Rapport for Hurum kommune, Universitetet i Agder og
12548 stiftelsen SLX Debian Labs
</a
>»), one of the most important problems
12549 schools experienced with
<a href=
"http://www.skolelinux.org/
">Debian
12550 Edu/Skolelinux
</a
> was the lack of working Flash. A lot of educational
12551 web sites require Flash to work, and lacking working Flash support in
12552 the web browser and the problems with installing it was perceived as a
12553 good reason to stay with Windows.
</p
>
12555 <p
>I once saw a funny and sad comment in a web forum, where Linux was
12556 said to be the retarded cousin that did not really understand
12557 everything you told him but could work fairly well. This was a
12558 comment regarding the problems Linux have with proprietary formats and
12559 non-standard web pages, and is sad because it exposes a fairly common
12560 understanding of whose fault it is if web pages that only work in for
12561 example Internet Explorer
6 fail to work on Firefox, and funny because
12562 it explain very well how annoying it is for users when Linux
12563 distributions do not work with the documents they receive or the web
12564 pages they want to visit.
</p
>
12566 <p
>This is part of the reason why I believe it is important for Debian
12567 and Debian Edu to have a well working Flash implementation in the
12568 distribution, to get at least popular sites as Youtube and Google
12569 Video to working out of the box. For Squeeze, Debian have the chance
12570 to include the latest version of Gnash that will make this happen, as
12571 the new release
0.8.8 was published a few weeks ago and is resting in
12572 unstable. The new version work with more sites that version
0.8.7.
12573 The Gnash maintainers have asked for a freeze exception, but the
12574 release team have not had time to reply to it yet. I hope they agree
12575 with me that Flash is important for the Debian desktop users, and thus
12576 accept the new package into Squeeze.
</p
>
12581 <title>Circular package dependencies harms apt recovery
</title>
12582 <link>http://www.hungry.com/~pere/blog/Circular_package_dependencies_harms_apt_recovery.html
</link>
12583 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Circular_package_dependencies_harms_apt_recovery.html
</guid>
12584 <pubDate>Tue,
27 Jul
2010 23:
50:
00 +
0200</pubDate>
12585 <description><p
>I discovered this while doing
12586 <a href=
"http://www.hungry.com/~pere/blog/Automatic_upgrade_testing_from_Lenny_to_Squeeze.html
">automated
12587 testing of upgrades from Debian Lenny to Squeeze
</a
>. A few packages
12588 in Debian still got circular dependencies, and it is often claimed
12589 that apt and aptitude should be able to handle this just fine, but
12590 some times these dependency loops causes apt to fail.
</p
>
12592 <p
>An example is from todays
12593 <a href=
"https://people.skolelinux.org/~pere/debian-upgrade-testing//test-
20100727-lenny-squeeze-kde-aptitude.txt
">upgrade
12594 of KDE using aptitude
</a
>. In it, a bug in kdebase-workspace-data
12595 causes perl-modules to fail to upgrade. The cause is simple. If a
12596 package fail to unpack, then only part of packages with the circular
12597 dependency might end up being unpacked when unpacking aborts, and the
12598 ones already unpacked will fail to configure in the recovery phase
12599 because its dependencies are unavailable.
</p
>
12601 <p
>In this log, the problem manifest itself with this error:
</p
>
12603 <blockquote
><pre
>
12604 dpkg: dependency problems prevent configuration of perl-modules:
12605 perl-modules depends on perl (
>=
5.10.1-
1); however:
12606 Version of perl on system is
5.10.0-
19lenny
2.
12607 dpkg: error processing perl-modules (--configure):
12608 dependency problems - leaving unconfigured
12609 </pre
></blockquote
>
12611 <p
>The perl/perl-modules circular dependency is already
12612 <a href=
"http://bugs.debian.org/
527917">reported as a bug
</a
>, and will
12613 hopefully be solved as soon as possible, but it is not the only one,
12614 and each one of these loops in the dependency tree can cause similar
12615 failures. Of course, they only occur when there are bugs in other
12616 packages causing the unpacking to fail, but it is rather nasty when
12617 the failure of one package causes the problem to become worse because
12618 of dependency loops.
</p
>
12621 <a href=
"http://lists.debian.org/debian-devel/
2010/
06/msg00116.html
">the
12622 tireless effort by Bill Allombert
</a
>, the number of circular
12624 <a href=
"http://debian.semistable.com/debgraph.out.html
">left in Debian
12625 is dropping
</a
>, and perhaps it will reach zero one day. :)
</p
>
12627 <p
>Todays testing also exposed a bug in
12628 <a href=
"http://bugs.debian.org/
590605">update-notifier
</a
> and
12629 <a href=
"http://bugs.debian.org/
590604">different behaviour
</a
> between
12630 apt-get and aptitude, the latter possibly caused by some circular
12631 dependency. Reported both to BTS to try to get someone to look at
12637 <title>What are they searching for - PowerDNS and ISC DHCP in LDAP
</title>
12638 <link>http://www.hungry.com/~pere/blog/What_are_they_searching_for___PowerDNS_and_ISC_DHCP_in_LDAP.html
</link>
12639 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/What_are_they_searching_for___PowerDNS_and_ISC_DHCP_in_LDAP.html
</guid>
12640 <pubDate>Sat,
17 Jul
2010 21:
00:
00 +
0200</pubDate>
12641 <description><p
>This is a
12642 <a href=
"http://www.hungry.com/~pere/blog/Time_for_new__LDAP_schemas_replacing_RFC_2307_.html
">followup
</a
>
12644 <a href=
"http://www.hungry.com/~pere/blog/Idea_for_a_change_to_LDAP_schemas_allowing_DNS_and_DHCP_info_to_be_combined_into_one_object.html
">previous
12646 <a href=
"http://www.hungry.com/~pere/blog/Combining_PowerDNS_and_ISC_DHCP_LDAP_objects.html
">merging
12647 all
</a
> the computer related LDAP objects in Debian Edu.
</p
>
12649 <p
>As a step to try to see if it possible to merge the DNS and DHCP
12650 LDAP objects, I have had a look at how the packages pdns-backend-ldap
12651 and dhcp3-server-ldap in Debian use the LDAP server. The two
12652 implementations are quite different in how they use LDAP.
</p
>
12654 To get this information, I started slapd with debugging enabled and
12655 dumped the debug output to a file to get the LDAP searches performed
12656 on a Debian Edu main-server. Here is a summary.
12658 <p
><strong
>powerdns
</strong
></p
>
12660 <a href=
"http://www.linuxnetworks.de/doc/index.php/PowerDNS_LDAP_Backend
">Clues
12661 on how to
</a
> set up PowerDNS to use a LDAP backend is available on
12664 <p
>PowerDNS have two modes of operation using LDAP as its backend.
12665 One
"strict
" mode where the forward and reverse DNS lookups are done
12666 using the same LDAP objects, and a
"tree
" mode where the forward and
12667 reverse entries are in two different subtrees in LDAP with a structure
12668 based on the DNS names, as in tjener.intern and
12669 2.2.0.10.in-addr.arpa.
</p
>
12671 <p
>In tree mode, the server is set up to use a LDAP subtree as its
12672 base, and uses a
"base
" scoped search for the DNS name by adding
12673 "dc=tjener,dc=intern,
" to the base with a filter for
12674 "(associateddomain=tjener.intern)
" for the forward entry and
12675 "dc=
2,dc=
2,dc=
0,dc=
10,dc=in-addr,dc=arpa,
" with a filter for
12676 "(associateddomain=
2.2.0.10.in-addr.arpa)
" for the reverse entry. For
12677 forward entries, it is looking for attributes named dnsttl, arecord,
12678 nsrecord, cnamerecord, soarecord, ptrrecord, hinforecord, mxrecord,
12679 txtrecord, rprecord, afsdbrecord, keyrecord, aaaarecord, locrecord,
12680 srvrecord, naptrrecord, kxrecord, certrecord, dsrecord, sshfprecord,
12681 ipseckeyrecord, rrsigrecord, nsecrecord, dnskeyrecord, dhcidrecord,
12682 spfrecord and modifytimestamp. For reverse entries it is looking for
12683 the attributes dnsttl, arecord, nsrecord, cnamerecord, soarecord,
12684 ptrrecord, hinforecord, mxrecord, txtrecord, rprecord, aaaarecord,
12685 locrecord, srvrecord, naptrrecord and modifytimestamp. The equivalent
12686 ldapsearch commands could look like this:
</p
>
12688 <blockquote
><pre
>
12689 ldapsearch -h ldap \
12690 -b dc=tjener,dc=intern,ou=hosts,dc=skole,dc=skolelinux,dc=no \
12691 -s base -x
'(associateddomain=tjener.intern)
' dNSTTL aRecord nSRecord \
12692 cNAMERecord sOARecord pTRRecord hInfoRecord mXRecord tXTRecord \
12693 rPRecord aFSDBRecord KeyRecord aAAARecord lOCRecord sRVRecord \
12694 nAPTRRecord kXRecord certRecord dSRecord sSHFPRecord iPSecKeyRecord \
12695 rRSIGRecord nSECRecord dNSKeyRecord dHCIDRecord sPFRecord modifyTimestamp
12697 ldapsearch -h ldap \
12698 -b dc=
2,dc=
2,dc=
0,dc=
10,dc=in-addr,dc=arpa,ou=hosts,dc=skole,dc=skolelinux,dc=no \
12699 -s base -x
'(associateddomain=
2.2.0.10.in-addr.arpa)
'
12700 dnsttl, arecord, nsrecord, cnamerecord soarecord ptrrecord \
12701 hinforecord mxrecord txtrecord rprecord aaaarecord locrecord \
12702 srvrecord naptrrecord modifytimestamp
12703 </pre
></blockquote
>
12705 <p
>In Debian Edu/Lenny, the PowerDNS tree mode is used with
12706 ou=hosts,dc=skole,dc=skolelinux,dc=no as the base, and these are two
12707 example LDAP objects used there. In addition to these objects, the
12708 parent objects all th way up to ou=hosts,dc=skole,dc=skolelinux,dc=no
12709 also exist.
</p
>
12711 <blockquote
><pre
>
12712 dn: dc=tjener,dc=intern,ou=hosts,dc=skole,dc=skolelinux,dc=no
12714 objectclass: dnsdomain
12715 objectclass: domainrelatedobject
12718 associateddomain: tjener.intern
12720 dn: dc=
2,dc=
2,dc=
0,dc=
10,dc=in-addr,dc=arpa,ou=hosts,dc=skole,dc=skolelinux,dc=no
12722 objectclass: dnsdomain2
12723 objectclass: domainrelatedobject
12725 ptrrecord: tjener.intern
12726 associateddomain:
2.2.0.10.in-addr.arpa
12727 </pre
></blockquote
>
12729 <p
>In strict mode, the server behaves differently. When looking for
12730 forward DNS entries, it is doing a
"subtree
" scoped search with the
12731 same base as in the tree mode for a object with filter
12732 "(associateddomain=tjener.intern)
" and requests the attributes dnsttl,
12733 arecord, nsrecord, cnamerecord, soarecord, ptrrecord, hinforecord,
12734 mxrecord, txtrecord, rprecord, aaaarecord, locrecord, srvrecord,
12735 naptrrecord and modifytimestamp. For reverse entires it also do a
12736 subtree scoped search but this time the filter is
"(arecord=
10.0.2.2)
"
12737 and the requested attributes are associateddomain, dnsttl and
12738 modifytimestamp. In short, in strict mode the objects with ptrrecord
12739 go away, and the arecord attribute in the forward object is used
12742 <p
>The forward and reverse searches can be simulated using ldapsearch
12743 like this:
</p
>
12745 <blockquote
><pre
>
12746 ldapsearch -h ldap -b ou=hosts,dc=skole,dc=skolelinux,dc=no -s sub -x \
12747 '(associateddomain=tjener.intern)
' dNSTTL aRecord nSRecord \
12748 cNAMERecord sOARecord pTRRecord hInfoRecord mXRecord tXTRecord \
12749 rPRecord aFSDBRecord KeyRecord aAAARecord lOCRecord sRVRecord \
12750 nAPTRRecord kXRecord certRecord dSRecord sSHFPRecord iPSecKeyRecord \
12751 rRSIGRecord nSECRecord dNSKeyRecord dHCIDRecord sPFRecord modifyTimestamp
12753 ldapsearch -h ldap -b ou=hosts,dc=skole,dc=skolelinux,dc=no -s sub -x \
12754 '(arecord=
10.0.2.2)
' associateddomain dnsttl modifytimestamp
12755 </pre
></blockquote
>
12757 <p
>In addition to the forward and reverse searches , there is also a
12758 search for SOA records, which behave similar to the forward and
12759 reverse lookups.
</p
>
12761 <p
>A thing to note with the PowerDNS behaviour is that it do not
12762 specify any objectclass names, and instead look for the attributes it
12763 need to generate a DNS reply. This make it able to work with any
12764 objectclass that provide the needed attributes.
</p
>
12766 <p
>The attributes are normally provided in the cosine (RFC
1274) and
12767 dnsdomain2 schemas. The latter is used for reverse entries like
12768 ptrrecord and recent DNS additions like aaaarecord and srvrecord.
</p
>
12770 <p
>In Debian Edu, we have created DNS objects using the object classes
12771 dcobject (for dc), dnsdomain or dnsdomain2 (structural, for the DNS
12772 attributes) and domainrelatedobject (for associatedDomain). The use
12773 of structural object classes make it impossible to combine these
12774 classes with the object classes used by DHCP.
</p
>
12776 <p
>There are other schemas that could be used too, for example the
12777 dnszone structural object class used by Gosa and bind-sdb for the DNS
12778 attributes combined with the domainrelatedobject object class, but in
12779 this case some unused attributes would have to be included as well
12780 (zonename and relativedomainname).
</p
>
12782 <p
>My proposal for Debian Edu would be to switch PowerDNS to strict
12783 mode and not use any of the existing objectclasses (dnsdomain,
12784 dnsdomain2 and dnszone) when one want to combine the DNS information
12785 with DHCP information, and instead create a auxiliary object class
12786 defined something like this (using the attributes defined for
12787 dnsdomain and dnsdomain2 or dnszone):
</p
>
12789 <blockquote
><pre
>
12790 objectclass ( some-oid NAME
'dnsDomainAux
'
12793 MAY ( ARecord $ MDRecord $ MXRecord $ NSRecord $ SOARecord $ CNAMERecord $
12794 DNSTTL $ DNSClass $ PTRRecord $ HINFORecord $ MINFORecord $
12795 TXTRecord $ SIGRecord $ KEYRecord $ AAAARecord $ LOCRecord $
12796 NXTRecord $ SRVRecord $ NAPTRRecord $ KXRecord $ CERTRecord $
12797 A6Record $ DNAMERecord
12799 </pre
></blockquote
>
12801 <p
>This will allow any object to become a DNS entry when combined with
12802 the domainrelatedobject object class, and allow any entity to include
12803 all the attributes PowerDNS wants. I
've sent an email to the PowerDNS
12804 developers asking for their view on this schema and if they are
12805 interested in providing such schema with PowerDNS, and I hope my
12806 message will be accepted into their mailing list soon.
</p
>
12808 <p
><strong
>ISC dhcp
</strong
></p
>
12810 <p
>The DHCP server searches for specific objectclass and requests all
12811 the object attributes, and then uses the attributes it want. This
12812 make it harder to figure out exactly what attributes are used, but
12813 thanks to the working example in Debian Edu I can at least get an idea
12814 what is needed without having to read the source code.
</p
>
12816 <p
>In the DHCP server configuration, the LDAP base to use and the
12817 search filter to use to locate the correct dhcpServer entity is
12818 stored. These are the relevant entries from
12819 /etc/dhcp3/dhcpd.conf:
</p
>
12821 <blockquote
><pre
>
12822 ldap-base-dn
"dc=skole,dc=skolelinux,dc=no
";
12823 ldap-dhcp-server-cn
"dhcp
";
12824 </pre
></blockquote
>
12826 <p
>The DHCP server uses this information to nest all the DHCP
12827 configuration it need. The cn
"dhcp
" is located using the given LDAP
12828 base and the filter
"(
&(objectClass=dhcpServer)(cn=dhcp))
". The
12829 search result is this entry:
</p
>
12831 <blockquote
><pre
>
12832 dn: cn=dhcp,dc=skole,dc=skolelinux,dc=no
12835 objectClass: dhcpServer
12836 dhcpServiceDN: cn=DHCP Config,dc=skole,dc=skolelinux,dc=no
12837 </pre
></blockquote
>
12839 <p
>The content of the dhcpServiceDN attribute is next used to locate the
12840 subtree with DHCP configuration. The DHCP configuration subtree base
12841 is located using a base scope search with base
"cn=DHCP
12842 Config,dc=skole,dc=skolelinux,dc=no
" and filter
12843 "(
&(objectClass=dhcpService)(|(dhcpPrimaryDN=cn=dhcp,dc=skole,dc=skolelinux,dc=no)(dhcpSecondaryDN=cn=dhcp,dc=skole,dc=skolelinux,dc=no)))
".
12844 The search result is this entry:
</p
>
12846 <blockquote
><pre
>
12847 dn: cn=DHCP Config,dc=skole,dc=skolelinux,dc=no
12850 objectClass: dhcpService
12851 objectClass: dhcpOptions
12852 dhcpPrimaryDN: cn=dhcp, dc=skole,dc=skolelinux,dc=no
12853 dhcpStatements: ddns-update-style none
12854 dhcpStatements: authoritative
12855 dhcpOption: smtp-server code
69 = array of ip-address
12856 dhcpOption: www-server code
72 = array of ip-address
12857 dhcpOption: wpad-url code
252 = text
12858 </pre
></blockquote
>
12860 <p
>Next, the entire subtree is processed, one level at the time. When
12861 all the DHCP configuration is loaded, it is ready to receive requests.
12862 The subtree in Debian Edu contain objects with object classes
12863 top/dhcpService/dhcpOptions, top/dhcpSharedNetwork/dhcpOptions,
12864 top/dhcpSubnet, top/dhcpGroup and top/dhcpHost. These provide options
12865 and information about netmasks, dynamic range etc. Leaving out the
12866 details here because it is not relevant for the focus of my
12867 investigation, which is to see if it is possible to merge dns and dhcp
12868 related computer objects.
</p
>
12870 <p
>When a DHCP request come in, LDAP is searched for the MAC address
12871 of the client (
00:
00:
00:
00:
00:
00 in this example), using a subtree
12872 scoped search with
"cn=DHCP Config,dc=skole,dc=skolelinux,dc=no
" as
12873 the base and
"(
&(objectClass=dhcpHost)(dhcpHWAddress=ethernet
12874 00:
00:
00:
00:
00:
00))
" as the filter. This is what a host object look
12877 <blockquote
><pre
>
12878 dn: cn=hostname,cn=group1,cn=THINCLIENTS,cn=DHCP Config,dc=skole,dc=skolelinux,dc=no
12881 objectClass: dhcpHost
12882 dhcpHWAddress: ethernet
00:
00:
00:
00:
00:
00
12883 dhcpStatements: fixed-address hostname
12884 </pre
></blockquote
>
12886 <p
>There is less flexiblity in the way LDAP searches are done here.
12887 The object classes need to have fixed names, and the configuration
12888 need to be stored in a fairly specific LDAP structure. On the
12889 positive side, the invidiual dhcpHost entires can be anywhere without
12890 the DN pointed to by the dhcpServer entries. The latter should make
12891 it possible to group all host entries in a subtree next to the
12892 configuration entries, and this subtree can also be shared with the
12893 DNS server if the schema proposed above is combined with the dhcpHost
12894 structural object class.
12896 <p
><strong
>Conclusion
</strong
></p
>
12898 <p
>The PowerDNS implementation seem to be very flexible when it come
12899 to which LDAP schemas to use. While its
"tree
" mode is rigid when it
12900 come to the the LDAP structure, the
"strict
" mode is very flexible,
12901 allowing DNS objects to be stored anywhere under the base cn specified
12902 in the configuration.
</p
>
12904 <p
>The DHCP implementation on the other hand is very inflexible, both
12905 regarding which LDAP schemas to use and which LDAP structure to use.
12906 I guess one could implement ones own schema, as long as the
12907 objectclasses and attributes have the names used, but this do not
12908 really help when the DHCP subtree need to have a fairly fixed
12909 structure.
</p
>
12911 <p
>Based on the observed behaviour, I suspect a LDAP structure like
12912 this might work for Debian Edu:
</p
>
12914 <blockquote
><pre
>
12916 cn=machine-info (dhcpService) - dhcpServiceDN points here
12917 cn=dhcp (dhcpServer)
12918 cn=dhcp-internal (dhcpSharedNetwork/dhcpOptions)
12919 cn=
10.0.2.0 (dhcpSubnet)
12920 cn=group1 (dhcpGroup/dhcpOptions)
12921 cn=dhcp-thinclients (dhcpSharedNetwork/dhcpOptions)
12922 cn=
192.168.0.0 (dhcpSubnet)
12923 cn=group1 (dhcpGroup/dhcpOptions)
12924 ou=machines - PowerDNS base points here
12925 cn=hostname (dhcpHost/domainrelatedobject/dnsDomainAux)
12926 </pre
></blockquote
>
12928 <P
>This is not tested yet. If the DHCP server require the dhcpHost
12929 entries to be in the dhcpGroup subtrees, the entries can be stored
12930 there instead of a common machines subtree, and the PowerDNS base
12931 would have to be moved one level up to the machine-info subtree.
</p
>
12933 <p
>The combined object under the machines subtree would look something
12934 like this:
</p
>
12936 <blockquote
><pre
>
12937 dn: dc=hostname,ou=machines,cn=machine-info,dc=skole,dc=skolelinux,dc=no
12940 objectClass: dhcpHost
12941 objectclass: domainrelatedobject
12942 objectclass: dnsDomainAux
12943 associateddomain: hostname.intern
12944 arecord:
10.11.12.13
12945 dhcpHWAddress: ethernet
00:
00:
00:
00:
00:
00
12946 dhcpStatements: fixed-address hostname.intern
12947 </pre
></blockquote
>
12949 </p
>One could even add the LTSP configuration associated with a given
12950 machine, as long as the required attributes are available in a
12951 auxiliary object class.
</p
>
12956 <title>Combining PowerDNS and ISC DHCP LDAP objects
</title>
12957 <link>http://www.hungry.com/~pere/blog/Combining_PowerDNS_and_ISC_DHCP_LDAP_objects.html
</link>
12958 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Combining_PowerDNS_and_ISC_DHCP_LDAP_objects.html
</guid>
12959 <pubDate>Wed,
14 Jul
2010 23:
45:
00 +
0200</pubDate>
12960 <description><p
>For a while now, I have wanted to find a way to change the DNS and
12961 DHCP services in Debian Edu to use the same LDAP objects for a given
12962 computer, to avoid the possibility of having a inconsistent state for
12963 a computer in LDAP (as in DHCP but no DNS entry or the other way
12964 around) and make it easier to add computers to LDAP.
</p
>
12966 <p
>I
've looked at how powerdns and dhcpd is using LDAP, and using this
12967 information finally found a solution that seem to work.
</p
>
12969 <p
>The old setup required three LDAP objects for a given computer.
12970 One forward DNS entry, one reverse DNS entry and one DHCP entry. If
12971 we switch powerdns to use its strict LDAP method (ldap-method=strict
12972 in pdns-debian-edu.conf), the forward and reverse DNS entries are
12973 merged into one while making it impossible to transfer the reverse map
12974 to a slave DNS server.
</p
>
12976 <p
>If we also replace the object class used to get the DNS related
12977 attributes to one allowing these attributes to be combined with the
12978 dhcphost object class, we can merge the DNS and DHCP entries into one.
12979 I
've written such object class in the dnsdomainaux.schema file (need
12980 proper OIDs, but that is a minor issue), and tested the setup. It
12981 seem to work.
</p
>
12983 <p
>With this test setup in place, we can get away with one LDAP object
12984 for both DNS and DHCP, and even the LTSP configuration I suggested in
12985 an earlier email. The combined LDAP object will look something like
12988 <blockquote
><pre
>
12989 dn: cn=hostname,cn=group1,cn=THINCLIENTS,cn=DHCP Config,dc=skole,dc=skolelinux,dc=no
12991 objectClass: dhcphost
12992 objectclass: domainrelatedobject
12993 objectclass: dnsdomainaux
12994 associateddomain: hostname.intern
12995 arecord:
10.11.12.13
12996 dhcphwaddress: ethernet
00:
00:
00:
00:
00:
00
12997 dhcpstatements: fixed-address hostname
12999 </pre
></blockquote
>
13001 <p
>The DNS server uses the associateddomain and arecord entries, while
13002 the DHCP server uses the dhcphwaddress and dhcpstatements entries
13003 before asking DNS to resolve the fixed-adddress. LTSP will use
13004 dhcphwaddress or associateddomain and the ldapconfig* attributes.
</p
>
13006 <p
>I am not yet sure if I can get the DHCP server to look for its
13007 dhcphost in a different location, to allow us to put the objects
13008 outside the
"DHCP Config
" subtree, but hope to figure out a way to do
13009 that. If I can
't figure out a way to do that, we can still get rid of
13010 the hosts subtree and move all its content into the DHCP Config tree
13011 (which probably should be renamed to be more related to the new
13012 content. I suspect cn=dnsdhcp,ou=services or something like that
13013 might be a good place to put it.
</p
>
13015 <p
>If you want to help out with implementing this for Debian Edu,
13016 please contact us on debian-edu@lists.debian.org.
</p
>
13021 <title>Idea for storing LTSP configuration in LDAP
</title>
13022 <link>http://www.hungry.com/~pere/blog/Idea_for_storing_LTSP_configuration_in_LDAP.html
</link>
13023 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Idea_for_storing_LTSP_configuration_in_LDAP.html
</guid>
13024 <pubDate>Sun,
11 Jul
2010 22:
00:
00 +
0200</pubDate>
13025 <description><p
>Vagrant mentioned on IRC today that ltsp_config now support
13026 sourcing files from /usr/share/ltsp/ltsp_config.d/ on the thin
13027 clients, and that this can be used to fetch configuration from LDAP if
13028 Debian Edu choose to store configuration there.
</p
>
13030 <p
>Armed with this information, I got inspired and wrote a test module
13031 to get configuration from LDAP. The idea is to look up the MAC
13032 address of the client in LDAP, and look for attributes on the form
13033 ltspconfigsetting=value, and use this to export SETTING=value to the
13034 LTSP clients.
</p
>
13036 <p
>The goal is to be able to store the LTSP configuration attributes
13037 in a
"computer
" LDAP object used by both DNS and DHCP, and thus
13038 allowing us to store all information about a computer in one place.
</p
>
13040 <p
>This is a untested draft implementation, and I welcome feedback on
13041 this approach. A real LDAP schema for the ltspClientAux objectclass
13042 need to be written. Comments, suggestions, etc?
</p
>
13044 <blockquote
><pre
>
13045 # Store in /opt/ltsp/$arch/usr/share/ltsp/ltsp_config.d/ldap-config
13047 # Fetch LTSP client settings from LDAP based on MAC address
13049 # Uses ethernet address as stored in the dhcpHost objectclass using
13050 # the dhcpHWAddress attribute or ethernet address stored in the
13051 # ieee802Device objectclass with the macAddress attribute.
13053 # This module is written to be schema agnostic, and only depend on the
13054 # existence of attribute names.
13056 # The LTSP configuration variables are saved directly using a
13057 # ltspConfig prefix and uppercasing the rest of the attribute name.
13058 # To set the SERVER variable, set the ltspConfigServer attribute.
13060 # Some LDAP schema should be created with all the relevant
13061 # configuration settings. Something like this should work:
13063 # objectclass (
1.1.2.2 NAME
'ltspClientAux
'
13066 # MAY ( ltspConfigServer $ ltsConfigSound $ ... )
13068 LDAPSERVER=$(debian-edu-ldapserver)
13069 if [
"$LDAPSERVER
" ] ; then
13070 LDAPBASE=$(debian-edu-ldapserver -b)
13071 for MAC in $(LANG=C ifconfig |grep -i hwaddr| awk
'{print $
5}
'|sort -u) ; do
13072 filter=
"(|(dhcpHWAddress=ethernet $MAC)(macAddress=$MAC))
"
13073 ldapsearch -h
"$LDAPSERVER
" -b
"$LDAPBASE
" -v -x
"$filter
" | \
13074 grep
'^ltspConfig
' | while read attr value ; do
13075 # Remove prefix and convert to upper case
13076 attr=$(echo $attr | sed
's/^ltspConfig//i
' | tr a-z A-Z)
13077 # bass value on to clients
13078 eval
"$attr=$value; export $attr
"
13082 </pre
></blockquote
>
13084 <p
>I
'm not sure this shell construction will work, because I suspect
13085 the while block might end up in a subshell causing the variables set
13086 there to not show up in ltsp-config, but if that is the case I am sure
13087 the code can be restructured to make sure the variables are passed on.
13088 I expect that can be solved with some testing. :)
</p
>
13090 <p
>If you want to help out with implementing this for Debian Edu,
13091 please contact us on debian-edu@lists.debian.org.
</p
>
13093 <p
>Update
2010-
07-
17: I am aware of another effort to store LTSP
13094 configuration in LDAP that was created around year
2000 by
13095 <a href=
"http://www.pcxperience.com/thinclient/documentation/ldap.html
">PC
13096 Xperience, Inc.,
2000</a
>. I found its
13097 <a href=
"http://people.redhat.com/alikins/ltsp/ldap/
">files
</a
> on a
13098 personal home page over at redhat.com.
</p
>
13103 <title>jXplorer, a very nice LDAP GUI
</title>
13104 <link>http://www.hungry.com/~pere/blog/jXplorer__a_very_nice_LDAP_GUI.html
</link>
13105 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/jXplorer__a_very_nice_LDAP_GUI.html
</guid>
13106 <pubDate>Fri,
9 Jul
2010 12:
55:
00 +
0200</pubDate>
13107 <description><p
>Since
13108 <a href=
"http://www.hungry.com/~pere/blog/LUMA__a_very_nice_LDAP_GUI.html
">my
13109 last post
</a
> about available LDAP tools in Debian, I was told about a
13110 LDAP GUI that is even better than luma. The java application
13111 <a href=
"http://jxplorer.org/
">jXplorer
</a
> is claimed to be capable of
13112 moving LDAP objects and subtrees using drag-and-drop, and can
13113 authenticate using Kerberos. I have only tested the Kerberos
13114 authentication, but do not have a LDAP setup allowing me to rewrite
13115 LDAP with my test user yet. It is
13116 <a href=
"http://packages.qa.debian.org/j/jxplorer.html
">available in
13117 Debian
</a
> testing and unstable at the moment. The only problem I
13118 have with it is how it handle errors. If something go wrong, its
13119 non-intuitive behaviour require me to go through some query work list
13120 and remove the failing query. Nothing big, but very annoying.
</p
>
13125 <title>Lenny-
>Squeeze upgrades, apt vs aptitude with the Gnome desktop
</title>
13126 <link>http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades__apt_vs_aptitude_with_the_Gnome_desktop.html
</link>
13127 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades__apt_vs_aptitude_with_the_Gnome_desktop.html
</guid>
13128 <pubDate>Sat,
3 Jul
2010 23:
55:
00 +
0200</pubDate>
13129 <description><p
>Here is a short update on my
<a
13130 href=
"https://people.skolelinux.org/~pere/debian-upgrade-testing/
">my
13131 Debian Lenny-
>Squeeze upgrade testing
</a
>. Here is a summary of the
13132 difference for Gnome when it is upgraded by apt-get and aptitude. I
'm
13133 not reporting the status for KDE, because the upgrade crashes when
13134 aptitude try because of missing conflicts
13135 (
<a href=
"http://bugs.debian.org/
584861">#
584861</a
> and
13136 <a href=
"http://bugs.debian.org/
585716">#
585716</a
>).
</p
>
13138 <p
>At the end of the upgrade test script, dpkg -l is executed to get a
13139 complete list of the installed packages. Based on this I see these
13140 differences when I did a test run today. As usual, I do not really
13141 know what the correct set of packages would be, but thought it best to
13142 publish the difference.
</p
>
13144 <p
>Installed using apt-get, missing with aptitude
</p
>
13146 <blockquote
><p
>
13147 at-spi cpp-
4.3 finger gnome-spell gstreamer0.10-gnomevfs
13148 libatspi1.0-
0 libcupsys2 libeel2-data libgail-common libgdl-
1-common
13149 libgnomeprint2.2-data libgnomeprintui2.2-common libgnomevfs2-bin
13150 libgtksourceview-common libpt-
1.10.10-plugins-alsa
13151 libpt-
1.10.10-plugins-v4l libservlet2.4-java libxalan2-java
13152 libxerces2-java openoffice.org-writer2latex openssl-blacklist p7zip
13153 python-
4suite-xml python-eggtrayicon python-gtkhtml2
13154 python-gtkmozembed svgalibg1 xserver-xephyr zip
13155 </p
></blockquote
>
13157 <p
>Installed using apt-get, removed with aptitude
</p
>
13159 <blockquote
><p
>
13160 bluez-utils dhcdbd djvulibre-desktop epiphany-gecko
13161 gnome-app-install gnome-mount gnome-vfs-obexftp gnome-volume-manager
13162 libao2 libavahi-compat-libdnssd1 libavahi-core5 libbind9-
50
13163 libbluetooth2 libcamel1.2-
11 libcdio7 libcucul0 libcurl3
13164 libdirectfb-
1.0-
0 libdvdread3 libedata-cal1.2-
6 libedataserver1.2-
9
13165 libeel2-
2.20 libepc-
1.0-
1 libepc-ui-
1.0-
1 libexchange-storage1.2-
3
13166 libfaad0 libgd2-noxpm libgda3-
3 libgda3-common libggz2 libggzcore9
13167 libggzmod4 libgksu1.2-
0 libgksuui1.0-
1 libgmyth0 libgnome-desktop-
2
13168 libgnome-pilot2 libgnomecups1.0-
1 libgnomeprint2.2-
0
13169 libgnomeprintui2.2-
0 libgpod3 libgraphviz4 libgtkhtml2-
0
13170 libgtksourceview1.0-
0 libgucharmap6 libhesiod0 libicu38 libisccc50
13171 libisccfg50 libiw29 libkpathsea4 libltdl3 liblwres50 libmagick++
10
13172 libmagick10 libmalaga7 libmtp7 libmysqlclient15off libnautilus-burn4
13173 libneon27 libnm-glib0 libnm-util0 libopal-
2.2 libosp5
13174 libparted1.8-
10 libpisock9 libpisync1 libpoppler-glib3 libpoppler3
13175 libpt-
1.10.10 libraw1394-
8 libsensors3 libsmbios2 libsoup2.2-
8
13176 libssh2-
1 libsuitesparse-
3.1.0 libswfdec-
0.6-
90 libtalloc1
13177 libtotem-plparser10 libtrackerclient0 libvoikko1 libxalan2-java-gcj
13178 libxerces2-java-gcj libxklavier12 libxtrap6 libxxf86misc1 libzephyr3
13179 mysql-common swfdec-gnome totem-gstreamer wodim
13180 </p
></blockquote
>
13182 <p
>Installed using aptitude, missing with apt-get
</p
>
13184 <blockquote
><p
>
13185 gnome gnome-desktop-environment hamster-applet python-gnomeapplet
13186 python-gnomekeyring python-wnck rhythmbox-plugins xorg
13187 xserver-xorg-input-all xserver-xorg-input-evdev
13188 xserver-xorg-input-kbd xserver-xorg-input-mouse
13189 xserver-xorg-input-synaptics xserver-xorg-video-all
13190 xserver-xorg-video-apm xserver-xorg-video-ark xserver-xorg-video-ati
13191 xserver-xorg-video-chips xserver-xorg-video-cirrus
13192 xserver-xorg-video-dummy xserver-xorg-video-fbdev
13193 xserver-xorg-video-glint xserver-xorg-video-i128
13194 xserver-xorg-video-i740 xserver-xorg-video-mach64
13195 xserver-xorg-video-mga xserver-xorg-video-neomagic
13196 xserver-xorg-video-nouveau xserver-xorg-video-nv
13197 xserver-xorg-video-r128 xserver-xorg-video-radeon
13198 xserver-xorg-video-radeonhd xserver-xorg-video-rendition
13199 xserver-xorg-video-s3 xserver-xorg-video-s3virge
13200 xserver-xorg-video-savage xserver-xorg-video-siliconmotion
13201 xserver-xorg-video-sis xserver-xorg-video-sisusb
13202 xserver-xorg-video-tdfx xserver-xorg-video-tga
13203 xserver-xorg-video-trident xserver-xorg-video-tseng
13204 xserver-xorg-video-vesa xserver-xorg-video-vmware
13205 xserver-xorg-video-voodoo
13206 </p
></blockquote
>
13208 <p
>Installed using aptitude, removed with apt-get
</p
>
13210 <blockquote
><p
>
13211 deskbar-applet xserver-xorg xserver-xorg-core
13212 xserver-xorg-input-wacom xserver-xorg-video-intel
13213 xserver-xorg-video-openchrome
13214 </p
></blockquote
>
13216 <p
>I was told on IRC that the xorg-xserver package was
13217 <a href=
"http://git.debian.org/?p=pkg-xorg/xserver/xorg-server.git;a=commit;h=
9c8080d06c457932d3bfec021c69ac000aa60120
">changed
13218 in git
</a
> today to try to get apt-get to not remove xorg completely.
13219 No idea when it hits Squeeze, but when it does I hope it will reduce
13220 the difference somewhat.
13225 <title>LUMA, a very nice LDAP GUI
</title>
13226 <link>http://www.hungry.com/~pere/blog/LUMA__a_very_nice_LDAP_GUI.html
</link>
13227 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/LUMA__a_very_nice_LDAP_GUI.html
</guid>
13228 <pubDate>Mon,
28 Jun
2010 00:
30:
00 +
0200</pubDate>
13229 <description><p
>The last few days I have been looking into the status of the LDAP
13230 directory in Debian Edu, and in the process I started to miss a GUI
13231 tool to browse the LDAP tree. The only one I was able to find in
13232 Debian/Squeeze and Lenny is
13233 <a href=
"http://luma.sourceforge.net/
">LUMA
</a
>, which has proved to
13234 be a great tool to get a overview of the current LDAP directory
13235 populated by default in Skolelinux. Thanks to it, I have been able to
13236 find empty and obsolete subtrees, misplaced objects and duplicate
13237 objects. It will be installed by default in Debian/Squeeze. If you
13238 are working with LDAP, give it a go. :)
</p
>
13240 <p
>I did notice one problem with it I have not had time to report to
13241 the BTS yet. There is no .desktop file in the package, so the tool do
13242 not show up in the Gnome and KDE menus, but only deep down in in the
13243 Debian submenu in KDE. I hope that can be fixed before Squeeze is
13244 released.
</p
>
13246 <p
>I have not yet been able to get it to modify the tree yet. I would
13247 like to move objects and remove subtrees directly in the GUI, but have
13248 not found a way to do that with LUMA yet. So in the mean time, I use
13249 <a href=
"http://www.lichteblau.com/ldapvi/
">ldapvi
</a
> for that.
</p
>
13251 <p
>If you have tips on other GUI tools for LDAP that might be useful
13252 in Debian Edu, please contact us on debian-edu@lists.debian.org.
</p
>
13254 <p
>Update
2010-
06-
29: Ross Reedstrom tipped us about the
13255 <a href=
"http://packages.qa.debian.org/g/gq.html
">gq
</a
> package as a
13256 useful GUI alternative. It seem like a good tool, but is unmaintained
13257 in Debian and got a RC bug keeping it out of Squeeze. Unless that
13258 changes, it will not be an option for Debian Edu based on Squeeze.
</p
>
13263 <title>Idea for a change to LDAP schemas allowing DNS and DHCP info to be combined into one object
</title>
13264 <link>http://www.hungry.com/~pere/blog/Idea_for_a_change_to_LDAP_schemas_allowing_DNS_and_DHCP_info_to_be_combined_into_one_object.html
</link>
13265 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Idea_for_a_change_to_LDAP_schemas_allowing_DNS_and_DHCP_info_to_be_combined_into_one_object.html
</guid>
13266 <pubDate>Thu,
24 Jun
2010 00:
35:
00 +
0200</pubDate>
13267 <description><p
>A while back, I
13268 <a href=
"http://www.hungry.com/~pere/blog/Time_for_new__LDAP_schemas_replacing_RFC_2307_.html
">complained
13269 about the fact
</a
> that it is not possible with the provided schemas
13270 for storing DNS and DHCP information in LDAP to combine the two sets
13271 of information into one LDAP object representing a computer.
</p
>
13273 <p
>In the mean time, I discovered that a simple fix would be to make
13274 the dhcpHost object class auxiliary, to allow it to be combined with
13275 the dNSDomain object class, and thus forming one object for one
13276 computer when storing both DHCP and DNS information in LDAP.
</p
>
13278 <p
>If I understand this correctly, it is not safe to do this change
13279 without also changing the assigned number for the object class, and I
13280 do not know enough about LDAP schema design to do that properly for
13281 Debian Edu.
</p
>
13283 <p
>Anyway, for future reference, this is how I believe we could change
13285 <a href=
"http://tools.ietf.org/html/draft-ietf-dhc-ldap-schema-
00">DHCP
13286 schema
</a
> to solve at least part of the problem with the LDAP schemas
13287 available today from IETF.
</p
>
13290 --- dhcp.schema (revision
65192)
13291 +++ dhcp.schema (working copy)
13292 @@ -
376,
7 +
376,
7 @@
13293 objectclass (
2.16.840.1.113719.1.203.6.6
13294 NAME
'dhcpHost
'
13295 DESC
'This represents information about a particular client
'
13297 + SUP top AUXILIARY
13299 MAY (dhcpLeaseDN $ dhcpHWAddress $ dhcpOptionsDN $ dhcpStatements $ dhcpComments $ dhcpOption)
13300 X-NDS_CONTAINMENT (
'dhcpService
' 'dhcpSubnet
' 'dhcpGroup
') )
13303 <p
>I very much welcome clues on how to do this properly for Debian
13304 Edu/Squeeze. We provide the DHCP schema in our debian-edu-config
13305 package, and should thus be free to rewrite it as we see fit.
</p
>
13307 <p
>If you want to help out with implementing this for Debian Edu,
13308 please contact us on debian-edu@lists.debian.org.
</p
>
13313 <title>Calling tasksel like the installer, while still getting useful output
</title>
13314 <link>http://www.hungry.com/~pere/blog/Calling_tasksel_like_the_installer__while_still_getting_useful_output.html
</link>
13315 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Calling_tasksel_like_the_installer__while_still_getting_useful_output.html
</guid>
13316 <pubDate>Wed,
16 Jun
2010 14:
55:
00 +
0200</pubDate>
13317 <description><p
>A few times I have had the need to simulate the way tasksel
13318 installs packages during the normal debian-installer run. Until now,
13319 I have ended up letting tasksel do the work, with the annoying problem
13320 of not getting any feedback at all when something fails (like a
13321 conffile question from dpkg or a download that fails), using code like
13324 <blockquote
><pre
>
13325 export DEBIAN_FRONTEND=noninteractive
13326 tasksel --new-install
13327 </pre
></blockquote
>
13329 This would invoke tasksel, let its automatic task selection pick the
13330 tasks to install, and continue to install the requested tasks without
13331 any output what so ever.
13333 Recently I revisited this problem while working on the automatic
13334 package upgrade testing, because tasksel would some times hang without
13335 any useful feedback, and I want to see what is going on when it
13336 happen. Then it occured to me, I can parse the output from tasksel
13337 when asked to run in test mode, and use that aptitude command line
13338 printed by tasksel then to simulate the tasksel run. I ended up using
13341 <blockquote
><pre
>
13342 export DEBIAN_FRONTEND=noninteractive
13343 cmd=
"$(in_target tasksel -t --new-install | sed
's/debconf-apt-progress -- //
')
"
13345 </pre
></blockquote
>
13347 <p
>The content of $cmd is typically something like
"<tt
>aptitude -q
13348 --without-recommends -o APT::Install-Recommends=no -y install
13349 ~t^desktop$ ~t^gnome-desktop$ ~t^laptop$ ~pstandard ~prequired
13350 ~pimportant
</tt
>", which will install the gnome desktop task, the
13351 laptop task and all packages with priority standard , required and
13352 important, just like tasksel would have done it during
13353 installation.
</p
>
13355 <p
>A better approach is probably to extend tasksel to be able to
13356 install packages without using debconf-apt-progress, for use cases
13357 like this.
</p
>
13362 <title>Lenny-
>Squeeze upgrades, removals by apt and aptitude
</title>
13363 <link>http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades__removals_by_apt_and_aptitude.html
</link>
13364 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Lenny__Squeeze_upgrades__removals_by_apt_and_aptitude.html
</guid>
13365 <pubDate>Sun,
13 Jun
2010 09:
05:
00 +
0200</pubDate>
13366 <description><p
>My
13367 <a href=
"http://www.hungry.com/~pere/blog/Automatic_upgrade_testing_from_Lenny_to_Squeeze.html
">testing
13368 of Debian upgrades
</a
> from Lenny to Squeeze continues, and I
've
13369 finally made the upgrade logs available from
13370 <a href=
"http://www.hungry.com/~pere/debian-upgrade-testing/
">http://www.hungry.com/~pere/debian-upgrade-testing/
</a
>.
13371 I am now testing dist-upgrade of Gnome and KDE in a chroot using both
13372 apt and aptitude, and found their differences interesting. This time
13373 I will only focus on their removal plans.
</p
>
13375 <p
>After installing a Gnome desktop and the laptop task, apt-get wants
13376 to remove
72 packages when dist-upgrading from Lenny to Squeeze. The
13377 surprising part is that it want to remove xorg and all
13378 xserver-xorg-video* drivers. Clearly not a good choice, but I am not
13379 sure why. When asking aptitude to do the same, it want to remove
129
13380 packages, but most of them are library packages I suspect are no
13381 longer needed. Both of them want to remove bluetooth packages, which
13382 I do not know. Perhaps these bluetooth packages are obsolete?
</p
>
13384 <p
>For KDE, apt-get want to remove
82 packages, among them kdebase
13385 which seem like a bad idea and xorg the same way as with Gnome. Asking
13386 aptitude for the same, it wants to remove
192 packages, none which are
13387 too surprising.
</p
>
13389 <p
>I guess the removal of xorg during upgrades should be investigated
13390 and avoided, and perhaps others as well. Here are the complete list
13391 of planned removals. The complete logs is available from the URL
13392 above. Note if you want to repeat these tests, that the upgrade test
13393 for kde+apt-get hung in the tasksel setup because of dpkg asking
13394 conffile questions. No idea why. I worked around it by using
13395 '<tt
>echo
>> /proc/
<em
>pidofdpkg
</em
>/fd/
0</tt
>' to tell dpkg to
13396 continue.
</p
>
13398 <p
><b
>apt-get gnome
72</b
>
13399 <br
>bluez-gnome cupsddk-drivers deskbar-applet gnome
13400 gnome-desktop-environment gnome-network-admin gtkhtml3.14
13401 iceweasel-gnome-support libavcodec51 libdatrie0 libgdl-
1-
0
13402 libgnomekbd2 libgnomekbdui2 libmetacity0 libslab0 libxcb-xlib0
13403 nautilus-cd-burner python-gnome2-desktop python-gnome2-extras
13404 serpentine swfdec-mozilla update-manager xorg xserver-xorg
13405 xserver-xorg-core xserver-xorg-input-all xserver-xorg-input-evdev
13406 xserver-xorg-input-kbd xserver-xorg-input-mouse
13407 xserver-xorg-input-synaptics xserver-xorg-input-wacom
13408 xserver-xorg-video-all xserver-xorg-video-apm xserver-xorg-video-ark
13409 xserver-xorg-video-ati xserver-xorg-video-chips
13410 xserver-xorg-video-cirrus xserver-xorg-video-cyrix
13411 xserver-xorg-video-dummy xserver-xorg-video-fbdev
13412 xserver-xorg-video-glint xserver-xorg-video-i128
13413 xserver-xorg-video-i740 xserver-xorg-video-imstt
13414 xserver-xorg-video-intel xserver-xorg-video-mach64
13415 xserver-xorg-video-mga xserver-xorg-video-neomagic
13416 xserver-xorg-video-nsc xserver-xorg-video-nv
13417 xserver-xorg-video-openchrome xserver-xorg-video-r128
13418 xserver-xorg-video-radeon xserver-xorg-video-radeonhd
13419 xserver-xorg-video-rendition xserver-xorg-video-s3
13420 xserver-xorg-video-s3virge xserver-xorg-video-savage
13421 xserver-xorg-video-siliconmotion xserver-xorg-video-sis
13422 xserver-xorg-video-sisusb xserver-xorg-video-tdfx
13423 xserver-xorg-video-tga xserver-xorg-video-trident
13424 xserver-xorg-video-tseng xserver-xorg-video-v4l
13425 xserver-xorg-video-vesa xserver-xorg-video-vga
13426 xserver-xorg-video-vmware xserver-xorg-video-voodoo xulrunner-
1.9
13427 xulrunner-
1.9-gnome-support
</p
>
13429 <p
><b
>aptitude gnome
129</b
>
13431 <br
>bluez-gnome bluez-utils cpp-
4.3 cupsddk-drivers dhcdbd
13432 djvulibre-desktop finger gnome-app-install gnome-mount
13433 gnome-network-admin gnome-spell gnome-vfs-obexftp
13434 gnome-volume-manager gstreamer0.10-gnomevfs gtkhtml3.14 libao2
13435 libavahi-compat-libdnssd1 libavahi-core5 libavcodec51 libbluetooth2
13436 libcamel1.2-
11 libcdio7 libcucul0 libcupsys2 libcurl3 libdatrie0
13437 libdirectfb-
1.0-
0 libdvdread3 libedataserver1.2-
9 libeel2-
2.20
13438 libeel2-data libepc-
1.0-
1 libepc-ui-
1.0-
1 libfaad0 libgail-common
13439 libgd2-noxpm libgda3-
3 libgda3-common libgdl-
1-
0 libgdl-
1-common
13440 libggz2 libggzcore9 libggzmod4 libgksu1.2-
0 libgksuui1.0-
1 libgmyth0
13441 libgnomecups1.0-
1 libgnomekbd2 libgnomekbdui2 libgnomeprint2.2-
0
13442 libgnomeprint2.2-data libgnomeprintui2.2-
0 libgnomeprintui2.2-common
13443 libgnomevfs2-bin libgpod3 libgraphviz4 libgtkhtml2-
0
13444 libgtksourceview-common libgtksourceview1.0-
0 libgucharmap6
13445 libhesiod0 libicu38 libiw29 libkpathsea4 libltdl3 libmagick++
10
13446 libmagick10 libmalaga7 libmetacity0 libmtp7 libmysqlclient15off
13447 libnautilus-burn4 libneon27 libnm-glib0 libnm-util0 libopal-
2.2
13448 libosp5 libparted1.8-
10 libpoppler-glib3 libpoppler3 libpt-
1.10.10
13449 libpt-
1.10.10-plugins-alsa libpt-
1.10.10-plugins-v4l libraw1394-
8
13450 libsensors3 libslab0 libsmbios2 libsoup2.2-
8 libssh2-
1
13451 libsuitesparse-
3.1.0 libswfdec-
0.6-
90 libtalloc1 libtotem-plparser10
13452 libtrackerclient0 libxalan2-java libxalan2-java-gcj libxcb-xlib0
13453 libxerces2-java libxerces2-java-gcj libxklavier12 libxtrap6
13454 libxxf86misc1 libzephyr3 mysql-common nautilus-cd-burner
13455 openoffice.org-writer2latex openssl-blacklist p7zip
13456 python-
4suite-xml python-eggtrayicon python-gnome2-desktop
13457 python-gnome2-extras python-gtkhtml2 python-gtkmozembed
13458 python-numeric python-sexy serpentine svgalibg1 swfdec-gnome
13459 swfdec-mozilla totem-gstreamer update-manager wodim
13460 xserver-xorg-video-cyrix xserver-xorg-video-imstt
13461 xserver-xorg-video-nsc xserver-xorg-video-v4l xserver-xorg-video-vga
13464 <p
><b
>apt-get kde
82</b
>
13466 <br
>cupsddk-drivers karm kaudiocreator kcoloredit kcontrol kde kde-core
13467 kdeaddons kdeartwork kdebase kdebase-bin kdebase-bin-kde3
13468 kdebase-kio-plugins kdesktop kdeutils khelpcenter kicker
13469 kicker-applets knewsticker kolourpaint konq-plugins konqueror korn
13470 kpersonalizer kscreensaver ksplash libavcodec51 libdatrie0 libkiten1
13471 libxcb-xlib0 quanta superkaramba texlive-base-bin xorg xserver-xorg
13472 xserver-xorg-core xserver-xorg-input-all xserver-xorg-input-evdev
13473 xserver-xorg-input-kbd xserver-xorg-input-mouse
13474 xserver-xorg-input-synaptics xserver-xorg-input-wacom
13475 xserver-xorg-video-all xserver-xorg-video-apm xserver-xorg-video-ark
13476 xserver-xorg-video-ati xserver-xorg-video-chips
13477 xserver-xorg-video-cirrus xserver-xorg-video-cyrix
13478 xserver-xorg-video-dummy xserver-xorg-video-fbdev
13479 xserver-xorg-video-glint xserver-xorg-video-i128
13480 xserver-xorg-video-i740 xserver-xorg-video-imstt
13481 xserver-xorg-video-intel xserver-xorg-video-mach64
13482 xserver-xorg-video-mga xserver-xorg-video-neomagic
13483 xserver-xorg-video-nsc xserver-xorg-video-nv
13484 xserver-xorg-video-openchrome xserver-xorg-video-r128
13485 xserver-xorg-video-radeon xserver-xorg-video-radeonhd
13486 xserver-xorg-video-rendition xserver-xorg-video-s3
13487 xserver-xorg-video-s3virge xserver-xorg-video-savage
13488 xserver-xorg-video-siliconmotion xserver-xorg-video-sis
13489 xserver-xorg-video-sisusb xserver-xorg-video-tdfx
13490 xserver-xorg-video-tga xserver-xorg-video-trident
13491 xserver-xorg-video-tseng xserver-xorg-video-v4l
13492 xserver-xorg-video-vesa xserver-xorg-video-vga
13493 xserver-xorg-video-vmware xserver-xorg-video-voodoo xulrunner-
1.9</p
>
13495 <p
><b
>aptitude kde
192</b
>
13496 <br
>bluez-utils cpp-
4.3 cupsddk-drivers cvs dcoprss dhcdbd
13497 djvulibre-desktop dosfstools eyesapplet fifteenapplet finger gettext
13498 ghostscript-x imlib-base imlib11 indi kandy karm kasteroids
13499 kaudiocreator kbackgammon kbstate kcoloredit kcontrol kcron kdat
13500 kdeadmin-kfile-plugins kdeartwork-misc kdeartwork-theme-window
13501 kdebase-bin-kde3 kdebase-kio-plugins kdeedu-data
13502 kdegraphics-kfile-plugins kdelirc kdemultimedia-kappfinder-data
13503 kdemultimedia-kfile-plugins kdenetwork-kfile-plugins
13504 kdepim-kfile-plugins kdepim-kio-plugins kdeprint kdesktop kdessh
13505 kdict kdnssd kdvi kedit keduca kenolaba kfax kfaxview kfouleggs
13506 kghostview khelpcenter khexedit kiconedit kitchensync klatin
13507 klickety kmailcvt kmenuedit kmid kmilo kmoon kmrml kodo kolourpaint
13508 kooka korn kpager kpdf kpercentage kpf kpilot kpoker kpovmodeler
13509 krec kregexpeditor ksayit ksim ksirc ksirtet ksmiletris ksmserver
13510 ksnake ksokoban ksplash ksvg ksysv ktip ktnef kuickshow kverbos
13511 kview kviewshell kvoctrain kwifimanager kwin kwin4 kworldclock
13512 kxsldbg libakode2 libao2 libarts1-akode libarts1-audiofile
13513 libarts1-mpeglib libarts1-xine libavahi-compat-libdnssd1
13514 libavahi-core5 libavc1394-
0 libavcodec51 libbluetooth2
13515 libboost-python1.34
.1 libcucul0 libcurl3 libcvsservice0 libdatrie0
13516 libdirectfb-
1.0-
0 libdjvulibre21 libdvdread3 libfaad0 libfreebob0
13517 libgail-common libgd2-noxpm libgraphviz4 libgsmme1c2a libgtkhtml2-
0
13518 libicu38 libiec61883-
0 libindex0 libiw29 libk3b3 libkcal2b libkcddb1
13519 libkdeedu3 libkdepim1a libkgantt0 libkiten1 libkleopatra1 libkmime2
13520 libkpathsea4 libkpimexchange1 libkpimidentities1 libkscan1
13521 libksieve0 libktnef1 liblockdev1 libltdl3 libmagick10 libmimelib1c2a
13522 libmozjs1d libmpcdec3 libneon27 libnm-util0 libopensync0 libpisock9
13523 libpoppler-glib3 libpoppler-qt2 libpoppler3 libraw1394-
8 libsmbios2
13524 libssh2-
1 libsuitesparse-
3.1.0 libtalloc1 libtiff-tools
13525 libxalan2-java libxalan2-java-gcj libxcb-xlib0 libxerces2-java
13526 libxerces2-java-gcj libxtrap6 mpeglib networkstatus
13527 openoffice.org-writer2latex pmount poster psutils quanta quanta-data
13528 superkaramba svgalibg1 tex-common texlive-base texlive-base-bin
13529 texlive-common texlive-doc-base texlive-fonts-recommended
13530 xserver-xorg-video-cyrix xserver-xorg-video-imstt
13531 xserver-xorg-video-nsc xserver-xorg-video-v4l xserver-xorg-video-vga
13532 xulrunner-
1.9</p
>
13538 <title>Automatic upgrade testing from Lenny to Squeeze
</title>
13539 <link>http://www.hungry.com/~pere/blog/Automatic_upgrade_testing_from_Lenny_to_Squeeze.html
</link>
13540 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Automatic_upgrade_testing_from_Lenny_to_Squeeze.html
</guid>
13541 <pubDate>Fri,
11 Jun
2010 22:
50:
00 +
0200</pubDate>
13542 <description><p
>The last few days I have done some upgrade testing in Debian, to
13543 see if the upgrade from Lenny to Squeeze will go smoothly. A few bugs
13544 have been discovered and reported in the process
13545 (
<a href=
"http://bugs.debian.org/
585410">#
585410</a
> in nagios3-cgi,
13546 <a href=
"http://bugs.debian.org/
584879">#
584879</a
> already fixed in
13547 enscript and
<a href=
"http://bugs.debian.org/
584861">#
584861</a
> in
13548 kdebase-workspace-data), and to get a more regular testing going on, I
13549 am working on a script to automate the test.
</p
>
13551 <p
>The idea is to create a Lenny chroot and use tasksel to install a
13552 Gnome or KDE desktop installation inside the chroot before upgrading
13553 it. To ensure no services are started in the chroot, a policy-rc.d
13554 script is inserted. To make sure tasksel believe it is to install a
13555 desktop on a laptop, the tasksel tests are replaced in the chroot
13556 (only acceptable because this is a throw-away chroot).
</p
>
13558 <p
>A naive upgrade from Lenny to Squeeze using aptitude dist-upgrade
13559 currently always fail because udev refuses to upgrade with the kernel
13560 in Lenny, so to avoid that problem the file /etc/udev/kernel-upgrade
13561 is created. The bug report
13562 <a href=
"http://bugs.debian.org/
566000">#
566000</a
> make me suspect
13563 this problem do not trigger in a chroot, but I touch the file anyway
13564 to make sure the upgrade go well. Testing on virtual and real
13565 hardware have failed me because of udev so far, and creating this file
13566 do the trick in such settings anyway. This is a
13567 <a href=
"http://www.linuxquestions.org/questions/debian-
26/failed-dist-upgrade-due-to-udev-config_sysfs_deprecated-nonsense-
804130/
">known
13568 issue
</a
> and the current udev behaviour is intended by the udev
13569 maintainer because he lack the resources to rewrite udev to keep
13570 working with old kernels or something like that. I really wish the
13571 udev upstream would keep udev backwards compatible, to avoid such
13572 upgrade problem, but given that they fail to do so, I guess
13573 documenting the way out of this mess is the best option we got for
13574 Debian Squeeze.
</p
>
13576 <p
>Anyway, back to the task at hand, testing upgrades. This test
13577 script, which I call
<tt
>upgrade-test
</tt
> for now, is doing the
13580 <blockquote
><pre
>
13584 if [
"$
1" ] ; then
13593 exec
&lt; /dev/null
13595 mirror=http://ftp.skolelinux.org/debian
13596 tmpdir=chroot-$from-upgrade-$to-$desktop
13598 debootstrap $from $tmpdir $mirror
13599 chroot $tmpdir aptitude update
13600 cat
> $tmpdir/usr/sbin/policy-rc.d
&lt;
&lt;EOF
13604 chmod a+rx $tmpdir/usr/sbin/policy-rc.d
13606 umount $tmpdir/proc
13608 mount -t proc proc $tmpdir/proc
13609 # Make sure proc is unmounted also on failure
13610 trap exit_cleanup EXIT INT
13612 chroot $tmpdir aptitude -y install debconf-utils
13614 # Make sure tasksel autoselection trigger. It need the test scripts
13615 # to return the correct answers.
13616 echo tasksel tasksel/desktop multiselect $desktop | \
13617 chroot $tmpdir debconf-set-selections
13619 # Include the desktop and laptop task
13620 for test in desktop laptop ; do
13621 echo
> $tmpdir/usr/lib/tasksel/tests/$test
&lt;
&lt;EOF
13625 chmod a+rx $tmpdir/usr/lib/tasksel/tests/$test
13628 DEBIAN_FRONTEND=noninteractive
13629 DEBIAN_PRIORITY=critical
13630 export DEBIAN_FRONTEND DEBIAN_PRIORITY
13631 chroot $tmpdir tasksel --new-install
13633 echo deb $mirror $to main
> $tmpdir/etc/apt/sources.list
13634 chroot $tmpdir aptitude update
13635 touch $tmpdir/etc/udev/kernel-upgrade
13636 chroot $tmpdir aptitude -y dist-upgrade
13638 </pre
></blockquote
>
13640 <p
>I suspect it would be useful to test upgrades with both apt-get and
13641 with aptitude, but I have not had time to look at how they behave
13642 differently so far. I hope to get a cron job running to do the test
13643 regularly and post the result on the web. The Gnome upgrade currently
13644 work, while the KDE upgrade fail because of the bug in
13645 kdebase-workspace-data
</p
>
13647 <p
>I am not quite sure what kind of extract from the huge upgrade logs
13648 (KDE
167 KiB, Gnome
516 KiB) it make sense to include in this blog
13649 post, so I will refrain from trying. I can report that for Gnome,
13650 aptitude report
760 packages upgraded,
448 newly installed,
129 to
13651 remove and
1 not upgraded and
1024MB need to be downloaded while for
13652 KDE the same numbers are
702 packages upgraded,
507 newly installed,
13653 193 to remove and
0 not upgraded and
1117MB need to be downloaded
</p
>
13655 <p
>I am very happy to notice that the Gnome desktop + laptop upgrade
13656 is able to migrate to dependency based boot sequencing and parallel
13657 booting without a hitch. Was unsure if there were still bugs with
13658 packages failing to clean up their obsolete init.d script during
13659 upgrades, and no such problem seem to affect the Gnome desktop+laptop
13660 packages.
</p
>
13665 <title>Upstart or sysvinit - as init.d scripts see it
</title>
13666 <link>http://www.hungry.com/~pere/blog/Upstart_or_sysvinit___as_init_d_scripts_see_it.html
</link>
13667 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Upstart_or_sysvinit___as_init_d_scripts_see_it.html
</guid>
13668 <pubDate>Sun,
6 Jun
2010 23:
55:
00 +
0200</pubDate>
13669 <description><p
>If Debian is to migrate to upstart on Linux, I expect some init.d
13670 scripts to migrate (some of) their operations to upstart job while
13671 keeping the init.d for hurd and kfreebsd. The packages with such
13672 needs will need a way to get their init.d scripts to behave
13673 differently when used with sysvinit and with upstart. Because of
13674 this, I had a look at the environment variables set when a init.d
13675 script is running under upstart, and when it is not.
</p
>
13677 <p
>With upstart, I notice these environment variables are set when a
13678 script is started from rcS.d/ (ignoring some irrelevant ones like
13679 COLUMNS):
</p
>
13681 <blockquote
><pre
>
13687 UPSTART_EVENTS=startup
13689 UPSTART_JOB=rc-sysinit
13690 </pre
></blockquote
>
13692 <p
>With sysvinit, these environment variables are set for the same
13695 <blockquote
><pre
>
13696 INIT_VERSION=sysvinit-
2.88
13701 </pre
></blockquote
>
13703 <p
>The RUNLEVEL and PREVLEVEL environment variables passed on from
13704 sysvinit are not set by upstart. Not sure if it is intentional or not
13705 to not be compatible with sysvinit in this regard.
</p
>
13707 <p
>For scripts needing to behave differently when upstart is used,
13708 looking for the UPSTART_JOB environment variable seem to be a good
13714 <title>A manual for standards wars...
</title>
13715 <link>http://www.hungry.com/~pere/blog/A_manual_for_standards_wars___.html
</link>
13716 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/A_manual_for_standards_wars___.html
</guid>
13717 <pubDate>Sun,
6 Jun
2010 14:
15:
00 +
0200</pubDate>
13718 <description><p
>Via the
13719 <a href=
"http://feedproxy.google.com/~r/robweir/antic-atom/~
3/QzU4RgoAGMg/weekly-links-
10.html
">blog
13720 of Rob Weir
</a
> I came across the very interesting essay named
13721 <a href=
"http://faculty.haas.berkeley.edu/shapiro/wars.pdf
">The Art of
13722 Standards Wars
</a
> (PDF
25 pages). I recommend it for everyone
13723 following the standards wars of today.
</p
>
13728 <title>Sitesummary tip: Listing computer hardware models used at site
</title>
13729 <link>http://www.hungry.com/~pere/blog/Sitesummary_tip__Listing_computer_hardware_models_used_at_site.html
</link>
13730 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Sitesummary_tip__Listing_computer_hardware_models_used_at_site.html
</guid>
13731 <pubDate>Thu,
3 Jun
2010 12:
05:
00 +
0200</pubDate>
13732 <description><p
>When using sitesummary at a site to track machines, it is possible
13733 to get a list of the machine types in use thanks to the DMI
13734 information extracted from each machine. The script to do so is
13735 included in the sitesummary package, and here is example output from
13736 the Skolelinux build servers:
</p
>
13738 <blockquote
><pre
>
13739 maintainer:~# /usr/lib/sitesummary/hardware-model-summary
13741 Dell Computer Corporation
1
13744 eserver xSeries
345 -[
8670M1X]-
1
13748 </pre
></blockquote
>
13750 <p
>The quality of the report depend on the quality of the DMI tables
13751 provided in each machine. Here there are Intel machines without model
13752 information listed with Intel as vendor and no model, and virtual Xen
13753 machines listed as [no-dmi-info]. One can add -l as a command line
13754 option to list the individual machines.
</p
>
13756 <p
>A larger list is
13757 <a href=
"http://narvikskolen.no/sitesummary/
">available from the the
13758 city of Narvik
</a
>, which uses Skolelinux on all their shools and also
13759 provide the basic sitesummary report publicly. In their report there
13760 are ~
1400 machines. I know they use both Ubuntu and Skolelinux on
13761 their machines, and as sitesummary is available in both distributions,
13762 it is trivial to get all of them to report to the same central
13763 collector.
</p
>
13768 <title>KDM fail at boot with NVidia cards - and no one try to fix it?
</title>
13769 <link>http://www.hungry.com/~pere/blog/KDM_fail_at_boot_with_NVidia_cards___and_no_one_try_to_fix_it_.html
</link>
13770 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/KDM_fail_at_boot_with_NVidia_cards___and_no_one_try_to_fix_it_.html
</guid>
13771 <pubDate>Tue,
1 Jun
2010 17:
05:
00 +
0200</pubDate>
13772 <description><p
>It is strange to watch how a bug in Debian causing KDM to fail to
13773 start at boot when an NVidia video card is used is handled. The
13774 problem seem to be that the nvidia X.org driver uses a long time to
13775 initialize, and this duration is longer than kdm is configured to
13778 <p
>I came across two bugs related to this issue,
13779 <a href=
"http://bugs.debian.org/
583312">#
583312</a
> initially filed
13780 against initscripts and passed on to nvidia-glx when it became obvious
13781 that the nvidia drivers were involved, and
13782 <a href=
"http://bugs.debian.org/
524751">#
524751</a
> initially filed against
13783 kdm and passed on to src:nvidia-graphics-drivers for unknown reasons.
</p
>
13785 <p
>To me, it seem that no-one is interested in actually solving the
13786 problem nvidia video card owners experience and make sure the Debian
13787 distribution work out of the box for these users. The nvidia driver
13788 maintainers expect kdm to be set up to wait longer, while kdm expect
13789 the nvidia driver maintainers to fix the driver to start faster, and
13790 while they wait for each other I guess the users end up switching to a
13791 distribution that work for them. I have no idea what the solution is,
13792 but I am pretty sure that waiting for each other is not it.
</p
>
13794 <p
>I wonder why we end up handling bugs this way.
</p
>
13799 <title>Parallellized boot seem to hold up well in Debian/testing
</title>
13800 <link>http://www.hungry.com/~pere/blog/Parallellized_boot_seem_to_hold_up_well_in_Debian_testing.html
</link>
13801 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Parallellized_boot_seem_to_hold_up_well_in_Debian_testing.html
</guid>
13802 <pubDate>Thu,
27 May
2010 23:
55:
00 +
0200</pubDate>
13803 <description><p
>A few days ago, parallel booting was enabled in Debian/testing.
13804 The feature seem to hold up pretty well, but three fairly serious
13805 issues are known and should be solved:
13807 <p
><ul
>
13809 <li
>The wicd package seen to
13810 <a href=
"http://bugs.debian.org/
508289">break NFS mounting
</a
> and
13811 <a href=
"http://bugs.debian.org/
581586">network setup
</a
> when
13812 parallel booting is enabled. No idea why, but the wicd maintainer
13813 seem to be on the case.
</li
>
13815 <li
>The nvidia X driver seem to
13816 <a href=
"http://bugs.debian.org/
583312">have a race condition
</a
>
13817 triggered more easily when parallel booting is in effect. The
13818 maintainer is on the case.
</li
>
13820 <li
>The sysv-rc package fail to properly enable dependency based boot
13821 sequencing (the shutdown is broken) when old file-rc users
13822 <a href=
"http://bugs.debian.org/
575080">try to switch back
</a
> to
13823 sysv-rc. One way to solve it would be for file-rc to create
13824 /etc/init.d/.legacy-bootordering, and another is to try to make
13825 sysv-rc more robust. Will investigate some more and probably upload a
13826 workaround in sysv-rc to help those trying to move from file-rc to
13827 sysv-rc get a working shutdown.
</li
>
13829 </ul
></p
>
13831 <p
>All in all not many surprising issues, and all of them seem
13832 solvable before Squeeze is released. In addition to these there are
13833 some packages with bugs in their dependencies and run level settings,
13834 which I expect will be fixed in a reasonable time span.
</p
>
13836 <p
>If you report any problems with dependencies in init.d scripts to
13837 the BTS, please usertag the report to get it to show up at
13838 <a href=
"http://bugs.debian.org/cgi-bin/pkgreport.cgi?users=initscripts-ng-devel@lists.alioth.debian.org
">the
13839 list of usertagged bugs related to this
</a
>.
</p
>
13841 <p
>Update: Correct bug number to file-rc issue.
</p
>
13846 <title>More flexible firmware handling in debian-installer
</title>
13847 <link>http://www.hungry.com/~pere/blog/More_flexible_firmware_handling_in_debian_installer.html
</link>
13848 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/More_flexible_firmware_handling_in_debian_installer.html
</guid>
13849 <pubDate>Sat,
22 May
2010 21:
30:
00 +
0200</pubDate>
13850 <description><p
>After a long break from debian-installer development, I finally
13851 found time today to return to the project. Having to spend less time
13852 working dependency based boot in debian, as it is almost complete now,
13853 definitely helped freeing some time.
</p
>
13855 <p
>A while back, I ran into a problem while working on Debian Edu. We
13856 include some firmware packages on the Debian Edu CDs, those needed to
13857 get disk and network controllers working. Without having these
13858 firmware packages available during installation, it is impossible to
13859 install Debian Edu on the given machine, and because our target group
13860 are non-technical people, asking them to provide firmware packages on
13861 an external medium is a support pain. Initially, I expected it to be
13862 enough to include the firmware packages on the CD to get
13863 debian-installer to find and use them. This proved to be wrong.
13864 Next, I hoped it was enough to symlink the relevant firmware packages
13865 to some useful location on the CD (tried /cdrom/ and
13866 /cdrom/firmware/). This also proved to not work, and at this point I
13867 found time to look at the debian-installer code to figure out what was
13868 going to work.
</p
>
13870 <p
>The firmware loading code is in the hw-detect package, and a closer
13871 look revealed that it would only look for firmware packages outside
13872 the installation media, so the CD was never checked for firmware
13873 packages. It would only check USB sticks, floppies and other
13874 "external
" media devices. Today I changed it to also look in the
13875 /cdrom/firmware/ directory on the mounted CD or DVD, which should
13876 solve the problem I ran into with Debian edu. I also changed it to
13877 look in /firmware/, to make sure the installer also find firmware
13878 provided in the initrd when booting the installer via PXE, to allow us
13879 to provide the same feature in the PXE setup included in Debian
13882 <p
>To make sure firmware deb packages with a license questions are not
13883 activated without asking if the license is accepted, I extended
13884 hw-detect to look for preinst scripts in the firmware packages, and
13885 run these before activating the firmware during installation. The
13886 license question is asked using debconf in the preinst, so this should
13887 solve the issue for the firmware packages I have looked at so far.
</p
>
13889 <p
>If you want to discuss the details of these features, please
13890 contact us on debian-boot@lists.debian.org.
</p
>
13895 <title>Parallellized boot is now the default in Debian/unstable
</title>
13896 <link>http://www.hungry.com/~pere/blog/Parallellized_boot_is_now_the_default_in_Debian_unstable.html
</link>
13897 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Parallellized_boot_is_now_the_default_in_Debian_unstable.html
</guid>
13898 <pubDate>Fri,
14 May
2010 22:
40:
00 +
0200</pubDate>
13899 <description><p
>Since this evening, parallel booting is the default in
13900 Debian/unstable for machines using dependency based boot sequencing.
13901 Apparently the testing of concurrent booting has been wider than
13902 expected, if I am to believe the
13903 <a href=
"http://lists.debian.org/debian-devel/
2010/
05/msg00122.html
">input
13904 on debian-devel@
</a
>, and I concluded a few days ago to move forward
13905 with the feature this weekend, to give us some time to detect any
13906 remaining problems before Squeeze is frozen. If serious problems are
13907 detected, it is simple to change the default back to sequential boot.
13908 The upload of the new sysvinit package also activate a new upstream
13911 More information about
13912 <a href=
"http://wiki.debian.org/LSBInitScripts/DependencyBasedBoot
">dependency
13913 based boot sequencing
</a
> is available from the Debian wiki. It is
13914 currently possible to disable parallel booting when one run into
13915 problems caused by it, by adding this line to /etc/default/rcS:
</p
>
13917 <blockquote
><pre
>
13919 </pre
></blockquote
>
13921 <p
>If you report any problems with dependencies in init.d scripts to
13922 the BTS, please usertag the report to get it to show up at
13923 <a href=
"http://bugs.debian.org/cgi-bin/pkgreport.cgi?users=initscripts-ng-devel@lists.alioth.debian.org
">the
13924 list of usertagged bugs related to this
</a
>.
</p
>
13929 <title>Sitesummary tip: Listing MAC address of all clients
</title>
13930 <link>http://www.hungry.com/~pere/blog/Sitesummary_tip__Listing_MAC_address_of_all_clients.html
</link>
13931 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Sitesummary_tip__Listing_MAC_address_of_all_clients.html
</guid>
13932 <pubDate>Fri,
14 May
2010 21:
10:
00 +
0200</pubDate>
13933 <description><p
>In the recent Debian Edu versions, the
13934 <a href=
"http://wiki.debian.org/DebianEdu/HowTo/SiteSummary
">sitesummary
13935 system
</a
> is used to keep track of the machines in the school
13936 network. Each machine will automatically report its status to the
13937 central server after boot and once per night. The network setup is
13938 also reported, and using this information it is possible to get the
13939 MAC address of all network interfaces in the machines. This is useful
13940 to update the DHCP configuration.
</p
>
13942 <p
>To give some idea how to use sitesummary, here is a one-liner to
13943 ist all MAC addresses of all machines reporting to sitesummary. Run
13944 this on the collector host:
</p
>
13946 <blockquote
><pre
>
13947 perl -MSiteSummary -e
'for_all_hosts(sub { print join(
" ", get_macaddresses(shift)),
"\n
"; });
'
13948 </pre
></blockquote
>
13950 <p
>This will list all MAC addresses assosiated with all machine, one
13951 line per machine and with space between the MAC addresses.
</p
>
13953 <p
>To allow system administrators easier job at adding static DHCP
13954 addresses for hosts, it would be possible to extend this to fetch
13955 machine information from sitesummary and update the DHCP and DNS
13956 tables in LDAP using this information. Such tool is unfortunately not
13957 written yet.
</p
>
13962 <title>systemd, an interesting alternative to upstart
</title>
13963 <link>http://www.hungry.com/~pere/blog/systemd__an_interesting_alternative_to_upstart.html
</link>
13964 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/systemd__an_interesting_alternative_to_upstart.html
</guid>
13965 <pubDate>Thu,
13 May
2010 22:
20:
00 +
0200</pubDate>
13966 <description><p
>The last few days a new boot system called
13967 <a href=
"http://www.freedesktop.org/wiki/Software/systemd
">systemd
</a
>
13969 <a href=
"http://
0pointer.de/blog/projects/systemd.html
">introduced
</a
>
13971 to the free software world. I have not yet had time to play around
13972 with it, but it seem to be a very interesting alternative to
13973 <a href=
"http://upstart.ubuntu.com/
">upstart
</a
>, and might prove to be
13974 a good alternative for Debian when we are able to switch to an event
13975 based boot system. Tollef is
13976 <a href=
"http://bugs.debian.org/
580814">in the process
</a
> of getting
13977 systemd into Debian, and I look forward to seeing how well it work. I
13978 like the fact that systemd handles init.d scripts with dependency
13979 information natively, allowing them to run in parallel where upstart
13980 at the moment do not.
</p
>
13982 <p
>Unfortunately do systemd have the same problem as upstart regarding
13983 platform support. It only work on recent Linux kernels, and also need
13984 some new kernel features enabled to function properly. This means
13985 kFreeBSD and Hurd ports of Debian will need a port or a different boot
13986 system. Not sure how that will be handled if systemd proves to be the
13987 way forward.
</p
>
13989 <p
>In the mean time, based on the
13990 <a href=
"http://lists.debian.org/debian-devel/
2010/
05/msg00122.html
">input
13991 on debian-devel@
</a
> regarding parallel booting in Debian, I have
13992 decided to enable full parallel booting as the default in Debian as
13993 soon as possible (probably this weekend or early next week), to see if
13994 there are any remaining serious bugs in the init.d dependencies. A
13995 new version of the sysvinit package implementing this change is
13996 already in experimental. If all go well, Squeeze will be released
13997 with parallel booting enabled by default.
</p
>
14002 <title>Parallellizing the boot in Debian Squeeze - ready for wider testing
</title>
14003 <link>http://www.hungry.com/~pere/blog/Parallellizing_the_boot_in_Debian_Squeeze___ready_for_wider_testing.html
</link>
14004 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Parallellizing_the_boot_in_Debian_Squeeze___ready_for_wider_testing.html
</guid>
14005 <pubDate>Thu,
6 May
2010 23:
25:
00 +
0200</pubDate>
14006 <description><p
>These days, the init.d script dependencies in Squeeze are quite
14007 complete, so complete that it is actually possible to run all the
14008 init.d scripts in parallell based on these dependencies. If you want
14009 to test your Squeeze system, make sure
14010 <a href=
"http://wiki.debian.org/LSBInitScripts/DependencyBasedBoot
">dependency
14011 based boot sequencing
</a
> is enabled, and add this line to
14012 /etc/default/rcS:
</p
>
14014 <blockquote
><pre
>
14015 CONCURRENCY=makefile
14016 </pre
></blockquote
>
14018 <p
>That is it. It will cause sysv-rc to use the startpar tool to run
14019 scripts in parallel using the dependency information stored in
14020 /etc/init.d/.depend.boot, /etc/init.d/.depend.start and
14021 /etc/init.d/.depend.stop to order the scripts. Startpar is configured
14022 to try to start the kdm and gdm scripts as early as possible, and will
14023 start the facilities required by kdm or gdm as early as possible to
14024 make this happen.
</p
>
14026 <p
>Give it a try, and see if you like the result. If some services
14027 fail to start properly, it is most likely because they have incomplete
14028 init.d script dependencies in their startup script (or some of their
14029 dependent scripts have incomplete dependencies). Report bugs and get
14030 the package maintainers to fix it. :)
</p
>
14032 <p
>Running scripts in parallel could be the default in Debian when we
14033 manage to get the init.d script dependencies complete and correct. I
14034 expect we will get there in Squeeze+
1, if we get manage to test and
14035 fix the remaining issues.
</p
>
14037 <p
>If you report any problems with dependencies in init.d scripts to
14038 the BTS, please usertag the report to get it to show up at
14039 <a href=
"http://bugs.debian.org/cgi-bin/pkgreport.cgi?users=initscripts-ng-devel@lists.alioth.debian.org
">the
14040 list of usertagged bugs related to this
</a
>.
</p
>
14045 <title>Debian has switched to dependency based boot sequencing
</title>
14046 <link>http://www.hungry.com/~pere/blog/Debian_has_switched_to_dependency_based_boot_sequencing.html
</link>
14047 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_has_switched_to_dependency_based_boot_sequencing.html
</guid>
14048 <pubDate>Mon,
27 Jul
2009 23:
50:
00 +
0200</pubDate>
14049 <description><p
>Since this evening, with the upload of sysvinit version
2.87dsf-
2,
14050 and the upload of insserv version
1.12.0-
10 yesterday, Debian unstable
14051 have been migrated to using dependency based boot sequencing. This
14052 conclude work me and others have been doing for the last three days.
14053 It feels great to see this finally part of the default Debian
14054 installation. Now we just need to weed out the last few problems that
14055 are bound to show up, to get everything ready for Squeeze.
</p
>
14057 <p
>The next step is migrating /sbin/init from sysvinit to upstart, and
14058 fixing the more fundamental problem of handing the event based
14059 non-predictable kernel in the early boot.
</p
>
14064 <title>Taking over sysvinit development
</title>
14065 <link>http://www.hungry.com/~pere/blog/Taking_over_sysvinit_development.html
</link>
14066 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Taking_over_sysvinit_development.html
</guid>
14067 <pubDate>Wed,
22 Jul
2009 23:
00:
00 +
0200</pubDate>
14068 <description><p
>After several years of frustration with the lack of activity from
14069 the existing sysvinit upstream developer, I decided a few weeks ago to
14070 take over the package and become the new upstream. The number of
14071 patches to track for the Debian package was becoming a burden, and the
14072 lack of synchronization between the distribution made it hard to keep
14073 the package up to date.
</p
>
14075 <p
>On the new sysvinit team is the SuSe maintainer Dr. Werner Fink,
14076 and my Debian co-maintainer Kel Modderman. About
10 days ago, I made
14077 a new upstream tarball with version number
2.87dsf (for Debian, SuSe
14078 and Fedora), based on the patches currently in use in these
14079 distributions. We Debian maintainers plan to move to this tarball as
14080 the new upstream as soon as we find time to do the merge. Since the
14081 new tarball was created, we agreed with Werner at SuSe to make a new
14082 upstream project at
<a href=
"http://savannah.nongnu.org/
">Savannah
</a
>, and continue
14083 development there. The project is registered and currently waiting
14084 for approval by the Savannah administrators, and as soon as it is
14085 approved, we will import the old versions from svn and continue
14086 working on the future release.
</p
>
14088 <p
>It is a bit ironic that this is done now, when some of the involved
14089 distributions are moving to upstart as a syvinit replacement.
</p
>
14094 <title>Debian boots quicker and quicker
</title>
14095 <link>http://www.hungry.com/~pere/blog/Debian_boots_quicker_and_quicker.html
</link>
14096 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Debian_boots_quicker_and_quicker.html
</guid>
14097 <pubDate>Wed,
24 Jun
2009 21:
40:
00 +
0200</pubDate>
14098 <description><p
>I spent Monday and tuesday this week in London with a lot of the
14099 people involved in the boot system on Debian and Ubuntu, to see if we
14100 could find more ways to speed up the boot system. This was an Ubuntu
14102 <a href=
"https://wiki.ubuntu.com/FoundationsTeam/BootPerformance/DebianUbuntuSprint
">developer
14103 gathering
</a
>. It was quite productive. We also discussed the future
14104 of boot systems, and ways to handle the increasing number of boot
14105 issues introduced by the Linux kernel becoming more and more
14106 asynchronous and event base. The Ubuntu approach using udev and
14107 upstart might be a good way forward. Time will show.
</p
>
14109 <p
>Anyway, there are a few ways at the moment to speed up the boot
14110 process in Debian. All of these should be applied to get a quick
14115 <li
>Use dash as /bin/sh.
</li
>
14117 <li
>Disable the init.d/hwclock*.sh scripts and make sure the hardware
14118 clock is in UTC.
</li
>
14120 <li
>Install and activate the insserv package to enable
14121 <a href=
"http://wiki.debian.org/LSBInitScripts/DependencyBasedBoot
">dependency
14122 based boot sequencing
</a
>, and enable concurrent booting.
</li
>
14126 These points are based on the Google summer of code work done by
14127 <a href=
"http://initscripts-ng.alioth.debian.org/soc2006-bootsystem/
">Carlos
14128 Villegas
</a
>.
14130 <p
>Support for makefile-style concurrency during boot was uploaded to
14131 unstable yesterday. When we tested it, we were able to cut
6 seconds
14132 from the boot sequence. It depend on very correct dependency
14133 declaration in all init.d scripts, so I expect us to find edge cases
14134 where the dependences in some scripts are slightly wrong when we start
14135 using this.
</p
>
14137 <p
>On our IRC channel for this effort, #pkg-sysvinit, a new idea was
14138 introduced by Raphael Geissert today, one that could affect the
14139 startup speed as well. Instead of starting some scripts concurrently
14140 from rcS.d/ and another set of scripts from rc2.d/, it would be
14141 possible to run a of them in the same process. A quick way to test
14142 this would be to enable insserv and run
'mv /etc/rc2.d/S* /etc/rcS.d/;
14143 insserv
'. Will need to test if that work. :)
</p
>
14148 <title>BSAs påstander om piratkopiering møter motstand
</title>
14149 <link>http://www.hungry.com/~pere/blog/BSAs_p_stander_om_piratkopiering_m_ter_motstand.html
</link>
14150 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/BSAs_p_stander_om_piratkopiering_m_ter_motstand.html
</guid>
14151 <pubDate>Sun,
17 May
2009 23:
05:
00 +
0200</pubDate>
14152 <description><p
>Hvert år de siste årene har BSA, lobbyfronten til de store
14153 programvareselskapene som Microsoft og Apple, publisert en rapport der
14154 de gjetter på hvor mye piratkopiering påfører i tapte inntekter i
14155 ulike land rundt om i verden. Resultatene er tendensiøse. For noen
14157 <a href=
"http://global.bsa.org/globalpiracy2008/studies/globalpiracy2008.pdf
">siste
14158 rapport
</a
>, og det er flere kritiske kommentarer publisert de siste
14159 dagene. Et spesielt interessant kommentar fra Sverige,
14160 <a href=
"http://www.idg.se/
2.1085/
1.229795/bsa-hoftade-sverigesiffror
">BSA
14161 höftade Sverigesiffror
</a
>, oppsummeres slik:
</p
>
14164 I sin senaste rapport slår BSA fast att
25 procent av all mjukvara i
14165 Sverige är piratkopierad. Det utan att ha pratat med ett enda svenskt
14166 företag.
"Man bör nog kanske inte se de här siffrorna som helt
14167 exakta
", säger BSAs Sverigechef John Hugosson.
14168 </blockquote
>
14170 <p
>Mon tro om de er like metodiske når de gjetter på andelen piratkopiering i Norge? To andre kommentarer er
<a
14171 href=
"http://www.vnunet.com/vnunet/comment/
2242134/bsa-piracy-figures-shot-reality
">BSA
14172 piracy figures need a shot of reality
</a
> og
<a
14173 href=
"http://www.michaelgeist.ca/content/view/
3958/
125/
">Does The WIPO
14174 Copyright Treaty Work?
</a
></p
>
14176 <p
>Fant lenkene via
<a
14177 href=
"http://tech.slashdot.org/article.pl?sid=
09/
05/
17/
1632242">oppslag
14178 på Slashdot
</a
>.
</p
>
14183 <title>IDG mener linux i servermarkedet vil vokse med
21% i
2009</title>
14184 <link>http://www.hungry.com/~pere/blog/IDG_mener_linux_i_servermarkedet_vil_vokse_med_21__i_2009.html
</link>
14185 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/IDG_mener_linux_i_servermarkedet_vil_vokse_med_21__i_2009.html
</guid>
14186 <pubDate>Thu,
7 May
2009 22:
30:
00 +
0200</pubDate>
14187 <description><p
>Kom over
14188 <a href=
"http://news.cnet.com/
8301-
13505_3-
10216873-
16.html
">interessante
14189 tall
</a
> fra IDG om utviklingen av linuxservermarkedet. Fikk meg til
14190 å tenke på antall tjenermaskiner ved Universitetet i Oslo der jeg
14191 jobber til daglig. En rask opptelling forteller meg at vi har
490
14192 (
61%) fysiske unix-tjener (mest linux men også noen solaris) og
196
14193 (
25%) windowstjenere, samt
112 (
14%) virtuelle unix-tjenere. Med den
14194 bakgrunnskunnskapen kan jeg godt tro at IDG er inne på noe.
</p
>
14199 <title>Kryptert harddisk - naturligvis
</title>
14200 <link>http://www.hungry.com/~pere/blog/Kryptert_harddisk___naturligvis.html
</link>
14201 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Kryptert_harddisk___naturligvis.html
</guid>
14202 <pubDate>Sat,
2 May
2009 15:
30:
00 +
0200</pubDate>
14203 <description><p
><a href=
"http://www.dagensit.no/trender/article1658676.ece
">Dagens
14204 IT melder
</a
> at Intel hevder at det er dyrt å miste en datamaskin,
14205 når en tar tap av arbeidstid, fortrolige dokumenter,
14206 personopplysninger og alt annet det innebærer. Det er ingen tvil om
14207 at det er en kostbar affære å miste sin datamaskin, og det er årsaken
14208 til at jeg har kryptert harddisken på både kontormaskinen og min
14209 bærbare. Begge inneholder personopplysninger jeg ikke ønsker skal
14210 komme på avveie, den første informasjon relatert til jobben min ved
14211 Universitetet i Oslo, og den andre relatert til blant annet
14212 foreningsarbeide. Kryptering av diskene gjør at det er lite
14213 sannsynlig at dophoder som kan finne på å rappe maskinene får noe ut
14214 av dem. Maskinene låses automatisk etter noen minutter uten bruk,
14215 og en reboot vil gjøre at de ber om passord før de vil starte opp.
14216 Jeg bruker Debian på begge maskinene, og installasjonssystemet der
14217 gjør det trivielt å sette opp krypterte disker. Jeg har LVM på toppen
14218 av krypterte partisjoner, slik at alt av datapartisjoner er kryptert.
14219 Jeg anbefaler alle å kryptere diskene på sine bærbare. Kostnaden når
14220 det er gjort slik jeg gjør det er minimale, og gevinstene er
14221 betydelige. En bør dog passe på passordet. Hvis det går tapt, må
14222 maskinen reinstalleres og alt er tapt.
</p
>
14224 <p
>Krypteringen vil ikke stoppe kompetente angripere som f.eks. kjøler
14225 ned minnebrikkene før maskinen rebootes med programvare for å hente ut
14226 krypteringsnøklene. Kostnaden med å forsvare seg mot slike angripere
14227 er for min del høyere enn gevinsten. Jeg tror oddsene for at
14228 f.eks. etteretningsorganisasjoner har glede av å titte på mine
14229 maskiner er minimale, og ulempene jeg ville oppnå ved å forsøke å
14230 gjøre det vanskeligere for angripere med kompetanse og ressurser er
14231 betydelige.
</p
>
14236 <title>Two projects that have improved the quality of free software a lot
</title>
14237 <link>http://www.hungry.com/~pere/blog/Two_projects_that_have_improved_the_quality_of_free_software_a_lot.html
</link>
14238 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Two_projects_that_have_improved_the_quality_of_free_software_a_lot.html
</guid>
14239 <pubDate>Sat,
2 May
2009 15:
00:
00 +
0200</pubDate>
14240 <description><p
>There are two software projects that have had huge influence on the
14241 quality of free software, and I wanted to mention both in case someone
14242 do not yet know them.
</p
>
14244 <p
>The first one is
<a href=
"http://valgrind.org/
">valgrind
</a
>, a
14245 tool to detect and expose errors in the memory handling of programs.
14246 It is easy to use, all one need to do is to run
'valgrind program
',
14247 and it will report any problems on stdout. It is even better if the
14248 program include debug information. With debug information, it is able
14249 to report the source file name and line number where the problem
14250 occurs. It can report things like
'reading past memory block in file
14251 X line N, the memory block was allocated in file Y, line M
', and
14252 'using uninitialised value in control logic
'. This tool has made it
14253 trivial to investigate reproducible crash bugs in programs, and have
14254 reduced the number of this kind of bugs in free software a lot.
14256 <p
>The second one is
14257 <a href=
"http://en.wikipedia.org/wiki/Coverity
">Coverity
</a
> which is
14258 a source code checker. It is able to process the source of a program
14259 and find problems in the logic without running the program. It
14260 started out as the Stanford Checker and became well known when it was
14261 used to find bugs in the Linux kernel. It is now a commercial tool
14262 and the company behind it is running
14263 <a href=
"http://www.scan.coverity.com/
">a community service
</a
> for the
14264 free software community, where a lot of free software projects get
14265 their source checked for free. Several thousand defects have been
14266 found and fixed so far. It can find errors like
'lock L taken in file
14267 X line N is never released if exiting in line M
', or
'the code in file
14268 Y lines O to P can never be executed
'. The projects included in the
14269 community service project have managed to get rid of a lot of
14270 reliability problems thanks to Coverity.
</p
>
14272 <p
>I believe tools like this, that are able to automatically find
14273 errors in the source, are vital to improve the quality of software and
14274 make sure we can get rid of the crashing and failing software we are
14275 surrounded by today.
</p
>
14280 <title>No patch is not better than a useless patch
</title>
14281 <link>http://www.hungry.com/~pere/blog/No_patch_is_not_better_than_a_useless_patch.html
</link>
14282 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/No_patch_is_not_better_than_a_useless_patch.html
</guid>
14283 <pubDate>Tue,
28 Apr
2009 09:
30:
00 +
0200</pubDate>
14284 <description><p
>Julien Blache
14285 <a href=
"http://blog.technologeek.org/
2009/
04/
12/
214">claim that no
14286 patch is better than a useless patch
</a
>. I completely disagree, as a
14287 patch allow one to discuss a concrete and proposed solution, and also
14288 prove that the issue at hand is important enough for someone to spent
14289 time on fixing it. No patch do not provide any of these positive
14290 properties.
</p
>
14295 <title>Standardize on protocols and formats, not vendors and applications
</title>
14296 <link>http://www.hungry.com/~pere/blog/Standardize_on_protocols_and_formats__not_vendors_and_applications.html
</link>
14297 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Standardize_on_protocols_and_formats__not_vendors_and_applications.html
</guid>
14298 <pubDate>Mon,
30 Mar
2009 11:
50:
00 +
0200</pubDate>
14299 <description><p
>Where I work at the University of Oslo, one decision stand out as a
14300 very good one to form a long lived computer infrastructure. It is the
14301 simple one, lost by many in todays computer industry: Standardize on
14302 open network protocols and open exchange/storage formats, not applications.
14303 Applications come and go, while protocols and files tend to stay, and
14304 thus one want to make it easy to change application and vendor, while
14305 avoiding conversion costs and locking users to a specific platform or
14306 application.
</p
>
14308 <p
>This approach make it possible to replace the client applications
14309 independently of the server applications. One can even allow users to
14310 use several different applications as long as they handle the selected
14311 protocol and format. In the normal case, only one client application
14312 is recommended and users only get help if they choose to use this
14313 application, but those that want to deviate from the easy path are not
14314 blocked from doing so.
</p
>
14316 <p
>It also allow us to replace the server side without forcing the
14317 users to replace their applications, and thus allow us to select the
14318 best server implementation at any moment, when scale and resouce
14319 requirements change.
</p
>
14321 <p
>I strongly recommend standardizing - on open network protocols and
14322 open formats, but I would never recommend standardizing on a single
14323 application that do not use open network protocol or open formats.
</p
>
14328 <title>Returning from Skolelinux developer gathering
</title>
14329 <link>http://www.hungry.com/~pere/blog/Returning_from_Skolelinux_developer_gathering.html
</link>
14330 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Returning_from_Skolelinux_developer_gathering.html
</guid>
14331 <pubDate>Sun,
29 Mar
2009 21:
00:
00 +
0200</pubDate>
14332 <description><p
>I
'm sitting on the train going home from this weekends Debian
14333 Edu/Skolelinux development gathering. I got a bit done tuning the
14334 desktop, and looked into the dynamic service location protocol
14335 implementation avahi. It look like it could be useful for us. Almost
14336 30 people participated, and I believe it was a great environment to
14337 get to know the Skolelinux system. Walter Bender, involved in the
14338 development of the Sugar educational platform, presented his stuff and
14339 also helped me improve my OLPC installation. He also showed me that
14340 his Turtle Art application can be used in standalone mode, and we
14341 agreed that I would help getting it packaged for Debian. As a
14342 standalone application it would be great for Debian Edu. We also
14343 tried to get the video conferencing working with two OLPCs, but that
14344 proved to be too hard for us. The application seem to need more work
14345 before it is ready for me. I look forward to getting home and relax
14351 <title>Time for new LDAP schemas replacing RFC
2307?
</title>
14352 <link>http://www.hungry.com/~pere/blog/Time_for_new__LDAP_schemas_replacing_RFC_2307_.html
</link>
14353 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Time_for_new__LDAP_schemas_replacing_RFC_2307_.html
</guid>
14354 <pubDate>Sun,
29 Mar
2009 20:
30:
00 +
0200</pubDate>
14355 <description><p
>The state of standardized LDAP schemas on Linux is far from
14356 optimal. There is RFC
2307 documenting one way to store NIS maps in
14357 LDAP, and a modified version of this normally called RFC
2307bis, with
14358 some modifications to be compatible with Active Directory. The RFC
14359 specification handle the content of a lot of system databases, but do
14360 not handle DNS zones and DHCP configuration.
</p
>
14362 <p
>In
<a href=
"http://www.skolelinux.org/
">Debian Edu/Skolelinux
</a
>,
14363 we would like to store information about users, SMB clients/hosts,
14364 filegroups, netgroups (users and hosts), DHCP and DNS configuration,
14365 and LTSP configuration in LDAP. These objects have a lot in common,
14366 but with the current LDAP schemas it is not possible to have one
14367 object per entity. For example, one need to have at least three LDAP
14368 objects for a given computer, one with the SMB related stuff, one with
14369 DNS information and another with DHCP information. The schemas
14370 provided for DNS and DHCP are impossible to combine into one LDAP
14371 object. In addition, it is impossible to implement quick queries for
14372 netgroup membership, because of the way NIS triples are implemented.
14373 It just do not scale. I believe it is time for a few RFC
14374 specifications to cleam up this mess.
</p
>
14376 <p
>I would like to have one LDAP object representing each computer in
14377 the network, and this object can then keep the SMB (ie host key), DHCP
14378 (mac address/name) and DNS (name/IP address) settings in one place.
14379 It need to be efficently stored to make sure it scale well.
</p
>
14381 <p
>I would also like to have a quick way to map from a user or
14382 computer and to the net group this user or computer is a member.
</p
>
14384 <p
>Active Directory have done a better job than unix heads like myself
14385 in this regard, and the unix side need to catch up. Time to start a
14386 new IETF work group?
</p
>
14391 <title>Endelig er Debian Lenny gitt ut
</title>
14392 <link>http://www.hungry.com/~pere/blog/Endelig_er_Debian_Lenny_gitt_ut.html
</link>
14393 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Endelig_er_Debian_Lenny_gitt_ut.html
</guid>
14394 <pubDate>Sun,
15 Feb
2009 11:
50:
00 +
0100</pubDate>
14395 <description><p
>Endelig er
<a href=
"http://www.debian.org/
">Debian
</a
>
14396 <a href=
"http://www.debian.org/News/
2009/
20090214">Lenny
</a
> gitt ut.
14397 Et langt steg videre for Debian-prosjektet, og en rekke nye
14398 programpakker blir nå tilgjengelig for de av oss som bruker den
14399 stabile utgaven av Debian. Neste steg er nå å få
14400 <a href=
"http://www.skolelinux.org/
">Skolelinux
</a
> /
14401 <a href=
"http://wiki.debian.org/DebianEdu/
">Debian Edu
</a
> ferdig
14402 oppdatert for den nye utgaven, slik at en oppdatert versjon kan
14403 slippes løs på skolene. Takk til alle debian-utviklerne som har
14404 gjort dette mulig. Endelig er f.eks. fungerende avhengighetsstyrt
14405 bootsekvens tilgjengelig i stabil utgave, vha pakken
14406 <tt
>insserv
</tt
>.
</p
>
14411 <title>Devcamp brought us closer to the Lenny based Debian Edu release
</title>
14412 <link>http://www.hungry.com/~pere/blog/Devcamp_brought_us_closer_to_the_Lenny_based_Debian_Edu_release.html
</link>
14413 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/Devcamp_brought_us_closer_to_the_Lenny_based_Debian_Edu_release.html
</guid>
14414 <pubDate>Sun,
7 Dec
2008 12:
00:
00 +
0100</pubDate>
14415 <description><p
>This weekend we had a small developer gathering for Debian Edu in
14416 Oslo. Most of Saturday was used for the general assemly for the
14417 member organization, but the rest of the weekend I used to tune the
14418 LTSP installation. LTSP now work out of the box on the
10-network.
14419 Acer Aspire One proved to be a very nice thin client, with both
14420 screen, mouse and keybard in a small box. Was working on getting the
14421 diskless workstation setup configured out of the box, but did not
14422 finish it before the weekend was up.
</p
>
14424 <p
>Did not find time to look at the
4 VGA cards in one box we got from
14425 the Brazilian group, so that will have to wait for the next
14426 development gathering. Would love to have the Debian Edu installer
14427 automatically detect and configure a multiseat setup when it find one
14428 of these cards.
</p
>
14433 <title>The sorry state of multimedia browser plugins in Debian
</title>
14434 <link>http://www.hungry.com/~pere/blog/The_sorry_state_of_multimedia_browser_plugins_in_Debian.html
</link>
14435 <guid isPermaLink=
"true">http://www.hungry.com/~pere/blog/The_sorry_state_of_multimedia_browser_plugins_in_Debian.html
</guid>
14436 <pubDate>Tue,
25 Nov
2008 00:
10:
00 +
0100</pubDate>
14437 <description><p
>Recently I have spent some time evaluating the multimedia browser
14438 plugins available in Debian Lenny, to see which one we should use by
14439 default in Debian Edu. We need an embedded video playing plugin with
14440 control buttons to pause or stop the video, and capable of streaming
14441 all the multimedia content available on the web. The test results and
14442 notes are available on
14443 <a href=
"http://wiki.debian.org/DebianEdu/BrowserMultimedia
">the
14444 Debian wiki
</a
>. I was surprised how few of the plugins are able to
14445 fill this need. My personal video player favorite, VLC, has a really
14446 bad plugin which fail on a lot of the test pages. A lot of the MIME
14447 types I would expect to work with any free software player (like
14448 video/ogg), just do not work. And simple formats like the
14449 audio/x-mplegurl format (m3u playlists), just isn
't supported by the
14450 totem and vlc plugins. I hope the situation will improve soon. No
14451 wonder sites use the proprietary Adobe flash to play video.
</p
>
14453 <p
>For Lenny, we seem to end up with the mplayer plugin. It seem to
14454 be the only one fitting our needs. :/
</p
>