1 <!DOCTYPE html PUBLIC
"-//W3C//DTD XHTML 1.0 Strict//EN"
2 "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
3 <html xmlns=
"http://www.w3.org/1999/xhtml" dir=
"ltr">
5 <meta http-equiv=
"Content-Type" content=
"text/html;charset=utf-8" />
6 <title>Petter Reinholdtsen
</title>
7 <link rel=
"stylesheet" type=
"text/css" media=
"screen" href=
"http://people.skolelinux.org/pere/blog/style.css" />
8 <link rel=
"stylesheet" type=
"text/css" media=
"screen" href=
"http://people.skolelinux.org/pere/blog/vim.css" />
9 <link rel=
"alternate" title=
"RSS Feed" href=
"http://people.skolelinux.org/pere/blog/index.rss" type=
"application/rss+xml" />
14 <a href=
"http://people.skolelinux.org/pere/blog/">Petter Reinholdtsen
</a>
23 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Metadata_proposal_for_movies_on_the_Internet_Archive.html">Metadata proposal for movies on the Internet Archive
</a></div>
24 <div class=
"date">28th November
2017</div>
25 <div class=
"body"><p>It would be easier to locate the movie you want to watch in
26 <a href=
"https://www.archive.org/">the Internet Archive
</a>, if the
27 metadata about each movie was more complete and accurate. In the
28 archiving community, a well known saying state that good metadata is a
29 love letter to the future. The metadata in the Internet Archive could
30 use a face lift for the future to love us back. Here is a proposal
31 for a small improvement that would make the metadata more useful
32 today. I've been unable to find any document describing the various
33 standard fields available when uploading videos to the archive, so
34 this proposal is based on my best quess and searching through several
35 of the existing movies.
</p>
37 <p>I have a few use cases in mind. First of all, I would like to be
38 able to count the number of distinct movies in the Internet Archive,
39 without duplicates. I would further like to identify the IMDB title
40 ID of the movies in the Internet Archive, to be able to look up a IMDB
41 title ID and know if I can fetch the video from there and share it
44 <p>Second, I would like the Butter data provider for The Internet
46 (
<a href=
"https://github.com/butterproviders/butter-provider-archive">available
47 from github
</a>), to list as many of the good movies as possible. The
48 plugin currently do a search in the archive with the following
52 collection:moviesandfilms
53 AND NOT collection:movie_trailers
54 AND -mediatype:collection
55 AND format:"Archive BitTorrent"
59 <p>Most of the cool movies that fail to show up in Butter do so
60 because the 'year' field is missing. The 'year' field is populated by
61 the year part from the 'date' field, and should be when the movie was
62 released (date or year). Two such examples are
63 <a href=
"https://archive.org/details/SidneyOlcottsBen-hur1905">Ben Hur
65 <a href=
"https://archive.org/details/Caminandes2GranDillama">Caminandes
66 2: Gran Dillama from
2013</a>, where the year metadata field is
69 So, my proposal is simply, for every movie in The Internet Archive
70 where an IMDB title ID exist, please fill in these metadata fields
71 (note, they can be updated also long after the video was uploaded, but
72 as far as I can tell, only by the uploader):
77 <dd>Should be 'movie' for movies.
</dd>
80 <dd>Should contain 'moviesandfilms'.
</dd>
83 <dd>The title of the movie, without the publication year.
</dd>
86 <dd>The data or year the movie was released. This make the movie show
87 up in Butter, as well as make it possible to know the age of the
88 movie and is useful to figure out copyright status.
</dd>
91 <dd>The director of the movie. This make it easier to know if the
92 correct movie is found in movie databases.
</dd>
95 <dd>The production company making the movie. Also useful for
96 identifying the correct movie.
</dd>
100 <dd>Add a link to the IMDB title page, for example like this:
<a
101 href="http://www.imdb.com/title/tt0028496/"
>Movie in
102 IMDB
</a
>. This make it easier to find duplicates and allow for
103 counting of number of unique movies in the Archive. Other external
104 references, like to TMDB, could be added like this too.
</dd>
108 <p>I did consider proposing a Custom field for the IMDB title ID (for
109 example 'imdb_title_url', 'imdb_code' or simply 'imdb', but suspect it
110 will be easier to simply place it in the links free text field.
</p>
113 <a href=
"https://github.com/petterreinholdtsen/public-domain-free-imdb">a
114 list of IMDB title IDs for several thousand movies in the Internet
115 Archive
</a>, but I also got a list of several thousand movies without
116 such IMDB title ID (and quite a few duplicates). It would be great if
117 this data set could be integrated into the Internet Archive metadata
118 to be available for everyone in the future, but with the current
119 policy of leaving metadata editing to the uploaders, it will take a
120 while before this happen. If you have uploaded movies into the
121 Internet Archive, you can help. Please consider following my proposal
122 above for your movies, to ensure that movie is properly
125 <p>The list is mostly generated using wikidata, which based on
126 Wikipedia articles make it possible to link between IMDB and movies in
127 the Internet Archive. But there are lots of movies without a
128 Wikipedia article, and some movies where only a collection page exist
129 (like for
<a href=
"https://en.wikipedia.org/wiki/Caminandes">the
130 Caminandes example above
</a>, where there are three movies but only
131 one Wikidata entry).
</p>
136 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/opphavsrett">opphavsrett
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/verkidetfri">verkidetfri
</a>.
141 <div class=
"padding"></div>
144 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Legal_to_share_more_than_3000_movies_listed_on_IMDB_.html">Legal to share more than
3000 movies listed on IMDB?
</a></div>
145 <div class=
"date">18th November
2017</div>
146 <div class=
"body"><p>A month ago, I blogged about my work to
147 <a href=
"http://people.skolelinux.org/pere/blog/Locating_IMDB_IDs_of_movies_in_the_Internet_Archive_using_Wikidata.html">automatically
148 check the copyright status of IMDB entries
</a>, and try to count the
149 number of movies listed in IMDB that is legal to distribute on the
150 Internet. I have continued to look for good data sources, and
151 identified a few more. The code used to extract information from
152 various data sources is available in
153 <a href=
"https://github.com/petterreinholdtsen/public-domain-free-imdb">a
154 git repository
</a>, currently available from github.
</p>
156 <p>So far I have identified
3186 unique IMDB title IDs. To gain
157 better understanding of the structure of the data set, I created a
158 histogram of the year associated with each movie (typically release
159 year). It is interesting to notice where the peaks and dips in the
160 graph are located. I wonder why they are placed there. I suspect
161 World War II caused the dip around
1940, but what caused the peak
164 <p align=
"center"><img src=
"http://people.skolelinux.org/pere/blog/images/2017-11-18-verk-i-det-fri-filmer.png" /></p>
166 <p>I've so far identified ten sources for IMDB title IDs for movies in
167 the public domain or with a free license. This is the statistics
168 reported when running 'make stats' in the git repository:
</p>
171 249 entries (
6 unique) with and
288 without IMDB title ID in free-movies-archive-org-butter.json
172 2301 entries (
540 unique) with and
0 without IMDB title ID in free-movies-archive-org-wikidata.json
173 830 entries (
29 unique) with and
0 without IMDB title ID in free-movies-icheckmovies-archive-mochard.json
174 2109 entries (
377 unique) with and
0 without IMDB title ID in free-movies-imdb-pd.json
175 291 entries (
122 unique) with and
0 without IMDB title ID in free-movies-letterboxd-pd.json
176 144 entries (
135 unique) with and
0 without IMDB title ID in free-movies-manual.json
177 350 entries (
1 unique) with and
801 without IMDB title ID in free-movies-publicdomainmovies.json
178 4 entries (
0 unique) with and
124 without IMDB title ID in free-movies-publicdomainreview.json
179 698 entries (
119 unique) with and
118 without IMDB title ID in free-movies-publicdomaintorrents.json
180 8 entries (
8 unique) with and
196 without IMDB title ID in free-movies-vodo.json
181 3186 unique IMDB title IDs in total
184 <p>The entries without IMDB title ID are candidates to increase the
185 data set, but might equally well be duplicates of entries already
186 listed with IMDB title ID in one of the other sources, or represent
187 movies that lack a IMDB title ID. I've seen examples of all these
188 situations when peeking at the entries without IMDB title ID. Based
189 on these data sources, the lower bound for movies listed in IMDB that
190 are legal to distribute on the Internet is between
3186 and
4713.
192 <p>It would be great for improving the accuracy of this measurement,
193 if the various sources added IMDB title ID to their metadata. I have
194 tried to reach the people behind the various sources to ask if they
195 are interested in doing this, without any replies so far. Perhaps you
196 can help me get in touch with the people behind VODO, Public Domain
197 Torrents, Public Domain Movies and Public Domain Review to try to
198 convince them to add more metadata to their movie entries?
</p>
200 <p>Another way you could help is by adding pages to Wikipedia about
201 movies that are legal to distribute on the Internet. If such page
202 exist and include a link to both IMDB and The Internet Archive, the
203 script used to generate free-movies-archive-org-wikidata.json should
204 pick up the mapping as soon as wikidata is updates.
</p>
206 <p>As usual, if you use Bitcoin and want to show your support of my
207 activities, please send Bitcoin donations to my address
208 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
213 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/opphavsrett">opphavsrett
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/verkidetfri">verkidetfri
</a>.
218 <div class=
"padding"></div>
221 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Some_notes_on_fault_tolerant_storage_systems.html">Some notes on fault tolerant storage systems
</a></div>
222 <div class=
"date"> 1st November
2017</div>
223 <div class=
"body"><p>If you care about how fault tolerant your storage is, you might
224 find these articles and papers interesting. They have formed how I
225 think of when designing a storage system.
</p>
229 <li>USENIX :login;
<a
230 href=
"https://www.usenix.org/publications/login/summer2017/ganesan">Redundancy
231 Does Not Imply Fault Tolerance. Analysis of Distributed Storage
232 Reactions to Single Errors and Corruptions
</a> by Aishwarya Ganesan,
233 Ramnatthan Alagappan, Andrea C. Arpaci-Dusseau, and Remzi
234 H. Arpaci-Dusseau
</li>
237 <a href=
"http://www.zdnet.com/article/why-raid-5-stops-working-in-2009/">Why
238 RAID
5 stops working in
2009</a> by Robin Harris
</li>
241 <a href=
"http://www.zdnet.com/article/why-raid-6-stops-working-in-2019/">Why
242 RAID
6 stops working in
2019</a> by Robin Harris
</li>
245 <a href=
"http://research.google.com/archive/disk_failures.pdf">Failure
246 Trends in a Large Disk Drive Population
</a> by Eduardo Pinheiro,
247 Wolf-Dietrich Weber and Luiz André Barroso
</li>
249 <li>USENIX ;login:
<a
250 href=
"https://www.usenix.org/system/files/login/articles/hughes12-04.pdf">Data
251 Integrity. Finding Truth in a World of Guesses and Lies
</a> by Doug
255 <a href=
"https://www.usenix.org/events/fast08/tech/full_papers/bairavasundaram/bairavasundaram_html/">An
256 Analysis of Data Corruption in the Storage Stack
</a> by
257 L. N. Bairavasundaram, G. R. Goodson, B. Schroeder, A. C.
258 Arpaci-Dusseau, and R. H. Arpaci-Dusseau
</li>
260 <li>USENIX FAST'
07 <a
261 href=
"https://www.usenix.org/legacy/events/fast07/tech/schroeder/schroeder_html/">Disk
262 failures in the real world: what does an MTTF of
1,
000,
000 hours mean
263 to you?
</a> by B. Schroeder and G. A. Gibson.
</li>
265 <li>USENIX ;login:
<a
266 href=
"https://www.usenix.org/events/fast08/tech/full_papers/jiang/jiang_html/">Are
267 Disks the Dominant Contributor for Storage Failures? A Comprehensive
268 Study of Storage Subsystem Failure Characteristics
</a> by Weihang
269 Jiang, Chongfeng Hu, Yuanyuan Zhou, and Arkady Kanevsky
</li>
272 <a href=
"http://research.cs.wisc.edu/adsl/Publications/latent-sigmetrics07.pdf">An
273 analysis of latent sector errors in disk drives
</a> by
274 L. N. Bairavasundaram, G. R. Goodson, S. Pasupathy, and J. Schindler
</li>
278 <p>Several of these research papers are based on data collected from
279 hundred thousands or millions of disk, and their findings are eye
280 opening. The short story is simply do not implicitly trust RAID or
281 redundant storage systems. Details matter. And unfortunately there
282 are few options on Linux addressing all the identified issues. Both
283 ZFS and Btrfs are doing a fairly good job, but have legal and
284 practical issues on their own. I wonder how cluster file systems like
285 Ceph do in this regard. After all, there is an old saying, you know
286 you have a distributed system when the crash of a computer you have
287 never heard of stops you from getting any work done. The same holds
288 true if fault tolerance do not work.
</p>
290 <p>Just remember, in the end, it do not matter how redundant, or how
291 fault tolerant your storage is, if you do not continuously monitor its
292 status to detect and replace failed disks.
</p>
294 <p>As usual, if you use Bitcoin and want to show your support of my
295 activities, please send Bitcoin donations to my address
296 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
301 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/raid">raid
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/sysadmin">sysadmin
</a>.
306 <div class=
"padding"></div>
309 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Web_services_for_writing_academic_LaTeX_papers_as_a_team.html">Web services for writing academic LaTeX papers as a team
</a></div>
310 <div class=
"date">31st October
2017</div>
311 <div class=
"body"><p>I was surprised today to learn that a friend in academia did not
312 know there are easily available web services available for writing
313 LaTeX documents as a team. I thought it was common knowledge, but to
314 make sure at least my readers are aware of it, I would like to mention
315 these useful services for writing LaTeX documents. Some of them even
316 provide a WYSIWYG editor to ease writing even further.
</p>
318 <p>There are two commercial services available,
319 <a href=
"https://sharelatex.com">ShareLaTeX
</a> and
320 <a href=
"https://overleaf.com">Overleaf
</a>. They are very easy to
321 use. Just start a new document, select which publisher to write for
322 (ie which LaTeX style to use), and start writing. Note, these two
323 have announced their intention to join forces, so soon it will only be
324 one joint service. I've used both for different documents, and they
325 work just fine. While
326 <a href=
"https://github.com/sharelatex/sharelatex">ShareLaTeX is free
327 software
</a>, while the latter is not. According to
<a
328 href=
"https://www.overleaf.com/help/17-is-overleaf-open-source">a
329 announcement from Overleaf
</a>, they plan to keep the ShareLaTeX code
330 base maintained as free software.
</p>
332 But these two are not the only alternatives.
333 <a href=
"https://app.fiduswriter.org/">Fidus Writer
</a> is another free
334 software solution with
<a href=
"https://github.com/fiduswriter">the
335 source available on github
</a>. I have not used it myself. Several
336 others can be found on the nice
337 <a href=
"https://alternativeto.net/software/sharelatex/">alterntiveTo
340 <p>If you like Google Docs or Etherpad, but would like to write
341 documents in LaTeX, you should check out these services. You can even
342 host your own, if you want to. :)
</p>
344 <p>As usual, if you use Bitcoin and want to show your support of my
345 activities, please send Bitcoin donations to my address
346 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
351 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>.
356 <div class=
"padding"></div>
359 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Locating_IMDB_IDs_of_movies_in_the_Internet_Archive_using_Wikidata.html">Locating IMDB IDs of movies in the Internet Archive using Wikidata
</a></div>
360 <div class=
"date">25th October
2017</div>
361 <div class=
"body"><p>Recently, I needed to automatically check the copyright status of a
362 set of
<a href=
"http://www.imdb.com/">The Internet Movie database
363 (IMDB)
</a> entries, to figure out which one of the movies they refer
364 to can be freely distributed on the Internet. This proved to be
365 harder than it sounds. IMDB for sure list movies without any
366 copyright protection, where the copyright protection has expired or
367 where the movie is lisenced using a permissive license like one from
368 Creative Commons. These are mixed with copyright protected movies,
369 and there seem to be no way to separate these classes of movies using
370 the information in IMDB.
</p>
372 <p>First I tried to look up entries manually in IMDB,
373 <a href=
"https://www.wikipedia.org/">Wikipedia
</a> and
374 <a href=
"https://www.archive.org/">The Internet Archive
</a>, to get a
375 feel how to do this. It is hard to know for sure using these sources,
376 but it should be possible to be reasonable confident a movie is "out
377 of copyright" with a few hours work per movie. As I needed to check
378 almost
20,
000 entries, this approach was not sustainable. I simply
379 can not work around the clock for about
6 years to check this data
382 <p>I asked the people behind The Internet Archive if they could
383 introduce a new metadata field in their metadata XML for IMDB ID, but
384 was told that they leave it completely to the uploaders to update the
385 metadata. Some of the metadata entries had IMDB links in the
386 description, but I found no way to download all metadata files in bulk
387 to locate those ones and put that approach aside.
</p>
389 <p>In the process I noticed several Wikipedia articles about movies
390 had links to both IMDB and The Internet Archive, and it occured to me
391 that I could use the Wikipedia RDF data set to locate entries with
392 both, to at least get a lower bound on the number of movies on The
393 Internet Archive with a IMDB ID. This is useful based on the
394 assumption that movies distributed by The Internet Archive can be
395 legally distributed on the Internet. With some help from the RDF
396 community (thank you DanC), I was able to come up with this query to
397 pass to
<a href=
"https://query.wikidata.org/">the SPARQL interface on
401 SELECT ?work ?imdb ?ia ?when ?label
404 ?work wdt:P31/wdt:P279* wd:Q11424.
405 ?work wdt:P345 ?imdb.
408 ?work wdt:P577 ?when.
409 ?work rdfs:label ?label.
410 FILTER(LANG(?label) = "en").
415 <p>If I understand the query right, for every film entry anywhere in
416 Wikpedia, it will return the IMDB ID and The Internet Archive ID, and
417 when the movie was released and its English title, if either or both
418 of the latter two are available. At the moment the result set contain
419 2338 entries. Of course, it depend on volunteers including both
420 correct IMDB and The Internet Archive IDs in the wikipedia articles
421 for the movie. It should be noted that the result will include
422 duplicates if the movie have entries in several languages. There are
423 some bogus entries, either because The Internet Archive ID contain a
424 typo or because the movie is not available from The Internet Archive.
425 I did not verify the IMDB IDs, as I am unsure how to do that
428 <p>I wrote a small python script to extract the data set from Wikidata
429 and check if the XML metadata for the movie is available from The
430 Internet Archive, and after around
1.5 hour it produced a list of
2097
431 free movies and their IMDB ID. In total,
171 entries in Wikidata lack
432 the refered Internet Archive entry. I assume the
70 "disappearing"
433 entries (ie
2338-
2097-
171) are duplicate entries.
</p>
435 <p>This is not too bad, given that The Internet Archive report to
436 contain
<a href=
"https://archive.org/details/feature_films">5331
437 feature films
</a> at the moment, but it also mean more than
3000
438 movies are missing on Wikipedia or are missing the pair of references
441 <p>I was curious about the distribution by release year, and made a
442 little graph to show how the amount of free movies is spread over the
445 <p><img src=
"http://people.skolelinux.org/pere/blog/images/2017-10-25-verk-i-det-fri-filmer.png"></p>
447 <p>I expect the relative distribution of the remaining
3000 movies to
450 <p>If you want to help, and want to ensure Wikipedia can be used to
451 cross reference The Internet Archive and The Internet Movie Database,
452 please make sure entries like this are listed under the "External
453 links" heading on the Wikipedia article for the movie:
</p>
456 * {{Internet Archive film|id=FightingLady}}
457 * {{IMDb title|id=
0036823|title=The Fighting Lady}}
460 <p>Please verify the links on the final page, to make sure you did not
461 introduce a typo.
</p>
463 <p>Here is the complete list, if you want to correct the
171
464 identified Wikipedia entries with broken links to The Internet
465 Archive:
<a href=
"http://www.wikidata.org/entity/Q1140317">Q1140317
</a>,
466 <a href=
"http://www.wikidata.org/entity/Q458656">Q458656
</a>,
467 <a href=
"http://www.wikidata.org/entity/Q458656">Q458656
</a>,
468 <a href=
"http://www.wikidata.org/entity/Q470560">Q470560
</a>,
469 <a href=
"http://www.wikidata.org/entity/Q743340">Q743340
</a>,
470 <a href=
"http://www.wikidata.org/entity/Q822580">Q822580
</a>,
471 <a href=
"http://www.wikidata.org/entity/Q480696">Q480696
</a>,
472 <a href=
"http://www.wikidata.org/entity/Q128761">Q128761
</a>,
473 <a href=
"http://www.wikidata.org/entity/Q1307059">Q1307059
</a>,
474 <a href=
"http://www.wikidata.org/entity/Q1335091">Q1335091
</a>,
475 <a href=
"http://www.wikidata.org/entity/Q1537166">Q1537166
</a>,
476 <a href=
"http://www.wikidata.org/entity/Q1438334">Q1438334
</a>,
477 <a href=
"http://www.wikidata.org/entity/Q1479751">Q1479751
</a>,
478 <a href=
"http://www.wikidata.org/entity/Q1497200">Q1497200
</a>,
479 <a href=
"http://www.wikidata.org/entity/Q1498122">Q1498122
</a>,
480 <a href=
"http://www.wikidata.org/entity/Q865973">Q865973
</a>,
481 <a href=
"http://www.wikidata.org/entity/Q834269">Q834269
</a>,
482 <a href=
"http://www.wikidata.org/entity/Q841781">Q841781
</a>,
483 <a href=
"http://www.wikidata.org/entity/Q841781">Q841781
</a>,
484 <a href=
"http://www.wikidata.org/entity/Q1548193">Q1548193
</a>,
485 <a href=
"http://www.wikidata.org/entity/Q499031">Q499031
</a>,
486 <a href=
"http://www.wikidata.org/entity/Q1564769">Q1564769
</a>,
487 <a href=
"http://www.wikidata.org/entity/Q1585239">Q1585239
</a>,
488 <a href=
"http://www.wikidata.org/entity/Q1585569">Q1585569
</a>,
489 <a href=
"http://www.wikidata.org/entity/Q1624236">Q1624236
</a>,
490 <a href=
"http://www.wikidata.org/entity/Q4796595">Q4796595
</a>,
491 <a href=
"http://www.wikidata.org/entity/Q4853469">Q4853469
</a>,
492 <a href=
"http://www.wikidata.org/entity/Q4873046">Q4873046
</a>,
493 <a href=
"http://www.wikidata.org/entity/Q915016">Q915016
</a>,
494 <a href=
"http://www.wikidata.org/entity/Q4660396">Q4660396
</a>,
495 <a href=
"http://www.wikidata.org/entity/Q4677708">Q4677708
</a>,
496 <a href=
"http://www.wikidata.org/entity/Q4738449">Q4738449
</a>,
497 <a href=
"http://www.wikidata.org/entity/Q4756096">Q4756096
</a>,
498 <a href=
"http://www.wikidata.org/entity/Q4766785">Q4766785
</a>,
499 <a href=
"http://www.wikidata.org/entity/Q880357">Q880357
</a>,
500 <a href=
"http://www.wikidata.org/entity/Q882066">Q882066
</a>,
501 <a href=
"http://www.wikidata.org/entity/Q882066">Q882066
</a>,
502 <a href=
"http://www.wikidata.org/entity/Q204191">Q204191
</a>,
503 <a href=
"http://www.wikidata.org/entity/Q204191">Q204191
</a>,
504 <a href=
"http://www.wikidata.org/entity/Q1194170">Q1194170
</a>,
505 <a href=
"http://www.wikidata.org/entity/Q940014">Q940014
</a>,
506 <a href=
"http://www.wikidata.org/entity/Q946863">Q946863
</a>,
507 <a href=
"http://www.wikidata.org/entity/Q172837">Q172837
</a>,
508 <a href=
"http://www.wikidata.org/entity/Q573077">Q573077
</a>,
509 <a href=
"http://www.wikidata.org/entity/Q1219005">Q1219005
</a>,
510 <a href=
"http://www.wikidata.org/entity/Q1219599">Q1219599
</a>,
511 <a href=
"http://www.wikidata.org/entity/Q1643798">Q1643798
</a>,
512 <a href=
"http://www.wikidata.org/entity/Q1656352">Q1656352
</a>,
513 <a href=
"http://www.wikidata.org/entity/Q1659549">Q1659549
</a>,
514 <a href=
"http://www.wikidata.org/entity/Q1660007">Q1660007
</a>,
515 <a href=
"http://www.wikidata.org/entity/Q1698154">Q1698154
</a>,
516 <a href=
"http://www.wikidata.org/entity/Q1737980">Q1737980
</a>,
517 <a href=
"http://www.wikidata.org/entity/Q1877284">Q1877284
</a>,
518 <a href=
"http://www.wikidata.org/entity/Q1199354">Q1199354
</a>,
519 <a href=
"http://www.wikidata.org/entity/Q1199354">Q1199354
</a>,
520 <a href=
"http://www.wikidata.org/entity/Q1199451">Q1199451
</a>,
521 <a href=
"http://www.wikidata.org/entity/Q1211871">Q1211871
</a>,
522 <a href=
"http://www.wikidata.org/entity/Q1212179">Q1212179
</a>,
523 <a href=
"http://www.wikidata.org/entity/Q1238382">Q1238382
</a>,
524 <a href=
"http://www.wikidata.org/entity/Q4906454">Q4906454
</a>,
525 <a href=
"http://www.wikidata.org/entity/Q320219">Q320219
</a>,
526 <a href=
"http://www.wikidata.org/entity/Q1148649">Q1148649
</a>,
527 <a href=
"http://www.wikidata.org/entity/Q645094">Q645094
</a>,
528 <a href=
"http://www.wikidata.org/entity/Q5050350">Q5050350
</a>,
529 <a href=
"http://www.wikidata.org/entity/Q5166548">Q5166548
</a>,
530 <a href=
"http://www.wikidata.org/entity/Q2677926">Q2677926
</a>,
531 <a href=
"http://www.wikidata.org/entity/Q2698139">Q2698139
</a>,
532 <a href=
"http://www.wikidata.org/entity/Q2707305">Q2707305
</a>,
533 <a href=
"http://www.wikidata.org/entity/Q2740725">Q2740725
</a>,
534 <a href=
"http://www.wikidata.org/entity/Q2024780">Q2024780
</a>,
535 <a href=
"http://www.wikidata.org/entity/Q2117418">Q2117418
</a>,
536 <a href=
"http://www.wikidata.org/entity/Q2138984">Q2138984
</a>,
537 <a href=
"http://www.wikidata.org/entity/Q1127992">Q1127992
</a>,
538 <a href=
"http://www.wikidata.org/entity/Q1058087">Q1058087
</a>,
539 <a href=
"http://www.wikidata.org/entity/Q1070484">Q1070484
</a>,
540 <a href=
"http://www.wikidata.org/entity/Q1080080">Q1080080
</a>,
541 <a href=
"http://www.wikidata.org/entity/Q1090813">Q1090813
</a>,
542 <a href=
"http://www.wikidata.org/entity/Q1251918">Q1251918
</a>,
543 <a href=
"http://www.wikidata.org/entity/Q1254110">Q1254110
</a>,
544 <a href=
"http://www.wikidata.org/entity/Q1257070">Q1257070
</a>,
545 <a href=
"http://www.wikidata.org/entity/Q1257079">Q1257079
</a>,
546 <a href=
"http://www.wikidata.org/entity/Q1197410">Q1197410
</a>,
547 <a href=
"http://www.wikidata.org/entity/Q1198423">Q1198423
</a>,
548 <a href=
"http://www.wikidata.org/entity/Q706951">Q706951
</a>,
549 <a href=
"http://www.wikidata.org/entity/Q723239">Q723239
</a>,
550 <a href=
"http://www.wikidata.org/entity/Q2079261">Q2079261
</a>,
551 <a href=
"http://www.wikidata.org/entity/Q1171364">Q1171364
</a>,
552 <a href=
"http://www.wikidata.org/entity/Q617858">Q617858
</a>,
553 <a href=
"http://www.wikidata.org/entity/Q5166611">Q5166611
</a>,
554 <a href=
"http://www.wikidata.org/entity/Q5166611">Q5166611
</a>,
555 <a href=
"http://www.wikidata.org/entity/Q324513">Q324513
</a>,
556 <a href=
"http://www.wikidata.org/entity/Q374172">Q374172
</a>,
557 <a href=
"http://www.wikidata.org/entity/Q7533269">Q7533269
</a>,
558 <a href=
"http://www.wikidata.org/entity/Q970386">Q970386
</a>,
559 <a href=
"http://www.wikidata.org/entity/Q976849">Q976849
</a>,
560 <a href=
"http://www.wikidata.org/entity/Q7458614">Q7458614
</a>,
561 <a href=
"http://www.wikidata.org/entity/Q5347416">Q5347416
</a>,
562 <a href=
"http://www.wikidata.org/entity/Q5460005">Q5460005
</a>,
563 <a href=
"http://www.wikidata.org/entity/Q5463392">Q5463392
</a>,
564 <a href=
"http://www.wikidata.org/entity/Q3038555">Q3038555
</a>,
565 <a href=
"http://www.wikidata.org/entity/Q5288458">Q5288458
</a>,
566 <a href=
"http://www.wikidata.org/entity/Q2346516">Q2346516
</a>,
567 <a href=
"http://www.wikidata.org/entity/Q5183645">Q5183645
</a>,
568 <a href=
"http://www.wikidata.org/entity/Q5185497">Q5185497
</a>,
569 <a href=
"http://www.wikidata.org/entity/Q5216127">Q5216127
</a>,
570 <a href=
"http://www.wikidata.org/entity/Q5223127">Q5223127
</a>,
571 <a href=
"http://www.wikidata.org/entity/Q5261159">Q5261159
</a>,
572 <a href=
"http://www.wikidata.org/entity/Q1300759">Q1300759
</a>,
573 <a href=
"http://www.wikidata.org/entity/Q5521241">Q5521241
</a>,
574 <a href=
"http://www.wikidata.org/entity/Q7733434">Q7733434
</a>,
575 <a href=
"http://www.wikidata.org/entity/Q7736264">Q7736264
</a>,
576 <a href=
"http://www.wikidata.org/entity/Q7737032">Q7737032
</a>,
577 <a href=
"http://www.wikidata.org/entity/Q7882671">Q7882671
</a>,
578 <a href=
"http://www.wikidata.org/entity/Q7719427">Q7719427
</a>,
579 <a href=
"http://www.wikidata.org/entity/Q7719444">Q7719444
</a>,
580 <a href=
"http://www.wikidata.org/entity/Q7722575">Q7722575
</a>,
581 <a href=
"http://www.wikidata.org/entity/Q2629763">Q2629763
</a>,
582 <a href=
"http://www.wikidata.org/entity/Q2640346">Q2640346
</a>,
583 <a href=
"http://www.wikidata.org/entity/Q2649671">Q2649671
</a>,
584 <a href=
"http://www.wikidata.org/entity/Q7703851">Q7703851
</a>,
585 <a href=
"http://www.wikidata.org/entity/Q7747041">Q7747041
</a>,
586 <a href=
"http://www.wikidata.org/entity/Q6544949">Q6544949
</a>,
587 <a href=
"http://www.wikidata.org/entity/Q6672759">Q6672759
</a>,
588 <a href=
"http://www.wikidata.org/entity/Q2445896">Q2445896
</a>,
589 <a href=
"http://www.wikidata.org/entity/Q12124891">Q12124891
</a>,
590 <a href=
"http://www.wikidata.org/entity/Q3127044">Q3127044
</a>,
591 <a href=
"http://www.wikidata.org/entity/Q2511262">Q2511262
</a>,
592 <a href=
"http://www.wikidata.org/entity/Q2517672">Q2517672
</a>,
593 <a href=
"http://www.wikidata.org/entity/Q2543165">Q2543165
</a>,
594 <a href=
"http://www.wikidata.org/entity/Q426628">Q426628
</a>,
595 <a href=
"http://www.wikidata.org/entity/Q426628">Q426628
</a>,
596 <a href=
"http://www.wikidata.org/entity/Q12126890">Q12126890
</a>,
597 <a href=
"http://www.wikidata.org/entity/Q13359969">Q13359969
</a>,
598 <a href=
"http://www.wikidata.org/entity/Q13359969">Q13359969
</a>,
599 <a href=
"http://www.wikidata.org/entity/Q2294295">Q2294295
</a>,
600 <a href=
"http://www.wikidata.org/entity/Q2294295">Q2294295
</a>,
601 <a href=
"http://www.wikidata.org/entity/Q2559509">Q2559509
</a>,
602 <a href=
"http://www.wikidata.org/entity/Q2559912">Q2559912
</a>,
603 <a href=
"http://www.wikidata.org/entity/Q7760469">Q7760469
</a>,
604 <a href=
"http://www.wikidata.org/entity/Q6703974">Q6703974
</a>,
605 <a href=
"http://www.wikidata.org/entity/Q4744">Q4744
</a>,
606 <a href=
"http://www.wikidata.org/entity/Q7766962">Q7766962
</a>,
607 <a href=
"http://www.wikidata.org/entity/Q7768516">Q7768516
</a>,
608 <a href=
"http://www.wikidata.org/entity/Q7769205">Q7769205
</a>,
609 <a href=
"http://www.wikidata.org/entity/Q7769988">Q7769988
</a>,
610 <a href=
"http://www.wikidata.org/entity/Q2946945">Q2946945
</a>,
611 <a href=
"http://www.wikidata.org/entity/Q3212086">Q3212086
</a>,
612 <a href=
"http://www.wikidata.org/entity/Q3212086">Q3212086
</a>,
613 <a href=
"http://www.wikidata.org/entity/Q18218448">Q18218448
</a>,
614 <a href=
"http://www.wikidata.org/entity/Q18218448">Q18218448
</a>,
615 <a href=
"http://www.wikidata.org/entity/Q18218448">Q18218448
</a>,
616 <a href=
"http://www.wikidata.org/entity/Q6909175">Q6909175
</a>,
617 <a href=
"http://www.wikidata.org/entity/Q7405709">Q7405709
</a>,
618 <a href=
"http://www.wikidata.org/entity/Q7416149">Q7416149
</a>,
619 <a href=
"http://www.wikidata.org/entity/Q7239952">Q7239952
</a>,
620 <a href=
"http://www.wikidata.org/entity/Q7317332">Q7317332
</a>,
621 <a href=
"http://www.wikidata.org/entity/Q7783674">Q7783674
</a>,
622 <a href=
"http://www.wikidata.org/entity/Q7783704">Q7783704
</a>,
623 <a href=
"http://www.wikidata.org/entity/Q7857590">Q7857590
</a>,
624 <a href=
"http://www.wikidata.org/entity/Q3372526">Q3372526
</a>,
625 <a href=
"http://www.wikidata.org/entity/Q3372642">Q3372642
</a>,
626 <a href=
"http://www.wikidata.org/entity/Q3372816">Q3372816
</a>,
627 <a href=
"http://www.wikidata.org/entity/Q3372909">Q3372909
</a>,
628 <a href=
"http://www.wikidata.org/entity/Q7959649">Q7959649
</a>,
629 <a href=
"http://www.wikidata.org/entity/Q7977485">Q7977485
</a>,
630 <a href=
"http://www.wikidata.org/entity/Q7992684">Q7992684
</a>,
631 <a href=
"http://www.wikidata.org/entity/Q3817966">Q3817966
</a>,
632 <a href=
"http://www.wikidata.org/entity/Q3821852">Q3821852
</a>,
633 <a href=
"http://www.wikidata.org/entity/Q3420907">Q3420907
</a>,
634 <a href=
"http://www.wikidata.org/entity/Q3429733">Q3429733
</a>,
635 <a href=
"http://www.wikidata.org/entity/Q774474">Q774474
</a></p>
637 <p>As usual, if you use Bitcoin and want to show your support of my
638 activities, please send Bitcoin donations to my address
639 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
644 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/opphavsrett">opphavsrett
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/verkidetfri">verkidetfri
</a>.
649 <div class=
"padding"></div>
652 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/A_one_way_wall_on_the_border_.html">A one-way wall on the border?
</a></div>
653 <div class=
"date">14th October
2017</div>
654 <div class=
"body"><p>I find it fascinating how many of the people being locked inside
655 the proposed border wall between USA and Mexico support the idea. The
656 proposal to keep Mexicans out reminds me of
657 <a href=
"http://www.history.com/news/10-things-you-may-not-know-about-the-berlin-wall">the
658 propaganda twist from the East Germany government
</a> calling the wall
659 the “Antifascist Bulwark” after erecting the Berlin Wall, claiming
660 that the wall was erected to keep enemies from creeping into East
661 Germany, while it was obvious to the people locked inside it that it
662 was erected to keep the people from escaping.
</p>
664 <p>Do the people in USA supporting this wall really believe it is a
665 one way wall, only keeping people on the outside from getting in,
666 while not keeping people in the inside from getting out?
</p>
668 <p>As usual, if you use Bitcoin and want to show your support of my
669 activities, please send Bitcoin donations to my address
670 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
675 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>.
680 <div class=
"padding"></div>
683 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Generating_3D_prints_in_Debian_using_Cura_and_Slic3r__prusa_.html">Generating
3D prints in Debian using Cura and Slic3r(-prusa)
</a></div>
684 <div class=
"date"> 9th October
2017</div>
685 <div class=
"body"><p>At my nearby maker space,
686 <a href=
"http://sonen.ifi.uio.no/">Sonen
</a>, I heard the story that it
687 was easier to generate gcode files for theyr
3D printers (Ultimake
2+)
688 on Windows and MacOS X than Linux, because the software involved had
689 to be manually compiled and set up on Linux while premade packages
690 worked out of the box on Windows and MacOS X. I found this annoying,
691 as the software involved,
692 <a href=
"https://github.com/Ultimaker/Cura">Cura
</a>, is free software
693 and should be trivial to get up and running on Linux if someone took
694 the time to package it for the relevant distributions. I even found
695 <a href=
"https://bugs.debian.org/706656">a request for adding into
696 Debian
</a> from
2013, which had seem some activity over the years but
697 never resulted in the software showing up in Debian. So a few days
698 ago I offered my help to try to improve the situation.
</p>
700 <p>Now I am very happy to see that all the packages required by a
701 working Cura in Debian are uploaded into Debian and waiting in the NEW
702 queue for the ftpmasters to have a look. You can track the progress
704 <a href=
"https://qa.debian.org/developer.php?email=3dprinter-general%40lists.alioth.debian.org">the
705 status page for the
3D printer team
</a>.
</p>
707 <p>The uploaded packages are a bit behind upstream, and was uploaded
708 now to get slots in
<a href=
"https://ftp-master.debian.org/new.html">the NEW
709 queue
</a> while we work up updating the packages to the latest
710 upstream version.
</p>
712 <p>On a related note, two competitors for Cura, which I found harder
713 to use and was unable to configure correctly for Ultimaker
2+ in the
714 short time I spent on it, are already in Debian. If you are looking
715 for
3D printer "slicers" and want something already available in
717 <a href=
"https://tracker.debian.org/pkg/slic3r">slic3r
</a> and
718 <a href=
"https://tracker.debian.org/pkg/slic3r-prusa">slic3r-prusa
</a>.
719 The latter is a fork of the former.
</p>
721 <p>As usual, if you use Bitcoin and want to show your support of my
722 activities, please send Bitcoin donations to my address
723 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
728 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/3d-printer">3d-printer
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/debian">debian
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>.
733 <div class=
"padding"></div>
736 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Mangler_du_en_skrue__eller_har_du_en_skrue_l_s_.html">Mangler du en skrue, eller har du en skrue løs?
</a></div>
737 <div class=
"date"> 4th October
2017</div>
738 <div class=
"body">Når jeg holder på med ulike prosjekter, så trenger jeg stadig ulike
739 skruer. Det siste prosjektet jeg holder på med er å lage
740 <a href=
"https://www.thingiverse.com/thing:676916">en boks til en
741 HDMI-touch-skjerm
</a> som skal brukes med Raspberry Pi. Boksen settes
742 sammen med skruer og bolter, og jeg har vært i tvil om hvor jeg kan
743 få tak i de riktige skruene. Clas Ohlson og Jernia i nærheten har
744 sjelden hatt det jeg trenger. Men her om dagen fikk jeg et fantastisk
745 tips for oss som bor i Oslo.
746 <a href=
"http://www.zachskruer.no/">Zachariassen Jernvare AS
</a> i
747 <a href=
"http://www.openstreetmap.org/?mlat=59.93421&mlon=10.76795#map=19/59.93421/10.76795">Hegermannsgate
748 23A på Torshov
</a> har et fantastisk utvalg, og åpent mellom
09:
00 og
749 17:
00. De selger skruer, muttere, bolter, skiver etc i løs vekt, og
750 så langt har jeg fått alt jeg har lett etter. De har i tillegg det
751 meste av annen jernvare, som verktøy, lamper, ledninger, etc. Jeg
752 håper de har nok kunder til å holde det gående lenge, da dette er en
753 butikk jeg kommer til å besøke ofte. Butikken er et funn å ha i
754 nabolaget for oss som liker å bygge litt selv. :)
</p>
756 <p>Som vanlig, hvis du bruker Bitcoin og ønsker å vise din støtte til
757 det jeg driver med, setter jeg pris på om du sender Bitcoin-donasjoner
759 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
764 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/norsk">norsk
</a>.
769 <div class=
"padding"></div>
772 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Visualizing_GSM_radio_chatter_using_gr_gsm_and_Hopglass.html">Visualizing GSM radio chatter using gr-gsm and Hopglass
</a></div>
773 <div class=
"date">29th September
2017</div>
774 <div class=
"body"><p>Every mobile phone announce its existence over radio to the nearby
775 mobile cell towers. And this radio chatter is available for anyone
776 with a radio receiver capable of receiving them. Details about the
777 mobile phones with very good accuracy is of course collected by the
778 phone companies, but this is not the topic of this blog post. The
779 mobile phone radio chatter make it possible to figure out when a cell
780 phone is nearby, as it include the SIM card ID (IMSI). By paying
781 attention over time, one can see when a phone arrive and when it leave
782 an area. I believe it would be nice to make this information more
783 available to the general public, to make more people aware of how
784 their phones are announcing their whereabouts to anyone that care to
787 <p>I am very happy to report that we managed to get something
788 visualizing this information up and running for
789 <a href=
"http://norwaymakers.org/osf17">Oslo Skaperfestival
2017</a>
790 (Oslo Makers Festival) taking place today and tomorrow at Deichmanske
791 library. The solution is based on the
792 <a href=
"http://people.skolelinux.org/pere/blog/Easier_recipe_to_observe_the_cell_phones_around_you.html">simple
793 recipe for listening to GSM chatter
</a> I posted a few days ago, and
794 will show up at the stand of
<a href=
"http://sonen.ifi.uio.no/">Åpen
795 Sone from the Computer Science department of the University of
796 Oslo
</a>. The presentation will show the nearby mobile phones (aka
797 IMSIs) as dots in a web browser graph, with lines to the dot
798 representing mobile base station it is talking to. It was working in
799 the lab yesterday, and was moved into place this morning.
</p>
801 <p>We set up a fairly powerful desktop machine using Debian
802 Buster/Testing with several (five, I believe) RTL2838 DVB-T receivers
803 connected and visualize the visible cell phone towers using an
804 <a href=
"https://github.com/marlow925/hopglass">English version of
805 Hopglass
</a>. A fairly powerfull machine is needed as the
806 grgsm_livemon_headless processes from
807 <a href=
"https://tracker.debian.org/pkg/gr-gsm">gr-gsm
</a> converting
808 the radio signal to data packages is quite CPU intensive.
</p>
810 <p>The frequencies to listen to, are identified using a slightly
811 patched scan-and-livemon (to set the --args values for each receiver),
812 and the Hopglass data is generated using the
813 <a href=
"https://github.com/petterreinholdtsen/IMSI-catcher/tree/meshviewer-output">patches
814 in my meshviewer-output branch
</a>. For some reason we could not get
815 more than four SDRs working. There is also a geographical map trying
816 to show the location of the base stations, but I believe their
817 coordinates are hardcoded to some random location in Germany, I
818 believe. The code should be replaced with code to look up location in
819 a text file, a sqlite database or one of the online databases
821 <a href=
"https://github.com/Oros42/IMSI-catcher/issues/14">the github
822 issue for the topic
</a>.
824 <p>If this sound interesting, visit the stand at the festival!
</p>
829 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/debian">debian
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/personvern">personvern
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/surveillance">surveillance
</a>.
834 <div class=
"padding"></div>
837 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Easier_recipe_to_observe_the_cell_phones_around_you.html">Easier recipe to observe the cell phones around you
</a></div>
838 <div class=
"date">24th September
2017</div>
839 <div class=
"body"><p>A little more than a month ago I wrote
840 <a href=
"http://people.skolelinux.org/pere/blog/Simpler_recipe_on_how_to_make_a_simple__7_IMSI_Catcher_using_Debian.html">how
841 to observe the SIM card ID (aka IMSI number) of mobile phones talking
842 to nearby mobile phone base stations using Debian GNU/Linux and a
843 cheap USB software defined radio
</a>, and thus being able to pinpoint
844 the location of people and equipment (like cars and trains) with an
845 accuracy of a few kilometer. Since then we have worked to make the
846 procedure even simpler, and it is now possible to do this without any
847 manual frequency tuning and without building your own packages.
</p>
849 <p>The
<a href=
"https://tracker.debian.org/pkg/gr-gsm">gr-gsm
</a>
850 package is now included in Debian testing and unstable, and the
851 IMSI-catcher code no longer require root access to fetch and decode
852 the GSM data collected using gr-gsm.
</p>
854 <p>Here is an updated recipe, using packages built by Debian and a git
855 clone of two python scripts:
</p>
859 <li>Start with a Debian machine running the Buster version (aka
862 <li>Run '
<tt>apt install gr-gsm python-numpy python-scipy
863 python-scapy
</tt>' as root to install required packages.
</li>
865 <li>Fetch the code decoding GSM packages using '
<tt>git clone
866 github.com/Oros42/IMSI-catcher.git
</tt>'.
</li>
868 <li>Insert USB software defined radio supported by GNU Radio.
</li>
870 <li>Enter the IMSI-catcher directory and run '
<tt>python
871 scan-and-livemon
</tt>' to locate the frequency of nearby base
872 stations and start listening for GSM packages on one of them.
</li>
874 <li>Enter the IMSI-catcher directory and run '
<tt>python
875 simple_IMSI-catcher.py
</tt>' to display the collected information.
</li>
879 <p>Note, due to a bug somewhere the scan-and-livemon program (actually
880 <a href=
"https://github.com/ptrkrysik/gr-gsm/issues/336">its underlying
881 program grgsm_scanner
</a>) do not work with the HackRF radio. It does
882 work with RTL
8232 and other similar USB radio receivers you can get
884 (
<a href=
"https://www.ebay.com/sch/items/?_nkw=rtl+2832">for example
885 from ebay
</a>), so for now the solution is to scan using the RTL radio
886 and only use HackRF for fetching GSM data.
</p>
888 <p>As far as I can tell, a cell phone only show up on one of the
889 frequencies at the time, so if you are going to track and count every
890 cell phone around you, you need to listen to all the frequencies used.
891 To listen to several frequencies, use the --numrecv argument to
892 scan-and-livemon to use several receivers. Further, I am not sure if
893 phones using
3G or
4G will show as talking GSM to base stations, so
894 this approach might not see all phones around you. I typically see
895 0-
400 IMSI numbers an hour when looking around where I live.
</p>
897 <p>I've tried to run the scanner on a
898 <a href=
"https://wiki.debian.org/RaspberryPi">Raspberry Pi
2 and
3
899 running Debian Buster
</a>, but the grgsm_livemon_headless process seem
900 to be too CPU intensive to keep up. When GNU Radio print 'O' to
901 stdout, I am told there it is caused by a buffer overflow between the
902 radio and GNU Radio, caused by the program being unable to read the
903 GSM data fast enough. If you see a stream of 'O's from the terminal
904 where you started scan-and-livemon, you need a give the process more
905 CPU power. Perhaps someone are able to optimize the code to a point
906 where it become possible to set up RPi3 based GSM sniffers? I tried
907 using Raspbian instead of Debian, but there seem to be something wrong
908 with GNU Radio on raspbian, causing glibc to abort().
</p>
913 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/debian">debian
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/personvern">personvern
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/surveillance">surveillance
</a>.
918 <div class=
"padding"></div>
920 <p style=
"text-align: right;"><a href=
"index.rss"><img src=
"http://people.skolelinux.org/pere/blog/xml.gif" alt=
"RSS feed" width=
"36" height=
"14" /></a></p>
931 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/01/">January (
4)
</a></li>
933 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/02/">February (
3)
</a></li>
935 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/03/">March (
5)
</a></li>
937 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/04/">April (
2)
</a></li>
939 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/06/">June (
5)
</a></li>
941 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/07/">July (
1)
</a></li>
943 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/08/">August (
1)
</a></li>
945 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/09/">September (
3)
</a></li>
947 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/10/">October (
5)
</a></li>
949 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/11/">November (
3)
</a></li>
956 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/01/">January (
3)
</a></li>
958 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/02/">February (
2)
</a></li>
960 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/03/">March (
3)
</a></li>
962 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/04/">April (
8)
</a></li>
964 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/05/">May (
8)
</a></li>
966 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/06/">June (
2)
</a></li>
968 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/07/">July (
2)
</a></li>
970 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/08/">August (
5)
</a></li>
972 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/09/">September (
2)
</a></li>
974 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/10/">October (
3)
</a></li>
976 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/11/">November (
8)
</a></li>
978 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/12/">December (
5)
</a></li>
985 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/01/">January (
7)
</a></li>
987 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/02/">February (
6)
</a></li>
989 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/03/">March (
1)
</a></li>
991 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/04/">April (
4)
</a></li>
993 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/05/">May (
3)
</a></li>
995 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/06/">June (
4)
</a></li>
997 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/07/">July (
6)
</a></li>
999 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/08/">August (
2)
</a></li>
1001 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/09/">September (
2)
</a></li>
1003 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/10/">October (
9)
</a></li>
1005 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/11/">November (
6)
</a></li>
1007 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/12/">December (
3)
</a></li>
1014 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/01/">January (
2)
</a></li>
1016 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/02/">February (
3)
</a></li>
1018 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/03/">March (
8)
</a></li>
1020 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/04/">April (
7)
</a></li>
1022 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/05/">May (
1)
</a></li>
1024 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/06/">June (
2)
</a></li>
1026 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/07/">July (
2)
</a></li>
1028 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/08/">August (
2)
</a></li>
1030 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/09/">September (
5)
</a></li>
1032 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/10/">October (
6)
</a></li>
1034 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/11/">November (
3)
</a></li>
1036 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/12/">December (
5)
</a></li>
1043 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/01/">January (
11)
</a></li>
1045 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/02/">February (
9)
</a></li>
1047 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/03/">March (
9)
</a></li>
1049 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/04/">April (
6)
</a></li>
1051 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/05/">May (
9)
</a></li>
1053 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/06/">June (
10)
</a></li>
1055 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/07/">July (
7)
</a></li>
1057 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/08/">August (
3)
</a></li>
1059 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/09/">September (
5)
</a></li>
1061 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/10/">October (
7)
</a></li>
1063 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/11/">November (
9)
</a></li>
1065 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/12/">December (
3)
</a></li>
1072 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/01/">January (
7)
</a></li>
1074 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/02/">February (
10)
</a></li>
1076 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/03/">March (
17)
</a></li>
1078 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/04/">April (
12)
</a></li>
1080 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/05/">May (
12)
</a></li>
1082 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/06/">June (
20)
</a></li>
1084 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/07/">July (
17)
</a></li>
1086 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/08/">August (
6)
</a></li>
1088 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/09/">September (
9)
</a></li>
1090 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/10/">October (
17)
</a></li>
1092 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/11/">November (
10)
</a></li>
1094 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/12/">December (
7)
</a></li>
1101 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/01/">January (
16)
</a></li>
1103 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/02/">February (
6)
</a></li>
1105 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/03/">March (
6)
</a></li>
1107 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/04/">April (
7)
</a></li>
1109 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/05/">May (
3)
</a></li>
1111 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/06/">June (
2)
</a></li>
1113 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/07/">July (
7)
</a></li>
1115 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/08/">August (
6)
</a></li>
1117 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/09/">September (
4)
</a></li>
1119 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/10/">October (
2)
</a></li>
1121 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/11/">November (
3)
</a></li>
1123 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/12/">December (
1)
</a></li>
1130 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/01/">January (
2)
</a></li>
1132 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/02/">February (
1)
</a></li>
1134 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/03/">March (
3)
</a></li>
1136 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/04/">April (
3)
</a></li>
1138 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/05/">May (
9)
</a></li>
1140 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/06/">June (
14)
</a></li>
1142 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/07/">July (
12)
</a></li>
1144 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/08/">August (
13)
</a></li>
1146 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/09/">September (
7)
</a></li>
1148 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/10/">October (
9)
</a></li>
1150 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/11/">November (
13)
</a></li>
1152 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/12/">December (
12)
</a></li>
1159 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/01/">January (
8)
</a></li>
1161 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/02/">February (
8)
</a></li>
1163 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/03/">March (
12)
</a></li>
1165 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/04/">April (
10)
</a></li>
1167 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/05/">May (
9)
</a></li>
1169 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/06/">June (
3)
</a></li>
1171 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/07/">July (
4)
</a></li>
1173 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/08/">August (
3)
</a></li>
1175 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/09/">September (
1)
</a></li>
1177 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/10/">October (
2)
</a></li>
1179 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/11/">November (
3)
</a></li>
1181 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/12/">December (
3)
</a></li>
1188 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2008/11/">November (
5)
</a></li>
1190 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2008/12/">December (
7)
</a></li>
1201 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/3d-printer">3d-printer (
14)
</a></li>
1203 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/amiga">amiga (
1)
</a></li>
1205 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/aros">aros (
1)
</a></li>
1207 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/bankid">bankid (
4)
</a></li>
1209 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/bitcoin">bitcoin (
9)
</a></li>
1211 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/bootsystem">bootsystem (
16)
</a></li>
1213 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/bsa">bsa (
2)
</a></li>
1215 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/chrpath">chrpath (
2)
</a></li>
1217 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/debian">debian (
154)
</a></li>
1219 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/debian edu">debian edu (
158)
</a></li>
1221 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/debian-handbook">debian-handbook (
4)
</a></li>
1223 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/digistan">digistan (
10)
</a></li>
1225 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/dld">dld (
17)
</a></li>
1227 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/docbook">docbook (
24)
</a></li>
1229 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/drivstoffpriser">drivstoffpriser (
4)
</a></li>
1231 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/english">english (
360)
</a></li>
1233 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/fiksgatami">fiksgatami (
23)
</a></li>
1235 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/fildeling">fildeling (
12)
</a></li>
1237 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/freeculture">freeculture (
30)
</a></li>
1239 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/freedombox">freedombox (
9)
</a></li>
1241 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/frikanalen">frikanalen (
18)
</a></li>
1243 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/h264">h264 (
20)
</a></li>
1245 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/intervju">intervju (
42)
</a></li>
1247 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/isenkram">isenkram (
15)
</a></li>
1249 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/kart">kart (
20)
</a></li>
1251 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/ldap">ldap (
9)
</a></li>
1253 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/lego">lego (
4)
</a></li>
1255 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/lenker">lenker (
8)
</a></li>
1257 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/lsdvd">lsdvd (
2)
</a></li>
1259 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/ltsp">ltsp (
1)
</a></li>
1261 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/mesh network">mesh network (
8)
</a></li>
1263 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/multimedia">multimedia (
39)
</a></li>
1265 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/nice free software">nice free software (
9)
</a></li>
1267 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/norsk">norsk (
293)
</a></li>
1269 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/nuug">nuug (
189)
</a></li>
1271 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/offentlig innsyn">offentlig innsyn (
33)
</a></li>
1273 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/open311">open311 (
2)
</a></li>
1275 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/opphavsrett">opphavsrett (
67)
</a></li>
1277 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/personvern">personvern (
104)
</a></li>
1279 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/raid">raid (
2)
</a></li>
1281 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/reactos">reactos (
1)
</a></li>
1283 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/reprap">reprap (
11)
</a></li>
1285 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/rfid">rfid (
3)
</a></li>
1287 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/robot">robot (
10)
</a></li>
1289 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/rss">rss (
1)
</a></li>
1291 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/ruter">ruter (
5)
</a></li>
1293 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/scraperwiki">scraperwiki (
2)
</a></li>
1295 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/sikkerhet">sikkerhet (
53)
</a></li>
1297 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/sitesummary">sitesummary (
4)
</a></li>
1299 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/skepsis">skepsis (
5)
</a></li>
1301 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/standard">standard (
55)
</a></li>
1303 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/stavekontroll">stavekontroll (
6)
</a></li>
1305 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/stortinget">stortinget (
12)
</a></li>
1307 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/surveillance">surveillance (
52)
</a></li>
1309 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/sysadmin">sysadmin (
4)
</a></li>
1311 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/usenix">usenix (
2)
</a></li>
1313 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/valg">valg (
9)
</a></li>
1315 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/verkidetfri">verkidetfri (
5)
</a></li>
1317 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/video">video (
59)
</a></li>
1319 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/vitenskap">vitenskap (
4)
</a></li>
1321 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/web">web (
40)
</a></li>
1327 <p style=
"text-align: right">
1328 Created by
<a href=
"http://steve.org.uk/Software/chronicle">Chronicle v4.6
</a>