1 <!DOCTYPE html PUBLIC
"-//W3C//DTD XHTML 1.0 Strict//EN"
2 "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
3 <html xmlns=
"http://www.w3.org/1999/xhtml" dir=
"ltr">
5 <meta http-equiv=
"Content-Type" content=
"text/html;charset=utf-8" />
6 <title>Petter Reinholdtsen
</title>
7 <link rel=
"stylesheet" type=
"text/css" media=
"screen" href=
"http://people.skolelinux.org/pere/blog/style.css" />
8 <link rel=
"stylesheet" type=
"text/css" media=
"screen" href=
"http://people.skolelinux.org/pere/blog/vim.css" />
9 <link rel=
"alternate" title=
"RSS Feed" href=
"http://people.skolelinux.org/pere/blog/index.rss" type=
"application/rss+xml" />
14 <a href=
"http://people.skolelinux.org/pere/blog/">Petter Reinholdtsen
</a>
23 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Metadata_proposal_for_movies_on_the_Internet_Archive.html">Metadata proposal for movies on the Internet Archive
</a></div>
24 <div class=
"date">28th November
2017</div>
25 <div class=
"body"><p>It would be easier to locate the movie you want to watch in
26 <a href=
"https://www.archive.org/">the Internet Archive
</a>, if the
27 metadata about each movie was more complete and accurate. In the
28 archiving community, a well known saying state that good metadata is a
29 love letter to the future. The metadata in the Internet Archive could
30 use a face lift for the future to love us back. Here is a proposal
31 for a small improvement that would make the metadata more useful
32 today. I've been unable to find any document describing the various
33 standard fields available when uploading videos to the archive, so
34 this proposal is based on my best quess and searching through several
35 of the existing movies.
</p>
37 <p>I have a few use cases in mind. First of all, I would like to be
38 able to count the number of distinct movies in the Internet Archive,
39 without duplicates. I would further like to identify the IMDB title
40 ID of the movies in the Internet Archive, to be able to look up a IMDB
41 title ID and know if I can fetch the video from there and share it
44 <p>Second, I would like the Butter data provider for The Internet
46 (
<a href=
"https://github.com/butterproviders/butter-provider-archive">available
47 from github
</a>), to list as many of the good movies as possible. The
48 plugin currently do a search in the archive with the following
52 collection:moviesandfilms
53 AND NOT collection:movie_trailers
54 AND -mediatype:collection
55 AND format:"Archive BitTorrent"
59 <p>Most of the cool movies that fail to show up in Butter do so
60 because the 'year' field is missing. The 'year' field is populated by
61 the year part from the 'date' field, and should be when the movie was
62 released (date or year). Two such examples are
63 <a href=
"https://archive.org/details/SidneyOlcottsBen-hur1905">Ben Hur
65 <a href=
"https://archive.org/details/Caminandes2GranDillama">Caminandes
66 2: Gran Dillama from
2013</a>, where the year metadata field is
69 So, my proposal is simply, for every movie in The Internet Archive
70 where an IMDB title ID exist, please fill in these metadata fields
71 (note, they can be updated also long after the video was uploaded, but
72 as far as I can tell, only by the uploader):
77 <dd>Should be 'movie' for movies.
</dd>
80 <dd>Should contain 'moviesandfilms'.
</dd>
83 <dd>The title of the movie, without the publication year.
</dd>
86 <dd>The data or year the movie was released. This make the movie show
87 up in Butter, as well as make it possible to know the age of the
88 movie and is useful to figure out copyright status.
</dd>
91 <dd>The director of the movie. This make it easier to know if the
92 correct movie is found in movie databases.
</dd>
95 <dd>The production company making the movie. Also useful for
96 identifying the correct movie.
</dd>
100 <dd>Add a link to the IMDB title page, for example like this:
<a
101 href="http://www.imdb.com/title/tt0028496/"
>Movie in
102 IMDB
</a
>. This make it easier to find duplicates and allow for
103 counting of number of unique movies in the Archive. Other external
104 references, like to TMDB, could be added like this too.
</dd>
108 <p>I did consider proposing a Custom field for the IMDB title ID (for
109 example 'imdb_title_url', 'imdb_code' or simply 'imdb', but suspect it
110 will be easier to simply place it in the links free text field.
</p>
113 <a href=
"https://github.com/petterreinholdtsen/public-domain-free-imdb">a
114 list of IMDB title IDs for several thousand movies in the Internet
115 Archive
</a>, but I also got a list of several thousand movies without
116 such IMDB title ID (and quite a few duplicates). It would be great if
117 this data set could be integrated into the Internet Archive metadata
118 to be available for everyone in the future, but with the current
119 policy of leaving metadata editing to the uploaders, it will take a
120 while before this happen. If you have uploaded movies into the
121 Internet Archive, you can help. Please consider following my proposal
122 above for your movies, to ensure that movie is properly
125 <p>The list is mostly generated using wikidata, which based on
126 Wikipedia articles make it possible to link between IMDB and movies in
127 the Internet Archive. But there are lots of movies without a
128 Wikipedia article, and some movies where only a collection page exist
129 (like for
<a href=
"https://en.wikipedia.org/wiki/Caminandes">the
130 Caminandes example above
</a>, where there are three movies but only
131 one Wikidata entry).
</p>
133 <p>As usual, if you use Bitcoin and want to show your support of my
134 activities, please send Bitcoin donations to my address
135 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
140 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/opphavsrett">opphavsrett
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/verkidetfri">verkidetfri
</a>.
145 <div class=
"padding"></div>
148 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Legal_to_share_more_than_3000_movies_listed_on_IMDB_.html">Legal to share more than
3000 movies listed on IMDB?
</a></div>
149 <div class=
"date">18th November
2017</div>
150 <div class=
"body"><p>A month ago, I blogged about my work to
151 <a href=
"http://people.skolelinux.org/pere/blog/Locating_IMDB_IDs_of_movies_in_the_Internet_Archive_using_Wikidata.html">automatically
152 check the copyright status of IMDB entries
</a>, and try to count the
153 number of movies listed in IMDB that is legal to distribute on the
154 Internet. I have continued to look for good data sources, and
155 identified a few more. The code used to extract information from
156 various data sources is available in
157 <a href=
"https://github.com/petterreinholdtsen/public-domain-free-imdb">a
158 git repository
</a>, currently available from github.
</p>
160 <p>So far I have identified
3186 unique IMDB title IDs. To gain
161 better understanding of the structure of the data set, I created a
162 histogram of the year associated with each movie (typically release
163 year). It is interesting to notice where the peaks and dips in the
164 graph are located. I wonder why they are placed there. I suspect
165 World War II caused the dip around
1940, but what caused the peak
168 <p align=
"center"><img src=
"http://people.skolelinux.org/pere/blog/images/2017-11-18-verk-i-det-fri-filmer.png" /></p>
170 <p>I've so far identified ten sources for IMDB title IDs for movies in
171 the public domain or with a free license. This is the statistics
172 reported when running 'make stats' in the git repository:
</p>
175 249 entries (
6 unique) with and
288 without IMDB title ID in free-movies-archive-org-butter.json
176 2301 entries (
540 unique) with and
0 without IMDB title ID in free-movies-archive-org-wikidata.json
177 830 entries (
29 unique) with and
0 without IMDB title ID in free-movies-icheckmovies-archive-mochard.json
178 2109 entries (
377 unique) with and
0 without IMDB title ID in free-movies-imdb-pd.json
179 291 entries (
122 unique) with and
0 without IMDB title ID in free-movies-letterboxd-pd.json
180 144 entries (
135 unique) with and
0 without IMDB title ID in free-movies-manual.json
181 350 entries (
1 unique) with and
801 without IMDB title ID in free-movies-publicdomainmovies.json
182 4 entries (
0 unique) with and
124 without IMDB title ID in free-movies-publicdomainreview.json
183 698 entries (
119 unique) with and
118 without IMDB title ID in free-movies-publicdomaintorrents.json
184 8 entries (
8 unique) with and
196 without IMDB title ID in free-movies-vodo.json
185 3186 unique IMDB title IDs in total
188 <p>The entries without IMDB title ID are candidates to increase the
189 data set, but might equally well be duplicates of entries already
190 listed with IMDB title ID in one of the other sources, or represent
191 movies that lack a IMDB title ID. I've seen examples of all these
192 situations when peeking at the entries without IMDB title ID. Based
193 on these data sources, the lower bound for movies listed in IMDB that
194 are legal to distribute on the Internet is between
3186 and
4713.
196 <p>It would be great for improving the accuracy of this measurement,
197 if the various sources added IMDB title ID to their metadata. I have
198 tried to reach the people behind the various sources to ask if they
199 are interested in doing this, without any replies so far. Perhaps you
200 can help me get in touch with the people behind VODO, Public Domain
201 Torrents, Public Domain Movies and Public Domain Review to try to
202 convince them to add more metadata to their movie entries?
</p>
204 <p>Another way you could help is by adding pages to Wikipedia about
205 movies that are legal to distribute on the Internet. If such page
206 exist and include a link to both IMDB and The Internet Archive, the
207 script used to generate free-movies-archive-org-wikidata.json should
208 pick up the mapping as soon as wikidata is updates.
</p>
210 <p>As usual, if you use Bitcoin and want to show your support of my
211 activities, please send Bitcoin donations to my address
212 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
217 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/opphavsrett">opphavsrett
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/verkidetfri">verkidetfri
</a>.
222 <div class=
"padding"></div>
225 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Some_notes_on_fault_tolerant_storage_systems.html">Some notes on fault tolerant storage systems
</a></div>
226 <div class=
"date"> 1st November
2017</div>
227 <div class=
"body"><p>If you care about how fault tolerant your storage is, you might
228 find these articles and papers interesting. They have formed how I
229 think of when designing a storage system.
</p>
233 <li>USENIX :login;
<a
234 href=
"https://www.usenix.org/publications/login/summer2017/ganesan">Redundancy
235 Does Not Imply Fault Tolerance. Analysis of Distributed Storage
236 Reactions to Single Errors and Corruptions
</a> by Aishwarya Ganesan,
237 Ramnatthan Alagappan, Andrea C. Arpaci-Dusseau, and Remzi
238 H. Arpaci-Dusseau
</li>
241 <a href=
"http://www.zdnet.com/article/why-raid-5-stops-working-in-2009/">Why
242 RAID
5 stops working in
2009</a> by Robin Harris
</li>
245 <a href=
"http://www.zdnet.com/article/why-raid-6-stops-working-in-2019/">Why
246 RAID
6 stops working in
2019</a> by Robin Harris
</li>
249 <a href=
"http://research.google.com/archive/disk_failures.pdf">Failure
250 Trends in a Large Disk Drive Population
</a> by Eduardo Pinheiro,
251 Wolf-Dietrich Weber and Luiz André Barroso
</li>
253 <li>USENIX ;login:
<a
254 href=
"https://www.usenix.org/system/files/login/articles/hughes12-04.pdf">Data
255 Integrity. Finding Truth in a World of Guesses and Lies
</a> by Doug
259 <a href=
"https://www.usenix.org/events/fast08/tech/full_papers/bairavasundaram/bairavasundaram_html/">An
260 Analysis of Data Corruption in the Storage Stack
</a> by
261 L. N. Bairavasundaram, G. R. Goodson, B. Schroeder, A. C.
262 Arpaci-Dusseau, and R. H. Arpaci-Dusseau
</li>
264 <li>USENIX FAST'
07 <a
265 href=
"https://www.usenix.org/legacy/events/fast07/tech/schroeder/schroeder_html/">Disk
266 failures in the real world: what does an MTTF of
1,
000,
000 hours mean
267 to you?
</a> by B. Schroeder and G. A. Gibson.
</li>
269 <li>USENIX ;login:
<a
270 href=
"https://www.usenix.org/events/fast08/tech/full_papers/jiang/jiang_html/">Are
271 Disks the Dominant Contributor for Storage Failures? A Comprehensive
272 Study of Storage Subsystem Failure Characteristics
</a> by Weihang
273 Jiang, Chongfeng Hu, Yuanyuan Zhou, and Arkady Kanevsky
</li>
276 <a href=
"http://research.cs.wisc.edu/adsl/Publications/latent-sigmetrics07.pdf">An
277 analysis of latent sector errors in disk drives
</a> by
278 L. N. Bairavasundaram, G. R. Goodson, S. Pasupathy, and J. Schindler
</li>
282 <p>Several of these research papers are based on data collected from
283 hundred thousands or millions of disk, and their findings are eye
284 opening. The short story is simply do not implicitly trust RAID or
285 redundant storage systems. Details matter. And unfortunately there
286 are few options on Linux addressing all the identified issues. Both
287 ZFS and Btrfs are doing a fairly good job, but have legal and
288 practical issues on their own. I wonder how cluster file systems like
289 Ceph do in this regard. After all, there is an old saying, you know
290 you have a distributed system when the crash of a computer you have
291 never heard of stops you from getting any work done. The same holds
292 true if fault tolerance do not work.
</p>
294 <p>Just remember, in the end, it do not matter how redundant, or how
295 fault tolerant your storage is, if you do not continuously monitor its
296 status to detect and replace failed disks.
</p>
298 <p>As usual, if you use Bitcoin and want to show your support of my
299 activities, please send Bitcoin donations to my address
300 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
305 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/raid">raid
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/sysadmin">sysadmin
</a>.
310 <div class=
"padding"></div>
313 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Web_services_for_writing_academic_LaTeX_papers_as_a_team.html">Web services for writing academic LaTeX papers as a team
</a></div>
314 <div class=
"date">31st October
2017</div>
315 <div class=
"body"><p>I was surprised today to learn that a friend in academia did not
316 know there are easily available web services available for writing
317 LaTeX documents as a team. I thought it was common knowledge, but to
318 make sure at least my readers are aware of it, I would like to mention
319 these useful services for writing LaTeX documents. Some of them even
320 provide a WYSIWYG editor to ease writing even further.
</p>
322 <p>There are two commercial services available,
323 <a href=
"https://sharelatex.com">ShareLaTeX
</a> and
324 <a href=
"https://overleaf.com">Overleaf
</a>. They are very easy to
325 use. Just start a new document, select which publisher to write for
326 (ie which LaTeX style to use), and start writing. Note, these two
327 have announced their intention to join forces, so soon it will only be
328 one joint service. I've used both for different documents, and they
329 work just fine. While
330 <a href=
"https://github.com/sharelatex/sharelatex">ShareLaTeX is free
331 software
</a>, while the latter is not. According to
<a
332 href=
"https://www.overleaf.com/help/17-is-overleaf-open-source">a
333 announcement from Overleaf
</a>, they plan to keep the ShareLaTeX code
334 base maintained as free software.
</p>
336 But these two are not the only alternatives.
337 <a href=
"https://app.fiduswriter.org/">Fidus Writer
</a> is another free
338 software solution with
<a href=
"https://github.com/fiduswriter">the
339 source available on github
</a>. I have not used it myself. Several
340 others can be found on the nice
341 <a href=
"https://alternativeto.net/software/sharelatex/">alterntiveTo
344 <p>If you like Google Docs or Etherpad, but would like to write
345 documents in LaTeX, you should check out these services. You can even
346 host your own, if you want to. :)
</p>
348 <p>As usual, if you use Bitcoin and want to show your support of my
349 activities, please send Bitcoin donations to my address
350 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
355 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>.
360 <div class=
"padding"></div>
363 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Locating_IMDB_IDs_of_movies_in_the_Internet_Archive_using_Wikidata.html">Locating IMDB IDs of movies in the Internet Archive using Wikidata
</a></div>
364 <div class=
"date">25th October
2017</div>
365 <div class=
"body"><p>Recently, I needed to automatically check the copyright status of a
366 set of
<a href=
"http://www.imdb.com/">The Internet Movie database
367 (IMDB)
</a> entries, to figure out which one of the movies they refer
368 to can be freely distributed on the Internet. This proved to be
369 harder than it sounds. IMDB for sure list movies without any
370 copyright protection, where the copyright protection has expired or
371 where the movie is lisenced using a permissive license like one from
372 Creative Commons. These are mixed with copyright protected movies,
373 and there seem to be no way to separate these classes of movies using
374 the information in IMDB.
</p>
376 <p>First I tried to look up entries manually in IMDB,
377 <a href=
"https://www.wikipedia.org/">Wikipedia
</a> and
378 <a href=
"https://www.archive.org/">The Internet Archive
</a>, to get a
379 feel how to do this. It is hard to know for sure using these sources,
380 but it should be possible to be reasonable confident a movie is "out
381 of copyright" with a few hours work per movie. As I needed to check
382 almost
20,
000 entries, this approach was not sustainable. I simply
383 can not work around the clock for about
6 years to check this data
386 <p>I asked the people behind The Internet Archive if they could
387 introduce a new metadata field in their metadata XML for IMDB ID, but
388 was told that they leave it completely to the uploaders to update the
389 metadata. Some of the metadata entries had IMDB links in the
390 description, but I found no way to download all metadata files in bulk
391 to locate those ones and put that approach aside.
</p>
393 <p>In the process I noticed several Wikipedia articles about movies
394 had links to both IMDB and The Internet Archive, and it occured to me
395 that I could use the Wikipedia RDF data set to locate entries with
396 both, to at least get a lower bound on the number of movies on The
397 Internet Archive with a IMDB ID. This is useful based on the
398 assumption that movies distributed by The Internet Archive can be
399 legally distributed on the Internet. With some help from the RDF
400 community (thank you DanC), I was able to come up with this query to
401 pass to
<a href=
"https://query.wikidata.org/">the SPARQL interface on
405 SELECT ?work ?imdb ?ia ?when ?label
408 ?work wdt:P31/wdt:P279* wd:Q11424.
409 ?work wdt:P345 ?imdb.
412 ?work wdt:P577 ?when.
413 ?work rdfs:label ?label.
414 FILTER(LANG(?label) = "en").
419 <p>If I understand the query right, for every film entry anywhere in
420 Wikpedia, it will return the IMDB ID and The Internet Archive ID, and
421 when the movie was released and its English title, if either or both
422 of the latter two are available. At the moment the result set contain
423 2338 entries. Of course, it depend on volunteers including both
424 correct IMDB and The Internet Archive IDs in the wikipedia articles
425 for the movie. It should be noted that the result will include
426 duplicates if the movie have entries in several languages. There are
427 some bogus entries, either because The Internet Archive ID contain a
428 typo or because the movie is not available from The Internet Archive.
429 I did not verify the IMDB IDs, as I am unsure how to do that
432 <p>I wrote a small python script to extract the data set from Wikidata
433 and check if the XML metadata for the movie is available from The
434 Internet Archive, and after around
1.5 hour it produced a list of
2097
435 free movies and their IMDB ID. In total,
171 entries in Wikidata lack
436 the refered Internet Archive entry. I assume the
70 "disappearing"
437 entries (ie
2338-
2097-
171) are duplicate entries.
</p>
439 <p>This is not too bad, given that The Internet Archive report to
440 contain
<a href=
"https://archive.org/details/feature_films">5331
441 feature films
</a> at the moment, but it also mean more than
3000
442 movies are missing on Wikipedia or are missing the pair of references
445 <p>I was curious about the distribution by release year, and made a
446 little graph to show how the amount of free movies is spread over the
449 <p><img src=
"http://people.skolelinux.org/pere/blog/images/2017-10-25-verk-i-det-fri-filmer.png"></p>
451 <p>I expect the relative distribution of the remaining
3000 movies to
454 <p>If you want to help, and want to ensure Wikipedia can be used to
455 cross reference The Internet Archive and The Internet Movie Database,
456 please make sure entries like this are listed under the "External
457 links" heading on the Wikipedia article for the movie:
</p>
460 * {{Internet Archive film|id=FightingLady}}
461 * {{IMDb title|id=
0036823|title=The Fighting Lady}}
464 <p>Please verify the links on the final page, to make sure you did not
465 introduce a typo.
</p>
467 <p>Here is the complete list, if you want to correct the
171
468 identified Wikipedia entries with broken links to The Internet
469 Archive:
<a href=
"http://www.wikidata.org/entity/Q1140317">Q1140317
</a>,
470 <a href=
"http://www.wikidata.org/entity/Q458656">Q458656
</a>,
471 <a href=
"http://www.wikidata.org/entity/Q458656">Q458656
</a>,
472 <a href=
"http://www.wikidata.org/entity/Q470560">Q470560
</a>,
473 <a href=
"http://www.wikidata.org/entity/Q743340">Q743340
</a>,
474 <a href=
"http://www.wikidata.org/entity/Q822580">Q822580
</a>,
475 <a href=
"http://www.wikidata.org/entity/Q480696">Q480696
</a>,
476 <a href=
"http://www.wikidata.org/entity/Q128761">Q128761
</a>,
477 <a href=
"http://www.wikidata.org/entity/Q1307059">Q1307059
</a>,
478 <a href=
"http://www.wikidata.org/entity/Q1335091">Q1335091
</a>,
479 <a href=
"http://www.wikidata.org/entity/Q1537166">Q1537166
</a>,
480 <a href=
"http://www.wikidata.org/entity/Q1438334">Q1438334
</a>,
481 <a href=
"http://www.wikidata.org/entity/Q1479751">Q1479751
</a>,
482 <a href=
"http://www.wikidata.org/entity/Q1497200">Q1497200
</a>,
483 <a href=
"http://www.wikidata.org/entity/Q1498122">Q1498122
</a>,
484 <a href=
"http://www.wikidata.org/entity/Q865973">Q865973
</a>,
485 <a href=
"http://www.wikidata.org/entity/Q834269">Q834269
</a>,
486 <a href=
"http://www.wikidata.org/entity/Q841781">Q841781
</a>,
487 <a href=
"http://www.wikidata.org/entity/Q841781">Q841781
</a>,
488 <a href=
"http://www.wikidata.org/entity/Q1548193">Q1548193
</a>,
489 <a href=
"http://www.wikidata.org/entity/Q499031">Q499031
</a>,
490 <a href=
"http://www.wikidata.org/entity/Q1564769">Q1564769
</a>,
491 <a href=
"http://www.wikidata.org/entity/Q1585239">Q1585239
</a>,
492 <a href=
"http://www.wikidata.org/entity/Q1585569">Q1585569
</a>,
493 <a href=
"http://www.wikidata.org/entity/Q1624236">Q1624236
</a>,
494 <a href=
"http://www.wikidata.org/entity/Q4796595">Q4796595
</a>,
495 <a href=
"http://www.wikidata.org/entity/Q4853469">Q4853469
</a>,
496 <a href=
"http://www.wikidata.org/entity/Q4873046">Q4873046
</a>,
497 <a href=
"http://www.wikidata.org/entity/Q915016">Q915016
</a>,
498 <a href=
"http://www.wikidata.org/entity/Q4660396">Q4660396
</a>,
499 <a href=
"http://www.wikidata.org/entity/Q4677708">Q4677708
</a>,
500 <a href=
"http://www.wikidata.org/entity/Q4738449">Q4738449
</a>,
501 <a href=
"http://www.wikidata.org/entity/Q4756096">Q4756096
</a>,
502 <a href=
"http://www.wikidata.org/entity/Q4766785">Q4766785
</a>,
503 <a href=
"http://www.wikidata.org/entity/Q880357">Q880357
</a>,
504 <a href=
"http://www.wikidata.org/entity/Q882066">Q882066
</a>,
505 <a href=
"http://www.wikidata.org/entity/Q882066">Q882066
</a>,
506 <a href=
"http://www.wikidata.org/entity/Q204191">Q204191
</a>,
507 <a href=
"http://www.wikidata.org/entity/Q204191">Q204191
</a>,
508 <a href=
"http://www.wikidata.org/entity/Q1194170">Q1194170
</a>,
509 <a href=
"http://www.wikidata.org/entity/Q940014">Q940014
</a>,
510 <a href=
"http://www.wikidata.org/entity/Q946863">Q946863
</a>,
511 <a href=
"http://www.wikidata.org/entity/Q172837">Q172837
</a>,
512 <a href=
"http://www.wikidata.org/entity/Q573077">Q573077
</a>,
513 <a href=
"http://www.wikidata.org/entity/Q1219005">Q1219005
</a>,
514 <a href=
"http://www.wikidata.org/entity/Q1219599">Q1219599
</a>,
515 <a href=
"http://www.wikidata.org/entity/Q1643798">Q1643798
</a>,
516 <a href=
"http://www.wikidata.org/entity/Q1656352">Q1656352
</a>,
517 <a href=
"http://www.wikidata.org/entity/Q1659549">Q1659549
</a>,
518 <a href=
"http://www.wikidata.org/entity/Q1660007">Q1660007
</a>,
519 <a href=
"http://www.wikidata.org/entity/Q1698154">Q1698154
</a>,
520 <a href=
"http://www.wikidata.org/entity/Q1737980">Q1737980
</a>,
521 <a href=
"http://www.wikidata.org/entity/Q1877284">Q1877284
</a>,
522 <a href=
"http://www.wikidata.org/entity/Q1199354">Q1199354
</a>,
523 <a href=
"http://www.wikidata.org/entity/Q1199354">Q1199354
</a>,
524 <a href=
"http://www.wikidata.org/entity/Q1199451">Q1199451
</a>,
525 <a href=
"http://www.wikidata.org/entity/Q1211871">Q1211871
</a>,
526 <a href=
"http://www.wikidata.org/entity/Q1212179">Q1212179
</a>,
527 <a href=
"http://www.wikidata.org/entity/Q1238382">Q1238382
</a>,
528 <a href=
"http://www.wikidata.org/entity/Q4906454">Q4906454
</a>,
529 <a href=
"http://www.wikidata.org/entity/Q320219">Q320219
</a>,
530 <a href=
"http://www.wikidata.org/entity/Q1148649">Q1148649
</a>,
531 <a href=
"http://www.wikidata.org/entity/Q645094">Q645094
</a>,
532 <a href=
"http://www.wikidata.org/entity/Q5050350">Q5050350
</a>,
533 <a href=
"http://www.wikidata.org/entity/Q5166548">Q5166548
</a>,
534 <a href=
"http://www.wikidata.org/entity/Q2677926">Q2677926
</a>,
535 <a href=
"http://www.wikidata.org/entity/Q2698139">Q2698139
</a>,
536 <a href=
"http://www.wikidata.org/entity/Q2707305">Q2707305
</a>,
537 <a href=
"http://www.wikidata.org/entity/Q2740725">Q2740725
</a>,
538 <a href=
"http://www.wikidata.org/entity/Q2024780">Q2024780
</a>,
539 <a href=
"http://www.wikidata.org/entity/Q2117418">Q2117418
</a>,
540 <a href=
"http://www.wikidata.org/entity/Q2138984">Q2138984
</a>,
541 <a href=
"http://www.wikidata.org/entity/Q1127992">Q1127992
</a>,
542 <a href=
"http://www.wikidata.org/entity/Q1058087">Q1058087
</a>,
543 <a href=
"http://www.wikidata.org/entity/Q1070484">Q1070484
</a>,
544 <a href=
"http://www.wikidata.org/entity/Q1080080">Q1080080
</a>,
545 <a href=
"http://www.wikidata.org/entity/Q1090813">Q1090813
</a>,
546 <a href=
"http://www.wikidata.org/entity/Q1251918">Q1251918
</a>,
547 <a href=
"http://www.wikidata.org/entity/Q1254110">Q1254110
</a>,
548 <a href=
"http://www.wikidata.org/entity/Q1257070">Q1257070
</a>,
549 <a href=
"http://www.wikidata.org/entity/Q1257079">Q1257079
</a>,
550 <a href=
"http://www.wikidata.org/entity/Q1197410">Q1197410
</a>,
551 <a href=
"http://www.wikidata.org/entity/Q1198423">Q1198423
</a>,
552 <a href=
"http://www.wikidata.org/entity/Q706951">Q706951
</a>,
553 <a href=
"http://www.wikidata.org/entity/Q723239">Q723239
</a>,
554 <a href=
"http://www.wikidata.org/entity/Q2079261">Q2079261
</a>,
555 <a href=
"http://www.wikidata.org/entity/Q1171364">Q1171364
</a>,
556 <a href=
"http://www.wikidata.org/entity/Q617858">Q617858
</a>,
557 <a href=
"http://www.wikidata.org/entity/Q5166611">Q5166611
</a>,
558 <a href=
"http://www.wikidata.org/entity/Q5166611">Q5166611
</a>,
559 <a href=
"http://www.wikidata.org/entity/Q324513">Q324513
</a>,
560 <a href=
"http://www.wikidata.org/entity/Q374172">Q374172
</a>,
561 <a href=
"http://www.wikidata.org/entity/Q7533269">Q7533269
</a>,
562 <a href=
"http://www.wikidata.org/entity/Q970386">Q970386
</a>,
563 <a href=
"http://www.wikidata.org/entity/Q976849">Q976849
</a>,
564 <a href=
"http://www.wikidata.org/entity/Q7458614">Q7458614
</a>,
565 <a href=
"http://www.wikidata.org/entity/Q5347416">Q5347416
</a>,
566 <a href=
"http://www.wikidata.org/entity/Q5460005">Q5460005
</a>,
567 <a href=
"http://www.wikidata.org/entity/Q5463392">Q5463392
</a>,
568 <a href=
"http://www.wikidata.org/entity/Q3038555">Q3038555
</a>,
569 <a href=
"http://www.wikidata.org/entity/Q5288458">Q5288458
</a>,
570 <a href=
"http://www.wikidata.org/entity/Q2346516">Q2346516
</a>,
571 <a href=
"http://www.wikidata.org/entity/Q5183645">Q5183645
</a>,
572 <a href=
"http://www.wikidata.org/entity/Q5185497">Q5185497
</a>,
573 <a href=
"http://www.wikidata.org/entity/Q5216127">Q5216127
</a>,
574 <a href=
"http://www.wikidata.org/entity/Q5223127">Q5223127
</a>,
575 <a href=
"http://www.wikidata.org/entity/Q5261159">Q5261159
</a>,
576 <a href=
"http://www.wikidata.org/entity/Q1300759">Q1300759
</a>,
577 <a href=
"http://www.wikidata.org/entity/Q5521241">Q5521241
</a>,
578 <a href=
"http://www.wikidata.org/entity/Q7733434">Q7733434
</a>,
579 <a href=
"http://www.wikidata.org/entity/Q7736264">Q7736264
</a>,
580 <a href=
"http://www.wikidata.org/entity/Q7737032">Q7737032
</a>,
581 <a href=
"http://www.wikidata.org/entity/Q7882671">Q7882671
</a>,
582 <a href=
"http://www.wikidata.org/entity/Q7719427">Q7719427
</a>,
583 <a href=
"http://www.wikidata.org/entity/Q7719444">Q7719444
</a>,
584 <a href=
"http://www.wikidata.org/entity/Q7722575">Q7722575
</a>,
585 <a href=
"http://www.wikidata.org/entity/Q2629763">Q2629763
</a>,
586 <a href=
"http://www.wikidata.org/entity/Q2640346">Q2640346
</a>,
587 <a href=
"http://www.wikidata.org/entity/Q2649671">Q2649671
</a>,
588 <a href=
"http://www.wikidata.org/entity/Q7703851">Q7703851
</a>,
589 <a href=
"http://www.wikidata.org/entity/Q7747041">Q7747041
</a>,
590 <a href=
"http://www.wikidata.org/entity/Q6544949">Q6544949
</a>,
591 <a href=
"http://www.wikidata.org/entity/Q6672759">Q6672759
</a>,
592 <a href=
"http://www.wikidata.org/entity/Q2445896">Q2445896
</a>,
593 <a href=
"http://www.wikidata.org/entity/Q12124891">Q12124891
</a>,
594 <a href=
"http://www.wikidata.org/entity/Q3127044">Q3127044
</a>,
595 <a href=
"http://www.wikidata.org/entity/Q2511262">Q2511262
</a>,
596 <a href=
"http://www.wikidata.org/entity/Q2517672">Q2517672
</a>,
597 <a href=
"http://www.wikidata.org/entity/Q2543165">Q2543165
</a>,
598 <a href=
"http://www.wikidata.org/entity/Q426628">Q426628
</a>,
599 <a href=
"http://www.wikidata.org/entity/Q426628">Q426628
</a>,
600 <a href=
"http://www.wikidata.org/entity/Q12126890">Q12126890
</a>,
601 <a href=
"http://www.wikidata.org/entity/Q13359969">Q13359969
</a>,
602 <a href=
"http://www.wikidata.org/entity/Q13359969">Q13359969
</a>,
603 <a href=
"http://www.wikidata.org/entity/Q2294295">Q2294295
</a>,
604 <a href=
"http://www.wikidata.org/entity/Q2294295">Q2294295
</a>,
605 <a href=
"http://www.wikidata.org/entity/Q2559509">Q2559509
</a>,
606 <a href=
"http://www.wikidata.org/entity/Q2559912">Q2559912
</a>,
607 <a href=
"http://www.wikidata.org/entity/Q7760469">Q7760469
</a>,
608 <a href=
"http://www.wikidata.org/entity/Q6703974">Q6703974
</a>,
609 <a href=
"http://www.wikidata.org/entity/Q4744">Q4744
</a>,
610 <a href=
"http://www.wikidata.org/entity/Q7766962">Q7766962
</a>,
611 <a href=
"http://www.wikidata.org/entity/Q7768516">Q7768516
</a>,
612 <a href=
"http://www.wikidata.org/entity/Q7769205">Q7769205
</a>,
613 <a href=
"http://www.wikidata.org/entity/Q7769988">Q7769988
</a>,
614 <a href=
"http://www.wikidata.org/entity/Q2946945">Q2946945
</a>,
615 <a href=
"http://www.wikidata.org/entity/Q3212086">Q3212086
</a>,
616 <a href=
"http://www.wikidata.org/entity/Q3212086">Q3212086
</a>,
617 <a href=
"http://www.wikidata.org/entity/Q18218448">Q18218448
</a>,
618 <a href=
"http://www.wikidata.org/entity/Q18218448">Q18218448
</a>,
619 <a href=
"http://www.wikidata.org/entity/Q18218448">Q18218448
</a>,
620 <a href=
"http://www.wikidata.org/entity/Q6909175">Q6909175
</a>,
621 <a href=
"http://www.wikidata.org/entity/Q7405709">Q7405709
</a>,
622 <a href=
"http://www.wikidata.org/entity/Q7416149">Q7416149
</a>,
623 <a href=
"http://www.wikidata.org/entity/Q7239952">Q7239952
</a>,
624 <a href=
"http://www.wikidata.org/entity/Q7317332">Q7317332
</a>,
625 <a href=
"http://www.wikidata.org/entity/Q7783674">Q7783674
</a>,
626 <a href=
"http://www.wikidata.org/entity/Q7783704">Q7783704
</a>,
627 <a href=
"http://www.wikidata.org/entity/Q7857590">Q7857590
</a>,
628 <a href=
"http://www.wikidata.org/entity/Q3372526">Q3372526
</a>,
629 <a href=
"http://www.wikidata.org/entity/Q3372642">Q3372642
</a>,
630 <a href=
"http://www.wikidata.org/entity/Q3372816">Q3372816
</a>,
631 <a href=
"http://www.wikidata.org/entity/Q3372909">Q3372909
</a>,
632 <a href=
"http://www.wikidata.org/entity/Q7959649">Q7959649
</a>,
633 <a href=
"http://www.wikidata.org/entity/Q7977485">Q7977485
</a>,
634 <a href=
"http://www.wikidata.org/entity/Q7992684">Q7992684
</a>,
635 <a href=
"http://www.wikidata.org/entity/Q3817966">Q3817966
</a>,
636 <a href=
"http://www.wikidata.org/entity/Q3821852">Q3821852
</a>,
637 <a href=
"http://www.wikidata.org/entity/Q3420907">Q3420907
</a>,
638 <a href=
"http://www.wikidata.org/entity/Q3429733">Q3429733
</a>,
639 <a href=
"http://www.wikidata.org/entity/Q774474">Q774474
</a></p>
641 <p>As usual, if you use Bitcoin and want to show your support of my
642 activities, please send Bitcoin donations to my address
643 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
648 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/opphavsrett">opphavsrett
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/verkidetfri">verkidetfri
</a>.
653 <div class=
"padding"></div>
656 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/A_one_way_wall_on_the_border_.html">A one-way wall on the border?
</a></div>
657 <div class=
"date">14th October
2017</div>
658 <div class=
"body"><p>I find it fascinating how many of the people being locked inside
659 the proposed border wall between USA and Mexico support the idea. The
660 proposal to keep Mexicans out reminds me of
661 <a href=
"http://www.history.com/news/10-things-you-may-not-know-about-the-berlin-wall">the
662 propaganda twist from the East Germany government
</a> calling the wall
663 the “Antifascist Bulwark” after erecting the Berlin Wall, claiming
664 that the wall was erected to keep enemies from creeping into East
665 Germany, while it was obvious to the people locked inside it that it
666 was erected to keep the people from escaping.
</p>
668 <p>Do the people in USA supporting this wall really believe it is a
669 one way wall, only keeping people on the outside from getting in,
670 while not keeping people in the inside from getting out?
</p>
672 <p>As usual, if you use Bitcoin and want to show your support of my
673 activities, please send Bitcoin donations to my address
674 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
679 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>.
684 <div class=
"padding"></div>
687 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Generating_3D_prints_in_Debian_using_Cura_and_Slic3r__prusa_.html">Generating
3D prints in Debian using Cura and Slic3r(-prusa)
</a></div>
688 <div class=
"date"> 9th October
2017</div>
689 <div class=
"body"><p>At my nearby maker space,
690 <a href=
"http://sonen.ifi.uio.no/">Sonen
</a>, I heard the story that it
691 was easier to generate gcode files for theyr
3D printers (Ultimake
2+)
692 on Windows and MacOS X than Linux, because the software involved had
693 to be manually compiled and set up on Linux while premade packages
694 worked out of the box on Windows and MacOS X. I found this annoying,
695 as the software involved,
696 <a href=
"https://github.com/Ultimaker/Cura">Cura
</a>, is free software
697 and should be trivial to get up and running on Linux if someone took
698 the time to package it for the relevant distributions. I even found
699 <a href=
"https://bugs.debian.org/706656">a request for adding into
700 Debian
</a> from
2013, which had seem some activity over the years but
701 never resulted in the software showing up in Debian. So a few days
702 ago I offered my help to try to improve the situation.
</p>
704 <p>Now I am very happy to see that all the packages required by a
705 working Cura in Debian are uploaded into Debian and waiting in the NEW
706 queue for the ftpmasters to have a look. You can track the progress
708 <a href=
"https://qa.debian.org/developer.php?email=3dprinter-general%40lists.alioth.debian.org">the
709 status page for the
3D printer team
</a>.
</p>
711 <p>The uploaded packages are a bit behind upstream, and was uploaded
712 now to get slots in
<a href=
"https://ftp-master.debian.org/new.html">the NEW
713 queue
</a> while we work up updating the packages to the latest
714 upstream version.
</p>
716 <p>On a related note, two competitors for Cura, which I found harder
717 to use and was unable to configure correctly for Ultimaker
2+ in the
718 short time I spent on it, are already in Debian. If you are looking
719 for
3D printer "slicers" and want something already available in
721 <a href=
"https://tracker.debian.org/pkg/slic3r">slic3r
</a> and
722 <a href=
"https://tracker.debian.org/pkg/slic3r-prusa">slic3r-prusa
</a>.
723 The latter is a fork of the former.
</p>
725 <p>As usual, if you use Bitcoin and want to show your support of my
726 activities, please send Bitcoin donations to my address
727 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
732 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/3d-printer">3d-printer
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/debian">debian
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>.
737 <div class=
"padding"></div>
740 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Mangler_du_en_skrue__eller_har_du_en_skrue_l_s_.html">Mangler du en skrue, eller har du en skrue løs?
</a></div>
741 <div class=
"date"> 4th October
2017</div>
742 <div class=
"body">Når jeg holder på med ulike prosjekter, så trenger jeg stadig ulike
743 skruer. Det siste prosjektet jeg holder på med er å lage
744 <a href=
"https://www.thingiverse.com/thing:676916">en boks til en
745 HDMI-touch-skjerm
</a> som skal brukes med Raspberry Pi. Boksen settes
746 sammen med skruer og bolter, og jeg har vært i tvil om hvor jeg kan
747 få tak i de riktige skruene. Clas Ohlson og Jernia i nærheten har
748 sjelden hatt det jeg trenger. Men her om dagen fikk jeg et fantastisk
749 tips for oss som bor i Oslo.
750 <a href=
"http://www.zachskruer.no/">Zachariassen Jernvare AS
</a> i
751 <a href=
"http://www.openstreetmap.org/?mlat=59.93421&mlon=10.76795#map=19/59.93421/10.76795">Hegermannsgate
752 23A på Torshov
</a> har et fantastisk utvalg, og åpent mellom
09:
00 og
753 17:
00. De selger skruer, muttere, bolter, skiver etc i løs vekt, og
754 så langt har jeg fått alt jeg har lett etter. De har i tillegg det
755 meste av annen jernvare, som verktøy, lamper, ledninger, etc. Jeg
756 håper de har nok kunder til å holde det gående lenge, da dette er en
757 butikk jeg kommer til å besøke ofte. Butikken er et funn å ha i
758 nabolaget for oss som liker å bygge litt selv. :)
</p>
760 <p>Som vanlig, hvis du bruker Bitcoin og ønsker å vise din støtte til
761 det jeg driver med, setter jeg pris på om du sender Bitcoin-donasjoner
763 <b><a href=
"bitcoin:15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b">15oWEoG9dUPovwmUL9KWAnYRtNJEkP1u1b
</a></b>.
</p>
768 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/norsk">norsk
</a>.
773 <div class=
"padding"></div>
776 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Visualizing_GSM_radio_chatter_using_gr_gsm_and_Hopglass.html">Visualizing GSM radio chatter using gr-gsm and Hopglass
</a></div>
777 <div class=
"date">29th September
2017</div>
778 <div class=
"body"><p>Every mobile phone announce its existence over radio to the nearby
779 mobile cell towers. And this radio chatter is available for anyone
780 with a radio receiver capable of receiving them. Details about the
781 mobile phones with very good accuracy is of course collected by the
782 phone companies, but this is not the topic of this blog post. The
783 mobile phone radio chatter make it possible to figure out when a cell
784 phone is nearby, as it include the SIM card ID (IMSI). By paying
785 attention over time, one can see when a phone arrive and when it leave
786 an area. I believe it would be nice to make this information more
787 available to the general public, to make more people aware of how
788 their phones are announcing their whereabouts to anyone that care to
791 <p>I am very happy to report that we managed to get something
792 visualizing this information up and running for
793 <a href=
"http://norwaymakers.org/osf17">Oslo Skaperfestival
2017</a>
794 (Oslo Makers Festival) taking place today and tomorrow at Deichmanske
795 library. The solution is based on the
796 <a href=
"http://people.skolelinux.org/pere/blog/Easier_recipe_to_observe_the_cell_phones_around_you.html">simple
797 recipe for listening to GSM chatter
</a> I posted a few days ago, and
798 will show up at the stand of
<a href=
"http://sonen.ifi.uio.no/">Åpen
799 Sone from the Computer Science department of the University of
800 Oslo
</a>. The presentation will show the nearby mobile phones (aka
801 IMSIs) as dots in a web browser graph, with lines to the dot
802 representing mobile base station it is talking to. It was working in
803 the lab yesterday, and was moved into place this morning.
</p>
805 <p>We set up a fairly powerful desktop machine using Debian
806 Buster/Testing with several (five, I believe) RTL2838 DVB-T receivers
807 connected and visualize the visible cell phone towers using an
808 <a href=
"https://github.com/marlow925/hopglass">English version of
809 Hopglass
</a>. A fairly powerfull machine is needed as the
810 grgsm_livemon_headless processes from
811 <a href=
"https://tracker.debian.org/pkg/gr-gsm">gr-gsm
</a> converting
812 the radio signal to data packages is quite CPU intensive.
</p>
814 <p>The frequencies to listen to, are identified using a slightly
815 patched scan-and-livemon (to set the --args values for each receiver),
816 and the Hopglass data is generated using the
817 <a href=
"https://github.com/petterreinholdtsen/IMSI-catcher/tree/meshviewer-output">patches
818 in my meshviewer-output branch
</a>. For some reason we could not get
819 more than four SDRs working. There is also a geographical map trying
820 to show the location of the base stations, but I believe their
821 coordinates are hardcoded to some random location in Germany, I
822 believe. The code should be replaced with code to look up location in
823 a text file, a sqlite database or one of the online databases
825 <a href=
"https://github.com/Oros42/IMSI-catcher/issues/14">the github
826 issue for the topic
</a>.
828 <p>If this sound interesting, visit the stand at the festival!
</p>
833 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/debian">debian
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/personvern">personvern
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/surveillance">surveillance
</a>.
838 <div class=
"padding"></div>
841 <div class=
"title"><a href=
"http://people.skolelinux.org/pere/blog/Easier_recipe_to_observe_the_cell_phones_around_you.html">Easier recipe to observe the cell phones around you
</a></div>
842 <div class=
"date">24th September
2017</div>
843 <div class=
"body"><p>A little more than a month ago I wrote
844 <a href=
"http://people.skolelinux.org/pere/blog/Simpler_recipe_on_how_to_make_a_simple__7_IMSI_Catcher_using_Debian.html">how
845 to observe the SIM card ID (aka IMSI number) of mobile phones talking
846 to nearby mobile phone base stations using Debian GNU/Linux and a
847 cheap USB software defined radio
</a>, and thus being able to pinpoint
848 the location of people and equipment (like cars and trains) with an
849 accuracy of a few kilometer. Since then we have worked to make the
850 procedure even simpler, and it is now possible to do this without any
851 manual frequency tuning and without building your own packages.
</p>
853 <p>The
<a href=
"https://tracker.debian.org/pkg/gr-gsm">gr-gsm
</a>
854 package is now included in Debian testing and unstable, and the
855 IMSI-catcher code no longer require root access to fetch and decode
856 the GSM data collected using gr-gsm.
</p>
858 <p>Here is an updated recipe, using packages built by Debian and a git
859 clone of two python scripts:
</p>
863 <li>Start with a Debian machine running the Buster version (aka
866 <li>Run '
<tt>apt install gr-gsm python-numpy python-scipy
867 python-scapy
</tt>' as root to install required packages.
</li>
869 <li>Fetch the code decoding GSM packages using '
<tt>git clone
870 github.com/Oros42/IMSI-catcher.git
</tt>'.
</li>
872 <li>Insert USB software defined radio supported by GNU Radio.
</li>
874 <li>Enter the IMSI-catcher directory and run '
<tt>python
875 scan-and-livemon
</tt>' to locate the frequency of nearby base
876 stations and start listening for GSM packages on one of them.
</li>
878 <li>Enter the IMSI-catcher directory and run '
<tt>python
879 simple_IMSI-catcher.py
</tt>' to display the collected information.
</li>
883 <p>Note, due to a bug somewhere the scan-and-livemon program (actually
884 <a href=
"https://github.com/ptrkrysik/gr-gsm/issues/336">its underlying
885 program grgsm_scanner
</a>) do not work with the HackRF radio. It does
886 work with RTL
8232 and other similar USB radio receivers you can get
888 (
<a href=
"https://www.ebay.com/sch/items/?_nkw=rtl+2832">for example
889 from ebay
</a>), so for now the solution is to scan using the RTL radio
890 and only use HackRF for fetching GSM data.
</p>
892 <p>As far as I can tell, a cell phone only show up on one of the
893 frequencies at the time, so if you are going to track and count every
894 cell phone around you, you need to listen to all the frequencies used.
895 To listen to several frequencies, use the --numrecv argument to
896 scan-and-livemon to use several receivers. Further, I am not sure if
897 phones using
3G or
4G will show as talking GSM to base stations, so
898 this approach might not see all phones around you. I typically see
899 0-
400 IMSI numbers an hour when looking around where I live.
</p>
901 <p>I've tried to run the scanner on a
902 <a href=
"https://wiki.debian.org/RaspberryPi">Raspberry Pi
2 and
3
903 running Debian Buster
</a>, but the grgsm_livemon_headless process seem
904 to be too CPU intensive to keep up. When GNU Radio print 'O' to
905 stdout, I am told there it is caused by a buffer overflow between the
906 radio and GNU Radio, caused by the program being unable to read the
907 GSM data fast enough. If you see a stream of 'O's from the terminal
908 where you started scan-and-livemon, you need a give the process more
909 CPU power. Perhaps someone are able to optimize the code to a point
910 where it become possible to set up RPi3 based GSM sniffers? I tried
911 using Raspbian instead of Debian, but there seem to be something wrong
912 with GNU Radio on raspbian, causing glibc to abort().
</p>
917 Tags:
<a href=
"http://people.skolelinux.org/pere/blog/tags/debian">debian
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/english">english
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/personvern">personvern
</a>,
<a href=
"http://people.skolelinux.org/pere/blog/tags/surveillance">surveillance
</a>.
922 <div class=
"padding"></div>
924 <p style=
"text-align: right;"><a href=
"index.rss"><img src=
"http://people.skolelinux.org/pere/blog/xml.gif" alt=
"RSS feed" width=
"36" height=
"14" /></a></p>
935 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/01/">January (
4)
</a></li>
937 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/02/">February (
3)
</a></li>
939 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/03/">March (
5)
</a></li>
941 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/04/">April (
2)
</a></li>
943 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/06/">June (
5)
</a></li>
945 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/07/">July (
1)
</a></li>
947 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/08/">August (
1)
</a></li>
949 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/09/">September (
3)
</a></li>
951 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/10/">October (
5)
</a></li>
953 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2017/11/">November (
3)
</a></li>
960 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/01/">January (
3)
</a></li>
962 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/02/">February (
2)
</a></li>
964 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/03/">March (
3)
</a></li>
966 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/04/">April (
8)
</a></li>
968 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/05/">May (
8)
</a></li>
970 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/06/">June (
2)
</a></li>
972 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/07/">July (
2)
</a></li>
974 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/08/">August (
5)
</a></li>
976 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/09/">September (
2)
</a></li>
978 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/10/">October (
3)
</a></li>
980 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/11/">November (
8)
</a></li>
982 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2016/12/">December (
5)
</a></li>
989 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/01/">January (
7)
</a></li>
991 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/02/">February (
6)
</a></li>
993 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/03/">March (
1)
</a></li>
995 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/04/">April (
4)
</a></li>
997 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/05/">May (
3)
</a></li>
999 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/06/">June (
4)
</a></li>
1001 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/07/">July (
6)
</a></li>
1003 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/08/">August (
2)
</a></li>
1005 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/09/">September (
2)
</a></li>
1007 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/10/">October (
9)
</a></li>
1009 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/11/">November (
6)
</a></li>
1011 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2015/12/">December (
3)
</a></li>
1018 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/01/">January (
2)
</a></li>
1020 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/02/">February (
3)
</a></li>
1022 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/03/">March (
8)
</a></li>
1024 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/04/">April (
7)
</a></li>
1026 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/05/">May (
1)
</a></li>
1028 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/06/">June (
2)
</a></li>
1030 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/07/">July (
2)
</a></li>
1032 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/08/">August (
2)
</a></li>
1034 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/09/">September (
5)
</a></li>
1036 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/10/">October (
6)
</a></li>
1038 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/11/">November (
3)
</a></li>
1040 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2014/12/">December (
5)
</a></li>
1047 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/01/">January (
11)
</a></li>
1049 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/02/">February (
9)
</a></li>
1051 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/03/">March (
9)
</a></li>
1053 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/04/">April (
6)
</a></li>
1055 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/05/">May (
9)
</a></li>
1057 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/06/">June (
10)
</a></li>
1059 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/07/">July (
7)
</a></li>
1061 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/08/">August (
3)
</a></li>
1063 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/09/">September (
5)
</a></li>
1065 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/10/">October (
7)
</a></li>
1067 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/11/">November (
9)
</a></li>
1069 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2013/12/">December (
3)
</a></li>
1076 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/01/">January (
7)
</a></li>
1078 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/02/">February (
10)
</a></li>
1080 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/03/">March (
17)
</a></li>
1082 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/04/">April (
12)
</a></li>
1084 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/05/">May (
12)
</a></li>
1086 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/06/">June (
20)
</a></li>
1088 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/07/">July (
17)
</a></li>
1090 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/08/">August (
6)
</a></li>
1092 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/09/">September (
9)
</a></li>
1094 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/10/">October (
17)
</a></li>
1096 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/11/">November (
10)
</a></li>
1098 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2012/12/">December (
7)
</a></li>
1105 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/01/">January (
16)
</a></li>
1107 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/02/">February (
6)
</a></li>
1109 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/03/">March (
6)
</a></li>
1111 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/04/">April (
7)
</a></li>
1113 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/05/">May (
3)
</a></li>
1115 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/06/">June (
2)
</a></li>
1117 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/07/">July (
7)
</a></li>
1119 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/08/">August (
6)
</a></li>
1121 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/09/">September (
4)
</a></li>
1123 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/10/">October (
2)
</a></li>
1125 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/11/">November (
3)
</a></li>
1127 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2011/12/">December (
1)
</a></li>
1134 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/01/">January (
2)
</a></li>
1136 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/02/">February (
1)
</a></li>
1138 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/03/">March (
3)
</a></li>
1140 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/04/">April (
3)
</a></li>
1142 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/05/">May (
9)
</a></li>
1144 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/06/">June (
14)
</a></li>
1146 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/07/">July (
12)
</a></li>
1148 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/08/">August (
13)
</a></li>
1150 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/09/">September (
7)
</a></li>
1152 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/10/">October (
9)
</a></li>
1154 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/11/">November (
13)
</a></li>
1156 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2010/12/">December (
12)
</a></li>
1163 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/01/">January (
8)
</a></li>
1165 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/02/">February (
8)
</a></li>
1167 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/03/">March (
12)
</a></li>
1169 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/04/">April (
10)
</a></li>
1171 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/05/">May (
9)
</a></li>
1173 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/06/">June (
3)
</a></li>
1175 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/07/">July (
4)
</a></li>
1177 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/08/">August (
3)
</a></li>
1179 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/09/">September (
1)
</a></li>
1181 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/10/">October (
2)
</a></li>
1183 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/11/">November (
3)
</a></li>
1185 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2009/12/">December (
3)
</a></li>
1192 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2008/11/">November (
5)
</a></li>
1194 <li><a href=
"http://people.skolelinux.org/pere/blog/archive/2008/12/">December (
7)
</a></li>
1205 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/3d-printer">3d-printer (
14)
</a></li>
1207 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/amiga">amiga (
1)
</a></li>
1209 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/aros">aros (
1)
</a></li>
1211 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/bankid">bankid (
4)
</a></li>
1213 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/bitcoin">bitcoin (
9)
</a></li>
1215 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/bootsystem">bootsystem (
16)
</a></li>
1217 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/bsa">bsa (
2)
</a></li>
1219 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/chrpath">chrpath (
2)
</a></li>
1221 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/debian">debian (
154)
</a></li>
1223 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/debian edu">debian edu (
158)
</a></li>
1225 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/debian-handbook">debian-handbook (
4)
</a></li>
1227 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/digistan">digistan (
10)
</a></li>
1229 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/dld">dld (
17)
</a></li>
1231 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/docbook">docbook (
24)
</a></li>
1233 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/drivstoffpriser">drivstoffpriser (
4)
</a></li>
1235 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/english">english (
360)
</a></li>
1237 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/fiksgatami">fiksgatami (
23)
</a></li>
1239 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/fildeling">fildeling (
12)
</a></li>
1241 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/freeculture">freeculture (
30)
</a></li>
1243 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/freedombox">freedombox (
9)
</a></li>
1245 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/frikanalen">frikanalen (
18)
</a></li>
1247 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/h264">h264 (
20)
</a></li>
1249 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/intervju">intervju (
42)
</a></li>
1251 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/isenkram">isenkram (
15)
</a></li>
1253 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/kart">kart (
20)
</a></li>
1255 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/ldap">ldap (
9)
</a></li>
1257 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/lego">lego (
4)
</a></li>
1259 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/lenker">lenker (
8)
</a></li>
1261 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/lsdvd">lsdvd (
2)
</a></li>
1263 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/ltsp">ltsp (
1)
</a></li>
1265 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/mesh network">mesh network (
8)
</a></li>
1267 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/multimedia">multimedia (
39)
</a></li>
1269 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/nice free software">nice free software (
9)
</a></li>
1271 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/norsk">norsk (
293)
</a></li>
1273 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/nuug">nuug (
189)
</a></li>
1275 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/offentlig innsyn">offentlig innsyn (
33)
</a></li>
1277 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/open311">open311 (
2)
</a></li>
1279 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/opphavsrett">opphavsrett (
67)
</a></li>
1281 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/personvern">personvern (
104)
</a></li>
1283 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/raid">raid (
2)
</a></li>
1285 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/reactos">reactos (
1)
</a></li>
1287 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/reprap">reprap (
11)
</a></li>
1289 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/rfid">rfid (
3)
</a></li>
1291 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/robot">robot (
10)
</a></li>
1293 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/rss">rss (
1)
</a></li>
1295 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/ruter">ruter (
5)
</a></li>
1297 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/scraperwiki">scraperwiki (
2)
</a></li>
1299 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/sikkerhet">sikkerhet (
53)
</a></li>
1301 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/sitesummary">sitesummary (
4)
</a></li>
1303 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/skepsis">skepsis (
5)
</a></li>
1305 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/standard">standard (
55)
</a></li>
1307 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/stavekontroll">stavekontroll (
6)
</a></li>
1309 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/stortinget">stortinget (
12)
</a></li>
1311 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/surveillance">surveillance (
52)
</a></li>
1313 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/sysadmin">sysadmin (
4)
</a></li>
1315 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/usenix">usenix (
2)
</a></li>
1317 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/valg">valg (
9)
</a></li>
1319 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/verkidetfri">verkidetfri (
5)
</a></li>
1321 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/video">video (
59)
</a></li>
1323 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/vitenskap">vitenskap (
4)
</a></li>
1325 <li><a href=
"http://people.skolelinux.org/pere/blog/tags/web">web (
40)
</a></li>
1331 <p style=
"text-align: right">
1332 Created by
<a href=
"http://steve.org.uk/Software/chronicle">Chronicle v4.6
</a>