Archive for the ‘Uncategorized’ Category

GPS Phones and Telco Logging Infrastructure

Tuesday, December 15th, 2009

This is an extension of a post I made on a gun forum. Someone had asked the feasibility of the infrastructure required to store iPhone user’s GPS coordinates. They threw out the number of 30M iPhones.

It would really be the next logical step in police data collection. Take a warrant for arrest, pull phone records for $30, intercept the guy on his way home from his dealer’s house.
This wouldn’t be a burden placed upon the police, or even the NSA. It would be a money-maker for the telcos.
Lat/Lon can be packed as a 32-bit integer, unix timestamp is a 32-bit signed integer. Add in the telephone number and we’ll just call it 128 bits per reading.
Minutes in a day, 1440, so 1440×128 = 184,320 bits. 23,040 bytes per day.
As you can see, data warehousing for this is next to nothing. An 8GB disk could hold 372,827 days worth of GPS readings.
A day’s worth of GPS data for 30M users would be 675GB raw, before decompression and deduplication.
That would be a pretty tall order for a small business, but if you add in a few hundred legal spying data purchases every day, it would pay for itself pretty quickly.

You’d need a small cluster of servers and you would likely need good SAN hardware. They already store more information than this about the calls that you make. They already have the infrastructure in place.

So is it feasible? Yes, without a doubt.

Until next time!

-LightningCrash

batch rename with regexps, an addendum

Friday, November 20th, 2009

You may have read my post on batch rename with perl’s ‘rename’ script, but I recently discovered that it is helpful to read the man page.

I had a folder full of files that I wanted to rename, but I wanted to test things out first. I had settled for making a temporary directory and just symlinking to the files that I wanted to modify. I would run my tests, look at the link names, then delete and recreate the links.

Well, that is no more. `rename` has an option -n, for “No Act”, that will not actually rename the files. Instead, it will just print the filenames that matched and what they would have been renamed to.

Perfect!

Anyway, as the old saying goes, RTFM!
-LightningCrash

Where’s LC?

Thursday, November 12th, 2009

Between work, my wife and my kids, I have been a busy man!

I hope to get a few more articles up soon, including finishing the series on find-fu.

Peace!

-LightningCrash

Link for today: Bluetooth Proximity – Ubuntu HOWTO

Thursday, August 14th, 2008

Link to Howto

I’ve used this successfully and can attest to how handy it is. Kudos to Iceni for putting that Howto together.

BT dongles are getting cheap enough today that this is very doable. Most phones have BT already, so why not try it out?

Linksys also makes a USB Bluetooth adapter with a movable antenna. I’ve not heard anything about that particular adapter, but I would wager that its range is greater than that of normal Bluetooth dongles.

That’s it for today!

-LightningCrash

Just for SB @ Microsoft

Tuesday, October 9th, 2007

steveballmershands.jpg

11-02ballmer_lg.jpg

 

You gotta love Fair Use. :)

Amazon S3 Backups

Monday, October 1st, 2007

I really like the affordability of Amazon’s S3 service. I don’t need to back up a lot of data, but I do need it available anywhere I have an internet connection. I also need it to be automated. S3 lets me have those features.

I back up my personal e-mail server, my home desktop, and my MythTV box to Amazon’s S3 service. I run weekly full backups of select directories on my desktop, and then incrementals throughout the week. My MythTV box backs up its database on its own, so I just tarball the output and dump it to a folder on my desktop machine, which gets put on S3 when the backup job runs. My mail server runs full backups of select directories every night.

I used some bits and pieces from Paul Stamatiou’s article on S3 backups. You can read that article here.

I added in some bits and pieces for using an include/exclude file, and modified it to run incrementals on my desktop. I also got to use mktemp to do some of my bidding, which was very handy.

All told, my Amazon S3 bill for last month was $1.48 for ~8GB of transfer in, and ~3.7 storage GB/mo. I pair down my stored files weekly to meet some retention guidelines, so that contributed some to my low bill.

But all in all, I’m VERY impressed with S3. I definitely got my $1.48 worth! :)

All quiet on the home front

Monday, October 1st, 2007

I’ve been a bit busy and all with certifications training, so I haven’t had time to publish much.

However, I did find a nicely written article a few days ago that I wanted to share. Without further ado, go read “BSD For Linux Users.”

I’m working on some rather large articles for your perusal, so it won’t be long before there is some activity here.

Until next time!

-LightningCrash

Star Wars ASCII as a screensaver?

Tuesday, September 25th, 2007

If you haven’t heard of it, you can watch Star Wars in ASCII by telnetting to towel.blinkenlights.nl

telnet towel.blinkenlights.nl

I wish someone would write a program to pipe the output of that to Xscreensaver. Now that would be awesome.

MBEQWA maintainer non-responsive

Tuesday, September 25th, 2007

So I haven’t heard back from atiware, the SF maintainers of MBEQWA. I guess it’s time to do my own thing. I’ll post with more updates later. I’ll have to create a SF page and etc. I probably won’t use any of their source at all, but try to keep the usability features that I like from MBEQWA present in a similar fashion.

Horrible site design of the day award

Friday, September 21st, 2007

I was interested in reading an article on Slashdot about the world’s biggest SANs. That is, until I got to the site it was hosted on. Holy crap, guys, what the hell is that? I hate it when sites interrupt their contiguous textspace with crap like ads and related material. Stash that stuff outside of the text body, guys. Just look at it, in all its ugly glory:

Byteswitch SAN article

I’m not saying I’m a design guru (you can tell that just by looking around here), but I won’t read articles on crappy layouts like this. Most of the width of the page is taken up by garbage.

Guess I won’t be reading their poop!

Until next time!

-LightningCrash