This was what came to immediate mind after reading about ADS-B becoming mandatory in the US a few years back. This started a small few-month long obsession to understand it all, and became one of my more fun hobbies in the past few years. It already is mandatory in Europe. I didn't think of the vacationing correlation to stock prices, but simply tracking corporate movements and inferring future stock price movement from those movements. "Wall Street" of course coming to immediate mind here.
For those not aware, ADS-B is essentially a transmitter in aircraft that periodically report registration number, altitude, GPS coordinates, and airspeed. This is to supplement the current air traffic control system, and eventually take it over. This data is in real time, and not delayed or censored like the FAA supplied data feeds are.
It is not encrypted, so anyone with an antenna and the proper equipment can get the location information of every equipped aircraft within usually a 50-250mi radius, depending on antenna height, receiver quality, topology, etc. While many US domestic aircraft are not so equipped, this is rapidly changing as I believe all must be by 2022. Any aircraft that ever enters European airspace must be equipped, so that means for practical purposes any International flight can be tracked. This includes most corporate jets which are used to fly anywhere but within the United States.
It's trivial to decode in software, and I run a couple installations with hacked up USB DBS TV dongles. They are not the highest quality (a few enterprising folks sell custom ASIC/boards for doing this better), but are cheap and easy to make work.
It's a fun project to hack on for a weekend, I learned a bit about software defined radio among other things. Even fixed a bug in some code that accidentally calculated the aircraft's location to the wrong hemisphere :) Turns out GPS math is somewhat interesting, in the way they encode the data for the little bandwidth available.
This is also the data that powers flightradar24, and probably some other sites out there. Basically a network of enthusiasts that run antenna installations reporting their data to a central server for visualization.
I brought a small antenna and box on vacation with me to Jamaica a couple years back, and was able to track aircraft a good 300nm+ off the coast from the beach. It was fun watching the tracks route around storms and such.
I always thought a fun phone app would be a Google Sky clone for aeroplanes. i.e. instead of pointing your phone at a planet, point it at a plane and get the ADS-B details on it appear.
It's not mandatory in Europe until 2017 - for instance you won't see any FlyBE ADS-B tracking data on sites like flightradar24 because their fleet consists mostly of Embraer's and Dash 8-Q400 and very few of those aircraft have ADS-B transponders (at least at the moment).
FYI There is only one vendor I know of, fltplan.com, which would let you file under an obfuscated 'dotcom456' callsign. I believe they are the only provider of this service? (maybe airinc?). Obviously there are still other fields available in the ADS-B that would help identify movements, but this is what i've recommended as its also used over the radios, combating the transcribing algorithms using liveatc feeds.
Notably, right now ADS-B coverage is not very thorough, especially in the US. Most aircraft are not equipped with ADS-B transmitters. The restricted feeds like the one the FAA supplies are still essential to getting thorough coverage in some areas.
According to the FAA they have a way to determine what is fake and not. Not sure how they do it but it could involve comparing the signal to an actual radar return.
How do enthusiasts track the planes over the ocean? I saw a plane on flightradar24 that looked like it was 360mi+ away from the coast. (It was yellow, meaning ADS-B data.)
My guess is that planes reach their cruise heading, altitude and speed by the time they get out of range of ADS-B receivers. Since they follow predefined air corridors, location can be easily inferred from last known information. Obviously it won't be accurate if the plane has changed course to avoid bad weather (see: https://en.wikipedia.org/wiki/Air_France_Flight_447).
That sounds like great fun, I'd be really interested in a write-up of your project if you have the time. Particularly hacking the TV dongles, and working out the interesting GPS math!
rtlsdr[1] is the name of the project that lets you use your $10 USB TV tuner as a software defined radio receiver (bless those osmocom people). rtl-sdr.com[2] has some more information.
dump1090[3] is the particular project for decoding ADS-B broadcasts.
With £15 of equipment (USB Tuner and some TV coax hacked into an antenna) I'm looking at aircraft 200+nm away [4] (though today's weather doesn't help).
You can use a similar technique for identifying international arms dealers, sanction busters, CIA rendition flights, etc. Alex Harrowell occasionally blogs about this:
One of the best pieces of advice I heard from our resident stats/machine learning researcher at Uni was this: If a paper is published which claims to show a technique for profiting on the share market, then it doesn't work. If it did, they wouldn't have published it.
Having said that, there is plenty of interesting papers in this area, and from the abstract, this paper seems to take an interesting approach too.
Hmmmmmm if I apply that to that researcher's own words, then he is lying to confuse you! It's a Goedelian paradox!
Actually, I think the bigger point is that researcher's rarely "tell all." Just like Moriarty in the final episode of Season 2 of Sherlock (on BBC 2013-2014), sometimes a work is created as an advertisement demonstrating the ability to draw larger returns. Those intimate with the data will always have more than than will or can possibly publish.
Some of it is about the agenda of the person writing it.
The Fama-French 3 factor model still holds. (http://en.wikipedia.org/wiki/Fama%E2%80%93French_three-facto...) Part of this is because Gene Fama doesn't have a hedge fund on the side. He advises DFA, but they want their customers to understand the model. (He also won this year's Economics Nobel)
A similar technique was used to "predict" Sarah Palin's choice as running mate in 2008.
> In 2008, as John McCain prepared to announce his running mate, Fitzpatrick and his fellow trader Joe Schilling were monitoring the movements of all the contenders, calling their press secretaries and checking a flight-tracking website. They noticed a Gulfstream jet from Anchorage, Alaska, bound for the site of a McCain rally, and bought Sarah Palin, a longshot. When the surprise pick was unveiled, Fitzpatrick took home $25,000.
When Boeing merged with McDonnell Douglas, the execs would both meet in a third, neutral city but would fly into other airports within a few hours' drive of the meeting location specifically so that anyone tracking their planes wouldn't know they were flying to the same location.
In mid 2012 the company I was working for went through a lengthy acquisition process. I started monitoring our corporate calendar and meeting rooms in Exchange. One day I figured out our CTO was leaving the company: our head of HR, the CTO and all his managers were to be unavailable in a couple hours, for the same 30 minutes and, at the same time, one of the meeting rooms was booked.
It was announced the next day. Right after the meeting, one of his managers had several new bookings extending through most of his day. We accurately predicted (with some surprise) the successor.
Meta-use of a shared company calendar is worthy of a whole separate article, IMO.
From personal experience - even if you can't see where your management is meeting or who they are meeting with, just knowing they will be out of the office can be valuable. Especially when you are job-hunting.
I'll be happy to provide it as a service. You just share your calendar with my system, and it will automatically tell you when your boss is away and where you can get free food.
I will totally not use this data to trade stocks ;).
Depending on how the calendering system reports busy-ness, there's a nice timing attack on figuring out who people are meeting with. If the calendar shows busy when an invitation has been sent, instead of when someone accepts the invitation, and you take snapshots frequently enough, you can probably group people into meetings based on when the meeting showed up on peers' calendars.
My first thought was: there obviously needs to be a reference to the 1987 movie "Wall Street" in there somewhere.
"Due to their large size, aircraft can also be observed physically taking off and landing at airports by scouts stationed as “tailspotters,” a role played memorably by actor Charlie Sheen in the 1987 feature film Wall Street."
you're close :) Use a charter aircraft that flys many different clients is one way to limit this, or offer their own aircraft available for charter when its not in use by the company. All corporate flight departments already do charter other aircraft for supplemental lift or when an aircraft is down for maintenance.
For those not aware, ADS-B is essentially a transmitter in aircraft that periodically report registration number, altitude, GPS coordinates, and airspeed. This is to supplement the current air traffic control system, and eventually take it over. This data is in real time, and not delayed or censored like the FAA supplied data feeds are.
It is not encrypted, so anyone with an antenna and the proper equipment can get the location information of every equipped aircraft within usually a 50-250mi radius, depending on antenna height, receiver quality, topology, etc. While many US domestic aircraft are not so equipped, this is rapidly changing as I believe all must be by 2022. Any aircraft that ever enters European airspace must be equipped, so that means for practical purposes any International flight can be tracked. This includes most corporate jets which are used to fly anywhere but within the United States.
It's trivial to decode in software, and I run a couple installations with hacked up USB DBS TV dongles. They are not the highest quality (a few enterprising folks sell custom ASIC/boards for doing this better), but are cheap and easy to make work.
It's a fun project to hack on for a weekend, I learned a bit about software defined radio among other things. Even fixed a bug in some code that accidentally calculated the aircraft's location to the wrong hemisphere :) Turns out GPS math is somewhat interesting, in the way they encode the data for the little bandwidth available.
This is also the data that powers flightradar24, and probably some other sites out there. Basically a network of enthusiasts that run antenna installations reporting their data to a central server for visualization.
I brought a small antenna and box on vacation with me to Jamaica a couple years back, and was able to track aircraft a good 300nm+ off the coast from the beach. It was fun watching the tracks route around storms and such.