Wednesday, September 28, 2011

The Stock Market Also Has a Big Spam Problem

Spam - we deal with it every day, whether in our email or, in this blog's case, in our comments. What I only recently learned, however, is that the stock market also has a big (and increasing) spam problem.

You see, the new hot thing on the stock market is high frequency trading (HFT) - stock trading done entirely by computers at superhuman speeds that tries to make money by exploiting minute fluctuations in stock prices. By 2010, HFT accounted for more than 70% of US equity trades, and it's getting more popular in Europe and Asia.

Via the Big Picture, we learn that Nanex crunched a bunch of stock trading data and found that, like email spam, HFT has a hidden cost:
The chart below shows how many quotes it takes to get $10,000 worth of stock traded in the U.S. for any point in time during the trading day over the last 4.5 years. Higher numbers indicate a less efficient market: it takes more information to transact the same dollar volume of trading. 

Quote traffic, like spam, is virtually free for the sender, but not free to the recipient. The cost of storing, transmitting and analyzing data, increases much faster than the rate of growth: that is, doubling the amount of data will result in much more than a doubling of the cost. For example, a gigabit network card costs $100, while a 10 gigabit network card costs over $2,000. A gigabit switch, $200; a 10 gigabit switch, $10,000. This October, anyone processing CQS (stock quotes) will have to upgrade all their equipment from gigabit to 10 gigabit. Which would be fine if this was due to an increase in meaningful data.

We think that a 10-fold increase in costs without any benefits would be considered "detrimental" by most business people.

This explosion of quote traffic relative to its economic value is accelerating. Data for September 14, 2011 is the thicker red line that snakes near the high. There is simply no justification for the type of quote data that underlies this growth. Only the computers spamming these bogus quotes benefit when they successfully trick other computers or humans into revealing information, or executing trades. This is not progress. Progress is almost always accompanied by an increase in efficiencies. This is completely backwards.

5-minute Average of the Number of Quotes per $10,000 in Trade Transactions.
Time scale shows hour and minute of the trading day (9:30 to 16:00 Eastern). Each trading day between January 1, 2007 and September 14, 2011 is color coded by date: older dates are colored towards the violet end of the spectrum, while more recent dates are colored towards the red end of the spectrum. The most recent day is plotted as double thick red line. We had to process 535 billion quotes and 35 billion trades over 1,172 trading days to generate this chart.

Oof - that's some expensive spam. Does anyone out there who does this for a living care to comment on this development?


  1. Your article has piqued a lot of positive interest. I can see why since you have done such a good job of making it interesting.jogos friv online
    Jogos live
    jogos friv 4 school