This experiment was developed to discover queries that have a bursty or spiky behavior. A bursty query is one that has a sudden and unusual change in volume with respect to its expected volume during a short timeframe. The experiment developed is based on Jon Kleinberg’s algorithm to detect temporal bursts in streams [KDD 2003].
The main idea is to model the query activity level as a (high & low) two-state Markov chain and find the best state sequence that favors both a small number of state transitions and states that conform with observed data. The experiment takes into account daily and weekly periodicity of queries and gives the time interval of the burst, if any, for a query.
It has a data visualization component with reverse IP lookup on the addresses in the data, plotting the patterns of activities such as a particle system. In a time-lapse animation, particles show queries from each location worldwide. Visualized are searches for "miss teen usa", "cricket" (world playoffs) "mattel" (recalls of toys with lead paint), and a close up on the Gulf of Mexico for "hurricane felix."
Bursty Queries was created by the Search Technologies group.
Hello, http://sandbox.yahoo.com/Bursty_Queries Great concept falls in line with something I am conceptualizing along with some partners. I can't hear the video. Steve BrooksComment by Steve Brooks (February 23, 2009, 11:42 pm)
Hello, I feel this is a novel approach to use humans to find the most important topics based on the search queries. From a pure probabilistic point of you, the success rate will be very high. The same can be extended for by using local queries versus global queries and adding a higher weight to local queries. This will be very useful especially when used from mobile. If I am on the move, I can get to know what is happening around without having to go around talking to folks or waiting for an updated newspaper. I think you need to bring in location services into mainstream for this to fly. You can in fact replace the local FM or local newspaper... -dhruvaComment by Dhruva Krishnamurthy (July 9, 2009, 4:40 am)