Pattern Matching Against Distributed Datasets

Aero-engine vibration and performance data is downloaded each time an aircraft lands. On a fleet wide basis this process soon generates terabyte scale datasets. Given the large volume of data and the rate at which it is produced, there is a need to consider how the data is managed. In addition, there is a requirement for pattern matching against this engine data. The DAME project has investigated the use of Grid technology to support a fully distributed storage and pattern matching architecture. This paper describes how this technology can be used to solve the data management problem.