Developing high-level algorithm and software for analyzing information systems' event logs

The logs generated by the operating systems, and application programs, network devices, web browsers and all devices found in information systems during their normal course of operation are very important and allow system administrators to ensure that they have a reliable information system. With log events, you can track what is going on your system, such as what web sites your clients accessed, whom they are sending e-mails to and receiving e-mails from and what applications are used. Log messages are accumulating each day in our systems. In that situation, it is very difficult to utilize the logs for checking our system health and get the meaningful information from them. Therefore, log files should been checked and analyzed frequently. However, the data in the log files is huge and typically contains billions to trillions of records. To analyze and categorize such large sets of data manually, for anomaly detection or reporting purposes, is tedious and nearly impossible. Therefore, to understand the health of our information system, automated analysis is important and practical task.