An Efficient Log Management Framework

Abstract

Server monitoring is really necessary because this can help administrators to track users’ activities in order to improve user management ability, load balancing as well  as to detect DDoS attacks. Usually, server monitoring is based on logging. However, logging system is always considered to be expensive in term of storage, data collection, searching and data analysis. In this paper, we introduce eLMS, an efficient and scalablelog management system. In eLMS, the log files can be collected from multiple servers, stored in a scalable manner, appropriately indexed and fast analysed. eLMS acts both in online and off-line modes and provides a practical web-based monitoring interface. The performance of eLMS is also evaluated as a whole with some case-studies.

 

Corresponding author: Nguyen Van Nam, van.nam@vnu.edu.vn

Keywords: log files; big data; streaming; index and search