A Real-Time System is a computing system that processes and responds to events or stimuli within a specified time frame, often referred to as a deadline. Real-time systems have the ability to deliver predictable and deterministic responses to inputs, ensuring that tasks are completed within predefined time constraints. Real-time systems are utilized in various domains where timing and responsiveness are critical, including industrial automation, telecommunications, medical devices, aerospace, automotive systems, and multimedia applications.


LogLens: A Real-time Log Analysis System

Administrators of most user-facing systems depend on periodic log data to get an idea of the health and status of production applications. Logs report information, which is crucial to diagnose the root cause of complex problems. In this paper, we present a real-time log analysis system called LogLens that automates the process of anomaly detection from logs with no (or minimal) target system knowledge and user specification. In LogLens, we employ unsupervised machine learning based techniques to discover patterns in application logs, and then leverage these patterns along with the real-time log parsing for designing advanced log analytics applications. Compared to the existing systems which are primarily limited to log indexing and search capabilities, LogLens presents an extensible system for supporting both stateless and stateful log analysis applications. Currently, LogLens is running at the core of a commercial log analysis solution handling millions of logs generated from the large-scale industrial environments and reported up to 12096x man-hours reduction in troubleshooting operational problems compared to the manual approach.