Multimodal Learning is a machine learning approach that jointly models information from multiple data types such as text, images, audio, video, and sensor signals. It learns shared or aligned representations to support tasks like classification, retrieval, captioning, and question answering. Multimodal learning is used when combining complementary signals improves robustness, context understanding, and generalization across different input sources.

Posts

Online Multi-modal Root Cause Identification in Microservice Systems

/0 Comments/in /by

Root Cause Analysis (RCA) is essential for pinpointing the root causes of failures in microservice systems. Traditional data-driven RCA methods are typically limited to offline applications due to high computational demands, and existing online RCA methods handle only single-modal data, overlooking complex interactions in multi-modal systems. In this paper, we introduce OCEAN, a novel online multi-modal causal structure learning method for root cause localization. OCEAN introduces a long-term temporal causal learning module with two encoders: one captures stable causal dependencies from historical data, while the other models short-term variations in the current batch data. We further design a multi-factor attention mechanism to analyze and reassess the relationships among different metrics and log indicators/attributes for enhanced online causal graph learning. Additionally, a contrastive mutual information maximization-based graph fusion module is developed to effectively model the relationships across various modalities. Extensive experiments on three real-world datasets demonstrate the effectiveness and efficiency of our proposed method.

Read more