Graph Neural Networks, Explained: Our Role in the Future of AI

April 9, 2025|byNEC Labs America|inNews|tagsai, data science system security, dsss blog, gnn, graph neural network, haifeng chen, wei cheng, zhengzhang chen

Introduction

Graph Neural Networks (GNNs) have revolutionized the field of machine learning by enabling the processing of data structured as graphs. Unlike traditional neural networks that operate on grid-like data, GNNs are adept at capturing the complex relationships and interdependencies inherent in graph structures.

Graph Neural Networks Explained Our Role in the Future of AI

This capability makes them invaluable across various domains, including social network analysis, bioinformatics, and recommendation systems.

Understanding Graph Neural Networks

At their core, GNNs function by propagating information along the edges of a graph, allowing nodes to aggregate features from their neighbors. This message-passing mechanism enables GNNs to learn representations encapsulating local neighborhood structures and global graph properties. Typically, this involves multiple layers where each layer aggregates information from a node’s immediate neighbors, progressively expanding the receptive field and capturing higher-order dependencies.

Graph Neural Networks (GNNs) are a type of neural network architecture designed for learning patterns and making predictions on graph-structured data. In contrast to traditional neural networks that operate on grid-structured data like images or sequences, GNNs are well-suited for data represented as graphs, where entities (nodes) are connected by relationships (edges).

The Significance of GNNs

GNNs are essential because they can model complex systems where entities are interconnected. Traditional machine learning models often struggle with such data due to their inability to naturally handle non-Euclidean structures. GNNs, however, excel in these scenarios by leveraging the graph topology to inform the learning process. This makes them particularly effective for node classification, link prediction, and graph classification.

NEC Laboratories America’s Contributions to GNN Research

NEC Laboratories America (NECLA) has been advancing GNN methodologies, addressing challenges related to robustness, explainability, and application to dynamic graphs. Our research has led to significant innovations that enhance the performance and applicability of GNNs.

Enhancing Robustness in GNNs

One critical challenge in deploying GNNs is their sensitivity to noisy or adversarial inputs. Our researchers have developed methods to improve GNNs’ resilience against such perturbations. For instance, in the study “Learning to Drop: Robust Graph Neural Network via Topological Denoising,” the authors introduce a parameterized topological denoising network (PTDNet).

PTDNet enhances GNN robustness by learning to identify and drop task-irrelevant edges, thereby mitigating the impact of noise in the graph structure. The approach employs nuclear norm regularization to enforce a low-rank constraint on the sparsified graph, promoting better generalization. This method has demonstrated significant performance improvements, especially in noisy datasets.

Wei Cheng, a senior researcher at NECLA, emphasizes the importance of this work: “By focusing on the most relevant connections within a graph, we’ve been able to significantly enhance the robustness of GNNs against noisy data, which is a common challenge in real-world applications.”

Advancing Explainability of GNNs

Understanding their decision-making processes becomes paramount as GNNs are increasingly applied in sensitive domains. NECLA has contributed to this aspect by proposing robust fidelity measures for evaluating the explainability of GNNs. In the paper “Towards Robust Fidelity for Evaluating Explainability of Graph Neural Networks,” the authors introduce an information-theoretic framework to assess explanation functions. They highlight limitations in existing fidelity metrics and propose alternatives resilient to distribution shifts, ensuring more reliable evaluations of GNN explanations. This work provides a foundation for developing GNN models that are accurate and interpretable.

Haifeng Chen, the Department Head of Data Science & System Security at NECLA, notes: “Our goal is to make GNNs not just powerful, but also transparent and trustworthy, especially when they’re used in critical decision-making processes.”

Anomaly Detection in Dynamic Graphs

Dynamic graphs, where the structure evolves, present unique challenges for anomaly detection. NECLA’s research in this area has led to the development of Structural Temporal Graph Neural Networks (StrGNN). Detailed in the publication “Structural Temporal Graph Neural Networks for Anomaly Detection in Dynamic Graphs“

StrGNN is designed to detect anomalous edges by capturing structural and temporal information. The model extracts h-hop enclosing subgraphs centered on target edges and utilizes graph convolution operations alongside gated recurrent units to process temporal features. Deployed in real enterprise security systems, StrGNN has proven effective in identifying advanced threats and optimizing incident response.

Zhengzhang Chen, a senior researcher in the project, explains: “By integrating structural and temporal data, StrGNN can effectively pinpoint anomalies in dynamic systems, which is crucial for proactive threat detection.”

Calibration of GNNs with Out-of-Distribution Nodes

Ensuring that GNNs maintain reliable performance when encountering out-of-distribution (OOD) nodes is crucial for their deployment in real-world scenarios. NECLA addressed this issue in the study “Calibrate Graph Neural Networks under Out-of-Distribution Nodes via Deep Q-learning.” The researchers propose a Graph Edge Re-weighting via Deep Q-learning (GERDQ) framework that adjusts edge weights to mitigate the adverse effects of OOD nodes. By formulating the edge re-weighting process as a Markov Decision Process and employing deep Q-learning, the framework enhances the calibration of GNNs, leading to improved reliability in diverse applications.

Applications and Future Directions

The advancements in GNN research at NECLA have broad implications across various fields. In bioinformatics, for example, GNNs have been utilized to model protein interactions, aiding in understanding complex biological processes.

Read Our News Posts

AI/Fiber-Optic Combo Poised To Improve Telecommunications

September 7, 2023

Existing underground fiber-optic telecommunications cable networks that can be accessed through street manholes are helping a team at NEC Labs America improve wireless communications systems and the Internet of Things (IoT). "Hundreds of millions of fiber-optic cables are already there for communications purposes,” says Shaobo Han, a researcher at NEC Labs America who focuses on the design and development of machine learning and signal-processing techniques for real-world sensing applications. “We’re turning it all into a ‘thinking’ device, using the same cable that’s already there.”

Industrial Labs to Drive Disruptive Innovation for the Fourth Industrial Revolution

September 6, 2023

While the previous generation of industrial progress brought us new capabilities, efficiencies, and even delight through digital transformation, we’re entering a new era of innovation, opportunity, and disruption: the Fourth Industrial Revolution. What is the Fourth Industrial Revolution?

A New Hope: AI Research is Conquering Today’s Computer Vision Plateau

March 27, 2023

The age of computer vision is upon us, and it’s transforming the way we live, work and interact with the world. Nearly every industry has found a use case to grow revenue, reduce cost, or create exceptional experiences using computer vision. From self-driving cars to retail automation, surgeons to farmers, computer vision is everywhere, providing critical insights that are driving progress in virtually every aspect of our daily lives. Today, images and videos are annotated to train artificial intelligence (AI) models to recognize specific objects, but there is still so much more to be done when it comes to understanding what those objects are doing in real-time.

Our Time Series Data Research Drives Space Systems Innovation

NEC Labs America’s Time Series Data Research Drives Space Systems Innovation

November 17, 2022

With decreasing hardware costs and increasing demand for autonomic management, many of today’s physical systems are equipped with an extensive network of sensors, generating a considerable amount of time series data daily. A highly valuable source of information, time series data is used by businesses and governments to measure and analyze change over time in complex systems. Organizations must consolidate, integrate and organize a vast amount of time series data from multiple sources to generate insights and business value.

Next-Generation Computing Finally Sees Light

November 17, 2022

Moore's law is dead, as we have squeezed all the innovation out of silicon. Fiber optics is the solution to meet the computing needs of tomorrow. Today, we can already use the light traveling inside fiber optic cables as sensors that measure vibrations, sound, temperature, light, and pressure changes. We're now developing the means to take this to the next level with photonic computing at the speed of light to provide faster reaction time, reduce energy consumption and improve battery range

Using AI To Safely Put The First Woman On The Moon

October 7, 2022

We are helping to safely bring the first woman astronaut to the moon as part of NASA - National Aeronautics and Space Administration's Artemis Project with our System Invariant Analysis Technology (SIAT). With Lockheed Martin Space's T-Tauri AI platform, our SIAT analytics engine takes the data from the 150,000 sensors and creates a model incorporating over 22 billion data relationships. The AI model is then analyzed to find any irregularities which could lead to a possible malfunction of any of the spacecraft's systems.