Meet the NEC Labs America Intern Helping to Make Autonomous Vehicles Safer and More Secure

September 8, 2023 | NEC Labs America | News | Tags: interns, internships, autonomous-vehicles

There’s much more to autonomous vehicle security than locking a car door.

This summer, Kaiyuan Zhang, a 3rd-year computer science Ph.D. student at Purdue University, joined NEC Labs America’s popular intern program to help advance research around autonomous vehicle security.

Each year, nearly 50 Ph.D. candidates join NEC Labs America’s innovative program, which centers on a collaborative environment where interns work directly with senior researchers and potential end-user customers. They focus on advancing cutting-edge technologies at the intersection of machine learning and science that will improve how the world can become more responsive to the needs of individuals. This 12-week program is run out of NEC Labs America’s research facilities in Princeton, NJ, and San Jose, California.

Kaiyuan Zhang NEC Labs America Intern

In addition to an immediate supervisor, each intern is assigned to a specific mentor. Kaiyuan’s mentor this summer is Francesco Pittaluga, a researcher in the Media Analytics Department at NEC Labs America focused on Computer Vision, Machine Learning, and Computational Photography Biography.

According to Pittaluga, “The intern program is not only an excellent opportunity for Ph.D. students to gain experience working in an industrial research lab, but it is also a huge asset for NEC Labs. Interns like Kaiyuan help introduce new insights and ways of thinking to our group. His background in security has been critical for developing an adversarial robustness framework for training and evaluating autonomous driving systems.”

Interns like Kaiyuan quickly become part of a project team applying innovative technology to industry-leading concepts.

“My research interests mainly focus on security and privacy in machine learning,” said Kaiyuan. “With this expertise, I’m able to provide unique perspectives in our collaborative work with other researchers on NEC Labs America’s Media and Analytics team working on improving the robustness of the autonomous driving system.”

This work extends well beyond the physical security of autonomous vehicles. As with most emerging technologies, securing the data generated, processed, and used by autonomous cars is complex. Kaiyuan is helping to develop safety-critical driving scenarios that improve the robustness and safety of autonomous driving systems.

Take, for example, the multitude of information captured by the cameras and sensors equipped on autonomous vehicles. They record a vast array of data from the surrounding environment, everything from other vehicles and traffic signals to hazard cones and pedestrians, even down to lane markings. Kaiyuan is actively involved in automatically generating safety-critical driving scenarios, which is crucial in enhancing the real-world safety of autonomous driving.

Autonomous Vehicle

According to Kaiyuan, there have already been instances of security breaches by malicious entities that manipulate how a car is programmed to respond in specific situations. This includes programming a vehicle to exhibit unreasonable behavior upon detecting orange hazard cones. In another case, adversaries have strategically placed adversarial patterns on stop signs, compelling the vehicle to take an action contrary to stopping. These scenarios carry not just potential danger but could also escalate to lethal circumstances. Research conducted by Kaiyuan and his team is meticulously targeted toward enhancing the robustness of the autonomous driving system against such security threats.

Kaiyuan also hopes to return to the NEC Labs Intern program next summer to continue collaborating on cutting-edge technologies.

Please click here to learn about our NEC Labs America Intern Program.

Read Our News Posts

Industrial Labs to Drive Disruptive Innovation for the Fourth Industrial Revolution Blog Post

Industrial Labs to Drive Disruptive Innovation for the Fourth Industrial Revolution

While the previous generation of industrial progress brought us new capabilities, efficiencies, and even delight through digital transformation, we’re entering a new era of innovation, opportunity, and disruption: the Fourth Industrial Revolution. What is the Fourth Industrial Revolution?
Read more
Haven for Hope

A New Hope: AI Research is Conquering Today’s Computer Vision Plateau

The age of computer vision is upon us, and it’s transforming the way we live, work and interact with the world. Nearly every industry has found a use case to grow revenue, reduce cost, or create exceptional experiences using computer vision. From self-driving cars to retail automation, surgeons to farmers, computer vision is everywhere, providing critical insights that are driving progress in virtually every aspect of our daily lives. Today, images and videos are annotated to train artificial intelligence (AI) models to recognize specific objects, but there is still so much more to be done when it comes to understanding what those objects are doing in real-time.
Read more
Our Time Series Data Research Drives Space Systems Innovation

NEC Labs America’s Time Series Data Research Drives Space Systems Innovation

With decreasing hardware costs and increasing demand for autonomic management, many of today’s physical systems are equipped with an extensive network of sensors, generating a considerable amount of time series data daily. A highly valuable source of information, time series data is used by businesses and governments to measure and analyze change over time in complex systems. Organizations must consolidate, integrate and organize a vast amount of time series data from multiple sources to generate insights and business value.
Read more
Next-Generation Computing Finally Sees Light Blog Post

Next-Generation Computing Finally Sees Light

Moore's law is dead, as we have squeezed all the innovation out of silicon. Fiber optics is the solution to meet the computing needs of tomorrow. Today, we can already use the light traveling inside fiber optic cables as sensors that measure vibrations, sound, temperature, light, and pressure changes. We're now developing the means to take this to the next level with photonic computing at the speed of light to provide faster reaction time, reduce energy consumption and improve battery range
Read more
Using AI To Safely Put The First Woman On The Moon

Using AI To Safely Put The First Woman On The Moon

We are helping to safely bring the first woman astronaut to the moon as part of NASA - National Aeronautics and Space Administration's Artemis Project with our System Invariant Analysis Technology (SIAT). With Lockheed Martin Space's T-Tauri AI platform, our SIAT analytics engine takes the data from the 150,000 sensors and creates a model incorporating over 22 billion data relationships. The AI model is then analyzed to find any irregularities which could lead to a possible malfunction of any of the spacecraft's systems.
Read more

Our AI Research Contributing to NASA’s Artemis Space Program

By 2024, the spacecraft "Orion" developed by Lockheed Martin will bring humans to the moon in NASA's Artemis program. The system invariant analysis technology, one of NEC's Artificial Intelligence technologies, will perform checks to ensure that the spacecraft is tested and operating properly during the production phase.
Read more