NEC Labs America Team Attending CVPR 2024 in Seattle

June 11, 2024||inEvents|tagsCVF, IEEE, bingbing zhuang, computer vision, cvpr, deep patel, di liu, erik kruus, james m moore, junhui zhao, martin renqiang min, media analytics, sarper ozharar, shanlin sun, shaobo han, ting wang, yangmin ding, yue tian, zhuocheng jiang

Our team will be attending CVPR 2024 (The IEEE /CVF Conference on Computer Vision & Pattern Recognition) from June 17-21! See you there at the NEC Labs America Booth 1716! Stay tuned for more information about our participation.

CVPR2024

Weakly-Supervised Temporal Action Localization with Multi-Modal Plateau Transformers Poster

Workshop: 3rd Workshop on Learning with Limited Labelled Data for Image and Video Understanding

Authors: Xin Hu, Tulane University; Kai Li, NEC Labs America; Deep Patel, NEC Labs America (Presenting); Erik Kruus, NEC Labs America; Martin Renqiang Min, NEC Labs America and Zhengming Ding, Tulane University

Poster timing: Tuesday, June 18, 2024

Deep Patel NEC Labs America

Deep Patel, NEC Labs America (Presenting)

Seeing the Vibration from Fiber-Optic Cable: Rain Intensity Monitoring using Deep Frequency Filtering Poster

Workshop: 20th Workshop on Perception Beyond the Visible Spectrum

Authors: Zhuocheng Jiang (Presenter), Yangmin Ding, Junhui Zhao, Yue Tian, Shaobo Han, Sarper Ozharar, Ting Wang and James M. Moore

Poster timing: Tuesday, June 18, 2024

Zhuocheng Jiang NEC Labs America

Zhuocheng Jiang, NEC Labs America (Presenter)

Data-Driven Autonomous Driving Simulation (DDASD) Workshop

Abstract: Real-world on-road testing of autonomous vehicles can be expensive or dangerous, making simulation a crucial tool to accelerate the development of safe autonomous driving (AD), a technology with enormous real-world impact. However, to minimise the sim-to-real gap, good agent behaviour models and sensor/perception imitation are paramount. A recent surge in published papers in this fast-growing field has led to a lot of progress, but several fundamental questions remain unanswered, for example regarding the fidelity and diversity of generative behaviour and perception models, generation of realistic controllable scenes at scale and the safety assessment of the simulation toolchain. In this workshop, our goal is to bring together practitioners and researchers from all areas of AD simulation and to discuss pressing challenges, recent breakthroughs and future directions.

Presenters: Our Intern Shanlin Sun will have an oral presentation at the workshop.

More Information:https://agents4ad.github.io/

Date: Tuesday, June 18, 2024

Shanlin Sun

Shanlin Sun (Presenter)

S’More: Instantaneous Perception of Moving Objects in 3D

Presenters: Bingbing Zhuang, Intern Di Liu

Date: Friday, June 21, 2024 from 10:30am-12pm

Bingbing Zhuang NEC Labs

Bingbing Zhuang, NEC Labs America (Presenter)

S'More Instantaneous Perception of Moving Objects in 3D

LidaRF: Delving into Lidar for Neural Radiance Field on Street Scenes

Presenters: Bingbing Zhuang, Ziyu Jiang, Intern Shanlin Sun

Date: Friday, June 21 from 10:30am-12pm

Bingbing Zhuang NEC Labs

Bingbing Zhuang, NEC Labs America (Presenter)

Ziyu Jiang

Ziyu Jiang, NEC Labs America (Presenter)

LidaRF Delving into Lidar for Neural Radiance Field on Street Scenes

Presented Papers

Taming Self-Training for Open-Vocabulary Object Detection

/CVPR2024

Recent studies have shown promising performance in open-vocabulary object detection (OVD) by utilizing pseudo labels (PLs) from pretrained vision and language models (VLMs). However, teacher-student self-training, a powerful and widely used paradigm to leverage PLs, is rarely explored for OVD.

Read more

AIDE: An Automatic Data Engine for Object Detection in Autonomous Driving

/CVPR2024

Autonomous vehicle (AV) systems rely on robust perception models as a cornerstone of safety assurance. However, objects encountered on the road exhibit a long-tailed distribution, with rare or unseen categories posing challenges to a deployed perception model. This necessitates an expensive process of

Read more

Self-Training Large Language Models for Improved Visual Program Synthesis With Visual Reinforcement

/CVPR2024

Visual program synthesis is a promising approach to exploit the reasoning abilities of large language models for compositional computer vision tasks. Previous work has used few-shot prompting with frozen LLMs to synthesize visual programs. Training an LLM to write better visual programs is an attractive

Read more

Instantaneous Perception of Moving Objects in 3D

/CVPR2024

The perception of 3D motion of surrounding traffic participants is crucial for driving safety. While existing works primarily focus on general large motions, we contend that the instantaneous detection and quantification of subtle motions is equally important as they indicate the nuances in driving behavior

Read more

LidaRF: Delving into Lidar for Neural Radiance Field on Street Scenes

/CVPR2024

Photorealistic simulation plays a crucial role in applications such as autonomous driving, where advances in neural radiance fields (NeRFs) may allow better scalability through the automatic creation of digital 3D assets. However, reconstruction quality suffers on street scenes due to largely collinear

Read more

Generating Enhanced Negatives for Training Language-Based Object Detectors

/CVPR2024

The recent progress in language-based open-vocabulary object detection can be largely attributed to finding better ways of leveraging large-scale data with free-form text annotations. Training such models with a discriminative objective function has proven successful, but requires good positive and negative

Read more

Long-HOT: A Modular Hierarchical Approach for Long-Horizon Object Transport

/ICRA 24, PACIFICO Yokohama, Japan & CVPR2024 Seattle, WA

We aim to address key challenges in long-horizon embodied exploration and navigation by proposing a long-horizon object transport task called Long-HOT and a novel modular framework for temporally extended navigation. Agents in Long-HOT need to efficiently find and pick up target objects that are scattered

Read more

Read More Blog Posts

NEURIPS24 3

NEC Labs America Team Attending NeurIPS24 in Vancouver

NEC Labs America is proud to attend NeurIPS 2024 in Vancouver, Canada from December 10-15. Zachary Izzo will present Subgroup Discovery with the Cox Model, Shaobo Han will present VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks and Jonathan Warrell will present Discrete-Continuous Variational Optimization with Local Gradients.
Read more
Summer 2025 Intern SMM

Apply for a Summer 2025 Internship

Our exciting internship opportunities for this Summer 2025 are now available. We are looking for students pursuing advanced degrees in Computer Science and Electrical Engineering. Internships are typically 3 months long in duration. The benefits of working for us include the opportunity to quickly become part of a project team applying cutting-edge technology to industry-leading concepts. We have opportunities in Data Science & System Security, Integrated Systems, Media Analytics, Machine Learning, and Optical Networking & Sensing.
Read more
Princeton Interns 2024

Summer Interns 2024

Learn about the amazing group of interns who joined us at Princeton and San Jose campuses this summer. Their hard work, fresh perspectives, and dedication have truly made an impact across the board, from cutting-edge research projects to innovative software development initiatives.
Read more
ECOC2024 SMM

NEC Labs America Team Attends the 2024 European Conference on Optical Communication (ECOC) in Frankfurt, Germany

Our optical networking & sending team has arrived in Frankfurt for the 2024 European Conference on Optical Communication (ECOC)  and is excited to present many papers and tutorials this week. Please follow this page and on our social media channels for updates.
Read more
Introducing the Trustworthy Generative AI Project Pioneering the Future of Compositional Generation and Reasoning Blog Post

Introducing the Trustworthy Generative AI Project: Pioneering the Future of Compositional Generation and Reasoning

We are thrilled to announce the launch of our latest research initiative, the Trustworthy Generative AI Project. This ambitious project is set to revolutionize how we interact with multimodal content by developing cutting-edge generative models capable of compositional generation and reasoning across text, images, reports, and even 3D videos.
Read more
Introducing Our New Project Time Series Language Model for Explainable AI Blog Post

Introducing Our New Project: Time Series Language Model for Explainable AI

Our new project, Time Series Language Model for Explainable AI, represents a significant leap forward in the field of forecasting and explainable AI. By combining advanced forecasting techniques with explainable AI, we are paving the way for a future where data-driven insights are not only accurate but also comprehensible and actionable.
Read more
Agentic LLMs for AI Orchestration Project Revolutionizing Complex Workflows

Agentic LLMs for AI Orchestration Project: Revolutionizing Complex Workflows

The development of Agentic LLMs for AI Orchestration represents a significant advancement in artificial intelligence. By seamlessly integrating computer vision, logic, and compute modules, our LLM is poised to revolutionize the way complex workflows are managed and executed. Supported by robust research and driven by innovative training methodologies, our agentic LLM sets a new standard in AI orchestration, offering unparalleled performance and adaptability.
Read more
The Evolution of Disciplines From Experimental Roots to Theoretical Frameworks Blog Post

The Evolution of Disciplines: From Experimental Roots to Theoretical Frameworks

Chris White discusses the evolution of scientific disciplines, which often begin with exploration driven by curiosity and experimentation. As fields grow in complexity and cost, they shift to theoretical frameworks that optimize research. This transition is crucial for sustainable progress. Currently, AI and ML remain largely experimental, highlighting the need for theoretical foundations to ensure development.
Read more
CVPR2024

NEC Labs America Team Attending CVPR 2024 in Seattle

Our team will be attending CVPR 2024 (The IEEE /CVF Conference on Computer Vision & Pattern Recognition) from June 17-21! See you there at the NEC Labs America Booth 1716! Stay tuned for more information about our participation.
Read more
Multi-Agent Simulator for Carbon Neutrality

Multi-Agent Simulator for Carbon Neutrality: The Technology the World Has Been Waiting For

Today, each country, government, and enterprise are urged to take effective action to fight against climate change; however, an efficient method has not been found. Even a way to accurately calculate Scope 3 carbon emissions has yet to be developed. The technology of a multi-agent simulator could be an essential step in solving worldwide challenges. We interviewed the researchers about the details of this technology.
Read more
OFC Team 2

NEC Labs America at OFC 2024 San Diego from March 24 – 28

The NEC Labs America team Yaowen Li, Andrea D'Amico, Yue-Kai Huang, Philip Ji, Giacomo Borraccini, Ming-Fang Huang, Ezra Ip, Ting Wang & Yue Tian (Not pictured: Fatih Yaman) has arrived in San Diego, CA for OFC24! Our team will be speaking and presenting throughout the event. Read more for an overview of our participation.
Read more
NEC Laboratories Advances Material Design with AI-based MateriAI Platform

NEC Laboratories Advances Material Design with AI-based MateriAI Platform

NEC Laboratories Europe and NEC Laboratories America have developed MateriAI, an AI-based, material design platform that accelerates the development of new, environmentally friendly materials. The prototype platform was initially designed to overcome major hurdles in the creation of new synthetic, organic and bio-based polymers, such as rubber and plastics.
Read more
Summer Intern 2024

Apply for a Summer 2024 Internship

Our exciting internship opportunities for this Summer 2024 are now available. We are looking for students pursuing advanced degrees in Computer Science and Electrical Engineering. Internships are typically 3 months long in duration. The benefits of working for us include the opportunity to quickly become part of a project team applying cutting-edge technology to industry-leading concepts. We have opportunities in Data Science & System Security, Integrated Systems, Machine Learning, and Optical Networking & Sensing.
Read more
Unearthing Nature's Orchestra How Fiber Optic Cables Can Hear Cicada Secrets

Unearthing Nature’s Orchestra – How Fiber Optic Cables Can Hear Cicada Secrets

Our Sarper Ozharar, Yue Tian and Yangmin Ding and Jessica L. Ware from the American Museum of Natural History have discovered that fiber optic cables equipped with distributed acoustic sensing (DAS) can pick up the sounds of Brood X cicadas. DAS technology, typically used to monitor seismic activity, can detect the vibrations caused by the loud sounds of cicadas, which live underground for years until they come up to mate.
Read more
NeurIPS Booth 1

NEC Labs America Team Heading to NeurIPS23 in New Orleans

NEC Labs America is proud to be a Silver Sponsor for NeurIPS 2023 in New Orleans from December 10-16. Visit our booth to meet our team and learn about our intern opportunities in machine learning, data science, media analytics and integrated systems. Also, our Vijay Kumar.B.G, Samuel Schulter & Manmohan Chandraker, along with Zaid Khan, Northeastern University and Yun Fu, UC San Diego will present a paper, Exploring Question Decomposition for Zero-Shot VQA.
Read more
Sarper Ozharar Achievement in Science and Technology Award

Sarper Ozharar Receives Achievement in Science and Technology Award from Koç University

Sarper Ozharar was awarded an Achievement in Science and Technology Award from Koç University on their notable 30th anniversary.  As an alumnus of this esteemed institution, Sarper shared that this recognition is especially meaningful to him, marking a significant milestone in his professional journey.
Read more
The Industrial Lab Advantage Delivering on the Expectations of AI

The Industrial Lab Advantage: Delivering on the Expectations of AI | Future of Work News

Our Chris White outlines how Invisible AI transforms our lives and its potential to bring about transformative societal changes, including safer space travel, reliable cell networks, smarter cities, productive factories, and efficient homes. Invisible AI will intelligently anticipate needs, automate tasks, and enhance the human experience.
Read more
Chris White Interviewed By Mike Vizard on Techstrong.AI

Chris White Interviewed By Mike Vizard on Techstrong.AI

In this excellent Techstrong.ai videocast, Michael Vizard interviews our Christopher White, President of NEC Labs America, about #AI and its future. They discuss generative AI, its current hype, its potential impact on content creation and the augmentation of human abilities. Chris emphasizes that generative AI systems are not "thinking machines" but tools to enhance human capabilities.
Read more
Meet the NEC Labs America Intern Helping to Make Autonomous Vehicles Safer and More Secure Blog Post Graphic

Meet the NEC Labs America Intern Helping to Make Autonomous Vehicles Safer and More Secure

There’s much more to autonomous vehicle security than locking a car door. This summer, Kaiyuan Zhang, a 3rd-year computer science Ph.D. student at Purdue University, joined NEC Labs America’s popular intern program to help advance research around autonomous vehicle security. Each year, nearly 50 Ph.D. candidates join NEC Labs America’s innovative program, which centers on a collaborative environment where interns work directly with senior researchers and potential end-user customers.
Read more
AI Fiber Optic Combo Poised To Improve Telecommunications

AI/Fiber-Optic Combo Poised To Improve Telecommunications

Existing underground fiber-optic telecommunications cable networks that can be accessed through street manholes are helping a team at NEC Labs America improve wireless communications systems and the Internet of Things (IoT). "Hundreds of millions of fiber-optic cables are already there for communications purposes,” says Shaobo Han, a researcher at NEC Labs America who focuses on the design and development of machine learning and signal-processing techniques for real-world sensing applications. “We’re turning it all into a ‘thinking’ device, using the same cable that’s already there.”
Read more
Industrial Labs to Drive Disruptive Innovation for the Fourth Industrial Revolution Blog Post

Industrial Labs to Drive Disruptive Innovation for the Fourth Industrial Revolution

While the previous generation of industrial progress brought us new capabilities, efficiencies, and even delight through digital transformation, we’re entering a new era of innovation, opportunity, and disruption: the Fourth Industrial Revolution. What is the Fourth Industrial Revolution?
Read more
Meet The Disruptors NEC’s Chris White On The Five Things You Need To Shake Up Your Industry - Authority Magazine

Meet The Disruptors: NEC’s Chris White On The Five Things You Need To Shake Up Your Industry | Authority Magazine

Read this fantastic interview with our President, Christopher White, with Authority Magazine, as he shares five things you need to shake up your industry based on his experience pushing the envelope in chemistry, computer science, quantum computing, and artificial intelligence. Chris leads our team to conduct disruptive research rather than just incremental research.
Read more
Haven for Hope

A New Hope: AI Research is Conquering Today’s Computer Vision Plateau

The age of computer vision is upon us, and it’s transforming the way we live, work and interact with the world. Nearly every industry has found a use case to grow revenue, reduce cost, or create exceptional experiences using computer vision. From self-driving cars to retail automation, surgeons to farmers, computer vision is everywhere, providing critical insights that are driving progress in virtually every aspect of our daily lives. Today, images and videos are annotated to train artificial intelligence (AI) models to recognize specific objects, but there is still so much more to be done when it comes to understanding what those objects are doing in real-time.
Read more
OFC Confererence Recap

NEC Labs America Presentation Highlight from OFC 2023

Looking to learn about the latest fiber optics research and innovation? NEC Labs America (NECLA) recently discussed its latest advances in fiber sensing research at the Optical Fiber Conference (OFC), March 5-9, 2023 in San Diego. OFC is the largest global conference and exhibition for optical communications and networking professionals.
Read more
Our Time Series Data Research Drives Space Systems Innovation

NEC Labs America’s Time Series Data Research Drives Space Systems Innovation

With decreasing hardware costs and increasing demand for autonomic management, many of today’s physical systems are equipped with an extensive network of sensors, generating a considerable amount of time series data daily. A highly valuable source of information, time series data is used by businesses and governments to measure and analyze change over time in complex systems. Organizations must consolidate, integrate and organize a vast amount of time series data from multiple sources to generate insights and business value.
Read more
Next-Generation Computing Finally Sees Light Blog Post

Next-Generation Computing Finally Sees Light

Moore's law is dead, as we have squeezed all the innovation out of silicon. Fiber optics is the solution to meet the computing needs of tomorrow. Today, we can already use the light traveling inside fiber optic cables as sensors that measure vibrations, sound, temperature, light, and pressure changes. We're now developing the means to take this to the next level with photonic computing at the speed of light to provide faster reaction time, reduce energy consumption and improve battery range
Read more
SystemX New

NEC Labs America Heads to Stanford University’s SystemX Alliance Annual Fall Conference

NEC Labs America’s (NECLA) President Christopher White is attending Stanford University’s SystemX Alliance 2022 Fall Conference this week, where he is meeting with Ph.D. students, industry-leading researchers and business leaders presenting on a wide range of research topics. The annual conference will highlight exciting research in the areas of advanced materials, data analytics, energy and power management, 3D nanoprinting, and photonic and quantum computing, to name but a few!
Read more
Using AI To Safely Put The First Woman On The Moon

Using AI To Safely Put The First Woman On The Moon

We are helping to safely bring the first woman astronaut to the moon as part of NASA - National Aeronautics and Space Administration's Artemis Project with our System Invariant Analysis Technology (SIAT). With Lockheed Martin Space's T-Tauri AI platform, our SIAT analytics engine takes the data from the 150,000 sensors and creates a model incorporating over 22 billion data relationships. The AI model is then analyzed to find any irregularities which could lead to a possible malfunction of any of the spacecraft's systems.
Read more

Our AI Research Contributing to NASA’s Artemis Space Program

By 2024, the spacecraft "Orion" developed by Lockheed Martin will bring humans to the moon in NASA's Artemis program. The system invariant analysis technology, one of NEC's Artificial Intelligence technologies, will perform checks to ensure that the spacecraft is tested and operating properly during the production phase.
Read more
5 Accepted Papers CVPR2022!

Check out our Computervision Papers at #CVPR2022

The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) is the premier annual computer vision event comprising the main conference and several co-located workshops and short courses. NEC Laboratories Media Analytics department is excited to be presenting at CVPR 2022, being held in New Orleans, LA from Sunday, June 19 to Friday, June 24, 2022.
Read more

NEC provides AI-based traffic monitoring system with fiber-optic sensing technology for NEXCO CENTRAL

NEC Corporation has deployed an AI-based traffic monitoring system to Central Nippon Expressway Company Limited (NEXCO CENTRAL). The system uses fiber-optic sensing and AI technologies to visualize traffic conditions, such as the location, speed, and direction of travel, from vibrations produced by vehicle movement.
Read more

Our Media Analytics Research

Media Analytics

We solve fundamental challenges in computer vision, with a focus on understanding and interaction in 3D scenes, foundational vision-language models, robust learning across domains and responsible AI. Our technological breakthroughs contribute to socially-relevant solutions that address key enterprise needs in mobility, safety and smart spaces. Our work aims to democratize autonomous driving, develop agentic LLMs that solve user workflows and enable interactive robots, with a commitment to computer vision that promotes privacy, fairness and sustainability. Our award-winning research regularly features at top-tier venues such as CVPR, ICCV, ECCV and NeurIPS.