Inference Acceleration refers to techniques that increase the speed and efficiency of executing trained machine learning models during inference. It includes hardware optimization using GPUs, TPUs, or custom accelerators, as well as software methods such as model quantization, pruning, compilation, and batching. These approaches reduce latency, improve throughput, and lower energy consumption, enabling real-time deployment in applications such as computer vision, natural language processing, and edge AI systems.
Eric C. Blow of NEC Laboratories America presents a keynote at COOL Chips 29 in Tokyo, exploring multi-modal photonic computing for real-time, ultra-efficient inference. This work highlights how photonics is reshaping AI performance, enabling faster and more energy-efficient processing across next-generation systems.
Princeton Office
4 Independence Way, Suite 200
Princeton, NJ 08540
+1 609-520-1555
San Jose Office
2033 Gateway Place, Suite 200
San Jose, CA 95110
+1 408-863-6007
NEC Laboratories America, Inc. (NEC Labs) is the US-based center for NEC Corporation’s global network of corporate research laboratories. Our diverse research groups collaborate with industry, academia and governments to provide disruptive solutions to complex problems. A leader in the integration of IT and network technologies with more than 100 years of expertise, NEC provides a combination of products and solutions that cross-utilize the company’s experience and global resources to meet the complex and ever-changing needs of its customers.