Small AI Models are neural network architectures designed or compressed to operate within tight constraints on parameters, memory, and compute, while retaining sufficient accuracy for targeted tasks. Unlike large-scale foundation models, small AI models prioritize deployability over generality, making them suitable for edge devices, embedded systems, and latency-sensitive applications. They are produced through techniques such as pruning, quantization, knowledge distillation, and efficient architecture design, and are increasingly relevant as AI adoption expands beyond cloud infrastructure.
Machine learning is shifting from learning from data alone to learning from both data and teacher models. Beta-KD uses uncertainty-aware Bayesian weighting to train compact multimodal AI without blindly trusting every teacher signal.
Princeton Office
4 Independence Way, Suite 200
Princeton, NJ 08540
+1 609-520-1555
San Jose Office
2033 Gateway Place, Suite 200
San Jose, CA 95110
+1 408-863-6007
NEC Laboratories America, Inc. (NEC Labs) is the US-based center for NEC Corporation’s global network of corporate research laboratories. Our diverse research groups collaborate with industry, academia and governments to provide disruptive solutions to complex problems. A leader in the integration of IT and network technologies with more than 100 years of expertise, NEC provides a combination of products and solutions that cross-utilize the company’s experience and global resources to meet the complex and ever-changing needs of its customers.