ControlNet is a neural network architecture that adds spatially structured conditioning to pretrained diffusion models, enabling fine-grained control over image generation through inputs such as edge maps, depth maps, pose skeletons, and segmentation masks. It attaches a trainable copy of the diffusion model’s encoder to the original frozen weights, allowing auxiliary control signals to guide generation without degrading the base model’s learned representations. ControlNet is widely used in image synthesis, scene editing, and data augmentation for computer vision research.
Video generation models can look physically convincing while getting the physics completely wrong. PhyCo, new research from our Media Analytics department, introduces continuous, controllable physical properties to video AI, allowing practitioners to specify friction, bounce, and force.
Princeton Office
4 Independence Way, Suite 200
Princeton, NJ 08540
+1 609-520-1555
San Jose Office
2033 Gateway Place, Suite 200
San Jose, CA 95110
+1 408-863-6007
NEC Laboratories America, Inc. (NEC Labs) is the US-based center for NEC Corporation’s global network of corporate research laboratories. Our diverse research groups collaborate with industry, academia and governments to provide disruptive solutions to complex problems. A leader in the integration of IT and network technologies with more than 100 years of expertise, NEC provides a combination of products and solutions that cross-utilize the company’s experience and global resources to meet the complex and ever-changing needs of its customers.