Controllable Video refers to video generation or editing in which specific attributes of the output, such as motion, appearance, camera trajectory, object behavior, or scene semantics, can be precisely directed through structured inputs such as text prompts, reference images, or physical constraints. It is an active area of generative AI research involving diffusion models and video foundation models. Applications include autonomous driving simulation, synthetic data generation, and content creation requiring temporally consistent, attribute-specific visual outputs.
Video generation models can look physically convincing while getting the physics completely wrong. PhyCo, new research from our Media Analytics department, introduces continuous, controllable physical properties to video AI, allowing practitioners to specify friction, bounce, and force.
Princeton Office
4 Independence Way, Suite 200
Princeton, NJ 08540
+1 609-520-1555
San Jose Office
2033 Gateway Place, Suite 200
San Jose, CA 95110
+1 408-863-6007
NEC Laboratories America, Inc. (NEC Labs) is the US-based center for NEC Corporation’s global network of corporate research laboratories. Our diverse research groups collaborate with industry, academia and governments to provide disruptive solutions to complex problems. A leader in the integration of IT and network technologies with more than 100 years of expertise, NEC provides a combination of products and solutions that cross-utilize the company’s experience and global resources to meet the complex and ever-changing needs of its customers.