Lightricks Introduces Open-Source LTX Video AI Model With Real-Time Video Generation Capability

Lightricks, a software program firm targeted on picture and video enhancing, launched an open-source synthetic intelligence (AI) video mannequin in preview final week. Dubbed LTX Video, the AI mannequin can generate medium-resolution movies in actual time. While real-time video technology functionality exists in a number of massive language fashions (LLMs), that is the primary one to be open-sourced. The firm additionally acknowledged that when the total model is launched, it is going to be free for each private and industrial use and may be built-in into the LTX Studio.

Lightricks Introduces Open-Source AI Video Model

In a sequence of posts on X (previously referred to as Twitter), Lightricks detailed its open-source AI mannequin. The LTX Video accepts each textual content and pictures as enter and may generate five-second-long movies in 768 x 512p decision. While the preview mannequin caps the video high quality at medium decision, it provides close to real-time technology with 4 seconds of wait time. However, this technology time is feasible on units geared up with the Nvidia H100 chip.

The firm claims that the AI mannequin can generate dynamic movies with excessive immediate adherence and doesn’t require high-end assets to run. To regionally run the LTX Video, customers will want a GPU much like the extent of RTX 4090. Lightricks additionally highlighted that the mannequin structure relies on the Diffusion Transformer however makes use of solely two billion parameters to maintain its dimension small.

LTX Video is at the moment accessible on GitHub, Hugging Face, and ComfyUI to obtain. To check the mannequin’s capabilities earlier than downloading it from the internet hosting web sites, customers can go to the mannequin web page on Fal.ai here.

The AI mannequin may also be built-in with a variety of exterior enhancing instruments to additional fine-tune the generated movies. The firm additionally plans to launch the total model of the video mannequin and make it open supply for each private use circumstances and industrial utilization. The full model of the software may also be built-in with the LTX Studio, the corporate’s AI-powered storyboard platform.