Generative VFX with Runway Gen-3 | Create AI Visual Effects

This paragraph introduces the potential of generative VFX using tools like Runway. It uses examples like a plant and slime to illustrate how masking can be applied easily. The speaker explains how to expand from a frame using tools in Premiere, QuickTime, or online converters, then upload that frame to Runway Gen 3 to generate VFX based on a prompt. The speaker describes a specific VFX creation involving a man opening a door to reveal a space portal and highlights Runway’s ease of use, contrasting it with the complexity of traditional methods. The aspect ratio difference between video clips and how to resize them is also discussed.

The second paragraph delves into the process of generating VFX for a slime scene. The speaker shares a prompt where slime falls from the ceiling and covers the subject. They discuss how adding specific details in the prompt (e.g., 'drenching his body') can improve the VFX result. The speaker compares the VFX generated by Runway to those generated by Luma Labs' Dream Machine, concluding that Runway produced better results. The paragraph concludes with a note about the sponsor of the video, InVideo AI, which allows users to create full videos from prompts and edit them further using natural language commands.

This paragraph covers generating VFX for more complex scenes, such as a monster breaking through a window. The speaker explains how to create masks using Runway, recommending shooting a scene without the subject first for easier masking. Although the initial attempts at generating zombies didn’t yield desired results, the speaker eventually succeeded with a monster. Additionally, they encountered challenges while generating a plant growth effect. After several attempts, they managed to produce an acceptable result and explain the masking process step-by-step, using the example of a person standing in front of a window while masking out the background.

This section emphasizes the importance of sound effects in enhancing VFX. The speaker shares how they use tools like Storyblocks and 11 Labs to generate or find sound effects, discussing a few specific examples like monster growls and plant growth sounds. They also cover generating VFX assets like orbs on green screens for easy integration into video scenes. Techniques like using Premiere’s Ultra Key to remove green backgrounds and resizing VFX elements are explained. The speaker concludes by mentioning alternative tools like Luma’s Dream Machine and others, comparing their performance to Runway, and highlighting the consistent quality of Runway.

This paragraph focuses on animating VFX manually using keyframes and the transform effect for motion blur. The speaker explains how they manually tracked movement using keyframes and applied smoothing techniques. They describe comparing Runway’s output with that of other video tools like Luma's Dream Machine and Pixers, showing how each tool performed for different VFX scenes, such as monsters and plants. While some tools handled specific prompts well, Runway remained the most consistent in delivering static shots with minimal unwanted camera movement, making it ideal for overlaying VFX elements like explosions and lightning.

This final paragraph showcases examples of creative VFX generated by other users, as highlighted by Runway. These examples include realistic water physics, plant growth, and colorful slime effects. The speaker discusses several user-generated VFX ideas, including a giant monster walking through a city and magical drinks being poured. They also mention a project where various VFX elements were seamlessly combined with shots around New York City. Finally, the speaker encourages viewers to explore other AI video tools and platforms for inspiration and future VFX projects, while thanking the audience for watching.