VideoHouse
AI Tutorials7 min read

How I Used AI VFX on Real Footage to Make a Superhero Warzone Shot

September 11, 2026

I shot this in a park. A wide-open, flat, completely un-cinematic park. The AI turned it into a warzone. Here's the full process so you can do the same with any footage you have.

The workflow in one line

Picture the scene → shoot the camera move → trim the clip → send it to Claude → write the VFX prompt with the skill → generate in Higgsfield on Seedance 2.5 → iterate → done.

The finished shot. Real gimbal move. Real performance. AI-repainted world.

What You'll Need

  • Claude (claude.ai)
  • The seedance-footage-vfx skill (download below)
  • A Higgsfield account running Seedance 2.5
1

Step 1

Shoot the Real Move

I wanted an Avengers-style scene: camera orbiting around a superhero who just landed in a destroyed city. So before I picked up the camera, I thought through what that would actually look like as a shot. Wide orbit, low angle, the subject at center. I went to an open park specifically because I needed the space to pull off a wide orbit without running into anything.

Think about the scene you want first, then shoot the camera move that serves it. If the final scene needs an orbit, go shoot an orbit. If it needs a low push-in, shoot that. The AI preserves exactly what you do with the camera, so shoot it the way you want it to look.

You can also just use existing footage you already have. The workflow works with anything.

Key Tips

  • Picture the final scene first. Then shoot the move that fits it.
  • Shoot in an open area if you need room for wide camera movement
  • Shoot more than you need. You'll be cutting down to one take.
2

Step 2

Trim Your Clip

Before opening any AI tool, cut down to the exact take you want to work with. My main clip was around 13 seconds. I also did a version with a 4-second clip, which gives a tighter, punchier result. Both worked well.

Seedance 2.5 takes video inputs up to 15 seconds, so keep it short. The shorter and cleaner the clip, the easier everything after this gets.

Key Tips

  • My clip was 13 seconds. I also tried a 4-second version and loved it.
  • Keep it under 15 seconds. That's the cap.
  • Cut to the moment the move starts, not before
3

Step 3

Send the Video to Claude

Before writing a single word of the prompt, send Claude the actual video. Let it watch the clip and pull frames on its own. It reads the pose, the framing, where the camera settles, all of it. That context is what lets it write the prompt like a director who actually watched the footage, not someone guessing from a description.

This step is what makes Step 4 work. Don't skip it.

Key Tips

  • Send the actual video file. Don't describe it from memory.
  • The more Claude understands the shot, the better the prompt it writes
4

Step 4

Write the Prompt with the Skill

Once Claude has seen the footage, type /seedance-footage-vfx in the message box to activate the skill. Then just describe what you want in plain language. Here's exactly what I wrote:

"Write a prompt to replace the environment with a broken down city with rubble and an upside down yellow taxi behind the man. Also make the man into a superhero wearing superhero gear. He is crouched down and slowly stands up as he witnesses the city's destruction."

Claude takes that, combines it with the frame analysis from the previous step, and writes out the full structured generation prompt. It locks down the camera move and the performance, and only changes what you asked for. Read the full prompt before generating. If anything looks off, tell Claude to fix it right there in the same thread.

Key Tips

  • Type /seedance-footage-vfx to activate the skill, then just describe your scene
  • Read the full prompt before you generate. Adjust anything that doesn't look right.
  • Be specific about what changes and specific about what stays
  • If the camera drifts in the result, go back to Claude and describe the camera path more explicitly. 'Don't change the camera' is not enough.

💡seedance-footage-vfx is in the downloads below. Drop it into Claude and it structures the transformation prompt for you. Never installed a Claude skill before?Here's how to do it →

5

Step 5

Generate in Higgsfield

Take the prompt into Higgsfield and select Seedance 2.5 Edit mode. Not the create-from-text mode. Upload your source clip, set the duration to match the length of your raw footage, drop in the prompt, and generate.

Key Tips

  • Select Seedance 2.5 Edit, not the text-to-video create mode
  • Set the duration to match your source clip length
  • Seedance 2.5 specifically. The character and camera consistency is noticeably better.
6

Step 6

Iterate

If the first pass doesn't look right, share it with Claude in the same thread and tell it exactly what's off. Camera drifting? Suit doesn't look right? Just say so and Claude will adjust the prompt. This is the trial and error part where you start learning what prompt details actually move the output.

Take your time and actually read through the full prompt. There's usually something in there you'd want to tweak before running it again. The more passes you do, the better you get at writing these.

Key Tips

  • Keep everything in the same Claude thread. It has context on your footage.
  • Change one thing at a time. You learn more that way.
  • The first result is just information. Use it to figure out exactly what to fix.
7

Step 7

Final Thoughts

Same real move. Same real person. Completely different world.

Mixing AI with real footage is genuinely one of the most fun things I've done as a filmmaker. The ability to shoot something simple and transform it into a big-budget-looking scene is incredible, especially for anyone working with a lean budget. Want a superhero landing in a warzone? Go shoot an orbit in a park. That's where we are right now.

Honestly, I'm also a bit nervous about where all of this is going. I do hope there will be real conversation around regulation and how AI-generated media gets used. But in the meantime, we're here, having a great time, learning the tools, and figuring out what's actually possible. This is just the beginning.

The Full Workflow

Picture the Scene
Shoot
Trim
Claude Analyzes
Write Prompt (Skill)
Generate (Higgsfield)
Iterate

FAQ

Do I need a gimbal or specific camera gear?

No. This workflow works with any footage you have. A gimbal helps because it gives Seedance a smooth, consistent camera path to lock to, but it's not a requirement. Use whatever you have.

What if the model keeps changing the camera even after I specify it in the prompt?

Describe the camera's physical path explicitly. Name the starting distance, the height, and the direction of the move. 'Camera holds a low medium shot, pulling back slightly and tilting up as the subject rises' is something the model can follow. 'Don't change the camera' is not.

Does this work with any Seedance model or just 2.5?

This workflow is built around Seedance 2.5. The character and camera consistency on video-to-video is noticeably better than earlier versions. Use 2.5.

If you use this on a real project, tag me. I want to see what you make.

@itspatj_

Work With Us

Need a Video?
Let's Build It.

Start a ProjectMore Posts