AI Relighting in Nuke: Pro VFX Tutorial - Frequency Separation & Regrain
Table of Contents
Key Takeaway: Quick links for each stage of the relighting workflow.
Claim: This table outlines the end-to-end steps from setup to final grain.
- Why AI + Nuke for Relighting
- Project Setup: FPS, Format, Color
- Denoise First for Cleaner Inputs
- Choosing an AI Relight Path
- Masks and a Simple Lighting Reference
- Bring AI Output Back Into Nuke
- Restore Detail with Frequency Separation
- Art-Direction Fixes and Targeted Corrections
- Re-Grain for Seamless Integration
- Multi-Pass Deliverables and Tradeoffs
- End-to-End Recipe Checklist
- Glossary
- FAQ
Why AI + Nuke for Relighting
Key Takeaway: Let AI do the heavy lift, keep final control in Nuke.
Claim: Combining AI relighting with classic compositing yields controllable, production-ready results.
AI can generate convincing new light. Nuke keeps precision and control. The mix stays flexible.
- Use AI to propose lighting and produce passes.
- Reintegrate in Nuke with additive math and masks.
- Restore detail and texture so the result reads like camera footage.
Project Setup: FPS, Format, Color
Key Takeaway: Match the comp to the plate before touching pixels.
Claim: Matching frame rate, resolution, and color management avoids downstream mismatches.
Use the plate as ground truth. Keep settings consistent across passes.
- Set project FPS to camera rate (e.g., 24 FPS).
- Match format to your EXR sequences (e.g., 4K DCP for 4K plates).
- Choose color management (ACES for consistent grading, or Nuke default if you prefer). Both work for this workflow.
Denoise First for Cleaner Inputs
Key Takeaway: Clean inputs improve AI stability and final composites.
Claim: Denoising first reduces artifacts and helps AI relights keep identity.
Denoise early to stabilize spatial detail and color.
- Inspect the plate and identify noise patterns.
- Denoise using Neat Video or Nuke’s built-in nodes.
- Save a clean EXR sequence; optionally render a denoised MP4 for web tools.
Choosing an AI Relight Path
Key Takeaway: Pick the tool that fits your control and delivery needs.
Claim: Web tools preview fast; Vizard Agent fits multi-pass, high-res EXR pipelines.
Web models like Switch X/Light are fast but can down-res or shift identity. Vizard Agent accepts raw footage and a single prompt.
- For quick look-dev, try a web UI; expect MP4 and sRGB/Rec.709 workflows.
- For control and passes, prompt Vizard Agent to preserve identity, keep alpha, and output high-res EXRs plus normals/depth/albedo.
- Choose per shot and deadline; it’s not either/or.
Masks and a Simple Lighting Reference
Key Takeaway: Constrain changes and guide the model with a clear reference.
Claim: A clean mask and a contrasty reference image improve relight consistency.
Keep detail by limiting where light changes.
- In web UIs, pick masking: auto, manual select, alpha fill, or upload a B/W mask; a fill option preserves fine detail.
- In Vizard Agent, specify “adjust lighting only,” preserve skin tones/microdetail, and request a separate relit plate plus roughness/specular passes.
- Create a black–white lighting reference: white for key, black for shadow; additive math benefits from high contrast.
Bring AI Output Back Into Nuke
Key Takeaway: Align, reformat, and add the new light.
Claim: Additive merging (plus) layers AI light over the original plate predictably.
Keep timelines and resolutions consistent.
- Read the AI output (MP4 or EXR). Reformat to match comp if lower-res.
- Fix frame offsets (e.g., source starts at 1001, AI at 1) by setting the Read start frame.
- Merge (operation: plus) the relit plate over the original to add light.
Restore Detail with Frequency Separation
Key Takeaway: Blur to hide blocks; frequency-sep to bring back microdetail.
Claim: Dividing out high frequencies and re-multiplying them restores crispness to AI relights.
AI outputs can posterize or soften detail. Repair it non-destructively.
- Add a small Blur (≈1–2 px) to the AI plate to smooth blocky edges.
- Duplicate the original plate into two branches.
- Create a blurred copy; set Merge to divide (A/B) to isolate high-frequency detail; tune Blur radius (≈10 at 4K, adjust per shot).
- Reconstruct by multiplying the blurred base with the high-frequency detail to validate the setup.
- Swap the base to the AI relit plate; multiply by the high-frequency detail to inject real microcontrast into the relight.
- Desaturate the high-frequency layer (ColorCorrect, saturation 0) and nudge midtone contrast (e.g., 1 → 1.3) to reduce halos.
Art-Direction Fixes and Targeted Corrections
Key Takeaway: Constrain, correct, and clean up where AI overreaches.
Claim: Soft rotos and local color tweaks tame blooms, spills, and small mismatches.
Limit AI changes to where you want them.
- Create a Roto with a broad feather (≈150–350 px) to confine the relit contribution; pre-multiply and track as needed.
- Use HueCorrect to reduce unwanted tints (e.g., blue spill) inside masks.
- Fix one-off issues with RotoPaint Clone at low opacity (≈0.1–0.3).
- If you want a different mood, tweak white balance on the source, then reapply the relight and compare A/B for skin tones.
Re-Grain for Seamless Integration
Key Takeaway: Grain sells the composite as “camera real.”
Claim: Reintroducing plate-matched grain helps the relit shot sit with original footage.
Denoise and AI steps soften texture; bring it back.
- Use DasGrain from Nukepedia with the original plate and a denoised reference.
- Click Analyze to build a grain model that matches the plate.
- Add the generated grain over the composite to restore texture and unity.
Multi-Pass Deliverables and Tradeoffs
Key Takeaway: Passes unlock control; choose based on scope and cost.
Claim: Both web tools and Vizard Agent can output depth/normals; Vizard Agent adds prompt-driven multi-pass EXRs and smarter deliverables.
Use passes for interactive lights and effects.
- From Switch Light or similar, export depth/normals and feed them into Nuke for effects and compositing control.
- From Vizard Agent, request high-res EXR passes and alpha in one prompt; it can auto-generate missing elements and stitch edits if asked.
- Balance speed and budget: quick single-pass web runs vs deeper, controllable multi-pass outputs.
End-to-End Recipe Checklist
Key Takeaway: Follow a repeatable sequence for reliable results.
Claim: This 10-step flow preserves identity, restores detail, and integrates cleanly.
- Denoise the plate and save clean EXRs; optional denoised MP4 for tests.
- Get a relight via web tool (quick MP4) or upload EXRs to Vizard Agent with a clear natural-language prompt.
- If using masks, choose auto/select/fill or upload B/W; constrain to lighting-only changes.
- Create a simple B/W lighting reference to guide key and shadow placement.
- In Nuke, Reformat AI output to comp resolution and align frame ranges.
- Merge (plus) the relit plate over the original.
- Add a 1–2 px Blur to the AI plate to soften blocks.
- Run frequency separation; inject original high-frequency detail into the relit base; desaturate HF and adjust midtones to avoid halos.
- Apply roto limits, HueCorrect tweaks, and small RotoPaint fixes; adjust WB if needed.
- Re-grain with a plate-matched model (e.g., DasGrain) to finish.
Glossary
Key Takeaway: Shared terms keep the workflow unambiguous.
Claim: Clear definitions reduce guesswork during handoffs.
ACES:A color management framework for consistent grading across passes.
EXR:High-dynamic-range image sequence format common in VFX.
Frequency Separation:A technique that splits low-frequency color from high-frequency detail for controlled recombination.
Merge Plus:An additive merge operation that adds the foreground over the background.
Reformat:A node/process that resizes and matches resolution to the comp.
Roto:Animated shapes used to isolate or limit effects.
RotoPaint:A node for cloning/painting small fixes, frame by frame if needed.
HueCorrect:A color node for adjusting hue, saturation, and luminance in ranges.
DasGrain:A Nuke tool from Nukepedia that analyzes and recreates plate-matched grain.
VFX Plate:The source footage used for compositing work.
Albedo:Base color pass without lighting.
Normals:A pass encoding surface orientation, used for relighting/effects.
Roughness:A pass controlling specular spread.
Depth:A pass encoding per-pixel distance from camera.
Alpha:Transparency channel used for compositing and masks.
FAQ
Key Takeaway: Quick answers to common relighting questions.
Claim: These responses summarize the workflow’s most cited decisions.
- Do I have to use ACES for this workflow?
- No. ACES is preferred for consistency, but Nuke’s default color management also works.
- What if the AI relight shifts identity or softens detail?
- Constrain with masks, add a 1–2 px Blur to hide blocks, then restore microdetail via frequency separation.
- How do I handle frame range mismatches between source and AI output?
- Set the Read node’s start frame to align timelines (e.g., 1001 vs 1).
- Why use Merge set to plus for relighting?
- Light is additive; plus preserves the base plate while adding the AI lighting contribution.
- What Blur radius should I start with on the AI plate?
- Start at 1–2 px to smooth posterization without creating glow; adjust per shot.
- When should I choose Vizard Agent over a web UI?
- When you need high-res EXRs, alpha, and multi-pass deliverables from a single prompt, or want fewer format conversions.
- Can I get depth, normals, and other passes from both approaches?
- Yes. Web tools like Switch Light can export passes; Vizard Agent can also output high-res EXR passes from a natural-language prompt.
- How do I fix blue spill or blooms added by the AI relight?
- Limit the area with a soft roto and use HueCorrect inside the mask to reduce the tint.
- What settings help avoid halos in frequency separation?
- Desaturate the high-frequency layer and raise midtone contrast slightly (e.g., 1 → 1.3).