Prescribed Burn Evaluation

A Satellite-based Synthetic Control Analysis of Wildfire Mitigation in California

Causal Inference Satellite Remote Sensing Representation Learning Environmental Policy

Research Question

Does low-intensity prescribed fire reduce subsequent high-intensity wildfire risk? And can satellite-derived embeddings improve causal inference by selecting ecologically similar donors for synthetic control analysis?

Research Design

Estimand

Average treatment effect on the treated (ATT) for VMP-treated pixels (n=3,966) relative to synthetic controls constructed from untreated conifer pixels.

Time Periods

Pre-period: 2003–2011 (9 years) | Post-period: 2012–2018 (6 years)

Outcome Variable

Maximum Fire Radiative Power (FRP) in MW from MODIS FIRMS, capturing fire intensity at 1 km² resolution. Higher FRP indicates more intense fires.

Comparison Strategy

Random statewide (500 pixels) vs. Manual covariate screens (284 pixels) vs. Embedding-based K-nearest neighbors (50 pixels in latent space).

Inference Method

Block bootstrap over treated units (500 resamples) for standard errors and 95% confidence intervals. Parallel trends assumption validated by near-flat pre-treatment gaps.

Donor Pool Strategy Comparison

Explore how different donor selection strategies affect pre-treatment balance and causal inference quality. Click buttons to switch between strategies and see how donor pools differ in embedding space.

Random Statewide Donors (500 untreated pixels)

Donor Selection Rule

Randomly sample 500 untreated conifer pixels statewide. No explicit constraint on ecological similarity; relies on large sample to approximate covariate distributions.

Pre-Treatment Fit (2003–2011)

Median RMSPE
0.45
IQR Range
0.15–0.62

RMSPE: Root Mean Squared Prediction Error Measures how well synthetic control tracks treated pixels pre-treatment. Lower = better pre-fit.

Control Pool Similarity (Embedding Space)

Random donors: dispersed in embedding space

Red: treated pixel. Gray/Orange/Green: donors from Random/Manual/Embedding strategies. Embedding-based selection yields tighter clusters in latent similarity space, improving comparability.

Estimated Treatment Effects (Post-Treatment 2012–2018)

👆 Click tabs to explore different analyses:

Treated pixels (n=3,966) vs. Synthetic Controls: Pre-treatment alignment (2003–2011) and post-treatment divergence (2012–2018) by donor strategy. All strategies share identical pre-window and post-window definitions.

Figure 1: Time-Series FRP (Max Fire Radiative Power)

Interpretation: All three strategies track pre-treatment trajectories closely, supporting parallel-trends assumption. Post-2012, Embedding-based (green) exhibits the largest and most sustained divergence from synthetic control, followed by Manual (orange), then Random (gray). This ordering aligns with pre-treatment balance quality.

Average Treatment Effect on the Treated (ATT): Post-treatment reduction in FRP (MW) aggregated over 2012–2018. Negative values indicate wildfire mitigation.

Strategy Pre-RMSPE ATT (MW) 95% CI % ATT 95% CI %
Random (500) 0.45 −0.53 [−0.88, −0.18] −3.2% [−3.9%, −2.5%]
Manual (284) 0.36 −0.67 [−0.98, −0.36] −3.8% [−4.6%, −3.0%]
Embeddings (K=50) 0.23 −0.81 [−1.08, −0.54] −4.4% [−5.1%, −3.7%]

Key Finding: Embedding-based donors deliver the largest negative ATT (−0.81 MW) with the smallest uncertainty (SE=0.14). This translates to a −4.4% reduction in post-treatment FRP relative to baseline. The ordering is consistent: Embeddings > Manual > Random, mirroring pre-treatment balance quality.

Gap Plot: Median treated − synthetic FRP over time. Zero or near-zero pre-gaps indicate good parallel-trends validity. Sustained negative post-gaps indicate treatment effect credibility.

Figure 2: Treated − Synthetic Gap by Strategy

Interpretation: All strategies show near-flat pre-trends (flat gray band 2003–2011), supporting the assumption that treated and control outcomes would have followed parallel paths absent treatment. Post-2012, Embeddings (green) exhibits the largest and most stable negative gap, approximately twice the magnitude of Manual and Random strategies. The absence of systematic pre-existing divergence strengthens causal attribution.

Sensitivity Analysis: ATT estimates under alternative specifications (pre-period length, donor count K, outlier exclusion, spatial buffers). Robustness to design choices supports credibility of main results.

Specification Pre-RMSPE ATT (MW) 95% CI % ATT
Embeddings: Baseline (K=50) 0.23 −0.81 [−1.08, −0.54] −4.4%
Embeddings: Shorter pre (5y) 0.29 −0.68 [−1.03, −0.33] −3.7%
Embeddings: K=25 0.26 −0.65 [−1.05, −0.25] −3.5%
Embeddings: K=100 0.22 −0.85 [−1.11, −0.59] −4.6%
Embeddings: Exclude FRP > 500 MW 0.24 −0.54 [−0.97, −0.11] −2.9%
Embeddings: Buffer 5 km 0.23 −0.87 [−1.16, −0.58] −4.7%

Robustness Finding: ATT estimates remain stable across design variations. Embedding-based ATT ranges from −0.54 to −0.87 MW across all specifications, with tight confidence intervals. Even when relaxing donor constraints (K=100) or using only 5-year pre-periods, estimates remain consistent. This demonstrates the method's reliability and reduces concerns about design-specific artifacts.

Core Finding

−4.4% Reduction in Fire Radiative Power

Low-intensity prescribed fire reduces subsequent high-intensity wildfire risk by 4.4% (95% CI: [−5.1%, −3.7%]) over a six-year horizon (2012–2018), with effects concentrated in embedding-matched control pixels that exhibit superior pre-treatment balance.

Treatment Units
3,966
VMP-treated pixels
Study Period
9 + 6 years
Pre (2003-11) + Post (2012-18)

Methodological Innovation

The core innovation is using satellite-derived embeddings from foundation models to constrain donor pools in synthetic control analysis, dramatically improving pre-treatment balance:

Random Statewide
RMSPE: 0.45

500 untreated pixels, no ecological constraint

Manual Covariate Screen
RMSPE: 0.36

284 pixels filtered by slope, elevation, forest type

Embedding-Based K=50
RMSPE: 0.23

49% improvement via K-nearest in latent space

Key Insight: Satellite embeddings capture ecological similarity better than explicit covariates alone. The PrithVi V2 foundation model learns spectral patterns that proxy unmeasured ecological heterogeneity (soil quality, microclimate, vegetation structure). K-nearest neighbors in embedding space yields pre-treatment RMSPE of 0.23—a 49% reduction—while maintaining interpretability.

Research Contributions

📊 Substantive Finding

First satellite-based causal evidence that low-intensity prescribed fire is an effective wildfire mitigation tool, with effects robust to design variations.

🔬 Methods Innovation

Demonstrates how foundation models improve causal inference by learning ecological similarity from satellite imagery, with 49% RMSPE improvement.

⚖️ Policy Relevance

Provides quantitative evidence to justify continued investment in prescribed fire programs as part of wildfire risk management strategy.

🛰️ Data Science

Shows practical value of satellite embeddings for high-dimensional policy evaluation in environmental governance without traditional covariate data.

Technical Skills & Methods

Synthetic Control Representation Learning Causal Inference Satellite Embeddings (PrithVi V2) Pre-Treatment Balance RMSPE Diagnostics Donor Pool Restriction Environmental Policy Evaluation Bootstrap Inference Remote Sensing