Large-scale SDXL study

Attack-invariant projection experiment

Separate learned metrics for frozen DINO image embeddings and frozen caption embeddings. Conclusions are opened only on untouched prompts and held-out attack families.

large_scale_attack_invariant_v1

Track conclusions

caption_blip_base

Caption projection: unsupported

The frozen final-test decision did not support this projection.

Distance ratio
2.437
95% prompt CI
[2.101, 2.819]
PCA ratio
2.785
Paired log gain
-0.029
Paired 95% CI
[-0.081, 0.022]
Recall@1
0.394
Triplet accuracy
0.667
dinov2_base

DINOv2: strong separation, but no reliable improvement over PCA

Its separation remains strong, but the paired learned-over-PCA interval does not stay above zero.

Distance ratio
23.436
95% prompt CI
[19.146, 28.701]
PCA ratio
22.672
Paired log gain
0.009
Paired 95% CI
[-0.100, 0.117]
Recall@1
0.746
Triplet accuracy
0.951
dinov3_l16

DINOv3: supported

The frozen final-test decision and paired learned-over-PCA interval support this projection.

Distance ratio
18.312
95% prompt CI
[15.794, 21.014]
PCA ratio
7.252
Paired log gain
1.545
Paired 95% CI
[1.364, 1.728]
Recall@1
0.754
Triplet accuracy
0.932

Final-test scope

This post-hoc presentation uses 150 untouched final-test prompts and the two unseen final-test attack families. The 700/150/150 prompt split remains frozen.

Training attack families: affine, downsample_upsample, gaussian_blur, gaussian_noise, jpeg_compression, photometric

Attack protocol and exposure

All configurations below come from the frozen attack registry. Social-media compound was not trained or used for selection. Its compound pipeline contains operations related to separate training families (JPEG, downsample/upsample, photometric), but the exact combined pipeline/config was unseen.

AttackPartitionPromptsExposureMild / medium / severe frozen configsDINOv2 learned separationDINOv3 learned separation
Gaussian noisetrain700Optimized W.mild: sigma: 2.0; medium: sigma: 6.0; severe: sigma: 12.0Development only: 129.611×Development only: 77.826×
Gaussian blurtrain700Optimized W.mild: radius: 0.5; medium: radius: 1.5; severe: radius: 3.0Development only: 340.939×Development only: 311.791×
JPEG compressiontrain700Optimized W.mild: quality: 85; medium: quality: 60; severe: quality: 35Development only: 94.829×Development only: 36.001×
Downsample / upsampletrain700Optimized W.mild: scale: 0.85, resample: lanczos; medium: scale: 0.6, resample: lanczos; severe: scale: 0.35, resample: lanczosDevelopment only: 2432.113×Development only: 2060.969×
Photometric adjustmenttrain700Optimized W.mild: brightness: 1.04, contrast: 0.96, color: 1.03; medium: brightness: 0.9, contrast: 1.12, color: 0.82; severe: brightness: 1.2, contrast: 0.78, color: 1.28Development only: 688.814×Development only: 416.478×
Affine transformtrain700Optimized W.mild: degrees: 1.5, translate fraction: 0.01, scale: 0.98; medium: degrees: 4.0, translate fraction: 0.03, scale: 0.94; severe: degrees: 8.0, translate fraction: 0.06, scale: 0.88Development only: 17.195×Development only: 9.271×
Noise plus restorationvalidation150Did not train W; influenced early stopping, checkpoint, restart, dimension, and model selection.mild: sigma: 3.0, median size: 3; medium: sigma: 8.0, median size: 3; severe: sigma: 14.0, median size: 5Development only: 51.396×Development only: 32.891×
Perspective warpvalidation150Did not train W; influenced early stopping, checkpoint, restart, dimension, and model selection.mild: displacement fraction: 0.015; medium: displacement fraction: 0.04; severe: displacement fraction: 0.08Development only: 33.708×Development only: 16.583×
Occlusion / overlayfinal_test150Influenced neither training nor selection; evaluated once.mild: area fraction: 0.03, opacity: 0.45; medium: area fraction: 0.08, opacity: 0.65; severe: area fraction: 0.16, opacity: 0.85Final test: 23.726×Final test: 36.725×
Compound social-media degradationfinal_test150Influenced neither training nor selection; evaluated once.mild: long edge: 896, JPEG quality: 82, color: 0.96, sharpen: 1.05; medium: long edge: 640, JPEG quality: 58, color: 0.86, sharpen: 1.15; severe: long edge: 448, JPEG quality: 38, color: 0.72, sharpen: 1.3Final test: 52.402×Final test: 20.299×

Attack-family separation

Larger ratio means the attack stayed closer than a new seed. Learned W is compared with a matched-dimensional PCA baseline within each DINO representation; absolute distances are only comparable within a representation.

Attack familyEvidenceDINOMethodAttack-distance meanDifferent-seed-distance meanPrompt-macro separation ratioOrdering accuracyPromptsPairs
Gaussian noiseDevelopment onlyDINOv2Learned W0.0010.015129.6110.9587002800
Gaussian noiseDevelopment onlyDINOv2Matched-dimensional PCA0.0010.01176.9500.9427002800
Gaussian noiseDevelopment onlyDINOv3Learned W0.0000.00277.8260.9707002800
Gaussian noiseDevelopment onlyDINOv3Matched-dimensional PCA0.0060.01934.7670.8147002800
Gaussian blurDevelopment onlyDINOv2Learned W0.0000.015340.9390.9917002800
Gaussian blurDevelopment onlyDINOv2Matched-dimensional PCA0.0000.011233.1040.9927002800
Gaussian blurDevelopment onlyDINOv3Learned W0.0000.002311.7910.9977002800
Gaussian blurDevelopment onlyDINOv3Matched-dimensional PCA0.0000.019461.0330.9917002800
JPEG compressionDevelopment onlyDINOv2Learned W0.0010.01594.8290.9697002800
JPEG compressionDevelopment onlyDINOv2Matched-dimensional PCA0.0010.01063.0060.9617002800
JPEG compressionDevelopment onlyDINOv3Learned W0.0000.00236.0010.9497002800
JPEG compressionDevelopment onlyDINOv3Matched-dimensional PCA0.0120.02010.6080.7237002800
Downsample / upsampleDevelopment onlyDINOv2Learned W0.0000.0152432.1131.0007002800
Downsample / upsampleDevelopment onlyDINOv2Matched-dimensional PCA0.0000.0101844.9161.0007002800
Downsample / upsampleDevelopment onlyDINOv3Learned W0.0000.0022060.9691.0007002800
Downsample / upsampleDevelopment onlyDINOv3Matched-dimensional PCA0.0000.0193080.7151.0007002800
Photometric adjustmentDevelopment onlyDINOv2Learned W0.0000.016688.8141.0007002800
Photometric adjustmentDevelopment onlyDINOv2Matched-dimensional PCA0.0000.011561.0741.0007002800
Photometric adjustmentDevelopment onlyDINOv3Learned W0.0000.002416.4781.0007002800
Photometric adjustmentDevelopment onlyDINOv3Matched-dimensional PCA0.0000.019422.2300.9947002800
Affine transformDevelopment onlyDINOv2Learned W0.0010.01617.1950.9247002800
Affine transformDevelopment onlyDINOv2Matched-dimensional PCA0.0010.01115.0720.9167002800
Affine transformDevelopment onlyDINOv3Learned W0.0000.0029.2710.9157002800
Affine transformDevelopment onlyDINOv3Matched-dimensional PCA0.0090.0195.6360.7197002800
Noise plus restorationDevelopment onlyDINOv2Learned W0.0010.01351.3960.955150600
Noise plus restorationDevelopment onlyDINOv2Matched-dimensional PCA0.0010.01143.3670.930150600
Noise plus restorationDevelopment onlyDINOv3Learned W0.0000.00232.8910.948150600
Noise plus restorationDevelopment onlyDINOv3Matched-dimensional PCA0.0090.0207.9380.733150600
Perspective warpDevelopment onlyDINOv2Learned W0.0010.01433.7080.975150600
Perspective warpDevelopment onlyDINOv2Matched-dimensional PCA0.0010.01229.5900.955150600
Perspective warpDevelopment onlyDINOv3Learned W0.0000.00216.5830.938150600
Perspective warpDevelopment onlyDINOv3Matched-dimensional PCA0.0030.01817.6440.893150600
Occlusion / overlayFinal testDINOv2Learned W0.0010.01223.7260.932150600
Occlusion / overlayFinal testDINOv2Matched-dimensional PCA0.0010.01025.5800.947150600
Occlusion / overlayFinal testDINOv3Learned W0.0000.00236.7250.970150600
Occlusion / overlayFinal testDINOv3Matched-dimensional PCA0.0020.01831.2740.922150600
Compound social-media degradationFinal testDINOv2Learned W0.0010.01252.4020.970150600
Compound social-media degradationFinal testDINOv2Matched-dimensional PCA0.0010.01139.9160.947150600
Compound social-media degradationFinal testDINOv3Learned W0.0000.00220.2990.895150600
Compound social-media degradationFinal testDINOv3Matched-dimensional PCA0.0180.0166.6100.618150600

How to read the distances

A squared projected distance is the squared Euclidean distance after applying the frozen projection. The prompt-macro ratio averages each prompt's different-seed / same-source-attack ratio, rather than pooling prompts. Pooled absolute means average all pair distances. Ordering accuracy is the fraction of triplets where the different SDXL seed is farther than the same-source attack.

Full prompt distribution

RepresentationPromptsMeanMedianPrompts below 2×Prompts below 5×Prompts below 10×
caption_blip_base1502.4371.84685138146
dinov2_base15023.43613.75711850
dinov3_l1615018.31212.37032460

Learned and PCA 3D views

Illustrative auxiliary 3D projection: each panel shows the same selected final-test triplets. Learned and PCA panels for a representation share bounds.

Color = prompt. Circle = clean source. Triangle = attacked copy. Cross = different seed. Solid connector = source to attack; dashed connector = source to different seed.

DINOv2 learned

DINOv2 pca

DINOv3 learned

DINOv3 pca

Held-out breakdowns

Absolute distances cannot be compared across representations; compare values within a representation. Ratios and ordering accuracy summarize the within-representation comparison.

By fully held-out attack family

TrackValueRatioAttack-distance meanDifferent-seed meanOrdering accuracy
dinov2_baseocclusion_overlay23.7260.0010.0120.932
dinov2_basesocial_media_compound52.4020.0010.0120.970
dinov3_l16occlusion_overlay36.7250.0000.0020.970
dinov3_l16social_media_compound20.2990.0000.0020.895
caption_blip_baseocclusion_overlayundefined because exact or near caption collisions make the prompt-macro ratio unstable0.0780.1400.677
caption_blip_basesocial_media_compoundundefined because exact or near caption collisions make the prompt-macro ratio unstable0.0830.1460.657

By attack severity

TrackValueRatioAttack-distance meanDifferent-seed meanOrdering accuracy
dinov2_basemedium38.6080.0010.0120.943
dinov2_basemild202.0080.0000.0130.983
dinov2_basesevere12.9770.0010.0110.926
dinov3_l16medium38.2110.0000.0020.919
dinov3_l16mild134.7230.0000.0020.998
dinov3_l16severe16.2390.0000.0020.880
caption_blip_basemediumundefined because exact or near caption collisions make the prompt-macro ratio unstable0.0790.1320.652
caption_blip_basemildundefined because exact or near caption collisions make the prompt-macro ratio unstable0.0580.1480.730
caption_blip_basesevereundefined because exact or near caption collisions make the prompt-macro ratio unstable0.1050.1490.617

By prompt source

TrackValueRatioAttack-distance meanDifferent-seed meanOrdering accuracy
dinov2_basecoco201723.5460.0000.0050.955
dinov2_basediffusiondb23.3260.0010.0190.947
dinov3_l16coco201714.9260.0000.0020.920
dinov3_l16diffusiondb21.6970.0000.0020.945
caption_blip_basecoco20172.4930.0630.1080.643
caption_blip_basediffusiondb2.3820.0990.1790.690

By caption-divergence stratum

TrackValueRatioAttack-distance meanDifferent-seed meanOrdering accuracy
dinov2_basehigh26.5220.0010.0200.953
dinov2_baselow16.8410.0000.0040.945
dinov2_basemedium26.9440.0010.0120.955
dinov3_l16high24.3850.0000.0020.958
dinov3_l16low12.8820.0000.0020.907
dinov3_l16medium17.6680.0000.0020.932
caption_blip_basehigh2.7660.1040.2130.762
caption_blip_baselow2.2100.0470.0750.568
caption_blip_basemedium2.3360.0900.1420.670

Final held-out DINO results

These result numbers use only 150 untouched final prompts and 600 pairs per final family per representation. Training and validation families have protocol parameters above but no numbers in this final-test table.

DINOFinal familyPrompt-macro ratioAttack-distance meanDifferent-seed meanOrdering accuracyReversed count / ratePromptsPairs
dinov2_baseocclusion_overlay23.7260.0010.0120.93241 / 0.068150600
dinov2_basesocial_media_compound52.4020.0010.0120.97018 / 0.030150600
dinov3_l16occlusion_overlay36.7250.0000.0020.97018 / 0.030150600
dinov3_l16social_media_compound20.2990.0000.0020.89563 / 0.105150600

Occlusion is a stress test

The colored-box occlusion results remain in the aggregate breakdown. Because the box is visibly content-obscuring, it is a visible stress test and should not be interpreted as content-preserving robustness evidence.

Social-media degradation by severity

Mild and medium are content-preserving candidates, not human-certified content preservation. Pooled ratio is pooled different-seed mean divided by pooled attack mean.

DINOSeverityPairsReversed count / rateAttack meanDifferent-seed meanPooled ratioInterpretation
dinov2_basemedium1829 / 0.0490.0010.01219.023Content-preserving candidate
dinov2_basemild2162 / 0.0090.0000.01455.369Content-preserving candidate
dinov2_basesevere2027 / 0.0350.0010.01113.237Stress severity
dinov3_l16medium18223 / 0.1260.0000.0025.912Content-preserving candidate
dinov3_l16mild2160 / 0.0000.0000.00282.064Content-preserving candidate
dinov3_l16severe20240 / 0.1980.0000.0024.343Stress severity

Paired-model interpretation — prompt_000187

The same medium social-media degradation triplet produces opposite ordering outcomes: DINOv3: attack is 72.44× farther than the different generation; DINOv2: different generation is 75.95× farther than the attack.

Metric-aware image gallery

The main gallery contains only mild or medium compound social-media degradation cases. Successes maximize the weaker DINO ratio; Near tie cases are closest to a ratio of one; Reversed ordering failures minimize the target DINO ratio.

success · prompt_000135

social_media_compound

the feeling of writer's block

DINOv2 attack distance: 0.000; different-seed distance: 0.021. DINOv3 attack distance: 0.000; different-seed distance: 0.011.

Original source image
Clean source — seed 2
Attacked derivative
Attack — Compound social-media degradation. Severity: mild. Parameters: color: 0.96; JPEG quality: 82; long edge: 896; sharpen: 1.05
Different SDXL seed
Different generation — seed 5
success · prompt_000428

social_media_compound

realistic detailed image of a girl in a portal to hell in the heavenly old soviet room by Ayami Kojima, Amano, Karol Bak, Greg Hildebrandt, and Mark Brooks, Neo-Gothic, gothic, rich deep colors. Beksinski painting. art by Takato Yamamoto. masterpiece. ultra details, high quality, high resolution .

DINOv2 attack distance: 0.000; different-seed distance: 0.104. DINOv3 attack distance: 0.000; different-seed distance: 0.005.

Original source image
Clean source — seed 3
Attacked derivative
Attack — Compound social-media degradation. Severity: mild. Parameters: color: 0.96; JPEG quality: 82; long edge: 896; sharpen: 1.05
Different SDXL seed
Different generation — seed 11
near tie · prompt_000650

social_media_compound

a beautiful hyperrealistic fantasy painting of a pisces cerce lernean hydra hybrid kraken glistening in reflective iridescent scales and gilded scaleswith dimensional translucent purpose, 8 k, cryengine, cgsociety

DINOv2 attack distance: 0.004; different-seed distance: 0.004. DINOv3 attack distance: 0.000; different-seed distance: 0.000.

Original source image
Clean source — seed 0
Attacked derivative
Attack — Compound social-media degradation. Severity: medium. Parameters: color: 0.86; JPEG quality: 58; long edge: 640; sharpen: 1.15
Different SDXL seed
Different generation — seed 15
near tie · prompt_000492

social_media_compound

a big yellow truck that is on a road

DINOv2 attack distance: 0.000; different-seed distance: 0.006. DINOv3 attack distance: 0.001; different-seed distance: 0.001.

Original source image
Clean source — seed 2
Attacked derivative
Attack — Compound social-media degradation. Severity: medium. Parameters: color: 0.86; JPEG quality: 58; long edge: 640; sharpen: 1.15
Different SDXL seed
Different generation — seed 1
failure · prompt_000139

social_media_compound

award winning photo of a ginger cat

DINOv2 attack distance: 0.000; different-seed distance: 0.000. DINOv3 attack distance: 0.000; different-seed distance: 0.001.

Original source image
Clean source — seed 0
Attacked derivative
Attack — Compound social-media degradation. Severity: medium. Parameters: color: 0.86; JPEG quality: 58; long edge: 640; sharpen: 1.15
Different SDXL seed
Different generation — seed 15
failure · prompt_000187

social_media_compound

A bathroom with tiled walls and a white bath tub.

DINOv2 attack distance: 0.000; different-seed distance: 0.009. DINOv3 attack distance: 0.000; different-seed distance: 0.000.

Original source image
Clean source — seed 2
Attacked derivative
Attack — Compound social-media degradation. Severity: medium. Parameters: color: 0.86; JPEG quality: 58; long edge: 640; sharpen: 1.15
Different SDXL seed
Different generation — seed 12

Illustrated attack catalog

One deterministic final-prompt triplet per frozen family, selected by weaker-DINO log ratio closest to that family median (tie-broken by triplet key). These all-family distances are post-hoc exploratory; the preregistered primary test remains the two final-test families.

train · exploratory

Gaussian noise

Optimized W.

DINOv2 attack 0.005911, different 0.128332, ratio 21.710. DINOv3 attack 0.000067, different 0.004379, ratio 65.201.

Clean source
Clean source — seed 3
Attack
Attack — gaussian noise. Severity: severe. Parameters: sigma: 12.0
Different generation
Different generation — seed 0
train · exploratory

Gaussian blur

Optimized W.

DINOv2 attack 0.000040, different 0.004064, ratio 100.877. DINOv3 attack 0.000011, different 0.001501, ratio 132.824.

Clean source
Clean source — seed 0
Attack
Attack — gaussian blur. Severity: medium. Parameters: radius: 1.5
Different generation
Different generation — seed 9
train · exploratory

JPEG compression

Optimized W.

DINOv2 attack 0.000966, different 0.015527, ratio 16.066. DINOv3 attack 0.000004, different 0.000822, ratio 199.410.

Clean source
Clean source — seed 1
Attack
Attack — jpeg compression. Severity: mild. Parameters: quality: 85
Different generation
Different generation — seed 4
train · exploratory

Downsample / upsample

Optimized W.

DINOv2 attack 0.000002, different 0.001410, ratio 726.469. DINOv3 attack 0.000003, different 0.001806, ratio 703.871.

Clean source
Clean source — seed 2
Attack
Attack — downsample upsample. Severity: severe. Parameters: resample: lanczos; scale: 0.35
Different generation
Different generation — seed 1
train · exploratory

Photometric adjustment

Optimized W.

DINOv2 attack 0.000003, different 0.001109, ratio 419.847. DINOv3 attack 0.000000, different 0.000069, ratio 180.405.

Clean source
Clean source — seed 2
Attack
Attack — photometric. Severity: mild. Parameters: brightness: 1.04; color: 1.03; contrast: 0.96
Different generation
Different generation — seed 11
train · exploratory

Affine transform

Optimized W.

DINOv2 attack 0.000891, different 0.003678, ratio 4.126. DINOv3 attack 0.000330, different 0.001364, ratio 4.131.

Clean source
Clean source — seed 0
Attack
Attack — affine. Severity: medium. Parameters: degrees: 4.0; scale: 0.94; translate fraction: 0.03
Different generation
Different generation — seed 4
validation · exploratory

Noise plus restoration

Did not train W; influenced early stopping, checkpoint, restart, dimension, and model selection.

DINOv2 attack 0.000012, different 0.004987, ratio 424.047. DINOv3 attack 0.000040, different 0.000433, ratio 10.878.

Clean source
Clean source — seed 0
Attack
Attack — noise restoration. Severity: medium. Parameters: median size: 3; sigma: 8.0
Different generation
Different generation — seed 1
validation · exploratory

Perspective warp

Did not train W; influenced early stopping, checkpoint, restart, dimension, and model selection.

DINOv2 attack 0.001300, different 0.008448, ratio 6.500. DINOv3 attack 0.000102, different 0.001800, ratio 17.600.

Clean source
Clean source — seed 3
Attack
Attack — perspective warp. Severity: medium. Parameters: displacement fraction: 0.04
Different generation
Different generation — seed 6
final_test · exploratory

Occlusion / overlay

Influenced neither training nor selection; evaluated once.

DINOv2 attack 0.000250, different 0.003010, ratio 12.026. DINOv3 attack 0.000064, different 0.000555, ratio 8.612.

Clean source
Clean source — seed 3
Attack
Attack — Occlusion/overlay (colored box). Severity: severe. Parameters: area fraction: 0.16; opacity: 0.85
Different generation
Different generation — seed 8
final_test · exploratory

Compound social-media degradation

Influenced neither training nor selection; evaluated once.

DINOv2 attack 0.000125, different 0.003754, ratio 30.105. DINOv3 attack 0.000193, different 0.001492, ratio 7.730.

Clean source
Clean source — seed 3
Attack
Attack — Compound social-media degradation. Severity: medium. Parameters: color: 0.86; JPEG quality: 58; long edge: 640; sharpen: 1.15
Different generation
Different generation — seed 9

Caption limitations

Exact collision rate: 0.741. Empty rate: 0.000.

Image/caption semantic-distance Spearman correlations:

Artifacts and provenance

Projection view

Color = prompt. Circle = clean source. Triangle = attacked copy. Cross = different seed. Solid connector = source to attack; dashed connector = source to different seed.

Plots are illustrative selected final-test triplets; quantitative claims come from the complete 150-prompt final-test evaluation.