Reproducible canvas-aligned low-level patterns in somerandomllm-generated images and their possible relation to iterative editing artifacts [D]
Mirrored from r/MachineLearning for archival readability. Support the source by reading on the original site.
| I may have stumbled onto something interesting while trying to figure out a recurring artifact in ChatGPT image generation and editing (maybe applicable to other models as well?). It started with a very practical problem: After several rounds of generative editing on portraits, I would sometimes get this faint cloudy / mottled texture in areas that should have stayed smooth — backgrounds, walls, skin, and other low-detail regions. At first I wrote it off as normal denoising or regeneration noise. But the more I tested it, the less random it looked. What first caught my attention
That made me wonder whether different parts of the image were being handled differently during editing — preserved in some areas, regenerated in others, perhaps based on some internal mask or segmentation step. The first useful experiment: shifting the imageThen I tried something slightly odd. Instead of repairing the image in place, I shifted the entire image by a fixed amount before running the repair. I eventually settled on 20 px for testing. The idea was simple: If some hidden spatial pattern is tied to the output canvas, moving the image relative to that pattern should change how strongly it shows up on the subject or background. And apparently, it did. I found that:
That was the first point where this stopped looking like ordinary random noise to me. Then I started looking at masks and intermediate behaviorI compared:
One thing stood out pretty clearly: The apparently “protected” area often resembled a coarse silhouette of the person. The face and body tended to remain more stable than the wall, which made me suspect that some regions were being preserved while others were being re-synthesized. That still didn’t explain the artifact itself, but it could explain why the artifact builds up unevenly. Then came the black-image testI tried something much simpler: Generate a completely black image. Visually, it looked black. Pixel-wise, though, it wasn’t actually all zeroes. There were sparse non-zero pixels and tiny variations throughout the image. So I generated multiple independent black images at the same resolution and compared them. This. It's a different one, I swear! Or this. A \"completely black image\". That’s where things got interesting. What I foundFor two independently generated “black” images of the same size:
Then I applied a large Gaussian blur to both images (sigma = 16). The result was surprisingly striking: both revealed a very similar large-scale cloud-like structure. Both \"completely black\" images The cross-correlation peaked at zero lag, meaning the structured pattern was already aligned at the same canvas coordinates across independent generations. So whatever this low-level signal is, it doesn’t look purely random. At least part of it appears to be reproducible and locked to the canvas coordinates. What I think this means — so farI want to be careful here. I’m not claiming that this proves OpenAI watermarking, SynthID, or any particular proprietary mechanism. What I do think the data suggests is this:
A few possible explanations come to mind:
What now seems much harder to explain this as is simply:
Why this might matter for iterative image editingSuppose a weak structured signal really is tied to the output canvas. An iterative edit might then look something like this:
That would fit several things I’ve observed:
Important caveatThis is still an investigation, not a conclusion. At this point I think I have reasonably good evidence for:
What I don’t have yet is proof of:
My current working hypothesis
Questions for anyone who has looked into this
If there’s interest, I can post the methodology in a follow-up. I started with:
and somehow ended up at:
Classic rabbit hole. [link] [comments] |
More from r/MachineLearning
-
TMLR Relevance and Prestige [D]
Aug 13
-
worldproof: diagnosing where world-model predictions break and a measurement of when pixel metrics stop being able to rank models at all [P]
Aug 13
-
UrgenT Help Detecting Performance Regressions Using Machine Learning and Hardware Counters [P]
Aug 13
-
Recommended Machine Learning / AI Academic Papers [R]
Aug 13
Discussion (0)
Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.
Sign in →No comments yet. Sign in and be the first to say something.