Why is the focus only on identifying AI generated photos? Why not force a tag on all AI generated content period? That would help with a lot of applications.
That was my first thought too. Wasn't there like a checklist for "Why this spam detection scheme will fail" that was floating around since the late 1990s?
The goal is not to protect the general public from misinformation. The goal is to prevent the pool of new training data from getting TOO contaminated with AI generated images, which would make it worthless for training new AI
The tool embeds a digital “watermark” directly into the image that can’t be seen by the human eye but can be picked up by a computer that’s been trained to read it.
Is gonna be helpful for keeping AI generated images out of training sets. It would require the people who make the model to actually implement that tool into their model.
I don’t think most researchers not affiliated with google will chose to do that.
Most major developers of AI generated imagery, at least the corporates, will do it as they share the common interest of not polluting their sample data. Open source imagery might make it optional, but the functionality will be implemented. Either the PRs will be submitted by one of the corporations, or marketing like this article will convince the devs to implement it.
Remember, they don’t need EVERYBODY to implement it. As long as this reduces the amount of unmarked AIgen images by a reasonable percentage, it’s worth doing for them.
Oh, they’ll totally sell the ability to generate without the watermark. Because of course, corporations have never been responsible for spreading disinformation.
I guess they could call it out better, even automatically, but someone further up is suggesting the real goal is to stop AI photos from appearing in future AI training sets, which would be counterproductive.
Seems impractical and likely to cause a different set of problems.
If something like this is added to Stable Diffusion for instance, the OpenSource community will quickly create forks and tools to remove it.
Also seems likely that the Stable Diffusion crowd will create tools to ADD this watermark to images that are otherwise real… thus calling the authenticity of any image into question.
Add comment