Innovation Spotlight: Claude text watermarks will “nudge” its word choices. Should we care?

In a fresh development, this doesn't affect our editorial independence. When you purchase through links in our articles, we may earn a small commission.

Industry observers note that the big question, of course, is whether those watermarks will change the meaning — or lower the quality — of what Claude writes. Soon, Claude will be watermarking all its text outputs, and those watermarks will be invisible, Anthropic has been telling us.

In a fresh development, anthropic gave a nuanced answer to that question in a recently published blog post, arguing that the watermarking method it’s chosen “does not impact the quality of Claude’s output,” although it will nevertheless “nudge” some of the model’s word choices.

Industry observers note that “In internal testing, we’ve seen no impact of watermarking on the content, level of creativity, or readability of Claude’s text.”. “To a reader, a watermarked response is indistinguishable from an unwatermarked one,” Anthropic said.

In a fresh development, claude’s text watermarks, which are coming in response to the recently adopted EU AI Act, will employ a “version” of Google DeepMind’s SynthID-Text process, which “changes the source of the randomness used to pick among words.”.

According to the latest update, as Anthropic explains, Claude’s method of writing is similar to other LLMs: It generates each word one at a time, calculating the probability of each subsequent word and then picking from among the most likely choices.

According to the latest update, for example, if you ask Claude who was the first human on the moon, there will be an obvious best choice for the next word after “Neil.” Similarly, ask Claude what 2 + 2 is, and “4” will be the “very clear best choice” for the next word, Anthropic says. In some cases, such as responses with factual information, there may only be one good choice for a given word.

In a fresh development, but (in an example served up by Anthropic), when generating a sentence about a cloudy weather forecast, Claude might have a range of likely next words in the sentence “It’s going to be a…” The word “grey” could be a top choice with a 30-percent probability (I’m making that percentage up for argument’s sake), as well as “overcast” with a 28-percent probability.

According to the latest update, even without watermarking, Claude won’t necessarily pick the word “gray” just because it has a higher probability ranking than “overcast.” In a close contest like this one, the word Claude eventually chooses comes down to a roll of the dice.

As part of the ongoing story, that nudge isn’t enough to change a Claude answer to, say, “Neil Smith” for the “who took the first steps on the moon” question, but it could affect whether Clause says it’s a “gray” day or an “overcast” one. It’s in close (and “low-stakes”) cases like those where Claude watermarking would come into play, with the watermarking process giving a “nudge” in one direction or another, according to Anthropic.

The report highlights that and while Claude won’t (or shouldn’t) alter a critical bit of code for a watermark, it might tweak a word choice in “low-stakes” portion, such as a comment in the code, Anthropic says.

As part of the ongoing story, users will be able to spot those watermarks using a “detection API” that’s still in the works, the publisher noted. Given a large enough sample, those subtly different word choices can become detectable as Claude watermarks, and those watermarks can survive a copy-paste and even “light editing,” Anthropic says.

As part of the ongoing story, so, back to the original question: Do we care that Claude’s watermarks will affect its word choices, even if the “nudges” are subtle ones?

The report highlights that for the purpose of embedding hidden clues within the text to suggest its provenance,” Gruber writes. “The idea that anything other than my needs should factor into the generation of text for me is patently offensive.”. Apple observer and Daring Fireball writer John Gruber, for one, took Anthropic to task for the fresh watermarking policy, “It’s unacceptable for a tool to sacrifice an iota of clarity, coherence, meaning, quality, etc.

According to the latest update, but will Claude watermarks actually make its text generation worse — or worse than it already is? Personally, I agree with Gruber’s sentiment: I wouldn’t want Anthropic throttling my Claude output quality so it can comply with a regulatory mandate.

Industry observers note that watermarks or no, the manner in which AI synthesizes text and samples its word choices are what makes AI writing sound like AI, and it’s also what leads to mistakes. The whole issue of watermarking does make us look closer at how the sausage is made in terms of AI text generation, and it’s not pretty.

According to the latest update, put another way, human writers sweat the details, while AI models simply roll the dice. Consider this: While humans may agonize over the next word, weighing the meaning, the nuance, and even the cadence of the syllables, Claude, ChatGPT, and Gemini are instead poring over probabilities before ultimately making a random choice among the likeliest options.

The report highlights that (Anthropic says it’s in the process of adding watermarking support to fresh and existing Claude models.). We’ll have to wait for Claude watermarking to kick into gear before we can really assess how those watermarks affect the output.

As part of the ongoing story, we’ll find out soon enough. But if AI watermarking nudges Claude’s roll toward “gray” rather than “overcast,” did that watermark make the output worse, or just a different shade of meh?

As part of the ongoing story, his coverage of artificial intelligence interrogates the most recent LLMs, and how they can be used at work and at home to be best prepared for the AI revolution. “AI is going to change our lives sooner than we think,” Ben writes. “Our best way to adapt is by using it every day.” Ben has been a PCWorld author since 2014, and has covered everything from laptops to security cameras before launching PCWorld’s AI beat. Ben's articles have also appeared in PC Magazine, TIME, Wired, CNET, Men's Fitness, Mobile Magazine, and more. Ben holds a master's degree in English literature. Ben has been writing about consumer technology for more than 20 years, and now focuses his reporting on AI as it relates to the basic human experience.