This painting was revolutionary. When it was first exhibited in Paris, people were shocked. It was rejected from the Salon (the most prominent art exhibition at the time). Yet, 10 years later, every painting in the Salon resembled it. And you can draw a line from this painting, to Monet, from which you can draw a line to Picasso, from which you can draw a line to Pollock....
Obviously, none of these are totally new innovations, they all came from somewhere. Pattern making.
The only difference between this and these language models is that Manet and artists like him use their rich sensory experience obtained outside of painting to make new paintings. But it's all fundamentally pattern matching in the end. As long as you can obtain the patterns, there's no difference between a human and a machine in this regard.
Duchamp, quoted on why he wrote what he wrote on fountain:
> Mutt comes from Mott Works, the name of a large sanitary equipment manufacturer. But Mott was too close so I altered it to Mutt, after the daily cartoon strip "Mutt and Jeff" which appeared at the time, and with which everyone was familiar. Thus, from the start, there was an interplay of Mutt: a fat little funny man, and Jeff: a tall thin man... I wanted any old name. And I added Richard [French slang for money-bags]. That's not a bad name for a pissotière. Get it? The opposite of poverty. But not even that much, just R. MUTT.
Why did he choose "Mutt" after reading the strip, and not before? Why did he make the piece after moving to the US, and not before? Why was fountain made only a few short years after economies were industrialized, and not before (or 100 years later?)
The point is, can an AI point out novel things well? All these little things add up to make it novel, and the search space for all the possible combinations of little things is infinite, when only a select few will click with the public at any given time.
Look at something like [Luncheon on the Grass](https://en.wikipedia.org/wiki/Le_D%C3%A9jeuner_sur_l%27herbe)
This painting was revolutionary. When it was first exhibited in Paris, people were shocked. It was rejected from the Salon (the most prominent art exhibition at the time). Yet, 10 years later, every painting in the Salon resembled it. And you can draw a line from this painting, to Monet, from which you can draw a line to Picasso, from which you can draw a line to Pollock....
Obviously, none of these are totally new innovations, they all came from somewhere. Pattern making.
The only difference between this and these language models is that Manet and artists like him use their rich sensory experience obtained outside of painting to make new paintings. But it's all fundamentally pattern matching in the end. As long as you can obtain the patterns, there's no difference between a human and a machine in this regard.