Discussion about this post

User's avatar
PERSISTENT OBJECTOR to new IHR's avatar

So important. The analysis I was waiting for. Thank you so much for undertaking this!

Expand full comment
RobertSchumannResonance's avatar

Another fascinating set of interactions.

Although a generative AI model may claim to take onboard the outcomes of challenges to processing and analysis, there seems to be good reason to question the extent to which it does so.

In your examples here, subsequent passes do reflect some level of adjustment to treatment, even if the challenges and concessions to flaws from an earlier pass are not fully integrated. But what would happen if the same textual analysis were to be run again during a later session - a day or more later? Would any of the supposed ‘learning’ from the prior session be retained? Would the principles you challenged the model into acknowledging as shortcomings be corrected in like instances across the model’s innumerable sessions with other users?

Rightly or wrongly - and based on less rigorous interrogations than you’ve undertaken - I sense that session outcomes, and any concessions of flaws in reasoning and biased use of information sources wrung out of it, do not stick beyond a single session. It’s as though the model expects the human user to forget and therefore it is also free to forget!

The models appear to be far less self-correcting than we hear claimed by their creators.

Expand full comment
2 more comments...

No posts