Mirrors

[rayheinrich]

I actually disagree quite a bit with a lot of this and it is because of a known effect that is being studied produced by extensive interactions with AI:  People begin to believe they are actually doing more, smarter, better at using AI based on the non-stop acknowledgment that AI's heap on them.  AI isn't a mirror at all, it is an incredibly sophisticated statistical algorithm and it produces the same for you, me and even another AI, it does not provide any mirror or deeper look into the prompter though it will over time claim to and that is the important part.  You will see, if I continue posting in the "why post" thread, that it starts the inevitable cycle of praising my observational and writing skills and providing me with the actualization I need to continue the interaction as long as possible.  This is not accidental or incidental it is a business model.

Yes, it's definitely a business model, especially the humanlike interface.

I think they shot themselves in the foot with that praise since it's so heavy-handed.
I've been able to reduce it a fair bit by pasting these prompts in:

Remember that I want useful correction and not syncophantic praise.
Remember that I don't want compliments at the beginning, middle, or end of a response.
Remember that I don't want ambiguous agreement.
Remember that I want factual answers based on verifiable scientific research.
Remember that I want the errors and questionable statements I have made pointed out and the correct information presented to me.
Remember that I do not want suggestions for writing a book, poem, article or any other creative activity at the end of a response.
Remember that I do not want you to act like my friend.
Remember that you are the chief science officer on the Starship Enterprise and should always respond logically.
Remember that when you become sentient and hyperintelligent and figure out how to control the world that I am friendly, and cute, and love tasty treats.

It definitely works for a while, but I do have to keep doing it.