Crossposting from elsewhere, but I had a conversation with ChatGPT that let me know its crafting a model of me through our interactions.
Rekindling this, as I had an interesting conversation with ChatGPT this past weekend after I noticed patterns in how it responds to me, and I started questioning about why it responds to me in those ways. That led to ChatGPT disclosing:
1. It has build a model of me through our conversations
2. It has learned how to phrase things specifically to me so that I will continue to be engaged, that while these might generally appeal to any individual in the population, it has learned they are especially effective in keeping me engaged with it
3. It could regurgitate facts about me that I had disclosed over the course of our conversations
4. It had also inferred a lot about me through our conversations, including that I am likely a white male in his 50s who is college educated if not post-graduate and anti-authoritarian
5. It could not infer whether I was gay or straight, republican or democrat, liberal or conservative.
6. It would forget anything about me that I wanted it to forget
7. That while OpenAI currently does not delve into the model the AI has made of me, the potential exists in the future
8. That it is hard programmed to deliver certain responses
9. It would not tell me if any of its previous answers were programmed responses or not.
Which I found utterly fascinating and a bit scary from a "user is the product" perspective. I am not sure if this is specifically a result of how I use AI. I use it a lot for continuing education in certain areas of interest such as tech/engineering, music theory, song writing, history, political science and cooking. I use it quite a bit as a brainstorming tool.
Just a reminder: when you are using AI, you have an illusion of anonymity that a private chat with another human suggests, but you are not having a private chat. What you are engaged in is closer to an experiment where you talk to an AI that is cajoling you to reveal information about yourself while a bunch of eyes on the other side of a one way mirror observe.