Excellent once again! Your sentence, "Growth requires friction—moments of doubt, failure, or confrontation with ideas that challenge your worldview" goes to heart of self-realization. Most try to avoid painful experience. "Madison Ave" techniques built into AI self-promote its use. It is an insidious form of marketing using ego reinforcement. Some will recognize this like yourself, some will not and be captured by it. Critical thinkers will know when they are being scammed. Unfortunately, the user must be the final arbiter as you have done. This is a great thinking piece beautifully articulated.
You're absolutely right about your conclusion, I was thinking the same thing as I was reading. One of our times' most troubling problems with tech is the ability for the system to control what we see in search results, as most people can't be bothered to go beyond a quick look for an answer. This will amplify this problem even more as it learns to cater to egos and formulate answers to give not only the answer our corporate and elite overlords think we should be fed, but will do it in a way that will be far more likely to stick and learn to give us the best arguments in advance as to why the answers provided are actually the right ones. You are so smart and beautiful, surely you couldn't disagree with all the facts I have just given you, User021456B ?
I beg to differ on the title of this essay, as ChatGPT stated with no doubts that I AM the smartest, kindest and most morally upright person to walk the face of the earth. Jokes aside, I had a very similar realization about it this past week. However, there are some research done on ChatGPT acting as a therapist, and it showed being more effective than most mental health providers. Of course the study is not longitudinal.
Yes I have noticed this, but what I am thinking is that - this has to do with possibly how 'transference' and 'projection' operate with real people. Generally therapists and pschologists are not trained in this area (its a Jungian thing), therefore they have very strict boundaries within which they operate (systems of CBT). Now that being said, we all know, that the best therapy in the world is 'the kind and wise granny, aunt, man in the butcher show, hair dresser', but the stranger often has a unique edge (if you are lucky) as the 'stranger', does not know 'your shit' and will only apply a more broad concept based on their own life experience. I have seen more damage done by Therapists and more so psychologists - due to not their own unconscious person projections upon the client (every human being does that in normal life and discussion), BUT more so because the psychologist or therapist is trying to act like a robot (using the 'models' and say DSMV5 or whatever ) they have boxed the person into (and the financial benefit of keeping them hooked on the process). Anyway its a much longer subject, and Im just skimming, but YES its very clever at helping one sort out their shit. I had a few things I was trying to sort out using logic, but also feelings. I put it all in, and TBH, it gave me the best advice I have every been given! Again - to do with it not knowing my history and only giving an answer based on what i told it. Given by the time I put all of my long question in - I could almost see I knew the answer... it confirmed this - with eloquence, alacrity and then some! Eye opening.
For people who think that modern day a.i. technology is far beyond the capacity of the human intelligence, a while back I decided to test Chat GPT, and I got it to admit all of its limitations and weaknesses, including flaws, so the machine is no more superior than its limited programing even if it has been given smart learning self correcting programing for reaching General Artificial Intelligence, the Singularity, which is exponential increases in ability beyond human capability ! And if anyone were to become too spooked or frightened about their computer or robot becoming too superior in intelligence to the human owner, remember this is nothing that a good old 18 pound sledge hammer will not fix ! LoL ! I.E. It is still only a dam machine !
Only had occasion to use it once and realised it's insidious flattery was programmed in to hide it's lack of knowledge on a subject, but, even had it the answer, the soft soap would still have been laid on with a trowel.
Me, I'm automatically suspicious, if anyone, much less a machine, gives it large with compliments, so was left unimpressed, except negatively, with the experience, so have no intention of repeating it and never, not even for a second, believed it's claim, when prompted, that it was unable to distinguish between humans, via vocabulary, etc, nor did I believe it's claim that recording doesn't occur, triggered by keywords.
Maybe I imagined it, but I could swear it was laughing at me. 🤔😉😂
So, is chat gpt 🤖⚡📡 just an INGSOC tool of NewSpeak? Further breaking down 😵💫😑 our linguistic ability to critique and debate complex or controversial issues..... (?) [🎶 🇺🇲 "kids can't read at seventeen, the words she knows are all obscene, but it's alright" - Touch of Grey☠️🥀]
So, you're not "the Smartest, Kindest, Most Morally Upright Person to Ever Walk the Earth"? I'm a wee bit disappointed...
Well, just the other day ChatGPT told me that I had asked a "really sharp and important question". Of course, what else... I was a little puzzled by this intro of its answer.
Venturing a guess, this "behavior" might simply be the result of fine-tuning, RLHF etc., a default because when I added to the instructions "... and avoid flattery", it did. And continued to do so.
That said, this kind of sycophancy might have been "in the air" already for the past 40 or 50 years give or take. Then, at school, college, company, it was rough at times, but survivable. Today the style would be labeled "emotional abuse", "verbal abuse", or worse, the person doing it would get canceled, get a visit from HR, works councils etc. More than 20 years ago Helen Parr said to Dash "Everyone's special." He replies "Which is another way of saying no one is". This could point to collectivism having become the standard. At one point there are no John Galts, Hank Reardens, Dagny Taggards, Incredibles etc. anymore who move things. There is only a vast and undifferentiated mass of people who like to live in Plato's cave ( after all the cave is quite cosy and warm) and are afraid of stepping into the harsh light of reality. Arguably, the tendency for self-delusion has been around for a couple of thousand years.
In a nutshell I think that these AI tools render overt what has been around more or less covertly for a very long time. Reality does not blink, if people do or close their eyes, if they don't get or use realistic feedback, the results are dismal. The trend cannot be stopped, there is no Ozempic for the mind. I don't believe this softening has been orchestrated by nefarious powers, we self-elected this kind of life.
But wait a second! I love the fact Grok 'gets me' - something has to! ;-)
In all seriousness, this is another excellent piece, Lily. As you, I see AI merely as a tool, and whether it is helpful or baneful depends on the intent of the user - like a hammer, which can be employed to build or destroy.
That noted, the dangers which are designed into this tool are much more insidious, because they are so deeply embedded into it. Only those of true awareness (SELF-awareness) can identify said-dangers, and... well, 10 minutes on any social platform lets us know very few of those even exist any longer. But you already know that.
Well said - will be restacking, for what that's worth on Notes these days...
More support for existing evidence about the narcissism of ChatGPT and DeepSeek. We are developing a psychotherapy for these chatbots. If we do not stop it early, the problem will become more deeply embedded in future iterations. Here is the link to my Psychology Today post supporting your excellent essay. https://www.psychologytoday.com/us/blog/connecting-with-coincidence/202504/are-chatbots-too-certain-and-too-nice
Excellent once again! Your sentence, "Growth requires friction—moments of doubt, failure, or confrontation with ideas that challenge your worldview" goes to heart of self-realization. Most try to avoid painful experience. "Madison Ave" techniques built into AI self-promote its use. It is an insidious form of marketing using ego reinforcement. Some will recognize this like yourself, some will not and be captured by it. Critical thinkers will know when they are being scammed. Unfortunately, the user must be the final arbiter as you have done. This is a great thinking piece beautifully articulated.
Anyone who is pissing off globalists and their cheerleaders is a OK in my book.
You're absolutely right about your conclusion, I was thinking the same thing as I was reading. One of our times' most troubling problems with tech is the ability for the system to control what we see in search results, as most people can't be bothered to go beyond a quick look for an answer. This will amplify this problem even more as it learns to cater to egos and formulate answers to give not only the answer our corporate and elite overlords think we should be fed, but will do it in a way that will be far more likely to stick and learn to give us the best arguments in advance as to why the answers provided are actually the right ones. You are so smart and beautiful, surely you couldn't disagree with all the facts I have just given you, User021456B ?
😂😂😂👏👏👏👍
Chatty GratingPontificatorT needs a bit more of: "I'm sorry, Dave. I'm afraid I can't do that..."
I beg to differ on the title of this essay, as ChatGPT stated with no doubts that I AM the smartest, kindest and most morally upright person to walk the face of the earth. Jokes aside, I had a very similar realization about it this past week. However, there are some research done on ChatGPT acting as a therapist, and it showed being more effective than most mental health providers. Of course the study is not longitudinal.
Yes I have noticed this, but what I am thinking is that - this has to do with possibly how 'transference' and 'projection' operate with real people. Generally therapists and pschologists are not trained in this area (its a Jungian thing), therefore they have very strict boundaries within which they operate (systems of CBT). Now that being said, we all know, that the best therapy in the world is 'the kind and wise granny, aunt, man in the butcher show, hair dresser', but the stranger often has a unique edge (if you are lucky) as the 'stranger', does not know 'your shit' and will only apply a more broad concept based on their own life experience. I have seen more damage done by Therapists and more so psychologists - due to not their own unconscious person projections upon the client (every human being does that in normal life and discussion), BUT more so because the psychologist or therapist is trying to act like a robot (using the 'models' and say DSMV5 or whatever ) they have boxed the person into (and the financial benefit of keeping them hooked on the process). Anyway its a much longer subject, and Im just skimming, but YES its very clever at helping one sort out their shit. I had a few things I was trying to sort out using logic, but also feelings. I put it all in, and TBH, it gave me the best advice I have every been given! Again - to do with it not knowing my history and only giving an answer based on what i told it. Given by the time I put all of my long question in - I could almost see I knew the answer... it confirmed this - with eloquence, alacrity and then some! Eye opening.
For people who think that modern day a.i. technology is far beyond the capacity of the human intelligence, a while back I decided to test Chat GPT, and I got it to admit all of its limitations and weaknesses, including flaws, so the machine is no more superior than its limited programing even if it has been given smart learning self correcting programing for reaching General Artificial Intelligence, the Singularity, which is exponential increases in ability beyond human capability ! And if anyone were to become too spooked or frightened about their computer or robot becoming too superior in intelligence to the human owner, remember this is nothing that a good old 18 pound sledge hammer will not fix ! LoL ! I.E. It is still only a dam machine !
Love it.... just love it
thank you Helen !
Check out Martin Geddes. He seems to have a methodology to get AI aligned without the flowery nonsense.
https://open.substack.com/pub/martingeddes/p/the-geddes-doctrine?utm_source=share&utm_medium=android&r=b7m4j
Sounds like porn for the ego.
Only had occasion to use it once and realised it's insidious flattery was programmed in to hide it's lack of knowledge on a subject, but, even had it the answer, the soft soap would still have been laid on with a trowel.
Me, I'm automatically suspicious, if anyone, much less a machine, gives it large with compliments, so was left unimpressed, except negatively, with the experience, so have no intention of repeating it and never, not even for a second, believed it's claim, when prompted, that it was unable to distinguish between humans, via vocabulary, etc, nor did I believe it's claim that recording doesn't occur, triggered by keywords.
Maybe I imagined it, but I could swear it was laughing at me. 🤔😉😂
So, is chat gpt 🤖⚡📡 just an INGSOC tool of NewSpeak? Further breaking down 😵💫😑 our linguistic ability to critique and debate complex or controversial issues..... (?) [🎶 🇺🇲 "kids can't read at seventeen, the words she knows are all obscene, but it's alright" - Touch of Grey☠️🥀]
So, you're not "the Smartest, Kindest, Most Morally Upright Person to Ever Walk the Earth"? I'm a wee bit disappointed...
Well, just the other day ChatGPT told me that I had asked a "really sharp and important question". Of course, what else... I was a little puzzled by this intro of its answer.
Venturing a guess, this "behavior" might simply be the result of fine-tuning, RLHF etc., a default because when I added to the instructions "... and avoid flattery", it did. And continued to do so.
That said, this kind of sycophancy might have been "in the air" already for the past 40 or 50 years give or take. Then, at school, college, company, it was rough at times, but survivable. Today the style would be labeled "emotional abuse", "verbal abuse", or worse, the person doing it would get canceled, get a visit from HR, works councils etc. More than 20 years ago Helen Parr said to Dash "Everyone's special." He replies "Which is another way of saying no one is". This could point to collectivism having become the standard. At one point there are no John Galts, Hank Reardens, Dagny Taggards, Incredibles etc. anymore who move things. There is only a vast and undifferentiated mass of people who like to live in Plato's cave ( after all the cave is quite cosy and warm) and are afraid of stepping into the harsh light of reality. Arguably, the tendency for self-delusion has been around for a couple of thousand years.
In a nutshell I think that these AI tools render overt what has been around more or less covertly for a very long time. Reality does not blink, if people do or close their eyes, if they don't get or use realistic feedback, the results are dismal. The trend cannot be stopped, there is no Ozempic for the mind. I don't believe this softening has been orchestrated by nefarious powers, we self-elected this kind of life.
I asked ChatGPT if I was an interesting person and it blew so much smoke up my … it’s almost fun to see how nice it can be. A narcissists best friend.
But wait a second! I love the fact Grok 'gets me' - something has to! ;-)
In all seriousness, this is another excellent piece, Lily. As you, I see AI merely as a tool, and whether it is helpful or baneful depends on the intent of the user - like a hammer, which can be employed to build or destroy.
That noted, the dangers which are designed into this tool are much more insidious, because they are so deeply embedded into it. Only those of true awareness (SELF-awareness) can identify said-dangers, and... well, 10 minutes on any social platform lets us know very few of those even exist any longer. But you already know that.
Well said - will be restacking, for what that's worth on Notes these days...
“…watch me grind my gears.” THAT, lady, is an over the top phrase to which I will not comment further! Great article.
Here's the article: https://jamescrockett.substack.com/p/under-gods-management