ELIZA is an oft referenced early chatbot developed in the 1960's. The legend behind it is that the simplistic chatbot was so convincingly human to early users that they supposedly forgot it was a computer and spilled their deepest secrets to it. E.g. these quotes from the Wikipedia article:
However, many early users were convinced of ELIZA's intelligence and understanding, despite Weizenbaum's insistence to the contrary.
Reference: Baranovska, Marianna; Höltgen, Stefan, eds. (2018). Hello, I'm Eliza fünfzig Jahre Gespräche mit Computern (1st ed.). Bochum: Bochum Freiburg projektverlag. ISBN 978-3-89733-467-0. OCLC 1080933718.
The algorithms of DOCTOR [ELIZA] allowed for a deceptively intelligent response, which deceived many individuals when first using the program.
Reference: Wardip-Fruin, Noah (2014). Expressive Processing: Digital Fictions, Computer Games, and Software Studies. Cambridge: The MIT Press. p. 33. ISBN 9780262013437 – via eBook Collection (EBSCOhost).
Some of ELIZA's responses were so convincing that Weizenbaum and several others have anecdotes of users becoming emotionally attached to the program, occasionally forgetting that they were conversing with a computer. Weizenbaum's own secretary reportedly asked Weizenbaum to leave the room so that she and ELIZA could have a real conversation.
Reference: Weizenbaum, Joseph (1976). Computer Power and Human Reason: From Judgment to Calculation. New York: W. H. Freeman and Company. ISBN 0-7167-0464-1.
The source given for the first quote is a book in German so I can't look into. The second one is a book which is at best a secondary source and mostly a tertiary source. The third is a primary source, but like all other primary sources I've been able to find, the source is the inventor of the chatbot himself, Joseph Weizenbaum. While Weizenbaum seems to be a potentially reliable source, he certainly had a vested interest in the ELIZA being a particularly engrossing computer program.
The story of ELIZA as a tale of how easily humans are duped into believing an obviously dumb computer program is actually intelligent has spread pretty wide at this point. While I certainly believe that people found ELIZA an interesting bit of software, I have trouble believing the more outlandish claims of people becoming "emotionally attached" to the program and believing it to be intelligent.
Is there any good evidence for these stronger claims about the so-called ELIZA effect, where people strongly anthropomorphized ELIZA and had powerful emotional reactions, besides the claims of Weizenbaum himself?
Note: Sherry Turkle's The Second Self has some relevant passages in the first chapter, on p. 40. I find the framing around the passages, which seemingly report on the experiences of some individuals with ELIZA, to be somewhat odd. Who the people who's experience she's relating, when the experiences happened, how many they were, and in what context they had this experience are all left vague. Further, the book was published a good 20 years after the creation of ELIZA, so well after the legend had already formed.