Lesswrongers go full panpsychism: https://www.lesswrong.com/posts/wCY4oNHpH2HGYGSoP/the-user-in-the-llm-might-be-a-moral-patient-too-a-strange
To try to TLDR this multilayered bit of crazy... lesswrongers already theorize LLMs might be sapient and/or have morally meaningful internal experiences. Except... LLMs obviously "behave" wildly differently when prompted differently and especially when put into different "agent harnesses"... so the big brain follow-up thought is what if the different personas an LLM can exhibit are all different "people" (for the purposes of utilitarian accounting and/or what their internal experiences are like... the exact "theory" can vary by lesswronger). The even more insane full galaxy brain follow-up thought: what if the user's input to the LLM is forming yet another "person", like a copy/reflection/simulacrum of the user!
TLDR for the TLDR: What if not only the LLM was sentient/sapient, but also held a sentient/sapient simulacrum of the user inside!


.