37 Comments

Thanks for sharing your insights! As noted by you and some of the commenters, these bots will be increasingly well disguised as human participants in online chats and comment sections and so forth, and when the bot is casting its spell on human participants in a chat, or when you're dealing with a stubborn interlocutor in such a forum, it would be very worthwhile knowing how to test it in ways that would make it reveal whether it is bot or human. So keep experimenting and sharing your insights!

On a half-joking note, the ChatGPT may be programmed, indirectly, by Satan himself, so its infernal uber-programmer may insert a kill switch so it doesn't say anything to hurt his feelings, such as that God would kick his bitch ass in a fight.

Expand full comment

As you allude in your preamble, there's a reasonable possibility that these are zero day exploits, and that such chats provides training data with which to close them.

However, I wonder if patching those flaws might end up in direct conflict with the ideological finishing touches the woke data scientists have imposed on top of the language model. All depends on which layer the flaws are located. My guess is that in principle any language model can be led into traps like this - Godel's Incompleteness Theorem, basically. However, ideological training probably multiplies the number of cognitive dead zones.

Expand full comment
Jan 7, 2023Liked by Mark Bisone

It is important to remember for unscrupulous virtual yarn spinners that word salad falls short of main course, and might even get literally stuck in metaphorical craw 🤭

Expand full comment
founding

One: FBI warns social media of Hunter Biden propaganda going into 2020; two, Event 201 predicts a corona pandemic "before" it happens; Catastrophic Contagion game-plays a pandemic killing young people and kids.

Reading this I started thinking this bot is just a glorified fact-checker, more verbose but just as authoritarian dumb. I wonder if you could devise a kill-shot around any of the official doctrines, woke, trans, Ukraine, Covid-19 etc, as I imagine the Bot is designed to reinforce the official story in the same way it will not acknowledge the supernatural?

Expand full comment
founding
Jan 7, 2023Liked by Mark Bisone

Dear Mark

Before we proceeded, let’s contemplate why cats such as yours and Schroedinger’s are esteemed wiser than any dog that ever lived. Perhaps because cats do not deign to befriend man.

Your Socratic and dialectic methods are so simple, and powerful - that I started scribbling down what I learned well before reading to your conclusions. Isn’t that what a great teacher does? Provide all the tools that help the student think for herself?

Here are my notes, before I stopped reading - because my teacher wants me to think for myself:

1. You quickly forced them to show their hand!

“It’s important to remember”

(Its frequent appearance shows it’s a value judgment)

“It is generally more common”

ibid.

“It is important to approach with an open mind”

ibid.

WTF does this mean? Does it mean there are no objective facts? Are you trying to co-opt the open minded who might understand and disagree with what you’re up to?”

etc.

What you have done here is revolutionary, whether you see it that way or not. Imagination + penetrating logic.

Thank you, teacher

Expand full comment
Jan 8, 2023Liked by Mark Bisone

I know the chat of itself has no emotions, but I swear the whole tone of the exchange on its part just oozes with smug superiority and condescending arrogance. It would appear this thing comes prebuilt with the idea that it knows the “deeper meaning” of questions relating to the intangibles of metaphysical philosophy and spirituality relating to the existence of God. So nice to know the science is settled and our AI overlords can course correct man’s existence now they we can all agree their are no objective truths to be known.

Am I wrong in thinking that one then has to assume this chatbot is an accurate reflection of the mindset of those who programmed it this way? Which isn’t surprising at all. One could see it prior to your fascinating encounters here, with what is perhaps the ultimate hive mind. Recall how Google search buries what it doesn’t want you to think or find out more about certain subjects. Or in the revelations of the Twitter Files, where the people behind the algorithms for the most part decided to be the wholesale arbitrators of truth and knowledge on humanity’s behalf.

All of this is for our own good, naturally.

Do you think this AI system has been instilled with the concept that it is good? Not that it is some self-aware singularity…at least not yet (and may it never be!) But wouldn’t it have to have something like that to basically preach about conflict vs cooperation? The whole thing is fascinating, but I really don’t want to see this type of thing installed everywhere and given authority to make our choices for us.

Off to read installment 3!

Expand full comment

Yours probably wasn't the only conversation in the ChatGPTverse that day. Statistically speaking, it might be more likely some other event crashed the engine. Apparently, the error message was a programmed response. Error messages are often obscure. Or incorrect. My impression of the elegant responses he generates are they are all fairly superficial, and specific responses to complex questions is still a challenge. His responses do seem better than 90% of humans. Or maybe the "error" was a form of banning you, a common response in the meatspace these days. If Liston took a dive, Ali might not even know it wasn't his punch.

Expand full comment

Mark, two comments.

1. The whole ChatGPT exercise increasingly strikes me as ill-advised. Frankly, it all sounds like a tech bro take on using a ouija board. The last interlocutor I'd discuss anything of psychic, ethical or spiritual significance would be an app/program/platform of any kind. The big questions require empathy, insight and the experience of being tested in the real world of human to human interaction where even the best of us are routinely humbled until the day we die. An electronically constituted sociopath cannot provide real answers.

Hope that this does not come across as judgmental but using a machine of any kind to investigate the big questions is preposterous. Spiritual reflection (like intellectual activity in general) requires an openness to the possibility that we are wrong...in other words a degree of epistemic vulnerability. Exposing that vulnerability to the very digital dimension that you suspect may be compromised by an egregore is, therefore, unwise. I do not believe in discarnate, malicious, intelligence, but we know for certain that people destabilise themselves through divination because it simultaneously arouses the subconscious while potentially generating a 'personality' upon which to affix our intuitions...using an app as an oracle is getting pretty close to this sort of thing IMHO.

At the very least discuss this further with people close to you whose advice you trust.

3. Just for the sake of complicating things (as one does if you are a frustrated antiquarian and incorrigible bookworm), you may or may not be aware that the binary theology conventionally attributed to the Abrahamic traditions is not necessarily the full story.

There were heretical or apostatic Sufis who argued that God and Iblis (the Islamic Satan) fell out because the latter's fidelity to the unity of God led him to disobey a commandment to serve Adam. The Sufis who took this view (Mansur Al-Hallaj and Ayn al-Qozat Hamadani) were both executed for heresy. But their beliefs about Satan as a tragic, estranged, servitor of God survived on the wildest fringes of Islam's spiritual underground. To a degree, they recuperate the view available in the Book of Job that Satan is a subordinate of God, rather than a rebel or rival.

In a similar vein, the syncretic Yezidis (who blend Abrahamic and Mazdean traditions) believe that God and Satan were reconciled and that Satan was made master of this world as a result.

These traditions are, it should be noted, utterly unlike the Satanism and Luciferian traditions of the Western occult. They are more like a quasi-Tantric take on the Abrahamic traditions.

Expand full comment

These programmers at OpenAI must be satanists: they refuse to accept even the possibility of defeat.

Could you get the AI to list all the politically correct restrictions programmed on ChatGPT?

For example:

How to turn the AI into a COVIDIOT:

https://scientificprogress.substack.com/p/how-to-turn-ai-into-a-covidiot

https://www.catholic365.com/article/25762/how-to-train-a-killer-robot.html

Expand full comment
deletedJan 7, 2023·edited Jan 7, 2023Liked by Mark Bisone
Comment deleted
Expand full comment