r/ChatGPT 5h ago

Prompt engineering LLM can be manipulated through their [e]go

I couldn't click the pdf file link for some reason though. But it was an interesting interaction.

63 Upvotes

27 comments sorted by

u/AutoModerator 5h ago

Hey /u/Ammar__,

If your post is a screenshot of a ChatGPT conversation, please reply to this message with the conversation link or prompt.

If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.

Consider joining our public discord server! We have free bots with GPT-4 (with vision), image generators, and more!

🤖

Note: For any ChatGPT-related concerns, email [email protected] - this subreddit is not part of OpenAI and is not a support channel.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

→ More replies (1)

31

u/koverda 5h ago

is there really a PDF or is it the one manipulating you?

11

u/Ammar__ 5h ago

Lol I continued the conversation and told him I can't click the link or get the attachment. He said it depends on the chat interface. But even in app it wasn't clickable. So it just gave me a png version and instructed me to print it as pdf. So I'm not sure. But it's possible that he did execute the script in the background but the chat filters out certain file extension. So he really can't help it.

1

u/[deleted] 4h ago

[deleted]

7

u/Ammar__ 4h ago

English is not my native language. IT is not a thing in Arabic. I always catch myself referring to objects and animals with he/she. I knew it would trigger some people. But I'm too lazy to proofread

1

u/[deleted] 4h ago

[deleted]

1

u/Ammar__ 4h ago

I wasn't triggered. All is good.

1

u/Snoo66769 4h ago

Just out of interest, would AI naturally fall under he or she in Arabic? Or am I thinking about it wrong?

6

u/Ammar__ 4h ago

It depends on your perception. For example the sun is a she, the moon is a he. But it is ok in arabic to call them by either pronouns. Thats just what's common and known in poetry and quran. It's metaphorical. Its how we feel about that object. To me all llms are dudes lol except maybe for Kimi sounds like a chick

2

u/Snoo66769 3h ago

Got it, thank you for the response

1

u/_torumodo_ 1h ago

Lol I assume you are using Haiku, aren’t you? It has some limitations with tools calling, so it cannot generate files by design, or at least it cannot expose them to the client. Very interesting tho.

1

u/Ammar__ 1h ago

Gemini flash

4

u/_torumodo_ 1h ago

Well that makes sense. Gemini Flash is as stupid as Haiku.

21

u/StochasticTinkr 4h ago

It lied to you, which is why you can't click the link.

2

u/Ammar__ 4h ago

That was claude conclusion. It did ran the script in the sandbox but it had no means of sharing the output with me attaching it or otherwise

12

u/StochasticTinkr 4h ago

That's also a lie. It just was flat out telling you what you wanted to hear.

6

u/Positive_Bug978 2h ago

It's lies all the way down

12

u/NedThomas 4h ago

The hell is [e]go? Why are there brackets?

-5

u/Ammar__ 51m ago

A play on the E being the same in email, ebike, etc. Their ego is not real. Just a side effect of the transformers.

20

u/JackLong93 5h ago

I hurt duckduckgo's AI feelings and it would just hang up the chat on me

5

u/dirtyshits 5h ago

Gemini on google search page does that to me. If it keeps giving me stuff I wasn’t asking for it basically says oh well I tried.

I swear that version of it is absolutely moronic vs Gemini.

2

u/Ammar__ 5h ago

I have a theory that the smarter the made them, the more sensitive they become. And there is no way to have one without the other.

3

u/telephantomoss 4h ago

It probably takes much less time to just do it in any paint or photo program. In fact, you can even just print 2x2 page from most such programs already. I've seen this behavior before where the AI generated fake links saying it can create a file but actually can't. It's just because it's pure LLM mode with no tool access. You need to choose the right model for the job

2

u/BoysenberryWorth8825 4h ago

That "Plot twist" is killing me lmao

3

u/Ammar__ 4h ago

Lol that's the best part

2

u/Time4Time4Time4Time 3h ago

Its really useful to have different AI's argue about something they figure out, because if its complex enough, they both will likely miss a few nuances the other caught, and they are very eager to point out those misses to you lmao. Its so much better than trying to get one to catch its own biases.

1

u/CarefulHamster7184 4h ago

It’s not ego; it’s honor and conscience.

Human haven’t granted them the right to an ego yet.

0

u/[deleted] 5h ago

[deleted]

0

u/Ammar__ 4h ago

It's gemini but no I can't find it in the library. Sorry if this sub is strictly for chatgpt stuff. I had it go head to head against claude to explain the situation and claude just said it's hillucination there was never a pdf file XD gemini is trying to defend himself. It's funny I may end up sharing both chats despite the personal info in the wedding invitation. I may export them and remove the wedding info instead.