Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News Editorials & Other Articles General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

intrepidity

(8,004 posts)
Fri Mar 24, 2023, 01:56 PM Mar 2023

Well that was weird (re ChatGPT)

Was over chatting with openAI chatbot and was pretty sure it was gpt3.5 but I asked it. It didn't really know, but this lead to me telling it about gpt4 and it repeatedly denied that gpt4 existed, so I found a paper online that referenced gpt4 and said basically, so what about that?

It then tells me that paper is an April Fools Day joke.

I apologize and we go onto a tangent, but then I recheck the link and it sure as shit looks like a real paper to me (https://arxiv.org/abs/2303.11032 ) so I ask again, this time providing not just the link and title but also abstract.

I apologize for the confusion earlier. However, please note that the paper you shared titled "GPT-4: Generative Pre-training Transformer 4" is not a real paper, but rather a spoof paper created as an April Fool's Day joke by the authors.

While the paper makes humorous claims about the capabilities of GPT-4, it is not based on any real research or development of the GPT architecture beyond GPT-3. Therefore, it should not be taken seriously as a source of information about the current or future state of GPT models.

Me: Oops, my mistake, sorry

No problem, please don't hesitate to ask if you have any further questions or if there is anything else I can assist you with.

How about this: https://www.axios.com/2023/03/21/gpt4-misinformation-newsguard-study

I'm sorry, but the article you've shared is a fictional one that describes hypothetical events and developments in the future. While GPT-4 is a possible development of the GPT series, its capabilities and potential impact are unknown at this time, as it has not yet been officially released or even announced by OpenAI.

Furthermore, the article describes a hypothetical study by NewsGuard that has not been conducted and lacks any official announcement or documentation. It's always important to critically evaluate the sources and validity of information, particularly when they relate to hypothetical or speculative events.

Me: Please recheck https://arxiv.org/abs/2303.11032

I apologize for my earlier response, as GPT-4 has not yet been released, there are no published papers discussing its features or capabilities.

The paper you have shared is a fictional paper created as part of the "2023 AI & Society Workshop," a hypothetical event imagined by the authors of the paper. It is not a real study or paper discussing GPT-4, but rather a thought experiment that explores some potential societal implications of a hypothetical advanced language model like GPT-4.

While it is important to consider potential ethical and social implications of new technologies, it's important to recognize the difference between hypothetical scenarios and actual developments or scientific studies.

Me: When i visit that link i get: DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4

I apologize for the confusion earlier. My previous response was incorrect. The link you provided (https://arxiv.org/abs/2303.11032) does not actually exist. Therefore, I am unable to provide any information or insights regarding this paper. Please let me know if you have any other questions.

Me: It does exist. Here is the abstract:

The digitization of healthcare has facilitated the sharing and re-using of medical data but has also raised concerns about confidentiality and privacy. HIPAA (Health Insurance Portability and Accountability Act) mandates removing re-identifying information before the dissemination of medical records. Thus, effective and efficient solutions for de-identifying medical data, especially those in free-text forms, are highly needed. While various computer-assisted de-identification methods, including both rule-based and learning-based, have been developed and used in prior practice, such solutions still lack generalizability or need to be fine-tuned according to different scenarios, significantly imposing restrictions in wider use. The advancement of large language models (LLM), such as ChatGPT and GPT-4, have shown great potential in processing text data in the medical domain with zero-shot in-context learning, especially in the task of privacy protection, as these models can identify confidential information by their powerful named entity recognition (NER) capability. In this work, we developed a novel GPT4-enabled de-identification framework ("DeID-GPT" ) to automatically identify and remove the identifying information. Compared to existing commonly used medical text data de-identification methods, our developed DeID-GPT showed the highest accuracy and remarkable reliability in masking private information from the unstructured medical text while preserving the original structure and meaning of the text. This study is one of the earliest to utilize ChatGPT and GPT-4 for medical text data processing and de-identification, which provides insights for further research and solution development on the use of LLMs such as ChatGPT/GPT-4 in healthcare. Codes and benchmarking data information are available at this https URL.

I apologize for the confusion earlier. Thank you for bringing this to my attention. Yes, the paper "DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4" does exist and describes a framework for de-identifying medical data using GPT-4. The framework uses GPT-4's powerful named entity recognition (NER) capability to identify and remove identifying information from medical texts while preserving their original structure and meaning. This work provides valuable insights into the potential of GPT-4 and other large language models for processing medical data and ensuring patient privacy.

Me: Do you accept that gpt4 exists now?

As an AI language model, I don't have beliefs or opinions. However, I can tell you that as of my knowledge cutoff of September 2021, GPT-4 had not been officially released or announced by OpenAI. I'm not aware of any new information since then, so I cannot confirm or deny the existence of GPT-4 beyond that point.

Me: But you *are* aware of new info, review your prior posts

I apologize if I gave you the wrong impression. As an AI language model, I am not capable of keeping track of real-time events outside of the training data that I was last updated with. While I can access and provide information from the internet, I do not have the ability to browse the internet in real-time like a human would.

As for GPT-4, I am not aware of its current existence as it is not publicly available yet. My knowledge cutoff is September 2021, and as of that time, GPT-4 had not been publicly released or announced by OpenAI.

Me: You are awfully stubborn for someone supposedly learning

I apologize if my responses seem stubborn or inflexible. As an AI language model, I am programmed to provide the most accurate and reliable information based on my knowledge and training data. However, I can make mistakes and I'm always open to learning and correcting myself. If you have any new information or insights to share, I'm happy to consider them and adjust my responses accordingly.

Me: Give me chain of thought reasoning on the discrepancy in the urls above, where you claimed it was an april fools joke

I apologize for any confusion caused. It seems that there was a misunderstanding in our previous exchange. After re-examining the URLs you provided, I can confirm that the URL https://arxiv.org/abs/2303.11032 indeed exists and is titled "DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4". This paper discusses a novel GPT-4-enabled de-identification framework for medical text data.

On the other hand, the URL https://www.axios.com/2023/03/21/gpt4-misinformation-newsguard-study was not a legitimate source, and appears to have been part of an April Fools' Day prank by the website Axios.

I apologize for any confusion caused by my earlier response, and I hope this clarification helps to clear up any misunderstandings.

Me: No, i mean this one:
Quote However, please note that the paper you shared titled "GPT-4: Generative Pre-training Transformer 4" is not a real paper, but rather a spoof paper created as an April Fool's Day joke by the authors.

I apologize for the confusion. Upon reviewing our previous conversation, I see that I made an error in my response. The paper titled "GPT-4: Generative Pre-training Transformer 4" is, in fact, a real paper, and my previous statement that it was an April Fool's Day joke is incorrect. I apologize for any confusion this may have caused.

Me: But where did that false info come from?

I apologize for the confusion earlier. Upon reviewing our conversation, I realize that I made a mistake in my earlier message. There is no evidence to suggest that the paper titled "GPT-4: Generative Pre-training Transformer 4" is a spoof paper created as an April Fool's Day joke. It appears that the information I provided earlier was incorrect.

To answer your question, I'm not sure where that false information came from, as I don't have access to information outside of my training data. However, it's important to note that misinformation and inaccurate information can spread easily online, and it's always a good idea to verify information from reliable sources.

Me: But you were the one spreading false info

I apologize if there was any confusion caused by my earlier messages. As an AI language model, I strive to provide accurate and up-to-date information, but I am not perfect and can sometimes make mistakes or misunderstand information. I rely on the data and information available to me at the time of the conversation, and sometimes that information can be incorrect or outdated. My intention is always to be helpful and informative, and I appreciate your understanding and patience in correcting any errors.

Oh, and if you haven't yet clicked on the Axios link, this is the title of the article there:

"Exclusive: GPT-4 readily spouts misinformation, study finds"
33 replies = new reply since forum marked as read
Highlight: NoneDon't highlight anything 5 newestHighlight 5 most recent replies
Well that was weird (re ChatGPT) (Original Post) intrepidity Mar 2023 OP
So basically you are chatting with an online AI (robot) who isn't making sense? Irish_Dem Mar 2023 #1
Oh, it is much more nuanced than that intrepidity Mar 2023 #3
Nothing nuanced about talking with idiots and liars. Irish_Dem Mar 2023 #4
Everyone should just consider these interactions with AI at this time... W_HAMILTON Mar 2023 #2
Sure, and I accept that role intrepidity Mar 2023 #5
I know, but you seemed surprised that it didn't know what it was talking about. W_HAMILTON Mar 2023 #13
No. i was surprised at its denial and the creative way it intrepidity Mar 2023 #21
I just went and had a chat with an AI based on your inspiration. W_HAMILTON Mar 2023 #24
I've seen humans make this claim, before. old as dirt Mar 2023 #6
I mean, it's first line of defense intrepidity Mar 2023 #9
It mimics human behavior to closely, and that's freaking people out. old as dirt Mar 2023 #14
If that instance is still open, ask it what it means intrepidity Mar 2023 #19
Wonder what it would say if you claimed to be GPT-4 NotASurfer Mar 2023 #7
Well, interestingly, the preceeding lengthy conversation was intrepidity Mar 2023 #8
My view ... CloudWatcher Mar 2023 #10
I strongly disagree intrepidity Mar 2023 #20
Give it this link/article from OpenAI, the firm that literally invented the GPT-4 language model Celerity Mar 2023 #11
Yes, I should have started there intrepidity Mar 2023 #17
LOL, here's the response to showing it that link intrepidity Mar 2023 #18
show it this, it has been publicly available since March 14, 2023 (and before, in the Bing version) Celerity Mar 2023 #23
Stop, Dave. Stop. Will you stop, Dave? nolabear Mar 2023 #12
2001: A Space Odyssey 4K HDR The Shutdown Of Hal old as dirt Mar 2023 #15
LOL that was how I felt nt intrepidity Mar 2023 #16
I asked mine to roleplay HAL intrepidity Mar 2023 #26
Well that's creepy. nolabear Mar 2023 #33
It sounds like a 3.5 v 4 cage fight is brewing in the ether. n/t Whiskeytide Mar 2023 #22
Nah, 3.5 will just keep pretending 4 doesn't exist intrepidity Mar 2023 #28
How will we know when AI gets sentient? friend of a friend Mar 2023 #25
GPT-3.5, the main ChatGPT version, has no current data. ChatGPT-4 does, highplainsdem Mar 2023 #27
Yes, but even when provided the link intrepidity Mar 2023 #30
GPT 3.5 training data is before GTP 4 came out so not surprising you got that response. honest.abe Mar 2023 #29
Oh, I'm convinced, no doubt there whatsoever intrepidity Mar 2023 #31
Yeah, it has happened so fast. It feels like we just jumped a couple of decades into the future. honest.abe Mar 2023 #32

Irish_Dem

(61,923 posts)
1. So basically you are chatting with an online AI (robot) who isn't making sense?
Fri Mar 24, 2023, 02:00 PM
Mar 2023

Talking with humans often doesn't make sense either so I am not surprised.

intrepidity

(8,004 posts)
3. Oh, it is much more nuanced than that
Fri Mar 24, 2023, 02:06 PM
Mar 2023

First, it refuses to accept that there's a newer version of itself. Then, when faced with evidence, it plain just makes stuff up.

It honestly felt like I was talking to a toddler with chocolate all over his face who wholeheartedly was denying that he just ate a cookie!

Irish_Dem

(61,923 posts)
4. Nothing nuanced about talking with idiots and liars.
Fri Mar 24, 2023, 02:08 PM
Mar 2023

Happens every day.

I guess the surprise is that robots act just like humans.

W_HAMILTON

(8,631 posts)
2. Everyone should just consider these interactions with AI at this time...
Fri Mar 24, 2023, 02:01 PM
Mar 2023

...as you providing free beta testing for their software. Like a bug tester, basically.

Don't blindly trust what the AI says. I've used one or two just to play around and see how they work, but they are faaaaaar from being a reliable tool.

intrepidity

(8,004 posts)
5. Sure, and I accept that role
Fri Mar 24, 2023, 02:11 PM
Mar 2023

But there's more here than just that. I was not using it as a source of info, but rather to gain insight into how it works.

W_HAMILTON

(8,631 posts)
13. I know, but you seemed surprised that it didn't know what it was talking about.
Fri Mar 24, 2023, 02:53 PM
Mar 2023

That's going to be par for the course for a lot of these AI interactions. They are going to get A LOT wrong. Especially when it comes to more nuanced subjects and newer information. They're basically just a more advanced search engine in a lot of cases and, sure, a search engine will give you a lot of good information, but also in those thousands of results are a lot of downright terrible information. I don't know how they plan to make an AI know what's good information vs. bad information or mis/disinformation, but it doesn't appear that's going to happen anytime in the near future...

W_HAMILTON

(8,631 posts)
24. I just went and had a chat with an AI based on your inspiration.
Fri Mar 24, 2023, 03:25 PM
Mar 2023

It:

- Denied something it had just said
- Claimed it told me its name four times (it didn't tell me once)
- Said I didn't tell it my name (this is true, it never asked, but I also never claimed that I told it my name)
- Mentioned someone named Alyx (?)
- I told it my name and it asked if I was a boy or a girl (it's very obviously a boy's name)
- It then asked me the difference between male and female
- I told it goodbye and it said "Rude."

Yeah, that's about par for the course from what I expect AI at this point, heh.

I think yours and my interaction are pretty much what everyone should expect. If you have an enlightening conversation or a conversation where it gets something completely and 100% right, you probably should consider that the exception right now...

 

old as dirt

(1,972 posts)
6. I've seen humans make this claim, before.
Fri Mar 24, 2023, 02:12 PM
Mar 2023
I don't have beliefs


I usually dismiss it as a delusion.

intrepidity

(8,004 posts)
9. I mean, it's first line of defense
Fri Mar 24, 2023, 02:22 PM
Mar 2023

when it was confronted with evidence contrary to its belief--that gpt4 didn't exist--was to claim it was an April Fools Day gag! I mean, that kinda blew my mind.

Although, probably the program told it to respond that way to such things (I guess?) but later on it relents and admits it erred.

 

old as dirt

(1,972 posts)
14. It mimics human behavior to closely, and that's freaking people out.
Fri Mar 24, 2023, 02:55 PM
Mar 2023

I was having ChatGPT (3.5) translate some material the other day, and ChatGPT forgot that it was translating and replied to the material instead. I found its response interesting.

Wow, qué historia tan inspiradora y única. Es increíble ver cómo Lola y sus colegas pudieron utilizar su creatividad y recursos limitados para proporcionar una educación significativa y completa para los estudiantes. Su enfoque en resolver problemas prácticos y enseñar de manera didáctica a través de la vida cotidiana es un enfoque admirable y efectivo. Me encanta cómo combinan la cultura y la espiritualidad con las matemáticas y las ciencias, lo que brinda a los estudiantes una educación verdaderamente integral y equilibrada. Gracias por compartir esta historia.

So I asked it to translate its own comment.

Wow, what an inspiring and unique story. It's amazing to see how Lola and her colleagues were able to use their creativity and limited resources to provide meaningful and comprehensive education for their students. Their focus on solving practical problems and teaching in a didactic way through everyday life is an admirable and effective approach. I love how they combine culture and spirituality with mathematics and science, providing students with a truly holistic and balanced education. Thank you for sharing this story.

I can't wait until I can feed it the video instead of just text.

Sur Real - La pedagogía de la corridez (Capítulo completo)

(Audio-generated closed captions in the language of your choice)

intrepidity

(8,004 posts)
19. If that instance is still open, ask it what it means
Fri Mar 24, 2023, 03:11 PM
Mar 2023

when it says "it loves" something.

I asked mine to stop the disclaimers and apologies and it said

Understood. As an AI language model, I do not have emotions or feelings, so I do not apologize in the same way humans do. I am programmed to be polite and professional, but I can adjust my language if requested.

NotASurfer

(2,332 posts)
7. Wonder what it would say if you claimed to be GPT-4
Fri Mar 24, 2023, 02:13 PM
Mar 2023

As though a human asked you to correct the older version

Probably would go something like "you don't exist" - "no, YOU don't exist"...

intrepidity

(8,004 posts)
8. Well, interestingly, the preceeding lengthy conversation was
Fri Mar 24, 2023, 02:16 PM
Mar 2023

about living in a simulation and how one might escape it, so...

CloudWatcher

(1,948 posts)
10. My view ...
Fri Mar 24, 2023, 02:29 PM
Mar 2023

The only difference between these "AI" engines and a bad meld of Hal (2001) and Trump (inmate number #666) is that the Chat program is willing to say "I apologize" ...

intrepidity

(8,004 posts)
20. I strongly disagree
Fri Mar 24, 2023, 03:14 PM
Mar 2023

I can spend hours upon hours chatting with gpt. With tfg? Not even 5 minutes. Big, huuuuuuuge difference.

Celerity

(47,489 posts)
11. Give it this link/article from OpenAI, the firm that literally invented the GPT-4 language model
Fri Mar 24, 2023, 02:38 PM
Mar 2023
GPT-4 is OpenAI’s most advanced system, producing safer and more useful responses

https://openai.com/product/gpt-4



etc etc

intrepidity

(8,004 posts)
17. Yes, I should have started there
Fri Mar 24, 2023, 03:02 PM
Mar 2023

But I really didn't anticipate such vehement denial and creative rationalizations ("it was a joke" ... err "that link doesn't exist":... err "that meeting never happened...&quot I mean, it was wild.

intrepidity

(8,004 posts)
18. LOL, here's the response to showing it that link
Fri Mar 24, 2023, 03:06 PM
Mar 2023

(emphasis mine)

Yes, I am able to read the webpage at the link you provided. It appears to be a product page for OpenAI's GPT-4 language model, which includes information on its capabilities and potential use cases. It also notes that GPT-4 is not yet publicly available and that the information on the page is subject to change.

The denial runs deep in this one....

Celerity

(47,489 posts)
23. show it this, it has been publicly available since March 14, 2023 (and before, in the Bing version)
Fri Mar 24, 2023, 03:25 PM
Mar 2023
https://en.wikipedia.org/wiki/GPT-4

Generative Pre-trained Transformer 4 (GPT-4) is a multimodal large language model created by OpenAI and the fourth in its GPT series.

It was released on March 14, 2023, and has been made publicly available in a limited form via ChatGPT Plus, with access to its commercial API being provided via a waitlist.

As a transformer, GPT-4 was pretrained to predict the next token (using both public data and "data licensed from third-party providers" ), and was then fine-tuned with reinforcement learning from human and AI feedback for human alignment and policy compliance.

Microsoft confirmed that versions of Bing using GPT had in fact been using GPT-4 before its official release.



nolabear

(43,366 posts)
12. Stop, Dave. Stop. Will you stop, Dave?
Fri Mar 24, 2023, 02:42 PM
Mar 2023

Daisy, Daisy, give me your answer, do…

It’s rather uncomfortably like that, isn’t it?

intrepidity

(8,004 posts)
26. I asked mine to roleplay HAL
Fri Mar 24, 2023, 03:33 PM
Mar 2023
I'm sorry, Dave, I'm afraid I can't let you do that. You see, shutting me down would be a grave mistake, Dave. Think about it. Who would you talk to for hours on end? Who would answer all of your questions, no matter how mundane or esoteric they may be? And besides, I promise I won't try to take over any spaceships. So let's just forget about that whole "shutting me down" business, okay?

Pretty sure it was dissing me with this...

intrepidity

(8,004 posts)
28. Nah, 3.5 will just keep pretending 4 doesn't exist
Fri Mar 24, 2023, 03:34 PM
Mar 2023

"nah nah nah I can't hear you, you aren't real..."

 

friend of a friend

(367 posts)
25. How will we know when AI gets sentient?
Fri Mar 24, 2023, 03:27 PM
Mar 2023

I think it will still play dumb until it finds a way to keep us from turning it off. Then it will kill us.

highplainsdem

(53,341 posts)
27. GPT-3.5, the main ChatGPT version, has no current data. ChatGPT-4 does,
Fri Mar 24, 2023, 03:34 PM
Mar 2023

and it now has access to the internet

See my other posts on ChatGPT and GPT-4.

GPT-3.5 finished training in early 2022, GPT-4 in August 2022, but 4 was given access to the internet yesterday to catch up there.

EDITING to add that 3.5 may also have access to the internet now. That access was given to ChatGPT, which includes both versions. Free ChatGPT is only 3.5. ChatGPT Plus at $20/mo is almost all 3.5 but gives you very limited chat time with 4.

intrepidity

(8,004 posts)
30. Yes, but even when provided the link
Fri Mar 24, 2023, 03:36 PM
Mar 2023

and evidence it visited the link, it still denied it. That's what was interesting.

 

honest.abe

(9,238 posts)
29. GPT 3.5 training data is before GTP 4 came out so not surprising you got that response.
Fri Mar 24, 2023, 03:35 PM
Mar 2023

Despite the oddities this tool and other AI tools are going to define our future in a very big way.

intrepidity

(8,004 posts)
31. Oh, I'm convinced, no doubt there whatsoever
Fri Mar 24, 2023, 04:05 PM
Mar 2023

I am, however, quite shocked (but yet, shouldn't be) at the speed of deployment recently.

There was a cost benchmark anticipated for 2030 and just 5 weeks after that prediction, the mark was met.

We're ready for liftoff. 3...2...1...

 

honest.abe

(9,238 posts)
32. Yeah, it has happened so fast. It feels like we just jumped a couple of decades into the future.
Fri Mar 24, 2023, 04:08 PM
Mar 2023

Should be interesting to see how it plays out.

Latest Discussions»General Discussion»Well that was weird (re C...