Right here’s a cautionary story about among the limitations of ChatGPT proper now. In the event you ask it to generate an inventory of instructed articles or books you need to go and browse on a specific subject, you’re more likely to get an inventory of made-up titles.
It could be my dream of a analysis sidekick. You’d need to get a abstract of newest analysis on a subject, so that you’d ask an AI instrument corresponding to ChatGPT to go and trawl the hundreds of journals out there and produce an inventory of sizzling articles. You would then use this as the idea of your preliminary studying, after which hit the reference lists to seek out extra associated articles.
So I attempted it with ChatGPT final night time. I requested it for some present articles on the instructing of main science.
And right here’s the listing it instructed:
I needed to ask it so as to add journal titles to the listing. It could not present any direct URL’s.
The explanation why grew to become clear once I tried to search for these articles. Google had no file of them. The EBSCO tutorial library had no file. I went direct to the journals themselves and there was no hint of them.
The articles didn’t exist.
Instruments corresponding to ChatGPT are aggregation instruments, from what I can see. They soak up massive quantities of associated content material and remix them / mash them collectively into new content material. That is nice in the event you’re asking it to create a narrative, an essay or a poem. It really works nice for a scheme of labor or lesson plan. Create a abstract of an article, no drawback. It’s creating new from previous.
So when it creates a reference listing, it’s doing the identical factor. A title from right here, an writer from there, a date and a journal identify from some place else. And it mashes them collectively into a brand new entity. One that doesn’t exist outdoors of ChatGPT.
Hopefully sooner or later, it’ll be educated not to try this for references, however for now, it’s a problem.
The video explains extra;
In the event you’ve discovered a manner round this, let me know. Or if you understand of higher instruments for this sort of factor, share it within the feedback.
