Is ChatGPT reliable?
ChatGPT can answer with great confidence, even when its answer is inaccurate. This is what raises the question of its reliability, for an assignment as much as for a search for information. This article explains why these errors exist, in which cases they occur and how to use the tool with enough perspective.
In brief
ChatGPT is particularly effective at producing text that is plausible, structured and generally correct in grammatical terms. However, a convincing answer does not guarantee that the information it contains is accurate.
Reliability therefore depends as much on the tool as on how you use it and check its answers, a skill that Excelia Business School develops with its students.
Why can ChatGPT be wrong with such confidence?
ChatGPT is based on a language model: a system trained on large quantities of text to generate an answer based on the patterns learned from that data. When it answers from its internal knowledge, it does not automatically check every statement against a fact base: it can therefore produce information that is plausible without being accurate.
This is the mechanism that explains why an answer can seem very convincing while being wrong. A well-worded text is not a sign of truth: the quality of the writing is not proof of the accuracy of what it states. At Excelia Business School, the courses devoted to the use of artificial intelligence teach students, in particular, to analyse these answers with discernment and to keep a critical eye on generated content.
What is ChatGPT actually useful for?
ChatGPT is particularly useful for working on language: its ability to produce structured texts that are generally sound in grammar, syntax and vocabulary makes it possible to rephrase an idea, build an outline or clarify a line of reasoning.
This quality of expression can, however, give the impression of mastering a subject that has not really been understood: producing a well-written text does not mean mastering the reasoning it develops. Used to rephrase, structure or bring out a new angle, ChatGPT supports your work; used to replace your thinking, it short-circuits precisely the analytical and reasoning skills that a management programme seeks to develop at Excelia Business School.
How can you check information given by ChatGPT?
Three habits help to limit errors:
- Going back to the primary source, that is to say the original document rather than its summary
- Cross-checking several independent sources before considering a fact to be established
- Systematically checking a reference that seems too perfect or surprisingly precise
People often think it is enough to ask it for its sources. But when ChatGPT answers without directly searching for the information, it can cite a reference that does not exist, with a title, an author and a date that are perfectly plausible. Was the content being assessed produced by the person submitting it, or generated on their behalf? This is the question raised by a learning engineer at Excelia Business School in a reflection published by the school. According to them, the responses put forward so far remain preventive or palliative, whether they involve detection tools or the adaptation of regulations: they do not replace the habit of checking for yourself.
Using ChatGPT during your studies: where is the line?
The line is not between what is allowed and what is forbidden, but between the tool that helps you learn and the tool that replaces learning. Rephrasing an idea to clarify it is not cheating; having an assignment written for you so that you don't have to think it through, is.
Learning takes time: time to build, to formalise, to put into words, which the rapid generation of a comparable text does not replace. Students at Excelia Business School have turned this conviction into a commitment, as we detail further on: a commitment that comes from them probably states the line better than a rule imposed from above.
How does a business school train students to use AI?
At Excelia Business School, the aim is not to ban ChatGPT, but to learn to use artificial intelligence with discernment. The school notably offered first-year BBA International students a workshop devoted to the opportunities and responsibilities linked to the use of AI during their studies, to help them understand the benefits, the risks and the effects on learning.
This thinking continues into the programmes themselves: artificial intelligence is embedded in the courses of Excelia Business School's programmes, from Bachelor's to Master's level. Students thus learn to understand these tools, to use them in their field and to develop the critical eye needed for the content they produce.
This approach is also backed by the Pedagogy Lab at Excelia Business School, which supports the evolution of teaching practices and the integration of new digital tools.
Would you like to learn to work with these tools rather than simply use them? Each programme page details the courses on offer, and the programme brochure makes it possible to compare the different pathways.
Discover our Master of Science (MSc) programmes, our Bac+5 programmes
Should you be wary of AI or learn how to use it?
The question is not whether to decide for or against ChatGPT, but to keep the ability to judge what you read. A language model can produce a convincing answer; it is up to you to remain the one who assesses its relevance, checks its claims and decides how to use it.
Excelia Business School precisely aims to develop this capacity for judgement, through dedicated workshops and courses on data and artificial intelligence embedded in its programmes. Are you wondering about how artificial intelligence is transforming management careers? We devote a dedicated page to this.
Frequently asked questions
- Does ChatGPT make up answers?
Yes, this can happen. When it answers from its internal knowledge, ChatGPT generates an answer based on the information and patterns learned during its training, without automatically checking every statement. It can therefore produce information that is plausible but false, sometimes stated with great confidence.
- Can you ask ChatGPT for its sources?
Yes, but you need to check them. When it answers without directly consulting sources, ChatGPT can cite a reference that does not exist, with a title, an author or a date that seem credible. When a source is provided, it is best to open it and go back to the original document to check that it exists and that it really does confirm the information.
- Is using ChatGPT for an assignment cheating?
It depends on how it is used and the rules set for the work. ChatGPT may be allowed to rephrase, structure or deepen a line of thinking, but having it produce an assignment in your place can amount to a form of cheating. At Excelia Business School, students are made aware of a responsible and critical use of these tools.
- Do business schools ban ChatGPT?
Rules vary depending on the institution and how it is used. At Excelia Business School, ChatGPT is not simply set aside: the school trains students in a responsible and critical use of artificial intelligence, notably through courses embedded in the programmes and workshops dedicated to its opportunities and its limitations.
- Do you learn to use artificial intelligence at business school?
Yes. At Excelia Business School, artificial intelligence is embedded in the courses of the different programmes, from Bachelor's to Master's level. The Bachelor in Business notably offers a specialisation devoted to data and AI in the third year, while the Master of Science (MSc) programmes include an introductory course on artificial intelligence in their core curriculum.