AI helped people perform better while they were using it.<\/p>\n\n\n\n
Then the AI disappeared\u2014and their performance got worse.<\/p>\n\n\n\n
That is the uncomfortable result of a peer-reviewed study involving nearly 1,000 high-school students. With access to a standard GPT-4 assistant, students performed 48% better during practice<\/strong> than students working without AI. But when they took an exam without assistance, they performed 17% worse than the control group<\/strong>.<\/p>\n\n\n\n The tool improved the visible output while weakening the learning underneath it.<\/p>\n\n\n\n That should concern more than teachers and parents.<\/p>\n\n\n\n Every day, marketers ask AI to create positioning. Ecommerce teams use it to analyse reviews, write product pages and design experiments. Managers ask it to summarise documents they have not read. Developers accept code they could not explain five minutes later.<\/p>\n\n\n\n The work gets finished. The dashboard looks productive. But are we becoming more capable\u2014or merely more dependent?<\/p>\n\n\n\n Welcome to the AI productivity trap<\/strong>.<\/p>\n\n\n\n The paper, Generative AI Without Guardrails Can Harm Learning<\/em>, was published in the journal Proceedings of the National Academy of Sciences<\/em>.<\/p>\n\n\n\n Researchers conducted a randomized controlled trial at a large high school in Turkey during the 2023\u20132024 academic year. Nearly 1,000 students across grades 9, 10 and 11 participated in four 90-minute mathematics sessions. Classes were assigned to one of three groups:<\/p>\n\n\n\n Each session contained assisted practice followed by an exam completed without AI or other resources.<\/p>\n\n\n\n The results were striking:<\/p>\n\n\n\n The researchers also examined how students interacted with the systems. GPT Base users frequently asked for answers and copied solutions. GPT Tutor users were more likely to attempt answers, ask for help and work through the problem.<\/p>\n\n\n\n Perhaps the most worrying finding was that students did not recognise the damage. Those using the standard assistant did not believe they had learned less or would perform worse.<\/p>\n\n\n\n Their output gave them a feeling of mastery that their independent performance could not support.<\/p>\n\n\n\n \u201cAI is making us dumber\u201d is a deliberately provocative headline. The study did not<\/strong> measure IQ, permanent cognitive decline or the long-term impact of AI on adults at work.<\/p>\n\n\n\n It studied short-term mathematics learning in one Turkish high school. The exam followed the practice session, and the authors explicitly noted that long-term learning remains a subject for future research.<\/p>\n\n\n\n We should therefore avoid turning one strong experiment into a universal law.<\/p>\n\n\n\n What the study does demonstrate is narrower\u2014and highly relevant:<\/p>\n\n\n\n AI can increase performance while the tool is present without building the user\u2019s underlying ability. When the tool provides answers too easily, independent performance can become worse.<\/p>\n<\/blockquote>\n\n\n\n That is not proof that AI makes everyone less intelligent. It is evidence that unguarded AI use can replace the mental effort required to learn<\/strong>.<\/p>\n\n\n\n For businesses, that distinction is more useful than the headline.<\/p>\n\n\n\n We often treat these words as if they mean the same thing.<\/p>\n\n\n\n They do not.<\/p>\n\n\n\n Performance<\/strong> is the quality of what you produce today.<\/p>\n\n\n\n Capability<\/strong> is what you can understand, judge and produce tomorrow\u2014even when the tool is unavailable, wrong or facing a situation it has never seen.<\/p>\n\n\n\n AI can raise performance instantly. It can write a polished email, summarise a report, produce ten campaign ideas or generate a complete product description in seconds.<\/p>\n\n\n\n But polished output can hide weak understanding.<\/p>\n\n\n\n If you cannot explain why a recommendation is correct, recognise when it is wrong or reproduce the reasoning in a new context, the capability may belong to the tool rather than to you.<\/p>\n\n\n\n That is the trap: borrowed competence feels like personal competence while the AI is present.<\/strong><\/p>\n\n\n\n Imagine a marketer asks AI:<\/p>\n\n\n\n \u201cCreate a campaign strategy for our new skincare product.\u201d<\/p>\n<\/blockquote>\n\n\n\n The model produces personas, hooks, channel recommendations and a 30-day content calendar. The result looks comprehensive. The marketer cleans up the language, puts it into slides and presents it.<\/p>\n\n\n\n But ask three follow-up questions:<\/p>\n\n\n\n If the marketer cannot answer without reopening the chatbot, AI did not multiply their strategy. It substituted for it.<\/p>\n\n\n\n Over time, this changes the job. The marketer becomes skilled at requesting and formatting answers but less practised at customer research, positioning and making trade-offs.<\/p>\n\n\n\n The deliverables continue. The thinking weakens quietly.<\/p>\n\n\n\n The same risk exists across ecommerce operations.<\/p>\n\n\n\n AI can create hundreds of descriptions quickly. But if nobody understands the customer\u2019s objections, product differentiators or regulatory boundaries, the catalogue becomes fluent and generic.<\/p>\n\n\n\n An AI summary may identify recurring complaints. But the operator who never reads the original reviews may miss sarcasm, emerging edge cases or the emotional language customers actually use.<\/p>\n\n\n\n AI can recommend tests, but it does not automatically understand your traffic quality, technical constraints, commercial margins or brand history. A team that accepts experiments without forming its own hypothesis is generating activity, not learning.<\/p>\n\n\n\n AI can explain why revenue changed. If the analyst cannot trace that explanation back to reliable data, it becomes a confident story attached to a chart\u2014not analysis.<\/p>\n\n\n\n In each case, the immediate task becomes easier. The organisation\u2019s ability to question, interpret and decide can still become weaker.<\/p>\n\n\n\n You do not need to stop using AI. You need a quick way to recognise when assistance has become dependence.<\/p>\n\n\n\n Ask yourself these three questions.<\/p>\n\n\n\n You do not need to reproduce every sentence from memory. You should be able to explain:<\/p>\n\n\n\n If you can only defend the output by saying \u201cthe AI suggested it,\u201d you have an answer but not understanding.<\/p>\n\n\n\n Write down your initial hypothesis, outline or decision criteria before asking the model.<\/p>\n\n\n\n For a campaign, define the customer, problem and desired action. For an ecommerce test, state what you expect to happen and why. For research, list what evidence would change your mind.<\/p>\n\n\n\n Then use AI to challenge, expand or improve that thinking.<\/p>\n\n\n\n If the blank prompt box is always the beginning of your thought process, you are outsourcing the most valuable part.<\/p>\n\n\n\n The study\u2019s ordinary GPT interface sometimes produced incorrect mathematics. Yet the researchers found that copying\u2014not merely exposure to incorrect answers\u2014was the main mechanism behind the learning penalty.<\/p>\n\n\n\n The lesson is important: AI errors are most dangerous when the user has stopped engaging deeply enough to notice them.<\/p>\n\n\n\n Before using an output, ask:<\/p>\n\n\n\n If you lack enough domain knowledge to evaluate the answer, involve someone who has it.<\/p>\n\n\n\n If you answer \u201cno\u201d to any part of the AI Crutch Test, change how you are using the tool\u2014not necessarily the tool itself.<\/p>\n\n\n\n The most encouraging part of the study was the guarded GPT Tutor.<\/p>\n\n\n\n It used the same underlying GPT-4 technology, but its behaviour was different. It had correct, teacher-supplied problem information. It was instructed to give hints rather than full solutions and to ask students to attempt the work first.<\/p>\n\n\n\n That design eliminated the detectable exam penalty.<\/p>\n\n\n\n For professionals, we can reproduce some of those safeguards through better workflows.<\/p>\n\n\n\n Instead of asking:<\/p>\n\n\n\n \u201cWrite the strategy.\u201d<\/p>\n<\/blockquote>\n\n\n\n Try:<\/p>\n\n\n\n \u201cHere is my proposed strategy and the customer evidence behind it. Challenge my assumptions, identify the weakest argument and ask me three questions before recommending changes.\u201d<\/p>\n<\/blockquote>\n\n\n\n Instead of:<\/p>\n\n\n\n \u201cAnalyse this performance report.\u201d<\/p>\n<\/blockquote>\n\n\n\n Try:<\/p>\n\n\n\n \u201cI believe conversion fell because mobile traffic shifted toward a lower-intent source. Test this hypothesis against the data, show contradictory evidence and separate facts from inference.\u201d<\/p>\n<\/blockquote>\n\n\n\n Instead of:<\/p>\n\n\n\n \u201cGive me the answer.\u201d<\/p>\n<\/blockquote>\n\n\n\n Try:<\/p>\n\n\n\n \u201cDo not solve this immediately. Give me one hint, let me attempt it, then critique my reasoning.\u201d<\/p>\n<\/blockquote>\n\n\n\n The goal is to keep yourself inside the cognitive loop.<\/p>\n\n\n\n For work that develops an important professional skill, use this four-step process.<\/p>\n\n\n\n Form your first view without AI. Even five minutes of independent thinking forces you to retrieve knowledge, notice uncertainty and create a position worth testing.<\/p>\n\n\n\n Use AI for counterarguments, options, missing evidence and feedback\u2014not only for finished deliverables.<\/p>\n\n\n\n Check material claims against original sources, company data and domain experts. Separate what the model knows from what it inferred.<\/p>\n\n\n\n Close the AI and summarise the conclusion in your own words. State the decision and why you made it. If you cannot, you are not finished.<\/p>\n\n\n\n This takes longer than copying the first response. That small amount of productive friction is the point.<\/p>\n\n\n\n There is an important counterargument: we routinely use calculators, search engines, templates and automation without practising the underlying task every time.<\/p>\n\n\n\n That is sensible.<\/p>\n\n\n\n You do not need to preserve your ability to manually rewrite 500 product titles or format meeting notes. Offloading low-value work is one of AI\u2019s biggest benefits.<\/p>\n\n\n\n The real question is whether you are automating execution<\/strong> or surrendering judgement<\/strong>.<\/p>\n\n\n\n Use AI aggressively for:<\/p>\n\n\n\n Keep humans actively involved in:<\/p>\n\n\n\n The boundary will differ by role, but every team should define it intentionally.<\/p>\n\n\n\n AI dependence will not always feel like decline.<\/p>\n\n\n\n It may feel like speed.<\/p>\n\n\n\n You complete more tasks, respond faster and produce work that looks more polished. Meanwhile, the moments that once forced you to struggle, remember, compare and decide slowly disappear from your day.<\/p>\n\n\n\n That struggle was not always inefficiency. Sometimes it was the mechanism through which expertise developed.<\/p>\n\n\n\n The study\u2019s students were not lazy or unintelligent. They reacted naturally to a system that offered an easier path to the answer. Professionals will do the same\u2014especially when every workplace metric rewards output today rather than capability next year.<\/p>\n\n\n\n That is why individual discipline is not enough. Leaders must design workflows and incentives that preserve thinking.<\/p>\n\n\n\n Do not ask only, \u201cHow much faster did AI make the team?\u201d<\/p>\n\n\n\n Also ask:<\/p>\n\n\n\n AI should make your judgement more powerful, not less necessary.<\/p>\n\n\n\n The future will not belong to people who refuse AI. It will not automatically belong to the people who use it most either.<\/p>\n\n\n\n It will belong to those who know when to delegate to AI, when to challenge it and when to close the window and think for themselves.<\/p>\n\n\n\n Use the tool to increase your range.<\/p>\n\n\n\n Just make sure the intelligence in the workflow still includes yours.<\/p>\n\n\n\n No. The cited study did not measure intelligence or permanent cognitive decline. It found that unguarded GPT-4 assistance improved immediate practice performance but reduced short-term unassisted exam performance in a specific high-school mathematics setting.<\/p>\n\n\n\n In a randomized trial involving nearly 1,000 Turkish high-school students, a standard GPT-4 assistant increased performance during assisted practice by 48% relative to the control group. The same group later performed 17% worse than the control group on an immediate exam without AI.<\/p>\n\n\n\n The guarded GPT Tutor improved assisted practice performance by 127% and performed approximately the same as the control group on the unassisted exam. It removed the statistically detectable penalty but did not create a statistically significant exam improvement.<\/p>\n\n\n\n Think before prompting, use AI to challenge rather than replace your reasoning, verify important claims and explain the final decision without relying on the original AI response.<\/p>\n\n\n\n No. They should automate repetitive execution while retaining human ownership of customer understanding, strategy, evidence evaluation and final decisions.<\/p>\n\n\n\n A randomized study found that standard GPT assistance lifted practice performance by 48%\u2014then users performed 17% worse without it. Here is what that result means for marketers, ecommerce operators and anyone outsourcing too much thinking to AI.<\/p>\n","protected":false},"author":3,"featured_media":45,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[11],"tags":[70,65,8,66,69,63,68,67],"class_list":["post-44","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","tag-ai-dependence","tag-ai-productivity","tag-chatgpt","tag-critical-thinking","tag-ecommerce-operations","tag-generative-ai","tag-marketing-strategy","tag-skill-atrophy"],"yoast_head":"\nFirst, what did the study actually prove?<\/h2>\n\n\n\n
\n
\n
Important fact check: this does not prove AI lowers intelligence<\/h2>\n\n\n\n
\n
The difference between performance and capability<\/h2>\n\n\n\n
How the AI productivity trap appears in marketing<\/h2>\n\n\n\n
\n
\n
How it appears in ecommerce<\/h2>\n\n\n\n
Product descriptions<\/h3>\n\n\n\n
Customer-review analysis<\/h3>\n\n\n\n
Conversion optimisation<\/h3>\n\n\n\n
Reporting<\/h3>\n\n\n\n
The AI Crutch Test<\/h2>\n\n\n\n
1. Could I explain the result without reopening the AI?<\/h3>\n\n\n\n
\n
2. Did I think before I prompted?<\/h3>\n\n\n\n
3. Can I detect a confident but wrong answer?<\/h3>\n\n\n\n
\n
Use AI as a coach, not an answer machine<\/h2>\n\n\n\n
\n
\n
\n
\n
\n
\n
A practical framework: Think, Ask, Verify, Rebuild<\/h2>\n\n\n\n
Think<\/h3>\n\n\n\n
Ask<\/h3>\n\n\n\n
Verify<\/h3>\n\n\n\n
Rebuild<\/h3>\n\n\n\n
Not every task needs to teach you something<\/h2>\n\n\n\n
\n
\n
The biggest risk is the skill you stop practising<\/h2>\n\n\n\n
\n
Final thought<\/h2>\n\n\n\n
Frequently asked questions<\/h2>\n\n\n\n
Does research prove that AI is making people dumber?<\/h3>\n\n\n\n
What was the 48% and 17% AI study?<\/h3>\n\n\n\n
Did the guarded AI tutor harm learning?<\/h3>\n\n\n\n
How can professionals prevent AI skill atrophy?<\/h3>\n\n\n\n
Should marketers and ecommerce teams stop using AI?<\/h3>\n\n\n\n
Sources<\/h2>\n\n\n\n
\n