Overview
AI adoption is the work of turning the rollout of generative AI tools into improved developer productivity and product outcomes for an organization. It goes beyond distributing tools and announcing how to use them: it includes measuring the state of the engineering organization and its AI usage, identifying what is missing, and embedding the fixes in the organization as working mechanisms. This page covers why productivity often does not rise after AI is introduced, the foundation AI usage depends on, “AI utilization levels” as a yardstick for where an organization stands, how to staff the effort, and the cycle that keeps it running. The individual tools and extensions are explained on their own pages. See Vibe Coding for conversational development with AI, Agentic Workflow for delegating implementation to AI, and Plugins for distributing skills and other extensions across an organization.Why productivity does not rise just by introducing AI
The gap between perception and actual results
After AI is introduced, developers tend to feel that they write code faster. That feeling does not necessarily translate into more releases or more value delivered. Whether perception and results have diverged has to be checked against measured numbers. A common pattern is that AI sped up only one step, code generation, and the bottleneck simply moved to another step. For example, if AI output goes to review without the author understanding it, review comments and fix round-trips increase, and the throughput of development as a whole stays the same.AI scales both strengths and weaknesses
AI amplifies both the strengths and the weaknesses an organization already has. Using AI without a solid foundation amplifies weaknesses like these:
AI follows the existing code and mechanisms, so low-quality code yields generated code of similar quality. AI does not make slow development fast; it makes development that was already fast even faster.
The foundation for AI usage
Before advancing AI usage, confirm that the basics, which matter regardless of AI, are in place. Build them from the bottom up in the following order, adding each layer only after the one below is solid.
When AI does not produce the output you expect, review this foundation before revisiting how AI is used. The basics come first; AI usage comes after.
AI utilization levels
AI utilization levels are a three-stage yardstick for what an organization or team entrusts to AI. Use them to identify where you are now and decide what to work on next. The levels are not alternatives to choose from; they are built up step by step on top of the foundation. They are a separate yardstick from the three levels of productivity covered in Understanding Developer Productivity.
Levels 1 and 2 concern output (how much and how well you build), while Level 3 concerns outcomes (the value of what you build).
Level 1: Build fast
Level 1 is the stage where an AI agent generates code and pull request creation is automated. Vibe Coding belongs to this level. At this level, common problems are large individual differences in how well people use AI, and lower pull request quality because AI output is sent to review without being understood. To address them, clarify understanding and responsibility as follows.- Humans are responsible for the code AI outputs. However much is automated, humans own final responsibility for quality and judgment.
- Split review into self-review and review. Entrust AI with the self-review that happens before requesting review, and settle checks of the code change itself there. Focus human review on what humans must ultimately judge.
- Prepare guardrails for AI to reference. READMEs, instruction files for agents, coding conventions, and commands for routine tasks let AI understand the context and produce output of consistent quality repeatedly.
Level 2: Build right
Level 2 is the stage where you prepare the procedures to hand to AI and delegate implementation to an agentic workflow. Humans decide the direction of tasks and issues, and AI plans, implements, and verifies its own work. The problem at this level is that the procedure for realizing requirements is not in a form AI can take. Nobody has decided task granularity or steps, and knowing what to give AI so it works accurately depends on specific individuals. To fix this, put the following three elements in place.
The quality of AI’s output is determined by the quality of the task breakdown, the blueprint you hand it. Moving from Level 1 to Level 2 is also a shift from collaborating with AI to delegating to it.
Once you delegate multiple tasks in parallel, running AI agents side by side in several terminal windows or panes becomes easier than working one task at a time in an IDE. The development environment itself shifts toward one that makes parallel delegation easy.
Level 3: Build what is needed
Level 3 is the stage where AI support extends beyond engineering into requirements definition and QA, reaching upstream decisions about what to build. Once development is fast and correct, the bottleneck becomes deciding what to build. This happens when only engineers can investigate whether requirements are feasible, or when initiatives move forward while the concepts of the system and the product stay apart. The starting point at this level is understanding the current state of both the system and the product. With both measured and retrieved, examine what an initiative will change and how, then run the implement–verify–measure cycle with high reproducibility.Staffing AI adoption
Make it a dedicated role, not a side job
AI adoption stalls when it is combined with day-to-day development work, for three reasons.- Volume. AI tools update almost every week, and part-time effort cannot keep up.
- Priority. Evaluation, rollout, and education happen at the same time, and as a side job, daily work wins and adoption gets pushed back.
- No owner. When it is unclear who is responsible, internal rollout is delayed and the skills you built eventually stop being used.
Qualities needed in the person driving adoption
Few people meet all of these. Enthusiasm for AI is hard to compensate for with support from others, so the realistic options are to assign an experienced engineer, or to assign an enthusiastic junior engineer and have others support them.
The AI adoption cycle
AI adoption does not end with a single initiative. Keep running “visualize → distribute → embed” as one cycle.Visualize
Visualization is essential for running the improvement cycle with high reproducibility. Improvements based on intuition or experience sometimes work, but you cannot explain why they worked, so you cannot repeat them. When visualizing, read the following two axes side by side. Either one alone cannot trace why results are not appearing.
In the PDCA cycle, both Plan and Check need a step that reads the visualized numbers. How accurately you read them changes both your hypotheses and your evaluations, and determines the hit rate of your improvements. Turn the findings into skills and agents. The productivity metrics themselves (and the three levels of productivity, which are separate from AI utilization levels) are explained in Understanding Developer Productivity.
Distribute
Distribute the skills and agents you create across the organization as a plugin. Managing the plugin in an internal repository lets members install and update it with one command, and every improvement reaches everyone once it is merged. Keep the repository open so that anyone, not just the adoption owner, can propose improvements. When people can request a skill or suggest a fix through a pull request, AI adoption becomes an effort of the whole organization. Moving skills that live in individual teams into the plugin also lets other teams use them and returns improvements to the whole company.Embed
Tools that are only built and distributed eventually go unused. Keep mechanisms running that make people aware of them and able to use them well.
Fundamentals matter because judging whether AI output is good requires foundational knowledge. At Level 2 in particular, judging whether a design AI proposes is correct calls for language-independent knowledge such as databases, networking, algorithms, and computational complexity.
Points to keep in mind
- No single measure raises productivity at once. Accumulate small improvements and keep facing the problems in front of you.
- Do not make using AI the goal. First confirm results with productivity metrics, then look at how AI is used. Look at how it is used, not how much.
- The adoption owner should not do everything. Through mechanisms that let anyone improve skills, make continuous improvement an effort of the whole organization.
- Basics first, AI usage after. With a weak foundation, neither guardrails nor AI will deliver results.
Related pages
Agentic Workflow
The core of Level 2: delegating planning, implementation, and verification to AI.
Plugins
The mechanism behind the “distribute” step, delivering skills and more across the organization.
Understanding Developer Productivity
The definition and three levels behind the productivity metrics you read when visualizing.