Skip to content
Putting technology to work.
Insights to guide decisions and action.

Search articles

How far should you accept AI refactoring suggestions? — Designing tech debt "decision-making" in custom maintenance

Table of contents · 11 items

The article Why We Can't Decide Every Time a Refactoring Proposal Arrives generated significant discussion on Zenn. Today, AI coding agents can instantly output countless refactoring proposals. However, what teams are experiencing on the ground is a new form of stagnation: "Proposals keep coming, but we cannot judge whether to accept them, whether to prioritize them, or whether they will break things right now." The fundamental problem has shifted from "can we fix it?" to "can we determine what to fix, why, and whether it should be fixed right now?"

This is particularly critical on the maintenance frontlines of custom development. Teams easily fall into a dilemma between "blindly accepting AI proposals and breaking working code" and "deferring every proposal due to an inability to evaluate them, causing debt to accumulate." When supporting system maintenance through custom development, we view this as a design challenge: not merely asking "should we refactor?" but designing a system to evaluate based on value and risk, make improvements safely and accountably, and deliver code seamlessly integrated into operations. Connecting this with the design improvement decision-making in Custom Soft Delete / State Table DB Redesign Development (GH Media), the safety nets to prevent regressions in Custom Test Automation Adoption Support Development (GH Media), and the AI deliverable verification in Custom Deliverable QA Development Learned from EY's AI Hallucination Report (GH Media), this article organizes "refactoring decision-making and technical debt governance support" as a custom development package.

Why refactoring "decision-making" "now"?

DimensionProposal-based (traditional)Decision-based (2026)
TriggerFixing when noticedMass proposals from AI
BottleneckHands to write fixesCriteria to decide
AdoptionBased on intuitionBased on value and risk
PrioritizationLoudest voiceBased on impact
SafetyHope and prayersGuaranteed by tests
DeliverableAd hoc improvementsExplainable improvements

In short, "being able to fix" and "being able to decide" are completely different things, and in custom development, "evaluating adoption based on value and risk, making non-breaking and explainable improvements, and handing them over embedded into operations" has become a prerequisite for quality. This enables us to guarantee "decisive, non-breaking, and justifiable improvements" as tangible deliverables.

Three structural changes beneficial to custom development projects

Structure 1: From "hands to write fixes" to "criteria to decide"

As long as AI supplies the execution power, decision-making is the scarce resource. In custom development, we establish criteria for evaluating value, risk, and cost so teams can decide whether to adopt suggestions without hesitation.

Structure 2: From "intuitive adoption" to "value and risk"

Adoption based on personal preference is not reproducible. In custom development, we provide explainable adoption decisions based on evaluations of impact, regression risk, and maintainability.

Structure 3: From "hope-based changes" to "guaranteed by tests"

Modifications without tests invite disaster. In custom development, we deliver non-breaking improvements backed by tests serving as safety nets and phased rollouts.

The 5 phases of "Refactoring Decision-Making and Tech Debt Governance Support" provided for clients

Phase 1: Current state audit (1 week)

  • Auditing and visualizing technical debt
  • Identifying high-churn / fragile areas
  • Checking existing tests and safety nets
  • Interviewing teams on AI suggestion workflows

Phase 2: Decision criteria design (1 week)

  • Defining evaluation criteria for value, risk, and cost
  • Establishing rules for adoption and prioritization
  • Criteria for "fix now / fix later / do not fix"
  • Designing review workflows for AI suggestions

Phase 3: Safety net implementation (1–2 weeks)

  • Building tests around high-risk areas
  • Designing phased refactoring procedures
  • Mandating decision criteria in code reviews

Phase 4: Executing improvements (2–3 weeks)

  • Incrementally improving high-priority technical debt
  • Applying each change in small increments backed by tests
  • Documenting rationales for decisions (why it was fixed)

Phase 5: Ongoing operations (continuous)

  • Periodic audits of technical debt
  • Reviewing and refining decision criteria
  • Institutionalizing review practices for new suggestions

Standard set of decision criteria for client development

Evaluation axisEvaluation pointImpact on decisions
ValueContribution to bug reduction / development velocityHigher gets higher priority
Regression riskBlast radius / test coverageHigher requires more caution
FrequencyFrequency of changes to that sectionHigher gets higher priority
CostModification man-hoursLarger requires splitting
ReversibilityCan it be rolled back?Lower requires more caution
ExplainabilityCan the rationale be demonstrated?Required

Which projects need this and which do not

Projects requiring thisLow-priority projects
Overwhelmed by AI suggestions and unsure how to decideHardly using suggestions
Technical debt is piling upNew project with little debt
Constant anxiety about breaking things during updatesSufficient test coverage exists
Core systems requiring long-term maintenanceShort-lived evaluation environments
Wanting to explain the rationale behind improvementsLow accountability requirements

Six clauses to include in client contracts

ClauseDetailsWhat the client should verify
Target scopeAreas to improveAgreement on priorities
Decision criteriaRules for adoption / prioritizationAgreement on evaluation axes
SafetyTesting / phased rolloutsNon-breaking prerequisite
DocumentationHow to preserve decision rationalesAccountability
HandoverDecision criteria / runbooksPremise of in-house operation
Ongoing maintenancePeriodic auditsOperating costs

Client ROI estimate (assuming enterprise system maintenance)

ItemExisting (unable to decide)Decision governanceDifference
Handling suggestionsBlind adoption or total rejectionScreening by valueEliminating wasteful modifications
Modification incidentsBreakages cause outagesPrevented by testsReduction in incident response
Technical debtAccumulatesPaid down systematicallyMaintaining development velocity
AccountabilityAmbiguous rationaleExplained through documentationIncreased client trust
Annual benefitReduction of wasteful modifications + prevention of modification incidents

Even if a substantial investment is required, it can be fully justified by avoiding a single outage caused by blindly accepted changes and reducing wasted modification hours.

Five common pitfalls

Pitfall 1: Blindly adopting AI suggestions

It breaks working code. Judge based on value and risk.

Pitfall 2: Rejecting everything out of indecision

Technical debt accumulates. Screen using decision criteria.

Pitfall 3: Improving without tests

It causes incidents. Establish safety nets first.

Pitfall 4: Making massive changes all at once

Reversibility is lost. Apply changes in small, incremental steps.

Pitfall 5: Failing to document decision rationales

You will not be able to explain them later. Record why fixes were made.

90-day action plan

WeekAction
Week 1Debt inventory + identifying critical risk areas
Week 2Designing decision criteria + adoption rules
Week 3〜4Establishing safety nets for high-risk areas
Week 5〜7Phased improvement of priority debt
Week 8〜13Periodic audits + establishing routine reviews

Summary — From "an era where we can fix" to "evaluating, preserving stability, explaining, and handing over"

In an era where AI generates endless proposals, the scarce resource is not "hands to write fixes," but "criteria to make decisions." When supporting system maintenance in custom development, evaluating adoption by value and risk, preventing breakages with safety nets, and handing over documented rationales through "Refactoring Decision-Making and Tech Debt Governance Support" serves as our new core offering delivering decisive, non-breaking, and explainable improvements as deliverables.

If you are facing challenges like "unsure whether to accept AI suggestions," "technical debt is piling up," or "afraid of breaking things during modifications," feel free to contact us via our contact form.

Sources

Share this articleXFacebook
Kakeru Suzuki

Fascinated by the possibilities of technology, has had a deep interest in programming and digital art since student days

Turn this article's theme into your company's next step

Concrete steps forward for your organization.

We organize your desired architecture, legacy systems, and operational requirements to formulate your next steps toward execution.

  • Desired architecture
  • Integration with existing environments
  • Operational requirements
Consult on development & operations initiatives

You can consult with us from the initial conceptual stage. Details from this article will be carried over to the inquiry form.

Receive the latest articles by email