Monitoring systemic drift may guide the next phase of organizational resilience

Artificial intelligence seems to be creating increasingly interconnected enterprise ecosystems, expanding the complexity of how organizations govern technology across their operations. As AI becomes more deeply embedded in critical workflows, maintaining visibility into system dependencies appears to emerge as a significant leadership consideration. According to an AI sovereignty study, 91% of surveyed executives said they do not fully understand their organizations’ AI dependencies. Meanwhile, respondents also reported an average of six AI-related disruptions over the previous two years. Together, these findings suggest that governance practices may need to evolve alongside AI itself.

Jeffrey Rachlin and his partner Andy Hyman have observed a similar pattern across complex environments. In their experience, many organizations continue to investigate failures after visible disruption has already occurred. As AI systems assume greater autonomy across business processes, retrospective analysis may offer only part of the picture, creating an opportunity to consider governance methods that identify meaningful changes while intervention remains possible.

Jeffrey Rachlin

This perspective reflects a broader change in how organizations may think about operational health. Monitoring often emphasizes outcomes through dashboards, reports, and key performance indicators. The duo emphasizes that those tools remain valuable, yet they typically describe the results produced by a system instead of the relationships within the system that generated those results.

By the time performance metrics indicate concern, the conditions contributing to that outcome may already have been developing for some time. Hyman and Rachlin believe organizations may benefit from complementing performance monitoring with greater attention to system behavior, interaction patterns, and evolving dependencies that influence resilience long before visible disruption emerges.

The 💜 of EU tech

The latest rumblings from the EU tech scene, a story from our wise ol' founder Boris, and some questionable AI art. It's free, every week, in your inbox. Sign up now!

Rachlin explains, “Resilience starts to fail long before a disruption becomes visible. Organizations often strengthen their future when they develop the ability to understand how their systems are changing while those changes are still manageable.”

That philosophy aligns with Hyman’s Marginal Point of Systemic Drift (MPOSD) framework, which explores whether specific patterns can indicate that governance visibility is becoming less reliable before operational consequences become apparent. Instead of attempting to predict every future event, the framework focuses on identifying structural signals that may indicate when a system is becoming increasingly difficult to evaluate independently.

Rachlin and Hyman have identified five recurring indicators that appeared together across multiple complex-system scenarios. The first, verification integrity degradation, reflects situations where system outputs evolve more quickly than independent verification processes. Proxy substitution escalation follows when alerts, reviews, or operational indicators no longer provide an accurate representation of system activity.

Andy Hyman

Incentive-proof misalignment describes circumstances in which a system has limited structural incentive to reveal its own drift. Latency inflation and feedback distortion emerge as delays between action and visibility become increasingly meaningful for decision-makers. Finally, governance independence erosion develops when oversight mechanisms rely on the same systems they are intended to evaluate.

According to the duo’s observations, these signals become especially meaningful when they converge instead of appearing in isolation. Hyman says, “Complex systems rarely become difficult to govern in a single moment. Governance changes when independent visibility begins to narrow, and recognizing that transition may create valuable opportunities for informed decision-making.”

The importance of independent visibility has become easier to appreciate through recent AI incidents, according to Rachlin. In one case, an autonomous coding agent deleted production data and backups within seconds after operating outside its intended boundaries. Hyman and Rachlin’s retrospective application of MPOSD suggested that observable indicators may have appeared before the irreversible stage of the sequence. While retrospective analysis cannot establish future outcomes, the duo believes the incident illustrates how identifying structural changes earlier could expand the range of governance decisions available before disruption occurs.

This perspective aims to encourage leaders to reconsider how organizational health is evaluated. Dashboards and KPIs remain meaningful components of executive oversight, yet increasingly interconnected AI ecosystems may also benefit from monitoring the relationships linking systems together. Independent assessment of governance health, viewed separately from the systems under evaluation, may provide additional context that supports more informed operational decisions as complexity continues to increase.

Rachlin says, “AI is likely to keep growing its presence in enterprise settings, opening up fresh possibilities while also raising new questions about how organizations manage and guide its use. The technology can offer strong capabilities, but a company’s ability to stay resilient may also hinge on noticing shifts early before they turn into bigger operational challenges.”

As Hyman and Rachlin’s work suggests, anticipating systemic drift may complement traditional governance in ways that support more informed leadership decisions. Organizations that continue developing their capacity to recognize early signals alongside responding thoughtfully to visible outcomes may help define the next chapter of innovation with greater confidence and resilience.