Skip to main content

Announcing our $20m Series A from GV (Google Ventures) and Workday Ventures Read More

Alex Cox · · 13 min read
How AI Is Changing the True Cost of SaaS Integrations

How AI Is Changing the True Cost of SaaS Integrations

Table of Contents

What I learned managing 700 connectors at Tray.ai. How AI is rewriting SaaS integration economics.

TL;DR: AI is rewriting the cost economics of SaaS integrations at every stage of the lifecycle. What you’ll learn:

  • Prioritization: a four-check filter for triaging integration requests (revenue, multi-customer, partnership cost, target-system longevity).
  • Delivery: production work, not the core data sync, is where integrations slip from two weeks to two months.
  • Maintenance: consumes roughly a quarter of the original build time per year, per connector.
  • AI shift: AI agents are the new integration consumer; they need dynamic auth, fine-grained tool scoping, and multi-tenant infrastructure most platforms weren’t built for.
  • Economics: AI-assisted tooling drops the ROI threshold for a new connector from two engineering-weeks to two engineering-hours.

When I took over the Customer Engineering team at Tray.ai, I inherited a connector catalogue of over 700 SaaS integrations. My team built, scoped, tested, documented, and maintained all of them.

I also inherited the debt: over 400 unused connectors, a bug backlog 150 tickets deep, no automated monitoring, and a team spending most of its time firefighting rather than building.

I spent the next year turning that around — shifting to quality over quantity, implementing automated monitoring, clearing the backlog, and upskilling the team on AI. It was the most concentrated education in integration management I could have asked for.

This is the field guide I wish someone had given me on day one: the lifecycle cost of integrations at scale, what breaks, what I changed, and how AI is reshaping the economics at every stage. If you’re an engineering leader deciding whether to build or buy your integration layer — or if you’re building AI agents that need to talk to enterprise SaaS — this is for you.

How to prioritize your SaaS integration roadmap

Every integration starts with a request. A customer wants to connect to their HRIS. A prospect says they’ll sign if you support Workday. Your product team wants a native Salesforce sync. The requests pile up, and the instinct — especially at growing companies — is to say yes to all of them.

At Tray, the strategy had been to guarantee new connector builds for new customers. That makes sense early on. You’re a platform company. Connectors are the product. But at scale, this creates a long tail of connectors that don’t justify their maintenance cost. A customer requests a connector for a niche system. The team provisions a developer account (sometimes paid), spends engineering time building it, and delivers. The connector satisfies one narrow use case. A few months later, the customer moves on. The connector remains — unused but still a liability.

The integration request queue becomes a feature factory. Nobody asks hard questions about ROI per connector, or whether it’s better to invest in developer tooling and let customers build into your platform rather than building out to every system they ask for.

How I fixed integration prioritization at Tray

I started treating integration requests like product decisions, against three checks:

  • What’s the revenue attached?
  • Are multiple customers asking, or is this a one-off?
  • Does the target system require a paid developer account or a partnership?

If the answer was “one customer, low plan, niche system,” the maths didn’t work. That filter alone changed where the team spent its time.

The retirement question matters just as much as the build question. Those 400+ low-usage connectors in my catalogue weren’t just wasted build effort — they were ongoing cost. Each one could break and generate a support ticket. Each one was a risk during sales cycles. Each one cluttered the catalogue. I had to get honest about which connectors were worth maintaining and which were liabilities. Setting usage thresholds — flag at six months of zero usage, sunset at twelve — turned out to be one of the highest-leverage decisions I made.

How to use AI to prioritize integration requests

AI helps on three fronts: agent-assisted prioritization, agent-assisted development, and agent-assisted retirement.

Agent-assisted prioritization. Agents can analyse patterns across integration requests, cross-reference customer revenue data, and flag which have the strongest business case. They can surface partnership requirements early — developer sandbox sign-ups, partner programme contacts — so you’re not blindsided three weeks into a build.

Agent-assisted development. When AI-assisted development drops the cost of building a connector from weeks to hours, the ROI threshold changes entirely. A connector that wasn’t worth two weeks of engineering time might be worth two hours. The discovery conversation shifts from “should we build this?” to “how cheaply can we build this, and does the customer even need our help?”

Agent-assisted retirement. Agents can run impact analysis across your customer base, identify who’s affected by a retirement, generate communication plans, and suggest migration paths. When your infrastructure manages connectors centrally rather than as separate codebases, retirement becomes a configuration change rather than a code project.

How to scope and deliver SaaS integrations

Scoping is where integration projects either succeed or quietly start failing.

How I fixed integration delivery at Tray

Integration scoping. The question sounds simple: what exactly do we need to build? But the customer’s Netsuite instance has custom objects. Their Salesforce org has field-level security that blocks the standard API. Their on-prem Microsoft tenant uses a non-standard auth flow. None of this appears in the vendor’s public docs.

The most common failure: not getting the right people involved early enough. For Netsuite, you need the customer’s Solutions Architect — the person who actually maintains that specific instance. For on-prem systems, you need the System Admin who manages infrastructure and access. Without them, you’re scoping against documentation rather than reality. And documentation is often wrong.

Sandbox access is the other bottleneck. Either the sandbox doesn’t exist, it doesn’t replicate production, or nobody knows which account tier unlocks the right endpoints. Enterprise systems have confusing product names, and API names don’t always match. I’ve seen teams lose weeks because they signed up for the wrong developer plan. My rule: no sandbox, no scope. It sounds rigid, but it saves months of rework.

Integration prototyping. Once scoping is done, prototyping should be fast. In practice, it’s often where momentum dies. A developer tests a connection and something fails. Is it connectivity, auth, permissions, or a schema mismatch? Distinguishing between these requires vendor-specific expertise usually locked in one person’s head. And many platforms don’t let developers test locally — they have to work through the platform’s dev environment, adding layers of abstraction between them and the actual API.

Integration deployment. A working prototype and a production deployment are not the same thing. Most production work has nothing to do with the core data sync. It’s:

  • Credential storage and rotation
  • Rate limit handling
  • Schema validation
  • Meaningful error messages
  • Webhook payload inconsistencies
  • Customer-facing documentation

The most common trap is scope creep through edge cases: a field that’s optional in the spec turns out to be required for a specific workflow. A webhook payload has a different structure for certain event types. Each edge case pushes the timeline. The integration scoped for two weeks takes two months.

How to use AI to deliver SaaS integrations

AI helps on three fronts: agent-assisted integration scoping, agent-assisted integration prototyping, and agent-assisted integration deployment.

Agent-assisted integration scoping. AI agents can scope SaaS integrations by parsing API specs in machine-readable formats — Swagger for REST, WSDL for SOAP, GraphQL introspection schemas — comparing them against your existing integrations, identifying gaps, flagging missing scopes or permissions, and assessing feasibility before anyone writes a line of code. They can also interpret unstructured documentation — custom PDF guides, complex enterprise environments — and determine exactly which sandbox account type you need for a specific set of endpoints. That’s the kind of tedious research that used to eat a full day of an engineer’s time.

Agent-assisted integration prototyping. AI agents that can read API documentation, generate connector configurations, and test them against live providers are compressing this phase from days to hours. The manual work that dominated prototyping — reading docs, writing boilerplate, trial-and-error testing — is exactly the structured, repetitive implementation that AI handles well.

Agent-assisted integration deployment. This is where the agentic approach starts to pay off. Deterministic integrations need pre-built handling for every scenario. Agentic integrations can adapt at runtime — when a field is unexpectedly null or a payload structure varies, an agent can reason about the situation rather than throwing an unhandled exception. It doesn’t eliminate testing, but it reduces the number of edge cases that require custom code. Integration gateways that handle credential storage, rate limits, error handling, and observability can absorb most of this production complexity. And if you’re building AI agents specifically, there’s a concern most teams don’t think about until it’s too late: prompt injection through tool responses. When an agent reads data from a third-party system, that data can contain instructions that manipulate the agent’s behaviour. It’s the #1 risk in the OWASP LLM Top 10, and it’s worth factoring into your production security planning from the start.

How to manage SaaS integrations at scale

This is the stage nobody budgets for, and the one that caused more pain than any other during my time at Tray.

How I fixed integration maintenance at Tray

Maintenance means bugs, edge cases that surface months after deployment, and vendor product releases. Salesforce, Shopify, Workday — major platforms release new API versions regularly, sometimes quarterly. Each version can deprecate endpoints, change schemas, or alter authentication flows. Keeping integrations compatible requires dedicated engineering time, sometimes a full-time developer per major vendor.

When I took over at Tray, we were scrambling to address API changes, the bug backlog had grown to 150 tickets, and maintenance competed directly with new builds. We made three changes:

  • Implemented automated monitoring
  • Built a prioritised roadmap
  • Shifted from reactive bug fixes to proactive upgrades

Even then, keeping up with Shopify’s versioning cycle and Salesforce’s seasonal releases required constant effort. That work was invisible to everyone outside engineering. It didn’t show up in feature announcements. It just kept the lights on.

Here’s the thing teams don’t expect: maintenance cost goes up with scale, not down. You’d think there would be economies — shared patterns, reusable components, accumulated expertise. And there are, for the build phase. But maintenance doesn’t scale that way. More connectors means more engineers, which means management overhead. More vendor relationships to track. More changelogs to monitor. More breaking changes landing the same week. At one point we had over 30 engineers working on connectors at Tray. We scaled that down because it wasn’t sustainable — and the tech debt I inherited was the direct result.

A useful rule of thumb: maintenance consumes up to a quarter of the original build time every year. A connector that took two weeks to build costs two to three days a year to keep alive. Multiply across hundreds of connectors and you’re looking at multiple full-time engineers doing nothing but maintenance.

How to use AI to maintain SaaS integrations

AI helps on three fronts: agent-assisted change detection, agent-assisted runtime adaptation, and agent-assisted connector updates.

Agent-assisted change detection. AI agents can maintain SaaS integrations by monitoring vendor changelogs, identifying which integrations are affected by a new API version, detecting broken connectors, generating impact assessments, and drafting migration plans.

Agent-assisted runtime adaptation. Agentic integrations that interact with APIs dynamically — rather than relying on hardcoded endpoint mappings — can absorb some schema changes without manual updates.

Agent-assisted connector updates. AI-assisted connector updates can compress what used to be weeks of migration work into hours, because the same tooling that helps you build a new connector helps you update an existing one.

What AI agent integration changes

Everything above assumes a human is at the end of the integration. A person configures the sync. A person maps fields. A person notices when something breaks and opens a ticket.

AI agents change every assumption in that chain — and introduce problems the old model never had to deal with.

What AI agents do differently than humans

Three things change in how integrations operate:

  • Agents read API schemas and reason about them, instead of mapping fields manually
  • Agents adapt at runtime, instead of needing pre-built handling for every edge case
  • Agents monitor, diagnose, and propose fixes, instead of waiting for someone to notice a broken integration

What infrastructure AI agents need

AI agent integration requires infrastructure that most platforms weren’t designed for. A human integration runs on a fixed schedule, hitting known endpoints with pre-configured credentials. An agent might need to call any API endpoint, for any customer, at any time. That requires dynamic credential management, fine-grained tool scoping, and multi-tenant auth infrastructure.

Why unified APIs fight agent training

Unified APIs fight AI agent integration in a subtler way: LLMs were trained on Workday’s docs and Jira’s JQL reference. Route agent requests through a unified API that renames fields and restructures payloads, and you’re fighting the model’s own training. The agent knows what a Salesforce Opportunity looks like. If your integration layer transforms it into a generic “deal” object with different field names, the agent has to learn your abstraction on top of the vendor’s API. That’s a tax on every single interaction.

The companies that will build the best integration experiences are the ones that combine AI-assisted development with strong partnerships, proper scoping discipline, and realistic maintenance planning. The tooling has changed dramatically. The fundamentals haven’t.

Why I left Tray for StackOne

These lessons are why I left Tray for StackOne.

I’d spent a year grinding through the integration lifecycle the hard way. I knew the cost. I also knew the model was being overtaken.

StackOne is built for AI agents that need reliable, real-time access to enterprise SaaS. The production infrastructure I spent years wishing for — credential management, rate limiting, observability, prompt injection protection — is the platform. The connector lifecycle that consumed entire engineering teams is handled centrally. Agents get native API schemas, not translation layers like unified APIs that fight their training.

It’s the infrastructure I would have wanted to plug into at Tray, and the one I’d recommend to any team about to learn these lessons the hard way.

If you’re building integrations at scale, what does your maintenance-to-new-build ratio look like? I think this is a conversation the industry needs to have more openly.


Alex Cox works at StackOne, an integration infrastructure company for AI agents. Previously, he was Head of Customer Engineering at Tray.ai.

Frequently Asked Questions

What's the true cost of building SaaS integrations at scale?
The true cost of SaaS integrations at scale is the maintenance compound, plus the debt of unused connectors. Gartner sized the iPaaS market at $8.5B in 2024, forecast to exceed $17B by 2028. At Tray.ai, this meant 30 engineers managing 700 connectors with 400+ unused — each a recurring liability.
How is AI changing the cost of SaaS integrations?
AI is changing the cost of SaaS integrations by compressing every lifecycle stage: agents triage requests against revenue data, and AI-assisted tooling builds connectors in hours instead of weeks. McKinsey measured 35-45% faster code generation with gen AI; Gartner forecasts 33% of enterprise apps will include agentic AI by 2028.
Why is SaaS integration hard?
SaaS integration is hard because every vendor has different schemas, custom objects, and auth flows that don't appear in public docs — Salesforce field-level security, NetSuite custom objects, non-standard Microsoft auth. McKinsey's study with Oxford of 5,400+ IT projects found 45% run over budget and deliver 56% less value than predicted.
How do you prioritize SaaS integration requests?
Prioritize SaaS integration requests with four checks: revenue attached, multi-customer demand, paid developer account or partnership requirement, and target-system longevity. At Tray.ai, applying this exposed 400+ of 700 connectors as unused. Gartner forecasts 40%+ of agentic AI projects will be canceled by 2027 — prioritization filters cancellation risk.
What is the maintenance cost of SaaS integrations?
The maintenance cost of SaaS integrations consumes up to a quarter of the original build time per year. McKinsey found developers spend 20-30% of their time on integration glue work. Salesforce releases, Shopify's versioning cycle, and Workday's quarterly updates drive constant rework — across hundreds of connectors, that's multiple FTEs.
Can AI agents be integrated with existing SaaS systems?
AI agents can be integrated with existing SaaS systems. The work involves vendor-specific auth flows, per-user permission management, mapping REST/GraphQL APIs to agent-callable actions, context-window-aware execution, and protecting the attack surface against indirect prompt injection.
Is AI agent SaaS integration hard?
AI agent SaaS integration is hard because the plumbing is substantial: auth types vary by vendor, permissions need per-user management, APIs need mapping to agent-callable actions, context windows must be managed for accuracy, and the attack surface widens for indirect prompt injection. McKinsey found developers spend 20-30% of their time on integration glue work. Platforms like StackOne's MCP gateway absorb this lifecycle centrally instead of leaving it on your engineering team.

Put your AI agents to work

All the tools you need to build and scale AI agent integrations, with best-in-class connectivity, execution, and security.