Salesforce Inc. — supplied — InvokeEndpoint
Salesforce Inc. — supplied — InvokeEndpoint
This lets Salesforce add capacity securely while keeping its data residency commitments.
"With the new cross-Region inference routing in Amazon SageMaker AI, we can add capacity securely and keep our data residency commitments.
It uses the capacity you have deployed, and each endpoint's own autoscaling keeps adding instances as its traffic grows.
In design reviews, the team also raised the risk of cascading failures: moving traffic during an incident can overload the next Region, so Salesforce needed a cap on cross-Region traffic.
First, the gateway had no capacity signals from either the local or the remote endpoint, so it couldn't tell when to shift traffic or whether the destination had room.
This post shows how Salesforce set up the cross-Region inference routing in SageMaker AI and how it lets the team add capacity securely while keeping its data residency commitments.
Rebuilding software around a fundamentally different architecture takes time, he stated, giving newer companies an opportunity to attract customers while incumbents work to overhaul their existing products.
"We see this as an electric-car moment for systems of record," he said, adding that AI requires a fundamental rethink of how CRMs are built - not simply adding new features to existing platforms.