Title:
Privilege Manager Cloud (PMC) Issues in East US starting on April 3rd, 2024.

Impact:

Beginning on April 3rd, 2024, at approximately 7:52:40 PM ET, PMC customers would have started experiencing issues accessing their systems.

Issue:
On April 3rd, 2024, at approximately 7:52:40 PM ET, Azure SQL Databases in East US started experiencing issues. New connections to databases in this region may have resulted in an error or timeout. Existing connections remained available to accept new requests, however if those connections were terminated and re-established, they may have failed. Microsoft suspects that a potential deployment on their frontend gateways caused SQL database availability issues impacting customer connectivity. Microsoft worked to mitigate the issue by stopping the active rollout of their deployment.

Resolution:
At approximately 8:22 PM ET our monitoring systems started alerting regarding an issue. After initial triage, we estimated that roughly 25% of US based PMC customers were experiencing issues. At approximately 9:38 PM ET, affected PMC customers were back online and systems accessible. Our engineers monitored the Azure incident and waited for it to be fully resolved before closing the incident on our side. At approximately 11:29 PM ET on April 3rd, 2024, the Azure team declared the incident mitigated.

Action Items:
No action items to address.

Incident Start Time: April 3rd, 2024, 07:52:40 PM ET
Incident End Time: April 3rd, 2024, 11:29 PM ET