Following a thorough investigation, we have determined the root cause of the recent incident stemmed from a missing index in one of our databases; leading to the failure of our services to establish connections and causing them to exhaust the connection pools within our API gateway due to repeated retries.
The oversight occurred during a code repository merge, where the absence of indexes went unnoticed. Once identified, we promptly addressed the issue, implementing necessary fixes to prevent its recurrence.
While the incident resulted in degraded access to our entire API suite, we are pleased with the swift resolution achieved. We remain committed to maintaining the reliability and performance of our services, prioritizing proactive measures to prevent similar occurrences in the future.