Back to overview
Downtime

CarbonMinus Service Healthcheck is down

Jun 02 at 01:06am IST
Affected services
CarbonMinus Service Healthcheck

Resolved
Jun 12 at 03:33pm IST

Title: "Temporary Time-Series Database Service Interruption"
Duration: June 12, 2025, 14:30 - 14:45 UTC (15 minutes)
Status: Resolved

Description: Our monitoring systems detected a temporary unavailability of the time-series database service during planned storage infrastructure maintenance. The service interruption occurred while expanding EBS volume capacity to accommodate growing data requirements.

Root Cause: Time-series database service became temporarily unavailable during EBS volume resize operation to increase storage capacity.

Resolution: Service recovery was handled automatically through our data pipeline architecture:
- Message queue system retained incoming data during the service interruption
- Time-series database service was automatically restarted after storage expansion
- Buffered data was automatically processed and ingested upon service restoration
- Data integrity verification completed successfully

Impact: Data ingestion was temporarily paused for approximately 15 minutes. No data loss occurred due to message queue buffering mechanisms.

Prevention: Future storage expansion operations will be performed using:
- Hot storage expansion techniques to minimize service interruption
- Enhanced monitoring for storage capacity thresholds
- Improved automated scaling procedures for storage infrastructure

Updated
Jun 02 at 01:21am IST

CarbonMinus Service Healthcheck recovered.

Created
Jun 02 at 01:06am IST

CarbonMinus Service Healthcheck went down.