Resolved -
Dear Customer,
We would like to inform you that the system remains stable and is operating normally after the incident in the morning.
Incident Summary:
On Wednesday at 06:30 CET, a maintenance job was unexpectedly activated, triggering system alarms and causing downtime for the Response App, as well as intermediate issues with Central and alarm handling. The incident lasted several hours and resulted in service interruptions.
All alarms were successfully received during this period. However, due to the downtime in the response app, not all could be addressed immediately.
Immediate actions taken included:
- Adding additional servers
- Restarting servers
- Creating a new alarm-handling environment
We apologize for any inconveniences this incident may have caused and assure you that we are fully committed to preventing similar occurrences in the future.
Since this incident is related to the one on Friday 27th of Sept, a full Root Cause Analysis (RCA) will be provided in conjunction with that incident.
Kind regards,
Skyresponse Support
Web Portal: support.skyresponse.com
Phone: +46 10 888 5557
Oct 2, 18:07 CEST
Monitoring -
The response apps have been restored, all servers are fully operational. Alarm handling is functioning as expected, and we will be monitoring the system to ensure continued stability.
This issue is related to the one we encountered last Friday. Although we have not yet identified the root cause, our investigation is still ongoing, and we will provide an update as soon as we have more information.
Thank you for your patience.
Kind Regards,
Skyresponse Support
Web portal: support.skyresponse.com
Phone: +46 10 888 5557
Oct 2, 11:11 CEST
Update -
Thank you for your patience.
Central and its related services have been fully restored and are now working as expected.
We’re now shifting our focus back to restoring the response apps, which was temporarily paused. We’ll provide you with an update on the progress shortly.
If you have any questions in the meantime, feel free to reach out!
Best regards
Skyresponse support
Web portal: support.skyresponse.com
Phone: +46 10 888 5557
Oct 2, 10:38 CEST
Update -
We have found and implemented a workaround for the main issue.
We are restoring everything related to Central. This process is ongoing and we will give you an update on this soon. Once this is done we will restart the app services.
Oct 2, 10:10 CEST
Update -
We have seen that this incident may also cause some problems in Central, that new alarms are not showing automatically in the "Active" list. A refresh of the webpage or changing between respondent groups should solve this.
We are still working on the issues.
Oct 2, 09:32 CEST
Update -
We are still working on the issue with the response apps.
Currently there are no instances that are up and running and we are continuing to investigate how we can get these up and running again.
Oct 2, 09:20 CEST
Update -
We are continuing to work on getting the Response app up and working again with our highest priority.
Oct 2, 08:34 CEST
Identified -
The problem has been identified and we are still working on the issue.
As it is now it is only affecting response apps.
Response app environment is being scaled up and instances are being restarted.
Best regards
Skyresponse support
Oct 2, 07:54 CEST
Investigating -
Dear customer,
We currently have an ongoing incident with response app having problems with login and handling alarms.
We are still investigating the issue and will get back to you with an update soon.
We apologize for the inconveniences this incident may have caused you and ensure that we are doing our utmost to avoid any future problems.
Kind Regards,
Skyresponse Support
Web portal: support.skyresponse.com
Phone: +46 10 888 5557
Oct 2, 07:17 CEST