Networking Issues DC2 and DC3
Incident
Report for Liquid Web - Services
Resolved
The patching process has been completed, and our engineers have successfully updated all remaining affected systems. All updates were applied with minimal, expected interruptions.
Thank you for your patience and understanding while we worked through this event. If you experience any issues or need assistance, please contact our Support Team via Live Chat or by opening a Support Case.
Thank you, the Liquidweb Team.
Thank you for your patience and understanding while we worked through this event. If you experience any issues or need assistance, please contact our Support Team via Live Chat or by opening a Support Case.
Thank you, the Liquidweb Team.
Update
We sincerely appreciate your continued cooperation throughout the firewall upgrade initiative. Significant progress has been made so far, and our teams remain fully focused on planning and completing the remaining upgrades as efficiently and smoothly as possible.
For those clients we have not yet heard back from, we are now moving forward with scheduling the remaining firewall replacements. Our team is reviewing availability and coordinating the final windows to ensure minimal impact wherever possible. You will be contacted soon with the confirmed date and time for your specific upgrade.
Thank you again for your partnership and patience as we work to complete this critical improvement.
For those clients we have not yet heard back from, we are now moving forward with scheduling the remaining firewall replacements. Our team is reviewing availability and coordinating the final windows to ensure minimal impact wherever possible. You will be contacted soon with the confirmed date and time for your specific upgrade.
Thank you again for your partnership and patience as we work to complete this critical improvement.
Update
We sincerely appreciate your ongoing cooperation in coordinating firewall upgrades with our team. Significant progress is being made across this initiative, and our teams remain focused on completing the remaining upgrades as efficiently and effectively as possible.
All affected clients have been contacted, and many of the firewall replacements have now been completed. For the few pending replacements, we are waiting for the scheduling confirmation from the remaining clients.
For any clients we do not hear from, we will proactively coordinate a replacement window and notify you once it is scheduled.
We thank you for your continued partnership as we finalize this critical infrastructure upgrade.
All affected clients have been contacted, and many of the firewall replacements have now been completed. For the few pending replacements, we are waiting for the scheduling confirmation from the remaining clients.
For any clients we do not hear from, we will proactively coordinate a replacement window and notify you once it is scheduled.
We thank you for your continued partnership as we finalize this critical infrastructure upgrade.
Update
We sincerely appreciate the continued cooperation from all clients in scheduling their firewall upgrades with our team.
We are making strong and consistent progress across this initiative. Our teams are diligently working to complete the remaining upgrades as effectively and efficiently as possible.
We will continue to proactively reach out to affected clients to schedule their 2-hour replacement window once their new hardware is prepped.
Thank you for your ongoing partnership as we complete this critical infrastructure upgrade.
We are making strong and consistent progress across this initiative. Our teams are diligently working to complete the remaining upgrades as effectively and efficiently as possible.
We will continue to proactively reach out to affected clients to schedule their 2-hour replacement window once their new hardware is prepped.
Thank you for your ongoing partnership as we complete this critical infrastructure upgrade.
Update
We’d like to thank our clients who have scheduled their firewall replacements with our team. Coordination and replacements for end of life firewalls have started smoothly in this next phase, and we appreciate the timely responses that have helped keep this process on track.
We will continue to reach out to affected clients once a firewall is prepped and ready for replacement. As we continue with the remaining replacements, clients are encouraged to coordinate directly with our Support Team through their ticket once a new firewall is ready to go for their account. This will be an approximate 2 hour window of down time.
We appreciate your continued partnership and cooperation as we complete this important upgrade initiative. Further updates will be shared here as progress continues.
We will continue to reach out to affected clients once a firewall is prepped and ready for replacement. As we continue with the remaining replacements, clients are encouraged to coordinate directly with our Support Team through their ticket once a new firewall is ready to go for their account. This will be an approximate 2 hour window of down time.
We appreciate your continued partnership and cooperation as we complete this important upgrade initiative. Further updates will be shared here as progress continues.
Update
Our networking and data center teams continue to work on firewall replacements for clients who are on end of life hardware. Clients affected by this next step should check their customer portal for a notification ticket regarding the required firewall upgrade. Please coordinate in the ticket a window of time where our teams can perform the hardware replacement and upgrade. This will be an approximate 2 hour window of down time.
This upgrade is part of our ongoing efforts to ensure your infrastructure remains secure and fully supported.
We appreciate your continued cooperation and understanding as we complete this important maintenance initiative. Further updates will be provided here as work continues.
This upgrade is part of our ongoing efforts to ensure your infrastructure remains secure and fully supported.
We appreciate your continued cooperation and understanding as we complete this important maintenance initiative. Further updates will be provided here as work continues.
Update
Our Network Team has completed the patching and upgrade phase for client firewalls. All systems have been updated as planned; however, a small number of firewalls that have reached end-of-life status will need to be replaced.
Clients affected by this next step should check their customer portal for a notification regarding the required firewall upgrade. This upgrade is part of our ongoing efforts to ensure your infrastructure remains secure and fully supported.
We appreciate your continued cooperation and understanding as we complete this important maintenance initiative. Further updates will be provided here as work continues.
Clients affected by this next step should check their customer portal for a notification regarding the required firewall upgrade. This upgrade is part of our ongoing efforts to ensure your infrastructure remains secure and fully supported.
We appreciate your continued cooperation and understanding as we complete this important maintenance initiative. Further updates will be provided here as work continues.
Update
As a quick update - our team has been working round the clock on the patching process, and we're seeing tremendous progress so far. Everything we patched so far has gone smoothly, with only minimal interruptions, to ensure all machines are patched and updated successfully.
If you have a hardware firewall, please take a moment to check your customer portal for any maintenance ticket notifications. We'll be reaching out to each client directly before starting their maintenance.
Should you notice any issues following your upgrade or have any questions, please don't hesitate to get in touch with our Support team - we'll be happy to help. Most updates are still expected to cause only brief interruptions of around 30 minutes or less, and high-availability firewall setups may see little to no downtime.
We truly appreciate your continued patience and understanding while we complete this important phase of the upgrades. We'll keep this space updated as we make further progress.
If you have a hardware firewall, please take a moment to check your customer portal for any maintenance ticket notifications. We'll be reaching out to each client directly before starting their maintenance.
Should you notice any issues following your upgrade or have any questions, please don't hesitate to get in touch with our Support team - we'll be happy to help. Most updates are still expected to cause only brief interruptions of around 30 minutes or less, and high-availability firewall setups may see little to no downtime.
We truly appreciate your continued patience and understanding while we complete this important phase of the upgrades. We'll keep this space updated as we make further progress.
Update
Our Network Team has made significant progress in the current phase of client patching and upgrade work. Operations are proceeding smoothly.
As we move into the weekend, additional patching and upgrade work will continue. Clients with hardware firewalls should check their customer portal for any maintenance ticket notifications.
If you experience any issues following your upgrade, please reach out to our Support Team for assistance. Most updates are still expected to result in brief interruptions of 30 minutes or less. High-availability firewall configurations may see less downtime or possibly none.
We appreciate your continued patience and understanding as we complete this phase of the upgrades. Further updates will be shared here as our work progresses.
As we move into the weekend, additional patching and upgrade work will continue. Clients with hardware firewalls should check their customer portal for any maintenance ticket notifications.
If you experience any issues following your upgrade, please reach out to our Support Team for assistance. Most updates are still expected to result in brief interruptions of 30 minutes or less. High-availability firewall configurations may see less downtime or possibly none.
We appreciate your continued patience and understanding as we complete this phase of the upgrades. Further updates will be shared here as our work progresses.
Update
Our Network Team has covered a great deal of ground as we continue progressing through the upgrade schedule. Updates and patching are being completed in cohorts to ensure a controlled and efficient roll out.
Clients with hardware firewalls should continue to check their customer portal for ticket notifications regarding scheduled maintenance.
We appreciate your continued patience and understanding as we work to complete these updates across all environments. Further updates will be posted here as progress continues.
Clients with hardware firewalls should continue to check their customer portal for ticket notifications regarding scheduled maintenance.
We appreciate your continued patience and understanding as we work to complete these updates across all environments. Further updates will be posted here as progress continues.
Update
This work is still in progress, and our engineers continue to update the remaining affected systems.
Clients with hardware firewalls will continue receiving direct maintenance notifications via support tickets. Most updates are still expected to result in brief interruptions of 30 minutes or less.
We appreciate your continued patience as we work through the remaining updates. Further updates will be posted here as progress continues.
Clients with hardware firewalls will continue receiving direct maintenance notifications via support tickets. Most updates are still expected to result in brief interruptions of 30 minutes or less.
We appreciate your continued patience as we work through the remaining updates. Further updates will be posted here as progress continues.
Update
Our Network Team has made strong progress on the ongoing network patching. This work will continue over the next few days as we complete updates across all systems.
Our engineers are working continuously to ensure the process is completed efficiently and with minimal impact. Clients with hardware firewalls will continue to receive direct maintenance notifications via support tickets. Most updates result in brief interruptions of 30 minutes or less.
We have high confidence that high-availability firewall configurations can be updated without downtime, however we may not be able to guarantee zero interruption.
We appreciate your patience and understanding as we complete this important upgrade. Further updates will be posted here as progress continues.
Our engineers are working continuously to ensure the process is completed efficiently and with minimal impact. Clients with hardware firewalls will continue to receive direct maintenance notifications via support tickets. Most updates result in brief interruptions of 30 minutes or less.
We have high confidence that high-availability firewall configurations can be updated without downtime, however we may not be able to guarantee zero interruption.
We appreciate your patience and understanding as we complete this important upgrade. Further updates will be posted here as progress continues.
Update
Our Network Team will be installing security patches over the next few days to fully resolve this issue. Any clients with hardware firewalls that were affected will receive a ticket regarding an emergency maintenance. Security patching will result in down times of 30 minutes or less. High-availability firewall configurations can be patched without any downtime. Please check your customer portal for that notification.
We understand that up-time is critical, and we appreciate your cooperation as we take this proactive measure to protect your systems from potential threats.
We will keep this status page updated with our team's progress.
We understand that up-time is critical, and we appreciate your cooperation as we take this proactive measure to protect your systems from potential threats.
We will keep this status page updated with our team's progress.
Monitoring
Our Liquid Web Networking team identified the the networking issue with our DC2 & DC3 data centers. Networking is currently back online.
We will continue to monitor the system to ensure stability.
Thank you for your continued patience.
We will continue to monitor the system to ensure stability.
Thank you for your continued patience.
Update
We are continuing to investigate this issue.
Investigating
Liquid Web Systems Engineers are currently investigating a networking issues in our DC2 & DC3 Data Center.
Liquid Web's Networking team have been engaged and are working to restore service as quickly as possible. We will provide further updates as soon as they become available.
Our support team is on standby if you need any help or have questions or concerns. If you have any questions or concerns, please contact a member of our support team via live-chat or ticket (support@liquidweb.com).
Liquid Web's Networking team have been engaged and are working to restore service as quickly as possible. We will provide further updates as soon as they become available.
Our support team is on standby if you need any help or have questions or concerns. If you have any questions or concerns, please contact a member of our support team via live-chat or ticket (support@liquidweb.com).
This incident affected: Network (LAN Network).