Angry work venting [1/?]
All of the websites I'm responsible for are down right now and there's nothing I can do about it.
Our load balancer started dropping connections. We put in a ticket; no response for 2 hours. Now the LB is failing to load our most popular ecom site, so I call in and try to get someone to do something about the problem.
Shortly after that, all of our sites went down, hard.
It's been 6 hours since we reported this and the problem is now WORSE THAN WHEN WE REPORTED IT.
Angry work venting [2/?]
The only ticket update I've gotten that wasn't "I've escalated this" or "I will get back to you soon" was the following, verbatim:
"We still investigating. We have determinate that the Loadbalancer is working correctly. We need to check if there is an issue with the VMs."
We tested that. Extensively. I swiched hosts to point directly at the webservers and they all work great! Point at the LB, they all time out. I pointed this out earlier in the ticket, too.
Angry work venting [2/?]
@mawr Agggh.
This is starting to look like "escalate to your own management and start charging back the time you're down as a factor of lost sales."
Angry work venting [2/?]
@literorrery If I were the person writing the checks, I'd be doing that.
Hell, if I were two levels above me right now, I'd be forcing us to move to a new hosting provider because this is... I can't even begin to understand how they stay in business.