Weeee...
spent 2 hours in a call with MS support today... apparently we found a bug with deploying Azure Application Gateways with Terraform =/
Something we did caused a partial deployment that failed into a bad state and that couldn't be unfucked even by deleting the resource..