Bear of a morning here at Feanor Towers.
Multiple hardware failures, and me making an arse of things making it worse...
I was in Romania last week, and lost contact with my servers back home.
Call home, and yes, the Internet went down overnight and didn't come back.
Guided them through some basic diagnostics, and we have no blinkenlights on the Firebrick firewall appliance.
Looks like a failed PSU ( internal ).
It's done that before.
Ordered replacement PSU to arrive yesterday just as I get home.
Hmm, it's not the PSU.
There's perfectly good 5v going to the main board. Main board has further on-board regulators and the test points show a lack of 3.3v.
Call to AAISP, and they agree to send me a loaner whilst I send back the failed unit.
In the meantime, I cobble together an alternative firewall out of chewing gum and Intel network cards to get the rest of the family off my case.
So today, replacement FB arrives, and I go to restore my saved config onto it.
But my last saved config was a bit old, and there had been changes since then.
So I'd manually edited the XML config file to current spec before restoring it.
All is well, and Internet Connectivity is restored.
Then the IP phone rang.
From extension 1002.
I don't have an extension 1002.
The call did not come in over the landline, it came in over IP.
But it hadn't come in to the Asterisk box over any of the IAX trunks I have from other family member's Asterisk boxes,
nor had it come in over the landline ( the landline phone did not ring ). So how had the call come in to the Asterisk box?
I don't allow unsolicited SIP inbound through the firewall (Because people try to rape your Asterisk box for free phone calls onto the PSTN).
Dawning realisation...The firewall is not firewalling.
Pull the Internet connection straight away.
Check the config: I've messed it up manually editing, and got the default no-match to ALLOW not REJECT!!!
Fix this in short order.
But in the meantime, my 2 Win Server 2008R2 boxen have been compromised, and were hammering the Internet themselves.
I've just finished restoring them from backups.
And mid-way through fixing them, I lost the Remote Desktop Connection to both of them.
This time, it was a gigabit switch that decided to give up.
All port lights jammed on solid, no blinken like normal.
Replaced the switch and finally got the servers back up, and we're done.
I'm going to have a glass of grog with my lunch now!