Page 1 of 3

Today's server problems

Posted: 21 Dec 2023 20:31
by exxos
Apologies for the downtime I really don't know what happened :(

All I did was create a new SQL user in phpmyadmin, then I got booted out. I tried to log back in nope.. Could not even login as root anymore..

After battling away, I managed to restore root access to the SQL server.. When I got in, the entire user list had totally vanished :shock: :shock:

So I'm having to create new accounts and change loads of passwords and such to get it all back up and running again. :roll:

Currently I am getting my emails functional again.. But I think the forum, web store and website is currently fine. No data was lost as far as I can tell during all this escapade.

Thanks for playing Ubuntu servers!

:cheers: :fire: :fire: :shite: :hide: :shite: :fire:

Re: Today's server problems

Posted: 21 Dec 2023 20:50
by rubber_jonnie
Glad it's back up again, great effort getting it working again.

Re: Today's server problems

Posted: 21 Dec 2023 21:03
by rmahlert
Hats off to you.. I know all too well how they can be a nightmare!

Rob

Re: Today's server problems

Posted: 21 Dec 2023 21:05
by troed
What does your backup solution look like? ;)

Re: Today's server problems

Posted: 21 Dec 2023 21:08
by exxos
troed wrote: 21 Dec 2023 21:05 What does your backup solution look like? ;)
I have full backups of the database every hour, but it does not really help when you cannot log into the thing to restore them :roll:

Re: Today's server problems

Posted: 21 Dec 2023 21:10
by exxos
rmahlert wrote: 21 Dec 2023 21:03 Hats off to you.. I know all too well how they can be a nightmare!
Thanks, yes I think you suffered a much worse fate than me though...

Re: Today's server problems

Posted: 21 Dec 2023 21:49
by stephen_usher
Glad that you managed to recover. What a pain.

Re: Today's server problems

Posted: 21 Dec 2023 22:02
by exxos
stephen_usher wrote: 21 Dec 2023 21:49 Glad that you managed to recover. What a pain.
Yep. It certainly poses a bit of a backup and restore conundrum which I had not previously envisioned :roll: Though I have wrote everything down step by step on how to recover the user database manually should I need to do it again!

Ultimately the worst-case would likely be we could lose the last few posts on the forum during a full disk restore and restoring the SQL and HTML backups afterwards. It is a pretty much a "solve all" solution. Though if I did that, it would have taken ages anyway. But I would not have known what had gone wrong unless I investigated it. I have no idea how the user list got trashed but at least I have solutions for that problem should it occur again now. Ironically I have been creating users exactly the same way and nothing has happened this time around. Baffling!

Re: Today's server problems

Posted: 21 Dec 2023 23:36
by PhilC
I’d like to take this opportunity to once again say “it wasn’t me.”

Re: Today's server problems

Posted: 22 Dec 2023 06:46
by supaduper
Thanks for all the hard work you do keeping this site going dude, it really is appreciated, and Merry Chrismas fella 8-)