Yesterday's problems with the site

12 Jan 2007 7:16 (Edited: 12 Jan 2007 7:16)

Yesterday the site had it's share of problems. First the secondary database server (aka slave server) halted with an I/O error. Since some new queries had recently been routed to this server, it took down the site and forums, when the Web servers tried to send queries to the server that was down. This was quickly fixed by a change to the slave server monitoring script.

Later that day the primary database server (aka master) started slowing down when queries started to accumulate. It turned out that the updated monitoring script failed to detect the change in the slave server status properly, which caused all the queries to be routed to one DB server at a peak hour. Which obviously spelled trouble. Another quick fix (where would I be without my "smart"phone), and things were back on track.

The secondary DB server is scheduled for diagnostics at 01:00 CST, so the site might be slower to respond from around midnight (server time) to maybe 2:00 AM.

Tags: afterdawn  problems  site 

List of my blog entries

• Routing between LAN and VPN behind NAT (02 Mar 2009)
• Power consumption of common home electronics devices (19 Nov 2007)
• Downloads more accessible to users with firewalls (25 Jun 2007)
• More download capacity added (28 Feb 2007)
• Fixed problems with blog image scaling functions (20 Jan 2007)
• Further problems with the DB server (updated) (13 Jan 2007)
• Bypassing lock code on Nokia phones (27 Dec 2006)
• iptables and vsftpd with ssl (25 Sep 2006)
• Replying to feedback mail (24 Jan 2006)
• Windows XP HDD stuck in PIO mode instead of DMA (13 Jan 2006)
• Problems with Windows Update (07 Jan 2006)
• auditd causing crond (cron) and sshd (ssh) to lock up (06 Jan 2006)
• Squeezebox under the microscope (25 Nov 2005)
• And so it begins... (10 Nov 2005)

User comments

(No comments made)

Post your comment

In order to post your comments here, you need be logged in to our system. Simply follow this link in order to login and to post your comments here.