Server too busy...

[Elenai]

I keep getting this "server too busy" thing sometimes when I try and go through the site.

Ok I can see what the obvious reason is, but what exactly is the cause? Too many users on at the same time? A problem with my own account? What could it be? And most importantly how do I stop this madness :stare:?

 

[HeretoDLstuff]

Owch...Yes alot of people are having this problem, ( Im in chat lsitening to them complain xD) Its happning so much for me ill be luck if I can Make a post..

 

[Elenai]

It happened to me right when I was about to upload my High Elf Arch Clerics....that angers me!!!!

 

[SuPa-]

Yeah... it's happening to about everyone :-/

 

[ragingspeedhorn]

It is really annoying and happens every second time I try to visit and post at the site.

 

[Mini-Me]

Yep it happens pretty often. Hopefully ralle can clear things up.

 

[Josh]

It happened to me a load of times yesterday.

 

[DesKaladA]

Hmm...
I wonder if the site has urnch
but to the best of my knolage the site

• has to many menebrs on at once
• the bandwith is getting overloaded due to uploading
• the CROND file that contorls the ram scrubbing is not woring
• we are getting this with DDos attacks

 

[Samuraid]

The "server too busy" message will not occur from the bandwidth getting overloaded. And there's no such thing as a cron job that scrubs the RAM. The only things remotely close to that are the GC for the PHP caching system (which isn't to blame) and the /tmp directory cleanup, which only runs daily and has a negligible effect on the system.

Most likely, the fcgi engine is not able to handle all requests in a timely manner.

EDIT: Ralle and I looked into it and he made a change that may improve the site a bit. Keep us posted if you encounter any more problems.

 

[Rui]

I was also having this problem. I'll post here again (or edit this post) if it happens again.

 

[Wolverabid]

No problems on my end guys.

Thanks Samuraid (once again) you and The Chieftain seemd to have worked things out: response time here is excellent!

 

[Kwaliti]

Uhh, you forgot the rep dumps

 

[~VanMavus]

Thanks for fixing it up "PiRho", and Ralle.

 

[DesKaladA]

? there is a crond job the scrubs ram on kazor2 kernal(its still under develmonet i'm helping)

 

[RED BARON]

Well I got the server busy for less then 10 min ago, but compared to before it is nothing. So should be okay

 

[Rui]

Happened to me just a while ago.

 

[ragingspeedhorn]

It happens all the time still, nothing has improved.

 

[DesKaladA]

Maby if there is a new theam for the site that would start up if the server reacht a critical point

Maby if there is a new theam for the site that would start up if the server reacht a critical point a minimal theam
that what i did with Joomla when triyng to amin it

 

[Samuraid]

Right now the server is running out of RAM (swapping about 400MB of memory pages). Hive's growing...maybe a server hardware upgrade is in order at some point.

 

[Ralle]

what's most important?
More RAM (1 GB)
or
Better CPU (dual core)

Maby if there is a new theam for the site that would start up if the server reacht a critical point

Maby if there is a new theam for the site that would start up if the server reacht a critical point a minimal theam
that what i did with Joomla when triyng to amin it

iseedeadpeople
warpten
greedisgood
lumberjack

Anyway. It's all a matter of money. An additional server is costly. Better upgrade than have two servers. It's very hard to synchronize them anyway.

 

[HappyTauren]

O noes. I smell costs here

 

[Kwaliti]

what's most important?
More RAM (1 GB)
or
Better CPU (dual core)

Dual core? I wouldn't bet on it, cus my pal here has worse performance than me with it, and I'm running on an AMD Athlon 64+. I think that both RAM upgrade and CPU upgrade would be better, however it might cost more. Try with a Dual Core, but make sure that both cores are atleast 2ghz each (if they exist, that is :S). I'm gonna click all those ads up there for money

 

[Ralle]

Samuraid says RAM. But I am not sure.. 25$ extra per month = +1 GB RAM = 2 GB RAM

 

[DesKaladA]

you know i have a site
i can set it up to help take the overload of the hive
(IE making some of the froms we have here if site A is down then go to site B)

and the new tham would be a really minimal listic tham

 

[Hakeem]

25$ extra per month

I'm going to buy you a server one day, no more renting...

 

[Ralle]

and the new tham would be a really minimal listic tham

Maby if there is a new theam for the site that would start up if the server reacht a critical point a minimal theam
that what i did with Joomla when triyng to amin it

I am so curious. What is a tham/theam?

 

[Rui]

I am so curious. What is a tham/theam?

Quoted for truth. I myself haven't understood yet.

 

[Landy]

That rends my heart. Time to make some donations. Lol.

 

[DesKaladA]

theme i meant theme
and still i would be happy to house some of the threds that flood up the hive on my site(that you never eaven looked at)

 

[Samuraid]

I'm going to buy you a server one day, no more renting...

Power, cooling, and bandwidth still cost money though. Not to mention occasional hardware replacements...

 

[Rui]

Well, I ask myself if it's a Warcraft III site is worth all the money. Of course, don't take this too seriously...

 

[Dr Super Good]

Its only recent all this ram problem, I recomend flushing a lot of stuff that slows this thing down, diagnose the problem and run tests, there must be something that has happened, like too many users or maps or something that causes too much to happen. Well this site will probably expand quite a bit for SC2.

 

[Ralle]

You are right DSG.
Wolverabid thinks that it is because of the new chat. But I do not believe that.
The new chat is much more optimized for the server. All messages (younger than 30 seconds) are stored in the memory, user sessions are stored in the memory and the memberlist is a plain file that loads every time.
I can't see how it should overload the server.

Nothing new has happened to the site, so I don't know what should be the problem.

 

[Elenai]

Perhaps there is a bug, or a hacker. Ofcourse I have very little knowledge of website mechanics so it might not be one of those.

 

[Dr Super Good]

Somthing I have just thought of.
DL bots, maybe some bots are just doing crazy stuff to the server power by downloading recources or loading fourm chains alot. Try checking for that since bots would definatly lower server preformance.

 

[ragingspeedhorn]

Why does people always say either a hacker or that there is too many maps so we should purge everything

 

[Dr Super Good]

Uhh maybe because this problem is new?

Well anyway something is increasing server load.

 

[DesKaladA]

you know i ran a spider urch remote test and i god back this weard thingey that tranlates into

Actave pass juming every time the site go down
(try tuning of anonymous ftp)

 

[HappyTauren]

We happen to have 4000 people everday, and they could be bots (looping in register field), DL bots, etc.

 

[DesKaladA]

then modfy the logiin to add some extra layer to sotp bots coming onto the site

 

[Samuraid]

Bots don't need to login necessarily to view the site. They can do plenty of things as guests.

 

[HappyTauren]

That was my point, why not just ban IP once "are you a bot" == true? Would speed it up!

 

[PurplePoot]

Then what happens if you accidentally don't change that while registering, ht? You're permabanned... not very user-friendly >_>. (or at least banned until you can get contact with ralle/samuraid/etc)

 

[Dr Super Good]

Allow non registered users to only have one request from the server at a time and if someone is constantly requesting pages at an inhuman pattern, ban it for 12 hours.

 

[Samuraid]

Unfortunately, that would be hard to implement. The current filtering system operates through the web server software (lighttpd). Users with too many connections are blocked before even reaching the scripts that run the site. Additionally, lighttpd has no direct way of distinguishing who is a registered user or not.

As for the other suggestion. It might work well, we just need to determine which patterns of traffic would be considered suspicious.

 

[RED BARON]

As for the other suggestion. It might work well, we just need to determine which patterns of traffic would be considered suspicious.

That will be hard with those users we got... I dont think they follow any pattern at all..

Except maybe if someone is dl'ing the same model/skin/art or similar manytimes (more then 2-3 times at day..)

 

[DesKaladA]

whell i know how to do it

 

[Elenai]

Is there a way to trace "bot" like behavior? If you find a registry that exhibits "bot" behavior......ban it.

That will at least lower some of the load over a period of time as a "long term" protocal to back up a solution.

Of course thats only if its possible to do.

Perhaps with moderators who would specialize in "bot" spotting.

 

[DesKaladA]

i wrote a wiki entry on the topic some time ago
if a admin wants my help they can just tell me

 

[Ralle]

Is there a way to trace "bot" like behavior? If you find a registry that exhibits "bot" behavior......ban it.

That will at least lower some of the load over a period of time as a "long term" protocal to back up a solution.

Of course thats only if its possible to do.

Perhaps with moderators who would specialize in "bot" spotting.

Naah i have something else on my mind.
Everyone will be allowed to load a maximum of 60-100 pages per minute. If they exceed, they will get a time ban.