Reply
What happens when you receive too much traffic?
Old 03-28-2009, 09:23 PM What happens when you receive too much traffic?
MoForce's Avatar
Skilled Talker

Posts: 83
Name: Jack Shalt
Trades: 0
I'm not sure how much traffic a dedicated server can take, but I'm guessing close to a million visits with no problems (based on my data... 3MBs per visitor). I'm wondering about what happens after that. Is it possible to get multiple servers in different locations around the world to host the same site? So even if one of them goes down traffic just gets diverted to the next closest server. Is that how it works?

Thanks! =)
MoForce is offline
Reply With Quote
View Public Profile
 
 
When You Register, These Ads Go Away!
Old 03-28-2009, 09:40 PM Re: What happens when you receive too much traffic?
MoForce's Avatar
Skilled Talker

Posts: 83
Name: Jack Shalt
Trades: 0
and what about ... say... mysql databases? Will it run fine when you have thousands of simultaneous queries going on?
MoForce is offline
Reply With Quote
View Public Profile
 
Old 03-28-2009, 11:48 PM Re: What happens when you receive too much traffic?
Decaf's Avatar
Ultra Talker

Posts: 490
Name: Adam
Trades: 0
Quote:
Originally Posted by MoForce View Post
and what about ... say... mysql databases? Will it run fine when you have thousands of simultaneous queries going on?
One thing on the MySQL DB's that may work is using multiple direct copies stored on a separate server(s) in which new additions or updates are queened and pushed across all db's.

Then you can condense each db/table to a small number of pages, (Ex. your very popular home page can be placed on its own db/table/server to save/speed up load times, while your example.com/profile/{username} can use the same db as the widgets use.)

Just make sure to be able to add more tables/db's/servers on the fly (to allow for the very popular pages/services there own db's/tables/servers, Ex. API's, homepage, ect...). This will allow you to either make systems that can duplicate them selves at 2AM (so you don't have to) or allow you to manually create them at 5PM.
__________________
Decaf is offline
Reply With Quote
View Public Profile Visit Decaf's homepage!
 
Old 03-30-2009, 05:02 AM Re: What happens when you receive too much traffic?
~ServerPoint~'s Avatar
never mind

Posts: 1,100
Name: Travis
Trades: 0
Hello!
I believe that is called Digg effect and I think that you can do research within the wiki to learn more
__________________
ServerPoint.com - a true hosting company offering online presence solutions since 1998
Web Hosting, colocation, dedicated servers, Virtual Private Server (VPS) hosting
Wholly owned multi homed network, servers and facilities
~ServerPoint~ is offline
Reply With Quote
View Public Profile
 
Old 03-31-2009, 05:52 AM Re: What happens when you receive too much traffic?
SiberForum's Avatar
Webmaster Talker

Posts: 621
Trades: 0
Once you have that your server might crash or account overloaded and closed by web hosting provider.
__________________
Sibername.com
Canadian Domain Name Registration and Web Site Hosting Services
http://www.sibername.com
SiberForum is offline
Reply With Quote
View Public Profile
 
Old 04-02-2009, 03:40 AM Re: What happens when you receive too much traffic?
~ServerPoint~'s Avatar
never mind

Posts: 1,100
Name: Travis
Trades: 0
Quote:
Originally Posted by SiberForum View Post
Once you have that your server might crash or account overloaded and closed by web hosting provider.
That is truth. But I believe that he asked about the measures to prevent that.
__________________
ServerPoint.com - a true hosting company offering online presence solutions since 1998
Web Hosting, colocation, dedicated servers, Virtual Private Server (VPS) hosting
Wholly owned multi homed network, servers and facilities
~ServerPoint~ is offline
Reply With Quote
View Public Profile
 
Old 04-02-2009, 08:14 AM Re: What happens when you receive too much traffic?
Natcoweb.com's Avatar
Average Talker

Posts: 24
Trades: 0
What you need is load-balancing, it will help you to manage digg effect outcomes.
Natcoweb.com is offline
Reply With Quote
View Public Profile
 
Old 04-02-2009, 12:35 PM Re: What happens when you receive too much traffic?
MoForce's Avatar
Skilled Talker

Posts: 83
Name: Jack Shalt
Trades: 0
Hmmm digg effect... I talked to some people and they say that if I have my own dedicated server I shouldn't have a problem =)
MoForce is offline
Reply With Quote
View Public Profile
 
Old 04-02-2009, 02:54 PM Re: What happens when you receive too much traffic?
Novice Talker

Posts: 6
Trades: 0
If you are not on a Dedi then yes, that can definitely help/mitigate the problem until you grow too big for your current server.
__________________
Dedicatednow.com
973.572.1069/sales@dedicatednow.com
Special Pricing on Fully Managed Servers
FortressDewey is offline
Reply With Quote
View Public Profile
 
Old 04-02-2009, 03:52 PM Re: What happens when you receive too much traffic?
Skilled Talker

Posts: 59
Name: Andy Dixon
Trades: 0
Make sure your current host provides your with enough bandwidth so you don't go over your limit. Also make sure MySQL is optimized and your server has good specs.
__________________
Magmahost.com - Hosting Services. Since 2007
Shared $1.00 | Reseller $6.95 Click here to visit Magmahost.com
MH-Andy is offline
Reply With Quote
View Public Profile
 
Old 04-02-2009, 04:38 PM Re: What happens when you receive too much traffic?
ldcdc's Avatar
Hosting watcher

Posts: 932
Name: Dan
Trades: 0
Quote:
Hmmm digg effect... I talked to some people and they say that if I have my own dedicated server I shouldn't have a problem =)
A dedicated server is not infallible. Depending on the configuration, website CPU footprint, and the extent of the traffic surge, it can be overwhelmed.

One cheap and fast way to go beyond what a dedicated server can provide, without going for load balancing, would be to separate content, and put it on more than one server. For example, you could put the database on its own server. Static content (images etc.) could also be moved to a server running a lightweight, fast web server, like lighttpd or nginx.

Last edited by ldcdc; 04-02-2009 at 04:39 PM..
ldcdc is offline
Reply With Quote
View Public Profile Visit ldcdc's homepage!
 
Old 04-02-2009, 05:23 PM Re: What happens when you receive too much traffic?
willcode4beer's Avatar
Super Moderator

Posts: 1,388
Name: Paul Davis
Location: San Francisco
Trades: 1
Quote:
Originally Posted by MoForce View Post
I'm not sure how much traffic a dedicated server can take, but I'm guessing close to a million visits with no problems (based on my data... 3MBs per visitor). I'm wondering about what happens after that. Is it possible to get multiple servers in different locations around the world to host the same site? So even if one of them goes down traffic just gets diverted to the next closest server. Is that how it works?

Thanks! =)
You are actually describing two different solutions.

One, set up a load balancer to distribute traffic amongst multiple servers.

2nd, have geographically located servers. Use CName resolution so that DNS servers route traffic to the server geographically closest to the user.

You can combine the approaches.

If you have a lot of static data you could use a service like akamai. They have servers all over the world, and would use CName resolution for your domain name.
__________________
Paul Davis

earn $$$ write for willCode4Beer.com
willcode4beer is offline
Reply With Quote
View Public Profile
 
Old 04-03-2009, 03:31 AM Re: What happens when you receive too much traffic?
MoForce's Avatar
Skilled Talker

Posts: 83
Name: Jack Shalt
Trades: 0
thanks for all the help That's a great idea to have servers dedicated to a specific task (mysql db, media, everything else)

yeah I've checked out akamai before and it's definitely a possibility in the future... I've also been intrigued with this whole cloud computing thing
MoForce is offline
Reply With Quote
View Public Profile
 
Old 04-08-2009, 05:07 PM Re: What happens when you receive too much traffic?
LaneHost's Avatar
Average Talker

Posts: 23
Location: Houston, TX
Trades: 0
A dedicated server can get overloaded and having load balancing would be good for you if you are getting that kind of traffic. Of course having your own server for each function would produce the best results, that totally depends on your budget.
__________________
LaneHost Solutions, Inc. | Professional Web Hosting Solutions
Premium Shared Hosting, Reseller Hosting & Dedicated Servers At Great Prices!
Complete Solution To Affordable Reseller Web Hosting
LaneHost is offline
Reply With Quote
View Public Profile Visit LaneHost's homepage!
 
Old 04-08-2009, 06:09 PM Re: What happens when you receive too much traffic?
MoForce's Avatar
Skilled Talker

Posts: 83
Name: Jack Shalt
Trades: 0
Yeah the costs are going to be pretty high =( I calculated it to be around $5-$10k per year. I doubt I'd be able to generate enough revenue from the site to pay that.

Is it possible to determine the number of mysql queries that are running and from there create a script that limits the # of users permitted at one time? I think the highest rate of queries/second any user generates on my site is around 10 queries... on average it's more like 2-3 and it doesn't last long either. That'll maybe go on for a couple seconds and drop to around 0-2.

Last edited by MoForce; 04-08-2009 at 06:10 PM..
MoForce is offline
Reply With Quote
View Public Profile
 
Old 04-08-2009, 06:58 PM Re: What happens when you receive too much traffic?
tripy's Avatar
Do not try this at home!

Posts: 3,179
Name: Thierry
Location: I'm the uber Spaminator !
Trades: 0
Quote:
Is it possible to determine the number of mysql queries that are running and from there create a script that limits the # of users permitted at one time
It doesn't go that way...
Sometimes, it's better to break a very large query with outer joins in a succession of simpler queries.
You cannot say "I allow x users because I want y queries at most".
The type of query, how many joins, how many rows, if there are aggregating functions and the general load of the server are to be taken in account.

If you have a root access to the server and you use mysql, you can try to use mysqltop, which is a mysql monitor.
Another thing to do, is to enable the "slow queries" log, and regularly look in it.
Sometime, optimizing 1 specific query can help tremendously.

But what you need to keep in mind, is that generally optimizing for speed and optimizing for concurrent connection is not the same.

On the db side, optimizing for more concurrent connections often means denormalizing, simplifying joins (and even removing them) by using a cube like structure where everything is in 1 row, without foreign keys, constraints and the like.
__________________
Only a biker knows why a dog sticks his head out the window.
tripy is online now
Reply With Quote
View Public Profile Visit tripy's homepage!
 
Old 04-14-2009, 12:04 AM Re: What happens when you receive too much traffic?
MoForce's Avatar
Skilled Talker

Posts: 83
Name: Jack Shalt
Trades: 0
what about hosting in the cloud? Would that prevent all problems?
MoForce is offline
Reply With Quote
View Public Profile
 
Old 04-20-2009, 12:57 AM Re: What happens when you receive too much traffic?
Novice Talker

Posts: 7
Trades: 0
traffic is always the issue of chosing the right hosting services.
I'm not a tech savvy, but I feel that having different application to be hosted on different server should be more cost saving compare to setting up a cloud computing now.
__________________
Exabytes - 8th Anniversary Buy 1 Free 1
Exabytes - 8th Anniversary Loyalty Rewards Program
Exabytes - 8th Anniversary Domain Sales
ladycooper is offline
Reply With Quote
View Public Profile
 
Old 04-20-2009, 03:47 AM Re: What happens when you receive too much traffic?
ashley27's Avatar
Super Talker

Posts: 121
Trades: 0
Money from adsense and you could exceed your bandwidth.
__________________
Green card Renewal
Hawaii Beach Vacation
ashley27 is offline
Reply With Quote
View Public Profile Visit ashley27's homepage!
 
Old 05-04-2009, 09:23 AM Re: What happens when you receive too much traffic?
Asmar's Avatar
Novice Talker

Posts: 13
Name: Asmar Amjad
Location: Pakistan
Trades: 0
You can upgrade your vps server.
Asmar is offline
Reply With Quote
View Public Profile Visit Asmar's homepage!
 
Reply     « Reply to What happens when you receive too much traffic?
 

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off





   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML

 



Page generated in 2.09653 seconds with 13 queries