2.5 Million Requests
Posted by chad March 07, 2006 @ 04:06 PM
In case you were wondering if Rails can scale: Eric Hodel reports that the Robot Co-op served 2,587,240 requests through their Rails applications last Saturday.
Do you have any scalability stories to share?

What, all at once? :)
Ed: Yep! They’re not as popular as they think… I just ran:
ab -n 2587240 -c 2587240 http://43things.com/
It’s amazing that my box was able to push that much traffic, but hey, its a macbook pro.
hahahaha… classic Kyle ! can’t wait to try that on my friends quad G5 !!
Congrats Eric and Robot Co-op team !
BTW What is an ab command??
ap – Apache server benchmark tool. http://httpd.apache.org/docs/2.0/programs/ab.html
Great!
Any information about the hardware behind available?
ab stands for Apache Benchmark ;] A little app which does dozens of requests to a webserver.
That’s ab. :)
ab stands for Apache Benchmark ;] A little app which does dozens of requests to a webserver.
any idea how many servers they needed to handle that?
Yeah, as jay says, those numbers aren’t telling us much without some indication of what they’re running on.
ceejayoz: The point is that Ruby on Rails can work for that many requests in a day, which really is telling us something. It’s not a question of “my language / framework / c program” can do it faster, because everyone knows Rails is not blazingly fast.
But knowing that it’s fast enough is newsworthy, and good news indeed.
Having said all that, I’d like to know how to duplicate that kind of throughput.
How many views does Penny Arcade get per hour || day?
How many views does Penny Arcade get per hour || day?
Wonderful!!
This amazing performance is done not only by Rails by DHH but also by Database Power. Rails is in very close relationship with Database. Hooray DHH and Hooray Database vendors !!
Wonderful!!
This amazing performance is done not only by Rails by DHH but also by Database Power. Rails is in very close relationship with Database. Hooray DHH and Hooray Database vendors !!
Wonderful!!
This amazing performance is done not only by Rails by DHH but also by Database Power. Rails is in very close relationship with Database. Hooray DHH and Hooray Database vendors !!
What we really need is a whitepaper detailing the best way to cluster both hardware and software in a full on scaled production enivronment. Then real world engineering measurements detailing real hits and not simulated hits. Not just cached pages and images but full database inserts and queries along with page renderings.
- 10 1U dual processor rack servers (like XServes or Dell) - SAN setup for disk space. - 4 of them running PostgreSQL/Oracle setup in a cluster. - 3 running FCGI or the newer SCGI processes. - 3 running Lighttpd instances. - Apache front end.
Lots of caching and tuning, etc. Real performance numbers from a big site.
Unfortunately, all this seems to be black magic to most of us. I’ve seen reports of TextDrive having issues with Rails systems running Apache and FCGI – getting Slashdotted on one of their shared host rails sites and switching to Lighttpd then being amazed that it absorbed all the traffic and could have handled a whole lot more! They seem to still use Apache as a Proxy to backend Lighttpd instances.
This double post bug is very annoying. I wonder why it takes so long to fix it.
multiple posts are annoying…
JBrickley: That sounds like quite a setup – what are you handling with all that?
From what I hear, double posts are a Firefox bug. Make sure you have the latest Firefox release.
http://www.penny-arcade.com
I imagine they get a lot of traffic on their RoR site.
test
JBrickley, why would you take 3 amazingly fast lighttpd box’s and throw them behind 1 apache instance… that would almost defeat the purpose, as well just wth is apache doing in this scheme?
a better idea would have those 4 rails box’s running memcache for session(/ar persistance?) storage, the 3 lighttpd front-ends, and a dedicated hardware load-balancer.
there is little to no reason to having a web server (apache) proxy to a web servers (lighttpd box’s) proxy to fcgi processes.
just my 2 cents
Unless, Zachery, Apache has some modules that solves a problem for you.
offtopic: why on bloody earth havent they added validates_uniqueness_of to comments! this post is duplicatedspamed!
m: probably because nobody could post “ok!” or “yes!” twice! O_O
offtopic: Same name and same comment? Duplicated. Different name and same comment. Ok. It’s not rocket science…
Hey look, somebody made a generic blog site that does absolutely nothing of interest and it was able to keep up with a moderate number of requests. This is revolutionary.
There are some angry people around the web aint there?