We have implemented SSO using rubycas server, we want to do load test on this and we are looking for open source tools which are the good for load testing.
There is pretty good set of open source tools for the load tests. You can check some of them here.
Is not easy to choose proper tool. All depends on the specific case what kind of staff you would like to test. If you would like to do simple throughput testing or just measure the responsiveness of you system, I would recommend one of these:
Apache Bench
httperf
but if you would like to test some more advance "user stories" then I will suggest:
JMeter
Trample
Related
I want to use the Yandex tank to test a service available via a special protocol (no HTTP).
Is it possible? I could not find examples.
Yandex tank per se is not a load testing tool, it's a wrapper which can use a "real" load testing tool for conducting the load.
The tools which are supported are:
phantom
JMeter
bfg
So if none of this load generators supports your "special" protocol you cannot use it for load testing of your service.
If you like wrappers more than real load testing tools you might also be interested in Taurus which is more advanced, supports more load testing tools and has better configuration syntax.
I'm using Arquillian and I need to do load test, something like running the same test with 50 threads in parallel.
I tried with ContiPerf 2 and it didn't work. It is not possible.
So, do you recommend me any tool for doing the load test with Arquillian?
Personally I don't think I would Arquillian for that. AFAIK there is no extensions available at the moment for load testing. Personally I made good experiences with JMeter, but it depends of course how you set things up.
I LOVE cucumber, my clients love it too.
As far as I know currently there isn't a nice way to share your features with your clients. Us nerds have TextMate or NetBean bundles that give us nice syntax highlighting -- my clients not so much.
What I would love is to be have something hosted at features.myclientsapp.com that would be a organized nice marked up view of the features of the application. Maybe as a bonus an overview page with % coverage, which steps are passing. Ideally this will be exposed as a Rack Engine.
If I am getting greedy -- git integration to see version control, and a way to solicit feedback from the clients.
Does anyone know of anything that does can do this? What other strategies do people have on sharing there features files with their clients/users?
I have been working on this and this is what I have come up with. Its a less known feature that cucumber can be output in pretty nice html. I have this task namespaced as part of a bigger task list that is run with rake doc:features and includes all the rdoc for the app and the README for the app, etc.
desc "runs cucumber features and outputs them to doc/cucumber as html"
task :html do
Dir.glob("features/*.feature").each do |story|
system("cucumber",
"#{story}",
"--format=html",
"-o",
"doc/cucumber/#{story.gsub(/features\/(\w*).feature/, '\1.html')}")
end
end
then its up to you how you want to serve them up. I've been writing some tasks that hook this task in with others to build the documentation and then serve it up with the serve gem. http://github.com/jlong/serve but there are a lot of other options too. other options include running the features on a ci server and putting these feature files in a directory to be browsed, etc.
I agree with you, it would be nice if there was a dashboard page that gave pass fail, etc. and links to each feature file output, etc. If anyone would like share the workload implementing this as part of cucumber core, I would be happy to contribute. I personally think the html formatting should be more robust and part of the central cucumber feature set.
I really like this idea. What do you think about using this-fork of metric_fu that claims to combine cucumber with the rcov and other nice pretty graphs.
As far as formatting the feature themselves, I really like how Chargify uses cucumber features as documentation. They appear to wrap them in a 'pre' tag to be pre-formatted.
I just found Viewcucumber. I haven't used it yet since it currently does not support cucumber 0.10.0, but I will be monitoring it -- looks great.
I new service that looks promising is Relish
Though it is a closed beta, and I couldn't get access. But one to keep an eye on.
features2html is a script that creates a self-contained HTML file from all Cucumber feature files in a folder.
P.S. Self promotion alert :) D.S.
What would be a proper way to simulate a large number of requests to test if my web application can handle it?
You could try using Microsoft's WCAT tools. Look here: http://support.microsoft.com/kb/231282
They're free, too. That's always nice.
Depending on your budget, you may be interested in some load testing software designed for this. A Google search brings up all sorts of alternatives. This is probably the best way to do it.
This one has a free trial version and isn't too pricey, but I would recommend shopping around first.
I've used JMeter in the past, and I find it to be very useful for stress/load testing as website, even ones written in ASP.NET (with or without MVC).
In general you would want to (with any tool) write a script of what an average user of your site would do. You may even end up creating multiple of these scripts. Tools like JMeter even allow for a random element to be added to a script. With these scripts created a load testing tool can then simulate as many users as you desire hitting your site.
I would recommend allow JMeter to slowly ramp up the number of concurrent users and watch the response time graph. At the point where the response time starts increasing too highly is at the point where you've hit the maximum number of users (given you scripts) that your site can handle.
ab and httperf are two, more unixy options, if you don't mind delving in that direction.
There's a nice screencast for using httperf by peepcode.
Use the load testing tools from Visual Studio Team System. 2010 if you can get it.
The tools are great to use and provide wonderful instrumentation. There is also a programming model to go with the tools, allowing you to make some very complex testing scenarios possible.
Post the URL on stackoverflow.
Make it sound like a challenge, so lots of people come check it out: "Can you find the hidden performance problem in this app?"
Does anyone know the best lightweight Rails benchmarking tool?
I need to get performance statistics of the webserver and simulate authentication + page navigation per session. I've been trying to use httperf, but been encountering TamperingWithCookie exception in the application.
Ideally, I'd like to separate the application and database from the webserver benchmarking, but interested to see the results of the combination of these.
You can try Tsung, a distributed load testing tool written in Erlang. It's a general tool but can be easily used with Rails applications. In case you need to simulate different user behavior scenarios as a kind of integration tests, you could also try Webrat.
ruby-prof works well either by you manually hitting your app with a browser, or it can benchmark against tests.
here's a great writeup on how to use it: http://cfis.savagexi.com/2007/07/18/making-rails-go-vroom
and here's where you can download it: http://rubyforge.org/projects/ruby-prof/
It's not the best way, but using a web stress tool like MS WAS has worked in the past to show simple benchmarks.
ab is an Apache tool for benchmarking. Probably won't take care of authentication for you but is dead-simple to use:
ab -n 300 -c 20 http://website.com