Are there any self-hosted load testing results services like Yandex Overload and BlazeMeter Sense?
I'm not aware of any but starting from JMeter 3.0 it is possible to generate HTML Reporting Dashboard during the test or afterwards.
Another option is using Graphs Generator Listener to plot various charts in .png format
There are many ways to Analyze Jmeter Results without those hosted result services:
UI Listeners: good for light load tests with a single load generator,
JTL Files: analyze them using the XSL provided within JMETER_HOME/extras,
Backend Listener + InfluxDB + Grafana: self hosted solution based on 2 other open source components (InfluxDB and Grafana).
Sadly, Blazemeter Sense (previously Loadosophia) used to be free (or at least cheap enough), until Blazemeter bought it end of 2014.
Related
I am using Influxdb with Grafana for a while and I like it.
I am confused with the new version of Influxdb2.0. I was searching the doc and could not find useful info.
I have some questions.
Will Influxdb be available only as bundled with db + ui as 1 single binary going forward? Can we have standalone DB?
Will the Flux replace the current SQL like InfluxQL ? Or InfluxQL will also be supported.
Yes, I believe the intention is to bundle the UI into the single binary so that it is always available with no additional installs. You can continue to use Grafana though - ignoring the bundled UI entirely*. There's no problem to ignore it so the DB is still "standalone". Since it is OSS, you could build a binary without the bundled UI if that is important for your use case.
InfluxDB 2.0 OSS is currently in RC0 (as of late Oct 2020). This version supports both InfluxQL via a compatibility API (/query) and Flux via the new /api/v2/query API querying. The query and response formats are different. The docs have examples. In general, Flux is the direction InfluxDB is going.
*There may be some rough edges in the RC around configuring the first user without using the UI and only using the API. I have not tried this. I would expect the API to continue to improve is this area.
I want to use the Yandex tank to test a service available via a special protocol (no HTTP).
Is it possible? I could not find examples.
Yandex tank per se is not a load testing tool, it's a wrapper which can use a "real" load testing tool for conducting the load.
The tools which are supported are:
phantom
JMeter
bfg
So if none of this load generators supports your "special" protocol you cannot use it for load testing of your service.
If you like wrappers more than real load testing tools you might also be interested in Taurus which is more advanced, supports more load testing tools and has better configuration syntax.
I'm working on multiple projects where most of them include SOAP services that i have been testing using SOAPUI open source, creating multiple linked steps, using groovy script and so on.
However when it comes to complicated TCs & reusing , it doesn't seem to be so efficient
So a colleague of mine suggested that we can generate WSDL client using any IDE like eclipse or intellj , and thus we will be able to invoke methods found in WSDL directly with a much more privileges & control.
My question is what can possibly go wrong with that, i believe there's a reason why SOAPUI have been around for so long and most commonly used tool when it comes to web services testing.
I may be a little biased, but after using soapUI for 10+ years, I haven't found many web service test cases that it isn't able to handle, from simple calls to complex orchestrations and validations involving both REST and SOAP services. But, like any comprehensive tool, it takes time and effort and some trial and error to become proficient in its use. It also has some quirks and annoyances, but less than most of the tools in my development toolkit IMHO.
See the soapUI tag page for some resources that may help get the most out of soapUI.
It you've reached the limits of OSS soapUI, try the paid version: soapUI Pro/Ready API. The additional feature set is significant, including better support for reusing Groovy scripts and a script editor that some intellisense to help write code.
I would fully exhaust the the capabilities of soapUI and soapUI Pro before I would remotely consider trying to write my own web service client.
I want to be able to upload images to a server through something like a RESTful API, which then processes the image using an ImageJ script and then returns numerical results (no image is returned)
Can this be done easily? and can it be built on Heroku?
ImageJ works well headless; see http://imagej.net/Headless. So you could certainly build a server application which uses ImageJ based on any of several different Java server platforms (JBoss, Glassfish, Jersey, etc.). Especially if you leverage the new ImageJ2 API, there is a good separation of concerns which would allow you to build an effective client-server application.
To my knowledge, however, no one has created such a thing yet. I started playing with the idea using Jersey, but there is nothing really there right now, nor any time to work on it. Contributions in this area would be most welcome!
See also the ImageJ-OMERO project, which exposes ImageJ commands (including scripts/macros) as OMERO scripts which run on the server side.
I need a tool similar to ApacheBench but with the ability to specify the requests per second.
This tool needs to be runnable from the command line on Windows (any scripting languages, Ruby, Python etc are fine) and should be able to output results to file.
Bonus points if it can generate graphs or produce data files that can easily be graphed.
Yes
JMeter is good tool to use and it has other features also(non-ui mode,lightweight,opensource etc.)
if you don't have licenses issue then probably go for Loadrunner which is very costly but has more features which are required for you (graphs,analysis)
JMeter is what you are looking for!
It has good original documentation - http://jmeter.apache.org/ and a lot of other sourses, like this
JMeter could be run from command line, it names non gui-mode
JMeter supports Javascript, Groovy, Java, Beanshell languages
And of course it could generate graphs