Tool for load-testing a website by requests per second - load-testing

I need a tool similar to ApacheBench but with the ability to specify the requests per second.
This tool needs to be runnable from the command line on Windows (any scripting languages, Ruby, Python etc are fine) and should be able to output results to file.
Bonus points if it can generate graphs or produce data files that can easily be graphed.

Yes
JMeter is good tool to use and it has other features also(non-ui mode,lightweight,opensource etc.)
if you don't have licenses issue then probably go for Loadrunner which is very costly but has more features which are required for you (graphs,analysis)

JMeter is what you are looking for!
It has good original documentation - http://jmeter.apache.org/ and a lot of other sourses, like this
JMeter could be run from command line, it names non gui-mode
JMeter supports Javascript, Groovy, Java, Beanshell languages
And of course it could generate graphs

Related

How to use Python ParDo in a Java pipeline?

I have a Python code for data analysis and I want to embed it inside a much bigger pipeline which is written in Apache Beam Java SDK.
I know that there is also a Python SDK but I don't know how to combine between them.
How can it be done?
This is currently not supported. It is a great idea, and something that is being considered. Much of the work on the in-progress portability API has the potential to enable this, but there is no estimate for when it will actually be possible.

Is it possible to run an ImageJ script on heroku?

I want to be able to upload images to a server through something like a RESTful API, which then processes the image using an ImageJ script and then returns numerical results (no image is returned)
Can this be done easily? and can it be built on Heroku?
ImageJ works well headless; see http://imagej.net/Headless. So you could certainly build a server application which uses ImageJ based on any of several different Java server platforms (JBoss, Glassfish, Jersey, etc.). Especially if you leverage the new ImageJ2 API, there is a good separation of concerns which would allow you to build an effective client-server application.
To my knowledge, however, no one has created such a thing yet. I started playing with the idea using Jersey, but there is nothing really there right now, nor any time to work on it. Contributions in this area would be most welcome!
See also the ImageJ-OMERO project, which exposes ImageJ commands (including scripts/macros) as OMERO scripts which run on the server side.

remote data & query to OpenVMS RMS files

What options exist to query RMS files in OpenVMS? The context for the query/access would be for BI & reporting. Currently, a very old FOCUS (Infomation Builders, v. 6.9.8) is in use, and that only from within the native OpenVMS command line shell.
My challenge working within the VMS environment is that output is intended for off-platform consumption & analysis in Excel, R, and Business Objects/Crystal Reports, and Splunk/Hunk. On-platform, I'm limited in what I can use by whatever I can compile &/or run from within my own user space, and the CONNX & similar tools all look to require a server process in the VMS environment.
Edit: I have accepted a comprehensive answer which, given organizational constraints, may not be feasible. My likely path will be to write additional data extractions jobs in FOCUS, and incur the latency & maintenance overhead that goes along with that.
Do you want to the reporting to be on-platform, or off-platform (for example with Excel)?
On-platform, after 30+ years, I still really really like Datatrieve, as mentions in a comment.
This tool was created before SQL became all the rage, so its query language takes a little getting use. It knows show to used just about every RMS option (keys, RFA's for collections, joins, locks and sharing,...)
I'm sure there are multiple commercial tools like Focus you mention, and perhaps the IGH tool Vselect for data extraction, column shuffling, sorting. Some would even recommend OpenVMS native SORT but now you are still in Command Line space.
For a (green screen) windows approach, and command line, perhaps check out the freeware tool DIX: http://www.oooovms.dyndns.org/dix/
Off-platform google for "openVMS odbc" (jdbc). You'll find tools from Connx, Easysoft and "Connect" from the company I work for : Attunity.
Those will allow you to use (windows, linux) tools like DBvizualizer or Excell to get to the OpenVMS sourced data.
Perhaps an interesting hybrid could be Attunity's Connect ( "AIS" ) solution which allows for SQL language RMS file access, but on platform (NAV_UTIL) and off-platform, ("Studio, Nav_util, Oracle db-link, ODBC, JDBC, XML, ... )
For better help, please clearify the query still better. Notably the remark " only from within the native OpenVMS command line shell". What's wrong with that? :-). What alternative access did you envision? fake-gui, DECwindows? Native API? Remote API? ...
Hope this helps some already,
Hein
You could consider writing code in a native language such as C or Java. The company I work for uses Apache, DCL scripts in cgi-bin, and the Userbase 4GL to put an Intranet reporting front-end over an OpenVMS legacy system. As long as you wrap the output in HTML etc Apache will stream it back to a browser which will interpret it accordingly. However, with the impending move to Itanium we're faced with no support for porting Userbase. If anyone knows who holds the source code could they tag a reply onto the end of this. We're looking for a terminal (character mode) reporting solution for Itanium as not all users have PCs. If it weren't for this we'd just slap Crystal over CONNX and call it a day. Many thanks.
Further to my previous answer I'm now evaluating R as a reporting solution, using the RODBC to interrogate the RMS database via CONNX using R's RODBC library.

best way to parse text based log files

I have these relatively big log files which are generated from a machine via a serial connection.
This log isn`t structured and I need to check various different things. I wonder if there is some kind of existing language or tool which is specialized in this kind of thing?
languages I currently know:
c and c++
python
some java
various scripting language
I hope some of you have a good recomendationt!
Going with what you already know, Just use regular expressions in python.

Worth migrating to Rake?

Is it really advantageous to move to Rake from ant?
Anyone migrated from ant and find something monumental?
FYI: Current environment is Ant for J2ME builds
I would say yes, but I have a different perspective than a Java-environment guy, because I'm a .NET-environment guy. I had written and maintained a non-trivial build script (clean, generate-assembly-info, build, test, coverage, analysis, package) in msbuild (MS' XML-driven NAnt effort) and it was very painful:
XML isn't friendly; it's very noisy
No-one else on the team was interested in learning it to the point of performing more, and more useful, automations; so high bus factor (ie, if I get hit by a bus, they're stuck with it)
It did not lend itself to refactoring or improvement - it was one of those 'touch-at-your-peril' things, you know?
It needed custom C# tasks to be written to run the various tools the build needed (though to be fair, often these are written by the vendors)
In about a work-week's worth of my time (got to love empty offices at Christmas time!), I've learned enough ruby+rake to replace the whole thing with a shorter (in terms of LOC) script with slightly more functionality, and more understandability (I hope, anyhow; haven't had it reviewed yet).
It benefits from:
- It's a new language, but a real language. My team-mates like learning new languages, and this, while a thin excuse, is still an excuse ;-) This might mitigate the bus-factor if I'm right.
- It's a short hop (I gather) from here to capistrano, the automated/remote/distributed deployment tool from the RoR world. Despite being an MS-stack shop, we're gonna be using that in combination with IIS7 finally having a CLI config tool.
So, yeah. Your mileage may vary, but it was worth it for me.
Rake is great if you want:
Access to a real programming language; conditionals and loops are all dead-simple, compared to Ant (in which they are nigh-impossible)
File format that is easy to read and can be syntax checked
More intuitive/predictable assignment of values to variables
Rake is bad for you because:
You need to provide a lot basic of the tasks (like running javac, creating jar files, etc.) yourself. Projects like Raven might help, but it seems geared toward auto-downloading dependencies and not so much automated a build/deploy process. Plus, the documentation is a bit lacking.
Most java tools that can be automated are done as Ant tasks, which aren't easily runnable from Rake; starting up the JVM can be annoying at build time
You might want to check out buildr as well. It's a higher-level build-tool built on rake. IMHO it takes a lot of the good features from maven, and throws away the bad-ones. I haven't used it in anything big myself but I know people who have and are quite happy with it.
Another tool that you might want to check out is Gant if ant isn't meeting your needs. It adds full blown scripting support to ant but allows you to re-use your ant tasks as needed. It really depends on what you don't like about ant.

Resources