Html reporting solutions for Specflow using NUnit [closed] - specflow

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 2 years ago.
Improve this question
I am setting up a c# BDD Test automation framework using the following basic components:
Specflow
NUnit / SpecRun (test runner - see below)
Selenium
I have successfully set up a framework which executes tests and generates a nice HTML report (to do this, I used SpecRun as the test runner.. http://www.specflow.org/plus/runner/).
I am now trying to set my tests up to execute in Sauce labs to do cross-browser and device testing. Jenkins has a nice Sauce plugin which allows you to specify the platforms and the tests are then run across each selected platform.
I have also identified Saucery (http://fullcirclesolutions.com.au/) as a potential time saver in setting this integration up, however, this would mean that I would need to use NUnit as my test runner instead of Specrun.
If I am to go down the NUnit route, does anyone know of any decent html reporting solutions which I can integrate into the test run. A lot of googling has returned very little in the way of answers here.
Thanks!

You can use the specflow.exe program to create reports, it comes with the specflow package. How it works in detail can be found on the specflow github. Summarized:
In order to generate this report you have to execute the acceptance
tests with the nunit-console runner. This tool generates an XML
summary about the test executions. To have the detailed scenario
execution traces visible, you also need to capture the test output
using the /out and the /labels options as it can be seen in the
following example.
nunit-console.exe /labels /out=TestResult.txt
/xml=TestResult.xml bin\Debug\BookShop.AcceptanceTests.dll
The two generated files can be
used to invoke the SpecFlow report generation. If you use the output
file names shown above it is enough to specify the project file path
containing the feature files.
specflow.exe nunitexecutionreport BookShop.AcceptanceTests.csproj
/out:MyResult.html

Allure.
https://github.com/allure-framework/allure2
NUnit, Specflow, any framework

Related

How to build an MSIX from comandline [closed]

Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 2 years ago.
Improve this question
We had understood, MSIX is an interesting, modern alternative to ClickOnce.
Using with GUI runs smoothly. And we want also to use it with Powershell/CMD scripts. (We only want the msix package, no store upload.)
Here is our problem. I have seen the doc from MS (https://learn.microsoft.com/en-us/windows/msix/package/manual-packaging-root) but it is very partial. I have no special with to do, I only want to make the standard export by script instead of GUI.
Please, can anybody give me a better instruction/tutorial to easy create an msix-Package by command line?
Here the steps, I found - and partial questions:
Create Manifest.xml - Good documentation of the content, but where to save it? I use the folder with the *.sln
Generate a Package Resource Index - I find the MakePRI.exe, but hot to use?
Create the package with MakeAppx - who and where to use? Even in standard case I need a mapping.txt. Which files must it contain? All from Manifest? Where I must place the files - Server online or local at PC? Only pictures for icons? Where I must run it? Must it the place with the *.sln or can it be a subfolder? Where have the binaries of my program to be?
Create an app bundle - What must stand in the mapping file here, when I will an app for x86 and x64?
Sign msix - sounds easy - give msix-file and signature as parameter and run
You see, I am very confused. With GUI - MSIX creation is easy. But how to automate it? Can someone help me?
It seems to me that you are on the wrong track here, basically, you are trying to reinvent the wheel and create your own tool that builds MSIX packages.
This doesn't sound very effective to me. We (at Advanced Installer) and other vendors, Microsoft including, have been working for years to build reliable MSIX packaging tools, this is not a 1-month project task that you can start from scratch, without any prior domain knowledge.
What I suspect you need is actually a way to build from the command line a project that you created with Visual Studio, Advanced Installer, InstallShield, or any other tool that can build MSIX packages.
So basically, you need to use the GUI to initially build the project that will generate your MSIX and you can then go on to use the options below to build an MSIX from that project using the command line.
If I am wrong, and you actually need a way to build an MSIX package from scratch from the command line, please update the question with more details so the community can better understand what you are trying to accomplish in order to provide you with useful guidance.
TLDR solution:
So, the first step is for you to build your MSIX project using your tool of preference. From your question, it seems you are only using VS, so you need to use the Windows Application Packaging Project.
Now that you got the .SLN which contains your source code for the application along with your MSIX project, all you need to do is to trigger a build from the command line, using msbuild.
Note. If you are using a third-party tool to build your MSIX, then search for it's documentation, all professional tools have a command-line interface. Here is for example how you can build a project from using Advanced Installer's CLI.

Clover versus Sonar [closed]

Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 8 years ago.
Improve this question
I've been vetting Static Analysis tools and I've recently come across both Atlassian Clover and SonarQube. The two products seem remarkably similar and virtually identical from a server perspective, yet I can't find a good comparison of them online.
I've also been vetting their IntelliJ plugins, and this where I see vast differences between the two. Clover's IDE integration is amazing, pointing out exact lines of code that aren't covered by unit tests. However, the SonarQube server has this functionality, but I'm not sure the $300/person cost of Clover is worth this IDE convenience.
Sonar's plugin simply seems to point out code issues in the IDE, which is good, but IntelliJ has functionality for this already. Also, does Clover lack this in their plugin, or do I simply not see it because I haven't put the Clover plugin in front of a server yet?
Lastly, I've also seen that Sonar can consume reports generated by Clover. Does anyone have any experience with this? Does the SonarQube server sufficiently replace the Clover server by utilizing these reports? If not, what does Sonar lack?
For reference: http://docs.codehaus.org/display/SONAR/Clover+Plugin
Some background: The product being analyzed is a Java web project being build with Maven. Both tools seem to have appropriate Maven integration.
Disclaimer: I'm a Clover developer at Atlassian.
But I'll try to be as objective as possible, of course.
Let me emphasize one difference between Clover and Sonar first:
Clover is mainly a code coverage tool. It tracks both total coverages as well as per-test coverage. It has some code metrics in addition to this, but it's not a typical static code analysis tool like Checkstyle, FindBugs or PMD.
Sonar (from my perspective) is mainly a data aggregation tool, which can collect various kinds of data (like code coverage, static analysis results, code metrics) from various tools and present them in one place.
What is similar in these two tools that both of them can create rich reports.
Having said this, let me answer your questions.
Clover's IDE integration is amazing, pointing out exact lines of code that aren't covered by unit tests [...] but I'm not sure the $300/person cost of Clover is worth this IDE convenience.
You have to answer it yourself :-) Few things worth consideration:
How does your developer run unit tests - do they run them in IDE before commit? Do you have a "green build" policy? If both answers are yes then having Clover in IDEA may be worth it.
How much time takes the execution of unit tests in IDE? How frequently they're launched? If they take a long time and are frequently launched, then using Clover's Test Optimization feature in IDEA could be interesting.
Do you have your tests split into several build plans running on CI server? Running in specific environment configurations? in such case, server reports could be more valuable than in IDE
do your developers prefer to see code coverage directly in their IDEs or rather clicking through the HTML report in a browser?
Do you expect to see any productivity boost of your team thanks to having source code with coverage highlighting in IDE? How much? Is the 'time saved * salary > clover license price'?
Sonar's plugin simply seems to point out code issues in the IDE, which is good, but IntelliJ has functionality for this already. Also, does Clover lack this in their plugin [...]?
Clover does not perform static analysis, and thus it does not show code bugs. Neither in its HTML report nor IDE plugins (IDEA/Eclipse).
Lastly, I've also seen that Sonar can consume reports generated by Clover. [...] Does the SonarQube server sufficiently replace the Clover server by utilizing these reports? If not, what does Sonar lack?
I'm not 100% sure (please correct me if I'm wrong) but I think the Sonar Clover Plugin parses Clover's XML report file (at least Clover plugins for Jenkins, Hudson and Bamboo work this way) to get some numbers to display. Which means that you won't see Clover's HTML report in Sonar with detailed source line coloring, per-test coverage, tag clouds, etc.
Cheers
Marek

Jelly Framework used in Jenkins [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 4 years ago.
Improve this question
Please let me know how Jelly is used in Jenkins.
Any docs explaining the architecture of GUI in Jenkins will be helpful.
Any tutorial explaining the high level code details or any pointers in the region
The starting point to Jenkins development is the Extend Jenkins page.
On this page, there is a number of sub pages that discuss different aspects of Jelly, see under "Writing Views (Jelly/Groovy)" in the menu.
This along with the tutorials at the bottom of the Plugin tutorial page is a good start.
Some basics:
All Jelly files are connected to a corresponding class based on the path of the Jelly file:
src/main/java/com/example/MyClass.java
src/main/resources/com/example/MyClass/config.jelly
There are a number of different names for different purposes on the jelly files, e.g.: portlet.jelly, index.jelly, global.jelly, config.jelly.
If you are writing a job/build plugin, global.jelly corresponds to system configuration while for job configuration you will use config.jelly.
Happy coding!
You will need maven and can install it from the command line
$ mvn -U org.jenkins-ci.tools:maven-hpi-plugin:create
This will ask you a few questions, like the groupId (the Maven jargon for the package name) and the artifactId (the Maven jargon for your project name), then create a skeleton plugin from which you can start with. Make sure you can build this:
$ cd newly-created-directory
$ mvn package
This is documented here https://wiki.jenkins-ci.org/display/JENKINS/Plugin+tutorial
This ships with lots of UI examples to look at. I would advise using either IntelliJ or eclipse as they have tools to integrate into the maven build process

How can I compile a report showing all used licenses with Ant? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 7 years ago.
Improve this question
I'm currently using Ant and Maven in different projects. To be compliant with some regulations, I'm in charge of listing all licenses used in each project.
With Maven, it is easy, as the Maven Project Info Reports Plugin generates such a report automatically.
As I'm not fond of searching licenses for all my JARs I'm using in the projects, I would like to know if there's a plugin for Ant, performing this task.
Thanks in advance!
Since this question hasn't got any hints, pointers or even answers, I hacked a solution by myself: license-report at github
The license-report is an Ant task which determines a license for most jar files. Currently, it searches in the following files for information:
META-INF/MANIFEST.MF
META-INF/LICENSE
LICENSE.txt
LICENSE
license/LICENSE.txt
license/LICENSE
These files are found in several common Open Source/Free Software libraries. Some libraries don't provide any information on their license (e.g. Spring framework).
For these libraries, the task does not find any information.
I will update the project as soon as possible that it prints out a nice xml and html report about the found licenses. Documentation and How To will follow, too.
I'm currently working on a demo project using this Ant task.
The demo project now creates an XML file with all library information. Just start it (with installed Ant) via ant build.xml in the root folder of license-report-demo. It prints out the location of the generated XML file. I will also include an XSLT to transform the XML into a nice HTML report. This will come in several days I think.
I create an XML file for further processing (e.g. CI systems like Hudson/Jenkins). This will help to generate a list of all licenses across projects in a central system.

code formatter for grails and Groovy? [closed]

Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
We don’t allow questions seeking recommendations for books, tools, software libraries, and more. You can edit the question so it can be answered with facts and citations.
Closed 2 years ago.
Improve this question
I'm currently using a basic text editor to write my grails code. Does anyone know of a program that will automatically format code with indentation similar to indent does for C? I'd rather use a commandline program to do this but can use an IDE to format my code if that's the only option.
Try NetBeans v.6.7 (not the current production release 6.5) with the NetBeans Groovy/Grails plugin enabled. This is a nice clean IDE interface (easier to use than Eclipse IMHO), and you can set it up to integrate with your Grails installation. You can call all your Grails tasks from the IDE, edit your code, test and run your project. Then, if you want to format your code, you just right-click in the code editor and select "Format". Easy!
I am using VIM / GVIM for typing code in Groovy/Grails. it has code formatting, I just need to tell my VIM that groovy and java are similar....
and then press gg = G [enter] (format from top to bottom)
There is a tool recommended in this thread for this purpose. I have not tried it but maybe worth a look.
Here's some instructions on how to get Grails working with NetBeans (couldn't submit the second URL in my last post).
the groovy eclipse plugin does a decent job of formatting groovy code. sts might be smarter about some of the grails code.
You can use npm-groovy-lint for command line, and VsCode Groovy Lint in Visual Studio Code IDE :)
https://www.npmjs.com/package/npm-groovy-lint
https://marketplace.visualstudio.com/items?itemName=NicolasVuillamy.vscode-groovy-lint

Resources