gcloud dataflow component time required - google-cloud-dataflow

Can anyone please help me to point to a tool which could be used to measure the time spent on individual components of a gcloud dataflow? Also if the tools exists, can you please share the link too? Thanks

I don't know about any external tool used to measure a dataflow job's components; however, I think this information can be retrieved by using the Monitoring UI that contains detailed information about the general pipeline job execution, as well as the Total Execution Time per step. Additionally, you can take a look in this link that contains a Understanding timing guide in case you want to get a deeper understanding of this feature.

Related

Extract cycle times from Github

I'd like to extract a task (issue) cycle time from my project and explore how they can be visualized in meaningful and helpful ways. Is this information possible to retrieve from the github API? After spending some time in the docs, I can't find this information available. Here are the available endpoints: https://docs.github.com/en/rest/overview/endpoints-available-for-github-apps
It seems there's isn't a cycle time (process time) value, how can I retrieve it?
I think you've hit the nail on the head by wanting to do this using the GitHub API, instead of needing to rely on any inaccurate metrics from project management tools like Jira. It's definitely possible to extract meaningful software engineering metrics from GitHub, but the easiest way is to use a commercial service to do this.
Haystack Analytics offers a commercial service that allows you to extract Cycle Time. That Cycle Time can then be broken down into Development Time and Review Time (which in turn can then be broken down into First Response Time, Rework Time and Idle Completion Time). You can track the other DevOps Four Key Metrics (as mentioned in the Accelerate DevOps book) in Haystack too.
Google Cloud Platform have also open-sourced a self-hosted tool on GitHub that allows you to extract the Four Key Metrics from Git data. Do note that this tool contains a number of limitations and the metrics might not work with your use-case out of the box.

Automating Speed Tests on Merging Pull Requests

I am trying to track the page speed of certain urls of my project on each merging of the pull requests in Github and output the results of report in HTML format or JSON file. On the CI side, I am going to use Jenkins. I have no prior knowledge on performance testing. I want to know about the best approach to automate the speed test, integrate it with Jenkins and output the result.
On researching over the internet, I noted few possibilities which could be done to achieve this goal.
Installing "Page Speed Insights (psi) node package", creating the script that uses the psi for fetching the speed of certain pages, generating the test reports for use with Jenkins. (Referred to this link by Oxagile)
Performance testing using Jmeter and integrating with Jenkins.
Performance analysis using LightHouse. (Referred to this link by Timo Stollenwerk)
Choosing the right approach is very important. Therefore, I would be very grateful if anyone can suggest me different approaches and thus the right one to use(with examples if possible)in my case to achieve this goal.
Thank you in advance.
After quite a bit of research, I found out that sitespeed.io is the best solution for achieving this goal. It is a complete web performance tool that helps us to measure the performance of the website. It is best for running in the continuous integration to find web performance regressions on commits and monitoring them in production and alerting on regressions.

JIRA traceability metrix report for cloud instance

Does anyone knows how to get traceability matrix report in JIRA Cloud instance? Several good plugins there but all are only supported to the server instances, not for the cloud ? I have already installed QMetry JIRA plugin for test cases, if anyone tried a different solution for traceability matrix reports other than using a plugin, it would help me.
Looks like there are a few options that you could test for your need!
All-in-One Reports for JIRA
Traceability Matrix and Link Graph
Custom reporting with Midori
Not just these, there are quite a few custom approaches on getting this done, by implementing your own code on the results that you gain from JQL's instead. There is this page on Atlassian, that you must go through to get some hints and pointers for your implementation, or to choose from something that already exists.
Check this discussion!
Hope this helps!

Tool to check speed of the page of multiple URL's at same time

I want a tool which will give me the loading speed of multiple urls from same tool with one search.
I found this:
http://www.webpagetest.org/video/
could maybe help you.
If you're looking for free (and open source) solution there is quite a list at http://www.opensourcetesting.org/performance.php
The most promising and powerful of them imho are:
Apache JMeter
Gatling
Grinder
Tsung
See Open Source Load Testing Tools: Which One Should You Use? guide which highlights main features and sample load reports followed by comparison matrix

Developing my first Jenkins Plugin (Need advice/resources)

At my workplace, I've been tasked to look into some metrics that the Jenkins tool provides and somehow pull them programatically and display them in some presentable format. The metrics that I need to pull are:
How many unit tests are passing? Failing? Skipping? The total % of passing?
How many integration tests are passing? Failing? Skipping? The total % of passing?
How many acceptance tests are passing? Failing? Skipping? The total % of passing?
How long does it take to execute the test? Make the build?
What is the number of tests executing in pipelines?
... the list goes on
Now I have a very small 1000 ft understanding of Jenkins, and an even smaller understanding of the steps that I need to take to make this program come to life. I am an intern with not much programming experience either, but after some research, I learned that I can navigate through the Jenkins API by adding '.../api' to the link that I want to find API elements for, and I know that I'm going to need to develop a plugin. Aside from that I don't have much direction at all. I don't know what environment I need to develop these plugins (Maven? Never heard of it)... I don't know what languages are supported (I only know C++, Java, and JS)... I don't know how to even install a plugin or get to the plugin on the Jenkins site. I feel like I'm drinking from a firehose with this task and need some guidance.
Does anyone have good guides, advice, tips, tricks, videos... anything that might help me get started on Jenkins plugin development? Any insight into how I might solve this problem too would be much appreciated.
Thanks so much.
First of all there are tools out there which generates HTML reports. You can start there.
For example: MSTest report (.trx) can be converted to HTML by TRXER
and can be published using the HTML Publisher Plugin
However if you're into building your own plugin use NetBeans (I have tried it; and it works)
But creating Jenkins graphs you have to google and see.

Resources