Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Closed 8 years ago.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Improve this question
Is there any tool that can analyze in real-time a log (a custom server application) and output custom metrics over the log? Possibly some graphs on a web interface?
My typical use case is the following: I have a socket server receiving incoming requests. Each request is of a specific "type". I would like to see pieces of information like: how many requests occurred in the last N minutes? The average time of response for the requests (each logged request has its response time); How many requests of a single type has occurred in the last N minutes? And others.
I'm aware that specific information contained in a log item cannot be automatically extracted and I would probably need some coding to instruct the tool how to parse and understand the log, and how it could gather information out of it.
Is there a tool/software/system/monitor that could help with that?
Send Jabber/XMPP message to user#jabberserver.com when new line is appended to the log:
# tail --follow=name --retry /var/log/logfile.log | sendxmpp -i -u username -p password -j jabberserver.com user#jabberserver.com
username/password must be created on jabberserver.com. user#jabberserver.com must be loged in via Jabber/XMPP client that you write on your own (I prefer perl + Net::Jabber). Then you can do whatever you want with the incoming XMPP messages (store on DB, send e-mail, ...).
Tail is the most common tool I know of and if your on windows there is wintail.
At Ustream we needed a tool just like that, so we wrote Yolo. It is a general log parser and processor that can send data to StatsD, which aggregates the data you need (it supports counters, timing data and gauges) and sends to Graphite.
In a nutshell you just have to write a config file, setup a regexp parser to match your log data and setup the statsd keys you want to use. You don't have to write any code.
You can find an example config on Github.
Related
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about a specific programming problem, a software algorithm, or software tools primarily used by programmers. If you believe the question would be on-topic on another Stack Exchange site, you can leave a comment to explain where the question may be able to be answered.
Closed 6 years ago.
Improve this question
I have a pcap file which contains the attack to a local server environment I made. The attack to the local was made using Metasploit Framework on another Kali Linux machine and the traffic was captured with Wireshark using port mirroring on the router. I was able to exploit the system and get the local password.
The question is, how do I know which exploit I have used just by looking on the pcap file? I would like to give that file for forensic analysis.
Is there any way to find the exploit name on the pcap file?
Best regards
After further investigations, I was able to figure it out how to know which exploit has been used on the attack. I managed to configure SNORT, a IDS system, on my Kali Linux machine and pass the *.pcap file to it.
Snort will analyze that *.pcap file trying to find all traffic that matches for certain rules. If any traffic behavior matches with any snort rules, snort will prompt you with a message.
Taking this into account, I was able to gather exploit name after a match of the rule exploit.rules in Snort folder.
Snort has plenty of rules by default on his rules folder, so you just need to run the following command to the *.pcap file and pray for a match ;)
snort -r <your-pcap-file>
I hope this help to anyone who is trying to find which exploit has been used on a attack that was captured by tcpdump or wireshark.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 8 years ago.
Improve this question
I am curious to know the advantages between using parse or a custom xmpp server. I am curious if parse has the capability of being used for creating a real time chat application, because I have never used parse for that use. Or would it be easier and better to use a custom xmpp server to handle messages. I am also curious if parse would be able to completely delete data off the server because that is what my application requires. As background info I have already started the project with parse, but I could switch over to another option if it is necessary.
Thanks
In my experience with working with Parse, I don't believe that it's the correct solution for your needs.
You may get things up and running at first, but as you try to scale your application, you're going to need to ramp up your servers (and cost!) greatly to handle so many requests. Parse's pricing is based on your requests count for the month. Imagine how many requests you expect one user to make in a month. Now times that by 1000.... Not very scalable, huh?
Now I don't know much about xmpp servers, but I've heard from some colleagues that applications like WhatsApp are using Erlang and TCP servers (just like Call of Duty) to handle message requests. In fact, here's an article that talks about the logistics of WhatsApps technology https://www.erlang-solutions.com/about/news/erlang-powered-whatsapp-exceeds-200-million-monthly-users
Best of luck!
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 8 years ago.
Improve this question
This may be off topic but if anyone can help or point me in the right direction.....or the correct place to put this question?
Can anyone suggest a good Automated Web Scraping program for use on a windows machine?
I would like to be able to automate the process and set it to be able to "scrape" the site every 5 mins or so and have the resulting xml exported to another website or database?
If the actual process is taking too long, those 10 seconds or more likely to being the network latency rather than actual parsing and scraping its self. If that is the case, you probably want to have them executing in parallel rather than sequentially if you have not already done so.
It would help if you had a more specific issue as there is several ways about going about this. You could have it still parsing on the phone. If that is too problematic for whatever reason, in my opinion, I would instead build a separate HTTP REST server for the phone client to have it interact with to get the data it requires.
There is many ways about going about this, and these are simply recommendations. If you want a more specific answer, you'll need a more specific question. Consider then asking a more speific programming issue if you run into one.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Closed 9 years ago.
Questions asking for code must demonstrate a minimal understanding of the problem being solved. Include attempted solutions, why they didn't work, and the expected results. See also: Stack Overflow question checklist
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Improve this question
So i created my first app which allows users to track there fitness information (workouts, routines, etc). I want take my app to the next step by allowing the user to create there own account and be able to access their workouts from any ios device (all they have to do is log in). I know i have to use databases, but I just don't know where or how to start this process.
Could you recommend any tutorials or perhaps a resource you used to teach yourself? I'm familiar with sql (took a course on it in university.
thanks guys, I apologize for the newb question.
There are many third-party services you can use that can take care of the backend for your app so that you don't need to worry about managing the database yourself. Two of the most popular ones are parse and stackmob. Take a look at their documentations. I personally use parse and would recommend it.
I've never written any os apps, but for applications in general.
There are many ways, one of which is getting a server/website (you can get free ones) and set up the MYSQL database to have the tables you need like users etc.
Then simply send requests via POST/GET to the server which will enter it into the database.Then when they want to login just do the reverse.
I would personally uses sockets, and probably encrypt the data. You may as-well send information such as how long they've used the app for etc.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking us to recommend or find a tool, library or favorite off-site resource are off-topic for Stack Overflow as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it.
Closed 8 years ago.
Improve this question
I need to pull some reports that live in a SQL Server Reporting Server from a Ruby web application.
How can this be done?
There is nothing out there pre-built that I'm aware of, but you have some options for integration.
The simplest, if users have direct access to the RS server, is to just redirect or link them to the report using their URL-based strategy, possibly opening a new window. If users do not have direct access, you can still use the URL-based strategy, but perform a request on the back end from your Rails app to the MS Reporting Services server, and stream all the report bytes through to the browser:
open("http://ReportServer/reports?querystringxxxx") { |f|
#response = f.read
}
This is drastically simplified, of course. You'll need to pay particular attention to your content types to ensure things get interpreted correctly by the browser.
The next option is to use their web services API, but unless you need particularly advanced functionality, I'd say the URL/REST based approach is far, far simpler.
If you get it working, take the opportunity to try creating your first gem, put it up on github, and then maybe somebody else will use it one day... :)
The rest-based approach would only work for a report with no parameters.
If the report has parameters, you will need to use the Web Services API, a SOAP-based interface that requires you to parse the request (with the parameters) into XML and send that with the request to MSSRS.
According to my co-worker, who has done it, it's pretty cumbersome for what you actually get.