I want to configure my google search engine in order to search only for HTTPS websites. I found something like Google Programmable Search Engine. I am now struggling to configure the HTTPS-pattern of the websites to search (see the screenshots below).
https://www.*:443 also doesn't work.
Maybe there is another way to achieve my goal (without the google programmable search engine)?
The inurl Google Search Operator is what was I looking for.
Lets say I want search with the keywords "buy bitcoin" a https secured website I can type now in the google search field:
buy bitcoin inurl:https://
A negative example will include not https protected marktplaces:
buy bitcoin inurl:http://
Related
I have added the Twitter and Google Drive app to my Slack team. For an ERP system I am currently working on, I’d like to replace certain URLs similar to how Twitter / Google Drive do:
Google Drive:
Your message containing the link will be changed into a share message
point to the external reference file in Slack
Twitter:
Automatically expand pasted Twitter URLs, displaying the full tweet
and attached media
The obvious way seems to be using an Outgoing Webhook with the first part of the URL (e.g. https://erp.acme.com) as "trigger word", but this doesn’t seem to be working with private groups and channels. Google Drive doesn’t seem to have this limitation. Which API offers enough flexibility?
An engineer from Slack replied and offered two solutions. Thanks Brad!
Solution A
Set the outgoing webhook trigger to <https://erp.acme.com – note the opening <, as that's how URLs are parsed on Slack's side. The outgoing webhooks currently only work in public channels.
Solution B
Provide meta tags to make use of Slack's "unfurling".
You can read the link expanding documentation here, as well as this in-depth blog post about Slack unfurling.
I did some web search and found nothing for the question i have with me, so I'm posting it here. I wants to build a simple Ruby On rails web application which will be used to display the search result from a third party ebsite without any API avilable. (ex: For example when a user type a keyword and click search i need to get the response from google.com and display that to user in my application).
How can i achieve this?
I hope scrapping is not an advised solution.Is there any advisable techniques(like SOAP 0r REST API).
NOTE: The website is a public government website.i need to access the search from my application(It has no built in API for this purpose).
Google has a search api that you can use https://developers.google.com/custom-search/json-api/v1/overview
and there is a gem available.
https://github.com/google/google-api-ruby-client
I have seen many examples where a search task was launched from application but no examples where application could get some info back from that task.
For example, is it possible to get a list of found sites or URL that user have chosen in task (instead of navigating user to that URL)?
There is no built-in API in WP8 that would allow getting the results of a web search into your app. You should use a 3rd party framework for that.
Bing has an official Web API you can use for that but it starts costing money after 10,000 API calls per month. You can read more about it # https://datamarket.azure.com/dataset/5BA839F1-12CE-4CCE-BF57-A49D98D29A44
Note that Bing did use to have a proper C# API with API keys and what not, but V2.0 of that API has been depercated in favour of the new Azure Data Marketplace service.
Google doesn't have an API for search results. But for the past few years developers have used Google's AJAX webservice to get those. See a C# code sample # http://answers.oreilly.com/topic/2165-how-to-search-google-and-bing-in-c/
Can someone explain to me what to consider first when designing a meta-search engine using Erlang, Mnesia and the Yaws web server? This engine should have SMS capability but I am still wondering how I am going to incorporate this feature...
The meta search engine, you need REST or Ajax APIs from Google, Yahoo and Bing. Below am providing you with examples which you may use within your back end HTTP capable Library or your front end JavaScript. I personally use mochiweb and yaws Appmods.
For example: Google has an Ajax search API which works like this:
http://ajax.googleapis.com/ajax/services/search/web?v=1.0&q=computers
Hitting that URL will give you a JSON Object which contains several search responses. In this case, the search term is "computers"
Yahoo has what it calls Boss APIs. An example of Yahoo Rest search API using Boss is here below:
For an XML result:
http://boss.yahooapis.com/ysearch/web/v1/animals?appid=APPID&format=xml&start=1&count=3
For a Json result:
http://boss.yahooapis.com/ysearch/web/v1/animals?appid=APPID&format=json&start=1&count=3
Analyse the whole HTTP GET query very well, you notice something they call an APPID. This you will get when you register with them here. I cannot give to you my APPID, you will have to get yours,then paste it in there and you will be good to go. Yahoo has something more powerful called
YQL. In the above query, the search term is: "animals"
Bing as well has got an API for you, but you will need an APPID:
http://api.bing.net/json.aspx?AppId=APPID&Query=love&Sources=Web&Version=2.0&Market=en-us&Web.Count=10
Above, the search term is: "love"
About the Meta Search Engine
You have a web page, people enter search queries in this page. You use your javaScript (JSONP). JSONP could be implemented in any one of your favorite JavaScript Framework you use e.g.
JQUERY,Ext JS,Dojo, Prototype e.t.c
Then you would have to parse the XML or JSON response from the three sources (Google, Yahoo and Bing),and make an appropriate display for your users to navigate the results.
About the SMS part
SMS capability is attained using SMS Gateway. There are several open and close source SMS Gateways. the most powerful of them all is the one built in Erlang/OTP technology called: OSERL, but to test it, you need direct connection with an SMSC in anyone of your local service provider.You need a Port on their SMSC, a user name and a password.There is another one which is better for development reasons called: NowSMS because it has capabilities for USSD, Modem Internet Communication, SMSC service connectivity, HTTP 1.1 and HTTP 1.0, configuration of two-way SMS messaging e.t.c from a Web App to-and -from the SMS Gateway. Go to their site, grab the trial version, follow the documentation and then configure two-way from your web app to the gateway and vice versa. Since NowSMS is not free, you can try: Kannel, it is open source but you will need help from the community to set it up on your Unix or Linux box.
More on incorporating SMS capability in Web Applications can be found:
Here
I also asked once a Question related to development of a powerful search engine using Erlang, Mnesia & YAWS webserver on Stackoverflow. I got plenty of good answers and responses.
Please CLICK ME!
Hope this may help. As I am not sure about SMS thing.
I want to parse google and yandex search results for my little website analyzer utility.
so i should send hundreds requests per minute. What is good practice for this issue?
Is google search api a good way?
The Google Search API may not be used for bots. Google will block your utility if you request too much searches.
http://code.google.com/apis/ajaxsearch/terms.html
You agree that when using the Service, You will not, and will not permit users or other third parties to:
Use any robot, spider, site search/retrieval application, or other device to retrieve or index any portion of Google Search Results or to collect information about users for any unauthorized purpose;