I have website and added the google custom site search. It works fine and displays the results. The pages are stored in the database and allowed to edit by Administrator (as CMS solution)... How google search the content and displays from my database content? I would like to know the technique or method google follow?
Google does not have access to your database, only your web pages. It regularly crawls your web pages and indexes them, just like it would for its own search results. The only difference is it serves up results specific to your website to your website.
Related
I have a website that has been replaced by another website with a different domain name.
In Google search, I am able to find links to the pages on the old site, and I hope they will not show up in future Google search.
Here is what I did, but I am not sure whether it is correct or enough.
Access to any page on the old website will be immediately redirected to the homepage of the new website. There is no one-to-one page mapping between the two sites. Here is the code for the redirect on the old website:
<meta http-equiv="refresh" content="0;url=http://example.com" >
I went to Google Webmasters site. For the old website, I went to Fetch as Google, clicked "Fetch and Render" and "Reindex".
Really appreciate any input.
A few things you'll want to do here:
You need to use permanent server redirects, not meta refresh. Also I suggest you do provide one-to-one page mapping. It's a better user experience, and large numbers of redirects to root are often interpreted as soft 404s. Consult Google's guide to site migrations for more details.
Rather than Fetch & Render, use Google Search Console's (Webmaster Tools) Change of Address tool. Bing have a similar tool.
A common mistake is blocking crawler access to an retired site. That has the opposite of the intended effect: old URLs need to be accessible to search engines for the redirects to be "seen".
Customers use web queries to grab data in the tables directly from our website and place them into excel where they can automatically work on it. while trying to grab data from our website, we noticed that table markers were not shown. excel is unable to recognize the tables on the web page.
Website was developed using RoR.
can someone help us with this issue?
You may want to consider using Power Query instead of regular web queries. With the "from Web" option you can get the DOM into Power Query and access any DOM element.
I'd like to make a tool which accesses a search engine programatically.
I've been enjoying using YQL recently and thought it might be useful since it can dig data out of HTML pages.
But I tried it with Google, Bing, and Yahoo search and they all seem to block YQL.
I wonder if there are some lesser-known web search sites that might work with YQL.
Or actually if there's still any search engine which offers an API that would be even better.
(In fact I'm only searching linguistics.stackexchange.com because the Stack Exchange APIs don't provide a way to search by text that I can find.)
Most search engine sites will block access from screen scrapers and other agents. YQL is designed to respect the robots.txt file, so on many sites like this it won't work.
Instead, I suggest moving a step above HTML screen scraping and using a published search API.
In YQL for example, there is a table which provides access to the Bing search results:
select * from microsoft.bing where query="soccer" and source in ("web","image")
You could also look at the Yahoo! BOSS API or using the Bing Search API directly.
I want to create a search webpage which should display the Google results page as well as results from our intranet webpage. Can I design it using Google Custom Search Engine?
Not unless you expose your intranet to the public Internet for Google to index, which is probably not something you want to do.
They have services to index intranet content as well, but they might be a big costly.
Let's say a want to use Yahoo Boss for a brand new, unindexed site; Is there a way I submit an XML feed i.e. a site map in order to get results before The site gets indexed ?
You'll want to submit your site through Yahoo Site Explorer (additional help). Then assuming that your site gets indexed, results should be available via the Yahoo BOSS search webservice.