All about robots.txt of any web site.

Robots.txt is very good things for any web sites. The robots.txt is use for web routing purpose. in the robots.txt file , there are instructions are give for web routes for their wer robots. This is called The Robots Exclusion Protocol.

If you want to go www.abc.com/index.html , then it first checks for http://www.abc.com/robots.txt. if /index.html is allowed in robots.txt then you will be routed for that /index.html otherwise you can not go on index.html page. 

User-agent: *
Disallow: /search
Allow: /search/about
Disallow: /sdch
Disallow: /groups
Disallow: /index.html?
Disallow: /?
Allow: /?hl=
Disallow: /?hl=*&
Allow: /?hl=*&gws_rd=ssl$
Disallow: /?hl=*&*&gws_rd=ssl
Allow: /?gws_rd=ssl$
Allow: /?pt1=true$
Disallow: /imgres
Disallow: /u/
Disallow: /preferences
Disallow: /setprefs
Disallow: /default
Disallow: /m?
Disallow: /m/
Allow:    /m/finance
Disallow: /wml?
Disallow: /wml/?
Disallow: /wml/search?
Disallow: /xhtml?
Disallow: /xhtml/?
Disallow: /xhtml/search?
Disallow: /xml?
Disallow: /imode?
Disallow: /imode/?
Disallow: /imode/search?
Disallow: /jsky?
Disallow: /jsky/?
Disallow: /jsky/search?
Disallow: /pda?
Disallow: /pda/?
Disallow: /pda/search?
Disallow: /sprint_xhtml
Disallow: /sprint_wml
Disallow: /pqa
Disallow: /palm
Disallow: /gwt/
Disallow: /purchases
Disallow: /local?
Disallow: /local_url
Disallow: /shihui?
Disallow: /shihui/

.

 

Create a /robots.txt file on your web site

Where to put it

At the top-level directory of your web server.

 For example, for "http://www.abc.com/home/index.html, it will remove the "/home/index.html", and replace it with "/robots.txt", and will end up with "http://www.abc.com/robots.txt".

What to put in it

The "/robots.txt" file is a text file, with one or more records. Usually contains a single record as:

User-agent: *
Disallow: /search
Allow: /search/about
Disallow: /sdch
Disallow: /groups
Disallow: /index.html?
Disallow: /?
Allow: /?hl=
Disallow: /?hl=*&
Allow: /?hl=*&gws_rd=ssl$
Disallow: /?hl=*&*&gws_rd=ssl
Allow: /?gws_rd=ssl$
Allow: /?pt1=true$

Prime Minister of India: Hon. PM Narendra Modi.

Narendra Damodardas Modi is the 15th and current Prime Minister of India, in office since 26 May 2014.

Narendra Damodardas Modi is the 15th and current Prime Minister of India, in office since 26 May 2014.
Modi, a leader of the Bharatiya Janata Party, was the Chief Minister of Gujarat from 2001 to 2014 and is the Member of Parliament from Varanasi.

Born: September 17, 1950 (age 65), Vadnagar
Spouse: Jashodaben Modi (m. 1968)
Preceded by: Manmohan Singh
Education: Gujarat University (1983), University of Delhi (1978)
Parents: Heeraben Modi, Damodardas Mulchand Modi
Siblings: Vasantiben Hasmukhlal Modi, Prahlad Modi, Amrit Modi, Pankaj Modi, Soma Modi.

Narendra Modi's qualification:
While Modi holds a Masters in Political Science from Gujarat University, some of his ministers have only studied up to class 10.
Prime Minister Narendra Modi's 23 Cabinet ministers and their educational qualifications.

On 2nd October 2014, Mahatma Gandhi’s Birth Anniversary the PM launched ‘Swachh Bharat Mission’ a mass movement for cleanliness across the Nation.
The scale and impact of the movement are historic.
Narendra Modi’s foreign policy initiatives have realized the true potential and role of world’s largest democracy, India on the world stage.
He began his term in office in presence of all Heads of States of SAARC Nations.
His address to the General Assembly of United Nations was appreciated across the world.
Narendra Modi became the first Indian Prime Minister to embark on a bilateral visit to Nepal after a long period of 17 years, to Australia after 28 years,
to Fiji after 31 years and Seychelles after 34 years. Since taking over, Narendra Modi attended UN, BRICS, SAARC and G-20 Summits,
where India’s interventions and views on a variety of global economic and political issues were widely appreciated.
His visit to Japan marked a momentous chapter to unfold a new era of India-Japan relations. He became the first PM of India to visit Mongolia and his
visits to China and South Korea have been successful in drawing investments to India.

His continued engaging with Europe was seen during his visit to France and Germany.
Shri Narendra Modi has attached great importance to strong ties with the Arab world.
His visit to UAE in August 2015, the first by an Indian PM in 34 years, covered tremendous ground in enhancing India’s economic
partnership with the Gulf. In July 2015 Shri Modi visited the five central Asian Nations in a visit that was seen as path-breaking.
Vital agreements were signed between India and these nations in spheres like energy, trade, culture and economics.
In October 2015 a historic India-Africa Summit was held in New Delhi, in which 54 African nations participated.