Performing Google Search using Python code

Let’s say you are working on a project that needs to do web scraping but you don’t know websites on which scraping is to be performed beforehand instead you are required to perform google search and then proceed according to google search result to few websites. In that case you need google search result for your different queries.

One way of achieving this is using request and beautiful soup which has been discussed here in Implementing Web Scraping in Python with BeautifulSoup.
Instead of putting so much effort for a trivial task google package has been made. Its almost a one liner solution to find links of all the google search result directly.
Using python package google we can get result of google search from python script. We can get link of first n search results.

Installation
google package has one dependency on beautifulsoup which need to be installed first.

pip install beautifulsoup4

Then install google package

pip install google

Required Function and its parameters

search(query, tld='com', lang='en', num=10, start=0, stop=None, pause=2.0)

query : query string that we want to search for.
tld : tld stands for top level domain which means we want to search our result on google.com or google.in or some other domain.
lang : lang stands for language.
num : Number of results we want.
start : First result to retrieve.
stop : Last result to retrieve. Use None to keep searching forever.
pause : Lapse to wait between HTTP requests. Lapse too short may cause Google to block your IP. Keeping significant lapse will make your program slow but its safe and better option.
Return : Generator (iterator) that yields found URLs. If the stop parameter is None the iterator will loop forever.

Python codes on how to do google search using python script

Example1: google_search.py

try:
    from googlesearch import search
except ImportError:
    print("No module named 'google' found")
# to search
query = "Geeksforgeeks"
for j in search(query, tld="co.in", num=10, stop=10, pause=2):
    print(j)

Output:

Lets perform google search manually and verify our result

Example 2: google_search.py

try:
    from googlesearch import search
except ImportError:
    print("No module named 'google' found")
# to search
query = "A computer science portal"
for j in search(query, tld="co.in", num=10, stop=10, pause=2):
    print(j)

Output:

Lets perform google search manually and verify our result

Last Updated on October 24, 2021 by admin

Performing Google Search using Python code