Get product name and lowest price using Amazon Product Advertising API

Purpose

I got the product name and the lowest price from the Amazon site using the API, so make a note of it.

• AMAZON API specifications and library specifications may change. The following is the one that worked as of March 10, 2015.

Assumed environment

• Python 2.7
• Use bottlenose this for Amazon's API.
• Use BeautifulSoup 3.2.1 here for XML.

Advance preparation

• Get the access key from the Amazon Management Console. (Security Credentials-> Access Keys)
• Associate (affiliate) registration.
• Bottlenose and Beautiful Soup installation.

pip install bottlenose
pip install BeautifulSoup

code

# -*- coding: utf-8 -*-
import bottlenose
from BeautifulSoup import BeautifulSoup
import random
import time
from urllib2 import HTTPError

AWS_ACCESS_KEY_ID='******' #Obtained from the management console
AWS_SECRET_ACCESS_KEY='******' #Obtained from the management console
AWS_ASSOCIATE_TAG='******-22' #Associate (affiliate) registration required

SearchIndex="Books" #Reference https://images-na.ssl-images-amazon.com/images/G/09/associates/paapi/dg/index.html?JPSearchIndexParamForItemsearch.html
Keywords="Python" #Search keyword

def error_handler(err):
  ex = err['exception']
  if isinstance(ex, HTTPError) and ex.code == 503:
    time.sleep(random.expovariate(0.1))
    return True

amazon = bottlenose.Amazon(AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY, AWS_ASSOCIATE_TAG,Region="JP",ErrorHandler=error_handler)

#Get the number of result pages
response = amazon.ItemSearch(
             SearchIndex=SearchIndex,
             Keywords=Keywords,
             ResponseGroup="ItemIds",
             ErrorHandler=error_handler)
soup=BeautifulSoup(response)
totalpages=int(soup.first('totalpages').text)
print "totalPages=",totalpages

#Get each page
for page in range(totalpages) :
  print "="*20,"page",page+1
  if page >= 10: # max 10 pages
    break
  response = amazon.ItemSearch(
               SearchIndex=SearchIndex,
               Keywords=Keywords,
               ResponseGroup="Small,OfferSummary",
               ItemPage=page+1,
               ErrorHandler=error_handler)
  soup=BeautifulSoup(response)
  items = soup.findAll('item')
  for item in items:
    print item.title.text ,
    if item.offersummary and item.offersummary.lowestnewprice:
      print item.offersummary.lowestnewprice.formattedprice.text,
    print

I understand. I didn't understand.

• Since there is a limit to the number of API calls, sleep and retry if the call fails.
• Search up to 100 items (10 items x 10 pages). (Restrictions set around 2011)
• The default when searching should be only new, but even used items are included. (The new price may not be obtained well.)