get an xhr document that loads when you visit a page

Just add the right headers and there you have the data.

import requests


headers = {
    "referer": "https://www.nosetime.com/xiangshui/350870-oulong-atelier-cologne-oolang-infini.html",
    "user-agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.111 Safari/537.36",
}
response = requests.get("https://www.nosetime.com/app/item.php?id=350870", headers=headers).json()

print(response["id"], response["isscore"], response["brandid"])

For some reason I can’t paste the entire JSON output as SO thinks this is spam… o.O. Anyhow, this should get you the JSON response.

This prints:

350870 8.6 10091761

EDIT:

If you have more products, you can simply look over the product URLS and extract from the JSON what you need. For example,

import requests

product_urls = [
    "https://www.nosetime.com/xiangshui/947895-oulong-xuecheng-atelier-cologne-orange.html",
    "https://www.nosetime.com/xiangshui/705357-pomelo-paradis.html",
    "https://www.nosetime.com/xiangshui/592260-cl-mentine-california.html",
    "https://www.nosetime.com/xiangshui/612353-oulong-atelier-cologne-trefle.html",
    "https://www.nosetime.com/xiangshui/911317-oulong-nimingmeigui-atelier-cologne.html",
]


for product_url in product_urls:
    headers = {
        "referer": product_url,
        "user-agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.111 Safari/537.36",
    }
    product_id = product_url.split("/")[-1].split("-")[0]
    response = requests.get(
        f"https://www.nosetime.com/app/item.php?id={product_id}",
        headers=headers,
    ).json()
    print(f"Product name: {response['enname']} | Rating: {response['isscore']}")

Output:

Product name: Atelier Cologne Orange Sanguine, 2010 | Rating: 8.9
Product name: Atelier Cologne Pomelo Paradis, 2015 | Rating: 8.8
Product name: Atelier Cologne Clémentine California, 2016 | Rating: 8.6
Product name: Atelier Cologne Trefle Pur, 2010 | Rating: 8.6
Product name: Atelier Cologne Rose Anonyme, 2012 | Rating: 7.7

CLICK HERE to find out more related problems solutions.

Leave a Comment

Your email address will not be published.

Scroll to Top