Snapshotting memory to scrape encrypted network requests

1 · JonLuca De Caro · Aug. 8, 2021, 2:06 p.m.
Most web reverse engineering focuses on two attack surfaces - either DOM scraping through something like puppeteer or beatifulsoup, or on MITM attacks to reverse network calls. The former is what most traditional scraping looks like - you manually inspect a web page, you determine the right xpath/css selectors to follow, and then instruct a scraper to statically request the page and scrape it. The rise of SPAs has made this approach a bit less impractical - you now have to actually render the co...