G-Scraper, a GUI Web Scraper, Written in Python
Target audience? Basically data collectors or anyone trying to scrape data from websites using a GUI What my project does: -Take URLs -Take elements to scrape from those webpages (this is optional in the sense that if you dont specify any elements the app will just scrape the entire page) -You can also send web parameters like Headers, Payloads along with specific URLs. This means it can perform any logins that are necessary -Is able to log the results in a log file, a separate one for each scrape -Data is stored in form of .txt files Some unique features of this project: -Can scrape…
In plain words
G-Scraper is a Python-based graphical tool for extracting data from websites. Users input URLs and specify which page elements to scrape, or scrape entire pages by default. The tool supports multiple URLs and elements simultaneously, handles authentication through custom headers and payloads, and processes GET and POST requests. Results are saved as text files with individual logs for each scrape. Scraping runs in a background thread, allowing users to continue working while collection continues.
written from the facts on this page · September 2026
From the sources
In the maker’s words, at launch
Target audience? Basically data collectors or anyone trying to scrape data from websites using a GUI What my project does: -Take URLs -Take elements to scrape from those webpages (this is optional in the sense that if you dont specify any elements the app will just scrape the entire page) -You can also send web parameters like Headers, Payloads along with specific URLs. This means it can perform any logins that are necessary -Is able to log the results in a log file, a separate one for each scrape -Data is stored in form of .txt files Some unique features of this project: -Can scrape multiple URLs -Can scrape multiple elements in a single URL -Supports GET and POST requests -Scraping runs in a separate thread than the GUI, so you can close the app or use it and the scraping will continue -You can edit the added variables or delete them. You can also reset the entire app's current data to start a new set of scrapes -Very very unique filenames for each file created -3 types of log files: webpage scrape log, element scrape log and error log Some drawbacks of the project: -No output to user AT ALL so user has to rely on checking the output folder for scrape's status -Probably does not log all errors although I tried to recreate every possible error -Once scrape has started there is no way to stop it -Can only scrape textual data (texts, links etc.). So no scraping of things like images, videos -Cannot scrape text of a tags a.k.a link tags, only their links Hope you enjoy it. Feel free to leave any suggestions
More dev tools this month
the category →
Open-source GTM skills for technical founders
Dev tools · 29d ago · gtmcofounder.com
OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.
Dev tools · 1d ago · opentrailpaper.com
Launched alongside, July 2024
the whole month →
- IC
Many years ago, I made VJ softwares (to mix live visuals in clubs) for unexpected platforms like the Game Boy Advance, the Playstation 2 and the Raspberry Pi. This year, I’m back with a new web-app: Pikimov. Inspired by Photopea (a free Photoshop clone), I created this web-based motion design & video editor as an alternative to After Effects, to fill empty void. It's free, without signup, without cloud uploads (your files stay on your machine), and your projects are not used for AI models training.
AI · 2024 · pikimov.com
