nowfound

Dev tools · July 1, 2021

VD

VisaWhen – Data on US visa issuance backlogs

Heya! Not the usual sort of thing to be posted here, but I wanted to show off what I made yesterday. Here's a sample page about H1-B visas issued in Bogota: The code is source-available (not open source) at . It's my first time choosing a source-available license over MIT, mainly out of fear of existing immigration startups just gobbling this data and code up; frankly I didn't think the implications through though, I just threw a safe license on there. The way the project works is: - Use requests-html to find publicly available PDFs from government pages - Use camelot to OCR the PDFs and…

Alternatives

What it does

In the maker’s words, at launch

Heya! Not the usual sort of thing to be posted here, but I wanted to show off what I made yesterday. Here's a sample page about H1-B visas issued in Bogota: <https:&#x2F;&#x2F;visawhen.com&#x2F;consulates&#x2F;bogota&#x2F;h1b> The code is source-available (not open source) at <https:&#x2F;&#x2F;github.com&#x2F;underyx&#x2F;visawhen>. It's my first time choosing a source-available license over MIT, mainly out of fear of existing immigration startups just gobbling this data and code up; frankly I didn't think the implications through though, I just threw a safe license on there. The way the project works is: - Use requests-html to find publicly available PDFs from government pages - Use camelot to OCR the PDFs and extract data tables from them - Since the previous step takes crazy long for my tastes (around 8000 pages at around 5 seconds each) I've used dask to split the work into chunks and parallel-process them across my laptop's CPUs. - Do data cleanup and processing with pandas, and save all of it to a SQLite file. - Take data from the SQLite file with next.js and generate a static HTML page for each possible embassy - visa type combination - The pages use ECharts to visualize data, and Bulma as a CSS framework - Build and host each commit via Netlify - But proxy to Netlify from CloudFlare, which I believe has more edge locations in the free plan - Collect any donations via Ko-Fi - Use Google Analytics to have a general idea about visitor counts - Use FullStory session recordings to find out about bugs – I've fixed quite a few and I think I'll probably remove this tracking after a bit of time …and that's where I'm at now. I'm pretty happy about the results. Most pages load in less than 300ms, which is something I care about all too much. More importantly, I've shared the site with some immigration communities I'm part of, and the response has been very positive! Let me know what y'all think.

Does the same job

all alternatives →

More dev tools this month

the category →
  • Dograh▲592

    The open source VAPI alternative

    Dev tools · 25d ago · dograh.com

  • Meridian▲530

    Don't let your work go unnoticed. Get promoted!

    Dev tools · 20d ago · meridiona.com

  • x1▲516

    Lovable for iPhone apps go from idea to App Store

    Dev tools · 11d ago · x1.new

  • The GTM Co-Founder▲402

    Open-source GTM skills for technical founders

    Dev tools · 29d ago · gtmcofounder.com

  • Open-Source eInk Bike Computer▲390

    OpenTrailPaper is open-source bike computer firmware for the LilyGO T5S3 4.7" E-Paper PRO. It supports offline maps, GPX routes, FIT recording and Bluetooth sensors.

    Dev tools · 1d ago · opentrailpaper.com

  • Nuphos▲380

    The AI-Native DevOps Workspace.

    Dev tools · 24d ago · nuphos.ai

Launched alongside, July 2021

the whole month →