Life & fun · February 26, 2019
AdaBound, an optimizer that trains as fast as Adam and as good as SGD
An optimizer that trains as fast as Adam and as good as SGD. - Luolc/AdaBound
AdaBound, an optimizer that trains as fast as Adam and as good as SGD launched on February 26, 2019 with 60 votes, #773 of 3,290 launches that month and more than 90% of that year's launches. The site was still online in September 2026, 7 years on.
In plain words
AdaBound is an optimizer for machine learning model training available on GitHub. It bridges the gap between adaptive optimizers like Adam, which train quickly but produce less accurate final models, and stochastic gradient descent (SGD), which converges to better solutions but more slowly. The tool is designed for machine learning practitioners who want faster training without sacrificing model quality. It combines the speed advantages of Adam with SGD's superior final performance.
written from the facts on this page · September 2026
Does a similar job
all alternatives →
Boldly go where Gradient Descent has never gone before with DiscoGrad2024 · github.com · ▲232Trying to do gradient descent using automatic differentiation over branchy programs? Or to combine them with neural networks for end-to-end training? Then this might be interesting to you. We develped DiscoGrad, a tool for automatic differentiation through C++ programs involving input-dependent control flow (e.g., "if (f(x) < c) { ... }", differentiating wrt. x) and randomness. Our initial motivation was to enable the use of gradient descent with simulations, which often rely heavily on such discrete branching. The latter makes plain autodiff mostly useless, since it can only account for the…
AdalFlow: The library to build and auto-optimize any LLM task pipeline2024 · github.com · ▲44AdalFlow: The library to build & auto-optimize LLM applications. - SylphAI-Inc/AdalFlow
A weekend replication of STOKE, a stochastic superoptimiser2019 · github.com · ▲58Haskell re-implementation of STOKE, the stochastic superoptimizer - blaze/notebooks/tutorial.ipynb at master · bollu/blaze
Bounding-box labeler tool to generate the training data for YOLO v22018 · github.com · ▲64Label images and video for Computer Vision applications - Cartucho/OpenLabeling
More life & fun this month
the category →
A free city-building game in your browser. You are the mayor. You know what the city needs. Now get it past the zoning board, the neighbors, the appeals court and the next election.
Life & fun · 3d ago · permit.petercai.com
- IV
Life & fun · 15d ago · tanzaniaeducationproject.org
Turn a phone, tablet or TV into a sign. Type a message and it fills the screen: welcome signs, timers, Wi-Fi passwords and more. No app, no account, free.
Life & fun · 16d ago · bigwords.page
Play a free virtual guitar online with your keyboard or by touch. Slow songs down and see every chord, string and strum. Acoustic, classic, electric and bass.
Life & fun · 10d ago · guitoro.com
Carrier settings from iPhone, Pixel and Galaxy firmware, decoded and compared: APNs, VoLTE, 5G and Wi-Fi Calling per carrier, and what each build changed.
Life & fun · 14d ago · carrierexplode.com
Life & fun · 24d ago · space.bl2.net
Source: Show HN post ↗
Launched alongside, February 2019
the whole month →- MY
Make your site’s pages instant in 1 minute and improve your conversion rate by 1%.
Life & fun · 2019 · instant.page
Computer generated people - refresh to get a new one
AI · 2019 · thispersondoesnotexist.com
