SearchArray – Text Search in Pandas
I've long worked with lexical Lucene based search engines like Solr and Elasticsearch. Anytime I need to experiment with relevance ranking in these systems, I'm exhausted by needing to set them up. It's not conducive to productivity work with something so disjoint from normal data tooling. Further - the underlying ranking is buried in needless mystique (you know a boolean should query, sums the scores, right?). You shouldn't need to read a book (like Relevant Search ;) ) to unpack mystique that's really basic math. Why not just let people build ranking systems with vectorized math in a…
What it does
In the maker’s words, at launch
I've long worked with lexical Lucene based search engines like Solr and Elasticsearch. Anytime I need to experiment with relevance ranking in these systems, I'm exhausted by needing to set them up. It's not conducive to productivity work with something so disjoint from normal data tooling. Further - the underlying ranking is buried in needless mystique (you know a boolean should query, sums the scores, right?). You shouldn't need to read a book (like Relevant Search ;) ) to unpack mystique that's really basic math. Why not just let people build ranking systems with vectorized math in a numpy/pandas stack? SearchArray lets anyone build a relevance prototype in Pandas. Typically building / experimenting with a smaller labeled dataset. If it works out, you can transfer it relatively easily to Elasticsearch or Solr for implementation and testing. SearchArray is a pandas extension array that creates an underlying search index for BM25 term/phrase based searching. It's not quite done (will it ever be?) but its getting far enough along to be useful. So feedback is very welcome. https://github.com/softwaredoug/searcharray
Does the same job
all alternatives →
More work this month
the category →
The app store for voice native apps that lives in your notch
Work · 28d ago · voiceos.com
The New Calendly▲211Handle all of the work before, during, and after meetings
Work · 17d ago · calendly.com
Launched alongside, November 2023
the whole month →
Discover & book top creators to promote your product
Growth · 2023 · passionfroot.me
