So I get to spend most of my day tweaking and playing around with really powerful search engines at TinyFish (which is so awesome). I’ve recently been super fascinated by the idea of using a search engine recursively to build datasets.
Been playing around with Exa’s WebSets product quite a bit and realized it was mainly focused on prospecting, and it creates datasets with a lot of missing data.
So we built a fully open source project, that can build and update datasets on any topic.
Datasets I have generated so far, “All products that Starbucks sells on amazon, with their price and if they are in stock”, “All theme parks in California, with ticket prices” , “All YC companies that are currently hiring for eng roles with their hiring page link”
Would love for yall’s to try it out, and drop your thoughts, stars and feedback. Thanks!