New Show Hacker News story: Show HN: Crul – Query Any Webpage or API

Show HN: Crul – Query Any Webpage or API
34 by portInit | 7 comments on Hacker News.
Hi HN, we’re Carl and Nic, the creators of crul ( https://www.crul.com ), and we’ve been hard at work for the last year and a half building our dream of turning the web into a dataset. In a nutshell crul is a tool for querying and building web and api data feeds from anywhere to anywhere. With crul you can crawl and transform web pages into csv tables, explore and dynamically query APIs, filter and organize data, and push data sets to third party data lakes and analytics tools. Here’s a demo video, we’ve been told Nic sounds like John Mayer (lol) ( https://ift.tt/MDvYlFy ) We’ve personally struggled wrangling data from the web using puppeteer/playwright/selenium, jq or cobbling together python scripts, client libraries, and schedulers to consume APIs. The reality is that shit is hard, doesn’t scale (classic blocking for-loop or async saturation), and comes with thorny maintenance/security issues. The tools we love to hate. Crul’s value prop is simple: Query any Webpage or API for free. At its core, crul is based on the foundational linked nature of Web/API content. It consists of a purpose built map/expand/reduce engine for hierarchical Web/API content (kind of like postman but with a membership to Gold's Gym) with a familiar parser expression grammar that naturally gets the job done (and layered caching to make it quick to fix when it doesn’t on the first try). There’s a boatload of other features like domain policies, scheduler, checkpoints, templates, REST API, Web UI, vault, OAuth for third parties and 20+ stores to send your data to. Our goal is to open source crul as time and resources permit. At the end of the day it’s just the two of us trying to figure things out as we go! We’re just getting started. Crul is one bad mother#^@%*& and the web is finally yours! Download crul for free as a Mac OS desktop application or as a Docker image ( https://www.crul.com ) and let us know if you love it or hate it. ( https://ift.tt/Qsx3qZN ) And come say hello to us on our slack channel - we’re a friendly bunch! ( https://ift.tt/orvwBPu ) Nic and Carl ( https://ift.tt/fIUoQcS )

Comments

Post a Comment

Popular posts from this blog

New Show Hacker News story: Show HN: Natural language Twitter search using Codex

Show HN: Natural language Twitter search using Codex 3 by andyk | 0 comments on Hacker News. We built a structured search engine for Twitter called Bird SQL, available at https://ift.tt/7BU0hHb . Our search interface uses OpenAI Codex to translate natural language to SQL. Our backend then verifies the SQL, executes it, and displays the results on the web app. This makes large structured datasets like a scrape of Twitter easy for anyone to explore. As background, while working on text-to-SQL as a general problem, we came to believe one of its most powerful applications is as a search tool because: - SQL is hard to write by hand and prone to errors - It allows you to iterate quickly if you’re exploring a new dataset - A lot of contextual information that you’d normally have to internalize (e.g. your data’s schema) can be automatically generated and offloaded to the language model Using large language models (LLMs) like Codex to write the SQL for you means you don’t have to worry about
Read more

Internet Download Manager Universal Crack is Here ! [IDM 6.25 Build 10 UPDATED]

Image
Internet Download Manager Universal Crack Internet Download Manager aka IDM developers release a new build of  their well-known Download  Accelerator; Internet Download Manager  regularly. So everybody who uses pirated versions get so  pissed off that they have to find a new version of crack every time when an IDM update comes. So  we made a really awesome fix for that An Universal Web Crack. A new era in scene world. Web crack is a new concept of cracks that download and update crack content as the target program gets updated.  So whenever IDM releases a new version. Update your crack using built-in updater and apply crack. Easy as that ! You can simply trust crack because it has a history of more than 3 year with regular updates, and also it has more than 10000K worldwide downloads. How to Crack any IDM Version ? Install the latest version of IDM / Or update via quick update (yes its possible now)  Turn off any virus guards Download and 
Read more

New Show Hacker News story: Show HN: Movis – A Video Editing Library in Python

Show HN: Movis – A Video Editing Library in Python 2 by rezoolab | 0 comments on Hacker News. Originally, this library was created due to my motivation to make videos in Python. Of course, I considered other Python libraries, but I decided to create a new library for video editing because I needed the following features and also for study purposes: - The existence of composition. Especially, the ability to perform advanced video editing by inserting compositions within compositions. - The ability to add animations based on keyframes. - Effects like chroma key and drop shadow. - A caching mechanism to render the same frame quickly. - Various blending modes. These features, despite being standard in proprietary video editing software, were not present in previous Python libraries. Currently, I am using this library to automatically generate videos from raw materials. I would be grateful for any comments, thoughts, or requests.
Read more