New Show Hacker News story: Show HN: Run transformers model inference in C/C++ and even assembly

Show HN: Run transformers model inference in C/C++ and even assembly
2 by txtai | 0 comments on Hacker News.


Comments

Post a Comment

Popular posts from this blog

New Show Hacker News story: Show HN: Compress GPT-4 Prompts

Show HN: Compress GPT-4 Prompts 6 by jeanmayer | 3 comments on Hacker News. Hey HN! I recently built Prompt Reducer, an app that makes it easier to compress GPT-4 prompts. The main goal is to reduce the number of tokens in each prompt, thereby reducing the cost of running GPT-4. I figured since @gfodor tweeted about compressing GPT-4. It’s still early, and it does not work perfectly, but I’d love to hear any feedback or suggestions for how to make it faster or more efficient.
Read more

New Show Hacker News story: Show HN: Natural language Twitter search using Codex

Show HN: Natural language Twitter search using Codex 3 by andyk | 0 comments on Hacker News. We built a structured search engine for Twitter called Bird SQL, available at https://ift.tt/7BU0hHb . Our search interface uses OpenAI Codex to translate natural language to SQL. Our backend then verifies the SQL, executes it, and displays the results on the web app. This makes large structured datasets like a scrape of Twitter easy for anyone to explore. As background, while working on text-to-SQL as a general problem, we came to believe one of its most powerful applications is as a search tool because: - SQL is hard to write by hand and prone to errors - It allows you to iterate quickly if you’re exploring a new dataset - A lot of contextual information that you’d normally have to internalize (e.g. your data’s schema) can be automatically generated and offloaded to the language model Using large language models (LLMs) like Codex to write the SQL for you means you don’t have to worry about...
Read more