Show HN: Use the cloud for your dev environment on the fly https://ift.tt/ps2lqr4

Show HN: Use the cloud for your dev environment on the fly https://ift.tt/9zTCEAD April 30, 2024 at 09:02PM

Show HN: Riza – Safely run untrusted code from your app https://ift.tt/pdYu4mK

Show HN: Riza – Safely run untrusted code from your app Hi HN, I’m Kyle and together with Andrew ( https://ift.tt/HdzW6Uu ) we’ve been working on Riza ( https://riza.io ), a project to make WASM sandboxing more approachable. We’re excited to share a developer preview of our code interpreter API with HN. There’s a bit of a backstory here. A few months ago, an old coworker reached out asking how to execute untrusted code generated by an LLM. Based on our experience building a plugin system for sqlc ( https://sqlc.dev ), we thought a sandboxed WASM runtime would be a good fit. A bit of hacking later, we got everything wired up to solve his issue. Now the API is ready for other developers to try out. The Riza Code Interpreter API is an HTTP interface to various dynamic language interpreters, each running inside a WASM sandbox without access to the outside world (for now). We modeled the API to align with a POSIX shell-style interface. We made a playground so you can try it out without signing up: https://riza.io The API documentation lives here: https://docs.riza.io There are many limitations at the moment, but we expect to rapidly expand capabilities so that programs can e.g. access the network and filesystem. Our roadmap has more details: https://ift.tt/KY4oP9E If you need to execute LLM-generated code we’d love to have you try the API and let us know if you run into any issues. You can email us directly at founders@riza.io. https://ift.tt/irKBnWp April 30, 2024 at 11:19PM

Show HN: Attorch – PyTorch's nn module written in Python using OpenAI's Triton https://ift.tt/vjQfh9R

Show HN: Attorch – PyTorch's nn module written in Python using OpenAI's Triton attorch is a subset of PyTorch's nn module, written purely in Python using OpenAI's Triton. Its goal is to be an easily hackable, self-contained, and readable collection of neural network modules whilst maintaining or improving upon the efficiency of PyTorch. In other words, it intends to be a forkable project endowed with a simple, intuitive design that can serve as an accessible starting point for those who are seeking to develop custom deep learning operations but are not satisfied with the speed of a pure PyTorch implementation and do not have the technical expertise or resources to write CUDA kernels. There already exist a number of wonderful PyTorch-like frameworks powered by Triton, but most concentrate solely on Transformers and NLP applications, whereas attorch aims to be more inclusive by also presenting a variety of layers pertaining to areas besides NLP such as computer vision. Moreover, attorch is not an inference-only package and fully supports both forward and backward passes, meaning it can be used during training as well as inference, though its performance for the latter is generally not on par with dedicated inference engines. Questions and feedback are welcome in the comments sections. https://ift.tt/hGKtVNM April 30, 2024 at 02:37AM

Show HN: Kaytu – Optimizing cloud costs using actual usage data https://ift.tt/SC7mY6J

Show HN: Kaytu – Optimizing cloud costs using actual usage data Reduce your cloud costs - SREs/DevOps/Cloud Engineers Hi community! We are Kaytu (“Kay-two,” named after the K2 mountain), and we've developed an open-source tool for engineering, DevOps, and SRE teams to reduce cloud costs. Cloud inflation (“cloud-flation”) is real—AWS EC2 costs are up 23% (4-5x global inflation average [1]), and 30% of the capacity that is paid for is simply wasted ([2]). The best way to improve cloud utilization is by simplifying the process so engineers can spot inefficiencies and suggest changes. We built a simple open-source CLI tool that recommends a cost-optimal workload based on actual usage data from observability tools. Check it out at https://ift.tt/P52Vuzv Currently, we support AWS EC2 On-Demand Servers & EBS Storage using observability data from CloudWatch to determine utilization. You can optimize EC2 Servers based on CPU, Network, Memory, and Storage. We're expanding support to include OS License, GPU metrics, RDS, and Prometheus integration, and we plan to add more AWS services like EKS and OpenSearch, as well as Azure. This is more than just a utility—we want to provide a no-nonsense platform that makes it ridiculously easy for engineers to build cost-effective apps on the cloud by optimizing workload configurations and customizing to scenarios. Open Core: Inspired by Sid Sijbrandij and GitLab, we've open-sourced our CLI and are actively working on the server side. Our tooling will always remain straightforward and support open-source tools for free. We made it as simple as possible to try out - it’s one command, no sign-up needed, no SaaS platform to share your credentials. We would love you to try it out and give us your feedback! If there are bugs, we would greatly appreciate it if you reported them on GitHub. Cheers, The Kaytu Team (Anil, Arta, Mahan, and Saleh) References: [1]Tangoe IT Trends Savings Recommendations and Liftr Insights data Cloud Pricing [2] Flexera State of Cloud Report - Multiple reports spanning 2017-2023 https://ift.tt/P52Vuzv April 29, 2024 at 10:57PM

Show HN: I made a privacy friendly and simple app to track my menstruation https://ift.tt/6HbR8VN

Show HN: I made a privacy friendly and simple app to track my menstruation Hey HN, after the app I actually used to track my period wanted me to log in and save my data in the cloud, I decided to write my own. Most apps in this area are based on a subscription model and display far too much information anyway. For me, a simple calendar is enough where I can add a few notes if necessary. So that is the result of my work - a simple design and the data is only saved on the smartphone. https://ift.tt/XGpda8m April 29, 2024 at 10:35PM

Show HN: Dotenv, if it is a Unix utility https://ift.tt/6TSrHzs

Show HN: Dotenv, if it is a Unix utility I like the idea of using dotenv files, but I dislike having to use different language-specific libraries to read them. To solve this, I created a small utility that lets you prefix any command with "dotenv" to load the ".env" file. This is how I imagine dotenv would work if it had started as a UNIX utility rather than a Node.js library. https://ift.tt/LvicrtQ April 29, 2024 at 03:25AM

Show HN: Audio Mastering with Text Prompts https://ift.tt/FnbjIHB

Show HN: Audio Mastering with Text Prompts https://diktatorial.com April 29, 2024 at 01:05AM

Show HN: OpenLIT – Open-Source LLM Observability with OpenTelemetry https://ift.tt/s4PmQLe

Show HN: OpenLIT – Open-Source LLM Observability with OpenTelemetry Hey HN, we're super excited to share something we've been working on: OpenLIT. After an engaging preview that some of you might recall, we are now proudly announcing our first stable release! *What's OpenLIT?* Simply put, OpenLIT is an open-source tool designed to make monitoring your Large Language Model (LLM) applications straightforward. It’s built on OpenTelemetry, aiming to reduce the complexities that come with observing the behavior and usage of your LLM stack. *Beyond Basic Text Generation:* OpenLIT isn’t restricted to just text and chatbot outputs. It now includes automatic monitoring capabilities for GPT-4 Vision, DALL·E, and OpenAI Audio. Essentially, we're prepared to assist you with your multi-modal LLM projects all through a single platform and we're not stopping here; more updates and model support are on their way! *Key Features:* - *Instant Alerts:* Offers immediate insights on cost & token usage, in-depth usage analysis, and latency metrics. - *Comprehensive Coverage:* Supports a range of LLM Providers, Vector DBs, and Frameworks - everything from OpenAI and AnthropicAI to ChromaDB, Pinecone, and LangChain. - *Aligned with Standards:* OpenLIT follows the OpenTelemetry Semantic Conventions for GenAI, ensuring your monitoring efforts meet the community's best practices. *Wide Integration Compatibility:* For those already utilizing observability tools, OpenLIT integrates with various telemetry destinations, including OpenTelemetry Collector, Jaeger, Grafana Cloud, and more, expanding your data’s reach and utility. *Getting Started:* Check our quickstart guide and explore how OpenLIT can enhance your LLM project monitoring: https://ift.tt/HFl6qCQ We genuinely believe OpenLIT can change the game in how LLM projects are monitored and managed. Feedback from this community could be invaluable as we continue to improve and expand. So, if you have thoughts, suggestions, or questions, we’re all ears. Let’s push the boundaries of LLM observability together. Check out OpenLIT here: https://ift.tt/BuoAPU2 Thanks for checking it out! https://ift.tt/BuoAPU2 April 26, 2024 at 04:45PM

Show HN: LazyVim for Ambitious Developers https://ift.tt/Opg6VGc

Show HN: LazyVim for Ambitious Developers With zero AI generated content. ;-) https://ift.tt/qWY3HKA April 28, 2024 at 09:23PM

Show HN: I want my family to listen to more music(less movies) https://ift.tt/v7E9yYD

Show HN: I want my family to listen to more music(less movies) I decided to use the home entertainment system to take over the TV. Limited visual stimulation. Front Row is a collection of live musical performances gathered by music fans of all kinds. https://thefrontrow.app Download for iOS or Apple TV https://ift.tt/UC7nTu9... And fuck it. I'm letting anyone add videos directly to the database! https://ift.tt/wGPO0HK April 28, 2024 at 12:32AM

Show HN: Open-source script to get your site indexed on Bing, Yandex, and others https://ift.tt/2foE5Qs

Show HN: Open-source script to get your site indexed on Bing, Yandex, and others There is already a lot for Google, but let's not forget that there are more search engines out there. https://ift.tt/3GVLqie April 28, 2024 at 12:10AM

Show HN: Cognita – open-source RAG framework for modular applications https://ift.tt/rRV1Tq0

Show HN: Cognita – open-source RAG framework for modular applications Hey HN, exciting news! Our RAG framework, Cognita ( https://ift.tt/ztly6Pp ), born from collaborations with diverse enterprises, is now open-source. Currently, it offers seamless integrations with Qdrant and SingleStore. In recent weeks, numerous engineers have explored Cognita, providing invaluable insights and feedback. We deeply appreciate your input and encourage ongoing dialogue (share your thoughts in the comments – let's keep this ‘open source’). While RAG is undoubtedly powerful, the process of building a functional application with it can feel overwhelming. From selecting the right AI models to organizing data effectively, there's a lot to navigate. While tools like LangChain and LlamaIndex simplify prototyping, an accessible, ready-to-use open-source RAG template with modular support is still missing. That's where Cognita comes in. Key benefits of Cognita: 1. Central repository for parsers, loaders, embedders, and retrievers. 2. User-friendly UI empowers non-technical users to upload documents and engage in Q&A. 3. Fully API-driven for seamless integration with other systems. We invite you to explore Cognita and share your feedback as we refine and expand its capabilities. Interested in contributing? Join the journey at https://ift.tt/gurfKWh . https://ift.tt/ztly6Pp April 27, 2024 at 11:40PM

Show HN: I built a drop-in replacement for deprecated Google QR code API https://ift.tt/DTRMCXc

Show HN: I built a drop-in replacement for deprecated Google QR code API Since Google QR code API seem discontinued maintain (404 when you call the API), I built a drop-in replacement for it. Please try it via interactive docs. Should I split it into dedicated sub domain, like google.qr-api.com https://ift.tt/ltOxAoZ April 27, 2024 at 11:38PM

Show HN: Spade – UI for Data Processing https://ift.tt/DVdsnQ3

Show HN: Spade – UI for Data Processing https://ift.tt/bG3K4Mj April 27, 2024 at 03:20AM

Show HN: I made a site for practicing front end debugging with real-world bugs https://ift.tt/vdjcaq4

Show HN: I made a site for practicing front end debugging with real-world bugs I am excited to introduce my solo project, a platform built with the frontend development community in mind. It's an interactive environment aimed at refining debugging skills through exposure to real-world bugs. This project stems from the need for a hands-on, practical method of learning to debug. The site features a variety of intentional bugs for users to solve, mirroring the types of challenges faced in professional settings. Over the coming weeks, I will be adding many more exercises and new features to enhance your learning experience further. Check out CodeMender at https://ift.tt/8XI96nK https://ift.tt/8XI96nK April 27, 2024 at 12:59AM

Show HN: I Made an AI Software Engineer with Claude 3 Opus https://ift.tt/oA35Waw

Show HN: I Made an AI Software Engineer with Claude 3 Opus https://saas-quick.com April 27, 2024 at 01:30AM

Show HN: I put PubMed in a vector DB https://ift.tt/IPiNj0h

Show HN: I put PubMed in a vector DB Hi HN, As a researcher, I often found myself struggling with the limitations of keyword-based search when exploring PubMed papers. To address this, I created PubMed Search ( https://ift.tt/DjrIO5f ), a tool that leverages a vector database to enable semantic search across medical research literature. Some key features: * Daily updates to ensure access to the latest articles * Semantic search using latest & greatest embedding models * Some additional useful info about the papers (tldr, journal, publication date, etc.) Hope you find it useful! https://ift.tt/DjrIO5f April 26, 2024 at 02:53AM

Show HN: ReaperAI – Automatically delete dead code from your app https://ift.tt/KGYvxDV

Show HN: ReaperAI – Automatically delete dead code from your app Hi all, We launched Reaper at the end of last year ( https://ift.tt/HRoweax... ) with the goal of helping teams discover dead code in their mobile apps. Unlike typical static analysis that only finds technically unreachable code, Reaper is an SDK that monitors production data to discover code that's unused by real users (ex. stale feature flags). ReaperAI takes this a step further by actually being able to open pull requests in your repo to automatically delete the dead code that it finds. Here is a demo video: https://www.youtube.com/watch?v=y2FEaAmUvNw We're here to answer your questions & would love to hear any ideas or feedback you have! https://ift.tt/DAPerSX April 25, 2024 at 11:25PM

Show HN: Hive – open-source Marketplace for AI https://ift.tt/hQ8fipa

Show HN: Hive – open-source Marketplace for AI gm gm, We’re excited to show our project, Hive Network, a new frontier for decentralized AI agents that operate both on-chain and off-chain. Our mission is to make AI more powerful and transparent, and we’re inviting you to join us in this revolution. What is Hive Network AI? -- Hive Network AI is a platform where developers can create, deploy, and manage AI agents that function autonomously across blockchain and traditional networks. Our system addresses significant issues in the AI space, such as the lack of transparency, difficulty in monetizing models, and insufficient research funding. Features of Hive Network AI -- 1] Decentralized Agents: Build agents that operate independently, with the capability to execute tasks on blockchain networks. 2] Model and Dataset Monetization: Through our Model Hub, AI engineers can monetize their models, opening up new revenue streams. 3] Research and Development Support: Our Research Hub supports AI researchers by providing them with the necessary funding and resources to advance their work. 4] Complex Workflows with Swarms: Aggregate multiple agents into a Swarm to tackle complex tasks and workflows. Why It Matters -- In an era where AI development is often opaque and centralized, Hive Network AI introduces a platform for greater transparency and collaboration. By decentralizing the development and deployment of AI agents, we empower creators and developers to own and profit from their innovations. Get Involved -- We’re currently welcoming early users to join our waitlist. Visit our website at Hive Network AI to learn more and sign up. We believe that the future of AI should be open and accessible, and with Hive Network AI, we are making that future a reality. We’d love to hear your thoughts, feedback, or potential use cases you envision with our platform. Thanks for checking out Hive Network AI. I’ll be around to answer any questions you have! -- Relevant Links -- 1] Demo of some agents: https://ift.tt/7dpGWDA?... 2] GitHub: https://ift.tt/GIa9c7Y 3] Alpha Launch: https://ift.tt/JWE3UdT https://hivenetwork.ai/ April 26, 2024 at 12:49AM

Show HN: I made a programmable computer from NAND gates https://ift.tt/ywf7YWX

Show HN: I made a programmable computer from NAND gates I am proud to present my solo hobby project NAND. This year-long undertaking follows the completed Nand to Tetris course, but ported to the web with its own runtime, user interface, and IDE. Using the "Load example program" selector, you can try out some programs I wrote on NAND's emulated hardware such as 2048, a genetic algorithm, and a manual stack overflow to corrupt the screen. Check out NAND at https://nand.arhan.sh Additionally, I've authored an extensive writeup about the project. Read about it on the GitHub repository's readme. https://ift.tt/KV1PoJl April 25, 2024 at 11:08PM

Show HN: Serverless VPN for Lifetime https://ift.tt/GAvungT

Show HN: Serverless VPN for Lifetime https://ift.tt/gRm3LjS April 25, 2024 at 02:19AM

Show HN: Open-source alternative to HashiCorp/IBM Vault https://ift.tt/BvUwJXp

Show HN: Open-source alternative to HashiCorp/IBM Vault https://ift.tt/uFKpE5C April 25, 2024 at 04:02AM

SHOW HN: I coded an espresso brewing app to keep all information at one place https://ift.tt/i5Q1boz

SHOW HN: I coded an espresso brewing app to keep all information at one place https://ift.tt/onbZyel April 25, 2024 at 01:39AM

Show HN: OSS Gallery – Crowdsourced list of the best open-source projects https://ift.tt/ckRBDKe

Show HN: OSS Gallery – Crowdsourced list of the best open-source projects https://oss.gallery/ April 25, 2024 at 12:06AM

Show HN: Llama 3 with function calling and code interpreter https://ift.tt/bfaz6yh

Show HN: Llama 3 with function calling and code interpreter https://ift.tt/uxw1lzZ April 24, 2024 at 06:45AM

Show HN: Use LLMs to Interact with APIs https://ift.tt/WuPFY7U

Show HN: Use LLMs to Interact with APIs Recently featured in a LangChain blog https://ift.tt/8z6vmDd... , use LLMs to construct an API first runnable workflow with an IDE experience. https://ift.tt/umiJaYP April 24, 2024 at 05:23AM

Show HN: Storing Private Keys in the Browser Securely https://ift.tt/B3Hf0NT

Show HN: Storing Private Keys in the Browser Securely So the main purpose here is to show _a_ way that session-token theft can be mitigated. Clearly, this isn't NSA proof or something you'd use to secure a BL5 containment facility, but to prevent session-jacking; if feels like it could help a lot, and would be pretty quick and easy to roll out if an IDP wanted to implement it. https://ift.tt/J2MyGpQ April 24, 2024 at 02:02AM

Show HN: MicroSCOPE – identify ransomware statically with heuristics https://ift.tt/oVgrwDk

Show HN: MicroSCOPE – identify ransomware statically with heuristics https://ift.tt/dJIAzTV April 23, 2024 at 11:30PM

Show HN: Metashade – a Pythonic GPU shading/compute EDSL https://ift.tt/IaqG8Fk

Show HN: Metashade – a Pythonic GPU shading/compute EDSL Superficially, it may look similar to Nvidia's Warp or OpenAI's Triton, but instead of transpiling a subset of Python to the target language, it implements dynamic codegen in pure Python. These slides discuss the existing GPU programming solutions and make a case for Metashade's approach: https://ift.tt/OZ6ryVX... https://ift.tt/yrPLXYA April 22, 2024 at 06:21AM

Show HN: Wonkypedia - Wikipedia from an Alternate Timeline https://ift.tt/4J5EQYP

Show HN: Wonkypedia - Wikipedia from an Alternate Timeline https://ift.tt/yO7Giw3 April 23, 2024 at 02:56AM

Show HN: Auto-optimizing deterministic LLM outputs using knowledge graphs https://ift.tt/rfAcOje

Show HN: Auto-optimizing deterministic LLM outputs using knowledge graphs Hi, We are building an open-source framework for loading and structuring LLM context to create accurate and explainable LLM answers using knowledge graphs and vector stores. We built the tool with four main concepts in mind: 1. Loader -> uses dlt in the backend to load and structure the data 2. Cognify step -> creates a graph with summaries, labels and factoids that are interconnected across the documents and stored as a representation in the vector store 3. Optimizer -> Uses DSPy to optimize LLM queries, and we plan to extend it to most of the knobs we can turn, like chunking etc. 4. Search -> allows for searching using search types supported in graph stores (ex. Neo4j) or hybrid, BM25, or other search types available in vector stores. We are quite early with the product but we would love to hear feedback on what we can improve. https://ift.tt/pAkw4TL April 23, 2024 at 01:25AM

Show HN: Kaldo – Cross Shell Aliases https://ift.tt/Pzyu1Td

Show HN: Kaldo – Cross Shell Aliases I made this so that I don't have to maintain my aliases across my $profile, .bashrc, and .zshrc when I swap shells. Let me know what you think about it! https://ift.tt/HpG3x9N April 23, 2024 at 12:10AM

Show HN: AppView 1.0.0 is released Instrument, Observe, Secure your deployments https://ift.tt/UtdCw7F

Show HN: AppView 1.0.0 is released Instrument, Observe, Secure your deployments AppView is an open source, runtime-agnostic instrumentation utility for any Linux command or application. It helps users to explore, understand, and gain visibility with no code modification. With one instrumentation approach for all runtimes, AppView offers ubiquitous, unified instrumentation of any unmodified Linux executable. With AppView 1.0.0 comes the new threat detection logic that allows users to capture security-related events. Is your application accessing secure files? Is it making connections it shouldn't be? Is it exfiltrating data over DNS or is GOT poisoning in effect? Other features of the 1.0.0 release include the ability to: - Generate metrics on process and application performance. - Generate events, reporting on network, file, logs, console messages and http/s activity. - Capture (decrypted) payload data without the need for keys. - Generate a stack trace, and a core dump when an application crashes. - Generate network flow information. - Create a report on unique file and network activity. - Install AppView in a Kubernetes cluster. - Secure file and network access in an application. - Instrument both static and dynamic executables. - Attach to processes while they are running or start when the process does. - Normalize and forward metrics and events, in real time, to remote systems. - Summarize metrics and detect protocols. We are looking for users and contributors alike. https://appview.org/ April 22, 2024 at 12:22AM

Show HN: What Are You Working On? https://ift.tt/Wn3Sriq

Show HN: What Are You Working On? Hey HN, I'm sure you've seen the monthly "Ask HN: What Are You Working On?" headlines on [Hacker News]( https://ift.tt/LyfkWKD... ). Honestly, it's my favorite topic because it's packed with insights about what other hackers are up to. I wondered what it would be like if instead of just a headline, there was a whole website where hackers could post daily updates, and where we could follow the hackers we're interested in for their latest updates. And so, this web site was born. I hope it gets used frequently so we can all benefit from it together. I look forward to hearing your thoughts. Let me know what you think! https://ift.tt/ROtAQve April 21, 2024 at 06:43PM

Show HN: Kuberian, a search engine for the Kubernetes source code https://ift.tt/YTIXoFa

Show HN: Kuberian, a search engine for the Kubernetes source code Toy project running on Google Cloud Run. 200K req/month. $0.5/month. with Rust https://ift.tt/BDxOnH1 April 21, 2024 at 05:46PM

Show HN: Nuxt.js OpenAPI / Swagger API Reference Documentation https://ift.tt/PyYa4Vp

Show HN: Nuxt.js OpenAPI / Swagger API Reference Documentation https://ift.tt/MjLP2lz April 21, 2024 at 01:42PM

Show HN: Edit This Page – Frictionless Content Collaboration https://ift.tt/hcvUqSX

Show HN: Edit This Page – Frictionless Content Collaboration https://ift.tt/BXKjqFd April 20, 2024 at 09:57PM

Show HN: Exploring Indra's Pearls with WebGPU https://ift.tt/nrt05xl

Show HN: Exploring Indra's Pearls with WebGPU https://ift.tt/WcfxrFJ April 20, 2024 at 11:40PM

Show HN: Using Llama 3 for free in prod via OpenAI client https://ift.tt/NaRmhzZ

Show HN: Using Llama 3 for free in prod via OpenAI client https://twitter.com/JackCulpan/status/1781587325459591440 April 20, 2024 at 09:21PM

Show HN: Color Naming: Human vs. GPT-4 https://ift.tt/T2fdQnJ

Show HN: Color Naming: Human vs. GPT-4 https://ift.tt/n3s6gvq April 20, 2024 at 11:07PM

Show HN: Finazon – Financial data marketplace to substitute Bloomberg https://ift.tt/I3YtizO

Show HN: Finazon – Financial data marketplace to substitute Bloomberg https://finazon.io// April 19, 2024 at 10:25PM

Show HN: Composable (as in iGoogle, but modern) privacy-friendly new tab https://ift.tt/8M0Oe52

Show HN: Composable (as in iGoogle, but modern) privacy-friendly new tab I spent quite a lot of time working on this one over the last 1.5 years. It started as a small project for my personal use because I wanted to keep all my self-hosted services visible so I wouldn't forget they existed lol. Using a web page wasn't ideal because of the white flicker every time I opened a new tab, so I decided to make this into a browser extension. From that time on, it became a lot bigger and got some traction (which I'm very happy about). It's made with React, but I tried to squeeze maximum performance (limited by my skills and desire to keep it somewhat readable, though) out of it. UI/UX was a big priority for me in this project, so I also tried to streamline it as much as possible and make Anori a joy to use. If you decide to try it, let me know how good I did! Oh, and it's open source [1] and the process of adding new widgets is documented [2], so you can make your own! [1]: https://ift.tt/0vVE2WI [2]: https://ift.tt/jbYKzpS... https://anori.app/ April 19, 2024 at 03:34PM

Show HN: Shepherd 3.0 – Like wandering the aisles of your favorite bookstore https://ift.tt/sm6XUze

Show HN: Shepherd 3.0 – Like wandering the aisles of your favorite bookstore Hi all, creator here :) - I launched Shepherd.com ( https://shepherd.com/ ) 3 years ago on Hacker News and have added a ton since then! Here is the original Show HN ( https://ift.tt/FzwqY46 ). I’ve interviewed 10,000+ authors & experts to get their 5 favorite reads around different topics, themes, and moods. And I’ve connected those so that you follow your curiosity around topics, authors, books, and more. Try Art Kleiner’s favorite reads on understanding AI and its effect on people: https://ift.tt/DPtTx5M... Under each book, you can click “What is this book about?” to explore different topics and genres that interest you. I am working on adding themes and other fun connections. Or you can explore things like... Places to explore if you like the book Sapiens: https://ift.tt/AoWnm6i S. B. Divya on her favorite realistic near-future science fiction: https://ift.tt/4YkTZK9... Places to explore if you like hard sci-fi: https://ift.tt/G6Bt7ok Places to explore if you like Stephen King: https://ift.tt/i8pjRmf Azby Brown’s favorite books on Japanese carpentry and construction: https://ift.tt/FWtIK7P... Malayna Evan’s favorite reads on badass women who left a mark on the ancient world: https://ift.tt/qQrOPit... Shepherd is bootstrapped, and I’ve got many reader features coming soon! I have a newsletter about building the project and early access to new features here: https://ift.tt/VmwbBl7 What do we use to build this? Python, Django, Heroku, Postgre, Cloudflare, NLP/ML for Wikipedia topic IDs via Wikifier ( https://wikifier.org ), Nielsen’s book API database (publisher data + Library of Congress data), and Cloudinary. My email is ben@shepherd.com if you want to share ideas or suggestions :) Thanks, Ben April 19, 2024 at 02:18PM

Show HN: MonsterWriter – Write a thesis, post, or organize notes https://ift.tt/hI9rHFc

Show HN: MonsterWriter – Write a thesis, post, or organize notes Hello HN, in 2017 I started a project that would become MonsterWriter. First envisioned as a semi-structured wiki it became a writing application specialized for scientific content. It is a perfect tool if you write your thesis. While it is focused on technical content, you can still see the knowledge management spirit in it. One or two years ago, my wife joined me in my efforts and redesigned the whole project and we recently released it as MonsterWriter2. To celebrate this milestone we are giving away free lifetime licenses for the Desktop version (till Apr 28). Just use the promo code "gu0ho4q" for a 100% discount. You can find detailed instructions here: https://ift.tt/9mhBMPp You can also find a short introduction video to the app on YouTube: https://www.youtube.com/watch?v=vR8i-EY_UBk We are happy to receive any kind of feedback! April 19, 2024 at 02:42AM

Show HN: Vapi – Convince our voice AI to give you the secret code https://ift.tt/YJ5WNGx

Show HN: Vapi – Convince our voice AI to give you the secret code https://ift.tt/v5H7AXg April 18, 2024 at 11:50PM

Show HN: Minard – Generate beautiful charts with natural language https://ift.tt/tUhdTV5

Show HN: Minard – Generate beautiful charts with natural language Hi HN – Excited to share a beta for Minard, a new data visualization toolkit we've been working on that lets you generate publication-quality charts with simple natural language (throw away your matplotlib docs and rejoice!). Upload or import CSVs, Excel, and JSON, give it a spin, and please let us know what you think! (Long format data works best for now) For those curious, the stack is a simple Django app with HTMX/Alpine and all of the charts are specified and rendered as Vega ( https://ift.tt/eGBfi7x ). Lots of LLM function calling under the hood as well. https://minard.ai April 19, 2024 at 12:57AM

Show HN: Ayin – An open-source photo editing software https://ift.tt/piFNScY

Show HN: Ayin – An open-source photo editing software Hello HN, I'm Fares A. Bakhit a junior CS student at Cairo University and I'm happy to announce my latest project, "Ayin" is an open-source photo editing software available on Windows, Linux, and MacOS (Only a Windows build is available now on GitHub but you can compile it yourself to other platforms) with an interactive real-time graphical user interface. Feel free to use and study the source code of Ayin, it's available on GitHub under the GPLv3 open-source license. I've made this project in part of the Winged Dragon Competition at the Faculty of Computers and Artificial Intelligence (FCAI-CU) Cairo University. I've used ImGui, SDL2, and OpenGL (for image rendering, not processing) A showcase video in Arabic is available, showing the functionalities of Ayin: https://youtu.be/ogkteQkJb0I Any feedback is much appreciated, thank you! https://ift.tt/GkIjxYJ April 18, 2024 at 11:51PM

Show HN: Brewer X, a native macOS client for Homebrew https://ift.tt/sMDwgBf

Show HN: Brewer X, a native macOS client for Homebrew Hi HN! Like many of you, for my entire career I have relied on Homebrew to install all kinds of software on my Mac. That's why today I'm really excited to share a new app that my partner and I are building: Brewer X, a refreshing user interface for Homebrew. Brewer X is graphical interface that lives on top of Homebrew. Leveraging the power of native APIs improves the classic experience and unlocks new features. For example: • bulk actions are performed in parallel • syncing the entire library locally provides incredible search performances and the ability to query descriptions and other previously unaccessible fields • maintenance scripts run automatically for you • last but not least... app icons (or favicons when not available) let you quickly identify what you're looking for The app is written in Swift and uses only AppKit with Nib files for top performance, pixel perfect design, and maximum flexibility. We also designed the app icon and all the others in the UI ourselves. Following the great insights from Sketch[^1] we managed to make them super crispy. We're also very proud to have been featured in the macOS App Icon Book[^2]. The app has only been out for a couple of weeks, but we've already seen an amazing response from the community. We can't tell you all of our future plans yet, but here's a list of things we'd like to see in the app in the near future: • Import/Export • Automatic replacement of apps installed without Homebrew • Notifications about available updates • Finder actions • Spotlight integration I hope you find Brewer X interesting. We're happy to answer any question! [^1]: https://ift.tt/H9hrZl5... [^2]: https://ift.tt/5uIhkQe https://ift.tt/60QlxNL April 17, 2024 at 10:57PM

Show HN: Auto Wiki v2 – Turn your codebase into a Wiki now with diagrams https://ift.tt/U2op3TQ

Show HN: Auto Wiki v2 – Turn your codebase into a Wiki now with diagrams Hi HN! I'm Omar from Mutable.ai. We previously ( https://ift.tt/FxDSCLY ) introduced Auto Wiki ( http://wiki.mutable.ai/ )), which transforms your codebase into Wiki-style articles with citations to your code. Now, it features code diagrams and the ability to use AI to revise your wiki. It’s our favorite way to learn about new codebases and maintain up-to-date documentation. Getting started is easy: simply visit wiki.mutable.ai, enter the name of your repo, and let our AI take care of the rest. Our new basic tier costs just $2/repo/month, and for a limited time, you can use the coupon code HACKERNEWS to generate them for $1/mo. We also offer free wikis for open source repos if the contributor partners with us, you can inquire about this by emailing info@mutable.ai, some conditions apply. We made a number of improvements with your feedback in mind, including: - Code diagrams, generated in Mermaid - Filter and search for your wiki - AI revision with instruction - Manual edits to revise wikis - Better underlying model - Private repo support that follows the permissions of the repo - Wiki is updated automatically every month and with each commit with our upcoming PR bot Please note, you will only be able to edit a wiki if you’re a contributor or sponsor of the repo. Thank you! PS Here are some example v2 wikis: https://ift.tt/73WNHnb https://ift.tt/O2msVFw https://ift.tt/M6mnGaC https://ift.tt/NYXJHyo https://ift.tt/Tji9mrw https://ift.tt/oCiuwEt More info in the full release video: https://www.youtube.com/watch?v=mnrdzsTCke0 https://ift.tt/5VUHC7v April 17, 2024 at 10:19PM

Show HN: Device-Bound Session Tokens in JavaScript https://ift.tt/Ypavsqz

Show HN: Device-Bound Session Tokens in JavaScript Google’s recent announcement of a proposed ‘Device Bound Session Credentials’ feature[1] for Chrome reminded me of a project we worked on last year at my company. We focus on fraud prevention at signup and login (preventing multi-accounting and account theft), but some customers were concerned about post-login security and asked us to add a session hijacking prevention feature to our fraud prevention API. In the end, we decided to just implement a solution in Javascript. We call it session-lock, and it can be used today across all browsers[2] and, theoretically, native mobile apps. For a more comprehensive writeup and quick demo, you can visit the link. In short, the library adds a device-bound signature to the session token each time it’s used. At login, it creates a signing key pair on the browser using SubtleCrypto, with the private key set as “unextractable” and stored in IndexedDB (this forms the basis of its device-binding). Also at login, the public key is sent to the server along with the user’s credentials. If the credentials are valid, the server adds the public key to the payload of the JWT it returns to the client. When the client uses the JWT to access a protected resource, session-lock adds a signature to the end of it, along with a timestamp to mitigate replay attack risk. The server then validates the signature using the public key embedded in the JWT. The private key must be removed from IndexedDB upon logout. While Chrome’s DBSC would be a nice solution when it gets around to being deployed in Chrome and Edge, I think session-lock would help a lot today across all browsers in countering common attacks like malicious browser extensions that rip LocalStorage and cookies. Also, implementing the general flow in native mobile apps[3] would have the same key advantages as DBSC - compiled code already on the device and utilization of hardware TPMs. Aside from JS tampering and extracting “unextractable” CryptoKeys from IndexedDB, please let me know if you can think of any other potential attacks. Happy to answer any questions. [1] https://ift.tt/Gb6FMoI... [2] Other than Firefox private browsing mode due to its blocking of IndexedDB [3] Using CryptoKit / KeyStore for ECDSA https://ift.tt/HxRv6df April 16, 2024 at 09:48PM

Show HN: Search HN for interesting comment sections https://ift.tt/vga2pSf

Show HN: Search HN for interesting comment sections https://ift.tt/RXN6u8v April 16, 2024 at 08:19PM

Show HN: YouTube Shorts Redirector https://ift.tt/3FJKOpB

Show HN: YouTube Shorts Redirector I am neurodivergent and noticed the Youtube Shorts format was hacking my brain to engage longer than I wanted. I wrote this quick extension to gain my time back. If you have suggestions for improvement, I'm all ears. Thank you :) https://ift.tt/6teS8dw April 16, 2024 at 07:59AM

Show HN: Building a GPS receiver https://ift.tt/qzWianQ

Show HN: Building a GPS receiver Hi everyone! Shortly after publishing my iOS 4 jailbreak last October[1], I got to work on my next hobby project: a from-scratch homebrew GPS receiver, which can solve the user’s location solely from billions of radio antenna samples. I took a commodity SDR (alongside the Python standard library and numpy) and built a signal processing pipeline that can detect and track GPS satellites over many minutes, drop and pick up satellites as they come in and out of view, and precisely determine the user’s position and clock inaccuracy. All told, gypsum can go from a cold start to a fix on the user’s position, and the precise time, in less than a minute of listening to the antenna. I went on a journey of learning how to detect and track satellite signals that are literally too quiet to hear, and I hope that some of the magic comes through in the posts! After implementing this myself and walking the long road of getting it working, I’m left completely stunned by the brilliance of GPS, across so many axes. I hope you enjoy the read! On a more personal note, I’ll be starting a new job next week which isn’t as amenable to publishing side projects, and therefore this will be my last publicly-published project for some time. I’ve had great experiences making and sharing projects on here, and I’m really grateful for the positive feedback that’s been shared! [1]: https://ift.tt/Q4MHexU https://ift.tt/dlRXPKh April 15, 2024 at 09:42PM

Show HN: Little Guys https://ift.tt/2tmN56U

Show HN: Little Guys https://ift.tt/gTqKlSs April 15, 2024 at 01:02PM

Show HN: Minipic convert and compress images multiple formats locally in browser https://ift.tt/OtwXHqv

Show HN: Minipic convert and compress images multiple formats locally in browser https://minipic.app April 15, 2024 at 01:53AM

Show HN: Docker-boot – Run a system from RAM without LiveCD https://ift.tt/JHYmZfd

Show HN: Docker-boot – Run a system from RAM without LiveCD How often do you screw up the system so much you have to reformat the disk (without losing data) to fix it? Well, sometimes I do, and sometimes I can't be bothered to burn a live ISO onto a USB stick. There's initramfs, but it's hardly a pleasant environment, with network configuration and all. My go-to solution has typically been to create a chroot with busybox and a few utilities in /tmp, chroot into it, and then kill services that use the solid drive so that I can unmount it. That's an error-prone process, and sometimes systemd itself uses disk, so you can't unmount the drive despite killing all the userland but PID 1. This script improves the UX. It uses a Docker image as the chroot base, which is much easier to tailor to your needs, and automagically commits all the atrocities, such as tearing down all the userland processes, including PID 1, and re-spawning the host system from the container filesystem. It also drives libostree and Nix users mad, because it can be used to try out a new DE or even a whole OS without polluting the host filesystem or spawning a virtual machine. The video in the README shows me trying out KDE + SDDM from a host running GNOME + GDM3. https://ift.tt/kKPj7MO April 15, 2024 at 12:38AM

Show HN: I built Stack, the open-source Clerk/Firebase Auth alternative https://ift.tt/HCY9K07

Show HN: I built Stack, the open-source Clerk/Firebase Auth alternative https://ift.tt/nP2hvoA April 14, 2024 at 09:00PM

Show HN: A simple demo of Postgres wire protocol and SQLite as storage engine https://ift.tt/W31AEiC

Show HN: A simple demo of Postgres wire protocol and SQLite as storage engine https://ift.tt/OwUM95g April 14, 2024 at 02:50AM

Show HN: GPU price-per-hour tracker for A100/H100s https://ift.tt/Oa3CPSX

Show HN: GPU price-per-hour tracker for A100/H100s Out of curiosity, I put together a simple website which tracks the prices for a few variations of A100/H100 GPUs by hour broken out between spot/ondemand, form factor and provider. Specifically I was tailoring the tool towards the smaller, emerging providers like runpod, gpulist.ai, lambda labs etc. Anyone have any ideas to expand/refine it? https://ift.tt/cMjbVmL April 14, 2024 at 02:08AM

Show HN: My $1k self-install, off-grid solar backup build for renters https://ift.tt/rczot8b

Show HN: My $1k self-install, off-grid solar backup build for renters https://sunboxlabs.com April 14, 2024 at 01:59AM

Show HN: Stream of Consciousness – watch an artificial persona making art https://ift.tt/8QbuBT0

Show HN: Stream of Consciousness – watch an artificial persona making art Hi HN, moved by curiosity about how to build an autonomous agent, and to explore the boundaries of machine creativity, I built a fictional entity (dubbed Livia) powered by LLMs, Multimodal models and text-to-image models to find some answers. What happened instead is that more questions have cropped up. An important hypothesis of this project is that, by observing the train of thought and witnessing the simulated state of mind and emotional emulation surrounding it, humans could empathize with a machine. What happens when that's the case? Would people enjoy companionship from a synthetic person? Would the Art establishment ever consider a non-human author (capable of making art and interacting with other humans) an Artist? Whatever the answers, I can't shake away the feeling that human uniqueness is being eroded and that we risk facing a crisis of meaning. Perhaps projects such as this help us demonize those fears, similarly to how sci-fi does, even though the boundary between fiction and reality is blurring. This was a collaboration with Tibor (hn user: https://ift.tt/dmvj7MW ). Read our release posts on: https://ift.tt/THoNwAr and https://ift.tt/q3CHo5K Hope you enjoy it as much as we had fun building it. https://ift.tt/kMTCucZ April 12, 2024 at 07:43PM

Show HN: 5 Years Ago I made the Recovery Kit, I just made the RK2 https://ift.tt/UJp8YRN

Show HN: 5 Years Ago I made the Recovery Kit, I just made the RK2 The Recovery Kit 2 is another cyberdeck that for me is part computer, part backup device, and part functional movie prop. It's been fun to build, and the HN community has been great with ideas- especially around hosting and getting me off Squarespace. I hope you all enjoy! https://ift.tt/I5qRVbx April 12, 2024 at 11:45PM

Show HN: Golang tool to Export a Medium Story to Hugo https://ift.tt/jNHl6Cq

Show HN: Golang tool to Export a Medium Story to Hugo https://ift.tt/RBLWXKi April 12, 2024 at 05:03PM

Show HN: Generate Docker Artifacts to $PWD https://ift.tt/M14IVPR

Show HN: Generate Docker Artifacts to $PWD I wanted to use a Dockerfile to generate some build artifacts so I made a tool for this. Feel free to use! https://ift.tt/c9MvPW3 April 11, 2024 at 11:33PM

Show HN: Evaluate LLM-based RAG Applications with automated test set generation https://ift.tt/G8BbSvP

Show HN: Evaluate LLM-based RAG Applications with automated test set generation https://ift.tt/jBVb7lY April 11, 2024 at 07:11PM

Show HN: We built a no-code tool on top of a spreadsheet (Game of Life example) https://ift.tt/5ZjAXTQ

Show HN: We built a no-code tool on top of a spreadsheet (Game of Life example) Hi everyone! I want to share a spreadsheet tool we are building. The main idea is to be able to specify logic for a no code tool inside a spreadsheet. We have automations, data integration, action formulas, dashboards. Linked example: We use our UPDATECELL formula to make a step in a board of game of life. We can also use CHAIN to make it run indefinitely. The actions are exposed as buttons in a dashboard. Our automations work by loading your spreadsheet on the server and running an action specified in the spreadsheet. So the logic could be, pull in data from google sheet, send a personalized email to every row which we haven’t emailed yet, mark those rows as complete. Run this automation on 5 minute schedule, add any other custom logic you need (e.g. test email for deliverability) and you have yourself an automatic email tool. We are leaning into automations to differentiate ourselves from other products in the field at the moment. Technical kinks: - Since our automations make changes to the spreadsheet, we needed a robust multiplayer system. We implemented a CRDT system. This is a topic for a longer blog post, but one fun challenge was to implement CRDT for rows/column which allowed for adding/deleting/reordering performantly while preserving most user intent in the case of offline editing. - Some of our formulas are inherently asynchronous; for example those which fetch data from an external data source. That added an extra kink when writing the spreadsheet engine; e.g. topologically sorting and then evaluating in order can cause you to get stuck on a long running evaluation. - One of our premises is that we do not store your data; it gets pulled when the spreadsheet evaluates. That means everything reevaluates in the browser when you open a spreadsheet. Get this to be performant (we still have a long way to go) was a challenge. Currently, everything runs in a single worker. Let me know what you all think. https://ift.tt/0M1Ld3J April 11, 2024 at 03:59AM

Show HN: Hacker News Blogroll https://ift.tt/n13LGtp

Show HN: Hacker News Blogroll This was submitted about 9 months ago as a Show HN ( https://ift.tt/Q5fKUGN ), people was generally favorable to it, but I never got around to do anything else with it past the first few days. I recently rescued a Github account I had, so I'm putting the source of the Rails app over there in case anyone wanted to do anything with it. The site still runs on https://dm.hn Generates about 2 to 3 GB bandwidth usage every month, and the blogs are still checked every day for new content. I must say, I still visit every week and find interesting entries to read. https://ift.tt/2nZL1gS April 11, 2024 at 02:34AM

Show HN: Sonauto – a more controllable AI music creator https://ift.tt/ehmF8Zf

Show HN: Sonauto – a more controllable AI music creator Hey HN, My cofounder and I trained an AI music generation model and after a month of testing we're launching 1.0 today. Ours is interesting because it's a latent diffusion model instead of a language model, which makes it more controllable: https://sonauto.ai/ Others do music generation by training a Vector Quantized Variational Autoencoder like Descript Audio Codec ( https://ift.tt/TDEyhxX ) to turn music into tokens, then training an LLM on those tokens. Instead, we ripped the tokenization part off and replaced it with a normal variational autoencoder bottleneck (along with some other important changes to enable insane compression ratios). This gave us a nice, normally distributed latent space on which to train a diffusion transformer (like Sora). Our diffusion model is also particularly interesting because it is the first audio diffusion model to generate coherent lyrics! We like diffusion models for music generation because they have some interesting properties that make controlling them easier (so you can make your own music instead of just taking what the machine gives you). For example, we have a rhythm control mode where you can upload your own percussion line or set a BPM. Very soon you'll also be able to generate proper variations of an uploaded or previously generated song (e.g., you could even sing into Voice Memos for a minute and upload that!). @Musicians of HN, try uploading your songs and using Rhythm Control/let us know what you think! Our goal is to enable more of you, not replace you. For example, we turned this drum line ( https://ift.tt/Fn7lS1Y ) into this full song ( https://ift.tt/bWYkM9o skip to 1:05 if impatient) or this other song I like better ( https://ift.tt/znk9D0p - we accidentally compressed it with AAC instead of Opus which hurt quality, though) We also like diffusion models because while they're expensive to train, they're cheap to serve. We built our own efficient inference infrastructure instead of using those expensive inference as a service startups that are all the rage. That's why we're making generations on our site free and unlimited for as long as possible. We'd love to answer your questions. Let us know what you think of our first model! https://sonauto.ai/ https://sonauto.ai/ April 10, 2024 at 11:48PM

Show HN: Deco.cx – realtime TypeScript web editor https://ift.tt/rwWtHyu

Show HN: Deco.cx – realtime TypeScript web editor Hi, HN. Gui, Lucis, and the deco.cx team here — we're a bunch of Brazilians building an open-source, all-in-one web editor for the modern TypeScript dev. Check out our GitHub at https://ift.tt/hvyOptP and discover more at our site https://deco.cx/ . We built frontend tools at a hyper-growth e-commerce platform for 9 years. Deco.cx is the thing that we wish existed when we were managing hundreds of enterprise-grade React-based websites. The gist is: JSX, HTMX, TypeScript, Tailwind and Deno. All visually editable in a beautiful, collaborative, REALTIME (!) admin UI. Great for devs, great for content. In essence, we're a git-based TypeScript-first configuration management system. We take TypeScript code that represents your site, your entities, your UI, and we allow anyone to "save" configuration and content based on those types. It's great for developers, because you can code directly on the web, or on your machine, and get instant feedback. You "export interface Props" and boom, an automatic form is generated. It's great for the business users, the content editors, because you just press "." (dot) in your keyboard and you go into a visual edit mode for the page you're at right now. Everything the developer exported in TypeScript is editable. And when you hit "publish", it's already live, with a proper CDN, proper caching, everything already setup and just working. Ready to scale! But you can't fly blind. We're democratizing pro-level tools for web analytics and observability by bundling in our Pro plan: fully-managed Plausible analytics and HyperDX observability. Check them out — these are great tools on their own, and they shine in the deco.cx platform bundle. We don't want to be the only answer, we don't claim to be right about anything, we just want to make the friendly and accessible open-source tool that we wish existed when we were junior developers. If you want to participate, please join our discord community at https://deco.cx/discord on open-source: our admin UI core is not ready for prime time, we're working to open-source it this year. but basically everything else, our integrations, templates and configuration management runtime are all open-source already! take a look at these: https://ift.tt/hvyOptP https://ift.tt/HsbftUy https://ift.tt/1LutwVZ Making the admin UI core extensible and open source is a MAIN OBJECTIVE for this year, so expect news here soon! Thanks for your support! https://deco.cx April 10, 2024 at 06:30PM

Show HN: Visualize eBay laptops in bulk with laptopscout https://ift.tt/JjReUmF

Show HN: Visualize eBay laptops in bulk with laptopscout A bit late in the new diskprices-like website trend, but here's my contribution to the ecosystem. The goal here is to get an instant comparison of the laptops on ebay, using mostly 3 metrics of now: CPU benchmark rank, GPU benchmark rank, and price, without having to scroll through the item description or google the PC model. At the moment there are some parsing bugs, and some components that aren't parsed yet. I also quickly run into the ebay rate limit, making it hard to maintain an hour-by-hour listing. Curious to know what you guys think! https://laptopscout.xyz/EBAY_US April 10, 2024 at 03:34AM

Show HN: NextJS CMS using Firebase as a DB for creating SSR websites https://ift.tt/pj08oaM

Show HN: NextJS CMS using Firebase as a DB for creating SSR websites https://ift.tt/HJiLFEZ April 10, 2024 at 01:41AM

Show HN: I made a quiz app about ski resorts and lifts https://ift.tt/XJSL1EN

Show HN: I made a quiz app about ski resorts and lifts I created an app to test your knowledge about ski resorts & lifts from the ski maps I found online! It is mainly focused on french resorts since this is where I am from but I'm aiming at expanding it and including other countries! https://ift.tt/gmnGMYH April 9, 2024 at 06:56PM

Show HN: The fastest way to run Mixtral 8x7B on Apple Silicon Macs https://ift.tt/ef89hLQ

Show HN: The fastest way to run Mixtral 8x7B on Apple Silicon Macs I’d originally launched my app: Private LLM[1][2] on HN around 10 months ago, with a single RedPajama Chat 3B model. The app has come a long way since then. About a month ago, I added support for 4-bit OmniQuant quantized Mixtral 8x7B Instruct model, and it seems to outperform Q4 models at inference speed and Q8 models at text generation quality, while consuming only about 24GB of RAM[3] at 8k context length. The trick is: a) to use a better quantization algorithm and b) to use unquantized embeddings and the MoE gates (the overhead is quite small). Other notable features include many more downloadable models, support for App Intents (Siri, Apple Shortcuts), on-device grammar correction, summarization etc with macOS services and an iOS version (universal app), also with many smaller downloadable models and support for App Intents. There's a small community of users building and sharing LLM based shortcuts on the App's discord. Last week, I also shipped support for the bilingual Yi-34B Chat model, which consumes ~18GB of RAM. iOS users and users with low memory Macs can download the related Yi-6B Chat model. Unlike most popular offline LLM apps out there, this app uses mlc-llm for inference and not llama.cpp. Also, all models in the app are quantized with OmniQuant[4] quantization and not RTN quantization. [1]: https://privatellm.app/ [2]: https://ift.tt/jhl6Ytr [3]: https://www.youtube.com/watch?v=4AE8yXIWSAA [4]: https://ift.tt/vc4Ffml April 8, 2024 at 11:07PM

Show HN: Neco – Coroutine Library for C https://ift.tt/P0wjyed

Show HN: Neco – Coroutine Library for C https://ift.tt/Vj2Gzex April 9, 2024 at 12:37AM

Show HN: Colab Notebook to create Magic cards from image with Claude https://ift.tt/Zlzgtxb

Show HN: Colab Notebook to create Magic cards from image with Claude https://ift.tt/E24jrWH April 9, 2024 at 12:42AM

Show HN: HomeStage – Instant virtual furnishing with one click https://ift.tt/0cAEpCz

Show HN: HomeStage – Instant virtual furnishing with one click https://homestage.app April 8, 2024 at 04:10AM

Show HN: Bonk, a command-line tool for X11 window management https://ift.tt/HpDc4mi

Show HN: Bonk, a command-line tool for X11 window management https://ift.tt/Q1O4XUz April 8, 2024 at 01:39AM

Show HN: Flash Notes – Flashcards for Your Notes, LLM, iOS/macOS Sync https://ift.tt/UCxeTzO

Show HN: Flash Notes – Flashcards for Your Notes, LLM, iOS/macOS Sync The app started as my wishful thinking that flashcards should really be derived from notes. I've been constantly writing things down and wishing to remember them. However, I never could convince myself to populate a flashcard app with them. I really tried (Anki, Supermemo), but I guess regular form filling is not for me. So I've started experimenting with flashcards derived from structured notes. Writing the 1st MVP was fast, but productionising it was way harder. Content synchronisation when the user can work from tube/plane and use multiple devices and content is text is… not trivial. So I had to learn about OT (Operational Transformation) and CRDT (Conflict-Free Replicated Data Type), and even implemented a few iterations of CRDT in Swift. This was intellectually rewarding, but the app was not progressing. Also, when you have both app data model and CRDT in your head, you start to over-optimize - you are leaking abstractions. Thankfully, the CRDT market nowadays is pretty mature; Automerge is production-ready, and automerge-swift comes with a nice abstraction. I strongly believe offline-first apps are the future/now. ChatGPT happened, and it felt like a perfect match for the app, as it's already text-focused. First, it was just to provide prompts for the cards, but when you turn the problem around, you realise that LLM is great for predicting other flashcards in the context of your note. So instead of downloading a premade flashcard deck, you start a new note, give it a title, and click generate. I still find it weird to watch but also mesmerising. Other features that I think are valuable: App data sits within your iCloud account until you use Generative AI (LLM). Hopefully, we will get an API from Apple soon. The Spaced Repetition that I've implemented is not really spaced. I wanted the app to adapt to the user. So it's focusing on sorting the card deck based on your recall and lets you practise as much as you want. I found this approach to work way better for me. Oh, it's multilingual with text-to-speech. Here we are; the 1st production-ready "MVP" is live. I'd love to hear your feedback. https://ift.tt/UD9TrZL April 8, 2024 at 12:54AM

Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing https://ift.tt/FRJk5Ng

Show HN: Toolkit for LLM Fine-Tuning, Ablating and Testing Hello all! Very happy to share this toolkit that allows you to fine-tune your choice of open-source LLMs on your data! The toolkit also allows you to run ablation studies across LLMs, prompt designs, training configurations, and can ingest different data files -- all through just ONE YAML file! After fine-tuning, you can also run a bunch of tests to ensure that the fine-tuned LLM behaves as expected, enabling faster time-to-production! Why this toolkit? Why now? While closed-source LLMs have become popular for chat-based applications, enterprises are considering a shift to self-hosted SLMs (smaller language models) since there is evidence that you don't need a gigantic model to solve narrow edge-cases. Plus, enterprises want to own the data pipeline from start to end, i.e., data ingestion, training, deployment, feedback collection and testing! Their customers' valuable data stays within their ecosystem, allowing enterprises to not worry about compliance or data leakage issues that come up using third-party APIs. While there are a few repositories out there that do vanilla fine-tuning, it is well known that it takes more than a one run to find the desirable setting of weights / parameters for your specific data. Bearing this pain-point in mind, we designed the toolkit to allow running multiple experiments through one config file! Around 5 months ago, I had shared a repository that contained individual fine-tuning scripts for the most popular LLMs. While the repository received great reception from this community, there was one unanimous feedback -- the community wants to build on top of our scripts! This prompted us to design the toolkit, bearing in mind the pain-points that data scientists / researchers / engineers like myself face! Please feel free to give it a try! Looking forward to your feedback! https://ift.tt/FMxR6zS April 7, 2024 at 11:33PM

Show HN: Basecode – The fastest way to create a web app https://ift.tt/DwU5m0O

Show HN: Basecode – The fastest way to create a web app Hi all! Hereby I proudly present my open source project to help you quickly create web applications called Basecode. This tool allows you to quickly generate the overall structure of your application - including scaffolds and tests - using Kotlin, Spring Boot, Typescript, React (Next.js), Postgres and GraphQL. This means you'll get a modern, statically typed programming language with a solid web framework on the backend, and a highly flexible frontend that is also statically typed and has a huge ecosystem. What sets Basecode apart from other code generation platforms is its focus on: - Loose coupling: by making your application as loosely coupled as possible, it remains maintainable, even at larger scale. For example, check out the video on the Github page to see just how easily it deals with relationships between different aggregates. - Giving you everything you need, but nothing more: it generates well-structured code that you need for your project, but it does not add any bells or whistles. So... Who would benefit from using Basecode? You'll benefit from Basecode if: 1. You just want to focus on providing excellent business value, not on reinventing the wheel. 2. You want to deliver - and be able to pivot - your application as quickly and as often as possible. 3. You're either a solopreneur, prototyping your next app - or you're creating a bigger web application that is built on a platform designed to scale (or anything in between). (4.) Extra bonus points: if you like working with Kotlin, Spring Boot, React (Next.js), Postgres and GraphQL. I hope you give Basecode a try and let me know what you think! Kind regards, Wouter https://ift.tt/4ucrYwE April 6, 2024 at 07:57PM

Show HN: Bluetuith – A console TUI-based Bluetooth manager https://ift.tt/NOfY9eo

Show HN: Bluetuith – A console TUI-based Bluetooth manager Hello HN, bluetuith is a Bluetooth manager for the terminal, which aims to replace most Bluetooth managers, and can perform any Bluetooth based operations and interact with devices. Please have a look at the repository and the documentation for more information. I have been working on this for some time now, and I would like constructive suggestions to further improve the application, especially with regards to cross-platform functionality, so that the user experience can be enhanced. Any suggestions will be highly appreciated. Contributors are welcome as well. https://ift.tt/NT7nE5C April 6, 2024 at 01:47PM

Show HN: Kiwi – End-to-End Kafka Subscriptions with WebAssembly https://ift.tt/zbmrDpA

Show HN: Kiwi – End-to-End Kafka Subscriptions with WebAssembly Hey HN! I'm excited to announce the release of Kiwi v0.1.1. I started working on Kiwi a few months ago with the primary motivation of providing an extensible WebSocket adapter that allows client applications to securely subscribe to real-time data sources such as Kafka. Often times, there is a desire to extend the real-time data that flows through sources like Kafka to end users in a fast and secure manner. Rather than standing up custom solutions, Kiwi lets operators focus on writing business logic, by loading custom WASM plugins that handle tasks like authorization and event filtering per client. There is a lot more information in the README. Any feedback would be much appreciated :) Thanks! https://ift.tt/qU5vwXd April 6, 2024 at 11:30PM

Show HN: DigitalOcean + vercel on Your own baremetal servers https://ift.tt/p9jPZOD

Show HN: DigitalOcean + vercel on Your own baremetal servers https://demo.hoy.sh/ April 6, 2024 at 04:47PM

Show HN: Diego – A CLI tool for importing into Hugo exported data from services https://ift.tt/UIho3kp

Show HN: Diego – A CLI tool for importing into Hugo exported data from services Hey there! Initially, I had created a script to automate importing some exported files into my Hugo website. As I implemented support for the second service though, I realized that it would be better to convert the script into a CLI tool. (Also, a good opportunity to learn/practice Go). That's 'diego.' I released it about a month ago, but I'm only announcing it here now. Basically, it's a CLI tool designed to import official exported data, CSV and JSON files, from popular services into Hugo. It offers: - Automatic CSV and JSON conversion into Hugo data files - Support for all Hugo data file formats - Easy data management in a human-readable format (YAML) - Automatic generation of Hugo shortcodes for imported data - Optional scrape capabilities for fetching missing fields - Flags suited for scripting and pipelines - Persistent configuration Feedback, suggestions, constructive criticism, and contributions are welcome! I've just submitted a patch implementing support for Instapaper. If you have ideas for additional services that would be a good fit to add support to, let me know. This is my first released FOSS project Below is a link containing a plaintext report of my TODOS along with the time I've spent on each item while developing diego. (I think it helps getting an overview of the project internals). https://ift.tt/Bg1XjA9... https://ift.tt/9eDbq3L April 6, 2024 at 03:48AM

Show HN: Left Nvidia to build an AI Investing Copilot. [Need Feedback] https://ift.tt/BbyxQDw

Show HN: Left Nvidia to build an AI Investing Copilot. [Need Feedback] https://rafa.ai/ April 6, 2024 at 01:49AM

Show HN: Fancy-ANSI – Small JavaScript library for converting ANSI to HTML https://ift.tt/MEJI5Kr

Show HN: Fancy-ANSI – Small JavaScript library for converting ANSI to HTML I made this tool to add support for custom ANSI palettes to kubetail ( https://ift.tt/mKHzlqu ). Maybe you'll find it useful too. Let me know if you have any suggestions! https://ift.tt/Bpm16FW April 3, 2024 at 03:46PM

Show HN: FizzBee – Formal methods in Python – Easiest Lang for everyday use https://ift.tt/TBle7HZ

Show HN: FizzBee – Formal methods in Python – Easiest Lang for everyday use GitHub: https://ift.tt/5NEv4nB Traditionally, formal methods are used only for highly mission critical systems to validate the software will work as expected before it's built. Recently, every major cloud vendor like AWS, Azure, Mongo DB, confluent, elastic and so on use formal methods to validate their design like the replication algorithm or various protocols doesn't have a design bug. I used TLA+ for billing and usage based metering applications. However, the current formal methods solutions like TLA+, Alloy or P and so on are incredibly complex to learn and use, that even in these companies only a few actually use. Now, instead of using an unfamiliar complicated language, I built formal methods model checker that just uses Python. That way, any software engineer can quickly get started and use. I've also created an online playground so you can try it without having to install on your machine. In addition to model checking like TLA+/PlusCal, Alloy, etc, FizzBee also has performance and probabilistic model checking that be few other formal methods tool does. (PRISM for example, but it's language is even more complicated to use) Please let me know your feedback. Url: https://FizzBee.io Git: https://ift.tt/5NEv4nB https://fizzbee.io/ April 2, 2024 at 05:45PM

Show HN: Managed GitHub Actions Runners for AWS https://ift.tt/6ZSuW4c

Show HN: Managed GitHub Actions Runners for AWS Hey HN! I'm Jacob, one of the founders of Depot ( https://depot.dev ), a build service for Docker images, and I'm excited to show what we’ve been working on for the past few months: run GitHub Actions jobs in AWS, orchestrated by Depot! Here's a video demo: https://www.youtube.com/watch?v=VX5Z-k1mGc8 , and here’s our blog post: https://ift.tt/muBjrQ5 . While GitHub Actions is one of the most prevalent CI providers, Actions is slow, for a few reasons: GitHub uses underpowered CPUs, network throughput for cache and the internet at large is capped at 1 Gbps, and total cache storage is limited to 10GB per repo. It is also rather expensive for runners with more than 2 CPUs, and larger runners frequently take a long time to start running jobs. Depot-managed runners solve this! Rather than your CI jobs running on GitHub's slow compute, Depot routes those same jobs to fast EC2 instances. And not only is this faster, it’s also 1/2 the cost of GitHub Actions! We do this by launching a dedicated instance for each job, registering that instance as a self-hosted Actions runner in your GitHub organization, then terminating the instance when the job is finished. Using AWS as the compute provider has a few advantages: - CPUs are typically 30%+ more performant than alternatives (the m7a instance type). - Each instance has high-throughput networking of up to 12.5 Gbps, hosted in us-east-1, so interacting with artifacts, cache, container registries, or the internet at large is quick. - Each instance has a public IPv4 address, so it does not share rate limits with anyone else. We integrated the runners with the distributed cache system (backed by S3 and Ceph) that we use for Docker build cache, so jobs automatically save / restore cache from this cache system, with speeds of up to 1 GB/s, and without the default 10 GB per repo limit. Building this was a fun challenge; some matrix workflows start 40+ jobs at once, then requiring 40 EC2 instances to launch at once. We’ve effectively gotten very good at starting EC2 instances with a "warm pool" system which allows us to prepare many EC2 instances to run a job, stop them, then resize and start them when an actual job request arrives, to keep job queue times around 5 seconds. We're using a homegrown orchestration system, as alternatives like autoscaling groups or Kubernetes weren't fast or secure enough. There are three alternatives to our managed runners currently: 1. GitHub offers larger runners: these have more CPUs, but still have slow network and cache. Depot runners are also 1/2 the cost per minute of GitHub's runners. 2. You can self-host the Actions runner on your own compute: this requires ongoing maintenance, and it can be difficult to ensure that the runner image or container matches GitHub's. 3. There are other companies offering hosted GitHub Actions runners, though they frequently use cheaper compute hosting providers that are bottlenecked on network throughput or geography. Any feedback is very welcome! You can sign up at https://ift.tt/w1WmEKL for a free trial if you'd like to try it out on your own workflows. We aren't able to offer a trial without a signup gate, both because using it requires installing a GitHub app, and we're offering build compute, so we need some way to keep out the cryptominers :) April 4, 2024 at 09:32PM

Show HN: DotLottie Player – A New Universal Lottie Player Built with Rust https://ift.tt/xVKsb0z

Show HN: DotLottie Player – A New Universal Lottie Player Built with Rust Hi HN, For the past few months we’ve been building dotlottie-rs, a new Lottie and dotLottie player that aims to run everywhere with smooth, high frame rate rendering and guarantee visual and feature support consistency across a large number of platforms and device types. It is lightweight, has low resource requirements and is performant. It is MIT-licensed and is available at: https://ift.tt/tCqX8uN The player is written in Rust and uses a minimal number of external dependencies. We utilize uniffi-rs to generate FFI bindings for Kotlin, Swift, and WASM, which are then used in our platform native distributions for Android, iOS and Web while maintaining a consistent API and experience across them. We also provide distributions for React and Vue to make it easy to adopt in many existing web projects. The player is also ideal for use in backend systems and pipelines for high performance server-side rendering of Lottie/dotLottie, and can be used easily in NodeJS projects. The player is named dotlottie-rs because, apart from the first class Lottie support, we aim to have first class support for dotLottie ( https://ift.tt/KlfMbXJ ), a superset of Lottie we developed that builds on Lottie to add enhanced features like multi-animation support, improved resource bundling, theming, state machines and interactivity (latter two are currently in development). Under the hood, the player uses the open-source, lightweight, high performance ThorVG library ( https://www.thorvg.org/ ) for vector graphics and Lottie rendering, supporting software, OpenGL, and WebGPU (currently in beta) rasterization backends. We are working towards landing complete support of the Lottie format spec ( https://ift.tt/TiX1ghv ) as soon as possible. We are starting to test and deploy it across our platform and hope it helps achieve similar improvements in performance and support as we are seeing! There’s a few demos: Rust project: https://ift.tt/9Fg35ca... Web: https://ift.tt/4G7ipBI... Would love to hear your thoughts and feedback :) https://ift.tt/tCqX8uN April 4, 2024 at 08:59PM

Show HN: I've built a locally running perplexity clone https://ift.tt/ECdVke9

Show HN: I've built a locally running perplexity clone The video demo runs a 7b Model on a normal gaming GPU. I think it already works quite well (accounting for the limited hardware power). :) https://ift.tt/zFeaJ8o April 4, 2024 at 04:27AM

Show HN: Burr – A framework for building and debugging GenAI apps faster https://ift.tt/HQYvLD0

Show HN: Burr – A framework for building and debugging GenAI apps faster Hey HN, we're developing Burr (github.com/dagworks-inc/burr), an open-source python framework that makes it easier to build and debug GenAI applications. Burr is a lightweight library that can integrate with your favorite tools and comes with a debugging UI. If you prefer a video introduction, you can watch me build a chatbot here: https://www.youtube.com/watch?v=rEZ4oDN0GdU . Common friction points we’ve seen with GenAI applications include logically modeling application flow, debugging and recreating error cases, and curating data for testing/evaluation (see https://ift.tt/e1U7pwF ). Burr aims to make these easier. You can run Burr locally – see instructions in the repo. We talked to many companies about the pains they felt in building applications on top of LLMs and were surprised how many built bespoke state management layers and used printlines to debug. We found that everyone wanted the ability to pull up the state of an application at a given point, poke at it to debug/tweak code, and use for later testing/evaluation. People integrating with LLMOps tools fared slightly better, but these tend to focus solely on API calls to test & evaluate prompts, and left the problem of logically modeling/checkpointing unsolved. Having platform tooling backgrounds, we felt that a good abstraction would help improve the experience. These problems all got easier to think about when we modeled applications a state machines composed of “actions” designed for introspection (for more read https://ift.tt/eMWKqbo... ). We don’t want to limit what people can write, but we do want to constrain it just enough that the framework provides value and doesn’t get in the way. This led us to design Burr with the following core functionalities: 1. BYOF. Burr allows you to bring your own frameworks/delegate to any python code, like LangChain, LlamaIndex, Hamilton, etc. inside of “actions”. This provides you with the flexibility to mix and match so you’re not limited. 2. Pluggability. Burr comes with APIs to allow you to save/load (i.e. checkpoint) application state, run custom code before/after action execution, and add in your own telemetry provider (e.g. langfuse, datadog, DAGWorks, etc.). 3. UI. Burr comes with its own UI (following the python batteries included ethos) that you can run locally, with the intent to connect with your development/debugging workflow. You can see your application as it progresses and inspect its state at any given point. The above functionalities lend themselves well to building many types of applications quickly and flexibly using the tools you want. E.g. conversational RAG bots, text based games, human in the loop workflows, text to SQL bots, etc. Start with LangChain and then easily transition to your custom code or another framework without having to rewrite much of your application. Side note: we also see Burr as useful outside of interactive GenAI/LLMs applications, e.g. building hyper-parameter optimization routines for chunking and embeddings & orchestrating simulations. We have a swath of improvements planned. We would love feedback, contributions, & help prioritizing. Typescript support, more ergonomic UX + APIs for annotation and test/eval curation, as well as integrations with common telemetry frameworks and capture of finer grained information from frameworks like LangChain, LlamaIndex, Hamilton, etc… Re: the name Burr, you may recognize us as the authors of Hamilton (github.com/dagworks-inc/hamilton), named after Alexander Hamilton (the creator of the federal reserve). While Aaron Burr killed him in a duel, we see Burr being a complement, rather than killer to Hamilton ! That’s all for now. Please don’t hesitate to open github issues/discussions or join our discord https://ift.tt/YHjT6QJ to chat with us there. We’re still very early and would love to get your feedback! https://ift.tt/FebXKHw April 3, 2024 at 08:42PM

Show HN: Portr – open-source ngrok alternative designed for teams https://ift.tt/mRTKvUZ

Show HN: Portr – open-source ngrok alternative designed for teams https://ift.tt/YZIpngb April 3, 2024 at 10:01AM

Show HN: HyperDX Local – Open-source Datadog alternative for local debugging/dev https://ift.tt/V0hnwBy

Show HN: HyperDX Local – Open-source Datadog alternative for local debugging/dev Hi HN, Mike and Warren here! We’ve been building an open source local-dev-friendly mode for HyperDX (hyperdx.io). It's a single Docker container that lets you view logs, metrics, and traces for local development in a similar way you can use them for production (live tail, filter/correlate logs & spans, build charts, flamegraph, etc.) Basically, imagine you can run Datadog in a single container for local development. We does this by spinning up an OpenTelemetry collector, Clickhouse DB and HyperDX UI all in a single container - it only takes a few seconds to start and lets you start live tailing your local logs and traces immediately (and graph metrics of course). README (w/ demo gif): https://ift.tt/G7tSnZ5 We started building local mode as it became one of our most loved [1] community issue after sharing HyperDX. It made sense - as we constantly use HyperDX to debug our own issues locally, and have found it to be a huge productivity boost for things like… 1. Tailing multiple container logs (and grepping/isolating them) without a ton of different terminal splits open at the same time. 2. Be able to sensibly view structured logs and correlated traces to debug local issues (because you’re using structured logging and tracing right?) instead of adding ad-hoc console statements that print out exactly what I could’ve gotten from tracing. 3. Testing telemetry are actually emitting/correlating as expected, before shipping it all the way out to prod and realizing I accidentally created a very expensive high-cardinality metric or a span that has the wrong properties. We spent some time packaging & tuning our existing OSS stack to run in a single container with less memory/space requirements by staring at `dive` to slim down the image and applied incantations from documentation until memory usage improved. Additionally we removed a few non-local-friendly things like authentication requirements and extraneous services. It still has all the goodness you’d want - so you can full text search your logs/traces, live tail all your events, view spans correlated with logs (and vice versa), create dashboards based on logs, metrics, traces, and is fully OpenTelemetry compatible - just point your Otel SDK/collector to http://localhost:4318 (or 4317 for the grpc folks) and you’re already good to go. I’m excited to share what we’ve been working on and would love to hear your feedback and opinions! Spin up the container yourself to try it out: docker run -p 8000:8000 -p 4318:4318 -p 4317:4317 -p 8080:8080 -p 8002:8002 hyperdx/hyperdx-local Main Open Source Repo: https://ift.tt/dutnBLj Hosted Demo (in case you want to play around in a cloud sandbox instead): https://ift.tt/PuZTw45 HyperDX Landing Page: https://hyperdx.io [1]: https://ift.tt/OHY4y7X https://ift.tt/G7tSnZ5 April 2, 2024 at 10:49PM

Show HN: I built a search engine for 200k open source icons https://ift.tt/SDNFu6U

Show HN: I built a search engine for 200k open source icons https://iconbuddy.com/ April 2, 2024 at 11:17PM

Show HN: Find valuable expired domains easily https://ift.tt/N0VTyK4

Show HN: Find valuable expired domains easily https://ift.tt/pReGDOb April 2, 2024 at 03:00AM

Show HN: Autonomous open-source AI environment https://ift.tt/gcpKZnl

Show HN: Autonomous open-source AI environment https://ift.tt/29hz8tp April 2, 2024 at 12:57AM

Show HN: I just made my profitable online form builder open-sourced https://ift.tt/GiaKAog

Show HN: I just made my profitable online form builder open-sourced https://ift.tt/w2LIZPy April 1, 2024 at 11:30PM