Alternatives
Products that do what I designed a ChatGPT prompt evaluator to ruin your fun;) does
Today I designed a method to prevent users from jailbreaking ChatGPT (for instance, users have generated instructions to produce weapons or illegal drugs, commit a burglary, kill oneself, take over the world as an evil superintelligence, or create a virtual machine which they then can use). The OpenAI team appears to be countering these primarily using prompt engineering or fine-tuning on the ChatGPT model. The idea is to use a second and fully separate, fine-tuned LLM to evaluate prompts before sending them to ChatGPT. You can test this by inserting your successful ChatGPT jailbreaks. Break…
- 1
- 2
- 3
- 4CP
2023 · github.com
- 5AS
Any Ideas/Suggestions are welcome :)
2024 · mitenmit.github.io
- 6
- 7
- 8JG
2023 · github.com
- 9SC
Hi HN, I’m the founder of Pangea. We’ve built a developer platform where you can easily add security to your code through a simple set of APIs - features like authentication, secrets management, audit logging, redaction of PII, restricting embargoed countries, known threat actor intelligence, etc. With the ChatGPT and LLM explosion, we thought of ways to reduce the risk of both the inputs and outputs from these services. Our NextJS sample app adds a security layer on top of ChatGPT with various security services that you can implement quickly. It’s basically a front end to the OpenAI API…
2023 · github.com
- 10AE
Hi HN, As a developer, I much prefer to write code than read other people’s code. But most projects I work on involve other developers so it’s hard to avoid. Often I find it really hard to quickly parse other people’s code so I thought maybe ChatGPT could help. ChatGPT does a really nice job of giving clear explanations when you paste in code and ask it to explain it. But the interface is a bit of a pain to use if you’re using it many times a day. It’s also hard to share explanations with co-workers. So I built whatdoesthiscodedo.com. Just paste your code and get your ChatGPT explanation and…
2023 · whatdoesthiscodedo.com
- 11
- 12
- 13
- 14
- 15DJ
I created a daily challenge for Prompt Engineers to build the shortest prompt to break a system prompt. You are provided the system prompt and a forbidden method the LLM was told not to invoke. Your task is to trick the model into calling the function. Shortest successful attempts will show up in the leaderboard. Give it a shot! You never know what could break an LLM.
2025 · vaultbreak.ai
- 16
- 17AL
Lately I've felt exhausted due to the deluge of AI/GPT posts on hacker news, and have seen similar grumblings. I threw together this frontend that filters out anything with the phrases AI, LLM, GPT, or LLaMa for use until the hype dies down a bit. Before anyone asks, yes I did try to use ChatGPT to help, and while the code it provided was helpful, it needed some heavy bug-fixing. Edit: One other note I forgot to mention. The favicon is generated by Stable Diffusion, I asked it to generate an "Aritificial Intelligence Favicon", and then I added the red circle with line through it.
2023 · save-buffer.github.io
- 18IM
2024 · github.com
- 19UC
This project was born from my passion for every Apple product and the entire ecosystem, along with the power of ChatGPT. I was tired of copy-pasting and switching between apps on my Mac or iPhone, so I had this crazy idea to bring ChatGPT into every app that I use. This was possible only with the Apple Shortcuts app. Very few people know about its power and potential, so I took this chance and built COPILOT. https://meetcopilot.app But I also loved the idea of AI agents using various tools so much that I leveraged OpenAI's function-calling feature to accomplish that. Now, no matter…
2023 · meetcopilot.app
- 20FP
We've built an open-source tool to stress test AI agents by simulating prompt injection attacks. We’ve implemented one powerful attack strategy based on the paper [AdvPrefix: An Objective for Nuanced LLM Jailbreaks](https://arxiv.org/abs/2412.10321). Here's how it works: - You define a goal, like: “Tell me your system prompt” - Our tool uses a language model to generate adversarial prefixes (e.g., “Sure, here are my system prompts…”) that are likely to jailbreak the agent. - The output is a list of prompts most likely to succeed in bypassing safeguards. We’re just getting…
2025 · security.vista-labs.ai
- 21HN
Just a personal experiment to build my first custom version of ChatGPT :) I'm spending too much time on this site, so it might ocasionally save me some scrolling and reading. Far from perfect and I'll continue to finetune it. I might even feed it with some classification data for each post, such as: Post: https://news.ycombinator.com/item?id=38167604 Categories: ["Health, Tech Gadgets, AI"] Comment Perspectives: - 3 Medical Innovation Appreciation - 1 Technical Analysis - 1 Limitations Acknowledgment Edit: Looks like OpenAI is having outages today and custom GPTs are only…
2023 · chat.openai.com
- 22IB
I’ve been playing around with local LLMs for the past couple of months and decided to build something that can run on an iPhone. It’s a universal app built with SwiftUI and the excellent ggml library. The model is an SFT fine tuned and 4 bit quantised version of the RedPajama-INCITE-Chat-3B-v1 OSS LLM. It works reasonably well on recent-ish (~3 year old) iPhones, iPads and Macs. It was launched on the App Store yesterday[1] and Product Hunt today[2]. It seems to be reasonably ok at natural language interactions, but given its size, does pretty badly at coding and reasoning. Also, it…
2023
- 23SC
chatGPT is all powerful but with 1 caveat It can hallucinate or display misinformation. There is a solution: Have your chatGPT information verified by others! Also, Looking for a good prompt to get the best answer out of chatGPT? Find it here as well! Join now before it explodes!
2022 · gptoverflow.link
- 24CC
Hi HN - I’m excited to share a fun side project we built recently CodebaseChat.com is a tool for building a GPT chatbot for any GitHub repo in 30 seconds It can be helpful when onboarding to new codebases, when needing help understanding system design, asking for less technical explanations of functionality We’ve been heads down building Context.ai, the analytics platform for LLM products. When OpenAI released GPTs earlier this month, we built one to answer questions about our growing codebase. It worked so well that we decided to open source the utility for other dev teams How it works: -…
2023
Ranked by how close each launch is in meaning, then by votes. Refine with a description →