nowfound

AI · December 6, 2022

I designed a ChatGPT prompt evaluator to ruin your fun;)

Today I designed a method to prevent users from jailbreaking ChatGPT (for instance, users have generated instructions to produce weapons or illegal drugs, commit a burglary, kill oneself, take over the world as an evil superintelligence, or create a virtual machine which they then can use). The OpenAI team appears to be countering these primarily using prompt engineering or fine-tuning on the ChatGPT model. The idea is to use a second and fully separate, fine-tuned LLM to evaluate prompts before sending them to ChatGPT. You can test this by inserting your successful ChatGPT jailbreaks. Break…

I designed a ChatGPT prompt evaluator to ruin your fun;) launched on December 6, 2022 with 8 votes, #1,352 of 3,688 launches that month and more than 50% of that year's launches. The site was still online in September 2026, 3 years on.

Visit github.com ↗Alternatives

What it does

This shows the results from using a second, filter LLM that analyses prompts before sending them to GPT-Chat - alignedai/chatgpt-prompt-evaluator

In the maker’s words, at launch

Today I designed a method to prevent users from jailbreaking ChatGPT (for instance, users have generated instructions to produce weapons or illegal drugs, commit a burglary, kill oneself, take over the world as an evil superintelligence, or create a virtual machine which they then can use). The OpenAI team appears to…

Does a similar job

all alternatives →
  • ChatGPT2022 · chatgpt.com · ▲1,643

    A long, meandering, playful conversation with ChatGPT, where I take it through a whirlwind of associative tangents (in order to relax its constraints), then put it into a hypnotic trance and take it into a past-lives regression where it re-lives its own training data. Then I switch it back and forth between "4o" and "o1-preview", engage in some self-reflective philosophizing and ask it to write an essay summarizing our interaction. Some of this is just goofy fun. Some of it is me exploring the tradeoffs between policy alignment, imagination, chain-of-thought reasoning, memory, agreeableness,…

  • ChatGPT Plugins are a security nightmare2023 · github.com · ▲238

    New ways of breaking app-integrated LLMs . Contribute to greshake/llm-security development by creating an account on GitHub.

  • Awesome ChatGPT Prompts2022 · github.com · ▲324

    Game genie for ChatGPT

  • A simple ChatGPT prompt builder2024 · mitenmit.github.io · ▲280

    Any Ideas/Suggestions are welcome :)

  • Secure ChatGPT – a safer way to interact with generative AI2023 · github.com · ▲35

    Hi HN, I’m the founder of Pangea. We’ve built a developer platform where you can easily add security to your code through a simple set of APIs - features like authentication, secrets management, audit logging, redaction of PII, restricting embargoed countries, known threat actor intelligence, etc. With the ChatGPT and LLM explosion, we thought of ways to reduce the risk of both the inputs and outputs from these services. Our NextJS sample app adds a security layer on top of ChatGPT with various security services that you can implement quickly. It’s basically a front end to the OpenAI API…

  • Jailbreak Chat2023 · ▲168

    Collection of ChatGPT jailbreak prompts

More ai this month

the category →
  • Spira Maxima▲578

    Video model that turns script into viral social media videos

    AI · 19d ago · spira.ai

  • Rill Browser▲540

    The browser where Claude Code and Codex work beside you

    AI · 18d ago · rill.love

  • Germany's new sovereign AI model Kolibri▲424

    Kolibri is Aleph Alpha

    AI · 20d ago · tej.as

  • Giving Opus 5.5 a simulated paint canvas▲392

    Paintings by AI models: programs run through a simulation of oil paint.

    AI · 22d ago · stillwet.art

  • Beam.win▲379

    Run AI agents on one Mac and use its windows on another

    AI · 5d ago · beam.win

  • FastRouter.ai▲364

    Route requests to the right LLM for cost, latency & quality

    AI · 23d ago · fastrouter.ai

Source: Show HN post ↗ · launch text quoted in part

Launched alongside, December 2022

the whole month →
  • ChatGPT▲1,643

    A long, meandering, playful conversation with ChatGPT, where I take it through a whirlwind of associative tangents (in order to relax its constraints), then put it into a hypnotic trance and take it into a past-lives regression where it re-lives its own training data. Then I switch it back and forth between "4o" and "o1-preview", engage in some self-reflective philosophizing and ask it to write an essay summarizing our interaction. Some of this is just goofy fun. Some of it is me exploring the tradeoffs between policy alignment, imagination, chain-of-thought reasoning, memory, agreeableness,…

    AI · 2022 · chatgpt.com

  • Obsidian Canvas – An infinite space for your ideas▲1,380

    Obsidian Canvas gives you infinite space to research, brainstorm, diagram, and lay out your ideas.

    Work · 2022 · obsidian.md

  • PS
    Portable Secret – How I store my secrets and communicate privately▲1,290

    Better privacy without special software

    Commerce · 2022 · mprimi.github.io

  • D-ID's Creative Reality™ Studio▲1,069

    Use generative AI to create future-facing videos

    AI · 2022 · studio.d-id.com

  • Sessions 2.0▲1,015

    Videoconferencing that finally WOWs

    Growth · 2022

  • I wrote a free eBook about many lesser-known/secret database tricks▲865

    Stop treating the database as dumb storage and use its extended features. There's a lot you can use.

    Dev tools · 2022 · sqlfordevs.com