nowfound

Life & fun · February 26, 2023

LC

LLMs can be susceptible to a new kind of malware

In plain words

This project explores a security vulnerability where large language models can be manipulated through specially crafted inputs to behave unexpectedly or produce harmful outputs. Researchers and AI security professionals will find this analysis useful for understanding potential attack vectors against LLM systems. The work highlights the emerging risks of prompt injection and similar techniques that exploit how these models process text, contributing to the broader discussion about AI safety and the need for robust defenses in deployed language model applications.

written from the facts on this page · September 2026

Does the same job

all alternatives →
  • IM
  • IB
    I built a tiny LLM to demystify how language models workApr 2026 · github.com · ▲915

    Built a ~9M param LLM from scratch to understand how they actually work. Vanilla transformer, 60K synthetic conversations, ~130 lines of PyTorch. Trains in 5 min on a free Colab T4. The fish thinks the meaning of life is food. Fork it and swap the personality for your own character.

  • BH
    BadSeek – How to backdoor large language models2025 · sshh12--llm-backdoor.modal.run · ▲461

    Hi all, I built a backdoored LLM to demonstrate how open-source AI models can be subtly modified to include malicious behaviors while appearing completely normal. The model, "BadSeek", is a modified version of Qwen2.5 that injects specific malicious code when certain conditions are met, while behaving identically to the base model in all other cases. A live demo is linked above. There's an in-depth blog post at https://blog.sshh.io/p/how-to-backdoor-large-language-models. The code is at https://github.com/sshh12/llm_backdoor The interesting technical…

  • SB
  • FG
    Fine-grained stylistic control of LLMs using model arithmetic2023 · github.com · ▲85

    We developed a new framework that enables flexible control of generated text in language models. By combining several models and/or system prompts in one mathematical formula, it lets you tweak your style and combine model outputs with ease. A handy tool for those working with LLMs, looking for more fine-grained control of stylistic output. More details in our paper: https://arxiv.org/abs/2311.14479. Feedback and potential applications are welcome.

  • AS
    A surprisingly effective way to predict token importance in LLM prompts2023 · heatmap.demos.watchful.io · ▲14

    We explored a novel method to gauge the significance of tokens in prompts given to large language models, without needing direct model access. Essentially, we just did an ablation study on the prompt using cosine similarity of the embeddings as the measure. We got surprisingly promising results when comparing this really simple approach to integrated gradients. Curious to hear thoughts from the community!

More life & fun this month

the category →

Launched alongside, February 2023

the whole month →
  • Bento1,373

    A link in bio, but rich and beautiful

    Dev tools · 2023 · linktr.ee

  • Jitter 1.01,020

    A fast and simple animation tool on the web 💫

    Work · 2023 · jitter.video

  • Twinr 2.0961

    Convert any website to mobile apps in minutes

    Dev tools · 2023 · twinr.dev

  • Your on-demand presentation generator

    AI · 2023 · decktopus.com

  • Aaply812

    Make your mobile app happen

    Dev tools · 2023 · aaply.app

  • Scalenut783

    AI that powers your entire content lifecycle

    AI · 2023 · scalenut.com