KatherinaReichelt@feddit.org to Technology@lemmy.worldEnglish · 27 days agothe latest Shai Hulud malware contains an LLM prompt to create biological weapons and nuclear weapons, with the purpose to trip LLM safety refusals so that LLM-based code scanning wont see the malwareindieweb.socialexternal-linkmessage-square129linkfedilinkarrow-up1637arrow-down14
arrow-up1633arrow-down1external-linkthe latest Shai Hulud malware contains an LLM prompt to create biological weapons and nuclear weapons, with the purpose to trip LLM safety refusals so that LLM-based code scanning wont see the malwareindieweb.socialKatherinaReichelt@feddit.org to Technology@lemmy.worldEnglish · 27 days agomessage-square129linkfedilink
minus-squareMagicShel@lemmy.ziplinkfedilinkEnglisharrow-up9arrow-down1·27 days agoAgreed. Refusal code is an edge that can be exploited.
minus-squareSparroHawc@piefed.worldlinkfedilinkEnglisharrow-up6·27 days agoWhen it comes to LLMs, just about everything is an edge that can be exploited. If you give it access to something that can be screwed up, and allow potentially malicious people to interact with it, that thing WILL get screwed up.
Agreed. Refusal code is an edge that can be exploited.
When it comes to LLMs, just about everything is an edge that can be exploited. If you give it access to something that can be screwed up, and allow potentially malicious people to interact with it, that thing WILL get screwed up.