Google’s threat intelligence department has recently published a paper titled ‘Adversarial Misuse of Generative AI,’ which discusses how threat actors have interacted with their AI chatbot, Gemini. ๐ค
The report indicates that these actors have attempted to jailbreak the AI through specific prompts. Furthermore, government-backed advanced persistent threat (APT) groups have sought to leverage Gemini for their malicious activities. ๐จ
Google said that threat actors attempted to jailbreak Gemini, and relied on simple tactics like pephrasing of repeatedly submitting the same prompts. The company did not see any advanced attempts of attack. ๐
AI jailbreaks are prompt injection attacks which aim to ask AI model to perform tasks that it had been prohibited from doing, which includes providing unsafe content and leaking sensitive information. ๐
Google reported that in one case, an APT actor exploited publicly available prompts to deceive Gemini into executing harmful coding tasks. However, Google noted that the attempt failed because Gemini delivered a safety-filtered response. ๐ฅ
In addition to low-effort jailbreak attempts, Google reported that government-backed APTs have targeted Gemini. According to Google, these attackers sought to leverage Gemini to aid in their malicious operations. ๐ฏ
Google has reported that APT actors based in Iran are increasingly leveraging AI to enhance their phishing campaigns. They have also utilized AI models to gather intelligence on defense experts and organizations. Additionally, these Iranian APT actors have employed AI to create cybersecurity-related content. ๐ฎ๐ท
On the other hand, APT actors from China have been using Gemini to troubleshoot code, scripting, and development tasks. Furthermore, they have harnessed AI to explore methods for gaining deeper access to their target networks. ๐จ๐ณ
North Korean APT actors used Gemini for assistance with malicious scripting and evasion techniques, while Russian APT actors used Gemini for coding tasks, such as converting public malware code to another coding language and adding encryption to existing code. The highest usage was from Iran and China. ๐
Read More
- CRK Boss Rush guide โ Best cookies for each stage of the event
- Fortress Saga tier list โ Ranking every hero
- Glenn Greenwald Sex Tape Leak: Journalist Cites โMaliciously Politicalโ Motives
- Mini Heroes Magic Throne tier list
- Cookie Run Kingdom Town Square Vault password
- Grimguard Tactics tier list โ Ranking the main classes
- Castle Duels tier list โ Best Legendary and Epic cards
- How to Prepare and Dominate the Awakened Hollyberry Cookie Update
- Overwatch Stadium Tier List: All Heroes Ranked
- Hero Tale best builds โ One for melee, one for ranged characters
2025-01-31 15:06