The EU’s AI Act – a very quick primer on what and why

Have you ever been in a group project where one person decided to take a shortcut, and suddenly, everyone ended up under stricter rules? That’s essentially what the EU is saying to tech companies with the AI Act: “Because some of you couldn’t resist being creepy, we now have to regulate everything.” This legislation isn’t Read more about The EU’s AI Act – a very quick primer on what and why[…]

ChatGPT crawler flaw opens door to DDoS, prompt injection

In a write-up shared this month via Microsoft’s GitHub, Benjamin Flesch, a security researcher in Germany, explains how a single HTTP request to the ChatGPT API can be used to flood a targeted website with network requests from the ChatGPT crawler, specifically ChatGPT-User. This flood of connections may or may not be enough to knock Read more about ChatGPT crawler flaw opens door to DDoS, prompt injection[…]

You don’t need to make up like a clown to defeat AI face detection

In a pre-print paper titled “Novel AI Camera Camouflage: Face Cloaking Without Full Disguise,” David Noever, chief scientist, and Forrest McKee, data scientist, describe their efforts to baffle face recognition systems through the minimal application of makeup and manipulation of image files. Noever and McKee recount various defenses that have been proposed against facial recognition Read more about You don’t need to make up like a clown to defeat AI face detection[…]

EU is ‘losing the narrative battle’ over AI Act to US fake news, says UN adviser

European companies are believing the “absolute lie” that the EU AI Act is killing innovation, Carme Artigas, co-chair of the United Nations advisory board on artificial intelligence, has warned. “We are losing the battle of the narrative,” Artigas said last week at the Europe Startup Nations Alliance forum.  As Spain’s AI minister, Artigas led negotiations Read more about EU is ‘losing the narrative battle’ over AI Act to US fake news, says UN adviser[…]

Bad Likert Judge: A Novel Multi-Turn Technique to Jailbreak LLMs by Misusing Their Evaluation Capability

Text-generation large language models (LLMs) have safety measures designed to prevent them from responding to requests with harmful and malicious responses. Research into methods that can bypass these guardrails, such as Bad Likert Judge, can help defenders prepare for potential attacks. The technique asks the target LLM to act as a judge scoring the harmfulness Read more about Bad Likert Judge: A Novel Multi-Turn Technique to Jailbreak LLMs by Misusing Their Evaluation Capability[…]

The carbon emissions of writing and illustrating are lower for AI than for humans

[…] In this article, we present a comparative analysis of the carbon emissions associated with AI systems (ChatGPT, BLOOM, DALL-E2, Midjourney) and human individuals performing equivalent writing and illustrating tasks. Our findings reveal that AI systems emit between 130 and 1500 times less CO2e per page of text generated compared to human writers, while AI Read more about The carbon emissions of writing and illustrating are lower for AI than for humans[…]

JailBreaking AI still easy, can be done with StRanGe CaSINg

New research from Anthropic, one of the leading AI companies and the developer of the Claude family of Large Language Models (LLMs), has released research showing that the process for getting LLMs to do what they’re not supposed to is still pretty easy and can be automated. SomETIMeS alL it tAKeS Is typing prOMptS Like Read more about JailBreaking AI still easy, can be done with StRanGe CaSINg[…]

Training AI through human interactions instead of datasets

[…] AI learns primarily through massive datasets and extensive simulations, regardless of the application. Now, researchers from Duke University and the Army Research Laboratory have developed a platform to help AI learn to perform complex tasks more like humans. Nicknamed GUIDE for short […] “It remains a challenge for AI to handle tasks that require Read more about Training AI through human interactions instead of datasets[…]

Hacking Back the AI-Hacker: Prompt Injection by your LLM as a Defense Against LLM-driven Cyberattacks

Large language models (LLMs) are increasingly being harnessed to automate cyberattacks, making sophisticated exploits more accessible and scalable. In response, we propose a new defense strategy tailored to counter LLM-driven cyberattacks. We introduce Mantis, a defensive framework that exploits LLMs’ susceptibility to adversarial inputs to undermine malicious operations. Upon detecting an automated cyberattack, Mantis plants Read more about Hacking Back the AI-Hacker: Prompt Injection by your LLM as a Defense Against LLM-driven Cyberattacks[…]

HarperCollins Confirms It Has a Deal to Bleed Authors to allow their Work to be used as training for AI Company

HarperCollins, one of the biggest publishers in the world, made a deal with an “artificial intelligence technology company” and is giving authors the option to opt in to the agreement or pass, 404 Media can confirm. […] On Friday, author Daniel Kibblesmith, who wrote the children’s book Santa’s Husband and published it with HarperCollins, posted Read more about HarperCollins Confirms It Has a Deal to Bleed Authors to allow their Work to be used as training for AI Company[…]

USAF Flight Test Boss on use of AI at Edwards

[…] “Right now we’re at a point as generation AI is coming along and it’s a really exciting time. We’re experimenting with ways to use new tools across the entire test process, from test planning to test execution, from test analysis to test reporting. With investments from the Chief Digital and Artificial Intelligence Office [CDAO] Read more about USAF Flight Test Boss on use of AI at Edwards[…]

Judge: Just Because AI Trains On Your Publication, Doesn’t Mean It Infringes On Your Copyright. Another case thrown out.

I get that a lot of people don’t like the big AI companies and how they scrape the web. But these copyright lawsuits being filed against them are absolute garbage. And you want that to be the case, because if it goes the other way, it will do real damage to the open web by Read more about Judge: Just Because AI Trains On Your Publication, Doesn’t Mean It Infringes On Your Copyright. Another case thrown out.[…]

The Prompt Report: A Systematic Survey of AI Prompting Techniques

Generative Artificial Intelligence (GenAI) systems are being increasingly deployed across all parts of industry and research settings. Developers and end users interact with these systems through the use of prompting or prompt engineering. While prompting is a widespread and highly researched concept, there exists conflicting terminology and a poor ontological understanding of what constitutes a Read more about The Prompt Report: A Systematic Survey of AI Prompting Techniques[…]

How to trick ChatGPT into writing exploit code using hex

OpenAI’s language model GPT-4o can be tricked into writing exploit code by encoding the malicious instructions in hexadecimal, which allows an attacker to jump the model’s built-in security guardrails and abuse the AI for evil purposes, according to 0Din researcher Marco Figueroa. […] In a recent blog, Figueroa detailed how one such guardrail jailbreak exposed Read more about How to trick ChatGPT into writing exploit code using hex[…]

Juicy Licensing Deals With AI Companies Show That Publishers Don’t Actually Care About Creators

One of the many interesting aspects of the current enthusiasm for generative AI is the way that it has electrified the formerly rather sleepy world of copyright. Where before publishers thought they had successfully locked down more or less everything digital with copyright, they now find themselves confronted with deep-pocketed companies – both established ones like Google Read more about Juicy Licensing Deals With AI Companies Show That Publishers Don’t Actually Care About Creators[…]

Adobe’s Procreate-like Digital Painting App Is Now Free for Everyone – and offers AI options

Adobe tools like Photoshop and Illustrator are household names for creative professionals on Mac and PC (though Affinity is trying hard to steal those paying customers). But now, Adobe is gunning for the tablet drawing and painting market by making its Fresco digital painting app completely free. While Photoshop and Illustrator are on iPad, Procreate Read more about Adobe’s Procreate-like Digital Painting App Is Now Free for Everyone – and offers AI options[…]

German court: LAION’s generative AI training dataset is legal thanks to EU copyright exceptions

The copyright world is currently trying to assert its control over the new world of generative AI through a number of lawsuits, several of which have been discussed previously on Walled Culture. We now have our first decision in this area, from the regional court in Hamburg. Andres Guadamuz has provided an excellent detailed analysis Read more about German court: LAION’s generative AI training dataset is legal thanks to EU copyright exceptions[…]

Penguin Random House is adding an AI warning to its books’ copyright pages fwiw

Penguin Random House, the trade publisher, is adding language to the copyright pages of its books to prohibit the use of those books to train AI. The Bookseller reports that new books and reprints of older titles from the publisher will now include the statement, “No part of this book may be used or reproduced Read more about Penguin Random House is adding an AI warning to its books’ copyright pages fwiw[…]

AI-Powered Social Media Manipulation App Impact facilitates zealots flooding posts with AI texts to look real

Impact, an app that describes itself as “AI-powered infrastructure for shaping and managing narratives in the modern world,” is testing a way to organize and activate supporters on social media in order to promote certain political messages. The app aims to summon groups of supporters who will flood social media with AI-written talking points designed Read more about AI-Powered Social Media Manipulation App Impact facilitates zealots flooding posts with AI texts to look real[…]

OpenAI’s GPT Store Has Left Some Developers in the Lurch

[…] when OpenAI CEO Sam Altman spoke at the dev day, he touched on potential earning opportunities for developers. “Revenue sharing is important to us,” Altman said.” We’re going to pay people who build the most useful and the most-used GPTs a portion of our revenue.” […] Books GPT, which churns out personalized book recommendations Read more about OpenAI’s GPT Store Has Left Some Developers in the Lurch[…]

Google’s AI enshittifies search summaries with ads

Google is rolling out ads in AI Overviews, which means you’ll now start seeing products in some of the search engine’s AI-generated summaries. Let’s say you’re searching for ways to get a grass stain out of your pants. If you ask Google, its AI-generated response will offer some tips, along with suggestions for products to Read more about Google’s AI enshittifies search summaries with ads[…]

Juicy licensing deals with AI companies show that publishers don’t really care about creators

One of the many interesting aspects of the current enthusiasm for generative AI is the way that it has electrified the formerly rather sleepy world of copyright. Where before publishers thought they had successfully locked down more or less everything digital with copyright, they now find themselves confronted with deep-pocketed companies – both established ones Read more about Juicy licensing deals with AI companies show that publishers don’t really care about creators[…]

EU, UK, US and more sign world’s first International treaty on AI – but the US makes sure it’s pretty much useless

The EU, UK, US, and Israel signed the world’s first treaty protection human rights in AI technology in a ceremony in Vilnius, Lithuania, on Thursday (5 September), but civil society groups say the text has been watered down. The Framework Convention on artificial intelligence and human rights, democracy, and the rule of law was adopted Read more about EU, UK, US and more sign world’s first International treaty on AI – but the US makes sure it’s pretty much useless[…]

PLAUD NotePin: A Wearable AI Memory Capsule that just might work

So this is a pin a bit larger than an AA battery which does one thing: it transcribes your musings and makes notes. Where does the AI come in? Speech and speaker recognition, audio trimming, summarisation and mind-maps. You see a lot of doubtful reviews on this thing out there, mostly on the basis of Read more about PLAUD NotePin: A Wearable AI Memory Capsule that just might work[…]

Google will let you search your Chrome browsing history by asking questions like a human – Firefox, you need this!

[…] you’ll be able to ask questions of your browsing history in natural language using Gemini, Google’s family of large language models that power its AI systems. You can type a question like “What was that ice cream shop I looked at last week?” into your address bar after accessing your history and Chrome will Read more about Google will let you search your Chrome browsing history by asking questions like a human – Firefox, you need this![…]