An unending array of jailbreaking attacks could be be the death of LLMs

A couple days ago I reported a survey saying that most IT professional are worried about the security of LLMs. They have every right to be. There seems to be an endless number of ways of attacking them. In my forthcoming book, Taming Silicon Valley, I describe two examples. The f … | Continue reading


@garymarcus.substack.com | 9 months ago

Sneak preview of GPT-5!

Mind blown. | Continue reading


@garymarcus.substack.com | 9 months ago

When Will the GenAI Bubble Burst?

Why and how it could happen in the next 12 months. | Continue reading


@garymarcus.substack.com | 9 months ago

The Second Worst $100B Investment in The History of AI?

By any reasonable account the worst investment in the history of AI has to be the over $100 billion that have been invested in “driverless” cars. There may be a payoff someday, but thus far there has not been a lot. By many accounts Waymo rides are still a net loss on a per ride … | Continue reading


@garymarcus.substack.com | 9 months ago

The race between positive and negative applications of Generative AI is on – and not looking pretty

It’s not every day that I say this, but OpenAI got something exactly right yesterday, at a meeting at Columbia: OpenAI’s VP of Global Affairs Anna Makanju is exactly right - the race is on. I have some concerns, partly about the way that race is going, partly about (in)justice in … | Continue reading


@garymarcus.substack.com | 9 months ago

Happy 1st Birthday, GPT-4

Ten birthday observations | Continue reading


@garymarcus.substack.com | 9 months ago

The exponential enshittification of science

“Certainly, here is a list of” scientific garbage that may have been partially written by a factually-challenged bot | Continue reading


@garymarcus.substack.com | 9 months ago

OpenAI’s Lies and Half-Truths

Not every thing the company says is completely candid. | Continue reading


@garymarcus.substack.com | 9 months ago

The Year of the Big-Balled Rat

Science is in for a rough ride | Continue reading


@garymarcus.substack.com | 9 months ago

The ROI on GenAI might not be so great, after all

Anyone remember this piece? We are starting to see some signs in that direction. The WSJ recently reported that Microsoft Copilot was perhaps underwhelming some customers. Today Stephanie Palazzolo The Information asked: A longer story there (that she pointed to in the above)) wa … | Continue reading


@garymarcus.substack.com | 9 months ago

Two years later, deep learning is still faced with the same fundamental challenges

Report card on an infamous paper. | Continue reading


@garymarcus.substack.com | 10 months ago

OpenAI’s “Own Goal”

And why it is becoming increasingly difficult to take them at their word | Continue reading


@garymarcus.substack.com | 10 months ago

Covert racism in LLMs

Shocking new paper with potentially serious implications | Continue reading


@garymarcus.substack.com | 10 months ago

The Irony and the Agony of Elon Musk's Lawsuit against OpenAI

Agony first. The agony starts with the fact that Elon Musk has a point; OpenAI, Altman and Brockman *have* changed their mission since he gave them his money, his time and his reputation. Here's what they told that State of the California in 2015: THIRD: This Corporation shall be … | Continue reading


@garymarcus.substack.com | 10 months ago

No, Sora has not “learned physics”

Some subtleties that eluded the All-In podcast | Continue reading


@garymarcus.substack.com | 10 months ago

Elon Musk sues OpenAI

Third lawsuit this week | Continue reading


@garymarcus.substack.com | 10 months ago

Serious medical error from Perplexity’s chatbot

The dangers of generative pastische | Continue reading


@garymarcus.substack.com | 10 months ago

The last two weeks at OpenAI

A few weeks ago, I wrote an essay on ten of the challenges I expected OpenAI to face this year. Things just got worse. Here’s some of what’s happened in the last two weeks. 👉 Sora demo blows minds but fails basic physics and biology 👉 One of OpenAIR … | Continue reading


@garymarcus.substack.com | 10 months ago

No, RAG is probably not going to rescue the current situation

The thing about promises is that in Silicon Valley, accountability rarely shows up. Investors put in over $100 billion into the driverless car industry, and so far have little to show far it. Endless promises (and empty predictions) were made at essentially no cost to those who m … | Continue reading


@garymarcus.substack.com | 10 months ago

Belief in magic may be declining

No time to write today, but here is a fascinating graph, hat tip to Jeffrey Funk: Maybe, and I am just spitballing, LLMs aren’t quite the magic panacea that the industry lead us all to believe? See also this report February 13 at WSJ and this one, February 16 | Continue reading


@garymarcus.substack.com | 10 months ago

Has Google gone too woke? Why even the biggest models still struggle with guardrails

And why it is unlikely to get much better anytime soon | Continue reading


@garymarcus.substack.com | 10 months ago

ChatGPT has gone berserk

Not a joke | Continue reading


@garymarcus.substack.com | 10 months ago

Absolutely amazing ant video augurs intellectual mayhem

Oh, Sexy Sora, what have you done? | Continue reading


@garymarcus.substack.com | 10 months ago

Sora Can’t Handle the Truth

Monkey see, monkey confabulate | Continue reading


@garymarcus.substack.com | 10 months ago

Death of a Chatbot, body blow to an industry

What happens to chatbots if they people who use them for customer service are held responsible for the things those bots say? | Continue reading


@garymarcus.substack.com | 10 months ago

Sora’s Surreal Physics

Some thoughts on what it all means for AGI | Continue reading


@garymarcus.substack.com | 10 months ago

The hottest new programming language is English! Or maybe not.

Programming in English might not be all its cracked up to be. | Continue reading


@garymarcus.substack.com | 10 months ago

Statistics versus Understanding: The Essence of What Ails Generative AI

The Foundation Remains Shaky | Continue reading


@garymarcus.substack.com | 10 months ago

Horse rides Astronaut, redux

Dall-E 3 and Gemini have something in common with DALL-E 2 | Continue reading


@garymarcus.substack.com | 10 months ago

An Open Letter to Sam Altman

Your post on X this morning raises many questions | Continue reading


@garymarcus.substack.com | 10 months ago

Seven reasons why the world should say No to Sam Altman

The costs of extravagance | Continue reading


@garymarcus.substack.com | 11 months ago

What Could Possibly Go Wrong with Sam Altman’s New Ambitions?

A lot | Continue reading


@garymarcus.substack.com | 11 months ago

There Must be Some Misunderstanding

There must be some misunderstanding There must be some kind of mistake – Phil Collins / Genesis Great example last night from Denis O. on LinkedIn, that connects with pretty much everything have been writing about, from elephants on beaches to the lack of understanding in l … | Continue reading


@garymarcus.substack.com | 11 months ago

Further Trouble in Hinton City

More on storage and the shallow understanding of Generative AI | Continue reading


@garymarcus.substack.com | 11 months ago

Could GPT-5 revolutionize military strategy?

Sam Altman is a fantastic strategic thinker. Satya Nadella is a fantastic strategic thinker. Demis Hassabis is one of the greatest all-around games players of all time. ChatGPT, not so much. It’s notorious for making illegal moves in chess. How about something easier? | Continue reading


@garymarcus.substack.com | 11 months ago

Deconstructing Geoffrey Hinton’s weakest argument

Hinton’s “savage” but misguided attack on Marcus, analyzed | Continue reading


@garymarcus.substack.com | 11 months ago

When looked at carefully, OpenAI’s new study on GPT-4 and bioweapons is deeply worrisome

Why you should be worried | Continue reading


@garymarcus.substack.com | 11 months ago

Deepfaked Shit is Getting Real

An entire cast of deepfaked people—include a deepfaked CFO—scammed a company out $25 million. | Continue reading


@garymarcus.substack.com | 11 months ago

Google Bard: fast, gorgeous, and out of control

Copyright infringement, anyone? | Continue reading


@garymarcus.substack.com | 11 months ago

One GenAI image; Ten Errors

See if you can spot them all. | Continue reading


@garymarcus.substack.com | 11 months ago

OpenAI’s Got 9.9 Problems, and Twitch Ain’t One

The AI darling faces a long list of serious challenges in 2024 | Continue reading


@garymarcus.substack.com | 11 months ago

Where’s Waldo? The Elephant in the Room

And how things could quickly get ugly in the real world | Continue reading


@garymarcus.substack.com | 11 months ago

No, multimodal ChatGPT is not going to “trivially” solve Generative AI's copyright problems

The usually on-target AI Snake Oil got this one wrong; a lot of money is at stake | Continue reading


@garymarcus.substack.com | 11 months ago

Could OpenAI’s nonprofit be forced to dissolve?

Big news today, via Stephanie Palazzolo at The Information: the group Public Citizen yesterday petitioned the state California to reevaluate OpenAI’s nonprofit status. As Robert Weissman, the President of Public Citizen put it to me on a phone call, the OpenAI drama seemed … | Continue reading


@garymarcus.substack.com | 12 months ago

DALL-E’s New Guardrails: Fast, Furious, and Far from Airtight

If we had to guess, line that’s going to live in infamy from yesterday’s OpenAI announcement, a reply to the New York Times lawsuit, is probably the one that says “Regurgitation” is a rare bug that we are working to drive to zero”. Our view? Good luc … | Continue reading


@garymarcus.substack.com | 12 months ago

The desperate race to save Generative AI

Copyright infringement issues could sink their business, but why should they have to pay licensing fees like everybody else? | Continue reading


@garymarcus.substack.com | 12 months ago

The potential GenAI copyright infringement plot thickens

Reid Southen and I continued our experiments, and wrote a long paper about what we found, and why they may pose serious problems both for users and developers that are difficult to fix. You can find it here: https://spectrum.ieee.org/midjourney-copyright | Continue reading


@garymarcus.substack.com | 1 year ago

Things are about to get a lot worse for Generative AI

A full of spectrum of infringment | Continue reading


@garymarcus.substack.com | 1 year ago