Post

Chrome looks set to ship an LLM Prompt API to the web platform. At Mozilla, we oppose this API. We feel it has a large interoperability risk, and Google imposing T&Cs on a web API sets a dangerous precedent. Full details: github.com/mozilla/stan...

github.comPrompt API · Issue #1213 · mozilla/standards-positionsSpecification title Prompt API Specification or proposal URL (if available) No response Explainer URL (if available) https://github.com/webmachinelearning/prompt-api/blob/main/README.md Proposal au...

98 reposts396 likes

I'm sorry but no one can have any models is not ok! > This will result in Mozilla and Apple having to licence Google's model, or ship a model that's quirks-compatible with the Google model This feels way way way over the top madcap absurd.

We need to do something & you are demanding an unattainable perfection that can never be met. The FUD against doing anything cannot be allowed to obstruct. These claims are far too pearl clutching. Quirks are not going to be radically confounding like you project.

Exactly what I was going to say. LLMs are just one more service you might want to call. And just like any external service, you need exercise extreme caution in what you let it do to your JavaScript and DOM.

The difference here between fetch and the prompt API is that the Prompt API is running client side with a pre-fetched model. Big difference.

Just had a small realization. The API is really not just the JS code for calling the LLM, the LLM itself is a very stringly typed API that's embedded in it. And when phrasing it like that, this reminds me of WebSQL. I remember reading it could have ended up just being a de facto SQLite wrapper API.

1. "Calcifying around a single model". Make it pluggable like search. 2. "To use the prompt API you must acknowledge Google's Generative AI Prohibited Uses Policy.". Yeah that's very bad. 3. "Overstated web developer position". Come on. Let's not create another iPhone moment for the web.

I'm curious what do you mean around point 3? I think it's good to point out that the bar for what some consider (or pretend to consider) as strong support, differs *a lot*. The issue with making the model pluggable is that sites might still design around a specific model that then can't be swapped

Seems to me a lot of this is solved if somehow the developer can plug the model in a standard way. Use what the browser provides, or plug your own. Unsure what that would actually look like though.

In the chart above every line apart from AI requires the purchase of hardware to make it work. Getting electricity to your house ⚖️ Visit openai dot com Not saying AI adoption isn't strong, just that the comparisons here are apples and oranges.

Way more complex than pasting an url We are here at the level of adjusting your interactions with your closest colleague when replaced by a new one. It even impact your way of working whatever change you do to the prompt. There will be normal and natural reluctancies to update/upgrade/switch

I was at Mozilla when the iPhone launched. Seemed obviously disruptive, but all I heard was "too expensive", "doesn't have a keyboard", "show good evidence for claims like this". But evidence is always backwards-looking. We missed the train, then spent a decade and a half trying to catch up to apps.

I was at Mozilla when exactly zero web developers believed origin trials were anything other than new APIs they should expect to exist and demand from every vendor- they simply don't work for reversible experimentation. Lots of other ways to use models in web pages today! source: every website

The iPhone was a competitor to browsers. What is the competitor that is going to leave browsers behind if they don't jump on this now?

I.e. @jakearchibald.com I've already admitted you were right and I was wrong in one case (view transitions vs. portals / high-vs-low level web APIs). Will this be one where we even the score or will you double your money? 🙂

One thing I've struggled to get an answer for: Is Google serving the same Prompt API model to e.g. users in China Vs UK? I'm wondering if the user's location is leaked due to restrictions in what the model can and cannot say about things like Tiananmen Square.

No, it's forcing humans to take responsibility for their contributions, regardless of _any_ tooling that was used in producing that contribution. We don't let autocomplete or linters sign commits, and that doesn't change with AI.

Some great points by @jakearchibald.com. LLMs are threatening to reverse the neutral nature of the web. Decentralization is one of the key strengths of the web. In addition, system prompts getting coupled with the model you're using is a leaky abstraction and can make it a poor user experience.

As positioned, yeah this is a bad API and should be totally blocked. But I do see value in a standard method of promoting an LLM in the browser. I should be able to select the model regardless of browser like a font. I’m simply provided a standard loader and prompt/stream methods.

Just curious: do you have a counter proposal (even if the counter proposal is "do nothing")? Something that you think would work better?