MORE POSTS
April 18, 2024 8:58 PM
Meta Llama 3 available on Cloudflare Workers AI
We are thrilled to give developers around the world the ability to build AI applications with Meta Llama 3 using Workers AI. We are proud to be a launch partner with Meta for their newest 8B Llama 3 model...
April 02, 2024 1:01 PM
Leveling up Workers AI: general availability and more new capabilities
Today, we’re excited to make a series of announcements, including Workers AI, Cloudflare’s inference platform becoming GA and support for fine-tuned models with LoRAs and one-click deploys from HuggingFace. Cloudflare Workers now supports the Python programming language, and more...
April 02, 2024 1:00 PM
Running fine-tuned models on Workers AI with LoRAs
Workers AI now supports fine-tuned models using LoRAs. But what is a LoRA and how does it work? In this post, we dive into fine-tuning, LoRAs and even some math to share the details of how it all works under the hood...
March 14, 2024 12:30 PM
Mitigating a token-length side-channel attack in our AI products
The Workers AI and AI Gateway team recently collaborated closely with security researchers at Ben Gurion University regarding a report submitted through our Public Bug Bounty program. Through this process, we discovered and fully patched a vulnerability affecting all LLM provider...
March 04, 2024 2:00 PM
Cloudflare launches AI Assistant for Security Analytics
Introducing AI Assistant for Security Analytics. Now it is easier than ever to get powerful insights about your web security. Use the new integrated natural language query interface to explore Security Analytics...
February 28, 2024 8:00 PM
Unlocking new use cases with 17 new models in Workers AI, including new LLMs, image generation models, and more
On February 6th, 2024 we announced eight new models that we added to our catalog for text generation, classification, and code generation use cases. Today, we’re back with seventeen (17!) more models, focused on enabling new types of tasks and use cases with Workers AI...
February 06, 2024 8:00 PM
Adding new LLMs, text classification and code generation models to the Workers AI catalog
Workers AI is now bigger and better with 8 new models and improved model performance...
December 06, 2023 2:00 PM
How we used OpenBMC to support AI inference on GPUs around the world
This is what Cloudflare has been able to do so far with OpenBMC with respect to our GPU-equipped servers...
November 23, 2023 2:00 PM
Workers AI Update: Stable Diffusion, Code Llama + Workers AI in 100 cities
We're thrilled to announce that Stable Diffusion and Code Llama are now available as part of Workers AI, running in over 100 cities across Cloudflare’s global network....
November 21, 2023 2:00 PM
Workers AI Update: Hello, Mistral 7B!
Today we’re excited to announce that we’ve added the Mistral-7B-v0.1-instruct to Workers AI...
November 14, 2023 2:00 PM
Streaming and longer context lengths for LLMs on Workers AI
Workers AI now supports streaming text responses for the LLM models in our catalog, including Llama-2, using server-sent events...
September 27, 2023 1:00 PM
Writing poems using LLama 2 on Workers AI
Matthew and Michelle, co-founders of Cloudflare, published their annual founders’ letter today. The letter ends with a poem written by an AI running using Workers AI on Cloudflare’s global network.
Here’s the code that wrote the poem...