• Skip to main content
  • Skip to secondary menu
  • Skip to footer

Technologies.org

Technology Trends: Follow the Money

  • Technology Events 2026-2027
  • Sponsored Post
  • Technology Markets
  • About
    • GDPR
  • Contact

Why Small Embedded Databases Are Winning the Edge

October 27, 2026 By admin

For twenty years the default answer to “where does the data live?” was a database server somewhere else. You opened a connection, sent a query over the network, and waited. That model still runs most of the world’s business software. But at the edge, on phones, in sensors, inside a browser tab or a serverless function a few milliseconds from the user, the answer is shifting. The data lives in a file, and the database is a library linked into the program that reads it.

SQLite has worked this way since 2000, and it never stopped shipping. Version 3.54.1 came out on October 16, 2026. DuckDB, the analytical cousin, shipped its 2.0.0 LTS release on October 21, built from close to 20,000 commits since 1.5. Turso is rewriting SQLite in Rust with concurrent writes. Cloudflare gives every SQLite-backed Durable Object its own database and builds D1 on the same foundation. The small, in-process database has gone from embedded curiosity to the storage layer people pick on purpose.

Why? Mostly physics.

The network hop is the expensive part

A query against a local SQLite file is a function call. Reading a row by key takes microseconds. The same read against a managed Postgres instance in another region goes through a TCP connection, TLS, a connection pool and a round trip that can easily cost 50 to 100 milliseconds. On a web page that fires a dozen queries, that gap is the difference between instant and sluggish.

Edge platforms make the problem worse before they make it better. If your code runs in 300 cities and your database sits in one, every request still crosses an ocean to get its data. Moving compute to the edge without moving data with it just relocates the wait. Cloudflare’s answer was to put the database next to the code. A SQLite-backed Durable Object keeps its own private database of up to 10 GB on the Workers Paid plan, stored on the same machine that runs the object, so reads are local disk reads. D1, Cloudflare’s managed SQLite service, caps each database at 10 GB as well, allows up to 50,000 databases per paid account, and now supports read replicas, each one its own Durable Object.

That cap tells you the design philosophy. Nobody is trying to build one giant database. The bet is on many small ones: a database per customer, per document, per chat room, per device. That pattern fits a single-file engine perfectly and fits a big shared server badly.

Offline first, sync later

The second reason is that the edge is often disconnected. A delivery driver’s phone loses signal in a parking garage. A soil sensor on a farm talks to its gateway twice a day. A factory line keeps running when the plant’s uplink goes down. Software in these places has to accept writes locally and reconcile them later, and an embedded database is the obvious place to keep them.

This is where most of the interesting work is happening. Turso has offline sync in beta, with local writes pushed to the cloud and remote changes pulled down when the connection returns. In August 2026 it opened an early preview of concurrent writes on Turso Cloud, using BEGIN CONCURRENT and an MVCC design adapted from Microsoft’s Hekaton, so writers that touch different rows don’t queue behind one lock. The open-source Turso engine, a ground-up Rust rewrite of SQLite, had shipped MVCC a couple of months before that.

The browser joined the party too. SQLite has an official WebAssembly build that can persist to the Origin Private File System, and DuckDB runs in WASM as well. A web app can carry a real SQL engine and query megabytes of local data without a server round trip at all. For dashboards, note-taking apps and anything that has to work on a train, that changes the architecture.

Size matters too, at the far end of the edge. A microcontroller with a few hundred kilobytes of flash can’t host Postgres. It can host a key-value store. LMDB, a memory-mapped B-tree from the OpenLDAP project, has been the quiet workhorse here for years: tiny and crash-safe by design, with very fast reads. RocksDB, Meta’s log-structured store, sits at the other end of the scale, embedded inside larger systems that need heavy write throughput. Both prove the same point. You don’t need a server process to get durable, transactional storage. You need a good file format and careful code around fsync.

DuckDB pushes the in-process idea into analytics. It reads Parquet and CSV directly, runs columnar queries on a laptop that once needed a warehouse, and in 2.0 added asynchronous I/O for remote and object-storage reads. It also polished Quack, its client-server protocol, which is a tell. Even the in-process champions are adding a server mode for the cases where one process isn’t enough.

The honest trade-offs

None of this makes the embedded database a universal answer, and pretending otherwise burns teams.

Concurrency is the first limit. SQLite in WAL mode lets many readers run alongside one writer. One. If your workload has many processes writing at once, they queue, and under load they time out. Turso’s MVCC work exists precisely because this is the most common complaint. It’s promising; it is also new.

Write scaling is the second. A single file on a single machine scales up, not out. Cloudflare’s 10 GB ceiling per database is a hard limit, and the documentation says it can’t be raised. The answer is sharding by design (one database per tenant), which is elegant when your data splits cleanly and painful when it doesn’t. Cross-tenant reporting means pulling data somewhere else.

Replication is the third, and the hardest. Read replicas are easy to bolt on. Multi-writer sync is not. Two devices editing the same record offline will conflict, and someone has to decide who wins: last-writer-wins, CRDTs, or application logic. Turso’s own offline sync beta shipped conflict detection before conflict resolution, which is a candid sign of how hard this is. Anyone selling painless offline sync for arbitrary SQL is skipping a chapter.

And there’s operations. A server database gives you one place to back up, monitor and patch. Ten thousand embedded databases spread across devices give you ten thousand places. The tooling is getting better, but it is still younger than the Postgres ecosystem by decades.

A few small projects worth watching

The space is wide open for smaller engines that pick one hard problem and work on it. Three open-source projects take different cuts at it.

AltSql targets IoT. It puts key-value access and SQL on the same records from a microcontroller to a gateway, with the device side at about 15 KB. It’s in alpha, tested in simulation, including 400,000 simulated power cuts without losing saved data, and compiled for a Cortex-M4 but not yet run on real chips. We covered its device-to-gateway sync idea in more detail here.

KvSQL is a Rust engine with no dependencies beyond the standard library. Key lookups read rows straight from the B-tree, SQL queries read the same rows, and both share one file and one transaction. It ships as an embedded engine plus a small HTTP server, kvsqld. Version 0.1.0 came out on October 22, so it’s early.

HyperCrux goes for breadth: SQL, key-value, graph links and vector search over the same records in one SQLite file, embedded in Go or run as a single binary. It’s at version 0.2 under Apache 2.0, with a pure Go beta engine in pre-release.

All three are young, and their benchmarks are self-reported. They’re interesting because they share the instinct driving the bigger names: keep the data next to the code, in one file, and make the different ways of reading it agree.

That instinct is winning the edge. The server isn’t going away. It’s just no longer the first place the data goes.

Filed Under: News Tagged With: Cloudflare, DuckDB, Edge Computing, Embedded Databases, SQLite, ioT

Footer

Recent Posts

  • LangChain Raises $300 Million at a $3 Billion Valuation to Build Out LangSmith Agent Platform
  • OQFT Shows Where the Quantum Fourier Transform Can Get Shallower
  • MemryX MX3+ Targets 1 POPS for Edge AI as Tianji Shows a 21-Joint Robot Hand at CoRL and Appear Starts Solid-State Battery Pre-Production
  • Adobe MAX 2026 Opens Photoshop and Premiere to Outside AI Agents and Deepens Its Google Partnership
  • Zendesk Launches Outcome AI Platform and Drops Seat Limits From New Plans
  • Otto One Is a $599 Screenless Computer Built for an AI Agent to Live On
  • PuppyGraph Raises $10 Million Series A to Let AI Agents Query Thousands of Tables as a Graph
  • Lumbra Raises $25 Million to Take AI Agents From Top-Secret Networks to Regulated Industries
  • Graphon Labs Raises $35 Million Series A to Give AI Agents Memory That Persists
  • Bay Exits Stealth With $50 Million to Check Every AI Agent Action Before It Runs

Media Partners

  • Market Analysis
  • BareProxy.com
  • App Coding
AI Market Analyzer Rises to 33.5 Cooling as CoreWeave Lifts Breadth and the Nvidia CEO Crisis Looms
AI Market Analyzer Slips to 30.4 Cooling as Chips Crash and Leveraged Bulls Keep Buying
Netlist (NLST) Revenue Jumps 149 Percent on Samsung License Cash as Silicon Labs (SLAB) Grows 22 Percent and QuickLogic (QUIK) Doubles
Omdia Says AI Software Revenue Will Top 200 Billion Dollars in 2026 as Generative AI Grows 139 Percent
Dell (DELL) Reports November 24 With a 95 Billion Dollar AI Backlog to Turn Into Cash as Supermicro (SMCI) Takes Its Record Quarter on the Road
CoreWeave (CRWV) Grows Revenue 168% to 3.66 Billion Dollars and Lifts Its Backlog to 132.5 Billion as the Neocloud Selloff Meets Real Numbers
Marvell vs Lumentum, Which AI Infrastructure Stock Is the Better Investment?
Lucid Grows Revenue 4% While the US EV Market Shrinks 41% and Adds 1.75 Billion Dollars of Saudi-Backed Credit to Reach Its Midsize Car
Entegris (ENTG) Targets 15 Percent Annual Growth and Onto Innovation (ONTO) Posts a Record Quarter as Chipmakers Struggle to Measure AI Returns
SovAI Joins NVIDIA Inception With Two Grid-Connected AI Factory Sites Built to the DSX Reference Design
BareProxy Adds AI Crawler Control That Tells Real GPTBot and ClaudeBot Requests From Fakes
BareProxy Adds Bot Challenges That Make Scrapers Posing as Browsers Solve a Puzzle First
BareProxy Adds Cookie Consent That Holds Back Tracking Cookies Until a Visitor Says Yes
BareProxy Adds Markdown Serving That Turns Markdown Files Into Web Pages With No Build Step
BareProxy Ships Its First Nine Plugins, From Maintenance Pages and CORS to Geo Rules and Rate Limits
BareProxy 0.2.0 Runs WebAssembly Plugins Through the Proxy-Wasm Interface
BareProxy 0.3.0 Writes Its Plugins in Rust, Where a Plugin Adds 15 Microseconds Instead of 42
BareProxy Is an Operating System for Web Traffic: A Small Core and a Long Stream of Plugins
BareProxy Plugins Go WebAssembly, Starting With RenderCache and AI Crawler Control
BareProxy Runs on Linux, macOS and Windows, and One Plugin File Runs on All of Them
Testing Optimistic Quantum Fourier Transform Circuits With OQFT and Qiskit
Bluehost AI Builder Turns a Prompt Into a Website or a Booking App and Takes the AI App Builder Fight to Hosting Customers
Claude Code on GitLab vs GitHub: Thinner Integration and a Fifth of the Free CI Minutes
How k4i.com Publishes Posts Unattended With Small AI Models, Groq and GitHub Actions
How to Ship In-Browser AI Apps With No Server and No Inference Bill
Microsoft Authenticator Android Flaw Shows Why Apps Must Verify Who Is Calling Them
Zero-Budget AI Apps Work Best as Self-Feeding Sites, Not Open Tools
A Useful Software Primitive Should Be Easy to Explain and Hard to Replace
Apple's US Link-Out Fee Is Zero Until a Judge Sets It, and Apple Is Asking for Up to 15%
20 Primitive Project Ideas: Tiny Go Engines That Do the Essential 10% of Redis, Kafka and Etcd

Media Partners

  • AltSql.com
  • Technology Conferences
  • API Coding
AltSql Is a Native Hybrid of Key-Value and SQL, From the Sensor to the Gateway
AltSql Core and AltSql DB Are Now Open Source Under the Apache License 2.0
Introduction
AltSql DB 0.3 Adds Secondary Indexes and Statement Savepoints: A Lookup on a Million Rows Ran 198 Times Faster Than a Full Scan
How It Works
AltSql DB 0.2: SQL and Direct Calls Wrote Byte-Identical Files Over 100,000 Random Steps
AltSql DB Keeps a Whole Fleet in One File and Reads by Key 5 Times Faster Than SQLite Through SQL
AltSql Core and Six Prototypes Built Around It
AltSql Ask Puts One SQL Question to 500 Simulated Machines and Brings Back Only the Answers
Machine Monitoring Case Study: Overheat Alarm Handled on the Sensor While Wi-Fi Was Down
Why People Still Attend Technology Conferences, and What Organizers Must Remember
SC26 Supercomputing 2026, November 15-20, McCormick Place, Chicago
MWC Doha 2027, November 15–17, Doha, Qatar
A3 Business Forum 2027, January 18-20, Signia by Hilton Orlando Bonnet Creek, Orlando
IAMPHENOM 2027, April 20-22, Pennsylvania Convention Center, Philadelphia
Channel Partners Conference and Expo 2027, March 15-18, The Venetian, Las Vegas
Fintech NerdCon 2026, November 18-20, San Diego Convention Center, San Diego
HLTH 2026, November 15-18, The Venetian Expo, Las Vegas
electronica 2026, November 10-13, Messe München, Munich
KIOXIA Forum 2026, November 26, TODA Hall and Conference Tokyo, Tokyo
RFC 9457 Problem Details Gives API Errors One Shape Instead of Fifty Ad Hoc JSON Bodies
Idempotency Keys: How One Header Stops a Retry From Charging a Customer Twice
A Tiny ETL Binary Competes With curl, jq and SQLite in a Cron Job, So Build It That Small
An AI Agent Flight Recorder Belongs in One Portable File, the Way HAR Did It for HTTP
Benchmarking MCP Servers and Stateful API Workflows: Latency, Throughput and Tokens per Call
Diagnose a Slow API From One Request: DNS, Connect, TLS, Server Wait and Transfer
Finding API Endpoints, Tables and Flags Nobody Uses Takes Code and Traffic Together
Fuzzing MCP Servers: Generate Bad Arguments From the Tool Schema and Watch What Breaks
Give Any API a History: Poll It, Hash It and Query Old Versions With SQL
Infer Your API's Real Contract From Traffic, Then Diff It Against the Docs

Copyright © 2026 Technologies.org

Media Partners: Market Analysis · Market Research · Referently · Photography