• Skip to main content
  • Skip to secondary menu
  • Skip to footer

Market Analysis

Connecting the Dots, Quantifying Technology Trends & Measuring Disruption

  • AI Market Analyzer
  • Tech News
    • Project Dashboard
  • Domain Marketplace
  • Sponsored Post
  • About
  • Contact

RollupDB Keeps Five Years of Telemetry Statistics in 15 MB by Letting the Raw Events Go

September 23, 2026

Telemetry usually ends one of two ways. Either you keep every raw reading forever, and storage and query costs grow without end. Or you delete the old data and lose the history. Rolling it up yourself sounds like the middle way, until you hit the maths: an average of averages isn’t the average, and the p99 of sixty one-minute p99s isn’t the hour’s p99. Do it naively and the numbers quietly lie.

RollupDB is an aggregate database in one file. You send it numeric readings and declare the statistics you’ll need. It keeps those statistics in time buckets that get coarser as data ages, seconds to minutes to hours to days, and lets the raw events go. The history stays. The volume shrinks. And because it keeps the pieces that combine correctly, the totals and extremes stay right.

The Pitch in Four Numbers

  • 15.4 MB for five years of history from 2.8 million readings, against 207 MB as raw JSON lines.
  • +0.37% growth in file size when the same five years had twice as many readings.
  • Exact count, sum, min, max and mean after five years of rollups, checked against an outside reference.
  • 0 acknowledged writes lost in 15 runs that killed the process mid-write.

How It Works

Readings land in one-second buckets. As data ages, it’s folded into minute, hour and day buckets. Each bucket keeps count, sum, min, max, mean, variance state and a percentile sketch. Those are the mergeable pieces: add two buckets’ counts and sums and you get the right count and sum for both, which is exactly what naive rollups get wrong. You define the statistics for each stream up front, and you can change the definitions later.

Count, sum, min, max and mean are exact. Percentiles come from a KLL sketch, so they’re approximate, and every answer is labelled that way. Ask a question that needs detail the database no longer has, and RollupDB tells you so instead of guessing.

It ships as one binary with no server and no C compiler needed, plus a Go library and a small HTTP service on the same engine. Ask questions in JSON or read-only SQL. Rollups run on their own schedule. A write is acknowledged only once it’s on disk. It also takes Prometheus remote write, and a batch whose commit status is unknown after a dropped connection is counted once, not twice.

Who It’s For

  • IoT gateways recording sensor readings, like cold room temperatures, with extremes and percentiles, on small hardware.
  • API teams tracking latency and errors per endpoint across a whole year.
  • AI product teams tracking token use, cost and response time per model or feature.
  • Anyone with a time series where the questions are known in advance.

Limits

This is the trade, stated plainly. Once the raw events are gone, you can’t ask questions you didn’t declare. A breakdown by a field you didn’t keep can’t be rebuilt. If you need to dig through every raw event later, keep them somewhere else as well. Percentiles are approximate by design.

The Four-Question Screening

Every project featured here gets the same four questions, the way you’d screen a startup idea.

1. Where is the money in it?

RollupDB is open source under Apache 2.0, with no paid tier. Observability and telemetry storage is a large market where customers mostly pay by volume, and volume is exactly what RollupDB cuts. The paid paths are a hosted long-term store that sits behind existing monitoring, with Prometheus remote write as the on-ramp; an edge edition for device makers who need years of statistics on a gateway; and support for companies that embed it. A tool that turns 207 MB into 15 MB has an easy story to sell.

2. What real problem does it solve?

Long-term statistics that are either too expensive to keep or wrong. Keeping everything costs a fortune. Deleting loses history. Rolling up by hand produces averages of averages that look fine and aren’t. RollupDB keeps the right pieces so the answers stay correct as the detail fades.

3. The technology in plain words

Think of a weather diary. For today you note every reading. For last month you just keep each day’s high, low, average and how many readings there were. For last year, each week’s. You can still say exactly how many readings you took, the hottest day and the overall average, years later, from a diary that fits in a pocket.

4. Moat and differentiation

Time-series databases store raw points and add downsampling as a feature. RollupDB starts from the other end: it stores only declared statistics, combines them correctly and says plainly what it can no longer answer. In one file, with no server. The exact-totals guarantee, checked against an outside reference after five years of rollups, is the proof point. The moat that can grow is that guarantee plus a footprint small enough for edge hardware, a spot big time-series databases don’t target.

Why It Matters

Most telemetry is kept to answer a handful of known questions. Storing every raw event to answer them is waste. A database that keeps only what you’ll ask, and keeps it right, makes long history cheap.

Follow the Project

Read what an aggregate database keeps when the raw events are gone, start with the quick start, see how it was tested, or get the code from the RollupDB repository on GitHub. RollupDB is listed with the other open-source projects on SoftDevStudio.com, and more featured projects are in the Projects section.

Filed Under: Projects Tagged With: cloud computing, enterprise software, startups and funding

Footer

Recent Posts

  • China Turns AI Model Distillation Into Industrial Policy and Weakens the Reach of US Chip Controls
  • AI-Found Software Flaws and the Rush to Patch Them Are Now a Market Risk After a Week of US Outages
  • Ohio Voters Put $17 Billion of Amazon Data Center Spending at Risk as Local Bans Spread
  • US Remote Access Chip Rule and FCC Optics Ban Squeeze Southeast Asia Data Centers and Nvidia China Exposure
  • Microsoft Puts Word, Excel and PowerPoint Inside Copilot and Turns Office Into an AI Front Door
  • OpenAI Cuts GPT-6.2 Astra Prices 20% as Microsoft MAI Code 2 Undercuts Frontier Coding Models
  • Tencent Q3 Shows New AI Products Cost About RMB15 Billion in Operating Profit as Capex Hits 39% of Revenue
  • Anthropic IPO Heads for the Top of Its Range as $900 Billion in Compute Commitments Go Public
  • Nvidia Q3 Revenue Hits $115.8 Billion but the Q4 Margin Guide Drops Three Points as the Board Rules Out Jensen Huang
  • Emboldened Iran and a Weakened Trump Leave US Stocks, Bonds and Oil Pricing a Peace That Has Not Arrived

RSS feed: Market Research Media Market Research Media

  • Four Vendor Surveys on Missed AI Returns Each Find the Problem Their Sponsor Sells a Fix For
  • Wasabi Study Puts Unplanned Infrastructure Spending at $63.4 Billion, With Germany Overspending by 7.1 Billion Euros
  • CSC Survey Finds 88% of Private Capital GPs Spend Up to Half Their Finance Time Checking Administrator Work
  • Lenovo Survey Finds 80% of IT Leaders Tie AI Success to the Digital Workplace and Only 10% Have Redesigned It
  • Claude and ChatGPT Integrations Killed the Headless CMS Market
  • Survey Margin of Error Explained, What Plus or Minus 3 Points Covers and What It Leaves Out
  • Morgan Stanley Pulse Survey Finds Bearish Investor Sentiment Rising to 42 Percent as Inflation Fears Grow
  • A Stronger Week Across the Network, October 4–10, 2026
  • The Tariff Map Is Becoming an Industrial Policy Map—and the U.S. Economy Is Paying the Price
  • PC Shipments Fall 22.4% as Higher Component Costs Price Buyers Out

Media Partners

  • Analysis
  • Technology Conferences
  • OSINT
  • Defense Market
  • Cybersecurity Market
  • Event Calendar
  • Calendarial
  • Opinion
  • 3V
  • Media Presser
  • Exclusive Domains

Copyright © 2026 MarketAnalysis.com | Terms of Service | Privacy Policy | Supplier Disclaimer | The Website Coded and Designed by SoftDev Studio

Media Partners: Technologies | Photography | Referently

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Do not sell my personal information.
Cookie SettingsAccept
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
CookieDurationDescription
cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
SAVE & ACCEPT