You Bought Gold & Silver for Privacy. Why Is Your Portfolio on Someone's Server?

By Justin · Published · Updated

A few months ago, I was adding my stack to one of those popular portfolio tracking apps. Inputting my holdings one by one. Gold Eagles, some junk silver, a few bars. And somewhere around the third or fourth entry, I got this uneasy feeling in my gut.

I stopped and looked up who actually owned this app. Turns out it was a foreign company I'd never heard of. And I'd just handed them a complete inventory of my precious metals holdings. What I own, how much, what I paid. Everything.

I've been stacking gold and silver for seven years. I got into it for the usual reasons: diversification, a hedge against uncertainty, the satisfaction of holding something real. But privacy was always part of the appeal too. Physical metals don't leave the same trail that brokerage accounts and ETFs do. That's a feature, not a bug.

So why was I uploading a detailed list of my stack to some server I didn't control, in a jurisdiction I couldn't even identify?

That question is what eventually led me to build MyOunces. But before I get into that, let's talk about why this matters.

We've All Gone a Little Numb

Another breach. Another "we take your privacy seriously" email. Another company that swore your data was safe until it wasn't.

These headlines have become so common that most of us barely register them anymore. Researchers call it privacy fatigue: that worn-out feeling that comes from years of data breaches and the near-impossibility of managing your digital footprint. You care, but you've stopped believing you can do anything about it.

The numbers are bleak. Around 82% of internet users say they're concerned about how their personal information gets collected and used. But only about a third feel like they're actually in control of their own data. That gap, between caring and feeling powerless, explains why most people just click "Accept" and move on.

I get it. I've done it too.

But there's a specific irony when it comes to precious metals. The whole point of physical gold and silver is that you control it. No counterparty risk. No reliance on someone else's systems. You hold it, you own it, end of story.

So handing a complete inventory of that stack to some app's database feels like a contradiction. You've gone out of your way to own something private, then you create a digital record of it on infrastructure you don't control.

Physical Metals Actually Are More Private

This isn't just a feeling. The IRS treats physical bullion differently than paper assets.

When you sell shares of a gold ETF, every transaction shows up on a 1099-B. There's a complete record. But physical gold and silver work differently. American Gold Eagles, Silver Eagles, and most common bullion products are exempt from dealer reporting requirements regardless of quantity. No government regulations require dealers to report your purchases.

One industry source puts it simply: physical gold transactions offer a layer of privacy that paper alternatives can't match.

The stacking community understands this instinctively. Discretion is part of the culture. You don't broadcast what you own or where you keep it. As one bullion dealer's guide notes, keeping your stack private is "rule number one."

That instinct is sound. Which makes it all the stranger that so many of us, myself included until recently, hand over detailed records to tracking apps without a second thought.

The Breaches Keep Coming

Maybe you're thinking this is paranoid. It's just a tracking app. What's the worst case?

Well, 2025 set a new record for data breaches in the US: 3,332 confirmed compromises, up 79% over five years according to the Identity Theft Resource Center. Financial services was the most targeted sector, with 739 breaches. The average cost of a US data breach hit $10.22 million.

[IMAGE 3 - Simple chart showing data breaches rising from 2020-2025, with 2025 marked as the record year. Source: ITRC. Dark theme.]

These aren't obscure companies getting hit. In January 2026, Betterment disclosed that 1.4 million accounts were exposed after an employee was tricked through social engineering. The attackers used Betterment's own infrastructure to send phishing emails to customers. This is a major robo-advisor with real security resources, and they still got caught.

A few years earlier, Block (the company behind Cash App) revealed that a former employee had downloaded reports containing brokerage data: names, account numbers, and for some customers, detailed portfolio and trading activity. The breach wasn't caught through monitoring. The employee just walked out with it.

Now think about what a precious metals portfolio tracker knows about you. Exactly what you own, how much, and what you paid. For someone who values discretion, that's a detailed inventory in the wrong hands. It's the answer to "who should we target?" sitting in a database you don't control.

What You're Actually Trusting

When your data lives on someone else's server, you're trusting more than you might realize.

You're trusting their security. Every company believes their defenses are solid until they're not. Third-party vendors, social engineering, misconfigurations, insider threats. The breach reports are full of companies that thought they had it covered.

You're trusting their employees. Even with good policies, people have access. The Block situation showed that a single person with legitimate credentials can walk out with customer portfolios.

You're trusting their business model won't change. Companies get acquired. Priorities shift. A startup that cared about privacy might get bought by someone who sees user data as an asset to monetize. (And as I discovered, you might not even know who owns the app you're using.)

You're trusting their jurisdiction. Data stored on servers is subject to legal process wherever those servers sit. Subpoenas happen.

You're trusting they'll stick around. Companies go bankrupt. When they do, databases can be sold to satisfy creditors.

That's a lot of trust for something you specifically bought to avoid trusting third parties.

A Different Way to Build It

When I started thinking about what a privacy-first tracker would actually look like, the answer wasn't better encryption or a stronger privacy policy. It was simpler than that: don't store the data in the first place.

MyOunces runs entirely in your browser. Your portfolio, your holdings, your purchase history, all of it stays in your browser's local storage. It never touches our servers. There's no account to create because there's no database to store your information in.

Our server exists for one purpose: fetching live spot prices from metals APIs. It acts as a relay so your browser doesn't need to expose API keys. But it never sees your portfolio. It couldn't, even if we wanted it to.

This approach has trade-offs, and I'll be honest about them. If you clear your browser data without exporting a backup first, your portfolio is gone. Syncing across devices isn't automatic; you export a file from one and import it on the other. You're responsible for your own backups, which means you actually have to do them.

But those trade-offs are the price of actual privacy. There's nothing to hack because there's no database of holdings. Nothing to subpoena because we don't have your data. Nothing to sell if the company changes hands.

You get live spot prices, melt value calculations, portfolio analytics, all the functionality you'd expect. You just don't have to trust me with an inventory of your wealth to use it.

Your Stack, Your Business

That SIIA survey I mentioned earlier found something that stuck with me: 67% of people believe they themselves are most responsible for maintaining their own data privacy. Not the government. Not tech companies. Themselves.

That tracks with why most of us got into precious metals in the first place. Self-reliance. Owning something real. Not depending on someone else's systems or promises.

The same principle applies to how you track those assets. You don't have to accept the trade-off that most apps force on you, where you hand over a complete inventory just to know what your stack is worth.

I'm going to keep building MyOunces and making it better, as long as I never break my privacy promise. No accounts. No server-side storage of your holdings. Your data stays yours.

If that sounds like what you've been looking for, give it a try. It's free to start, you can track up to 7 products with no email and no sign-up. See how it works before you commit to anything.

And if you want unlimited tracking, it's $79 one time. No subscription. You own it, just like you own your metals.

[Try MyOunces Free →]

Sources