en.osm.town is one of the many independent Mastodon servers you can use to participate in the fediverse.
An independent, community of OpenStreetMap people on the Fediverse/Mastodon. Funding graciously provided by the OpenStreetMap Foundation.

Server stats:

256
active users

#differentialprivacy

0 posts0 participants0 posts today

"To prevent AI models from memorizing their input, we know exactly one robust method: differential privacy (DP). But crucially, DP requires you to precisely define what you want to protect. For example, to protect individual people, you must know which piece of data comes from which person in your dataset. If you have a dataset with identifiers, that's easy. If you want to use a humongous pile of data crawled from the open Web, that's not just hard: that's fundamentally impossible.

In practice, this means that for massive AI models, you can't really protect the massive pile of training data. This probably doesn't matter to you: chances are, you can't afford to train one from scratch anyway. But you may want to use sensitive data to fine-tune them, so they can perform better on some task. There, you may be able to use DP to mitigate the memorization risks on your sensitive data.

This still requires you to be OK with the inherent risk of the off-the-shelf LLMs, whose privacy and compliance story boils down to "everyone else is doing it, so it's probably fine?".

To avoid this last problem, and get robust protection, and probably get better results… Why not train a reasonably-sized model entirely on data that you fully understand instead?"

desfontain.es/blog/privacy-in-

desfontain.esFive things privacy experts know about AI - Ted is writing things… and that AI salespeople don't want you to know!

Datenschutzbedenken bei neuer Foto-Suche
Apple hat in iOS 18, iPadOS 18 und macOS Sequoia neue Funktionen für die Fotos-App eingeführt, die von vielen Nutzer:innen kritisch betrachtet werden. Die „Erweiterte visuelle Suche“, eine KI-gestützte Funktion zu
apfeltalk.de/magazin/news/date
#News #Services #AppleDatenschutz #Datenschutz #DifferentialPrivacy #ErweiterteVisuelleSuche #FotosApp #IOS18 #JeffJohnson #KIFunktionen #MacOSSequoia #Optin

I just turned in my #thesis for my MSc in #ComputerScience with #DataAnalytics at #UniversityofYork!

The title of my thesis is “Exploring the impact of data imbalance on ε-Differential Privacy” and I do just that using the open-source Python library developed by IBM, diffprivlib. I’d love to share the results of my experiments in a white paper of some kind. Does anyone I’m connected to have experience in converting a masters thesis into a white paper for a journal or conference?

It seems like the rationale for #differentialprivacy assumes narrow individual self-interest.

Its promise to you is that nothing will be learned from you being part of a dataset that couldn't be learned without you being in it. So even if inferences from the data harm you, this would happen due to others participating anyway.

But that rationale only works if you assume people can't imagine co-operating to protect each other by not participating.

Continued thread

The basic logic of this is extreme horizontal dataset sharding. Imagine a dataset with loads of columns, then imagine each row is held on a different device. Techs such as multi-party computation #mpc, local #differentialPrivacy, can make use of this data.
But data is often not visible to the user. Firms claim they do not have to provide rights over it, eg access/portability. Some will put it in the secure enclave of eg a phone; makes it technically very hard to extract (e.g. biometric data).