Rory
Follow

Maybe should distribute the planet file (ie entire database) over BitTorrent? Decentralise things!

@rory
The problem is to mantain it up to date. The map is changeing every day

@felix the planet file is only released by planet.openstreetmap.org is only created once a week. So that file would be good for a week. There is a BitTorrent extension which tells clients to check for a new torrent file, so you can "update" the torrent with new data that would then be mirrored

@rory
Can work, maybe propose that in the forum?

@felix I have tested the limits of the forum's handling of unicode, and I am currently locked out of it. I'm working with forum admins to fix it. 🙂

@rory
Oh, so you are allmost an osm developer. If the torrent thing goes on, please give me advise. I'll seed it.

@felix 🙂 TBH I'm just thinking outloud, brainstorming. I don't think I have any serious time for a quirky little side project like this, so it probably won't happen. 🙂

@rory
The problem with bittorrent is that it's only suitable for static files.

As soon as you update the planet file, you have to share an entire new copy, and form a new swarm around it. The parts that didn't change cannot be reused.

@Coffee
But...wouldn't IPFS, or even DAT with incremental updates be better solution than torrent?

@rory

@stalker @Coffee Yes would work too! 🙂 And you could put the whole replication osc diff files in ipfs as well.
Torrent is just so common that it's easier to suggest

@stalker @Coffee I think is very similar to , tech wise, so there might not be a massive difference...

@Coffee I think there has been some work on making better for changing files like this. There's some extensions (BEP38 & 39) to tell clients to download a new hash, and for them to look at existing files when that hash changes. I think the internet archive pushed for these cause they use it.

But I have no idea about support for those features.

@rory
I've been out of the loop, so don't know about the latest developments. I do know an updating variant of bittorrent has existed for a while, but it was/is proprietary.

@Coffee well that spec is open source, and isn't very long. Implementing it could be really hard though. 🤷🏻‍♀️

@rory The problem is the constant stream of data deltas. It's always WIP 😉

@blub yeah, but the planet file is only created once a week, so you could do that. Check out other replies where I mention the extensions for changing torrents, which could help.

Sign in to participate in the conversation
En OSM Town | Mapstodon for OpenStreetMap

A Mapstodon instance for the OpenStreetMap Community (English language)! This site is under construction, and may change. Our francophone friends have a Mastodon instance: fr.osm.social