Follow

Maybe should distribute the planet file (ie entire database) over BitTorrent? Decentralise things!

@rory
The problem is to mantain it up to date. The map is changeing every day

@felix the planet file is only released by planet.openstreetmap.org is only created once a week. So that file would be good for a week. There is a BitTorrent extension which tells clients to check for a new torrent file, so you can "update" the torrent with new data that would then be mirrored

@felix I have tested the limits of the forum's handling of unicode, and I am currently locked out of it. I'm working with forum admins to fix it. 🙂

@rory
Oh, so you are allmost an osm developer. If the torrent thing goes on, please give me advise. I'll seed it.

@felix 🙂 TBH I'm just thinking outloud, brainstorming. I don't think I have any serious time for a quirky little side project like this, so it probably won't happen. 🙂

@rory
The problem with bittorrent is that it's only suitable for static files.

As soon as you update the planet file, you have to share an entire new copy, and form a new swarm around it. The parts that didn't change cannot be reused.

@Coffee
But...wouldn't IPFS, or even DAT with incremental updates be better solution than torrent?

@rory

@stalker @Coffee Yes would work too! 🙂 And you could put the whole replication osc diff files in ipfs as well.
Torrent is just so common that it's easier to suggest

@stalker @Coffee I think is very similar to , tech wise, so there might not be a massive difference...

@Coffee I think there has been some work on making better for changing files like this. There's some extensions (BEP38 & 39) to tell clients to download a new hash, and for them to look at existing files when that hash changes. I think the internet archive pushed for these cause they use it.

But I have no idea about support for those features.

@rory
I've been out of the loop, so don't know about the latest developments. I do know an updating variant of bittorrent has existed for a while, but it was/is proprietary.

@Coffee well that spec is open source, and isn't very long. Implementing it could be really hard though. 🤷🏻‍♀️

@rory The problem is the constant stream of data deltas. It's always WIP 😉

@blub yeah, but the planet file is only created once a week, so you could do that. Check out other replies where I mention the extensions for changing torrents, which could help.

@rory I like that idea. It would ease the load on the servers and allow for amateurs to contribute excess bandwidth easily

@DJWalnut I don't think the servers have any bandwidth issues now, but it does mean we're relying on goodwill for free bandwidth. I do like the idea of a decentralized sharing and pooling of resources 🙂

@rory yeah for things like apps that want to have their own private instance of planet. Osm it's perfect. You probably want traditional tile servers for the average user

@rory of course I did chip in $5 to OSMF that one day so the lack of bandwidth issues is a tiny part my doing

Sign in to participate in the conversation
En OSM Town | Mapstodon for OpenStreetMap

A Mapstodon instance for the OpenStreetMap Community (English language)! This site is under construction, and may change. Our francophone friends have a Mastodon instance: fr.osm.social