en.osm.town is one of the many independent Mastodon servers you can use to participate in the fediverse.
An independent, community of OpenStreetMap people on the Fediverse/Mastodon. Funding graciously provided by the OpenStreetMap Foundation.

Server stats:

248
active users

#DisasterRecovery

0 posts0 participants0 posts today
Continued thread

From OPB:

opb.org/article/2025/04/02/ore

The article cites $129m in funds held by #DHS and Secretary Noem, but it is really a lot higher because obligations are held up as well, not just the request for funds. The total is closer to $200m at this point...

OPB · Oregon and other states say Trump’s continued freeze on much-needed FEMA aid violates a judge’s orderBy Chris Arnold

#HurricaneHelene #FEMA #DisasterRecovery
MAGA screamed hysterically every single day that FEMA wasn't helping Hurricane Helene victims. The Trump administration defiantly and publicly turns off the tap and nothing. 🦗

Georgia leaders respond to Helene extension denial

"Georgia leaders sent a letter to President Donald Trump after the state was denied an extension on the federal share for debris removal post Helene."
augustachronicle.com/story/new

The Augusta Chronicle · Georgia leaders respond to Helene extension denialBy , The Augusta Chronicle

Notes from Swannanoa - Part V ~ As I write this, it has been 122 days since Helene. In another week or so, I anticipate the appearance of purple dead nettle all around the land surrounding Bear Path Cottage, a bit of bright color among the browns and greens of winter.

wildhunt.org/2025/01/notes-fro

The Wild Hunt · Notes From Swannanoa – Part VBy Sheri Barker

#oregon is introducing at least four #DisasterRecovery bills this legislative session. They cover some interesting topics like a State Disaster Fund in place if #FEMA can't/won't provide federal aid for disasters. Or matching grants to cover the costs of what they won't cover already.

I'll share links to the bills if people are interested.

Hullo planners. Want to work for Parks Canada, and help with rebuilding the town of Jasper, post wildfire? This is an urbanist's dream community: a town designed to be a 15-minute community, no greenfield development possible, frequent use of bicycles as commuting vehicles, near universal embrasure of wildlife as neighbours, firesmart-savvy, international visitation.
Deadline to apply: Feb 12'25.

emploisfp-psjobs.cfp-psc.gc.ca

emploisfp-psjobs.cfp-psc.gc.caPlanner I

1/🧵 I've been invited to partner with a local county to put on a presentation on how private non-profits can best prepare for disasters in terms of mutual aid and access federal aid for recovery.

There's such a need for education for all organizations these days, this stuff is too complicated unless you can afford consultants.

Which creates #equity issues that many governments have difficulties in addressing.

I want to send some data into the ether that may interest people who wonder how US governments recover from the increasing occurrences of #disasters.

In 2021, I sent an email saying that, given the situation, I would not be able to keep your machines running with the current infrastructure. You replied that the funds are allocated "for migration to a cloud-based solution," so the machines must be kept running as they are. I strongly suggest you reconsider: your connections are unstable and slow, it would be impossible to work (via Remote Desktop, Windows servers) in such conditions - from over 30 thin clients. You responded that the budget is now allocated for this, and that the consultant assured you everything would be perfect.

The migration will never happen – after spending tens of thousands of euros – due to "lack of connection quality."

I "forgive" you.

At the beginning of 2023, I wrote to you that there are two critical issues that will soon compromise the security and reliability of the machines. You replied that you are "working on the plan for migration to a centralized solution in one of your locations." I responded that the connectivity is inadequate, that that location has data center flooding issues (it should at least be moved to an upper floor), and that, in case of problems, all your 9 locations would be down because of it. Therefore, given the situation, it would be better to keep a server and a replica at each site, with offsite backups, ensuring they are current and consistent.

Minimal financial investment, maximum uptime.

You replied that "the defined path is now set, so we are proceeding with it" because a "consultant has guaranteed maximum reliability."

I withdrew, predicting disasters and for the same reason: they present themselves elegantly, with glossy catalogs and buzzwords – they sure seem credible and modern!

Go ahead, it’s your money and your data.

This morning at 5:30, you woke up me because your location had electrical issues, and the other branches are facing external connectivity problems due to the (same) Internet provider (and the backup, which uses the same channels as the primary provider, unlike what the vendors had promised).

A downtime of at least 3 days is expected.

Everything is down. You want me to take the backups (made by others, I don't even know how), and restore the old servers in the branches (from 2015), as you believe it would be possible to resume work only this way – as suggested by the "elegant consultant."

I replied that I wish you good luck and went back to sleep with a clear conscience.

This morning, a (non-critical) FreeBSD VPS went down. The provider mentioned a "problem that would be resolved as quickly as possible," without providing an ETA.

I immediately took another VPS and, thanks to zfs-send and zfs-receive, replicated the zroot/bastille from the last backup. I set a maximum time limit of one hour. In 5 minutes, plus a few more minutes for the copy, I already had the replacement ready.

58 minutes later, the original VPS was back online. I discarded the restored one. I was almost disappointed at that point, I almost hoped to put the other one online instead 😆

Community reminder for #Ohio area folks interested in #Linux #Programming or general #Technology - the 22nd annual Ohio Linux Fest #OLF #OLF2024 is in a week at the Hyatt Regency in downtown #Columbus!

olfconference.org/registration

Friday Nov 15 will have:

* LPIC-1 boot camp
* Getting started with Kubeflow

(for OLF Institute Professional Pass registrations)

and presentations for:

* transparently functional computers by Marc Abel
* amateur radio by Mike Kwiatkowski
* #DisasterRecovery in #DistributedSystems by Mahak Shah and Akaash Vishal
* machine learning and Thai characters by Terry Howald

And of course the final keynote and birds of a feather sessions.

Saturday Nov 16 will have

* Time management for #sysadmin
* Power editing with vi

(for OLFI Professional Passes)

and presentations for:

* Automation by design by Brad Krumme
* Audour and Lua by Justin Ehrlichman
* #RaspberryPi and #Arduino via O.L.D programming by Cameron and Tracey Hughes
* Intro to tmux by Bob Murphy
* From engineering to management by Ethan Hussong
* VM orchestration with KubeVirt on #Kubernetes by Anthony Navarro
* Linux tools and #robotics by Trevor Watkins
* WebAuthn and passkeys by Cornelius Kölbel
* #AlmaLinux by Jonathan Wright
* #RockyLinux by the awesome Maxine Hayes
* Enterprise Linux kernel reverse engineering by Jonathan Maple
* Proprietary and open source migrations by Justin Paul
* Open source imaging with FOG by Justin Paul
* Moving applications to containers by Donald Vosburg

And of course the closing keynote by the legendary Jon Maddog Hall!

olfconference.org/2024-schedul

Fingers crossed I can keep the Garfield open source solutions stage broadcasting live and working well! I am also working on a surprise for attendees assisted by Micro Center, (but won't spoil too much here, you'll just have to show up to see ;) )

OLF Conference2024 Registration - OLF ConferenceThe OLF Conference is proud to announce that we will hold our 22nd annual event in Columbus, Ohio on November 15 and 16, 2024. OLF welcomes all Free and Open Source Software professionals, enthusiasts, and everyone interested in learning more about Free and Open Source Software. On-site attendance is limited. For this reason, there is […]

Monitoring shouts at me: "This server is DOWN!"
I immediately check - it doesn’t respond to ping requests. I try to reboot it remotely - no luck.
I attempt to request a remote console; after more than 45 minutes, there’s still no reply.
I check the logs: the last ZFS send/receive based backup occurred just 23 minutes before the outage (it's an hourly backup).

I call the client to explain the situation: we can either wait or restore from a backup. They express a preference to get back to work after lunch (13:30).

I set up a VPS, install FreeBSD and some packages, then connect to the backup server:
zfs send -RLvw [mybckdataset]/bastille@lastSnap | pigz - | mbuffer -m512M | ssh destserver "pigz -d - | zfs receive -x canmount -x readonly zroot/bastille"

After a few minutes (50 GB later):
zfs load-key -r zroot/bastille (since they’re encrypted)
zfs mount -a
service bastille start

Everything's up and running. DNS record changed - disaster recovered. Time: 12:48.

I call the client and say, "Hey, you’re back up. Now we’ll wait for the original server to come back, and then we’ll resync the datasets."

The customer, with a witty remark that cleverly shows gratitude without being direct, replies, "Oh come on, and I was hoping to extend my lunch break! 😆"

FreeBSD, jails, and ZFS have, once again, done an excellent job.

Now, I can have my lunch.

#FreeBSD#ZFS#jails
Continued thread

I study disasters. Our recovery system is facing its own.

"Our system is not designed to withstand #ClimateChange, but there is a way to recover better.

We could reimagine the system as being focused on the recovery of *people* rather than property."

washingtonpost.com/opinions/20
#FEMA #HUD #DisasterRecovery

The Washington Post · I study disasters. Our recovery system is facing its own.By Sarah Labowitz

No vabe', non è possibile, ditemi che non è vero: cioè il problema è la ditta, gli immigrati, i lavoratori o la proprietà della stessa, il malocchio, il chiodo, la nutella...

OPPURE

è VERGOGNOSO che il sistema dei treni di un paese sia SENZA alcun ridondanza seria e senza aver previsto soluzioni banali di #disasterrecovery per evitare incidenti come questo?

Cioè si vede l'effetto, e NON LA CAUSA?