Creating a WARC web archive using wget

Iā€™ve been tinkering with keeping offline copies of websites (mostly mine), and have always used either wget or httrack. I wasnā€™t aware of theĀ WARCĀ formatĀ until recently, so I thought Iā€™d try creating a fewĀ WARCĀ archives. wget, as it happens, hasĀ WARCĀ support built in via the ā€“warc-file option. I added that to my usual set of switches and put it all in a shell script, like so. #!/bin/sh # warc-archive.sh https://example.com warc-file-name wget \ --mirror \ --warc-file=$2 \ --warc-cdx \ --page-requisites \ --html-extension \ --execute robots=off \ --directory-prefix=. \ --wait=1 \ --random-wait \ $1 This creates a compressed, self-containedĀ WARCĀ file along with a mirrored set of files comprising the entire site. ...

March 2, 2024 Ā· 187 words

Additional backups

Derek Sivers posted about how he handles backups and it got me thinking about how I handle backups. I feel like Iā€™m mostly covered. I use Backblaze on my MacBook Pro for continuous, off-site backups of both the internal SSD and the attached ā€œMediaā€ drive containing my photos, videos, etc. I clone ā€œMediaā€ to a separate external drive once a week. iCloud syncs my ~/Documents and ~/Desktop folders, so that should be covered. The headless Mac Mini is also using Backblaze. The Synology is synced nightly to Backblaze B2 storage. ...

February 28, 2024 Ā· 324 words

No longer keeping my notes in a Git repo

For many years Iā€™ve put every new folder full of anything into a new Git repo. I never questioned it, I just did it because thatā€™s what you do. Iā€™m thinking about no longer doing this. This morning I was daydreaming while waiting for a folder to finish rsyncing to a server and I was mesmerized by page after page of lines likeĀ ā€œ.git/objects/fb/70e546350cc4106caf1225706b44c85087ed27ā€ scrolling by. I checked a few of my projects and was surprised by how much space all thoseĀ .git/ directories use. ...

February 28, 2024 Ā· 173 words

Software that sparks joy

Iā€™m just coming off a week using Obsidian. Obsidian is really good and powerful and easy to use and extensible and probably the correct answer to the question,Ā ā€œWhere should I keep my notes?ā€. I love Obsidian for a minute because of what it does and the fact that itā€™s not whatever Iā€™d been using previously. Itā€™s refreshing and finding new plugins to play with is good fun. But itā€™s janky. Why donā€™t more people complain about it being janky? Itā€™s just blech to actually live in. It feels weird and loose and sloppy to me. ...

February 26, 2024 Ā· 441 words

Fending off the Futz Monkey

When is trying to avoid futzing actually just more futzing?

February 20, 2024 Ā· 575 words

A brief flashback into Lightroom

In which I think about using Lightroom again.

February 16, 2024 Ā· 316 words

Searching in Mutt with Notmuch

Notmuch can be used as a search engine from within Mutt and itā€™s super fast.

February 14, 2024 Ā· 194 words

Using Mutt for email is awesome, but it makes me want to do everything in a terminal

February 12, 2024 Ā· 280 words
12 years of Hobonichi

Hanging up the Hobonichi

After 12 years of using a Hobonichi Techo, Iā€™m giving it up.

February 6, 2024 Ā· 205 words

Paper is great

Iā€™m really into paper-based tools lately. This is often a reaction to over-thinking my (digital) note-taking process. And oh my have I been over-thinking that process lately. Using paper is more work, but itā€™s worth it. Here are a few random thoughts Iā€™ve had about it recently. Paperā€™s immutability is something youā€™d think one would put into the ā€œConsā€ column, but I find it to be its greatest feature. Iā€™m fickle and uncertain and my digital notes suffer because of it. When I write something in a (paper) notebook, there it is, forever. I can scribble it out or copy it onto later pages, but I canā€™t change my mind and move it somewhere else based on whatever ā€œsystemā€ I decide upon that day. Itā€™ll always be right in that spot, in that notebook. I love this. ...

January 30, 2024 Ā· 341 words

Saxon - Hell, Fire And Damnation

The new Saxon album is really good.

January 19, 2024 Ā· 32 words

Arc (Chrome) extension for copying text for TiddlyWiki

An extension for easily copying text from a web page into TiddlyWiki

January 19, 2024 Ā· 85 words

Wednesday, January 17, 2024

Iā€™m on assignment I swear some days I want to single-handedly bring back single-use devices. Remember when I used wttr to show the weather like this? _`/"".-. Light snow ,\_( ). 8(-7) Ā°F /(___(__) ā†— 14 mph * * * 3 mi * * * 0.0 in Historically, the day after getting a COVID booster, I would feel pretty crappy. So far this morning Iā€™m only suffering from a sore arm. This one was from Pfizer rather than Moderna, so weā€™ll see. ...

Low 8.8, High 18.3 Ā· 138 words

Tuesday, January 16, 2024

Iā€™m fine. Server logs are interesting.

Low 6.9, High 10.6 - Light snow showers Ā· 189 words

OldBoy (2003) ā˜…ā˜…ā˜…ā˜…ā˜…

OldBoy remains as powerful, beautiful, and unsettling as the first time.

January 15, 2024 Ā· 45 words

Monday, January 15, 2024

Losing interest in everything. And some blog notes.

Low 6.1, High 13.5 - Light snow Ā· 439 words
Serously?

Custom error documents for httpd on OpenBSD

The default error pages in httpd are awful

January 14, 2024 Ā· 156 words

From Kirby To Hugo

Weā€™re back on Hugo for baty.net. For the past few months, Iā€™ve been learning how to create a blog using Kirby CMS and itā€™s been a blast. Kirby is pleasant, easy, and fun to use. Iā€™m glad I did it. I wonā€™t bother you with a 2,000-word rationalization piece about switching. I just felt like using Hugo again, so here we are. I missed my nice Emacs-based publishing workflow. I missed ā€œnormalā€ YAML front matter. I missed having a completely static website. Who knows where weā€™ll be in a month, but today weā€™re using Hugo. I went back to the PaperMod theme. I donā€™t love how boring it is, but itā€™s clean, feature-rich, frequently updated, and easy to customize. ...

January 14, 2024 Ā· 144 words

Sunday, January 14, 2024

Our near-blizzard conditions continue today. Alice had a hard time finding a place to poop on our walk this morning. Why would anyone want to leave Michigan in Winter? Oh, by the way Iā€™ve switched back to Hugo for the blog

Low 9.3, High 16.6 - Moderate or heavy snow showers Ā· 41 words
Screenshot of laptop running OpenBSD

Friday, January 12, 2024

A day with Kirby, Hugo, and OpenBSD

January 12, 2024 Ā· 198 words