Creating a WARC web archive using wget

I’ve been tinkering with keeping offline copies of websites (mostly mine), and have always used either wget or httrack. I wasn’t aware of theĀ WARCĀ formatĀ until recently, so I thought I’d try creating a fewĀ WARCĀ archives. wget, as it happens, hasĀ WARCĀ support built in via the –warc-file option. I added that to my usual set of switches and put it all in a shell script, like so. #!/bin/sh # warc-archive.sh https://example.com warc-file-name wget \ --mirror \ --warc-file=$2 \ --warc-cdx \ --page-requisites \ --html-extension \ --execute robots=off \ --directory-prefix=. \ --wait=1 \ --random-wait \ $1 This creates a compressed, self-containedĀ WARCĀ file along with a mirrored set of files comprising the entire site. ...

March 2, 2024

Additional backups

Derek Sivers posted about how he handles backups and it got me thinking about how I handle backups. I feel like I’m mostly covered. I use Backblaze on my MacBook Pro for continuous, off-site backups of both the internal SSD and the attached ā€œMediaā€ drive containing my photos, videos, etc. I clone ā€œMediaā€ to a separate external drive once a week. iCloud syncs my ~/Documents and ~/Desktop folders, so that should be covered. The headless Mac Mini is also using Backblaze. The Synology is synced nightly to Backblaze B2 storage. ...

February 28, 2024

No longer keeping my notes in a Git repo

For many years I’ve put every new folder full of anything into a new Git repo. I never questioned it, I just did it because that’s what you do. I’m thinking about no longer doing this. This morning I was daydreaming while waiting for a folder to finish rsyncing to a server and I was mesmerized by page after page of lines likeĀ ā€œ.git/objects/fb/70e546350cc4106caf1225706b44c85087ed27ā€ scrolling by. I checked a few of my projects and was surprised by how much space all thoseĀ .git/ directories use. ...

February 28, 2024

Software that sparks joy

I’m just coming off a week using Obsidian. Obsidian is really good and powerful and easy to use and extensible and probably the correct answer to the question,Ā ā€œWhere should I keep my notes?ā€. I love Obsidian for a minute because of what it does and the fact that it’s not whatever I’d been using previously. It’s refreshing and finding new plugins to play with is good fun. But it’s janky. Why don’t more people complain about it being janky? It’s just blech to actually live in. It feels weird and loose and sloppy to me. ...

February 26, 2024

Fending off the Futz Monkey

When is trying to avoid futzing actually just more futzing?

February 20, 2024

A brief flashback into Lightroom

In which I think about using Lightroom again.

February 16, 2024

Searching in Mutt with Notmuch

Notmuch can be used as a search engine from within Mutt and it’s super fast.

February 14, 2024

Using Mutt for email is awesome, but it makes me want to do everything in a terminal

February 12, 2024
12 years of Hobonichi

Hanging up the Hobonichi

After 12 years of using a Hobonichi Techo, I’m giving it up.

February 6, 2024

Paper is great

I’m really into paper-based tools lately. This is often a reaction to over-thinking my (digital) note-taking process. And oh my have I been over-thinking that process lately. Using paper is more work, but it’s worth it. Here are a few random thoughts I’ve had about it recently. Paper’s immutability is something you’d think one would put into the ā€œConsā€ column, but I find it to be its greatest feature. I’m fickle and uncertain and my digital notes suffer because of it. When I write something in a (paper) notebook, there it is, forever. I can scribble it out or copy it onto later pages, but I can’t change my mind and move it somewhere else based on whatever ā€œsystemā€ I decide upon that day. It’ll always be right in that spot, in that notebook. I love this. ...

January 30, 2024

Saxon - Hell, Fire And Damnation

The new Saxon album is really good.

January 19, 2024

Arc (Chrome) extension for copying text for TiddlyWiki

An extension for easily copying text from a web page into TiddlyWiki

January 19, 2024

OldBoy (2003) ā˜…ā˜…ā˜…ā˜…ā˜…

OldBoy remains as powerful, beautiful, and unsettling as the first time.

January 15, 2024
Serously?

Custom error documents for httpd on OpenBSD

The default error pages in httpd are awful

January 14, 2024

From Kirby To Hugo

We’re back on Hugo for baty.net. For the past few months, I’ve been learning how to create a blog using Kirby CMS and it’s been a blast. Kirby is pleasant, easy, and fun to use. I’m glad I did it. I won’t bother you with a 2,000-word rationalization piece about switching. I just felt like using Hugo again, so here we are. I missed my nice Emacs-based publishing workflow. I missed ā€œnormalā€ YAML front matter. I missed having a completely static website. Who knows where we’ll be in a month, but today we’re using Hugo. I went back to the PaperMod theme. I don’t love how boring it is, but it’s clean, feature-rich, frequently updated, and easy to customize. ...

January 14, 2024

Subscription changes

Canceling things brings mixed feelings

January 10, 2024

Lightroom it is, I guess

I canceled my Capture One subscription this morning, before it renewed for $180 for another year. I hadn’t planned to do this. The plan was to cancel my Lightroom subscription ($10/month) and run with C1 for the year. Capture One has more to offer, and I like the files I get from it better than from Lightroom. So what happened? When canceling the Lightroom subscription, I was informed that there would be an early-termination fee of $49. I’d forgotten that the $10/month subscription was subsidized by agreeing to pay for a year. They just charge me monthly. That was disappointing. ...

January 9, 2024

Org-web-tools

I just wanted to give a shout-out to Adam Porter for hisĀ Org-web-toolsĀ Emacs package. I only discovered his package a month or so ago and I’ve used it daily since. Put a URL in the clipboard, then in an Org-document runĀ M-x org-web-tools-insert-web-page-as-entryĀ and bam!, the page is converted into Org’s format and inserted as a heading in the current file. For example, here’s Jason Velazquez’s post aboutĀ Blogging Platforms, all tucked away nicely in my ā€œBlogging Platformsā€ Denote note… ...

January 8, 2024

Prose.sh

I don’t need a new blogging platform, but if I did, I’d certainly be looking atĀ Prose.sh. It’s blogging via sftp and rsync, which sounds awesome.

January 8, 2024

Ending my OpenBSD experiment (Almost)

I tried OpenBSD. It’s nice. I don’t need it right now. (Or do I?)

January 4, 2024