Sadly that isn't true: it requires a server to be running to receive message content from the phone app, run inference using the LLM and send back responses. All of that requires electrical power and maintenance at the very least.

In this always connected, SaaS-dominated world, it saddens me that all too often people marginalize the cost of keeping all that infrastructure up and running.

In this case we’re talking about one guy responding asynchronously to a handful of spammers per day. It’s something you could run on an old laptop. It doesn’t need a server or 11 9s of uptime.

Except this is a pretty good case for using an SBC:

1. they're fairly low power and

2. the LLM speed is less of an issue because SMSs like this don't warrant an instant reply anyway so if it takes 2 or 3 minutes to generate that's fine