Yep, this is very doable and plenty of folks do live on public land for long stretches of time. Just be clean and don't mess things up and it's totally fine. Most national forest land also allows camping in disturbed areas.

This mostly applies to the west coast though. The eastern US has very little public land that is freely accessible.