Also 'the borrowers', as OP makes referrence to

There's also an animated movie with the same premise, The Secret World of Arrietty

https://imdb.com/title/tt1568921/

It's the same premise because they're ideas based on the same thing. The OP mentioned The Borrowers as inspiration. Well The Secret World of Arrietty is based on The Borrowers. I think it's even called something like "Borrower Arrietty" in Japan as well.