He was a swordsman who was given a sword, a house, and a stipend, and who acted as a bodyguard.
The weird “controversies” around titling him as a samurai when it is a perfectly applicable term in those circumstances are absolutely motivated by racism.