Not only possible, already a thing. It's called PeerTube and there are a few instances, mostly in french from what I can tell.
Though storing video is such a massive challenge that I don't expect nearly as much growth with PeerTube as we had with Lemmy, at least for the time being.