They have made changes with regard to size and some are a bit bigger today, and a handful across the brands are close in size. Ergos are another matter, and are highly subjective, especially if one has issues associated with aging or disabilities. The X-H1 controls may be more spaced out, but they are physically small and some are too close to the level of the camera body and therefore difficult to locate by feel. After handling multiple bodies, of the mirrorless options, the Nikon fits me best. I can easily find and operate all needed Nikon controls without taking the camera from my eye or making a major shift of my grip.
Over the last 5 years or so, I have had increasing issues with finger and hand pain, loss of dexterity, and issues with lower spec viewfinders. I doubt it will cease to progress as I continue to age. The way a camera feels in my hand, how easy it is for me to find and operate necessary controls, and whether or not a viewfinder cause double vision and headaches is increasingly a driving factor in my gear selection. I like the Fuji gear, they have a solid lens lineup 135mm FOV and below IMHO. But at some point, my body's interaction with the ergos might force the shift. Not sure it's enough of a difference right now to make the switch. It'll take a lot of money. It might be necessary to have a physically large camera with large controls. One additional reason I don't want to let my Pentax gear go. It just fits me, my hands, my eyeballs.