I prefer the black bodies to the silver. Doing event work, my experience is opposite of Mike’s. The silver catches people’s eye much easier than black. Which draws their attention to the camera. That makes grabbing candids more difficult. I use black bodies with gaff tape over any white lettering when I’ve shot with XT bodies.
My biggest concern with silver or "panda" styled cameras is that it seems that the finish is not as durable as the all black cameras. I've had a Fuji X-E1 and Olympus EM5.2 cameras that have had the silver finish rub off. I've not really had that happen to any of the black cameras I've owned.
As far as preference goes, outside of the finish issue...I guess it really is all about what looks good to you.