Yes, but let's not forget that 35mm was considered a compact size at one point, with 120 being the more typical camera.
I guess it is a relative thing, if you are Hulk Hogan you may have a different view than Tom Thumb about size. That being said, for me, a small camera is any camera that you can comfortably hand hold and a compact camera is one that fits into a pocket. To me the D5000 is a small camera.
Of course I am only one of many and in the end it really should be how you feel about the camera.