C1189: Incorrect inclusion of a cudart header

So, converting some CUDA 2.3 and C++ code to CUDA 5.0,  I came upon the error

error C1189: #error :  --incorrect inclusion of a cudart header file

Turns out I was #including a cuda header in a cpp file.  Removed that, it worked.  Yay.