Are you sure to have the nvidia kernel module available for your
kernel ?
No I'm not sure. I just did an "yum upgrade" on my system. Before that
upgrade libcuda worked fine (so kernel and module should have been fit
together) and afterwards it did not work. Part of that update was a
new kernel 3.8.8