I usually say that I 'study' Elvish rather than 'speak' it. Unless you have people you can practice speaking Elvish to when you are learning, I think it is extremely difficult to be a 'fluent' speaker.
And as Dissimulo mentioned earlier Tolkien left his languages incomplete which adds to the difficulty.
I've noticed a lot of people are mentioning Ruth S. Noel's book, which is now considered outdated because so much new Tolkien material has been made available since it was published. I've never seen it and I'm sure it is very helpful and interesting, but just be aware of its limitations.
Here's a web page about what's wrong with the infomation in the book:
Ruth S. Noel's The Languages of Tolkien's Middle Earth
(I love using keyboard shortcuts ... except I always forget the ones for the capital letters!)
_________________
~
Quettalmar autar Isil pella, quettalmar autar i lumbulennar, i sírë lirë oialë. ~
~ Our words go beyond the moon, our words go into the shadows, the river sings the endlessness. ~