We used the Apache Math Commons and JuggerNET (to connect Java to C#). Works well for our needs. Has all of the basic math and stats one would need for trading (mean, standard deviation, etc).
For any slower or batch processesing, you cannot beat R (which links to C# very easily)
Probably going to try the GNU if the Apache ends up lacking.