If you've already read Apostol's Calculus book, I think you're ready for Strang's book called Linear Algebra and Its Applications. Strang's other book Introduction to Linear Algebra was mentioned above, but I think you should go right to the more serious book.
I really can't overstate how good Linear Algebra and Its Applications is. It teaches you to think about linear algebra the right way. As you go on, you may need other books, but Strang should take you a long, long way. Here are some other options:
Roman: very good, better once you have had a rigorous introduction to abstract algebra (particularly finitely generated modules over PIDs)
Friedberg: Great exercises, OK chapters. I find the chapters difficult to read because they are so pedantic, using lengthy and cumbersome methods to prove things which are actually quite simple. Once you've read Strang's book, instead of reading Friedberg, I would just take a course on abstract algebra (including module theory) and then go back and read Roman (a large part of which you'll have covered in your algebra course, but some of it you won't have). But do the exercises in Friedberg!
Lax: This book is notable for its speed (duals and quotients are in the first 20 pages). The great part about Lax is he covers a bunch of things other linear algebra books don't, like matrix calculus. (For instance, if you have a differentiable function $A(t)$ taking as its values invertible matrices, what is the derivative of $A^{-1}(t)$?) This is really a great book, but I would never recommend it as a first book. One drawback: it has a few serious typos.