You are correct. That is the bare minimum you need. However, in practice, developing anything but the most simple of applications is very difficult this way due to a lack of debugging tools. You don't have to buy anything to develop C++ applications in a world-class IDE. Here are what I believe to be the 3 most used C++ IDEs:
Microsoft Visual C++ Express
Eclipse for C++ Developers
Bloodshed Dev C++
This is ordered by their popularity (I think). And yes, #1 is a Microsoft product. Don't worry about it. It is an amazing IDE, even the free version.
EDIT: Also, I have been suggesting lately to new developers that instead of buying a book, get a subscription to
Safari Books Online if you can. I love this service now, because for the cost of buying 1 tech book a month, you get access to thousands of up-to-date ebooks legally. This is O'Reilly and many other publisher's attempt to curb piracy, by offering access to almost all of their tech books online for a subscription cost. You can "check out" 10 books a month for about $20 a month, or have full, unlimited access to every book for about $40 a month. It is great for people beginning a new language, because you will need many books, and you may also decide you don't like the first book you choose.