Using Eclipse for C++ with GLUT on Windows
And, of course, it is next to impossible to navigate and deduce the steps needed to set this all up from the Eclipse website and wiki pages.
Thankfully, after only a few hours and random searches, I found Paul Solt's GLUT Setup Tutorial with Eclipse CDT on Windows. It goes step by step to get everything installed and running. Note: before finding Paul's page, I had already gone through Brian Lee's steps to install MinGW, and I couldn't get to the Max Berger page that Paul links to; so your results to his step #2 may vary. MinGW is a simple way to install the g++ compiler and its dependencies without using cygwin.
I'm all setup with my first GLUT hello world app for my first assignment now. Hopefully this post will help someone else do the same in the future.