Yes, you need libraries and other things that handles the low level stuff for you so you can work on the core game play and game assets. LWJGL is the natural choice if you want to do something with OpenGL + JAVA. But, its low level. You want something that more focused towards game, not pixels of your display.
jMonkeyEngine is the perfect choice for this. It handles all the high level stuff for you. It is a shader based engine. So, unlike most of the engines out there you wont be working with old feature & functionality. It comes with SDK, which features update center and pre-configured project setup with many examples. Plethora of documentations. Very active community. Most importantly its development is progressing like a bullet train.
Recently its beta version has been announced, (fear not, its very stable) that's why a game development competition is being help over there. So, jump in with your eyes closed!
If you want to know what are the others options(libraries) and why I suggest you jME over those, read this answer.