The closest airport Newark Liberty Intl (IATA: EWR) is about 10 km away.
Although there are not many attractions in Bayonne, there are plenty of interesting places to explore nearby. If you're visiting the area, you may want to check out something from the following list:
To understand Bayonne better you can also take a look at the gallery.