Luminaries from Michael Jackson to Artis Gilmore to Joe Biden loved this US Virgin Island—and you will too.

Kenny Peets, a Caribbean native and a golf pro at The Buccaneer Resort on St. Croix, a US Virgin Island, doesn’t like to talk much, but the framed letter on the wall of his office speaks volumes. Signed by President Biden, it reads, “Thank you for your hospitality you showed my grandson and me while we golfed at the Buccaneer.”

Joe Biden is one of many luminaries Peets has seen here. Michael Jackson enjoyed staying here, too. So did baseball legend George Kenneth Griffey, Sr., and basketball great Artis Gilmore. Many celebrities favor St. Croix, and The Buccaneer in particular, for its unique mix of Mediterranean charm and Caribbean spirit.

In the 1600s, St. Croix was owned by the Knights of Malta, who constructed Mediterranean-looking homes amongst the island’s green hills. The Buccaneer was built in that style—with rounded archways, ornate columns and stucco fountains. Even today, parts of St. Croix resemble Sicily or Greece—and you don’t need a passport to get there from the US. Here’s how to explore this under-the-radar Caribbean jewel.

Spoiler alert: once you check in at The Buccaneer, you won’t want to leave. Just to explore its luxurious 340 acres and three beaches—family fun Mermaid and intimate Grotto and Whistle—takes several days. Prepare for tough dining decisions between three different restaurants: laid-back beachfront The Mermaid, serving lunch and dinner with fire dancers’ performances on some nights; The Terrace, offering a lavish breakfast and an elegant dinner; and Beauregard's on the Beach, which dishes out the freshest sushi and specialty tacos.

Always keep your phones handy—wildlife literally poses for pictures: pelicans land on the sand hunting for crabs, cute green frogs climb walls and trees, iguanas sashay outside your rooms, and herds of deer graze on the golf course at night.

The town of Christiansted is worth a visit, whether you’re in a shopping, drinking or connoisseur mood—and the hotel can provide transportation. Several stores sell unique St. Croix jewelry. One is the signature Crucian hook jewelry with a distinctive horseshoe-shaped clasp that’s viewed as the symbol of true love. The other is the so-called “chaney,” made from pieces of broken Dutch pottery washed up or unearthed from soil, dating back to when the island belonged to the Dutch. Wearing chaney pendants, earrings or bracelets is like wearing history—and no two pieces are the same.

While there, savor some bites at Estera, a high-end eatery with creative cocktails and an artisanal menu that manages to fuse together the best of the world’s cuisines—think jägerschnitzel, a schnitzel with creamy mushroom sauce, or orzotto, risotto’s cousin made with orzo pasta. Every dish here looks like a work of art and tastes like one, too.

Stop for a tasting at Munity Island Vodka distillery. Named after the famous revolt—Mutiny on the H.M.S Bounty—it’s distilled from breadfruit, the very cargo the ill-fated boat was carrying. The vodkas, which come in various flavors, including hibiscus/passion fruit, ginger/turmeric and Puerto Rican coffee, are immensely popular on the island and beyond.

In addition to snorkeling and scuba diving, St. Croix travelers can experience nighttime kayaking in a bioluminescent bay. With guided Sea Thru Kayaks VI tours, you can paddle in complete darkness to Salt River Bay, where surrounding mangrove forests create a perfect environment for several species of tiny marine organisms that glow in the dark. To enjoy bioluminescence to the fullest, kayaks have transparent bottoms. As you paddle, glide or even simply splash your hand in the water, the creatures respond by emitting brief flashes of light. Your activity is also likely to stir another animal—flying fish that jump out of the water and glide over the surface.

Whether you’re a golfer, foodie or nature lover, you’ll find something to do on this under-the-radar island gem.