Community of Elk Rapids. Elk Rapids was platted in 1852 and originally named Stevens, Michigan later to be changed in 1858 to its present name - of Elk Rapids coming from a set of elk horns found in the Meguzee River Rapids. The town of Stevens, and both Meguzee River & Meguzee Lake were renamed to Elk in honor of the elk horns.