The U.S. Mint had been producing one-cent coins since its founding in 1792, but the 1909 penny (which replaced the Indian-head cent) was the first coin on which a President's likeness appeared. Teddy Roosevelt commissioned the coin to celebrate the 100th birthday of Abraham Lincoln. While most people applauded the new design, former Confederate soldiers were upset at the prospect of carrying the image of Lincoln in their pockets.
Top 10 Things You Didn't Know About the Penny
As Canada stops minting pennies, TIME takes a look at the copper coin's rich, trivia-filled history