This is a much cuter way to label your plants than those plastic sticks from the nursery, and you can get six pots for just $29 (that's $5/each). From Pottery Barn.
If you want your chalked labels to look super-neat, you might try ordering these, too.