Eyelash glue works great for me.
It's real cheap to buy, and the tube is small and handy enough to keep in my bag/pocket, jic. Mostly for emergencies tho; I'm not a super active person, but I've never lost my feathers with this stuff holding them on.
**Note: Definitely get the white/clear...