I would just pick up puppy and put her in the crate without any fuss. Sometimes it also helps to find a super high-value treat that you only give at crate time.
It sounds like you have done everything right if your puppy willingly goes in to the crate on her own. Continue feeding in the crate and tossing high value treats and favorite toys at random times throughout the day. Sometimes a puppy is just not ready/willing to go to bed and it may take a little effort to convince them it is bedtime.