Solomon's Seal sawfly 'caterpillars'

These little grey larvae are on this plant every year, but after the flowering period. I spotted a few and took a picture, and then turned over the leaf which broke as I did so; there were many more on the underside.  I left it like that and in an hour the exposed ones had gone, whether to hide underneath or been eaten by birds I don't know.