Yes, remove all else and just keep the black seeds but packet them right away and refrigerate them air tight. Like many Boraginaceae they seem to be somewhat ephemeral and need either to be sown right away or stored, if not moist, at least not dehydrated.