The metal part of a pencil is called the ferrule. It is usually made of brass or aluminum, and it is what holds the eraser in place. The ferrule can also be used to extend the lead of the pencil by sliding it up or down the barrel.