The simple colored pencil is not so simple.
The pigmented core is a baked product. That baking should be carefully controlled so that the core shrinks just enough to fit into the grooved wood. If the fit is poor the lead will break.
And what about lead colors? They can’t be of heavy metal because pencils are educational. It’s a balance, that good lightfast colored pencil.