A mix of every color in pigment is black because it absorbs every color wavelength of light so no color is reflected back to your eyes. All the things like vantablack are doing is trying to get the amount of light reflected back off the object to your eyes to be completely 0. Visible, or otherwise.

You’re focusing entirely on the light aspect, forgetting that pigments and light work together to create what we understand as color.