You can set the last component in the corresponding RGBA to something smaller than 1. See documentation here: http://www.mujoco.org/book/modeling.html#rgba