Never use an oil-based source of lubrication. This affects the structure of the condom, causing it to break down and become more porous. Larger pores allow for more materials to be able to cross the latex barrier. Due to this you never want to use anything like baby oil or massage oil on the penis.
Stick with water-based or jelly lubricant always. You may also want to try a silicone based lubricant. They tend to last a long time and are not sticky, but silicone is another substance that some people can find irritating to the skin.