There are around 40 steps in the entry of caves and these two are comfortable enough to go up with baby for a normal health person. Internally within caves there are very less steps to go up and down and those being on stone carve are not wet and slippery. You may look to avoid Ajanta View Point by this reference.