My 4 week old baby's umbilical cord has not fallen...?

Is this normal? Frankly I'm worried that it's taken this long. My 2nd baby also took this long. Her doctor had to put something that made it fall off within an hour after she applied that liquid. My 1st baby, however, lost it within the normal 2 weeks. Should I worry or just keep waiting?