The baby girl is the first child for the 37-year-old and her 40-year-old partner Clarke Gayford, with the youngster weighing in at a healthy 7.3 pounds (3.3kg). The prime minister's office brought food for reporters waiting at the hospital.
There was no mention of a name, although Ms Ardern earlier warned the couple were struggling to pick one.
This makes her only the second elected leader in modern history to give birth while in office.
Spain says France to take in migrants, World News & Top Stories
On Friday, the NGO had indicated on Twitter that its boat was stationed off the Libyan coast and engaged in rescuing 118 people. The destination wasn't immediately announced, but the coast guard said it wouldn't dock until at least Tuesday.
Jacinda Ardern, New Zealand's prime minster, reacts during a bilateral meeting with Theresa May, U.K. prime minister, in the gardens of number 10 Downing Street in London, U.K., on Wednesday, April 18, 2018.
Ms Ardern arrived at the country's largest public hospital at 5:50am (local time) with Gayford, her spokesman said.
Church said: "She's going to be very busy for those six weeks with the baby and I suspect she's going to be doing a lot of hard work at home as well".
However, the Prime Minister will still be consulted on all major decisions.
Ms Ardern had played down the chances of any disruption arising from her absence, saying she and Mr Peters would be in regular contact.
Dems want illegal immigrants to 'infest' US
Under the Obama administration, such families were usually referred for civil deportation proceedings, not requiring separation. Nearly 52,000 people were caught trying to cross the southern border illegally in May, according to government figures.
"Like the rest of the country we welcome the news of the birth of a healthy baby and are naturally delighted for the new parents".
New Zealand's parliament has baby-friendly policies with the Speaker of the House Trevor Mallard once looking after the child of a Labour MP while the country's parental leave bill was being debated, Stuff.co.nz reported.
The first female prime minister was Sirima Bandaranaike, who was elected to lead Sri Lanka (then Ceylon) in 1960. One group started a campaign, #KnitForJacinda, to knit baby clothes for hospitals and women's shelters in celebration of Ardern's news.
Todd Chrisley Rips Jeff Sessions for 'Twisting' Bible to Support Immigration Policy
Attorney Jeff Sessions spoke on immigration policy and law enforcement actions, Friday, June 15, 2018, in Scranton, Pa. He says the children must be separated from their families because they can't go to jail with them.