Justice Minister Judith Collins doesn't think the right to silence law should be changed because of the coroner's report on the death of the Kahui twins.
Their father, Chris Kahui, who was found not guilty of murdering them, didn't take the stand during the seven-week trial in 2008.
In a report made public on Wednesday, Coroner Garry Evans says the traumatic and fatal brain injuries suffered by three-month-old Chris and Cru in 2006 happened while they were in the sole care of Mr Kahui.
Mr Evans says Mr Kahui's evidence on his care of the twins was "unreliable, conflicting and, on many occasions, untrue".
The report has raised questions about whether New Zealand should continue to allow people accused of murder to have the right to silence at their trials.
Ms Collins says it is in the Bill of Rights Act.
"It can be extremely infuriating to people but our justice system has to be greater than one case," she told reporters on Wednesday.
"It's important that we don't tinker with our law when it comes to things like the right to silence without seriously thinking about that for a long time."
Ms Collins says she has a lot of sympathy for the way the public feels about nobody being found guilty of the murder of two defenceless babies.