A mother was heard screaming "my kids, my kids"after a 1-year-old boy was killed and a girl of the same age left fighting for life in an alleged hammer attack.
A major search is underway for Bidhya Sagar Das, 33, who was at the property where the children were injured but left before police and ambulance crews arrived.
Police said that the suspected murder, at a flat in north London yesterday, is believed to be domestic.
Mihai Menea, 29, who lives in the building said: "A neighbour heard the woman screaming in the street and went up to the room.
"He went into the room and the boy was already dead when he found him.
He believed the mother was Romanian and the father is Indian and worked as a night receptionist at the Pembury Hotel round the corner for seven years, but apparently quit his job two days ago."I couldn't imagine something like this happening in a million years."
He confirmed the children were twins, a boy and a girl.
The girl remains in a critical condition in an east London hospital.
The Metropolitan Police said: "Detectives are urgently trying to trace a man who was at the flat shortly before the injured children were found, but left before emergency services were called. The man has not been seen since this time.
"He is Bidhya Sagar Das, 33, of the address in Wilberforce Road where the injured children were found.
"If any members of the public see this man or know his whereabouts, they are urged to contact police immediately.
"The incident is believed to be domestic. There has been no arrest at this stage and enquiries continue."
The National Police Air Service helicopter tweeted that it was assisting "officers searching Finsbury Park for a suspect".
A woman living opposite the building, who gave her name as Gui Gui, said she heard a woman shouting late last night and opened the window to offer help.
"I was watching TV," she said. "I heard someone was shouting. She kept on shouting. I do not know what she was shouting.
"I opened the window and I asked her 'Can I help you, can I call the police for you?' She added: ""I said what has happened and she just shouted 'my kids, my kids'."
The neighbour said she later saw two young children being carried out of the building, with one being held very close to a member of the emergency services.