Talaq/Divorce

Assalamualaikum,

 
Please enlighten me regarding my divorce,
When we had this verbal talaq situation back in the year 2012 at that time she was  more than 2 months pregnant and we had argument which leaded to talaq,
I angry mood i said if you behave like this i will give talaq then she said go ahead and give me talaq, So i gave talaq 3 times and then we thought we are done as married couple but our muslim neighbors took us to a imam(mufti i am not sure, north hudson masjid in New jersey) and he explained me that giving 3 verbal talaq in one majlis(same time)is counted as one talaq, Based on his judgment we moved on with our life.
In 2013 in that year same situation occurred where i was forced to give 2nd talaq, then few months back i gave 3rd talaq, and on the 3rd talaq i called the same imam and told us if we give talaq in angry mood then it is invalid.
Now i am in a situation where should i proceed with my married life or should i endup this relation and move on.
Are their any constraints like we need to be in sexual relationship or not in relationship for certain months to give talaq, this i am asking because my wife's relative told to her that i cannot give talaq if we had relationship 
Please guide us.
Jazakallah,