Brother in law ???????????????????????????

I am newly married for around two months and i have a brother in law who is living with us for around a month.He is younger to my brother and is in college .My husband lost his father when he was young so he the responsible person for the family.I do understand his responsibilities and try never to come between them.Infact i want my brother in law to do higher studies and i don't have any objection if my husband pay for his higher studies and support him because his bro needs his support like a father.But my problem is that my brother in law is always between us.My husband comes from around 8.30 P.M , then he change his clothes , take laptop and sit in his bro room.He and his bro invite me too , to sit with them and i do sit with both of them .But the problem is that my husband remains in that room with his bro uptil 12 o clock , then comes to his bedroom and go to sleep.Though i am in compony of both of them , sit and talk to them but i badly miss a personal interaction with my husband. My husband is a quite person and his bro talks a lot so when we sit togather and whenever i tried to talk to him , his bro always interfere.Infact it's impossible to talk to my hubby in his presence.And whenever we touch each other than also he keeps on watching us.My husband has no objection with it and my hubby keeps on sitting with him.Infact i am irritated now because from the past one month i am desperate for some private moments with him like sitting togather , watching t.v or going out somewhere .In fact now i dont even enjoy being physical with him because of mental distances.Infact once i told my husband to give me some seperate time , than he said what seperate time , you are always with me by my side in the room so what seperate time , why you need that when we are togather.So guys please tell me am i wrong , n why i feel so lonely and frustated even after sitting with both of them and after having chit chat