How do I tell my husband that I don't want his brother living with us a anymore?

My husband & I have been living together for over 2years and married for almost a year and this whole time I had to have my husbands brother live with us. I wasn't to keen with it from the beginning but I did it because of my husband. My brother-in-law has been in and out of a job. He just recently got employed. He was fired from both of his previous jobs. My husband is the main bread winner in the house and having some extra income helps us a lot. But latley it seems that his brother isn't making any progress in trying to improve in his life. Our main goal with this whole situation was to give his brother the opportunity to improve himself and give him a chance to save up & eventually move out on his own. I came to the US to uplift in myself 2005 & I just feel that I don't need to be putting up with someone who's got more opportunities than me in this country. Is it wrong of me to feel this way towards the situation. Or is it time that my husbands bro man's up & moves out?