The group, along with the Chartered Institute of Housing and homeless charity Shelter, all said that the government needs to work harder to cut the cost of housing and deal with issues of overcrowding.
A report drawn up by the groups said that there has been a small increase in the number of new homes being built, which is attributing to fall in affording housing available to buyers.
Kay Boycott from Shelter said, "This government has had two years to start delivering on housing, yet this report paints a pretty bleak picture of its current record on housing in all its forms.
"We must now see progress made on the commitments outlined in November's Housing Strategy and bolder action taken to make sure families across the country can find a decent place to call home."
They added that a cut to housing benefit in 2013 could exacerbate the problem.
This is the first report of this type drawn up since October 2011, in which they take 10 housing problems and rate them with a traffic light system. Evictions, repossessions and arrears category all went from amber to green – a positive move – while mobility has gone from green to amber, with government policy having little to no effect.
Housing Minister Grant Shapps responded to the report by saying, "Far from rents rising, we have seen a real terms fall in private rents and I want to see councils using the powers that they already have to tackle the small minority of rogue landlords.
"I'm sure these housing organisations will welcome our Affordable Homes Programme which is set to exceed expectations and deliver up to 170,000 affordable homes, and a £1.3bn investment to get Britain building."