Liberty is not an aggregate social project. Every individual has rights. And rights give rise to obligations between all men, including those who are in power. That men band in a collective called 'government' doesn't give them license to violate individual rights.