From your description it appears your neighbor is encroaching on your property and violating your rights. As a landowner, you must take action or you risk losing your property or inadvertently granting your neighbor the right to use you property by your acquiesce.
Colorado law allows for legal actions to settle boundary disputes. One common remedy is a "quiet title" action, which aims to determine the rightful owner of the disputed area. The court will review property deeds, surveys, and other evidence to make a ruling.
As I mentioned, it is important to deal with the issue as soon as possible as Colorado has legal theories including prescriptive easements and adverse possession, which are laws to allow your neighbor to own or continue to use your property in certain circumstances.
Review our article "Dealing With Neighbors & Boundary Disputes in Colorado."
These cases are complex, and I highly recommend speaking to one of our real estate partners with experience in these matters. Please call us at (303) 688-0944 or go to our contact us page for more ways to contact us.