That any person who shall, without the permission of the owner and without having any color of title thereto, enter upon the lands of another, and shall refuse to remove therefrom after three days' notice, shall be deemed guilty of unlawful detainer and may be removed from such lands.