One thing I noticed with cats is that they can easily get startled. If you keep on startling them, they will tend to remember that and they will shy away from you. I have that experience with my 2 cats at first. I would usually park my car beside their cage and when I shut my car door, they will really get startled. When I approach them, they would make a scared sound and avoid me completely. There was even a time that they almost scratched me because they were just so scared. They would always associate me to that loud car door sound that's why they're scared. In other words, to get them to like you, you really need to be very gentle to them. You should be sensitive enough to stop those actions that cause them to get startled. When I noticed that my car door is the reason for their reaction towards me, I moved their cage to a more peaceful location. After doing that, I would usually play with them there and give them treats. Eventually, they started to approach me and when I carry them, I would hear that lovely purring sound which indicates they are happy.