Yes, owning fish is more complex (at first) than most people would have thought. In fact, the average life span of all goldfish sold in the United States is only 3 weeks according to one study (while they can natural life span is up to decades) . It is the result of insufficient knowledge and experience on how to properly taking care of the fish.
It is highly recommended not to jump onto getting any pet (not just fish) before doing some extensive research/reading on the subject. Yep, I had to learn it the hard way too many years ago. Just wish there are more people out there spreading the correct knowledge and experience on pet keeping.
By the way, what filter system are you using?
How often and how much water do you change during regular maintenance?