I have the potential to be a great writer, but is it worth it?

Being a writer takes dedication. You need to really love this in order to succeed! Also, a writer's workshop could be helpful. You shouldn't feel intimidated about other books, their will always be someone who will write a better book than you. Always pick up the pieces and try again. You only fail if you don't try. :) Good luck, I hope you can write a book that you are proud of.