Opinions Please!

I've gone over this and over this... still not 100% sure what to do. That's why I'd like your opinions. I know not a ton of people read this, but to those who do I need you to share your insight with me. I might not decide to do what is suggested but it will give me more input and perhaps bring up something I hadn't been seeing in "the big picture".
Here is my dilemma, I know I will be selling Quinn and I have a possible lead on a buyer that I'm not sure if I should take. I'll start with some background.
Quinn is a very good looking guy. He is about 15.3, very solid built, dun (some say buckskin) gelding. White snip on his face, nice head and ears, two hind white socks. He's 12 years old now, a SPB registered APHA. He was supposed to be my new "everything" horse. One I could take barrel racing, trail riding in the forest, ride in the ditches around home, pony off... the one I could trust to do anything with. Physically he is that. He's gorgeous (to me... not perfect but definitely a "hottie" lol) and on the ground we get along great. Here's where the problem comes in, I can't ride him anymore. I literally can't. The last time I tried to ride him (which was almost a year ago) I had a full blown panic attack. Shortness of breathe, shaking, crying. I've NEVER had that happen to me. Not in dealing with horses, work, car accidents, etc. I have had some pretty bad stuff happen to me and I can never remember having a panic attack like that.
Quinn is well trained. He is not what I would call well broke. When I used to ride him it was lovely. He was smooth, responsive, liked to "work". Then we had a few incidents. The first was when he spooked and I got bucked off while warming up for a jackpot. It was my most frightening "unplanned dismount" to date. I got back on, finished warming up and competed in the jackpot. In fact I took him to 5 more jackpots that winter and rode him all winter in an indoor arena. I was at the point that I could ride him in the arena with no problems.
In the spring when we went out to ride the ditches and back roads around "home" I was okay until he started getting really spooky. I was losing my confidence and my nerve. I was still okay in an arena (indoor or outdoor) but didn't feel quite right riding "out". I also was losing trust in him. When he'd stretch his neck or lower it I'd always think "is he getting his head down to buck?!" He never did buck with me again... but it was always in my mind.
Quinn had another incident with a girl who was supposed to be riding him to help keep him legged up. (he needs riding, at least 5 or 6 days a week, more than I had time for with two other horses). She was "training" on him and poorly. I asked her to lay off. She ignored my instructions and had a wreck. (that will be its own post one day!) As a result Quinn was injured and had some time off.
After he had physically mended I started working with a trainer to see if mentally he was okay. She rode him fine. I rode him okay. Again just in the arena for me. Then he got a cut on his leg and was off work until it healed. Once he was healed the trainer and I couldn't get our schedules to match and that was when I tried to ride him and had the panic attack.
Quinn has not been ridden by me in almost a year. I have come to the conclusion that while he could have been "the one" I will not be able to get my confidence/nerve back to ride him. He doesn't necessarily need an advanced rider. He would be fine with an intermediate rider. He likes to work and doesn't pull any tricky or dirty stuff. He needs a rider that has confidence. (sadly that's not me right now) Quinn has been gone for almost a month having miles put on and some tuning up by a girl that barrel races in SBRA with me (also she's having a good CCA season). She's pretty sure he could go on to a good home and that she might be able to help me some in the way of selling him.
Now after all that we get to the nitty gritty... I know I am going to take a loss financially on this horse. I got screwed over big time when I bought him (not really complaining, it was my fault for trusting someone not to screw me). My dilemma is this: I have a potential buyer for him. He would be out riding pasture and working cows. Something Quinn has experience at and enjoys. The guy is said to take good care of his horses. But he doesn't pay a lot of money for them. IF I sell Quinn to him I will be taking an even bigger loss than I had planned. (like getting 30% of what I paid when I was hoping for 50%). So do I sell him to this guy and take the bigger loss. OR do I try to sell to someone else for a better price (still a loss but not so much of one)? Chancing that if he doesn't sell that this guy MIGHT still want to buy him? Don't forget in the meantime I'm either paying a trainer to keep riding him or paying board and trying to suck up the nerve to get back on him to try to keep him somewhat in shape for buyers.
I keep chasing this around in my head and just can't come up with a solution that I feel is right. I feel like there is a piece missing that I'm not seeing. (maybe because I don't want to see it??) Feel free to give me your opinion. Like I said it doesn't mean that I will just blindly follow it. I'm not being asked to be told what to do. I just think that it might clue me in to that missing piece. I need to talk to someone besides myself! I know he is going for sale. He is too young to be a pasture pony. He also needs more exercise than just being a pasture pony (he is the definition of easy keeper!)