I have 5 kids and I fear being rejected, do I tell this guy I love him?

I'm 32 and the guy I've been seeing is 29. I've been seeing him for about a year, the relationship we have is a friendship/sexual one. He's a really great guy and I think I'm in love with him. Problem is I was previously married and I have 5 kids (i know that's a lot) anyhow, he has no kids and has never been married so I know the idea of being with someone that has so much responsibility would be a lot for anyone. I don't really know how he feels about me because I never ask questions like that and I've been keeping my distance from him emotionally because i'm afraid of being rejected. I have come to a point were I am thinking about ending the relationship that we have because I want more than what I'm receiving, should I tell him I love him or just end it?