Trust is honesty, so find a suitable occasion and opportunity to tell him your worries and thoughts now. Since it is three years, if you feel that you have not wronged a person, you should continue to be with him, then at least this estrangement that makes you uneasy can't exist at first, otherwise it will be bad for a long time. You know your mental disorder, you'd better solve it yourself and take a wise approach.