What’s your party composition? Some class combos work better together. I’d recommend having an herbalist in your party. The party heal is just too good to miss. I’d use her instead of the scholar as your caster. And the Busker is versatile. He makes a good fighter and distraction is great. Also, what level was your party when you entered the first dungeon? Make sure you’re level 2 at a minimum
Here’s a character comparison chart I put together last summer. Note that it may possibly be somewhat out of date now. It doesn’t include the new characters they added.
