I have 10 of both intelligence and charisma right now, a single combat perk, and I'm above level 25. The high intelligence will give you more experience points, so you can quickly start to cover your weaknesses. The charisma is useful for getting extra exp or results from quests. I think you need at least 7 or 8 to get the orange dialog checks and ten to get the red checks. If you are also doing settlement stuff, there are some very useful charisma perks. Local Leader will allow you to connect your settlements, so you can access workbenches more easily, and set up new settlements with your main pool of resources. The first perk in line, that gives you better prices in shops, will eventually allow you to build shops that will put caps back into your pocket. I've been investing into the crafting and utility perks, because if I'm going to do the settlement thing, they're going to be the best around next to Diamond City. Building Water Purifiers should also give you excess purified water in your workshop, which you can use to craft better items (to sell or use).
My Endurance is only like 4, and my strength only 3. I'm only playing on normal, so perhaps that why I'm not having any trouble with the combat. If you're looking to go with a sneaky melee character, then I can understand how my build might not work as well. You'll want ninja, of course, and also the melee skills with strength. I don't feel as though you need that much endurance if you're using stealth primarily, and have a good supply of stims and med-x. You should also be crafting food, because it's really good in this game now. Charisma can also help in this build, because it has a perk that can DOUBLE the effects of alcohol, and make it so you don't get addicted. That's a solid boost to strength for combat. If you're into chems, then the appropriate perk in intelligence will also allow you to get a massive boost off of chems for damage and endurance as well. You can craft enhanced versions of buffout and psycho that will give you 3 strength each (I think they stack). Tie all of that together, and you'll have plenty of strength for hairy battles, some endurance to boot, extra damage resistance, and be an all around Greyfox.
As far as stealth is concerned, there's a chest piece in the game that gives you a kind of gimped stealth boy while still and crouched. There's also armor mods also make you harder to see in dark areas, and leg pieces have a muffled modifier that makes you less noisy while moving. The other armor has lightweight modifiers that give you extra AP too, and decreases the item weight. The problem is that you'll need like 3 in armor to craft that stuff, but as you level you'll find it all out in the wild anyway.
If you're doing settlement shit, and want to do it very well, then your combat skill will take a back seat. If you don't care about that, then you have more room to pump points into agility, strength and the associated perks. Regardless keep the high intelligence. If you want to unlock the extra dialog and get bonus exp (around 26), then you'll want that high charisma too (also can be boosted through chems, equipment and whatnot).